Audio and Speech Processing

Authors and titles for June 2023

[176] arXiv:2306.00789 (cross-list from cs.CL) [pdf, html, other]

Title: Improved Cross-Lingual Transfer Learning For Automatic Speech Translation

Sameer Khurana, Nauman Dawalatabad, Antoine Laurent, Luis Vicente, Pablo Gimeno, Victoria Mingote, James Glass

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[177] arXiv:2306.00794 (cross-list from cs.SD) [pdf, other]

Title: SlothSpeech: Denial-of-service Attack Against Speech Recognition Models

Mirazul Haque, Rutvij Shah, Simin Chen, Berrak Şişman, Cong Liu, Wei Yang

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[178] arXiv:2306.00804 (cross-list from cs.SD) [pdf, other]

Title: Adaptive Contextual Biasing for Transducer Based Streaming Speech Recognition

Tianyi Xu, Zhanheng Yang, Kaixun Huang, Pengcheng Guo, Ao Zhang, Biao Li, Changru Chen, Chao Li, Lei Xie

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[179] arXiv:2306.00814 (cross-list from cs.SD) [pdf, html, other]

Title: Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis

Hubert Siuzdak

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[180] arXiv:2306.00830 (cross-list from cs.SD) [pdf, other]

Title: Adapting a ConvNeXt model to audio classification on AudioSet

Thomas Pellegrini, Ismail Khalfaoui-Hassani, Etienne Labbé, Timothée Masquelier

Comments: Accepted at INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[181] arXiv:2306.00860 (cross-list from cs.SD) [pdf, other]

Title: Differentiable Allpass Filters for Phase Response Estimation and Automatic Signal Alignment

Anders R. Bargum, Stefania Serafin, Cumhur Erkut, Julian D. Parker

Comments: Collaboration done while interning/employed at Native Instruments. Accepted for publication in Proc. DAFX'23, Copenhagen, Denmark, September 2023. Sound examples at this https URL v2: 10 pages, LaTeX; figures resized, pdf optimized

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[182] arXiv:2306.01015 (cross-list from cs.CL) [pdf, html, other]

Title: How to Estimate Model Transferability of Pre-Trained Speech Models?

Zih-Ching Chen, Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Shuo-Yiin Chang, Rohit Prabhavalkar, Hung-yi Lee, Tara N. Sainath

Comments: Accepted to Interspeech. Code is available at: this https URL. Fixed a typo

Subjects: Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[183] arXiv:2306.01031 (cross-list from cs.CL) [pdf, other]

Title: Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcripts

Dongji Gao, Matthew Wiesner, Hainan Xu, Leibny Paola Garcia, Daniel Povey, Sanjeev Khudanpur

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[184] arXiv:2306.01084 (cross-list from cs.SD) [pdf, other]

Title: Exploration on HuBERT with Multiple Resolutions

Jiatong Shi, Yun Tang, Hirofumi Inaguma, Hongyu GOng, Juan Pino, Shinji Watanabe

Comments: Accepted to Interspeech2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[185] arXiv:2306.01201 (cross-list from cs.CL) [pdf, other]

Title: Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models

Liam Dugan, Anshul Wadhawan, Kyle Spence, Chris Callison-Burch, Morgan McGuire, Victor Zordan

Comments: To appear at INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[186] arXiv:2306.01303 (cross-list from cs.CL) [pdf, other]

Title: DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model

Haoyu Wang, Siyuan Wang, Wei-Qiang Zhang, Jinfeng Bai

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[187] arXiv:2306.01304 (cross-list from cs.SD) [pdf, other]

Title: JEPOO: Highly Accurate Joint Estimation of Pitch, Onset and Offset for Music Information Retrieval

Haojie Wei, Jun Yuan, Rui Zhang, Yueguo Chen, Gang Wang

Comments: This paper has been accepted by IJCAI 2023; 11 pages, 6 figures

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[188] arXiv:2306.01327 (cross-list from cs.CL) [pdf, other]

Title: Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23

Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa, Marta R. Costa-jussà

Comments: IWSLT 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[189] arXiv:2306.01428 (cross-list from cs.SD) [pdf, other]

Title: Improved DeepFake Detection Using Whisper Features

Piotr Kawa, Marcin Plata, Michał Czuba, Piotr Szymański, Piotr Syga

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[190] arXiv:2306.01442 (cross-list from cs.SD) [pdf, other]

Title: Towards Robust FastSpeech 2 by Modelling Residual Multimodality

Fabian Kögel, Bac Nguyen, Fabien Cardinaux

Comments: Accepted at INTERSPEECH 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[191] arXiv:2306.01506 (cross-list from cs.CL) [pdf, other]

Title: BabySLM: language-acquisition-friendly benchmark of self-supervised spoken language models

Marvin Lavechin, Yaya Sy, Hadrien Titeux, María Andrea Cruz Blandón, Okko Räsänen, Hervé Bredin, Emmanuel Dupoux, Alejandrina Cristia

Comments: Proceedings of Interspeech 2023

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[192] arXiv:2306.01533 (cross-list from cs.SD) [pdf, html, other]

Title: Enhance Temporal Relations in Audio Captioning with Sound Event Detection

Zeyu Xie, Xuenan Xu, Mengyue Wu, Kai Yu

Comments: Interspeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[193] arXiv:2306.01635 (cross-list from cs.SD) [pdf, other]

Title: Q&A: Query-Based Representation Learning for Multi-Track Symbolic Music re-Arrangement

Jingwei Zhao, Gus Xia, Ye Wang

Comments: Accepted by IJCAI 2023 Special Track for AI the Arts and Creativity

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[194] arXiv:2306.01789 (cross-list from cs.SD) [pdf, other]

Title: Edit Distance based RL for RNNT decoding

Dongseong Hwang, Changwan Ryu, Khe Chai Sim

Comments: 5 pages, 2 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[195] arXiv:2306.01845 (cross-list from cs.SD) [pdf, other]

Title: Multi-View Multi-Task Representation Learning for Mispronunciation Detection

Yassine El Kheir, Shammur Absar Chowdhury, Ahmed Ali

Comments: 5 pages, Accepted SLaTE23

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[196] arXiv:2306.01864 (cross-list from cs.LG) [pdf, other]

Title: Discovering COVID-19 Coughing and Breathing Patterns from Unlabeled Data Using Contrastive Learning with Varying Pre-Training Domains

Jinjin Cai, Sudip Vhaduri, Xiao Luo

Comments: Accepted by Proceedings of INTERSPEECH 2023

Journal-ref: Proceedings of INTERSPEECH 2023

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[197] arXiv:2306.01942 (cross-list from cs.CL) [pdf, other]

Title: Can Contextual Biasing Remain Effective with Whisper and GPT-2?

Guangzhi Sun, Xianrui Zheng, Chao Zhang, Philip C. Woodland

Comments: To appear in Interspeech 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[198] arXiv:2306.01974 (cross-list from cs.SD) [pdf, other]

Title: BEDRF: Bidirectional Edge Diffraction Response Function for Interactive Sound Propagation

Chunxiao Cao, Zili An, Zhong Ren, Dinesh Manocha, Kun Zhou

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[199] arXiv:2306.02105 (cross-list from cs.CL) [pdf, html, other]

Title: Advancing African-Accented Speech Recognition: Epistemic Uncertainty-Driven Data Selection for Generalizable ASR Models

Bonaventure F. P. Dossou

Comments: Preprint Under review. Previously accepted at SIGUL-LREC 2024 Workshop

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[200] arXiv:2306.02153 (cross-list from cs.CL) [pdf, other]

Title: Acoustic Word Embeddings for Untranscribed Target Languages with Continued Pretraining and Learned Pooling

Ramon Sanabria, Ondrej Klejch, Hao Tang, Sharon Goldwater

Comments: Accepted to Interspeech 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)