Sound

Authors and titles for June 2023

[151] arXiv:2306.01015 (cross-list from cs.CL) [pdf, html, other]

Title: How to Estimate Model Transferability of Pre-Trained Speech Models?

Zih-Ching Chen, Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Shuo-Yiin Chang, Rohit Prabhavalkar, Hung-yi Lee, Tara N. Sainath

Comments: Accepted to Interspeech. Code is available at: this https URL. Fixed a typo

Subjects: Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[152] arXiv:2306.01031 (cross-list from cs.CL) [pdf, other]

Title: Bypass Temporal Classification: Weakly Supervised Automatic Speech Recognition with Imperfect Transcripts

Dongji Gao, Matthew Wiesner, Hainan Xu, Leibny Paola Garcia, Daniel Povey, Sanjeev Khudanpur

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[153] arXiv:2306.01100 (cross-list from eess.AS) [pdf, other]

Title: ALO-VC: Any-to-any Low-latency One-shot Voice Conversion

Bohan Wang, Damien Ronssin, Milos Cernak

Comments: Accepted to Interspeech 2023. Some audio samples are available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[154] arXiv:2306.01201 (cross-list from cs.CL) [pdf, other]

Title: Learning When to Speak: Latency and Quality Trade-offs for Simultaneous Speech-to-Speech Translation with Offline Models

Liam Dugan, Anshul Wadhawan, Kyle Spence, Chris Callison-Burch, Morgan McGuire, Victor Zordan

Comments: To appear at INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[155] arXiv:2306.01208 (cross-list from eess.AS) [pdf, other]

Title: Adapting an Unadaptable ASR System

Rao Ma, Mengjie Qian, Mark J. F. Gales, Kate M. Knill

Comments: Proceedings of INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[156] arXiv:2306.01303 (cross-list from cs.CL) [pdf, other]

Title: DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model

Haoyu Wang, Siyuan Wang, Wei-Qiang Zhang, Jinfeng Bai

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[157] arXiv:2306.01327 (cross-list from cs.CL) [pdf, other]

Title: Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23

Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa, Marta R. Costa-jussà

Comments: IWSLT 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[158] arXiv:2306.01332 (cross-list from eess.AS) [pdf, other]

Title: Differentiable Grey-box Modelling of Phaser Effects using Frame-based Spectral Processing

Alistair Carson, Cassia Valentini-Botinhao, Simon King, Stefan Bilbao

Comments: Accepted for publication in Proc. DAFx23, Copenhagen, Denmark, September 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[159] arXiv:2306.01385 (cross-list from eess.AS) [pdf, other]

Title: Task-Agnostic Structured Pruning of Speech Representation Models

Haoyu Wang, Siyuan Wang, Wei-Qiang Zhang, Hongbin Suo, Yulong Wan

Comments: Accepted by INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[160] arXiv:2306.01411 (cross-list from eess.AS) [pdf, other]

Title: HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders

Doyeon Kim, Soo-Whan Chung, Hyewon Han, Youna Ji, Hong-Goo Kang

Comments: Accepted by INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[161] arXiv:2306.01433 (cross-list from eess.AS) [pdf, html, other]

Title: Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach

Eloi Moliner, Filip Elvander, Vesa Välimäki

Comments: Submitted to IEEE/ACM Transactions on Audio, Speech and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[162] arXiv:2306.01522 (cross-list from eess.AS) [pdf, other]

Title: Auditory Representation Effective for Estimating Vocal Tract Information

Toshio Irino, Shintaro Doan

Comments: This manuscript is a revised version after acceptance for publication in Proc. APSIPA ASC 2023 on August 25, 2023

Journal-ref: Proc. APSIPA ASC 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[163] arXiv:2306.01864 (cross-list from cs.LG) [pdf, other]

Title: Discovering COVID-19 Coughing and Breathing Patterns from Unlabeled Data Using Contrastive Learning with Varying Pre-Training Domains

Jinjin Cai, Sudip Vhaduri, Xiao Luo

Comments: Accepted by Proceedings of INTERSPEECH 2023

Journal-ref: Proceedings of INTERSPEECH 2023

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2306.01942 (cross-list from cs.CL) [pdf, other]

Title: Can Contextual Biasing Remain Effective with Whisper and GPT-2?

Guangzhi Sun, Xianrui Zheng, Chao Zhang, Philip C. Woodland

Comments: To appear in Interspeech 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[165] arXiv:2306.02105 (cross-list from cs.CL) [pdf, html, other]

Title: Advancing African-Accented Speech Recognition: Epistemic Uncertainty-Driven Data Selection for Generalizable ASR Models

Bonaventure F. P. Dossou

Comments: Preprint Under review. Previously accepted at SIGUL-LREC 2024 Workshop

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[166] arXiv:2306.02153 (cross-list from cs.CL) [pdf, other]

Title: Acoustic Word Embeddings for Untranscribed Target Languages with Continued Pretraining and Learned Pooling

Ramon Sanabria, Ondrej Klejch, Hao Tang, Sharon Goldwater

Comments: Accepted to Interspeech 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[167] arXiv:2306.02273 (cross-list from cs.CL) [pdf, other]

Title: End-to-End Joint Target and Non-Target Speakers ASR

Ryo Masumura, Naoki Makishima, Taiga Yamane, Yoshihiko Yamazaki, Saki Mizuno, Mana Ihori, Mihiro Uchida, Keita Suzuki, Hiroshi Sato, Tomohiro Tanaka, Akihiko Takashima, Satoshi Suzuki, Takafumi Moriya, Nobukatsu Hojo, Atsushi Ando

Comments: Accepted at Interspeech 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[168] arXiv:2306.02317 (cross-list from cs.CL) [pdf, other]

Title: SpellMapper: A non-autoregressive neural spellchecker for ASR customization with candidate retrieval based on n-gram mappings

Alexandra Antonova, Evelina Bakhturina, Boris Ginsburg

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2306.02534 (cross-list from cs.CL) [pdf, other]

Title: Incorporating L2 Phonemes Using Articulatory Features for Robust Speech Recognition

Jisung Wang, Haram Lee, Myungwoo Oh

Comments: Accepted at INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2306.02579 (cross-list from cs.CL) [pdf, other]

Title: Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model

Hoyeon Lee, Hyun-Wook Yoon, Jong-Hwan Kim, Jae-Min Kim

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[171] arXiv:2306.02680 (cross-list from cs.CL) [pdf, other]

Title: BeAts: Bengali Speech Acts Recognition using Multimodal Attention Fusion

Ahana Deb, Sayan Nag, Ayan Mahapatra, Soumitri Chattopadhyay, Aritra Marik, Pijush Kanti Gayen, Shankha Sanyal, Archi Banerjee, Samir Karmakar

Comments: Accepted at INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[172] arXiv:2306.02719 (cross-list from cs.CL) [pdf, html, other]

Title: Multiple output samples per input in a single-output Gaussian process

Jeremy H. M. Wong, Huayun Zhang, Nancy F. Chen

Comments: This paper is presented in the "Symposium for Celebrating 40 Years of Bayesian Learning in Speech and Language Processing and Beyond", which is a satellite event of the ASRU workshop, on 20 December 2023. this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2306.02858 (cross-list from cs.CL) [pdf, other]

Title: Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Hang Zhang, Xin Li, Lidong Bing

Comments: Accepted by EMNLP 2023's demo track; Code, Pretrained Model, and Dataset: this https URL

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[174] arXiv:2306.02902 (cross-list from cs.CL) [pdf, other]

Title: N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognition

Bashar Talafha, Abdul Waheed, Muhammad Abdul-Mageed

Comments: 4 pages, INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2306.03014 (cross-list from eess.AS) [pdf, other]

Title: On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings

Danilo de Oliveira, Julius Richter, Jean-Marie Lemercier, Tal Peer, Timo Gerkmann

Comments: Submitted to ITG Conference on Speech Communication

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)