Audio and Speech Processing

Authors and titles for February 2024

[1] arXiv:2402.00067 [pdf, html, other]

Title: Online speaker diarization of meetings guided by speech separation

Elio Gruttadauria (IP Paris, LTCI, IDS, S2A), Mathieu Fontaine (LTCI, IP Paris), Slim Essid (IDS, S2A, LTCI)

Comments: Accepted at ICASSP 2024

Journal-ref: IEEE International Conference on Acoustics, Speech, and Signal Processing, Apr 2024, Seoul (Korea), South Korea

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[2] arXiv:2402.00282 [pdf, html, other]

Title: PAM: Prompting Audio-Language Models for Audio Quality Assessment

Soham Deshmukh, Dareen Alharthi, Benjamin Elizalde, Hannes Gamper, Mahmoud Al Ismail, Rita Singh, Bhiksha Raj, Huaming Wang

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[3] arXiv:2402.00288 [pdf, html, other]

Title: Frame-Wise Breath Detection with Self-Training: An Exploration of Enhancing Breath Naturalness in Text-to-Speech

Dong Yang, Tomoki Koriyama, Yuki Saito

Comments: Accepted by INTERSPEECH2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[4] arXiv:2402.00337 [pdf, html, other]

Title: Real-time Stereo Speech Enhancement with Spatial-Cue Preservation based on Dual-Path Structure

Masahito Togami, Jean-Marc Valin, Karim Helwani, Ritwik Giri, Umut Isik, Michael M. Goodwin

Comments: Accepted for ICASSP 2024, 5 pages

Subjects: Audio and Speech Processing (eess.AS)

[5] arXiv:2402.00811 [pdf, html, other]

Title: An Analysis of the Variance of Diffusion-based Speech Enhancement

Bunlong Lay, Timo Gerkmann

Comments: 5 pages, 3 figures, 1 table

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[6] arXiv:2402.00820 [pdf, html, other]

Title: USDnet: Unsupervised Speech Dereverberation via Neural Forward Filtering

Zhong-Qiu Wang

Comments: in IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[7] arXiv:2402.00828 [pdf, html, other]

Title: Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters

Umberto Cappellazzo, Daniele Falavigna, Alessio Brutti

Comments: Accepted at INTERSPEECH 2024. The code is publicly available at: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[8] arXiv:2402.00859 [pdf, other]

Title: Deep Room Impulse Response Completion

Jackie Lin, Georg Götz, Sebastian J. Schlecht

Comments: The following article has been submitted to the EURASIP Journal on Audio, Speech, and Music Processing

Subjects: Audio and Speech Processing (eess.AS)

[9] arXiv:2402.01271 [pdf, other]

Title: An Intra-BRNN and GB-RVQ Based END-TO-END Neural Audio Codec

Linping Xu, Jiawei Jiang, Dejun Zhang, Xianjun Xia, Li Chen, Yijian Xiao, Piao Ding, Shenyi Song, Sixing Yin, Ferdous Sohel

Comments: INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[10] arXiv:2402.01298 [pdf, html, other]

Title: Learning Semantic Information from Raw Audio Signal Using Both Contextual and Phonetic Representations

Jaeyeon Kim, Injune Hwang, Kyogu Lee

Comments: Accepted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[11] arXiv:2402.01385 [pdf, other]

Title: Del Visual al Auditivo: Sonorizaci\'on de Escenas Guiada por Imagen

María Sánchez, Laura Fernández, Julián Arias, Mateo Cámara, Giulia Comini, Adam Gabrys, José Luis Blanco, Juan Ignacio Godino, Luis Alfonso Hernández

Comments: 10 pages, in Spanish, Tecniacústica

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[12] arXiv:2402.01579 [pdf, html, other]

Title: Are Paralinguistic Representations all that is needed for Speech Emotion Recognition?

Orchid Chetia Phukan, Gautam Siddharth Kashyap, Arun Balaji Buduru, Rajesh Sharma

Comments: Accepted to INTERSPEECH 24

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[13] arXiv:2402.01591 [pdf, html, other]

Title: BAT: Learning to Reason about Spatial Sounds with Large Language Models

Zhisheng Zheng, Puyuan Peng, Ziyang Ma, Xie Chen, Eunsol Choi, David Harwath

Comments: Accepted to ICML 2024. Our demo, dataset, code and model weights are available at: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[14] arXiv:2402.01752 [pdf, other]

Title: Identifying False Content and Hate Speech in Sinhala YouTube Videos by Analyzing the Audio

W. A. K. M. Wickramaarachchi, Sameeri Sathsara Subasinghe, K. K. Rashani Tharushika Wijerathna, A. Sahashra Udani Athukorala, Lakmini Abeywardhana, A. Karunasena

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[15] arXiv:2402.01778 [pdf, html, other]

Title: Introduction to speech recognition

Gabriel Dauphin

Comments: in French language

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[16] arXiv:2402.01796 [pdf, html, other]

Title: Speech foundation models in healthcare: Effect of layer selection on pathological speech feature prediction

Daniela A. Wiepert, Rene L. Utianski, Joseph R. Duffy, John L. Stricker, Leland R. Barnard, David T. Jones, Hugo Botha

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[17] arXiv:2402.01933 [pdf, html, other]

Title: ToMoBrush: Exploring Dental Health Sensing using a Sonic Toothbrush

Kuang Yuan, Mohamed Ibrahim, Yiwen Song, Guoxiang Deng, Suvendra Vijayan, Robert Nerone, Akshay Gadre, Swarun Kumar

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[18] arXiv:2402.02302 [pdf, other]

Title: Predicting positive transfer for improved low-resource speech recognition using acoustic pseudo-tokens

Nay San, Georgios Paraskevopoulos, Aryaman Arora, Xiluo He, Prabhjot Kaur, Oliver Adams, Dan Jurafsky

Comments: Accepted for SIGTYP2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[19] arXiv:2402.02694 [pdf, html, other]

Title: Description on IEEE ICME 2024 Grand Challenge: Semi-supervised Acoustic Scene Classification under Domain Shift

Jisheng Bai, Mou Wang, Haohe Liu, Han Yin, Yafei Jia, Siwei Huang, Yutong Du, Dongzhe Zhang, Dongyuan Shi, Woon-Seng Gan, Mark D. Plumbley, Susanto Rahardja, Bin Xiang, Jianfeng Chen

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[20] arXiv:2402.02830 [pdf, other]

Title: Automatic Detection of Depression in Speech Using Ensemble Convolutional Neural Networks

Adrián Vázquez-Romero, Ascensión Gallardo-Antolín

Journal-ref: A. Vazquez-Romero and A. Gallardo-Antolin Entropy 22, no. 6: 688 (2020)

Subjects: Audio and Speech Processing (eess.AS)

[21] arXiv:2402.02850 [pdf, other]

Title: An Attention Long Short-Term Memory based system for automatic classification of speech intelligibility

Miguel Fernández-Díaz, Ascensión Gallardo-Antolín

Journal-ref: Miguel Fernandez-Diaz and Ascension Gallardo-Antolin Engineering Applications of Artificial Intelligence 96 (2020) 103976

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[22] arXiv:2402.02865 [pdf, other]

Title: On combining acoustic and modulation spectrograms in an attention LSTM-based system for speech intelligibility level classification

Ascensión Gallardo-Antolín, Juan M. Montero

Journal-ref: Ascension Gallardo-Antolin and Juan M. Montero Neurocomputing 456 (2021) 49-60

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[23] arXiv:2402.02899 [pdf, html, other]

Title: Positive and negative sampling strategies for self-supervised learning on audio-video data

Shanshan Wang, Soumya Tripathy, Toni Heittola, Annamaria Mesaros

Subjects: Audio and Speech Processing (eess.AS)

[24] arXiv:2402.03058 [pdf, html, other]

Title: Array Geometry-Robust Attention-Based Neural Beamformer for Moving Speakers

Marvin Tammen, Tsubasa Ochiai, Marc Delcroix, Tomohiro Nakatani, Shoko Araki, Simon Doclo

Comments: accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[25] arXiv:2402.03369 [pdf, other]

Title: Evaluation of Google's Voice Recognition and Sentence Classification for Health Care Applications

Majbah Uddin, Nathan Huynh, Jose M Vidal, Kevin M Taaffe, Lawrence D Fredendall, Joel S Greenstein

Journal-ref: Engineering Management Journal, 27:3, 152-162, 2015

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[26] arXiv:2402.03407 [pdf, html, other]

Title: Enhancing the Stability of LLM-based Speech Generation Systems through Self-Supervised Representations

Álvaro Martín-Cortinas, Daniel Sáez-Trigueros, Iván Vallés-Pérez, Biel Tura-Vecino, Piotr Biliński, Mateusz Lajszczak, Grzegorz Beringer, Roberto Barra-Chicote, Jaime Lorenzo-Trueba

Comments: 10 pages, 1 figure, 3 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[27] arXiv:2402.03710 [pdf, other]

Title: Listen, Chat, and Edit: Text-Guided Soundscape Modification for Enhanced Auditory Experience

Xilin Jiang, Cong Han, Yinghao Aaron Li, Nima Mesgarani

Comments: preprint

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[28] arXiv:2402.03988 [pdf, html, other]

Title: REBORN: Reinforcement-Learned Boundary Segmentation with Iterative Training for Unsupervised ASR

Liang-Hsuan Tseng, En-Pei Hu, Cheng-Han Chiang, Yuan Tseng, Hung-yi Lee, Lin-shan Lee, Shao-Hua Sun

Comments: NeurIPS 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[29] arXiv:2402.04254 [pdf, other]

Title: Large Vocabulary Spontaneous Speech Recognition for Tigrigna

Ataklti Kahsu, Solomon Teferra

Comments: 15 pages, 1 figures

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[30] arXiv:2402.04805 [pdf, other]

Title: Progressive unsupervised domain adaptation for ASR using ensemble models and multi-stage training

Rehan Ahmad, Muhammad Umar Farooq, Thomas Hain

Subjects: Audio and Speech Processing (eess.AS)

[31] arXiv:2402.04866 [pdf, html, other]

Title: Room Transfer Function Reconstruction Using Complex-valued Neural Networks and Irregularly Distributed Microphones

Francesca Ronchini, Luca Comanducci, Mirco Pezzoli, Fabio Antonacci, Augusto Sarti

Comments: Accepted at EUSIPCO 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[32] arXiv:2402.05819 [pdf, other]

Title: Integrating Self-supervised Speech Model with Pseudo Word-level Targets from Visually-grounded Speech Model

Hung-Chieh Fang, Nai-Xuan Ye, Yi-Jen Shih, Puyuan Peng, Hsuan-Fu Wang, Layne Berry, Hung-yi Lee, David Harwath

Comments: Accepted to ICASSP 2024 workshop on Self-supervision in Audio, Speech, and Beyond (SASB)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[33] arXiv:2402.06246 [pdf, html, other]

Title: Data-driven Joint Detection and Localization of Acoustic Reflectors

H. Nazim Bicer, Cagdas Tuna, Andreas Walther, Emanuël A. P. Habets

Comments: 4+1(bib) Pages. Accepted to ICASSP Satellite Workshop - HSCMA 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[34] arXiv:2402.06387 [pdf, html, other]

Title: A Transversal Study of Fundamental Frequency Contours in Parkinsonian Voices

Pablo Rodriguez-Perez, Ruben Fraile, Miguel Garcia-Escrig, Nicolas Saenz-Lechon, Juana M. Gutierrez-Arriola, Victor Osma-Ruiz

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[35] arXiv:2402.06683 [pdf, html, other]

Title: Sound Source Separation Using Latent Variational Block-Wise Disentanglement

Karim Helwani, Masahito Togami, Paris Smaragdis, Michael M. Goodwin

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[36] arXiv:2402.06888 [pdf, html, other]

Title: Analysis of Self-Supervised Speech Models on Children's Speech and Infant Vocalizations

Jialu Li, Mark Hasegawa-Johnson, Nancy L. McElwain

Comments: Accepted to 2024 ICASSP Workshop of Self-supervision in Audio, Speech and Beyond (SASB)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[37] arXiv:2402.06923 [pdf, html, other]

Title: CochCeps-Augment: A Novel Self-Supervised Contrastive Learning Using Cochlear Cepstrum-based Masking for Speech Emotion Recognition

Ioannis Ziogas, Hessa Alfalahi, Ahsan H. Khandoker, Leontios J. Hadjileontiadis

Comments: 5 pages, 1 figure Accepted in IEEE ICASSP 2024 Workshops - Self-Supervision in Audio, Speech, and Beyond

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP); Machine Learning (stat.ML)

[38] arXiv:2402.07383 [pdf, html, other]

Title: Making Flow-Matching-Based Zero-Shot Text-to-Speech Laugh as You Like

Naoyuki Kanda, Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Yufei Xia, Jinzhu Li, Yanqing Liu, Sheng Zhao, Michael Zeng

Comments: See this https URL for demo samples, v2: subjective evaluation has been added

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[39] arXiv:2402.07599 [pdf, other]

Title: Interactive singing melody extraction based on active adaptation

Kavya Ranjan Saxena, Vipul Arora

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[40] arXiv:2402.07729 [pdf, html, other]

Title: AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension

Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou

Comments: Code and Data: this https URL. Accepted by ACL 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[41] arXiv:2402.08252 [pdf, html, other]

Title: Unrestricted Global Phase Bias-Aware Single-channel Speech Enhancement with Conformer-based Metric GAN

Shiqi Zhang, Zheng Qiu, Daiki Takeuchi, Noboru Harada, Shoji Makino

Comments: Accepted by ICASSP 2024 Updated on 2024/06/04 to add one more citation in appendix

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[42] arXiv:2402.08312 [pdf, other]

Title: Channel-Combination Algorithms for Robust Distant Voice Activity and Overlapped Speech Detection

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas

Comments: 14 pages, 5 figures, accepted at IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[43] arXiv:2402.08789 [pdf, html, other]

Title: Leveraging cough sounds to optimize chest x-ray usage in low-resource settings

Alexander Philip, Sanya Chawla, Lola Jover, George P. Kafentzis, Joe Brew, Vishakh Saraf, Shibu Vijayan, Peter Small, Carlos Chaccour

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

[44] arXiv:2402.08898 [pdf, html, other]

Title: UniEnc-CASSNAT: An Encoder-only Non-autoregressive ASR for Speech SSL Models

Ruchao Fan, Natarajan Balaji Shanka, Abeer Alwan

Comments: Published in IEEE Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[45] arXiv:2402.08904 [pdf, html, other]

Title: Sound Field Reconstruction Using a Compact Acoustics-informed Neural Network

Fei Ma, Sipei Zhao, Ian S. Burnett

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[46] arXiv:2402.08932 [pdf, other]

Title: Listening to Multi-talker Conversations: Modular and End-to-end Perspectives

Desh Raj

Comments: Ph.D. dissertation

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[47] arXiv:2402.09245 [pdf, html, other]

Title: Overview of the L3DAS23 Challenge on Audio-Visual Extended Reality

Christian Marinoni, Riccardo Fosco Gramaccioni, Changan Chen, Aurelio Uncini, Danilo Comminiello

Comments: Accepted to 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Signal Processing (eess.SP)

[48] arXiv:2402.09313 [pdf, html, other]

Title: Mixture to Mixture: Leveraging Close-talk Mixtures as Weak-supervision for Speech Separation

Zhong-Qiu Wang

Comments: in IEEE Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[49] arXiv:2402.09378 [pdf, html, other]

Title: MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech

Shengpeng Ji, Ziyue Jiang, Hanting Wang, Jialong Zuo, Zhou Zhao

Comments: Accepted by ACL 2024 (Main Conference)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[50] arXiv:2402.09821 [pdf, html, other]

Title: Diffusion Models for Audio Restoration

Jean-Marie Lemercier, Julius Richter, Simon Welker, Eloi Moliner, Vesa Välimäki, Timo Gerkmann

Comments: Currently in revision for IEEE Signal Processing Magazine Special Issue "Model-based and Data-Driven Audio Signal Processing"

Journal-ref: IEEE Signal Processing Magazine, Jan 2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)