Audio and Speech Processing

Authors and titles for recent submissions

• Thu, 6 Feb 2025
• Wed, 5 Feb 2025
• Tue, 4 Feb 2025
• Mon, 3 Feb 2025
• Fri, 31 Jan 2025

See today's new changes

Wed, 5 Feb 2025 (showing 9 of 9 entries )

[11] arXiv:2502.02366 [pdf, other]

Title: Self-Supervised Convolutional Audio Models are Flexible Acoustic Feature Learners: A Domain Specificity and Transfer-Learning Study

Mattson Ogg

Subjects: Audio and Speech Processing (eess.AS)

[12] arXiv:2502.02019 [pdf, html, other]

Title: ComplexDec: A Domain-robust High-fidelity Neural Audio Codec with Complex Spectrum Modeling

Yi-Chiao Wu, Dejan Marković, Steven Krenn, Israel D. Gebru, Alexander Richard

Comments: 5 pages, 2 figures, 2 tables. Proc. ICASSP, 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[13] arXiv:2502.01649 [pdf, other]

Title: Privacy-Preserving Edge Speech Understanding with Tiny Foundation Models

Afsara Benazir, Felix Xiaozhu Lin

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[14] arXiv:2502.02424 (cross-list from cs.SD) [pdf, html, other]

Title: Pruning-aware Loss Functions for STOI-Optimized Pruned Recurrent Autoencoders for the Compression of the Stimulation Patterns of Cochlear Implants at Zero Delay

Reemt Hinrichs, Jörn Ostermann

Comments: Preprint of Asilomar 2024 Paper

Journal-ref: Proceedings of Asilomar 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[15] arXiv:2502.02138 (cross-list from cs.SD) [pdf, html, other]

Title: Investigation of perceptual music similarity focusing on each instrumental part

Yuka Hashizume, Tomoki Toda

Comments: Accepted ICASSP 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[16] arXiv:2502.02051 (cross-list from cs.RO) [pdf, html, other]

Title: Sound Judgment: Properties of Consequential Sounds Affecting Human-Perception of Robots

Aimee Allen (1), Tom Drummond (2), Dana Kulić (1) ((1) Monash University - Australia, (2) University of Melbourne - Australia)

Comments: 9 pages, 6 figures - Accepted to be published in the conference proceedings for HRI'25 - the 20th IEEE/ACM International Conference on Human-Robot Interaction. This paper has a companion paper: arXiv:2406.02938 Copyright 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media

Subjects: Robotics (cs.RO); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[17] arXiv:2502.01777 (cross-list from cs.LG) [pdf, html, other]

Title: CTC-DRO: Robust Optimization for Reducing Language Disparities in Speech Recognition

Martijn Bartelds, Ananjan Nandi, Moussa Koulako Bala Doumbouya, Dan Jurafsky, Tatsunori Hashimoto, Karen Livescu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[18] arXiv:2502.01709 (cross-list from cs.SD) [pdf, html, other]

Title: Adapter-Based Multi-Agent AVSR Extension for Pre-Trained ASR Models

Christopher Simic, Korbinian Riedhammer, Tobias Bocklet

Comments: Accepted at ICASSP 2025

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[19] arXiv:2502.01685 (cross-list from cs.AI) [pdf, html, other]

Title: Automated Extraction of Spatio-Semantic Graphs for Identifying Cognitive Impairment

Si-Ioi Ng, Pranav S. Ambadi, Kimberly D. Mueller, Julie Liss, Visar Berisha

Comments: To appear in ICASSP 2025

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Tue, 4 Feb 2025 (showing 20 of 20 entries )

[20] arXiv:2502.01547 [pdf, html, other]

Title: mWhisper-Flamingo for Multilingual Audio-Visual Noise-Robust Speech Recognition

Andrew Rouditchenko, Saurabhchand Bhati, Samuel Thomas, Hilde Kuehne, Rogerio Feris, James Glass

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

[21] arXiv:2502.00565 [pdf, html, other]

Title: Do neonates hear what we measure? Assessing neonatal ward soundscapes at the neonates ears

Bhan Lam, Peijin Esther Monica Fan, Yih Yann Tay, Woei Bing Poon, Zhen-Ting Ong, Kenneth Ooi, Woon-Seng Gan, Shin Yuh Ang

Comments: Accepted manuscript submitted to Building and Environment

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[22] arXiv:2502.00295 [pdf, html, other]

Title: Toward noise-robust whisper keyword spotting on headphones with in-earcup microphone and curriculum learning

Qiaoyu Yang, Shuo Zhang, Chuan-Che Huang

Comments: Accepted to ICASSP 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[23] arXiv:2502.01588 (cross-list from cs.LG) [pdf, html, other]

Title: A Differentiable Alignment Framework for Sequence-to-Sequence Modeling via Optimal Transport

Yacouba Kaloga, Shashi Kumar, Petr Motlicek, Ina Kodrasi

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[24] arXiv:2502.01185 (cross-list from cs.SD) [pdf, html, other]

Title: Deep Active Speech Cancellation with Multi-Band Mamba Network

Yehuda Mishaly, Lior Wolf, Eliya Nachmani

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[25] arXiv:2502.01152 (cross-list from cs.SD) [pdf, html, other]

Title: Gradient Norm-based Fine-Tuning for Backdoor Defense in Automatic Speech Recognition

Nanjun Zhou, Weilin Lin, Li Liu

Comments: 5 pages, 5 figures. This work has been accpeted by ICASSP 2025

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[26] arXiv:2502.01084 (cross-list from cs.LG) [pdf, html, other]

Title: Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis

Weiwei Lin, Chenghan He

Comments: ICLR 2025

Journal-ref: ICLR 2025

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[27] arXiv:2502.01046 (cross-list from cs.SD) [pdf, html, other]

Title: Emotional Face-to-Speech

Jiaxin Ye, Boyuan Cao, Hongming Shan

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[28] arXiv:2502.00734 (cross-list from cs.SD) [pdf, html, other]

Title: CycleGuardian: A Framework for Automatic RespiratorySound classification Based on Improved Deep clustering and Contrastive Learning

Yun Chu, Qiuhao Wang, Enze Zhou, Ling Fu, Qian Liu, Gang Zheng

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[29] arXiv:2502.00718 (cross-list from cs.LG) [pdf, html, other]

Title: "I am bad": Interpreting Stealthy, Universal and Robust Audio Jailbreaks in Audio-Language Models

Isha Gupta, David Khachaturov, Robert Mullins

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[30] arXiv:2502.00702 (cross-list from cs.HC) [pdf, html, other]

Title: CardioLive: Empowering Video Streaming with Online Cardiac Monitoring

Sheng Lyu, Ruiming Huang, Sijie Ji, Yasar Abbas Ur Rehman, Lan Ma, Chenshu Wu

Comments: Preprint

Subjects: Human-Computer Interaction (cs.HC); Networking and Internet Architecture (cs.NI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[31] arXiv:2502.00583 (cross-list from cs.CL) [pdf, html, other]

Title: Data-Driven Mispronunciation Pattern Discovery for Robust Speech Recognition

Anna Seo Gyeong Choi, Jonghyeon Park, Myungwoo Oh

Comments: Accepted to ICASSP 2025

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[32] arXiv:2502.00459 (cross-list from cs.SD) [pdf, html, other]

Title: AudioGenX: Explainability on Text-to-Audio Generative Models

Hyunju Kang, Geonhee Han, Yoonjae Jeong, Hogun Park

Comments: 14 pages

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[33] arXiv:2502.00421 (cross-list from cs.CL) [pdf, html, other]

Title: Sagalee: an Open Source Automatic Speech Recognition Dataset for Oromo Language

Turi Abu, Ying Shi, Thomas Fang Zheng, Dong Wang

Comments: Accepted for ICASSP2025 (2025 IEEE International Conference on Acoustics, Speech, and Signal Processing)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[34] arXiv:2502.00377 (cross-list from cs.CL) [pdf, html, other]

Title: When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation

Anna Min, Chenxu Hu, Yi Ren, Hang Zhao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[35] arXiv:2502.00374 (cross-list from cs.CL) [pdf, html, other]

Title: A Unit-based System and Dataset for Expressive Direct Speech-to-Speech Translation

Anna Min, Chenxu Hu, Yi Ren, Hang Zhao

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[36] arXiv:2502.00358 (cross-list from cs.SD) [pdf, html, other]

Title: Do Audio-Visual Segmentation Models Truly Segment Sounding Objects?

Jia Li, Wenjie Zhao, Ziru Huang, Yunhui Guo, Yapeng Tian

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[37] arXiv:2502.00310 (cross-list from cs.SD) [pdf, html, other]

Title: SigWavNet: Learning Multiresolution Signal Wavelet Network for Speech Emotion Recognition

Alaa Nfissi, Wassim Bouachir, Nizar Bouguila, Brian Mishara

Comments: Published in: IEEE Transactions on Affective Computing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[38] arXiv:2502.00030 (cross-list from cs.SD) [pdf, html, other]

Title: Evolving Performance Practices in Beethoven's Cello Sonatas: Tempo, Portamento, and Historical Interpretation of the First Movements

Ignasi Sole

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[39] arXiv:2502.00023 (cross-list from cs.MA) [pdf, html, other]

Title: Musical Agent Systems: MACAT and MACataRT

Keon Ju M. Lee, Philippe Pasquier

Comments: In Proceedings of the Creativity and Generative AI NIPS (Neural Information Processing Systems) Workshop 2024

Subjects: Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Mon, 3 Feb 2025 (showing 6 of 6 entries )

[40] arXiv:2501.19321 [pdf, html, other]

Title: Language Bias in Self-Supervised Learning For Automatic Speech Recognition

Edward Storey, Naomi Harte, Peter Bell

Comments: Accepted to Speech and Language Technology Workshop (SLT) 2024 accessible on IEEE Xplore

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Signal Processing (eess.SP)

[41] arXiv:2501.19377 (cross-list from cs.SD) [pdf, html, other]

Title: SELMA: A Speech-Enabled Language Model for Virtual Assistant Interactions

Dominik Wagner, Alexander Churchill, Siddharth Sigtia, Erik Marchi

Comments: Accepted at ICASSP 2025

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[42] arXiv:2501.19010 (cross-list from cs.CL) [pdf, html, other]

Title: DyPCL: Dynamic Phoneme-level Contrastive Learning for Dysarthric Speech Recognition

Wonjun Lee, Solee Im, Heejin Do, Yunsu Kim, Jungseul Ok, Gary Geunbae Lee

Comments: NAACL 2025 main conference, 9pages, 1 page appendix

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[43] arXiv:2501.18919 (cross-list from cs.SD) [pdf, html, other]

Title: Deepfake Detection of Singing Voices With Whisper Encodings

Falguni Sharma, Priyanka Gupta

Comments: Accepted in ICASSP,2025

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[44] arXiv:2501.18799 (cross-list from eess.SP) [pdf, other]

Title: A General-Purpose Neuromorphic Sensor based on Spiketrum Algorithm: Hardware Details and Real-life Applications

MHD Anas Alsakkal, Runze Wang, Jayawan Wijekoon, Piotr Dudek

Comments: Currently under review with IEEE TCAS

Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[45] arXiv:2501.18727 (cross-list from cs.CR) [pdf, html, other]

Title: Exploring Audio Editing Features as User-Centric Privacy Defenses Against Emotion Inference Attacks

Mohd. Farhan Israk Soumik, W.K.M. Mithsara, Abdur R. Shahid, Ahmed Imteaj

Comments: Accepted for presentation(Poster) at PPAI-25: The 6th AAAI Workshop on Privacy-Preserving Artificial Intelligence

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Fri, 31 Jan 2025 (showing 8 of 8 entries )

[46] arXiv:2501.18470 [pdf, html, other]

Title: Resampling Filter Design for Multirate Neural Audio Effect Processing

Alistair Carson, Vesa Välimäki, Alec Wright, Stefan Bilbao

Comments: Preprint

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[47] arXiv:2501.18355 [pdf, html, other]

Title: Multilayered Intelligent Reflecting Surface for Long-Range Underwater Acoustic Communication

Yu Luo, Lina Pu, Aijun Song

Comments: 12 pages, 16 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP); Systems and Control (eess.SY)

[48] arXiv:2501.18227 [pdf, html, other]

Title: BSM-iMagLS: ILD Informed Binaural Signal Matching for Reproduction with Head-Mounted Microphone Arrays

Or Berebi, Zamir Ben-Hur, David Lou Alon, Boaz Rafaely

Comments: 12 pages, 7 figures, submitted to IEEE TASLP

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[49] arXiv:2501.18224 [pdf, html, other]

Title: Ambisonics Binaural Rendering via Masked Magnitude Least Squares

Or Berebi, Fabian Brinkmann, Stefan Weinzierl, Boaz Rafaely

Comments: 5 pages, 4 figures, Accepted to IEEE ICASSP 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[50] arXiv:2501.17893 [pdf, html, other]

Title: Language Modelling for Speaker Diarization in Telephonic Interviews

Miquel India, Javier Hernando, José A.R. Fonollosa

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[51] arXiv:2501.18314 (cross-list from cs.MM) [pdf, html, other]

Title: AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessment

Yuqin Cao, Xiongkuo Min, Yixuan Gao, Wei Sun, Guangtao Zhai

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[52] arXiv:2501.18157 (cross-list from cs.SD) [pdf, html, other]

Title: Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment

Joanna Hong, Sanjeel Parekh, Honglie Chen, Jacob Donley, Ke Tan, Buye Xu, Anurag Kumar

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[53] arXiv:2501.17879 (cross-list from cs.IT) [pdf, html, other]

Title: Task and Perception-aware Distributed Source Coding for Correlated Speech under Bandwidth-constrained Channels

Sagnik Bhattacharya, Muhammad Ahmed Mohsin, Ahsan Bilal, John M. Cioffi

Comments: Published at AAAI 2025 Workshop

Journal-ref: Association for the Advancement of Artificial Intelligence (AAAI) 2025 Workshop

Subjects: Information Theory (cs.IT); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)