Audio and Speech Processing

Authors and titles for March 2025

[1] arXiv:2503.00340 [pdf, html, other]

Title: UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search

Xiaobin Rong, Dahan Wang, Yuxiang Hu, Changbao Zhu, Kai Chen, Jing Lu

Comments: 13 pages, 8 figures, submitted to Neural Networks

Subjects: Audio and Speech Processing (eess.AS)

[2] arXiv:2503.00493 [pdf, html, other]

Title: LLaSE-G1: Incentivizing Generalization Capability for LLaMA-based Speech Enhancement

Boyi Kang, Xinfa Zhu, Zihan Zhang, Zhen Ye, Mingshuai Liu, Ziqian Wang, Yike Zhu, Guobin Ma, Jun Chen, Longshuai Xiao, Chao Weng, Wei Xue, Lei Xie

Comments: 13 pages, 2 figures, 8 tables

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[3] arXiv:2503.00733 [pdf, html, other]

Title: UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation

Alexander H. Liu, Sang-gil Lee, Chao-Han Huck Yang, Yuan Gong, Yu-Chiang Frank Wang, James R. Glass, Rafael Valle, Bryan Catanzaro

Comments: ICLR 2025; demo page at this https URL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[4] arXiv:2503.01183 [pdf, html, other]

Title: DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion

Ziqian Ning, Huakang Chen, Yuepeng Jiang, Chunbo Hao, Guobin Ma, Shuai Wang, Jixun Yao, Lei Xie

Subjects: Audio and Speech Processing (eess.AS)

[5] arXiv:2503.02046 [pdf, html, other]

Title: CNN-based Robust Sound Source Localization with SRP-PHAT for the Extreme Edge

Jun Yin, Marian Verhelst

Journal-ref: ACM Transactions on Embedded Computing Systems, 2023, 22(3): 1-27

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[6] arXiv:2503.02977 [pdf, html, other]

Title: HARP 2.0: Expanding Hosted, Asynchronous, Remote Processing for Deep Learning in the DAW

Christodoulos Benetatos, Frank Cwitkowitz, Nathan Pruyne, Hugo Flores Garcia, Patrick O'Reilly, Zhiyao Duan, Bryan Pardo

Comments: ISMIR 2024 Late-Breaking Demo

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[7] arXiv:2503.03250 [pdf, html, other]

Title: Good practices for evaluation of synthesized speech

Erica Cooper, Sébastien Le Maguer, Esther Klabbers, Junichi Yamagishi

Subjects: Audio and Speech Processing (eess.AS)

[8] arXiv:2503.03304 [pdf, other]

Title: On the Relation Between Speech Quality and Quantized Latent Representations of Neural Codecs

Mhd Modar Halimeh, Matteo Torcoli, Philipp Grundhuber, Emanuël A. P. Habets

Subjects: Audio and Speech Processing (eess.AS)

[9] arXiv:2503.03593 [pdf, html, other]

Title: A Comparative Analysis of Generalised Echo and Interference Cancelling and Extended Multichannel Wiener Filtering for Combined Noise Reduction and Acoustic Echo Cancellation

Arnout Roebben, Toon van Waterschoot, Marc Moonen

Comments: Accepted for publication in ICASSP 2025

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[10] arXiv:2503.04713 [pdf, html, other]

Title: Scaling Rich Style-Prompted Text-to-Speech Datasets

Anuj Diwan, Zhisheng Zheng, David Harwath, Eunsol Choi

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[11] arXiv:2503.04974 [pdf, html, other]

Title: From Voice to Safety: Language AI Powered Pilot-ATC Communication Understanding for Airport Surface Movement Collision Risk Assessment

Yutian Pang, Andrew Paul Kendall, Alex Porcayo, Mariah Barsotti, Anahita Jain, John-Paul Clarke

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[12] arXiv:2503.04995 [pdf, html, other]

Title: Musical Source Separation of Brazilian Percussion

Richa Namballa, Giovana Morais, Magdalena Fuentes

Comments: 2 pages + references, 1 figure, 1 table, Extended Abstracts for the Late-Breaking Demo Session of the 25th International Society for Music Information Retrieval Conference

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[13] arXiv:2503.06375 [pdf, html, other]

Title: ProSE: Diffusion Priors for Speech Enhancement

Sonal Kumar, Sreyan Ghosh, Utkarsh Tyagi, Anton Jeran Ratnarajah, Chandra Kiran Reddy Evuru, Ramani Duraiswami, Dinesh Manocha

Comments: Accepted at NAACL 2025

Subjects: Audio and Speech Processing (eess.AS)

[14] arXiv:2503.06620 [pdf, html, other]

Title: Why Pre-trained Models Fail: Feature Entanglement in Multi-modal Depression Detection

Xiangyu Zhang, Beena Ahmed, Julien Epps

Subjects: Audio and Speech Processing (eess.AS)

[15] arXiv:2503.07352 [pdf, html, other]

Title: Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music

Eetu Tunturi, David Diaz-Guerra, Archontis Politis, Tuomas Virtanen

Comments: 5 pages, 2 figures, submitted to Eusipco2025

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[16] arXiv:2503.07357 [pdf, html, other]

Title: Impact of Microphone Array Mismatches to Learning-based Replay Speech Detection

Michael Neri, Tuomas Virtanen

Comments: Submitted to EUSIPCO 2025

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[17] arXiv:2503.07522 [pdf, html, other]

Title: Building English ASR model with regional language support

Purvi Agrawal, Vikas Joshi, Bharati Patidar, Ankur Gupta, Rupesh Kumar Mehta

Comments: 5 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[18] arXiv:2503.08638 [pdf, html, other]

Title: YuE: Scaling Open Foundation Models for Long-Form Music Generation

Ruibin Yuan, Hanfeng Lin, Shuyue Guo, Ge Zhang, Jiahao Pan, Yongyi Zang, Haohe Liu, Yiming Liang, Wenye Ma, Xingjian Du, Xinrun Du, Zhen Ye, Tianyu Zheng, Yinghao Ma, Minghao Liu, Zeyue Tian, Ziya Zhou, Liumeng Xue, Xingwei Qu, Yizhi Li, Shangda Wu, Tianhao Shen, Ziyang Ma, Jun Zhan, Chunhui Wang, Yatian Wang, Xiaowei Chi, Xinyue Zhang, Zhenzhu Yang, Xiangzhou Wang, Shansong Liu, Lingrui Mei, Peng Li, Junjie Wang, Jianwei Yu, Guojian Pang, Xu Li, Zihao Wang, Xiaohuan Zhou, Lijun Yu, Emmanouil Benetos, Yong Chen, Chenghua Lin, Xie Chen, Gus Xia, Zhaoxiang Zhang, Chao Zhang, Wenhu Chen, Xinyu Zhou, Xipeng Qiu, Roger Dannenberg, Jiaheng Liu, Jian Yang, Wenhao Huang, Wei Xue, Xu Tan, Yike Guo

Comments: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)

[19] arXiv:2503.08954 [pdf, html, other]

Title: An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR

Sewade Ogun, Vincent Colotte, Emmanuel Vincent

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[20] arXiv:2503.09412 [pdf, html, other]

Title: Multiple Speaker Separation from Noisy Sources in Reverberant Rooms using Relative Transfer Matrix

Wageesha N. Manamperi, Thushara D. Abhayapala

Comments: 5 pages, 4 figures, submitted to 33th European Signal Processing Conference (EUSIPCO) 2025

Subjects: Audio and Speech Processing (eess.AS)

[21] arXiv:2503.00084 (cross-list from cs.SD) [pdf, html, other]

Title: InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation

Chong Zhang, Yukun Ma, Qian Chen, Wen Wang, Shengkui Zhao, Zexu Pan, Hao Wang, Chongjia Ni, Trung Hieu Nguyen, Kun Zhou, Yidi Jiang, Chaohong Tan, Zhifu Gao, Zhihao Du, Bin Ma

Comments: Work in progress. Correspondence regarding this technical report should be directed to {this http URL, this http URL}@alibabathis http URL. Online demo available on this https URL and this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[22] arXiv:2503.00296 (cross-list from cs.SD) [pdf, html, other]

Title: Synthetic data enables context-aware bioacoustic sound event detection

Benjamin Hoffman, David Robinson, Marius Miron, Vittorio Baglione, Daniela Canestrari, Damian Elias, Eva Trapote, Olivier Pietquin

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[23] arXiv:2503.00389 (cross-list from cs.CV) [pdf, html, other]

Title: BGM2Pose: Active 3D Human Pose Estimation with Non-Stationary Sounds

Yuto Shibata, Yusuke Oumi, Go Irie, Akisato Kimura, Yoshimitsu Aoki, Mariko Isogawa

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[24] arXiv:2503.00427 (cross-list from cs.SD) [pdf, html, other]

Title: Language Model Mapping in Multimodal Music Learning: A Grand Challenge Proposal

Daniel Chin, Gus Xia

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[25] arXiv:2503.00455 (cross-list from cs.SD) [pdf, html, other]

Title: PodAgent: A Comprehensive Framework for Podcast Generation

Yujia Xiao, Lei He, Haohan Guo, Fenglong Xie, Tan Lee

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[26] arXiv:2503.00790 (cross-list from cs.SD) [pdf, other]

Title: Acoustic Anomaly Detection on UAM Propeller Defect with Acoustic dataset for Crack of drone Propeller (ADCP)

Juho Lee, Donghyun Yoon, Gumoon Jeong, Hyeoncheol Kim

Comments: 25 pages

Subjects: Sound (cs.SD); Emerging Technologies (cs.ET); Audio and Speech Processing (eess.AS)

[27] arXiv:2503.00907 (cross-list from cs.CL) [pdf, html, other]

Title: Unveiling Biases while Embracing Sustainability: Assessing the Dual Challenges of Automatic Speech Recognition Systems

Ajinkya Kulkarni, Atharva Kulkarni, Miguel Couceiro, Isabel Trancoso

Comments: Interspeech 2024

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[28] arXiv:2503.00957 (cross-list from cs.SD) [pdf, html, other]

Title: Exploiting Vulnerabilities in Speech Translation Systems through Targeted Adversarial Attacks

Chang Liu, Haolin Wu, Xi Yang, Kui Zhang, Cong Wu, Weiming Zhang, Nenghai Yu, Tianwei Zhang, Qing Guo, Jie Zhang

Comments: Preprint,17 pages, 17 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[29] arXiv:2503.01174 (cross-list from cs.CL) [pdf, html, other]

Title: Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics

Siddhant Arora, Zhiyun Lu, Chung-Cheng Chiu, Ruoming Pang, Shinji Watanabe

Comments: Accepted at ICLR 2025

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[30] arXiv:2503.01266 (cross-list from cs.SD) [pdf, html, other]

Title: Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology

Birger Moell, Fredrik Sand Aronsson

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[31] arXiv:2503.01362 (cross-list from cs.SD) [pdf, html, other]

Title: Streaming Piano Transcription Based on Consistent Onset and Offset Decoding with Sustain Pedal Detection

Weixing Wei, Jiahao Zhao, Yulun Wu, Kazuyoshi Yoshii

Comments: Accepted to ISMIR 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[32] arXiv:2503.01485 (cross-list from cs.SD) [pdf, html, other]

Title: FlowDec: A flow-based full-band general audio codec with high perceptual quality

Simon Welker, Matthew Le, Ricky T. Q. Chen, Wei-Ning Hsu, Timo Gerkmann, Alexander Richard, Yi-Chiao Wu

Comments: Accepted at ICLR 2025

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[33] arXiv:2503.01710 (cross-list from cs.SD) [pdf, html, other]

Title: Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens

Xinsheng Wang, Mingqi Jiang, Ziyang Ma, Ziyu Zhang, Songxiang Liu, Linqin Li, Zheng Liang, Qixi Zheng, Rui Wang, Xiaoqin Feng, Weizhen Bian, Zhen Ye, Sitong Cheng, Ruibin Yuan, Zhixian Zhao, Xinfa Zhu, Jiahao Pan, Liumeng Xue, Pengcheng Zhu, Yunlin Chen, Zhifei Li, Xie Chen, Lei Xie, Yike Guo, Wei Xue

Comments: Submitted to ACL 2025

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[34] arXiv:2503.01879 (cross-list from cs.MM) [pdf, html, other]

Title: Nexus-O: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision

Che Liu, Yingji Zhang, Dong Zhang, Weijie Zhang, Chenggong Gong, Haohan Li, Yu Lu, Shilin Zhou, Yue Lu, Ziliang Gan, Ziao Wang, Junwei Liao, Haipang Wu, Ji Liu, André Freitas, Qifan Wang, Zenglin Xu, Rongjuncheng Zhang, Yong Dai

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[35] arXiv:2503.02318 (cross-list from cs.SD) [pdf, html, other]

Title: Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models

Zhifei Xie, Mingbao Lin, Zihang Liu, Pengcheng Wu, Shuicheng Yan, Chunyan Miao

Comments: Technical report, in process

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[36] arXiv:2503.02389 (cross-list from cs.SD) [pdf, html, other]

Title: Robust detection of overlapping bioacoustic sound events

Louis Mahon, Benjamin Hoffman, Logan S James, Maddie Cusimano, Masato Hagiwara, Sarah C Woolley, Olivier Pietquin

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[37] arXiv:2503.02422 (cross-list from cs.SD) [pdf, html, other]

Title: Aggregation Strategies for Efficient Annotation of Bioacoustic Sound Events Using Active Learning

Richard Lindholm, Oscar Marklund, Olof Mogren, John Martinsson

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[38] arXiv:2503.02585 (cross-list from cs.SD) [pdf, html, other]

Title: A Hypernetwork-Based Approach to KAN Representation of Audio Signals

Patryk Marszałek, Maciej Rut, Piotr Kawa, Piotr Syga

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[39] arXiv:2503.02769 (cross-list from cs.SD) [pdf, html, other]

Title: InSerter: Speech Instruction Following with Unsupervised Interleaved Pre-training

Dingdong Wang, Jin Xu, Ruihang Chu, Zhifang Guo, Xiong Wang, Jincenzi Wu, Dongchao Yang, Shengpeng Ji, Junyang Lin

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[40] arXiv:2503.02823 (cross-list from cs.SD) [pdf, html, other]

Title: A Multimodal Symphony: Integrating Taste and Sound through Generative AI

Matteo Spanio, Massimiliano Zampini, Antonio Rodà, Franco Pierucci

Comments: 17 pages, 6 figures (2 + 2 figures with 2 subfigures each)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[41] arXiv:2503.02907 (cross-list from cs.SD) [pdf, html, other]

Title: Fine-Tuning Whisper for Inclusive Prosodic Stress Analysis

Samuel S. Sohn, Sten Knutsen, Karin Stromswold

Comments: Appears in Proceedings of the ISCA/ITG Workshop on Diversity in Large Speech and Language Models

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[42] arXiv:2503.03232 (cross-list from cs.SD) [pdf, html, other]

Title: Lead Instrument Detection from Multitrack Music

Longshen Ou, Yu Takahashi, Ye Wang

Comments: Camera ready version of ICASSP 2025 submission

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[43] arXiv:2503.03681 (cross-list from cs.CL) [pdf, other]

Title: Quantification of Tenseness in English and Japanese Tense-Lax Vowels: A Lagrangian Model with Indicator $θ_1$ and Force of Tenseness Ftense(t)

Tatsuya Ishizaki

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[44] arXiv:2503.03756 (cross-list from cs.SD) [pdf, html, other]

Title: Efficient Finetuning for Dimensional Speech Emotion Recognition in the Age of Transformers

Aneesha Sampath, James Tavernor, Emily Mower Provost

Comments: ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[45] arXiv:2503.03797 (cross-list from cs.SD) [pdf, html, other]

Title: VoiceGRPO: Modern MoE Transformers with Group Relative Policy Optimization GRPO for AI Voice Health Care Applications on Voice Pathology Detection

Enkhtogtokh Togootogtokh, Christian Klasen

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[46] arXiv:2503.03983 (cross-list from cs.SD) [pdf, html, other]

Title: Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities

Sreyan Ghosh, Zhifeng Kong, Sonal Kumar, S Sakshi, Jaehyeon Kim, Wei Ping, Rafael Valle, Dinesh Manocha, Bryan Catanzaro

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[47] arXiv:2503.04156 (cross-list from eess.SP) [pdf, other]

Title: Frequency-Based Alignment of EEG and Audio Signals Using Contrastive Learning and SincNet for Auditory Attention Detection

Yuan Liao, Yuhong Zhang, Qiushi Han, Yuhang Yang, Weiwei Ding, Yuzhe Gu, Hengxin Yang, Liya Huang

Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[48] arXiv:2503.04258 (cross-list from cs.SD) [pdf, html, other]

Title: TAIL: Text-Audio Incremental Learning

Yingfei Sun, Xu Gu, Wei Ji, Hanbin Zhao, Hao Fei, Yifang Yin, Roger Zimmermann

Comments: 4 figures, 5 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[49] arXiv:2503.04710 (cross-list from cs.SD) [pdf, html, other]

Title: Self-Supervised Models for Phoneme Recognition: Applications in Children's Speech for Reading Learning

Lucas Block Medin, Thomas Pellegrini, Lucile Gelin

Comments: This paper was originally published in the Proceedings of Interspeech 2024. DOI: https://doi.org/10.21437/Interspeech.2024-1095

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[50] arXiv:2503.04721 (cross-list from cs.CL) [pdf, html, other]

Title: Full-Duplex-Bench: A Benchmark to Evaluate Full-duplex Spoken Dialogue Models on Turn-taking Capabilities

Guan-Ting Lin, Jiachen Lian, Tingle Li, Qirui Wang, Gopala Anumanchipalli, Alexander H. Liu, Hung-yi Lee

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)