Audio and Speech Processing

Authors and titles for April 2025

[1] arXiv:2504.00621 [pdf, html, other]

Title: How Cyclic Acoustic Patterns Influence ASMR Perception: A Signal Processing Perspective

Zexin Fang, Bin Han, Henrik H. Sveen, C. Clark Cao, Hans D. Schotten

Comments: Submitted to IEEE Signal Processing Letters

Subjects: Audio and Speech Processing (eess.AS)

[2] arXiv:2504.00742 [pdf, other]

Title: Expanding and Analyzing ODAQ -- the Open Dataset of Audio Quality

Sascha Dick, Christoph Thompson, Chih-Wei Wu, Matteo Torcoli, Pablo Delgado, Phillip A. Williams, Emanuel Habets

Comments: Accepted for presentation at the Audio Engineering Society (AES) 157th Convention, October 2024, New York, USA

Subjects: Audio and Speech Processing (eess.AS)

[3] arXiv:2504.01392 [pdf, html, other]

Title: Spatial-Filter-Bank-Based Neural Method for Multichannel Speech Enhancement

Tianqin Zheng, Jilu Jin, Hanchen Pei, Gongping Huang, Jingdong Chen, Jacob Benesty

Subjects: Audio and Speech Processing (eess.AS)

[4] arXiv:2504.01767 [pdf, html, other]

Title: Leveraging Embedding Techniques in Multimodal Machine Learning for Mental Illness Assessment

Abdelrahaman A. Hassan, Abdelrahman A. Ali, Aya E. Fouda, Radwa J. Hanafy, Mohammed E. Fouda

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[5] arXiv:2504.03329 [pdf, html, other]

Title: Mind the Prompt: Prompting Strategies in Audio Generations for Improving Sound Classification

Francesca Ronchini, Ho-Hsiang Wu, Wei-Cheng Lin, Fabio Antonacci

Comments: Accepted at Generative Data Augmentation for Real-World Signal Processing Applications Workshop

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[6] arXiv:2504.04075 [pdf, html, other]

Title: Real-Time Auralization for First-Person Vocal Interaction in Immersive Virtual Environments

Mauricio Flores-Vargas, Enda Bates, Rachel McDonnell

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Signal Processing (eess.SP)

[7] arXiv:2504.04450 [pdf, html, other]

Title: WaveNet-Volterra Neural Networks for Active Noise Control: A Fully Causal Approach

Lu Bai, Mengtong Li, Siyuan Lian, Kai Chen, Jing Lu

Subjects: Audio and Speech Processing (eess.AS)

[8] arXiv:2504.04512 [pdf, html, other]

Title: Trainable Adaptive Score Normalization for Automatic Speaker Verification

Jeong-Hwan Choi, Ju-Seok Seong, Ye-Rin Jeoung, Joon-Hyuk Chang

Comments: Accepted at ICASSP'25

Subjects: Audio and Speech Processing (eess.AS)

[9] arXiv:2504.04721 [pdf, html, other]

Title: Bridging the Gap between Continuous and Informative Discrete Representations by Random Product Quantization

Xueqing Li, Zehan Li, Boyu Zhu, Ruihao Jing, Jian Kang, Jie Li, Xiao-Lei Zhang, Xuelong Li

Subjects: Audio and Speech Processing (eess.AS)

[10] arXiv:2504.04751 [pdf, html, other]

Title: Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches

Eloi Moliner, Michal Švento, Alec Wright, Lauri Juvela, Pavel Rajmic, Vesa Välimäki

Comments: Submitted to the 28th International Conference on Digital Audio Effects (DAFx25)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[11] arXiv:2504.05657 [pdf, html, other]

Title: Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing

Tianchi Liu, Duc-Tuan Truong, Rohan Kumar Das, Kong Aik Lee, Haizhou Li

Comments: This manuscript has been submitted for peer review

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[12] arXiv:2504.06963 [pdf, html, other]

Title: RNN-Transducer-based Losses for Speech Recognition on Noisy Targets

Vladimir Bataev

Comments: Final Project Report, Bachelor's Degree in Computer Science, University of London, March 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[13] arXiv:2504.00750 (cross-list from cs.SD) [pdf, html, other]

Title: $C^2$AV-TSE: Context and Confidence-aware Audio Visual Target Speaker Extraction

Wenxuan Wu, Xueyuan Chen, Shuai Wang, Jiadong Wang, Lingwei Meng, Xixin Wu, Helen Meng, Haizhou Li

Comments: Accepted by IEEE Journal of Selected Topics in Signal Processing (JSTSP)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[14] arXiv:2504.01094 (cross-list from cs.SD) [pdf, html, other]

Title: Multilingual and Multi-Accent Jailbreaking of Audio LLMs

Jaechul Roh, Virat Shejwalkar, Amir Houmansadr

Comments: 21 pages, 6 figures, 15 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[15] arXiv:2504.01297 (cross-list from cs.RO) [pdf, html, other]

Title: AIM: Acoustic Inertial Measurement for Indoor Drone Localization and Tracking

Yimiao Sun, Weiguo Wang, Luca Mottola, Ruijin Wang, Yuan He

Comments: arXiv admin note: substantial text overlap with arXiv:2504.00445

Subjects: Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[16] arXiv:2504.01519 (cross-list from cs.CL) [pdf, html, other]

Title: Chain of Correction for Full-text Speech Recognition with Large Language Models

Zhiyuan Tang, Dong Wang, Zhikai Zhou, Yong Liu, Shen Huang, Shidong Shang

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[17] arXiv:2504.01690 (cross-list from cs.SD) [pdf, html, other]

Title: Token Pruning in Audio Transformers: Optimizing Performance and Decoding Patch Importance

Taehan Lee, Hyukjun Lee

Comments: This work has been submitted to the IEEE for possible publication. Source code is available at this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[18] arXiv:2504.02061 (cross-list from cs.CV) [pdf, html, other]

Title: Aligned Better, Listen Better for Audio-Visual Large Language Models

Yuxin Guo, Shuailei Ma, Shijie Ma, Xiaoyi Bao, Chen-Wei Xie, Kecheng Zheng, Tingyu Weng, Siyang Sun, Yun Zheng, Wei Zou

Comments: Accepted to ICLR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[19] arXiv:2504.02302 (cross-list from cs.SD) [pdf, html, other]

Title: Causal Self-supervised Pretrained Frontend with Predictive Code for Speech Separation

Wupeng Wang, Zexu Pan, Xinke Li, Shuai Wang, Haizhou Li

Comments: arXiv admin note: text overlap with arXiv:2411.03085

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[20] arXiv:2504.02386 (cross-list from cs.CV) [pdf, html, other]

Title: VoiceCraft-Dub: Automated Video Dubbing with Neural Codec Language Models

Kim Sung-Bin, Jeongsoo Choi, Puyuan Peng, Joon Son Chung, Tae-Hyun Oh, David Harwath

Comments: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[21] arXiv:2504.02398 (cross-list from cs.CL) [pdf, html, other]

Title: Scaling Analysis of Interleaved Speech-Text Language Models

Gallil Maimon, Michael Hassid, Amit Roth, Yossi Adi

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[22] arXiv:2504.02402 (cross-list from cs.SD) [pdf, html, other]

Title: EvMic: Event-based Non-contact sound recovery from effective spatial-temporal modeling

Hao Yin, Shi Guo, Xu Jia, Xudong XU, Lu Zhang, Si Liu, Dong Wang, Huchuan Lu, Tianfan Xue

Comments: Our project page: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[23] arXiv:2504.02407 (cross-list from cs.SD) [pdf, html, other]

Title: F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimization

Xiaohui Sun, Ruitong Xiao, Jianye Mo, Bowen Wu, Qun Yu, Baoxun Wang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[24] arXiv:2504.02586 (cross-list from cs.SD) [pdf, other]

Title: Deep learning for music generation. Four approaches and their comparative evaluation

Razvan Paroiu, Stefan Trausan-Matu

Journal-ref: U.P.B. Scientific Bulletin, Series C, Vol. 85, Issue 4, 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[25] arXiv:2504.02604 (cross-list from cs.CL) [pdf, html, other]

Title: LinTO Audio and Textual Datasets to Train and Evaluate Automatic Speech Recognition in Tunisian Arabic Dialect

Hedi Naouara, Jean-Pierre Lorré, Jérôme Louradour

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[26] arXiv:2504.02988 (cross-list from cs.SD) [pdf, html, other]

Title: Generating Diverse Audio-Visual 360 Soundscapes for Sound Event Localization and Detection

Adrian S. Roman, Aiden Chang, Gerardo Meza, Iran R. Roman

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[27] arXiv:2504.03289 (cross-list from cs.SD) [pdf, html, other]

Title: RWKVTTS: Yet another TTS based on RWKV-7

Lin yueyu, Liu Xiao

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[28] arXiv:2504.03373 (cross-list from cs.SD) [pdf, html, other]

Title: An Efficient GPU-based Implementation for Noise Robust Sound Source Localization

Zirui Lin, Masayuki Takigahira, Naoya Terakado, Haris Gulzar, Monikka Roslianna Busto, Takeharu Eda, Katsutoshi Itoyama, Kazuhiro Nakadai, Hideharu Amano

Comments: 6 pages, 2 figures

Subjects: Sound (cs.SD); Robotics (cs.RO); Audio and Speech Processing (eess.AS)

[29] arXiv:2504.03546 (cross-list from cs.CL) [pdf, html, other]

Title: MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech Translation

Khai Le-Duc, Tuyen Tran, Bach Phan Tat, Nguyen Kim Hai Bui, Quan Dang, Hung-Phong Tran, Thanh-Thuy Nguyen, Ly Nguyen, Tuan-Minh Phan, Thi Thu Phuong Tran, Chris Ngo, Nguyen X. Khanh, Thanh Nguyen-Tang

Comments: Preprint, 122 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[30] arXiv:2504.03679 (cross-list from eess.SP) [pdf, other]

Title: Continuous Boostlet Transform and Associated Uncertainty Principles

Owais Ahmad, Jasifa Fayaz

Comments: 28pages,6 figures

Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS); Functional Analysis (math.FA)

[31] arXiv:2504.03998 (cross-list from cs.SD) [pdf, html, other]

Title: Determined blind source separation via modeling adjacent frequency band correlations in speech signals

Jianyu Wang, Shanzheng Guan, Zhengqiao Zhao, Nicolas Dobigeon, Jingdong Chen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[32] arXiv:2504.04060 (cross-list from cs.CL) [pdf, html, other]

Title: VocalNet: Speech LLM with Multi-Token Prediction for Faster and High-Quality Generation

Yuhao Wang, Heyang Liu, Ziyang Cheng, Ronghua Wu, Qunshan Gu, Yanfeng Wang, Yu Wang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[33] arXiv:2504.04589 (cross-list from cs.SD) [pdf, html, other]

Title: Diff-SSL-G-Comp: Towards a Large-Scale and Diverse Dataset for Virtual Analog Modeling

Yicheng Gu, Runsong Zhang, Lauri Juvela, Zhizheng Wu

Comments: Submitted to DAFx 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[34] arXiv:2504.05009 (cross-list from cs.SD) [pdf, html, other]

Title: Deconstructing Jazz Piano Style Using Machine Learning

Huw Cheston, Reuben Bance, Peter M. C. Harrison

Comments: Paper: 40 pages, 11 figures, 1 table. Supplementary material: 33 pages, 48 figures, 6 tables

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[35] arXiv:2504.05158 (cross-list from cs.SD) [pdf, html, other]

Title: Leveraging Label Potential for Enhanced Multimodal Emotion Recognition

Xuechun Shao, Yinfeng Yu, Liejun Wang

Comments: Main paper (8 pages). Accepted for publication by IJCNN 2025

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[36] arXiv:2504.05368 (cross-list from cs.SD) [pdf, html, other]

Title: Exploring Local Interpretable Model-Agnostic Explanations for Speech Emotion Recognition with Distribution-Shift

Maja J. Hjuler, Line H. Clemmensen, Sneha Das

Comments: Published in the proceedings of ICASSP 2025

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[37] arXiv:2504.05686 (cross-list from cs.SD) [pdf, html, other]

Title: kNN-SVC: Robust Zero-Shot Singing Voice Conversion with Additive Synthesis and Concatenation Smoothness Optimization

Keren Shao, Ke Chen, Matthew Baas, Shlomo Dubnov

Comments: 5 pages, 6 figures, 1 table, Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2025

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[38] arXiv:2504.05690 (cross-list from cs.SD) [pdf, html, other]

Title: STAGE: Stemmed Accompaniment Generation through Prefix-Based Conditioning

Giorgio Strano, Chiara Ballanti, Donato Crisostomi, Michele Mancusi, Luca Cosmo, Emanuele Rodolà

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[39] arXiv:2504.05802 (cross-list from cs.SD) [pdf, html, other]

Title: Mass-Spring Models for Passive Keyword Spotting: A Springtronics Approach

Finn Bohte, Theophile Louvet, Vincent Maillou, Marc Serra Garcia

Comments: 14 pages, 8 figures

Subjects: Sound (cs.SD); Disordered Systems and Neural Networks (cond-mat.dis-nn); Audio and Speech Processing (eess.AS)

[40] arXiv:2504.05847 (cross-list from cs.SD) [pdf, html, other]

Title: Réduire le bruit grâce à la réalité augmentée sonore -- Auditory Concealer

Clara Boukhemia

Comments: 57 pages, in French language, 24 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[41] arXiv:2504.06165 (cross-list from cs.SD) [pdf, other]

Title: Real-Time Pitch/F0 Detection Using Spectrogram Images and Convolutional Neural Networks

Xufang Zhao, Omer Tsimhoni

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[42] arXiv:2504.06275 (cross-list from cs.IR) [pdf, html, other]

Title: A Cascaded Architecture for Extractive Summarization of Multimedia Content via Audio-to-Text Alignment

Tanzir Hossain, Ar-Rafi Islam, Md. Sabbir Hossain, Annajiat Alim Rasel

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[43] arXiv:2504.06778 (cross-list from cs.SD) [pdf, html, other]

Title: Controllable Automatic Foley Artist

Roi Benita, Michael Finkelson, Tavi Halperin, Gleb Sterkin, Yossi Adi

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[44] arXiv:2504.07053 (cross-list from cs.CL) [pdf, html, other]

Title: TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling

Liang-Hsuan Tseng, Yi-Chang Chen, Kuan-Yi Lee, Da-Shan Shiu, Hung-yi Lee

Comments: Preprint. Work in progress

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)