Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Audio and Speech Processing

Authors and titles for April 2024

Total of 191 entries : 1-100 101-191
Showing up to 100 entries per page: fewer | more | all
[1] arXiv:2404.00082 [pdf, html, other]
Title: Data-Driven Room Acoustic Modeling Via Differentiable Feedback Delay Networks With Learnable Delay Lines
Alessandro Ilic Mezza, Riccardo Giampiccolo, Enzo De Sena, Alberto Bernardini
Journal-ref: J Audio Speech and Music Process., vol. 2024, no. 1, pp. 1-20 (51), 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[2] arXiv:2404.00685 [pdf, html, other]
Title: Scaling Properties of Speech Language Models
Santiago Cuervo, Ricard Marxer
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)
[3] arXiv:2404.00809 [pdf, html, other]
Title: Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfake
Orchid Chetia Phukan, Gautam Siddharth Kashyap, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to NAACL (Findings) 2024
Subjects: Audio and Speech Processing (eess.AS)
[4] arXiv:2404.00861 [pdf, html, other]
Title: Enhancing Real-World Active Speaker Detection with Multi-Modal Extraction Pre-Training
Ruijie Tao, Xinyuan Qian, Rohan Kumar Das, Xiaoxue Gao, Jiadong Wang, Haizhou Li
Comments: 10 pages
Subjects: Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)
[5] arXiv:2404.00863 [pdf, html, other]
Title: Voice Conversion Augmentation for Speaker Recognition on Defective Datasets
Ruijie Tao, Zhan Shi, Yidi Jiang, Tianchi Liu, Haizhou Li
Comments: 5 pages
Subjects: Audio and Speech Processing (eess.AS)
[6] arXiv:2404.01033 [pdf, html, other]
Title: KazEmoTTS: A Dataset for Kazakh Emotional Text-to-Speech Synthesis
Adal Abilbekov, Saida Mussakhojayeva, Rustem Yeshpanov, Huseyin Atakan Varol
Comments: To appear in Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Subjects: Audio and Speech Processing (eess.AS)
[7] arXiv:2404.01716 [pdf, html, other]
Title: Effective internal language model training and fusion for factorized transducer model
Jinxi Guo, Niko Moritz, Yingyi Ma, Frank Seide, Chunyang Wu, Jay Mahadeokar, Ozlem Kalinli, Christian Fuegen, Mike Seltzer
Comments: Accepted to ICASSP 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
[8] arXiv:2404.01737 [pdf, html, other]
Title: Transfer Learning from Whisper for Microscopic Intelligibility Prediction
Paul Best, Santiago Cuervo, Ricard Marxer
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[9] arXiv:2404.02677 [pdf, html, other]
Title: The VoicePrivacy 2024 Challenge Evaluation Plan
Natalia Tomashenko, Xiaoxiao Miao, Pierre Champion, Sarina Meyer, Xin Wang, Emmanuel Vincent, Michele Panariello, Nicholas Evans, Junichi Yamagishi, Massimiliano Todisco
Comments: 19 pages, this https URL. arXiv admin note: substantial text overlap with arXiv:2203.12468
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
[10] arXiv:2404.02781 [pdf, html, other]
Title: CLaM-TTS: Improving Neural Codec Language Model for Zero-Shot Text-to-Speech
Jaehyeon Kim, Keon Lee, Seungjun Chung, Jaewoong Cho
Comments: ICLR 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[11] arXiv:2404.03204 [pdf, html, other]
Title: RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis
Detai Xin, Xu Tan, Kai Shen, Zeqian Ju, Dongchao Yang, Yuancheng Wang, Shinnosuke Takamichi, Hiroshi Saruwatari, Shujie Liu, Jinyu Li, Sheng Zhao
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[12] arXiv:2404.03436 [pdf, html, other]
Title: Interpreting End-to-End Deep Learning Models for Speech Source Localization Using Layer-wise Relevance Propagation
Luca Comanducci, Fabio Antonacci, Augusto Sarti
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[13] arXiv:2404.04365 [pdf, html, other]
Title: Uformer: A UNet-Transformer fused robust end-to-end deep learning framework for real-time denoising of lung sounds
Samiul Based Shuvo, Syed Samiul Alam, Taufiq Hasan
Subjects: Audio and Speech Processing (eess.AS)
[14] arXiv:2404.04439 [pdf, html, other]
Title: Rethinking Non-Negative Matrix Factorization with Implicit Neural Representations
Krishna Subramani, Paris Smaragdis, Takuya Higuchi, Mehrez Souden
Comments: Submitted to IEEE SPL, Code: this https URL
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[15] arXiv:2404.04947 [pdf, html, other]
Title: Gull: A Generative Multifunctional Audio Codec
Yi Luo, Jianwei Yu, Hangting Chen, Rongzhi Gu, Chao Weng
Comments: Demo page: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[16] arXiv:2404.06079 [pdf, html, other]
Title: The X-LANCE Technical Report for Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge
Yiwei Guo, Chenrun Wang, Yifan Yang, Hankun Wang, Ziyang Ma, Chenpeng Du, Shuai Wang, Hanzheng Li, Shuai Fan, Hui Zhang, Xie Chen, Kai Yu
Comments: 5 pages, 3 figures. Report of a challenge
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[17] arXiv:2404.06095 [pdf, html, other]
Title: Masked Modeling Duo: Towards a Universal Audio Pre-training Framework
Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino
Comments: 15 pages, 6 figures, 15 tables. Accepted by TASLP
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[18] arXiv:2404.06690 [pdf, html, other]
Title: CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations
Leying Zhang, Yao Qian, Long Zhou, Shujie Liu, Dongmei Wang, Xiaofei Wang, Midia Yousefi, Yanmin Qian, Jinyu Li, Lei He, Sheng Zhao, Michael Zeng
Comments: Neural Information Processing Systems 2024, poster
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[19] arXiv:2404.06702 [pdf, html, other]
Title: What is Learnt by the LEArnable Front-end (LEAF)? Adapting Per-Channel Energy Normalisation (PCEN) to Noisy Conditions
Hanyu Meng, Vidhyasaharan Sethu, Eliathamby Ambikairajah
Comments: Interspeech 2023 Proceeding
Journal-ref: Interspeech 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[20] arXiv:2404.06818 [pdf, html, other]
Title: Towards Efficient and Real-Time Piano Transcription Using Neural Autoregressive Models
Taegyun Kwon, Dasaem Jeong, Juhan Nam
Comments: 11 pages, 8 figures, preprint
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[21] arXiv:2404.06928 [pdf, other]
Title: Efficient Sound Field Reconstruction with Conditional Invertible Neural Networks
Xenofon Karakonstantis, Efren Fernandez-Grande, Peter Gerstoft
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[22] arXiv:2404.07226 [pdf, html, other]
Title: Houston we have a Divergence: A Subgroup Performance Analysis of ASR Models
Alkis Koudounas, Flavio Giobergia
Comments: 2 pages
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[23] arXiv:2404.07341 [pdf, html, other]
Title: Conformer-1: Robust ASR via Large-Scale Semisupervised Bootstrapping
Kevin Zhang, Luka Chkhetiani, Francis McCann Ramirez, Yash Khare, Andrea Vanzo, Michael Liang, Sergio Ramirez Martin, Gabriel Oexle, Ruben Bousbib, Taufiquzzaman Peyash, Michael Nguyen, Dillon Pulliam, Domenic Donato
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[24] arXiv:2404.07970 [pdf, html, other]
Title: Differentiable All-pole Filters for Time-varying Audio Systems
Chin-Yun Yu, Christopher Mitcheltree, Alistair Carson, Stefan Bilbao, Joshua D. Reiss, György Fazekas
Comments: Published at DAFx 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[25] arXiv:2404.08064 [pdf, other]
Title: The Impact of Speech Anonymization on Pathology and Its Limits
Soroosh Tayebi Arasteh, Tomas Arias-Vergara, Paula Andrea Perez-Toro, Tobias Weise, Kai Packhaeuser, Maria Schuster, Elmar Noeth, Andreas Maier, Seung Hee Yang
Comments: Published in Communications Medicine
Journal-ref: Commun Med 4, (2024)
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
[26] arXiv:2404.09313 [pdf, html, other]
Title: Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment
Zhiqing Hong, Rongjie Huang, Xize Cheng, Yongqi Wang, Ruiqi Li, Fuming You, Zhou Zhao, Zhimeng Zhang
Comments: ACL 2024 Main
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[27] arXiv:2404.09385 [pdf, html, other]
Title: A Large-Scale Evaluation of Speech Foundation Models
Shu-wen Yang, Heng-Jui Chang, Zili Huang, Andy T. Liu, Cheng-I Lai, Haibin Wu, Jiatong Shi, Xuankai Chang, Hsiang-Sheng Tsai, Wen-Chin Huang, Tzu-hsun Feng, Po-Han Chi, Yist Y. Lin, Yung-Sung Chuang, Tzu-Hsien Huang, Wei-Cheng Tseng, Kushal Lakhotia, Shang-Wen Li, Abdelrahman Mohamed, Shinji Watanabe, Hung-yi Lee
Comments: The extended journal version for SUPERB and SUPERB-SG. Published in IEEE/ACM TASLP. The Arxiv version is preferred
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Signal Processing (eess.SP)
[28] arXiv:2404.09841 [pdf, html, other]
Title: Anatomy of Industrial Scale Multilingual ASR
Francis McCann Ramirez, Luka Chkhetiani, Andrew Ehrenberg, Robert McHardy, Rami Botros, Yash Khare, Andrea Vanzo, Taufiquzzaman Peyash, Gabriel Oexle, Michael Liang, Ilya Sklyar, Enver Fakhan, Ahmed Etefy, Daniel McCrystal, Sam Flamini, Domenic Donato, Takuya Yoshioka
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[29] arXiv:2404.10310 [pdf, html, other]
Title: Wireless Earphone-based Real-Time Monitoring of Breathing Exercises: A Deep Learning Approach
Hassam Khan Wazir, Zaid Waghoo, Vikram Kapila
Comments: 4 pages, 2 figures. Paper accepted at IEEE International Conference on Engineering in Medicine & Biology Society, 2024
Journal-ref: in IEEE International Conference on Engineering in Medicine and Biology Society, 2024, pp. 1-4
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[30] arXiv:2404.10419 [pdf, html, other]
Title: MAD Speech: Measures of Acoustic Diversity of Speech
Matthieu Futeral, Andrea Agostinelli, Marco Tagliasacchi, Neil Zeghidour, Eugene Kharitonov
Comments: NAACL 2025
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[31] arXiv:2404.11399 [pdf, html, other]
Title: In situ sound absorption estimation with the discrete complex image source method
Eric Brandao, William Fonseca, Paulo Mareze, Carlos Resende, Gabriel Azzuz, Joao Pontalti, Efren Fernandez-Grande
Comments: 37 pages, 12 figures, original manuscript to be submitted to the Journal of Sound and Vibration
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Classical Physics (physics.class-ph)
[32] arXiv:2404.11619 [pdf, html, other]
Title: Advancing Speech Translation: A Corpus of Mandarin-English Conversational Telephone Speech
Shannon Wotherspoon, William Hartmann, Matthew Snover
Comments: 2 pages
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[33] arXiv:2404.11621 [pdf, html, other]
Title: Efficient High-Performance Bark-Scale Neural Network for Residual Echo and Noise Suppression
Ernst Seidel, Pejman Mowlaee, Tim Fingscheidt
Comments: accepted to ICASSP 2024; 5 pages, 3 figures
Subjects: Audio and Speech Processing (eess.AS)
[34] arXiv:2404.14564 [pdf, html, other]
Title: Exploring the Potential of Data-Driven Spatial Audio Enhancement Using a Single-Channel Model
Arthur N. dos Santos, Bruno S. Masiero, Túlio C. L. Mateus
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[35] arXiv:2404.14700 [pdf, html, other]
Title: FlashSpeech: Efficient Zero-Shot Speech Synthesis
Zhen Ye, Zeqian Ju, Haohe Liu, Xu Tan, Jianyi Chen, Yiwen Lu, Peiwen Sun, Jiahao Pan, Weizhen Bian, Shulin He, Wei Xue, Qifeng Liu, Yike Guo
Comments: Efficient zero-shot speech synthesis
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[36] arXiv:2404.14860 [pdf, html, other]
Title: Rethinking Processing Distortions: Disentangling the Impact of Speech Enhancement Errors on Speech Recognition Performance
Tsubasa Ochiai, Kazuma Iwamoto, Marc Delcroix, Rintaro Ikeshita, Hiroshi Sato, Shoko Araki, Shigeru Katagiri
Comments: 13 pages, 6 figures, Submitted to IEEE/ACM Trans. Audio, Speech, and Language Processing
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[37] arXiv:2404.14903 [pdf, html, other]
Title: Multi-Sample Dynamic Time Warping for Few-Shot Keyword Spotting
Kevin Wilkinghoff, Alessia Cornaggia-Urrigshardt
Comments: Accepted for presentation at EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Information Retrieval (cs.IR); Sound (cs.SD)
[38] arXiv:2404.14913 [pdf, html, other]
Title: Additive Margin in Contrastive Self-Supervised Frameworks to Learn Discriminative Speaker Representations
Theo Lepage, Reda Dehak
Comments: accepted at Odyssey 2024: The Speaker and Language Recognition Workshop. arXiv admin note: text overlap with arXiv:2306.03664
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[39] arXiv:2404.15168 [pdf, html, other]
Title: Artificial Neural Networks to Recognize Speakers Division from Continuous Bengali Speech
Hasmot Ali, Md. Fahad Hossain, Md. Mehedi Hasan, Sheikh Abujar, Sheak Rashed Haider Noori
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)
[40] arXiv:2404.15176 [pdf, html, other]
Title: Voice Passing : a Non-Binary Voice Gender Prediction System for evaluating Transgender voice transition
David Doukhan, Simon Devauchelle, Lucile Girard-Monneron, Mía Chávez Ruz, V. Chaddouk, Isabelle Wagner, Albert Rilliard
Comments: 5 pages, 1 figure, keywords: Transgender voice, Gender perception, Speaker gender classification, CNN, X-Vector
Journal-ref: Proc. INTERSPEECH 2023, 5207-5211
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)
[41] arXiv:2404.16104 [pdf, html, other]
Title: Evolution of Voices in French Audiovisual Media Across Genders and Age in a Diachronic Perspective
Albert Rilliard, David Doukhan, Rémi Uro, Simon Devauchelle
Comments: 5 pages, 2 figures, keywords:, Gender, Diachrony, Vocal Tract Resonance, Vocal register, Broadcast speech
Journal-ref: Radek Skarnitzl & Jan Vol\'in (Eds.), Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS), Prague 2023, pp. 753-757. Guarant International. ISBN 978-80-908 114-2-3
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[42] arXiv:2404.16547 [pdf, html, other]
Title: Developing Acoustic Models for Automatic Speech Recognition in Swedish
Giampiero Salvi
Comments: 16 pages, 7 figures
Journal-ref: European Student Journal of Language and Speech, 1999
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[43] arXiv:2404.17107 [pdf, html, other]
Title: Exploring Pre-trained General-purpose Audio Representations for Heart Murmur Detection
Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino
Comments: 4 pages, 1 figure, and 4 tables. Accepted by IEEE EMBC 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[44] arXiv:2404.17490 [pdf, html, other]
Title: The CARFAC v2 Cochlear Model in Matlab, NumPy, and JAX
Richard F. Lyon, Rob Schonberger, Malcolm Slaney, Mihajlo Velimirović, Honglin Yu
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[45] arXiv:2404.17552 [pdf, html, other]
Title: A Semi-Automatic Approach to Create Large Gender- and Age-Balanced Speaker Corpora: Usefulness of Speaker Diarization & Identification
Rémi Uro, David Doukhan, Albert Rilliard, Laëtitia Larcher, Anissa-Claire Adgharouamane, Marie Tahon, Antoine Laurent
Comments: Keywords:, semi-automatic processing, corpus creation, diarization, speaker identification, gender-balanced, age-balanced, speaker corpus, diachrony
Journal-ref: Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 3271-3280, Marseille, 20-25 June 2022. European Language Resources Association (ELRA)
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Digital Libraries (cs.DL); Machine Learning (cs.LG); Sound (cs.SD)
[46] arXiv:2404.17810 [pdf, html, other]
Title: A Comparison of Differential Performance Metrics for the Evaluation of Automatic Speaker Verification Fairness
Oubaida Chouchane, Christoph Busch, Chiara Galdi, Nicholas Evans, Massimiliano Todisco
Comments: 8 pages, 7 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[47] arXiv:2404.18501 [pdf, html, other]
Title: Audio-Visual Target Speaker Extraction with Reverse Selective Auditory Attention
Ruijie Tao, Xinyuan Qian, Yidi Jiang, Junjie Li, Jiadong Wang, Haizhou Li
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[48] arXiv:2404.19375 [pdf, other]
Title: Deep low-latency joint speech transmission and enhancement over a gaussian channel
Mohammad Bokaei, Jesper Jensen, Simon Doclo, Jan Østergaard
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[49] arXiv:2404.19723 [pdf, html, other]
Title: Attention-Constrained Inference for Robust Decoder-Only Text-to-Speech
Hankun Wang, Chenpeng Du, Yiwei Guo, Shuai Wang, Xie Chen, Kai Yu
Comments: Accepted by IEEE Spoken Language Technology (SLT) Workshop 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[50] arXiv:2404.00124 (cross-list from cs.CL) [pdf, html, other]
Title: Where Are You From? Let Me Guess! Subdialect Recognition of Speeches in Sorani Kurdish
Sana Isam, Hossein Hassani
Comments: 30 pages, 25 figures, 6 tables
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[51] arXiv:2404.00470 (cross-list from cs.SD) [pdf, other]
Title: Classification of Short Segment Pediatric Heart Sounds Based on a Transformer-Based Convolutional Neural Network
Md Hassanuzzaman, Nurul Akhtar Hasan, Mohammad Abdullah Al Mamun, Khawza I Ahmed, Ahsan H Khandoker, Raqibul Mostafa
Comments: 16 pages,11 Figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[52] arXiv:2404.00569 (cross-list from cs.SD) [pdf, html, other]
Title: CM-TTS: Enhancing Real Time Text-to-Speech Synthesis Efficiency through Weighted Samplers and Consistency Models
Xiang Li, Fan Bu, Ambuj Mehrish, Yingting Li, Jiale Han, Bo Cheng, Soujanya Poria
Comments: Accepted by Findings of NAACL 2024. Code is available at this https URL
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[53] arXiv:2404.00656 (cross-list from cs.CL) [pdf, html, other]
Title: WavLLM: Towards Robust and Adaptive Speech Large Language Model
Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
Comments: accepted by EMNLP2024 findings
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[54] arXiv:2404.00775 (cross-list from cs.SD) [pdf, other]
Title: Measuring Audio Prompt Adherence with Distribution-based Embedding Distances
Maarten Grachten
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[55] arXiv:2404.00789 (cross-list from cs.SD) [pdf, html, other]
Title: A Comparative Analysis of Poetry Reading Audio: Singing, Narrating, or Somewhere In Between?
Kahyun Choi, Minje Kim
Journal-ref: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024, pp. 1296-1300
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[56] arXiv:2404.00791 (cross-list from cs.SD) [pdf, html, other]
Title: Personalized Neural Speech Codec
Inseon Jang, Haici Yang, Wootaek Lim, Seungkwon Beack, Minje Kim
Journal-ref: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024, pp. 991-995
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[57] arXiv:2404.00856 (cross-list from cs.SD) [pdf, html, other]
Title: Removing Speaker Information from Speech Representation using Variable-Length Soft Pooling
Injune Hwang, Kyogu Lee
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[58] arXiv:2404.00989 (cross-list from cs.CV) [pdf, html, other]
Title: 360+x: A Panoptic Multi-modal Scene Understanding Dataset
Hao Chen, Yuqi Hou, Chenyuan Qu, Irene Testini, Xiaohan Hong, Jianbo Jiao
Comments: CVPR 2024 (Oral Presentation), Project page: this https URL
Journal-ref: The IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[59] arXiv:2404.01058 (cross-list from cs.SD) [pdf, other]
Title: A Novel Audio Representation for Music Genre Identification in MIR
Navin Kamuni, Mayank Jindal, Arpita Soni, Sukender Reddy Mallreddy, Sharath Chandra Macha
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[60] arXiv:2404.01611 (cross-list from cs.LG) [pdf, other]
Title: Audio Simulation for Sound Source Localization in Virtual Evironment
Yi Di Yuan, Swee Liang Wong, Jonathan Pan
Comments: 2024 IEEE World Forum on Public Safety Technology
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[61] arXiv:2404.01616 (cross-list from cs.CL) [pdf, html, other]
Title: Transforming LLMs into Cross-modal and Cross-lingual Retrieval Systems
Frank Palma Gomez, Ramon Sanabria, Yun-hsuan Sung, Daniel Cer, Siddharth Dalmia, Gustavo Hernandez Abrego
Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[62] arXiv:2404.01620 (cross-list from cs.SD) [pdf, other]
Title: Voice EHR: Introducing Multimodal Audio Data for Health
James Anibal, Hannah Huth, Ming Li, Lindsey Hazen, Veronica Daoud, Dominique Ebedes, Yen Minh Lam, Hang Nguyen, Phuc Hong, Michael Kleinman, Shelley Ost, Christopher Jackson, Laura Sprabery, Cheran Elangovan, Balaji Krishnaiah, Lee Akst, Ioan Lina, Iqbal Elyazar, Lenny Ekwati, Stefan Jansen, Richard Nduwayezu, Charisse Garcia, Jeffrey Plum, Jacqueline Brenner, Miranda Song, Emily Ricotta, David Clifton, C. Louise Thwaites, Yael Bensoussan, Bradford Wood
Comments: 21 pages, 5 figures, 6 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Audio and Speech Processing (eess.AS)
[63] arXiv:2404.01657 (cross-list from cs.CL) [pdf, html, other]
Title: Release of Pre-Trained Models for the Japanese Language
Kei Sawada, Tianyu Zhao, Makoto Shing, Kentaro Mitsui, Akio Kaga, Yukiya Hono, Toshiaki Wakatsuki, Koh Mitsuda
Comments: 9 pages, 1 figure, 5 tables, accepted for LREC-COLING 2024. Models are publicly available at this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[64] arXiv:2404.01740 (cross-list from cs.SD) [pdf, html, other]
Title: Weakly-supervised Audio Separation via Bi-modal Semantic Similarity
Tanvir Mahmud, Saeed Amizadeh, Kazuhito Koishida, Diana Marculescu
Comments: Tech report. Accepted in ICLR-2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[65] arXiv:2404.01751 (cross-list from cs.CV) [pdf, html, other]
Title: T-VSL: Text-Guided Visual Sound Source Localization in Mixtures
Tanvir Mahmud, Yapeng Tian, Diana Marculescu
Comments: Accepted in CVPR-2024. Code: this https URL
Journal-ref: IEEE/CVF Computer Vision and Pattern Recognition (CVPR) Conference, 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[66] arXiv:2404.01981 (cross-list from cs.LG) [pdf, html, other]
Title: Zero-Shot Multi-Lingual Speaker Verification in Clinical Trials
Ali Akram, Marija Stanojevic, Malikeh Ehghaghi, Jekaterina Novikova
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[67] arXiv:2404.02000 (cross-list from cs.CL) [pdf, html, other]
Title: Africa-Centric Self-Supervised Pre-Training for Multilingual Speech Representation in a Sub-Saharan Context
Antoine Caubrière, Elodie Gauthier
Comments: To appear in AfricaNLP 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[68] arXiv:2404.02063 (cross-list from cs.SD) [pdf, html, other]
Title: SPMamba: State-space model is all you need in speech separation
Kai Li, Guo Chen, Runxuan Yang, Xiaolin Hu
Comments: Technical Report. Code is available at this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[69] arXiv:2404.02088 (cross-list from cs.CL) [pdf, html, other]
Title: LastResort at SemEval-2024 Task 3: Exploring Multimodal Emotion Cause Pair Extraction as Sequence Labelling Task
Suyash Vardhan Mathur, Akshett Rai Jindal, Hardik Mittal, Manish Shrivastava
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[70] arXiv:2404.02252 (cross-list from cs.SD) [pdf, html, other]
Title: SMITIN: Self-Monitored Inference-Time INtervention for Generative Music Transformers
Junghyun Koo, Gordon Wichern, Francois G. Germain, Sameer Khurana, Jonathan Le Roux
Journal-ref: IEEE Open Journal of Signal Processing, 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[71] arXiv:2404.02342 (cross-list from cs.CL) [pdf, other]
Title: A Computational Analysis of Lyric Similarity Perception
Haven Kim, Taketo Akama
Comments: In the process of a detailed revision
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[72] arXiv:2404.02456 (cross-list from cs.CL) [pdf, html, other]
Title: PhonologyBench: Evaluating Phonological Skills of Large Language Models
Ashima Suvarna, Harshita Khandelwal, Nanyun Peng
Comments: 17 pages, 7 figures, 6 tables
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[73] arXiv:2404.02592 (cross-list from cs.CL) [pdf, other]
Title: Leveraging the Interplay Between Syntactic and Acoustic Cues for Optimizing Korean TTS Pause Formation
Yejin Jeon, Yunsu Kim, Gary Geunbae Lee
Comments: Accepted to LREC-COLING 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[74] arXiv:2404.02710 (cross-list from cs.CL) [pdf, html, other]
Title: ART: The Alternating Reading Task Corpus for Speech Entrainment and Imitation
Zheng Yuan, Dorina de Jong, Štefan Beňuš, Noël Nguyen, Ruitao Feng, Róbert Sabo, Luciano Fadiga, Alessandro D`Ausilio
Comments: 15 pages, 2 figures, 7 tables, accepted at LREC-COLING 2024 conference
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[75] arXiv:2404.03073 (cross-list from cs.CL) [pdf, html, other]
Title: Mai Ho'omāuna i ka 'Ai: Language Models Improve Automatic Speech Recognition in Hawaiian
Kaavya Chaparala, Guido Zarrella, Bruce Torres Fischer, Larry Kimura, Oiwi Parker Jones
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[76] arXiv:2404.03179 (cross-list from cs.CV) [pdf, html, other]
Title: UniAV: Unified Audio-Visual Perception for Multi-Task Video Event Localization
Tiantian Geng, Teng Wang, Yanfu Zhang, Jinming Duan, Weili Guan, Feng Zheng, Ling shao
Comments: This work has been submitted to the IEEE for possible publication
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[77] arXiv:2404.03312 (cross-list from cs.CL) [pdf, html, other]
Title: M3TCM: Multi-modal Multi-task Context Model for Utterance Classification in Motivational Interviews
Sayed Muddashir Hossain, Jan Alexandersson, Philipp Müller
Comments: Accepted for publication at LREC-COLING'24
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[78] arXiv:2404.03520 (cross-list from physics.class-ph) [pdf, html, other]
Title: Correlation and Spectral Density Functions in Mode-Stirred Reverberation -- II. Spectral Moments, Sampling, Noise, EMI and Understirring
Luk R. Arnaut, John M. Ladbury
Comments: 13 pages, 11 figures
Journal-ref: IEEE Trans. Electromagn. Compat., 2024
Subjects: Classical Physics (physics.class-ph); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[79] arXiv:2404.03606 (cross-list from cs.SD) [pdf, html, other]
Title: Analyzing Musical Characteristics of National Anthems in Relation to Global Indices
S M Rakib Hasan, Aakar Dhakal, Ms. Ayesha Siddiqua, Mohammad Mominur Rahman, Md Maidul Islam, Mohammed Arfat Raihan Chowdhury, S M Masfequier Rahman Swapno, SM Nuruzzaman Nobel
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[80] arXiv:2404.03894 (cross-list from cs.SD) [pdf, html, other]
Title: Holon: a cybernetic interface for bio-semiotics
Jon McCormack, Elliott Wilson
Comments: Paper accepted at ISEA 24, The 29th International Symposium on Electronic Art, Brisbane, Australia, 21-29 June 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Audio and Speech Processing (eess.AS)
[81] arXiv:2404.03914 (cross-list from cs.HC) [pdf, html, other]
Title: Open vocabulary keyword spotting through transfer learning from speech synthesis
Kesavaraj V, Anil Kumar Vuppala
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[82] arXiv:2404.04295 (cross-list from cs.CL) [pdf, html, other]
Title: Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition
Hainan Xu, Zhehuai Chen, Fei Jia, Boris Ginsburg
Comments: accepted at the ICASSP 2024 conference
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[83] arXiv:2404.04386 (cross-list from cs.SD) [pdf, html, other]
Title: "It is okay to be uncommon": Quantizing Sound Event Detection Networks on Hardware Accelerators with Uncommon Sub-Byte Support
Yushu Wu, Xiao Quan, Mohammad Rasool Izadi, Chuan-Che Huang
Comments: 5 pages, 2 figures, Accepted to ICASSP 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[84] arXiv:2404.04420 (cross-list from cs.SD) [pdf, html, other]
Title: The NES Video-Music Database: A Dataset of Symbolic Video Game Music Paired with Gameplay Videos
Igor Cardoso, Rubens O. Moraes, Lucas N. Ferreira
Comments: Accepted for publication at the 19th International Conference on the Foundations of Digital Games
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[85] arXiv:2404.04645 (cross-list from cs.CL) [pdf, html, other]
Title: HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworks
Yingting Li, Rishabh Bhardwaj, Ambuj Mehrish, Bo Cheng, Soujanya Poria
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[86] arXiv:2404.04739 (cross-list from cs.SD) [pdf, html, other]
Title: Mathematics of the MML functional quantizer modules for VCV Rack software synthesizer
Maxwell Schneider, Cody McCarthy, Michael G. Maxwell, Joshua Pfeffer, Robert Schneider, Andrew V. Sills
Comments: 4 pages, published in Infinite Loop: an online journal for undergraduate research and applied computing projects (2024)
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); History and Overview (math.HO)
[87] arXiv:2404.04904 (cross-list from cs.SD) [pdf, html, other]
Title: Cross-Domain Audio Deepfake Detection: Dataset and Analysis
Yuang Li, Min Zhang, Mengxin Ren, Miaomiao Ma, Daimeng Wei, Hao Yang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[88] arXiv:2404.05071 (cross-list from cs.LG) [pdf, html, other]
Title: Test-Time Training for Depression Detection
Sri Harsha Dumpala, Chandramouli Shama Sastry, Rudolf Uher, Sageev Oore
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[89] arXiv:2404.05160 (cross-list from cs.CL) [pdf, other]
Title: Linguistic Changes in Spontaneous Speech for Detecting Parkinsons Disease Using Large Language Models
Jonathan Crawford
Comments: 12 pages, 3 figures
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[90] arXiv:2404.05206 (cross-list from cs.CV) [pdf, html, other]
Title: SoundingActions: Learning How Actions Sound from Narrated Egocentric Videos
Changan Chen, Kumar Ashutosh, Rohit Girdhar, David Harwath, Kristen Grauman
Comments: Accepted at CVPR 2024. Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[91] arXiv:2404.05600 (cross-list from cs.CL) [pdf, html, other]
Title: SpeechAlign: Aligning Speech Generation to Human Preferences
Dong Zhang, Zhaowei Li, Shimin Li, Xin Zhang, Pengyu Wang, Yaqian Zhou, Xipeng Qiu
Comments: Work in progress
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[92] arXiv:2404.05659 (cross-list from cs.CL) [pdf, html, other]
Title: VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain
Khai Le-Duc
Comments: LREC-COLING 2024 (Oral), 24 pages
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[93] arXiv:2404.05765 (cross-list from cs.SD) [pdf, other]
Title: A Novel Bi-LSTM And Transformer Architecture For Generating Tabla Music
Roopa Mayya, Vivekanand Venkataraman, Anwesh P R, Narayana Darapaneni
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[94] arXiv:2404.06103 (cross-list from cs.SD) [pdf, html, other]
Title: Exploring Diverse Sounds: Identifying Outliers in a Music Corpus
Le Cai, Sam Ferguson, Gengfa Fang, Hani Alshamrani
Journal-ref: The 16th International Symposium on Computer Music Multidisciplinary Research,2023
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[95] arXiv:2404.06292 (cross-list from cs.CL) [pdf, html, other]
Title: nEMO: Dataset of Emotional Speech in Polish
Iwona Christop
Comments: Accepted for LREC-Coling 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[96] arXiv:2404.06393 (cross-list from cs.SD) [pdf, html, other]
Title: MuPT: A Generative Symbolic Music Pretrained Transformer
Xingwei Qu, Yuelin Bai, Yinghao Ma, Ziya Zhou, Ka Man Lo, Jiaheng Liu, Ruibin Yuan, Lejun Min, Xueling Liu, Tianyu Zhang, Xinrun Du, Shuyue Guo, Yiming Liang, Yizhi Li, Shangda Wu, Junting Zhou, Tianyu Zheng, Ziyang Ma, Fengze Han, Wei Xue, Gus Xia, Emmanouil Benetos, Xiang Yue, Chenghua Lin, Xu Tan, Stephen W. Huang, Jie Fu, Ge Zhang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[97] arXiv:2404.06674 (cross-list from cs.SD) [pdf, html, other]
Title: VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing
Philip Anastassiou, Zhenyu Tang, Kainan Peng, Dongya Jia, Jiaxin Li, Ming Tu, Yuping Wang, Yuxuan Wang, Mingbo Ma
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[98] arXiv:2404.06682 (cross-list from cs.SD) [pdf, html, other]
Title: Learning Multidimensional Disentangled Representations of Instrumental Sounds for Musical Similarity Assessment
Yuka Hashizume, Li Li, Atsushi Miyashita, Tomoki Toda
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[99] arXiv:2404.06714 (cross-list from cs.CL) [pdf, html, other]
Title: Llama-VITS: Enhancing TTS Synthesis with Semantic Awareness
Xincan Feng, Akifumi Yoshimoto
Comments: 9 pages, 2 figures, 4 tables; accepted at LREC-COLING 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[100] arXiv:2404.07336 (cross-list from cs.CV) [pdf, html, other]
Title: PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scores
Lucas Goncalves, Prashant Mathur, Chandrashekhar Lavania, Metehan Cekic, Marcello Federico, Kyu J. Han
Comments: 24 pages
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
Total of 191 entries : 1-100 101-191
Showing up to 100 entries per page: fewer | more | all