Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Sound

Authors and titles for recent submissions

See today's new changes

Total of 55 entries : 1-50 51-55
Showing up to 50 entries per page: fewer | more | all

Wed, 25 Dec 2024 (showing 12 of 12 entries )

[1] arXiv:2412.18217 [pdf, html, other]
Title: U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation
Shaoxiang Dang, Tetsuya Matsumoto, Yoshinori Takeuchi, Hiroaki Kudo
Journal-ref: 2024 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[2] arXiv:2412.18191 [pdf, html, other]
Title: Explaining Speaker and Spoof Embeddings via Probing
Xuechen Liu, Junichi Yamagishi, Md Sahidullah, Tomi kinnunen
Comments: To appear in IEEE ICASSP 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[3] arXiv:2412.18157 [pdf, html, other]
Title: Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance
Yaoyun Zhang, Xuenan Xu, Mengyue Wu
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[4] arXiv:2412.18061 [pdf, html, other]
Title: Lla-VAP: LSTM Ensemble of Llama and VAP for Turn-Taking Prediction
Hyunbae Jeon, Frederic Guintu, Rayvant Sahni
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[5] arXiv:2412.17924 [pdf, html, other]
Title: Are audio DeepFake detection models polyglots?
Bartłomiej Marek, Piotr Kawa, Piotr Syga
Comments: Keywords: Audio DeepFakes, DeepFake detection, multilingual audio DeepFakes
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[6] arXiv:2412.18603 (cross-list from cs.CL) [pdf, html, other]
Title: Long-Form Speech Generation with Spoken Language Models
Se Jin Park, Julian Salazar, Aren Jansen, Keisuke Kinoshita, Yong Man Ro, RJ Skerry-Ryan
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[7] arXiv:2412.18495 (cross-list from cs.CL) [pdf, html, other]
Title: How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?
Sara Papi, Peter Polak, Ondřej Bojar, Dominik Macháček
Comments: Accepted at TACL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[8] arXiv:2412.18248 (cross-list from cs.LG) [pdf, other]
Title: Detection and Forecasting of Parkinson Disease Progression from Speech Signal Features Using MultiLayer Perceptron and LSTM
Majid Ali, Hina Shakir, Asia Samreen, Sohaib Ahmed
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[9] arXiv:2412.18141 (cross-list from eess.AS) [pdf, html, other]
Title: Neural Directed Speech Enhancement with Dual Microphone Array in High Noise Scenario
Wen Wen, Qiang Zhou, Yu Xi, Haoyu Li, Ziqi Gong, Kai Yu
Comments: Accepted by ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[10] arXiv:2412.18107 (cross-list from eess.AS) [pdf, html, other]
Title: SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Training
Jiaxing Yu, Xinda Wu, Yunfei Xu, Tieyao Zhang, Songruoyao Wu, Le Ma, Kejun Zhang
Comments: Extended version of paper accepted to AAAI 2025
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[11] arXiv:2412.17907 (cross-list from cs.HC) [pdf, other]
Title: A Multimodal Emotion Recognition System: Integrating Facial Expressions, Body Movement, Speech, and Spoken Language
Kris Kraack
Comments: 10 pages, 6 figures, 3 tables
Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[12] arXiv:2412.17851 (cross-list from eess.SP) [pdf, html, other]
Title: Noisereduce: Domain General Noise Reduction for Time Series Signals
Tim Sainburg, Asaf Zorea
Comments: Python library: this https URL or `pip install noisereduce`
Subjects: Signal Processing (eess.SP); Sound (cs.SD)

Tue, 24 Dec 2024 (showing 22 of 22 entries )

[13] arXiv:2412.17667 [pdf, html, other]
Title: VERSA: A Versatile Evaluation Toolkit for Speech, Audio, and Music
Jiatong Shi, Hye-jin Shim, Jinchuan Tian, Siddhant Arora, Haibin Wu, Darius Petermann, Jia Qi Yip, You Zhang, Yuxun Tang, Wangyou Zhang, Dareen Safar Alharthi, Yichen Huang, Koichi Saito, Jionghao Han, Yiwen Zhao, Chris Donahue, Shinji Watanabe
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[14] arXiv:2412.17306 [pdf, html, other]
Title: Multiple Consistency-guided Test-Time Adaptation for Contrastive Audio-Language Models with Unlabeled Audio
Gongyu Chen, Haomin Zhang, Chaofan Ding, Zihao Chen, Xinhan Di
Comments: 6 pages, 1 figure, accepted by ICASSP 2025
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[15] arXiv:2412.17212 [pdf, html, other]
Title: Trainingless Adaptation of Pretrained Models for Environmental Sound Classification
Noriyuki Tonami, Wataru Kohno, Keisuke Imoto, Yoshiyuki Yajima, Sakiko Mishima, Reishi Kondo, Tomoyuki Hino
Comments: Accepted to ICASSP2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[16] arXiv:2412.16928 [pdf, html, other]
Title: AV-DTEC: Self-Supervised Audio-Visual Fusion for Drone Trajectory Estimation and Classification
Zhenyuan Xiao, Yizhuo Yang, Guili Xu, Xianglong Zeng, Shenghai Yuan
Comments: Submitted to ICRA 2025
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[17] arXiv:2412.16904 [pdf, html, other]
Title: Temporal-Frequency State Space Duality: An Efficient Paradigm for Speech Emotion Recognition
Jiaqi Zhao, Fei Wang, Kun Li, Yanyan Wei, Shengeng Tang, Shu Zhao, Xiao Sun
Comments: Accepted by ICASSP 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[18] arXiv:2412.16861 [pdf, html, other]
Title: SoundLoc3D: Invisible 3D Sound Source Localization and Classification Using a Multimodal RGB-D Acoustic Camera
Yuhang He, Sangyun Shin, Anoop Cherian, Andrew Markham
Comments: Accepted by WACV2025
Journal-ref: WACV2025
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[19] arXiv:2412.16626 [pdf, html, other]
Title: Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement
Junyu Wang, Zizhen Lin, Tianrui Wang, Meng Ge, Longbiao Wang, Jianwu Dang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[20] arXiv:2412.16530 [pdf, html, other]
Title: Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translation
Lucas Goncalves, Prashant Mathur, Xing Niu, Brady Houston, Chandrashekhar Lavania, Srikanth Vishnubhotla, Lijia Sun, Anthony Ferritto
Comments: Accepted at ICASSP, 4 pages
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[21] arXiv:2412.16526 [pdf, html, other]
Title: Text2midi: Generating Symbolic Music from Captions
Keshav Bhandari, Abhinaba Roy, Kyra Wang, Geeta Puri, Simon Colton, Dorien Herremans
Comments: 9 pages, 3 figures, Accepted at the 39th AAAI Conference on Artificial Intelligence (AAAI 2025)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[22] arXiv:2412.16267 [pdf, html, other]
Title: A Classification Benchmark for Artificial Intelligence Detection of Laryngeal Cancer from Patient Speech
Mary Paterson, James Moor, Luisa Cutillo
Comments: 24 pages, 6 figures, 7 tables
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)
[23] arXiv:2412.16182 [pdf, other]
Title: Decoding Poultry Vocalizations -- Natural Language Processing and Transformer Models for Semantic and Emotional Analysis
Venkatraman Manikandan, Suresh Neethirajan
Comments: 28 Pages, 14 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[24] arXiv:2412.16176 [pdf, html, other]
Title: Efficient VoIP Communications through LLM-based Real-Time Speech Reconstruction and Call Prioritization for Emergency Services
Danush Venkateshperumal, Rahman Abdul Rafi, Shakil Ahmed, Ashfaq Khokhar
Comments: 15 pages,8 figures
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[25] arXiv:2412.17796 (cross-list from eess.AS) [pdf, html, other]
Title: Investigating Prosodic Signatures via Speech Pre-Trained Models for Audio Deepfake Source Attribution
Orchid Chetia Phukan, Drishti Singh, Swarup Ranjan Behera, Arun Balaji Buduru, Rajesh Sharma
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[26] arXiv:2412.17164 (cross-list from eess.AS) [pdf, html, other]
Title: Analysis of Speech Temporal Dynamics in the Context of Speaker Verification and Voice Anonymization
Natalia Tomashenko, Emmanuel Vincent, Marc Tommasi
Comments: Accepted at ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[27] arXiv:2412.17129 (cross-list from eess.AS) [pdf, html, other]
Title: Uncovering the Visual Contribution in Audio-Visual Speech Recognition
Zhaofeng Lin, Naomi Harte
Comments: 5 pages, 2 figures. Accepted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[28] arXiv:2412.17121 (cross-list from eess.AS) [pdf, html, other]
Title: Scalable Speech Enhancement with Dynamic Channel Pruning
Riccardo Miccini, Clement Laroche, Tobias Piechowiak, Luca Pezzarossa
Comments: Accepted for publication at the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[29] arXiv:2412.17048 (cross-list from eess.AS) [pdf, other]
Title: Why Do Speech Language Models Fail to Generate Semantically Coherent Outputs? A Modality Evolving Perspective
Hankun Wang, Haoran Wang, Yiwei Guo, Zhihan Li, Chenpeng Du, Xie Chen, Kai Yu
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[30] arXiv:2412.16982 (cross-list from cs.CV) [pdf, html, other]
Title: InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions
Ronghui Li, Youliang Zhang, Yachao Zhang, Yuxiang Zhang, Mingyang Su, Jie Guo, Ziwei Liu, Yebin Liu, Xiu Li
Comments: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[31] arXiv:2412.16915 (cross-list from cs.CV) [pdf, html, other]
Title: FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation
Tianyun Zhong, Chao Liang, Jianwen Jiang, Gaojie Lin, Jiaqi Yang, Zhou Zhao
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[32] arXiv:2412.16846 (cross-list from eess.AS) [pdf, html, other]
Title: Autoregressive Speech Synthesis with Next-Distribution Prediction
Xinfa Zhu, Wenjie Tian, Lei Xie
Comments: Technical report, work in progress
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[33] arXiv:2412.16507 (cross-list from cs.CL) [pdf, html, other]
Title: Adapting Whisper for Code-Switching through Encoding Refining and Language-Aware Decoding
Jiahui Zhao, Hao Shi, Chenrui Cui, Tianrui Wang, Hexin Liu, Zhaoheng Ni, Lingxuan Ye, Longbiao Wang
Journal-ref: ICASSP 2025
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[34] arXiv:2412.11090 (cross-list from cs.CL) [pdf, other]
Title: Hanprome: Modified Hangeul for Expression of foreign language pronunciation
Wonchan Kim, Michelle Meehyun Kim
Comments: 21 pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Mon, 23 Dec 2024 (showing 8 of 8 entries )

[35] arXiv:2412.15602 [pdf, other]
Title: Music Genre Classification: Ensemble Learning with Subcomponents-level Attention
Yichen Liu, Abhijit Dasgupta, Qiwei He
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[36] arXiv:2412.15230 [pdf, html, other]
Title: Early Dementia Detection Using Multiple Spontaneous Speech Prompts: The PROCESS Challenge
Fuxiang Tao, Bahman Mirheidari, Madhurananda Pahar, Sophie Young, Yao Xiao, Hend Elghazaly, Fritz Peters, Caitlin Illingworth, Dorota Braun, Ronan O'Malley, Simon Bell, Daniel Blackburn, Fasih Haider, Saturnino Luz, Heidi Christensen
Comments: 2 pages, no figure, conference
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[37] arXiv:2412.15995 (cross-list from cs.CL) [pdf, html, other]
Title: Data-Centric Improvements for Enhancing Multi-Modal Understanding in Spoken Conversation Modeling
Maximillian Chen, Ruoxi Sun, Sercan Ö. Arık
Comments: 22 pages, 6 figures, 14 tables
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[38] arXiv:2412.15922 (cross-list from cs.LG) [pdf, html, other]
Title: RiTTA: Modeling Event Relations in Text-to-Audio Generation
Yuhang He, Yash Jain, Xubo Liu, Andrew Markham, Vibhav Vineet
Comments: Audio Events Relation Modeling in TTA Generative Model. Code: this https URL
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[39] arXiv:2412.15560 (cross-list from q-bio.NC) [pdf, html, other]
Title: Predicting Artificial Neural Network Representations to Learn Recognition Model for Music Identification from Brain Recordings
Taketo Akama, Zhuohao Zhang, Pengcheng Li, Kotaro Hongo, Hiroaki Kitano, Shun Minamikawa, Natalia Polouliakh
Comments: 18 pages, 10 figures
Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[40] arXiv:2412.15322 (cross-list from cs.CV) [pdf, html, other]
Title: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
Ho Kei Cheng, Masato Ishii, Akio Hayakawa, Takashi Shibuya, Alexander Schwing, Yuki Mitsufuji
Comments: Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[41] arXiv:2412.15299 (cross-list from cs.CL) [pdf, html, other]
Title: LAMA-UT: Language Agnostic Multilingual ASR through Orthography Unification and Language-Specific Transliteration
Sangmin Lee, Woo-Jin Chung, Hong-Goo Kang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[42] arXiv:2412.15220 (cross-list from cs.MM) [pdf, html, other]
Title: SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text
Haohe Liu, Gael Le Lan, Xinhao Mei, Zhaoheng Ni, Anurag Kumar, Varun Nagaraja, Wenwu Wang, Mark D. Plumbley, Yangyang Shi, Vikas Chandra
Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

Fri, 20 Dec 2024 (showing 4 of 4 entries )

[43] arXiv:2412.15023 [pdf, html, other]
Title: Stable-V2A: Synthesis of Synchronized Sound Effects with Temporal and Semantic Controls
Riccardo Fosco Gramaccioni, Christian Marinoni, Emilian Postolache, Marco Comunità, Luca Cosmo, Joshua D. Reiss, Danilo Comminiello
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[44] arXiv:2412.15191 (cross-list from cs.CV) [pdf, html, other]
Title: AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation
Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Ivan Skorokhodov, Alper Canberk, Kwot Sin Lee, Vicente Ordonez, Sergey Tulyakov
Comments: Project Page: this http URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[45] arXiv:2412.15054 (cross-list from cs.CV) [pdf, html, other]
Title: GIRAFE: Glottal Imaging Dataset for Advanced Segmentation, Analysis, and Facilitative Playbacks Evaluation
G. Andrade-Miranda, K. Chatzipapas, J.D. Arias-Londoño, J. I. Godino-Llorente
Comments: 18 pages, 8 figures
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[46] arXiv:2412.14890 (cross-list from eess.AS) [pdf, html, other]
Title: Scale This, Not That: Investigating Key Dataset Attributes for Efficient Speech Enhancement Scaling
Leying Zhang, Wangyou Zhang, Chenda Li, Yanmin Qian
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

Thu, 19 Dec 2024 (showing first 4 of 9 entries )

[47] arXiv:2412.13514 [pdf, html, other]
Title: Tuning Music Education: AI-Powered Personalization in Learning Music
Mayank Sanganeria, Rohan Gala
Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Creative AI Track
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[48] arXiv:2412.13462 [pdf, html, other]
Title: SAVGBench: Benchmarking Spatially Aligned Audio-Video Generation
Kazuki Shimada, Christian Simon, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
Comments: 5 pages, 3 figures
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[49] arXiv:2412.13421 [pdf, html, other]
Title: Detecting Machine-Generated Music with Explainability -- A Challenge and Early Benchmarks
Yupei Li, Qiyang Sun, Hanqian Li, Lucia Specia, Björn W. Schuller
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[50] arXiv:2412.13279 [pdf, html, other]
Title: Synthetic Speech Classification: IEEE Signal Processing Cup 2022 challenge
Mahieyin Rahmun, Rafat Hasan Khan, Tanjim Taharat Aurpa, Sadia Khan, Zulker Nayeen Nahiyan, Mir Sayad Bin Almas, Rakibul Hasan Rajib, Syeda Sakira Hassan
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 55 entries : 1-50 51-55
Showing up to 50 entries per page: fewer | more | all