Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Audio and Speech Processing

Authors and titles for October 2024

Total of 358 entries
Showing up to 2000 entries per page: fewer | more | all
[1] arXiv:2410.00035 [pdf, html, other]
Title: FeruzaSpeech: A 60 Hour Uzbek Read Speech Corpus with Punctuation, Casing, and Context
Anna Povey, Katherine Povey
Comments: 5 Pages, 1 Figure, Preprint of Paper Accepted in ICNLSP 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)
[2] arXiv:2410.00037 [pdf, html, other]
Title: Moshi: a speech-text foundation model for real-time dialogue
Alexandre Défossez, Laurent Mazaré, Manu Orsini, Amélie Royer, Patrick Pérez, Hervé Jégou, Edouard Grave, Neil Zeghidour
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[3] arXiv:2410.00070 [pdf, html, other]
Title: Mamba for Streaming ASR Combined with Unimodal Aggregation
Ying Fang, Xiaofei Li
Comments: Accepted by ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[4] arXiv:2410.00390 [pdf, html, other]
Title: Multi-Scale Temporal Transformer For Speech Emotion Recognition
Zhipeng Li, Xiaofen Xing, Yuanbo Fang, Weibin Zhang, Hengsheng Fan, Xiangmin Xu
Subjects: Audio and Speech Processing (eess.AS)
[5] arXiv:2410.00511 [pdf, html, other]
Title: Pre-training with Synthetic Patterns for Audio
Yuchi Ishikawa, Tatsuya Komatsu, Yoshimitsu Aoki
Comments: Submitted to ICASSP'25
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
[6] arXiv:2410.00527 [pdf, html, other]
Title: An alternative Approach in Voice Extraction
The Hieu Pham, Phuong Thanh Tran Nguyen, Xuan Tho Nguyen, Tan Dat Nguyen, Duc Dung Nguyen
Comments: work in progress
Subjects: Audio and Speech Processing (eess.AS)
[7] arXiv:2410.00528 [pdf, other]
Title: End-to-End Speech Recognition with Pre-trained Masked Language Model
Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
Subjects: Audio and Speech Processing (eess.AS)
[8] arXiv:2410.00680 [pdf, html, other]
Title: The Conformer Encoder May Reverse the Time Dimension
Robin Schmitt, Albert Zeyer, Mohammad Zeineldeen, Ralf Schlüter, Hermann Ney
Comments: Accepted at ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Machine Learning (stat.ML)
[9] arXiv:2410.01108 [pdf, html, other]
Title: Augmentation through Laundering Attacks for Audio Spoof Detection
Hashim Ali, Surya Subramani, Hafiz Malik
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[10] arXiv:2410.01150 [pdf, html, other]
Title: Restorative Speech Enhancement: A Progressive Approach Using SE and Codec Modules
Hsin-Tien Chiang, Hao Zhang, Yong Xu, Meng Yu, Dong Yu
Comments: Paper in submission
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[11] arXiv:2410.01162 [pdf, html, other]
Title: Frozen Large Language Models Can Perceive Paralinguistic Aspects of Speech
Wonjune Kang, Junteng Jia, Chunyang Wu, Wei Zhou, Egor Lakomkin, Yashesh Gaur, Leda Sari, Suyoun Kim, Ke Li, Jay Mahadeokar, Ozlem Kalinli
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[12] arXiv:2410.01562 [pdf, html, other]
Title: HRTF Estimation using a Score-based Prior
Etienne Thuillier, Jean-Marie Lemercier, Eloi Moliner, Timo Gerkmann, Vesa Välimäki
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[13] arXiv:2410.01841 [pdf, other]
Title: A GEN AI Framework for Medical Note Generation
Hui Yi Leong, Yi Fan Gao, Shuai Ji, Bora Kalaycioglu, Uktu Pamuksuz
Comments: 8 Figures, 7 page, IEEE standard research paper
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Sound (cs.SD)
[14] arXiv:2410.02056 [pdf, html, other]
Title: Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Data
Sreyan Ghosh, Sonal Kumar, Zhifeng Kong, Rafael Valle, Bryan Catanzaro, Dinesh Manocha
Comments: Accepted at ICLR 2025. Code and Checkpoints available here: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[15] arXiv:2410.02364 [pdf, html, other]
Title: State-of-the-art Embeddings with Video-free Segmentation of the Source VoxCeleb Data
Sara Barahona, Ladislav Mošner, Themos Stafylakis, Oldřich Plchot, Junyi Peng, Lukáš Burget, Jan Černocký
Comments: This work has been submitted to the IEEE for possible publication
Subjects: Audio and Speech Processing (eess.AS)
[16] arXiv:2410.02371 [pdf, html, other]
Title: NTU-NPU System for Voice Privacy 2024 Challenge
Nikita Kuzmin, Hieu-Thi Luong, Jixun Yao, Lei Xie, Kong Aik Lee, Eng Siong Chng
Comments: System description for VPC 2024
Journal-ref: 2024 Challenge. Proc. 4th Symposium on Security and Privacy in Speech Communication, 72-79
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[17] arXiv:2410.03007 [pdf, html, other]
Title: FastAdaSP: Multitask-Adapted Efficient Inference for Large Speech Language Model
Yichen Lu, Jiaqi Song, Chao-Han Huck Yang, Shinji Watanabe
Comments: EMNLP 2024 Industry Track
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[18] arXiv:2410.03139 [pdf, html, other]
Title: How does the teacher rate? Observations from the NeuroPiano dataset
Huan Zhang, Vincent Cheung, Hayato Nishioka, Simon Dixon, Shinichi Furuya
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[19] arXiv:2410.03192 [pdf, html, other]
Title: MultiVerse: Efficient and Expressive Zero-Shot Multi-Task Text-to-Speech
Taejun Bak, Youngsik Eom, SeungJae Choi, Young-Sun Joo
Comments: Accepted to EMNLP 2024 Findings
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[20] arXiv:2410.03280 [pdf, other]
Title: Manikin-Recorded Cardiopulmonary Sounds Dataset Using Digital Stethoscope
Yasaman Torabi, Shahram Shirani, James P. Reilly
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Signal Processing (eess.SP)
[21] arXiv:2410.03298 [pdf, html, other]
Title: Textless Streaming Speech-to-Speech Translation using Semantic Speech Tokens
Jinzheng Zhao, Niko Moritz, Egor Lakomkin, Ruiming Xie, Zhiping Xiu, Katerina Zmolikova, Zeeshan Ahmed, Yashesh Gaur, Duc Le, Christian Fuegen
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS)
[22] arXiv:2410.04017 [pdf, html, other]
Title: Adversarial Attacks and Robust Defenses in Speaker Embedding based Zero-Shot Text-to-Speech System
Ze Li, Yao Shi, Yunfei Xu, Ming Li
Subjects: Audio and Speech Processing (eess.AS)
[23] arXiv:2410.04092 [pdf, html, other]
Title: Enhancement of Dysarthric Speech Reconstruction by Contrastive Learning
Keshvari Fatemeh, Mahdian Toroghi Rahil, Zareian Hassan
Subjects: Audio and Speech Processing (eess.AS)
[24] arXiv:2410.04198 [pdf, html, other]
Title: DJ Mix Transcription with Multi-Pass Non-Negative Matrix Factorization
Étienne Paul André, Dominique Fourer, Diemo Schwarz
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[25] arXiv:2410.04380 [pdf, html, other]
Title: HALL-E: Hierarchical Neural Codec Language Model for Minute-Long Zero-Shot Text-to-Speech Synthesis
Yuto Nishimura, Takumi Hirose, Masanari Ohi, Hideki Nakayama, Nakamasa Inoue
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[26] arXiv:2410.04690 [pdf, html, other]
Title: SegINR: Segment-wise Implicit Neural Representation for Sequence Alignment in Neural Text-to-Speech
Minchan Kim, Myeonghun Jeong, Joun Yeop Lee, Nam Soo Kim
Comments: This work has been submitted to the IEEE for possible publication
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[27] arXiv:2410.04785 [pdf, html, other]
Title: Towards Ultra-Low-Power Neuromorphic Speech Enhancement with Spiking-FullSubNet
Xiang Hao, Chenxiang Ma, Qu Yang, Jibin Wu, Kay Chen Tan
Comments: under review
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[28] arXiv:2410.04951 [pdf, html, other]
Title: A decade of DCASE: Achievements, practices, evaluations and future challenges
Annamaria Mesaros, Romain Serizel, Toni Heittola, Tuomas Virtanen, Mark D. Plumbley
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[29] arXiv:2410.05101 [pdf, html, other]
Title: CR-CTC: Consistency regularization on CTC for improved speech recognition
Zengwei Yao, Wei Kang, Xiaoyu Yang, Fangjun Kuang, Liyong Guo, Han Zhu, Zengrui Jin, Zhaoqing Li, Long Lin, Daniel Povey
Comments: Published as a conference paper at ICLR 2025
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[30] arXiv:2410.05151 [pdf, html, other]
Title: Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer
Siyuan Hou, Shansong Liu, Ruibin Yuan, Wei Xue, Ying Shan, Mangsuo Zhao, Chao Zhang
Comments: Accepted for publication at ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[31] arXiv:2410.05302 [pdf, other]
Title: Episodic fine-tuning prototypical networks for optimization-based few-shot learning: Application to audio classification
Xuanyu Zhuang (LTCI, IP Paris, S2A, IDS), Geoffroy Peeters (LTCI, IP Paris, S2A, IDS), Gaël Richard (S2A, IDS, LTCI, IP Paris)
Comments: Accepted at MLSP 2024
Journal-ref: 2024 IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2024), Sep 2024, London (UK), United Kingdom
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Signal Processing (eess.SP)
[32] arXiv:2410.05320 [pdf, html, other]
Title: The OCON model: an old but gold solution for distributable supervised classification
Stefano Giacomelli, Marco Giordano, Claudia Rinaldi
Comments: Accepted at "2024 29th IEEE Symposium on Computers and Communications (ISCC): workshop on Next-Generation Multimedia Services at the Edge: Leveraging 5G and Beyond (NGMSE2024)". arXiv admin note: text overlap with arXiv:2410.04098
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB); Machine Learning (cs.LG); Sound (cs.SD)
[33] arXiv:2410.05620 [pdf, html, other]
Title: Improving Data Augmentation-based Cross-Speaker Style Transfer for TTS with Singing Voice, Style Filtering, and F0 Matching
Leonardo B. de M. M. Marques, Lucas H. Ueda, Mário U. Neto, Flávio O. Simões, Fernando Runstein, Bianca Dal Bó, Paula D. P. Costa
Comments: Submitted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[34] arXiv:2410.05724 [pdf, html, other]
Title: Exploring rhythm formant analysis for Indic language classification
Parismita Gogoi, Sishir Kalita, Priyankoo Sarmah, S.R Mahadeva Prasanna
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[35] arXiv:2410.05986 [pdf, html, other]
Title: The USTC-NERCSLIP Systems for the CHiME-8 MMCSG Challenge
Ya Jiang, Hongbo Lan, Jun Du, Qing Wang, Shutong Niu
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[36] arXiv:2410.05997 [pdf, html, other]
Title: An Eye for an Ear: Zero-shot Audio Description Leveraging an Image Captioner using Audiovisual Distribution Alignment
Hugo Malard, Michel Olvera, Stéphane Lathuiliere, Slim Essid
Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
[37] arXiv:2410.06670 [pdf, html, other]
Title: LS-EEND: Long-Form Streaming End-to-End Neural Diarization with Online Attractor Extraction
Di Liang, Xiaofei Li
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[38] arXiv:2410.06787 [pdf, html, other]
Title: Efficient training strategies for natural sounding speech synthesis and speaker adaptation based on FastPitch
Teodora Răgman, Adriana Stan
Comments: Accepted at 2024 IEEE 20th International Conference on Intelligent Computer Communication and Processing (ICCP 2024)
Subjects: Audio and Speech Processing (eess.AS)
[39] arXiv:2410.06885 [pdf, html, other]
Title: F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching
Yushen Chen, Zhikang Niu, Ziyang Ma, Keqi Deng, Chunhui Wang, Jian Zhao, Kai Yu, Xie Chen
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[40] arXiv:2410.07277 [pdf, html, other]
Title: Swin-BERT: A Feature Fusion System designed for Speech-based Alzheimer's Dementia Detection
Yilin Pan, Yanpei Shi, Yijia Zhang, Mingyu Lu
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
[41] arXiv:2410.07379 [pdf, html, other]
Title: Learn from Real: Reality Defender's Submission to ASVspoof5 Challenge
Yi Zhu, Chirag Goel, Surya Koppisetti, Trang Tran, Ankur Kumar, Gaurav Bharaj
Comments: Accepted into ASVspoof5 workshop
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[42] arXiv:2410.07428 [pdf, html, other]
Title: The First VoicePrivacy Attacker Challenge Evaluation Plan
Natalia Tomashenko, Xiaoxiao Miao, Emmanuel Vincent, Junichi Yamagishi
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
[43] arXiv:2410.07935 [pdf, html, other]
Title: Robust Fixed-Filter Sound Zone Control with Audio-Based Position Tracking
Sankha Subhra Bhattacharjee, Andreas Jonas Fuglsig, Flemming Christensen, Jesper Rindom Jensen, Mads Græsbøll Christensen
Comments: Equal contribution by Sankha Subhra Bhattacharjee and Andreas Jonas Fuglsig. Accepted at ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[44] arXiv:2410.07978 [pdf, html, other]
Title: Sound Zone Control Robust To Sound Speed Change
Sankha Subhra Bhattacharjee, Jesper Rindom Jensen, Mads Græsbøll Christensen
Comments: 5 pages, 4 figures, submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[45] arXiv:2410.07982 [pdf, html, other]
Title: Window Function-less DFT with Reduced Noise and Latency for Real-Time Music Analysis
Cai Biesinger, Hiromitsu Awano, Masanori Hashimoto
Comments: 5 pages, 4 figures, Submitted to EUSIPCO 2025. TeX-generated PDF exemption due to formatting problems on arXiv. This version: clarified text throughout, updated data after further optimization work, added more comparisons and a table, added references
Subjects: Audio and Speech Processing (eess.AS)
[46] arXiv:2410.08250 [pdf, html, other]
Title: Exploring ASR-Based Wav2Vec2 for Automated Speech Disorder Assessment: Insights and Analysis
Tuan Nguyen, Corinne Fredouille, Alain Ghio, Mathieu Balaguer, Virginie Woisard
Comments: Accepted at the Spoken Language Technology (SLT) Conference 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
[47] arXiv:2410.08325 [pdf, html, other]
Title: Low Bitrate High-Quality RVQGAN-based Discrete Speech Tokenizer
Slava Shechtman, Avihu Dekel
Comments: You can download the model from this https URL
Journal-ref: Proc. Interspeech 2024, 4174-4178
Subjects: Audio and Speech Processing (eess.AS)
[48] arXiv:2410.08919 [pdf, html, other]
Title: Low-complexity Attention-based Unsupervised Anomalous Sound Detection exploiting Separable Convolutions and Angular Loss
Michael Neri, Marco Carli
Comments: Accepted for publication in IEEE Sensors Letters. 4 pages, 4 figures
Subjects: Audio and Speech Processing (eess.AS)
[49] arXiv:2410.09236 [pdf, other]
Title: Enhancing Infant Crying Detection with Gradient Boosting for Improved Emotional and Mental Health Diagnostics
Kyunghun Lee, Lauren M. Henry, Eleanor Hansen, Elizabeth Tandilashvili, Lauren S. Wakschlag, Elizabeth Norton, Daniel S. Pine, Melissa A. Brotman, Francisco Pereira
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[50] arXiv:2410.09503 [pdf, html, other]
Title: SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs
Wenxi Chen, Ziyang Ma, Xiquan Li, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Kai Yu, Xie Chen
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[51] arXiv:2410.09636 [pdf, html, other]
Title: Can We Estimate Purchase Intention Based on Zero-shot Speech Emotion Recognition?
Ryotaro Nagase, Takashi Sumiyoshi, Natsuo Yamashita, Kota Dohi, Yohei Kawaguchi
Comments: 5 pages, 3 figures, accepted for APSIPA 2024 ASC
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[52] arXiv:2410.10434 [pdf, other]
Title: In-Materia Speech Recognition
Mohamadreza Zolfagharinejad, Julian Büchel, Lorenzo Cassola, Sachin Kinge, Ghazi Sarwat Syed, Abu Sebastian, Wilfred G. van der Wiel
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[53] arXiv:2410.11025 [pdf, html, other]
Title: Code Drift: Towards Idempotent Neural Audio Codecs
Patrick O'Reilly, Prem Seetharaman, Jiaqi Su, Zeyu Jin, Bryan Pardo
Comments: ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[54] arXiv:2410.11097 [pdf, html, other]
Title: DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis
Yingahao Aaron Li, Rithesh Kumar, Zeyu Jin
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[55] arXiv:2410.11181 [pdf, html, other]
Title: DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detection
Sheng Yan, Cunhang fan, Hongyu Zhang, Xiaoke Yang, Jianhua Tao, Zhao Lv
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)
[56] arXiv:2410.11190 [pdf, html, other]
Title: Mini-Omni2: Towards Open-source GPT-4o with Vision, Speech and Duplex Capabilities
Zhifei Xie, Changqiao Wu
Comments: Technical report, work in progress. Demo and code: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
[57] arXiv:2410.11453 [pdf, other]
Title: The importance of spatial and spectral information in multiple speaker tracking
Hanan Beit-On, Vladimir Tourbabin, Boaz Rafaely
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[58] arXiv:2410.11865 [pdf, html, other]
Title: Automatic Screening for Children with Speech Disorder using Automatic Speech Recognition: Opportunities and Challenges
Dancheng Liu, Jason Yang, Ishan Albrecht-Buehler, Helen Qin, Sophie Li, Yuting Hu, Amir Nassereldine, Jinjun Xiong
Comments: AAAI-FSS 24
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)
[59] arXiv:2410.12182 [pdf, html, other]
Title: Guided Speaker Embedding
Shota Horiguchi, Takafumi Moriya, Atsushi Ando, Takanori Ashihara, Hiroshi Sato, Naohiro Tawara, Marc Delcroix
Comments: Accepted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[60] arXiv:2410.12266 [pdf, html, other]
Title: FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation
Huadai Liu, Jialei Wang, Rongjie Huang, Yang Liu, Heng Lu, Wei Xue, Zhou Zhao
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[61] arXiv:2410.12279 [pdf, html, other]
Title: Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR
Christoph Minixhofer, Ondrej Klejch, Peter Bell
Comments: Under review at ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[62] arXiv:2410.12359 [pdf, other]
Title: ERVQ: Enhanced Residual Vector Quantization with Intra-and-Inter-Codebook Optimization for Neural Audio Codecs
Rui-Chen Zheng, Hui-Peng Du, Xiao-Hang Jiang, Yang Ai, Zhen-Hua Ling
Subjects: Audio and Speech Processing (eess.AS)
[63] arXiv:2410.12536 [pdf, other]
Title: SiFiSinger: A High-Fidelity End-to-End Singing Voice Synthesizer based on Source-filter Model
Jianwei Cui, Yu Gu, Chao Weng, Jie Zhang, Liping Chen, Lirong Dai
Comments: Accepted by ICASSP 2024, Synthesized audio samples are available at: this https URL
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[64] arXiv:2410.12567 [pdf, html, other]
Title: SeQuiFi: Mitigating Catastrophic Forgetting in Speech Emotion Recognition with Sequential Class-Finetuning
Sarthak Jain, Orchid Chetia Phukan, Swarup Ranjan Behera, Arun Balaji Buduru, Rajesh Sharma
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[65] arXiv:2410.12645 [pdf, html, other]
Title: Beyond Speech and More: Investigating the Emergent Ability of Speech Foundation Models for Classifying Physiological Time-Series Signals
Orchid Chetia Phukan, Swarup Ranjan Behera, Girish, Mohd Mujtaba Akhtar, Arun Balaji Buduru, Rajesh Sharma
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[66] arXiv:2410.12675 [pdf, html, other]
Title: SWIM: An Attention-Only Model for Speech Quality Assessment Under Subjective Variance
Imran E Kibria, Donald S. Williamson
Subjects: Audio and Speech Processing (eess.AS)
[67] arXiv:2410.12885 [pdf, html, other]
Title: Exploiting Longitudinal Speech Sessions via Voice Assistant Systems for Early Detection of Cognitive Decline
Kristin Qi, Jiatong Shi, Caroline Summerour, John A. Batsis, Xiaohui Liang
Comments: IEEE International Conference on E-health Networking, Application & Services
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Quantitative Methods (q-bio.QM)
[68] arXiv:2410.12897 [pdf, html, other]
Title: AI-Enhanced Acoustic Analysis for Comprehensive Biodiversity Monitoring and Assessment
Kumar Srinivas Bobba, Kartheeban K, Vamsi Krishna Sai, Dinesh Bugga, Vijaya Mani Surendra Bolla
Subjects: Audio and Speech Processing (eess.AS)
[69] arXiv:2410.12947 [pdf, html, other]
Title: Multi-View Multi-Task Modeling with Speech Foundation Models for Speech Forensic Tasks
Orchid Chetia Phukan, Devyani Koshal, Swarup Ranjan Behera, Arun Balaji Buduru, Rajesh Sharma
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[70] arXiv:2410.13182 [pdf, html, other]
Title: Using RLHF to align speech enhancement approaches to mean-opinion quality scores
Anurag Kumar, Andrew Perrault, Donald S. Williamson
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[71] arXiv:2410.13198 [pdf, html, other]
Title: Failing Forward: Improving Generative Error Correction for ASR with Synthetic Data and Retrieval Augmentation
Sreyan Ghosh, Mohammad Sadegh Rasooli, Michael Levit, Peidong Wang, Jian Xue, Dinesh Manocha, Jinyu Li
Comments: Preprint. Under Review
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[72] arXiv:2410.13221 [pdf, html, other]
Title: Investigating Effective Speaker Property Privacy Protection in Federated Learning for Speech Emotion Recognition
Chao Tan, Sheng Li, Yang Cao, Zhao Ren, Tanja Schultz
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[73] arXiv:2410.13288 [pdf, html, other]
Title: DurIAN-E 2: Duration Informed Attention Network with Adaptive Variational Autoencoder and Adversarial Learning for Expressive Text-to-Speech Synthesis
Yu Gu, Qiushi Zhu, Guangzhi Lei, Chao Weng, Dan Su
Comments: Accepted by ICASSP2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[74] arXiv:2410.13342 [pdf, html, other]
Title: DART: Disentanglement of Accent and Speaker Representation in Multispeaker Text-to-Speech
Jan Melechovsky, Ambuj Mehrish, Berrak Sisman, Dorien Herremans
Comments: Accepted in Audio Imagination workshop of NeurIPS 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[75] arXiv:2410.13357 [pdf, html, other]
Title: Enhancing Crowdsourced Audio for Text-to-Speech Models
José Giraldo, Martí Llopart-Font, Alex Peiró-Lilja, Carme Armentano-Oller, Gerard Sant, Baybars Külebi
Comments: Submitted to Iberspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[76] arXiv:2410.13385 [pdf, html, other]
Title: On the Use of Audio to Improve Dialogue Policies
Daniel Roncel, Federico Costa, Javier Hernando
Comments: IberSpeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[77] arXiv:2410.13411 [pdf, html, other]
Title: STCON System for the CHiME-8 Challenge
Anton Mitrofanov, Tatiana Prisyach, Tatiana Timofeeva, Sergei Novoselov, Maxim Korenevsky, Yuri Khokhlov, Artem Akulov, Alexander Anikin, Roman Khalili, Iurii Lezhenin, Aleksandr Melnikov, Dmitriy Miroshnichenko, Nikita Mamaev, Ilya Odegov, Olga Rudnitskaya, Aleksei Romanenko
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[78] arXiv:2410.13599 [pdf, html, other]
Title: GAN-Based Speech Enhancement for Low SNR Using Latent Feature Conditioning
Shrishti Saha Shetu, Emanuël A. P. Habets, Andreas Brendel
Comments: 5 pages, 2 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[79] arXiv:2410.13620 [pdf, html, other]
Title: Align-ULCNet: Towards Low-Complexity and Robust Acoustic Echo and Noise Reduction
Shrishti Saha Shetu, Naveen Kumar Desiraju, Wolfgang Mack, Emanuël A. P. Habets
Comments: 5 pages, 4 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[80] arXiv:2410.14197 [pdf, html, other]
Title: A Unified Framework for Collecting Text-to-Speech Synthesis Datasets for 22 Indian Languages
Sujitha Sathiyamoorthy (1), N Mohana (1), Anusha Prakash (3), Hema A Murthy (1 and 2) ((1) Dept of Computer Science & Engineering, Indian Institute of Technology Madras, Chennai, India (2) Shiv Nadar University Chennai, India, (3) Independent Researcher Bengaluru, India)
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS)
[81] arXiv:2410.14910 [pdf, html, other]
Title: AC-Mix: Self-Supervised Adaptation for Low-Resource Automatic Speech Recognition using Agnostic Contrastive Mixup
Carlos Carvalho, Alberto Abad
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[82] arXiv:2410.15078 [pdf, html, other]
Title: Independent Feature Enhanced Crossmodal Fusion for Match-Mismatch Classification of Speech Stimulus and EEG Response
Shitong Fan, Wenbo Wang, Feiyang Xiao, Shiheng Zhang, Qiaoxi Zhu, Jian Guan
Comments: Shitong Fan and Wenbo Wang contributed equally. Accepted by the International Symposium on Chinese Spoken Language Processing (ISCSLP) 2024
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[83] arXiv:2410.15764 [pdf, html, other]
Title: LSCodec: Low-Bitrate and Speaker-Decoupled Discrete Speech Codec
Yiwei Guo, Zhihan Li, Chenpeng Du, Hankun Wang, Xie Chen, Kai Yu
Comments: 5 pages, 2 figures, 4 tables. Demo page: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[84] arXiv:2410.16048 [pdf, html, other]
Title: Continuous Speech Synthesis using per-token Latent Diffusion
Arnon Turetzky, Nimrod Shabtay, Slava Shechtman, Hagai Aronowitz, David Haws, Ron Hoory, Avihu Dekel
Comments: Preprint, Under review
Subjects: Audio and Speech Processing (eess.AS)
[85] arXiv:2410.16059 [pdf, html, other]
Title: Multi-Level Speaker Representation for Target Speaker Extraction
Ke Zhang, Junjie Li, Shuai Wang, Yangjie Wei, Yi Wang, Yannan Wang, Haizhou Li
Comments: 5 pages. Submitted to ICASSP 2025. Implementation will be released at this https URL
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[86] arXiv:2410.16130 [pdf, html, other]
Title: Can Large Audio-Language Models Truly Hear? Tackling Hallucinations with Multi-Task Assessment and Stepwise Audio Reasoning
Chun-Yi Kuan, Hung-yi Lee
Comments: Accepted to ICASSP 2025. Project Website: this https URL
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[87] arXiv:2410.16330 [pdf, html, other]
Title: End-to-End Transformer-based Automatic Speech Recognition for Northern Kurdish: A Pioneering Approach
Abdulhady Abas Abdullah, Shima Tabibian, Hadi Veisi, Aso Mahmudi, Tarik Rashid
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[88] arXiv:2410.16647 [pdf, html, other]
Title: GE2E-KWS: Generalized End-to-End Training and Evaluation for Zero-shot Keyword Spotting
Pai Zhu, Jacob W. Bartel, Dhruuv Agarwal, Kurt Partridge, Hyun Jin Park, Quan Wang
Comments: 8 pages, 6 figures, 2 tables The paper is accepted in IEEE Spoken Language Technology (SLT) 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[89] arXiv:2410.16726 [pdf, html, other]
Title: Enhancing Low-Resource ASR through Versatile TTS: Bridging the Data Gap
Guanrou Yang, Fan Yu, Ziyang Ma, Zhihao Du, Zhifu Gao, Shiliang Zhang, Xie Chen
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[90] arXiv:2410.17028 [pdf, html, other]
Title: Can a Machine Distinguish High and Low Amount of Social Creak in Speech?
Anne-Maria Laukkanen, Sudarsana Reddy Kadiri, Shrikanth Narayanan, Paavo Alku
Comments: Accepted in Journal of Voice
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[91] arXiv:2410.17033 [pdf, html, other]
Title: Prototype and Instance Contrastive Learning for Unsupervised Domain Adaptation in Speaker Verification
Wen Huang, Bing Han, Zhengyang Chen, Shuai Wang, Yanmin Qian
Comments: Accepted to ISCSLP 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[92] arXiv:2410.17437 [pdf, html, other]
Title: Improving Automatic Speech Recognition with Decoder-Centric Regularisation in Encoder-Decoder Models
Alexander Polok, Santosh Kesiraju, Karel Beneš, Lukáš Burget, Jan Černocký
Subjects: Audio and Speech Processing (eess.AS)
[93] arXiv:2410.17790 [pdf, other]
Title: Regularized autoregressive modeling and its application to audio signal declipping
Ondřej Mokrý, Pavel Rajmic
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[94] arXiv:2410.17834 [pdf, html, other]
Title: Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speech
Danilo de Oliveira, Julius Richter, Jean-Marie Lemercier, Simon Welker, Timo Gerkmann
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[95] arXiv:2410.18908 [pdf, html, other]
Title: A Survey on Speech Large Language Models
Jing Peng, Yucheng Wang, Yu Xi, Xu Li, Xizhuo Zhang, Kai Yu
Subjects: Audio and Speech Processing (eess.AS)
[96] arXiv:2410.19168 [pdf, html, other]
Title: MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
S Sakshi, Utkarsh Tyagi, Sonal Kumar, Ashish Seth, Ramaneswaran Selvakumar, Oriol Nieto, Ramani Duraiswami, Sreyan Ghosh, Dinesh Manocha
Comments: Project Website: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
[97] arXiv:2410.19595 [pdf, html, other]
Title: Mask-Weighted Spatial Likelihood Coding for Speaker-Independent Joint Localization and Mask Estimation
Jakob Kienegger, Alina Mannanova, Timo Gerkmann
Comments: ©2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[98] arXiv:2410.20095 [pdf, html, other]
Title: Analyzing long-term rhythm variations in Mising and Assamese using frequency domain correlates
Parismita Gogoi, Priyankoo Sarmah, S. R. M. Prasanna
Comments: Submitted to International Journal of Asian Language Processing (IJALP)
Subjects: Audio and Speech Processing (eess.AS)
[99] arXiv:2410.20578 [pdf, html, other]
Title: Meta-Learning Approaches for Improving Detection of Unseen Speech Deepfakes
Ivan Kukanov, Janne Laakkonen, Tomi Kinnunen, Ville Hautamäki
Comments: 6 pages, accepted to the IEEE Spoken Language Technology Workshop (SLT) 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[100] arXiv:2410.21455 [pdf, html, other]
Title: Simultaneous Diarization and Separation of Meetings through the Integration of Statistical Mixture Models
Tobias Cord-Landwehr, Christoph Boeddeker, Reinhold Haeb-Umbach
Comments: Accepted at ICASSP2025
Subjects: Audio and Speech Processing (eess.AS)
[101] arXiv:2410.21640 [pdf, html, other]
Title: A Tutorial on Clinical Speech AI Development: From Data Collection to Model Validation
Si-Ioi Ng, Lingfeng Xu, Ingo Siegert, Nicholas Cummins, Nina R. Benway, Julie Liss, Visar Berisha
Comments: 76 pages, 24 figures
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[102] arXiv:2410.21797 [pdf, html, other]
Title: Representational learning for an anomalous sound detection system with source separation model
Seunghyeon Shin, Seokjin Lee
Comments: DCASE 2024 workshop published
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[103] arXiv:2410.21951 [pdf, html, other]
Title: Fast and High-Quality Auto-Regressive Speech Synthesis via Speculative Decoding
Bohan Li, Hankun Wang, Situo Zhang, Yiwei Guo, Kai Yu
Comments: Accepted by ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[104] arXiv:2410.22033 [pdf, html, other]
Title: Timbre Difference Capturing in Anomalous Sound Detection
Tomoya Nishida, Harsh Purohit, Kota Dohi, Takashi Endo, Yohei Kawaguchi
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[105] arXiv:2410.22056 [pdf, html, other]
Title: Retrieval-Augmented Approach for Unsupervised Anomalous Sound Detection and Captioning without Model Training
Ryoya Ogura, Tomoya Nishida, Yohei Kawaguchi
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[106] arXiv:2410.22271 [pdf, html, other]
Title: Leveraging Reverberation and Visual Depth Cues for Sound Event Localization and Detection with Distance Estimation
Davide Berghi, Philip J. B. Jackson
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV); Signal Processing (eess.SP)
[107] arXiv:2410.22448 [pdf, html, other]
Title: A Closer Look at Neural Codec Resynthesis: Bridging the Gap between Codec and Waveform Generation
Alexander H. Liu, Qirui Wang, Yuan Gong, James Glass
Comments: NeurIPS 2024 Audio Imagination workshop paper; demo page at this https URL
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[108] arXiv:2410.22807 [pdf, html, other]
Title: APCodec+: A Spectrum-Coding-Based High-Fidelity and High-Compression-Rate Neural Audio Codec with Staged Training Paradigm
Hui-Peng Du, Yang Ai, Rui-Chen Zheng, Zhen-Hua Ling
Comments: Accepted by ISCSLP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[109] arXiv:2410.22903 [pdf, html, other]
Title: Augmenting Polish Automatic Speech Recognition System With Synthetic Data
Łukasz Bondaruk, Jakub Kubiak, Mateusz Czyżnikiewicz
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[110] arXiv:2410.23015 [pdf, html, other]
Title: Audiovisual angle and voice incongruence do not affect audiovisual verbal short-term memory in virtual reality
Cosima A. Ermert, Manuj Yadav, Jonathan Ehret, Chinthusa Mohanathasan, Andrea Bönsch, Torsten W. Kuhlen, Sabine J. Schlittmeier, Janina Fels
Comments: Submitted to PlosOne, 19 pages, 6 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[111] arXiv:2410.23293 [pdf, html, other]
Title: DDMD: AI-Powered Digital Drug Music Detector
Mohamed Gharzouli
Comments: 14 pages
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[112] arXiv:2410.23320 [pdf, html, other]
Title: Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesis
Théodor Lemerle, Harrison Vanderbyl, Vaibhav Srivastav, Nicolas Obin, Axel Roebel
Comments: Preprint
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[113] arXiv:2410.23323 [pdf, html, other]
Title: Exploiting Phonological Similarities between African Languages to achieve Speech to Speech Translation
Peter Ochieng, Dennis Kaburu
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[114] arXiv:2410.23325 [pdf, other]
Title: Transfer Learning in Vocal Education: Technical Evaluation of Limited Samples Describing Mezzo-soprano
Zhenyi Hou, Xu Zhao, Kejie Ye, Xinyu Sheng, Shanggerile Jiang, Jiajing Xia, Yitao Zhang, Chenxi Ban, Daijun Luo, Jiaxing Chen, Yan Zou, Yuchao Feng, Guangyu Fan, Xin Yuan
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)
[115] arXiv:2410.23523 [pdf, html, other]
Title: Novel View Acoustic Parameter Estimation
Ricardo Falcon-Perez, Ruohan Gao, Gregor Mueckl, Sebastia V. Amengual Gari, Ishwarya Ananthabhotla
Comments: 10 pages main text, 27 pages total; submitted to ICLR 2025, under review
Subjects: Audio and Speech Processing (eess.AS)
[116] arXiv:2410.23955 [pdf, html, other]
Title: An Empirical Analysis of Speech Self-Supervised Learning at Multiple Resolutions
Theo Clark, Benedetta Cevoli, Eloy de Jong, Timofey Abramski, Jamie Dougherty
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[117] arXiv:2410.23987 [pdf, html, other]
Title: Task-Aware Unified Source Separation
Kohei Saijo, Janek Ebbers, François G. Germain, Gordon Wichern, Jonathan Le Roux
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[118] arXiv:2410.24066 [pdf, html, other]
Title: Cough-E: A multimodal, privacy-preserving cough detection algorithm for the edge
Stefano Albini, Lara Orlandic, Jonathan Dan, Jérôme Thevenot, Tomas Teijeiro, Denisa Andreea Constantinescu, David Atienza
Comments: 14 pages, 10 figures
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[119] arXiv:2410.24177 [pdf, html, other]
Title: DC-Spin: A Speaker-invariant Speech Tokenizer for Spoken Language Models
Heng-Jui Chang, Hongyu Gong, Changhan Wang, James Glass, Yu-An Chung
Comments: Preprint
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[120] arXiv:2410.00023 (cross-list from eess.SP) [pdf, html, other]
Title: Self-Tuning Spectral Clustering for Speaker Diarization
Nikhil Raghav, Avisek Gupta, Md Sahidullah, Swagatam Das
Comments: Submitted to ICASSP 2025
Subjects: Signal Processing (eess.SP); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[121] arXiv:2410.00025 (cross-list from cs.CL) [pdf, html, other]
Title: Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach
Maxime Poli, Emmanuel Chemla, Emmanuel Dupoux
Comments: Accepted at EMNLP 2024 main conference. 9 pages, 4 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[122] arXiv:2410.00036 (cross-list from cs.HC) [pdf, html, other]
Title: InsightPulse: An IoT-based System for User Experience Interview Analysis
Dian Lyu, Yuetong Lu, Jassie He, Murad Mehrab Abrar, Ruijun Xie, John Raiti
Comments: Accepted for publication at the 10th IEEE International Conference on Collaboration and Internet Computing (IEEE CIC 2024), Washington D.C., USA
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[123] arXiv:2410.00168 (cross-list from cs.CL) [pdf, html, other]
Title: SSR: Alignment-Aware Modality Connector for Speech Language Models
Weiting Tan, Hirofumi Inaguma, Ning Dong, Paden Tomasello, Xutai Ma
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[124] arXiv:2410.00210 (cross-list from cs.SD) [pdf, html, other]
Title: End-to-end Piano Performance-MIDI to Score Conversion with Transformers
Tim Beyer, Angela Dai
Comments: 6 pages, to appear at ISMIR 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[125] arXiv:2410.00316 (cross-list from cs.CL) [pdf, html, other]
Title: EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control
Haozhe Chen, Run Chen, Julia Hirschberg
Comments: EMNLP 2024 Main
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[126] arXiv:2410.00344 (cross-list from cs.SD) [pdf, html, other]
Title: Integrating Text-to-Music Models with Language Models: Composing Long Structured Music Pieces
Lilac Atassi
Comments: arXiv admin note: substantial text overlap with arXiv:2404.11976
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[127] arXiv:2410.00667 (cross-list from cs.SD) [pdf, other]
Title: Contribution of soundscape appropriateness to soundscape quality assessment in space: a mediating variable affecting acoustic comfort
Xinhao Yang, Guangyu Zhang, Xiaodong Lu, Yuan Zhang, Jian Kang
Comments: Accepted by Journal of Environmental Management
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Classical Physics (physics.class-ph)
[128] arXiv:2410.00767 (cross-list from cs.SD) [pdf, html, other]
Title: Zero-Shot Text-to-Speech from Continuous Text Streams
Trung Dang, David Aponte, Dung Tran, Tianyi Chen, Kazuhito Koishida
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[129] arXiv:2410.00811 (cross-list from cs.SD) [pdf, html, other]
Title: Improving curriculum learning for target speaker extraction with synthetic speakers
Yun Liu, Xuechen Liu, Junichi Yamagishi
Comments: Accepted by SLT2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[130] arXiv:2410.00822 (cross-list from cs.SD) [pdf, html, other]
Title: VHASR: A Multimodal Speech Recognition System With Vision Hotwords
Jiliang Hu, Zuchao Li, Ping Wang, Haojun Ai, Lefei Zhang, Hai Zhao
Comments: 14 pages, 6 figures, accepted by EMNLP 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[131] arXiv:2410.00872 (cross-list from cs.SD) [pdf, other]
Title: Do Music Generation Models Encode Music Theory?
Megan Wei, Michael Freeman, Chris Donahue, Chen Sun
Comments: Accepted at ISMIR 2024. Dataset: this https URL Code: this https URL Website: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[132] arXiv:2410.00980 (cross-list from cs.SD) [pdf, html, other]
Title: Heterogeneous sound classification with the Broad Sound Taxonomy and Dataset
Panagiota Anastasopoulou, Jessica Torrey, Xavier Serra, Frederic Font
Comments: DCASE2024, post-print, 5 pages, 2 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[133] arXiv:2410.01020 (cross-list from cs.CV) [pdf, html, other]
Title: A Critical Assessment of Visual Sound Source Localization Models Including Negative Audio
Xavier Juanola, Gloria Haro, Magdalena Fuentes
Comments: Accepted in ICASSP 2025
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[134] arXiv:2410.01036 (cross-list from cs.CL) [pdf, html, other]
Title: MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages
Marco Gaido, Sara Papi, Luisa Bentivogli, Alessio Brutti, Mauro Cettolo, Roberto Gretter, Marco Matassoni, Mohamed Nabih, Matteo Negri
Comments: Accepted at EMNLP 2024 Main Conference
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[135] arXiv:2410.01350 (cross-list from cs.SD) [pdf, html, other]
Title: Takin-VC: Expressive Zero-Shot Voice Conversion via Adaptive Hybrid Content Encoding and Enhanced Timbre Modeling
Yuguang Yang, Yu Pan, Jixun Yao, Xiang Zhang, Jianhao Ye, Hongbin Zhou, Lei Xie, Lei Ma, Jianjun Zhao
Comments: Work in Progress; Under Review
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[136] arXiv:2410.01448 (cross-list from cs.IR) [pdf, html, other]
Title: Analyzing Byte-Pair Encoding on Monophonic and Polyphonic Symbolic Music: A Focus on Musical Phrase Segmentation
Dinh-Viet-Toan Le, Louis Bigo, Mikaela Keller
Comments: Accepted to 3rd Workshop on NLP for Music and Audio (NLP4MusA, co-located with ISMIR 2024)
Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[137] arXiv:2410.01469 (cross-list from cs.SD) [pdf, html, other]
Title: TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation
Mohan Xu, Kai Li, Guo Chen, Xiaolin Hu
Comments: Accepted by ICLR 2025, demo page: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[138] arXiv:2410.01481 (cross-list from cs.SD) [pdf, html, other]
Title: SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios
Kai Li, Wendi Sang, Chang Zeng, Runxuan Yang, Guo Chen, Xiaolin Hu
Comments: Accepted by ICLR 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[139] arXiv:2410.02060 (cross-list from cs.SD) [pdf, html, other]
Title: PerTok: Expressive Encoding and Modeling of Symbolic Musical Ideas and Variations
Julian Lenz, Anirudh Mani
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[140] arXiv:2410.02084 (cross-list from cs.SD) [pdf, html, other]
Title: Generating Symbolic Music from Natural Language Prompts using an LLM-Enhanced Dataset
Weihan Xu, Julian McAuley, Taylor Berg-Kirkpatrick, Shlomo Dubnov, Hao-Wen Dong
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[141] arXiv:2410.02130 (cross-list from cs.SD) [pdf, html, other]
Title: MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation
Trung X. Pham, Tri Ton, Chang D. Yoo
Comments: ICLR 2025
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[142] arXiv:2410.02144 (cross-list from cs.SD) [pdf, html, other]
Title: SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Model
Xinlei Niu, Jing Zhang, Charles Patrick Martin
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[143] arXiv:2410.02239 (cross-list from cs.SD) [pdf, html, other]
Title: A Pilot Study of Applying Sequence-to-Sequence Voice Conversion to Evaluate the Intelligibility of L2 Speech Using a Native Speaker's Shadowings
Haopeng Geng, Daisuke Saito, Nobuaki Minematsu
Comments: Accepted by APSIPA ASC 2024. arXiv admin note: text overlap with arXiv:2409.11742
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[144] arXiv:2410.02271 (cross-list from cs.SD) [pdf, html, other]
Title: CoLLAP: Contrastive Long-form Language-Audio Pretraining with Musical Temporal Structure Augmentation
Junda Wu, Warren Li, Zachary Novack, Amit Namburi, Carol Chen, Julian McAuley
Comments: 4 pages
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[145] arXiv:2410.02560 (cross-list from cs.SD) [pdf, html, other]
Title: Convolutional Variational Autoencoders for Spectrogram Compression in Automatic Speech Recognition
Olga Iakovenko, Ivan Bondarenko
Comments: Theory and Practice of Natural Computing 9th International Conference, TPNC 2020, Taoyuan, Taiwan, 2020, Proceedings 9
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[146] arXiv:2410.03037 (cross-list from cs.CL) [pdf, html, other]
Title: Disentangling Textual and Acoustic Features of Neural Speech Representations
Hosein Mohebbi, Grzegorz Chrupała, Willem Zuidema, Afra Alishahi, Ivan Titov
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[147] arXiv:2410.03264 (cross-list from cs.SD) [pdf, html, other]
Title: Enriching Music Descriptions with a Finetuned-LLM and Metadata for Text-to-Music Retrieval
SeungHeon Doh, Minhee Lee, Dasaem Jeong, Juhan Nam
Comments: Accepted for publication at the IEEE ICASSP 2024
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[148] arXiv:2410.03312 (cross-list from cs.CL) [pdf, html, other]
Title: Context and System Fusion in Post-ASR Emotion Recognition with Large Language Models
Pavel Stepachev, Pinzhen Chen, Barry Haddow
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[149] arXiv:2410.03335 (cross-list from cs.SD) [pdf, html, other]
Title: Audio-Agent: Leveraging LLMs For Audio Generation, Editing and Composition
Zixuan Wang, Chi-Keung Tang, Yu-Wing Tai
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[150] arXiv:2410.03375 (cross-list from cs.SD) [pdf, other]
Title: SoundSignature: What Type of Music Do You Like?
Brandon James Carone, Pablo Ripollés
Comments: 10 pages, 1 figure, to be published in the 2024 International Symposium on the IEEE Internet of Sounds Proceedings
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[151] arXiv:2410.03427 (cross-list from cs.SD) [pdf, html, other]
Title: Biodenoising: Animal Vocalization Denoising without Access to Clean Data
Marius Miron, Sara Keen, Jen-Yu Liu, Benjamin Hoffman, Masato Hagiwara, Olivier Pietquin, Felix Effenberger, Maddie Cusimano
Comments: 5 pages, 2 tables
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[152] arXiv:2410.03459 (cross-list from cs.SD) [pdf, html, other]
Title: Generative Semantic Communication for Text-to-Speech Synthesis
Jiahao Zheng, Jinke Ren, Peng Xu, Zhihao Yuan, Jie Xu, Fangxin Wang, Gui Gui, Shuguang Cui
Comments: The paper has been accepted by IEEE Globecom Workshop
Subjects: Sound (cs.SD); Information Theory (cs.IT); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[153] arXiv:2410.03676 (cross-list from cs.SD) [pdf, html, other]
Title: A quest through interconnected datasets: lessons from highly-cited ICASSP papers
Cynthia C. S. Liem, Doğa Taşcılar, Andrew M. Demetriou
Comments: in Proceedings of the 21st International Conference on Content-based Multimedia Indexing, September 18-20 2024, Reykjavik, Iceland
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[154] arXiv:2410.03719 (cross-list from cs.CL) [pdf, html, other]
Title: FluentEditor2: Text-based Speech Editing by Modeling Multi-Scale Acoustic and Prosody Consistency
Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li
Comments: submitted for an IEEE publication
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[155] arXiv:2410.03734 (cross-list from cs.SD) [pdf, html, other]
Title: Accent conversion using discrete units with parallel data synthesized from controllable accented TTS
Tuan Nam Nguyen, Ngoc Quan Pham, Alexander Waibel
Comments: Accepted at Syndata4genAI
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[156] arXiv:2410.03751 (cross-list from cs.CL) [pdf, html, other]
Title: Recent Advances in Speech Language Models: A Survey
Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, Ziqiao Meng, Guangyan Zhang, Qichao Wang, Yiwen Guo, Irwin King
Comments: Work in progress
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[157] arXiv:2410.03752 (cross-list from cs.SD) [pdf, html, other]
Title: Efficient Streaming LLM for Speech Recognition
Junteng Jia, Gil Keren, Wei Zhou, Egor Lakomkin, Xiaohui Zhang, Chunyang Wu, Frank Seide, Jay Mahadeokar, Ozlem Kalinli
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[158] arXiv:2410.03791 (cross-list from cs.HC) [pdf, html, other]
Title: People are poorly equipped to detect AI-powered voice clones
Sarah Barrington, Emily A. Cooper, Hany Farid
Journal-ref: Scientific Reports 15, 11004, 2025
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[159] arXiv:2410.03798 (cross-list from cs.CL) [pdf, html, other]
Title: Self-Powered LLM Modality Expansion for Large Speech-Text Models
Tengfei Yu, Xuebo Liu, Zhiyi Hou, Liang Ding, Dacheng Tao, Min Zhang
Comments: Accepted to EMNLP 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[160] arXiv:2410.03813 (cross-list from cs.LG) [pdf, html, other]
Title: SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model
Grzegorz Stefański, Paweł Daniluk, Artur Szumaczuk, Jakub Tkaczuk
Comments: NeurIPS 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[161] arXiv:2410.03879 (cross-list from cs.SD) [pdf, html, other]
Title: SONIQUE: Video Background Music Generation Using Unpaired Audio-Visual Data
Liqian Zhang, Magdalena Fuentes
Comments: The paper has been accepted for ICASSP 2025, updating the latest camera-ready version
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[162] arXiv:2410.03904 (cross-list from cs.SD) [pdf, html, other]
Title: Did You Hear That? Introducing AADG: A Framework for Generating Benchmark Data in Audio Anomaly Detection
Ksheeraja Raghavan, Samiran Gode, Ankit Shah, Surabhi Raghavan, Wolfram Burgard, Bhiksha Raj, Rita Singh
Comments: 9 pages, under review
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[163] arXiv:2410.03930 (cross-list from cs.CL) [pdf, html, other]
Title: Reverb: Open-Source ASR and Diarization from Rev
Nishchal Bhandari, Danny Chen, Miguel Ángel del Río Fernández, Natalie Delworth, Jennifer Drexler Fox, Migüel Jetté, Quinten McNamara, Corey Miller, Ondřej Novotný, Ján Profant, Nan Qin, Martin Ratajczak, Jean-Philippe Robichaud
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[164] arXiv:2410.04029 (cross-list from cs.CL) [pdf, html, other]
Title: SyllableLM: Learning Coarse Semantic Units for Speech Language Models
Alan Baade, Puyuan Peng, David Harwath
Comments: 10 pages, 2 figures
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[165] arXiv:2410.04091 (cross-list from cs.LG) [pdf, html, other]
Title: Cross-Lingual Query-by-Example Spoken Term Detection: A Transformer-Based Approach
Allahdadi Fatemeh, Mahdian Toroghi Rahil, Zareian Hassan
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[166] arXiv:2410.04098 (cross-list from cs.SD) [pdf, html, other]
Title: The OCON model: an old but green solution for distributable supervised classification for acoustic monitoring in smart cities
Stefano Giacomelli, Marco Giordano, Claudia Rinaldi
Comments: Accepted at "IEEE 5th International Symposium on the Internet of Sounds, 30 Sep / 2 Oct 2024, Erlangen, Germany"
Journal-ref: in Proceedings of the 5th IEEE International Symposium on the Internet of Sounds (IEEE IS2 2024, https://internetofsounds.net/is2_2024/)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[167] arXiv:2410.04159 (cross-list from cs.SD) [pdf, html, other]
Title: Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer
Tomoki Honda, Shinsuke Sakai, Tatsuya Kawahara
Comments: Submitted to InterSpeech2024, Sample code is available at this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[168] arXiv:2410.04324 (cross-list from cs.SD) [pdf, html, other]
Title: Where are we in audio deepfake detection? A systematic analysis over generative and detection models
Xiang Li, Pin-Yu Chen, Wenqi Wei
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[169] arXiv:2410.04478 (cross-list from cs.SD) [pdf, html, other]
Title: Configurable Multilingual ASR with Speech Summary Representations
Harrison Zhu, Ivan Fung, Yingke Zhu, Lahiru Samarakoon
Comments: A preprint
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[170] arXiv:2410.04534 (cross-list from cs.SD) [pdf, html, other]
Title: UniMuMo: Unified Text, Music and Motion Generation
Han Yang, Kun Su, Yutong Zhang, Jiaben Chen, Kaizhi Qian, Gaowen Liu, Chuang Gan
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[171] arXiv:2410.04702 (cross-list from cs.SD) [pdf, html, other]
Title: Demo of Zero-Shot Guitar Amplifier Modelling: Enhancing Modeling with Hyper Neural Networks
Yu-Hua Chen, Yuan-Chiao Cheng, Yen-Tung Yeh, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang
Comments: demo of the ISMIR paper
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[172] arXiv:2410.04704 (cross-list from cs.SD) [pdf, html, other]
Title: Modeling and Estimation of Vocal Tract and Glottal Source Parameters Using ARMAX-LF Model
Kai Lia, Masato Akagia, Yongwei Lib, Masashi Unokia
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[173] arXiv:2410.04797 (cross-list from cs.SD) [pdf, html, other]
Title: Attentive-based Multi-level Feature Fusion for Voice Disorder Diagnosis
Lipeng Shen, Yifan Xiong, Dongyue Guo, Wei Mo, Lingyu Yu, Hui Yang, Yi Lin
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[174] arXiv:2410.04906 (cross-list from cs.MM) [pdf, html, other]
Title: Art2Mus: Bridging Visual Arts and Music through Cross-Modal Generation
Ivan Rinaldi, Nicola Fanelli, Giovanna Castellano, Gennaro Vessio
Comments: Presented at the AI for Visual Arts (AI4VA) workshop at ECCV 2024
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[175] arXiv:2410.04990 (cross-list from cs.SD) [pdf, html, other]
Title: Stage-Wise and Prior-Aware Neural Speech Phase Prediction
Fei Liu, Yang Ai, Hui-Peng Du, Ye-Xin Lu, Rui-Chen Zheng, Zhen-Hua Ling
Comments: Accepted by SLT2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[176] arXiv:2410.05019 (cross-list from cs.SD) [pdf, html, other]
Title: RelUNet: Relative Channel Fusion U-Net for Multichannel Speech Enhancement
Ibrahim Aldarmaki, Thamar Solorio, Bhiksha Raj, Hanan Aldarmaki
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[177] arXiv:2410.05037 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Speaker Representations Using Contrastive Losses on Multi-scale Features
Satvik Dixit, Massa Baali, Rita Singh, Bhiksha Raj
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[178] arXiv:2410.05146 (cross-list from cs.CL) [pdf, html, other]
Title: CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation
Rui Zhao, Jinyu Li, Ruchao Fan, Matt Post
Comments: Accepted by IEEE Spoken Language Technology Workshop (SLT 2024)
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[179] arXiv:2410.05167 (cross-list from cs.SD) [pdf, html, other]
Title: Presto! Distilling Steps and Layers for Accelerating Music Generation
Zachary Novack, Ge Zhu, Jonah Casebeer, Julian McAuley, Taylor Berg-Kirkpatrick, Nicholas J. Bryan
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[180] arXiv:2410.05301 (cross-list from cs.SD) [pdf, other]
Title: Diffusion-based Unsupervised Audio-visual Speech Enhancement
Jean-Eudes Ayilo (MULTISPEECH), Mostafa Sadeghi (MULTISPEECH), Romain Serizel (MULTISPEECH), Xavier Alameda-Pineda (ROBOTLEARN)
Journal-ref: International Conference on Acoustics Speech and Signal Processing (ICASSP), IEEE, Apr 2025, Hyderabad, India
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[181] arXiv:2410.05361 (cross-list from cs.LG) [pdf, html, other]
Title: RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction
Yuwei Zhang, Tong Xia, Aaqib Saeed, Cecilia Mascolo
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[182] arXiv:2410.05423 (cross-list from cs.SD) [pdf, html, other]
Title: Incorporating Talker Identity Aids With Improving Speech Recognition in Adversarial Environments
Sagarika Alavilli, Annesya Banerjee, Gasser Elbanna, Annika Magaro
Comments: Submitted to ICASSP 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[183] arXiv:2410.05455 (cross-list from cs.LG) [pdf, html, other]
Title: Dynamic HumTrans: Humming Transcription Using CNNs and Dynamic Programming
Shubham Gupta, Isaac Neri Gomez-Sarmiento, Faez Amjed Mezdari, Mirco Ravanelli, Cem Subakan
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[184] arXiv:2410.05647 (cross-list from cs.SD) [pdf, html, other]
Title: FGCL: Fine-grained Contrastive Learning For Mandarin Stuttering Event Detection
Han Jiang, Wenyu Wang, Yiquan Zhou, Hongwu Ding, Jiacheng Xu, Jihua Zhu
Comments: Accepted to SLT 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[185] arXiv:2410.05739 (cross-list from cs.SD) [pdf, html, other]
Title: Array2BR: An End-to-End Noise-immune Binaural Audio Synthesis from Microphone-array Signals
Cheng Chi, Xiaoyu Li, Andong Li, Yuxuan Ke, Xiaodong Li, Chengshi Zheng
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[186] arXiv:2410.05791 (cross-list from cs.GR) [pdf, html, other]
Title: FürElise: Capturing and Physically Synthesizing Hand Motions of Piano Performance
Ruocheng Wang, Pei Xu, Haochen Shi, Elizabeth Schumann, C. Karen Liu
Comments: SIGGRAPH Asia 2024. Project page: this https URL
Subjects: Graphics (cs.GR); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[187] arXiv:2410.05920 (cross-list from cs.SD) [pdf, html, other]
Title: FINALLY: fast and universal speech enhancement with studio-like quality
Nicholas Babaev, Kirill Tamogashev, Azat Saginbaev, Ivan Shchekotov, Hanbin Bae, Hosang Sung, WonJun Lee, Hoon-Young Cho, Pavel Andreev
Comments: Accepted to NeurIPS 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[188] arXiv:2410.06016 (cross-list from cs.SD) [pdf, html, other]
Title: VRVQ: Variable Bitrate Residual Vector Quantization for Audio Compression
Yunkee Chae, Woosung Choi, Yuhta Takida, Junghyun Koo, Yukara Ikemiya, Zhi Zhong, Kin Wai Cheuk, Marco A. Martínez-Ramírez, Kyogu Lee, Wei-Hsiang Liao, Yuki Mitsufuji
Comments: Accepted at NeurIPS 2024 Workshop on Machine Learning and Compression
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[189] arXiv:2410.06221 (cross-list from cs.SD) [pdf, html, other]
Title: POLIPHONE: A Dataset for Smartphone Model Identification from Audio Recordings
Davide Salvi, Daniele Ugo Leonzio, Antonio Giganti, Claudio Eutizi, Sara Mandelli, Paolo Bestagini, Stefano Tubaro
Comments: Submitted to IEEE Access
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[190] arXiv:2410.06459 (cross-list from cs.SD) [pdf, html, other]
Title: Mamba-based Segmentation Model for Speaker Diarization
Alexis Plaquet, Naohiro Tawara, Marc Delcroix, Shota Horiguchi, Atsushi Ando, Shoko Araki
Comments: 5 pages, 4 figures. Submitted to ICASSP 2025. Code at this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[191] arXiv:2410.06543 (cross-list from cs.CR) [pdf, html, other]
Title: Gumbel Rao Monte Carlo based Bi-Modal Neural Architecture Search for Audio-Visual Deepfake Detection
Aravinda Reddy PN, Raghavendra Ramachandra, Krothapalli Sreenivasa Rao, Pabitra Mitra Vinod Rathod
Subjects: Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[192] arXiv:2410.06544 (cross-list from cs.SD) [pdf, html, other]
Title: SRC-gAudio: Sampling-Rate-Controlled Audio Generation
Chenxing Li, Manjie Xu, Dong Yu
Comments: Accepted by APSIPA2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[193] arXiv:2410.06608 (cross-list from cs.SD) [pdf, html, other]
Title: Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS
Onkar Kishor Susladkar, Vishesh Tripathi, Biddwan Ahmed
Journal-ref: EMNLP 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[194] arXiv:2410.06675 (cross-list from cs.SD) [pdf, html, other]
Title: SCOREQ: Speech Quality Assessment with Contrastive Regression
Alessandro Ragano, Jan Skoglund, Andrew Hines
Comments: Accepted NeurIPS 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[195] arXiv:2410.06846 (cross-list from cs.CL) [pdf, html, other]
Title: Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity
Mutian He, Philip N. Garner
Comments: 18 pages, 5 figures; ICLR 2025 camera ready. Code: this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[196] arXiv:2410.06927 (cross-list from cs.SD) [pdf, html, other]
Title: Spectral and Rhythm Features for Audio Classification with Deep Convolutional Neural Networks
Friedrich Wolf-Monheim
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[197] arXiv:2410.07168 (cross-list from cs.CL) [pdf, html, other]
Title: Sylber: Syllabic Embedding Representation of Speech from Raw Audio
Cheol Jun Cho, Nicholas Lee, Akshat Gupta, Dhruv Agarwal, Ethan Chen, Alan W Black, Gopala K. Anumanchipalli
Comments: Accepted at ICLR 2025
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[198] arXiv:2410.07400 (cross-list from cs.CL) [pdf, other]
Title: Advocating Character Error Rate for Multilingual ASR Evaluation
Thennal D K, Jesin James, Deepa P Gopinath, Muhammed Ashraf K
Comments: 4 pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[199] arXiv:2410.07436 (cross-list from cs.LG) [pdf, html, other]
Title: Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gap
Georgia Channing, Juil Sock, Ronald Clark, Philip Torr, Christian Schroeder de Witt
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[200] arXiv:2410.07491 (cross-list from cs.CL) [pdf, html, other]
Title: Transducer Consistency Regularization for Speech to Text Applications
Cindy Tseng, Yun Tang, Vijendra Raj Apsingekar
Comments: 8 pages, 4 figures. Accepted in IEEE Spoken Language Technology Workshop 2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[201] arXiv:2410.07530 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Explanation Synthesis with Generative Foundation Models
Alican Akman, Qiyang Sun, Björn W. Schuller
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[202] arXiv:2410.07771 (cross-list from cs.SD) [pdf, html, other]
Title: Full-Rank No More: Low-Rank Weight Training for Modern Speech Recognition Models
Adriana Fernandez-Lopez, Shiwei Liu, Lu Yin, Stavros Petridis, Maja Pantic
Comments: Submitted to ICASSP 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[203] arXiv:2410.08235 (cross-list from cs.SD) [pdf, html, other]
Title: A Recurrent Neural Network Approach to the Answering Machine Detection Problem
Kemal Altwlkany, Sead Delalic, Elmedin Selmanovic, Adis Alihodzic, Ivica Lovric
Comments: 6 pages, 2 figures, 2024 47th MIPRO ICT and Electronics Convention (MIPRO)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[204] arXiv:2410.08321 (cross-list from cs.SD) [pdf, html, other]
Title: Music Genre Classification using Large Language Models
Mohamed El Amine Meguenani, Alceu de Souza Britto Jr., Alessandro Lameiras Koerich
Comments: 7 pages
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[205] arXiv:2410.08324 (cross-list from cs.CL) [pdf, html, other]
Title: The language of sound search: Examining User Queries in Audio Search Engines
Benno Weck, Frederic Font
Comments: Accepted at DCASE 2024. Supplementary materials at this https URL
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[206] arXiv:2410.08435 (cross-list from cs.SD) [pdf, html, other]
Title: Efficient Fine-Grained Guidance for Diffusion-Based Symbolic Music Generation
Tingyu Zhu, Haoyu Liu, Ziyu Wang, Zhimin Jiang, Zeyu Zheng
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[207] arXiv:2410.08626 (cross-list from cs.SD) [pdf, html, other]
Title: Small Tunes Transformer: Exploring Macro & Micro-Level Hierarchies for Skeleton-Conditioned Melody Generation
Yishan Lv, Jing Luo, Boyuan Ju, Xinyu Yang
Comments: Accepted by 31st International Conference on MultiMedia Modeling (MMM2025)
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[208] arXiv:2410.08828 (cross-list from cs.CL) [pdf, html, other]
Title: Enhancing Indonesian Automatic Speech Recognition: Evaluating Multilingual Models with Diverse Speech Variabilities
Aulia Adila, Dessi Lestari, Ayu Purwarianti, Dipta Tanaya, Kurniawati Azizah, Sakriani Sakti
Comments: Accepted at O-COCOSDA 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[209] arXiv:2410.08974 (cross-list from cs.CL) [pdf, other]
Title: UniGlyph: A Seven-Segment Script for Universal Language Representation
G. V. Bency Sherin, A. Abijesh Euphrine, A. Lenora Moreen, L. Arun Jose
Comments: This submission includes 23 pages and tables. No external funding has been received for this research. Acknowledgments to Jeseentha V. for contributions to the phonetic study
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Symbolic Computation (cs.SC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[210] arXiv:2410.09250 (cross-list from cs.SD) [pdf, html, other]
Title: Quantum-Trained Convolutional Neural Network for Deepfake Audio Detection
Chu-Hsuan Abraham Lin, Chen-Yu Liu, Samuel Yen-Chi Chen, Kuan-Cheng Chen
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Quantum Physics (quant-ph)
[211] arXiv:2410.09289 (cross-list from cs.SD) [pdf, html, other]
Title: Multimodal Audio-based Disease Prediction with Transformer-based Hierarchical Fusion Network
Jinjin Cai, Ruiqi Wang, Dezhong Zhao, Ziqin Yuan, Victoria McKenna, Aaron Friedman, Rachel Foot, Susan Storey, Ryan Boente, Sudip Vhaduri, Byung-Cheol Min
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[212] arXiv:2410.09360 (cross-list from cs.SD) [pdf, html, other]
Title: Towards the Synthesis of Non-speech Vocalizations
Enjamamul Hoq, Ifeoma Nwogu
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[213] arXiv:2410.09396 (cross-list from cs.SD) [pdf, html, other]
Title: ExpGest: Expressive Speaker Generation Using Diffusion Model and Hybrid Audio-Text Guidance
Yongkang Cheng, Mingjiang Liang, Shaoli Huang, Jifeng Ning, Wei Liu
Comments: Accepted by ICME 2024
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[214] arXiv:2410.09456 (cross-list from cs.CL) [pdf, html, other]
Title: Automatic Speech Recognition with BERT and CTC Transformers: A Review
Noussaiba Djeffal, Hamza Kheddar, Djamel Addou, Ahmed Cherif Mazari, Yassine Himeur
Journal-ref: 2023 2nd International Conference on Electronics, Energy and Measurement (IC2EM)
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[215] arXiv:2410.09472 (cross-list from cs.SD) [pdf, html, other]
Title: DRCap: Decoding CLAP Latents with Retrieval-Augmented Generation for Zero-shot Audio Captioning
Xiquan Li, Wenxi Chen, Ziyang Ma, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Qiuqiang Kong, Xie Chen
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[216] arXiv:2410.09524 (cross-list from cs.CL) [pdf, html, other]
Title: Emphasis Rendering for Conversational Text-to-Speech with Multi-modal Multi-scale Context Modeling
Rui Liu, Zhenqi Jia, Jie Yang, Yifan Hu, Haizhou Li
Comments: submitted to IEEE Transaction
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[217] arXiv:2410.09578 (cross-list from cs.SD) [pdf, html, other]
Title: Objective Measurements of Voice Quality
Hira Dhamyal, Rita Singh
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[218] arXiv:2410.09778 (cross-list from cs.SD) [pdf, html, other]
Title: LEAD Dataset: How Can Labels for Sound Event Detection Vary Depending on Annotators?
Naoki Koga, Yoshiaki Bando, Keisuke Imoto
Comments: Accepted to APSIPA ASC 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[219] arXiv:2410.09869 (cross-list from cs.SD) [pdf, html, other]
Title: Prompt Tuning for Audio Deepfake Detection: Computationally Efficient Test-time Domain Adaptation with Limited Target Dataset
Hideyuki Oiso, Yuto Matsunaga, Kazuya Kakizaki, Taiki Miyagawa
Comments: Accepted at Interspeech 2024. Hideyuki Oiso and Yuto Matsunaga contributed equally
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[220] arXiv:2410.09928 (cross-list from cs.SD) [pdf, html, other]
Title: M2M-Gen: A Multimodal Framework for Automated Background Music Generation in Japanese Manga Using Large Language Models
Megha Sharma, Muhammad Taimoor Haseeb, Gus Xia, Yoshimasa Tsuruoka
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[221] arXiv:2410.10125 (cross-list from cs.SD) [pdf, html, other]
Title: Generative Deep Learning and Signal Processing for Data Augmentation of Cardiac Auscultation Signals: Improving Model Robustness Using Synthetic Audio
Leigh Abbott, Milan Marocchi, Matthew Fynn, Yue Rong, Sven Nordholm
Comments: 21 pages, 8 figures, 10 tables
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[222] arXiv:2410.10508 (cross-list from cs.CL) [pdf, html, other]
Title: Everyday Speech in the Indian Subcontinent
Utkarsh P
Comments: 3 Pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[223] arXiv:2410.10515 (cross-list from cs.SD) [pdf, html, other]
Title: Do we need more complex representations for structure? A comparison of note duration representation for Music Transformers
Gabriel Souza, Flavio Figueiredo, Alexei Machado, Deborah Guimarães
Comments: Presented at the Music for Machine Learning Workshop with ECML/PKDD. To be published by Springer
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[224] arXiv:2410.10537 (cross-list from cs.SD) [pdf, html, other]
Title: Reproducible Machine Learning-based Voice Pathology Detection: Introducing the Pitch Difference Feature
Jan Vrba, Jakub Steinbach, Tomáš Jirsa, Laura Verde, Roberta De Fazio, Yuwen Zeng, Kei Ichiji, Lukáš Hájek, Zuzana Sedláková, Zuzana Urbániová, Martin Chovanec, Jan Mareš, Noriyasu Homma
Comments: Code repository: this https URL, Supplementary materials: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[225] arXiv:2410.10676 (cross-list from cs.SD) [pdf, html, other]
Title: Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
Peiwen Sun, Sitong Cheng, Xiangtai Li, Zhen Ye, Huadai Liu, Honggang Zhang, Wei Xue, Yike Guo
Comments: Accepted by ICLR 2025
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[226] arXiv:2410.10851 (cross-list from cs.GR) [pdf, html, other]
Title: LLM Gesticulator: Leveraging Large Language Models for Scalable and Controllable Co-Speech Gesture Synthesis
Haozhou Pang, Tianwei Ding, Lanshan He, Ming Tao, Lu Zhang, Qi Gan
Subjects: Graphics (cs.GR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[227] arXiv:2410.10913 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Captioning RAG via Generative Pair-to-Pair Retrieval with Refined Knowledge Base
Choi Changin, Lim Sungjun, Rhee Wonjong
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[228] arXiv:2410.10994 (cross-list from cs.SD) [pdf, html, other]
Title: GraFPrint: A GNN-Based Approach for Audio Identification
Aditya Bhattacharjee, Shubhr Singh, Emmanouil Benetos
Comments: Submitted to IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2025)
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[229] arXiv:2410.11062 (cross-list from cs.SD) [pdf, html, other]
Title: CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning
Sjoerd Groot, Qinyu Chen, Jan C. van Gemert, Chang Gao
Comments: This paper has been accepted to be presented at the 2025 International Symposium on Circuits and Systems (ISCAS)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[230] arXiv:2410.11068 (cross-list from cs.CV) [pdf, html, other]
Title: Character-aware audio-visual subtitling in context
Jaesung Huh, Andrew Zisserman
Comments: ACCV 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[231] arXiv:2410.11120 (cross-list from cs.SD) [pdf, html, other]
Title: Audio-based Kinship Verification Using Age Domain Conversion
Qiyang Sun, Alican Akman, Xin Jing, Manuel Milling, Björn W. Schuller
Comments: 4 pages, 2 figures, submitted to IEEE Signal Processing Letters
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[232] arXiv:2410.11243 (cross-list from cs.SD) [pdf, html, other]
Title: Investigation of Speaker Representation for Target-Speaker Speech Processing
Takanori Ashihara, Takafumi Moriya, Shota Horiguchi, Junyi Peng, Tsubasa Ochiai, Marc Delcroix, Kohei Matsuura, Hiroshi Sato
Comments: Accepted at IEEE SLT 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[233] arXiv:2410.11299 (cross-list from cs.SD) [pdf, html, other]
Title: Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models
Saksham Singh Kushwaha, Jianbo Ma, Mark R. P. Thomas, Yapeng Tian, Avery Bruni
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[234] arXiv:2410.11522 (cross-list from cs.SD) [pdf, other]
Title: Leveraging LLM Embeddings for Cross Dataset Label Alignment and Zero Shot Music Emotion Prediction
Renhang Liu, Abhinaba Roy, Dorien Herremans
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[235] arXiv:2410.12028 (cross-list from cs.SD) [pdf, html, other]
Title: EmotionCaps: Enhancing Audio Captioning Through Emotion-Augmented Data Generation
Mithun Manivannan (1), Vignesh Nethrapalli (1), Mark Cartwright (1) ((1) New Jersey Institute of Technology)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[236] arXiv:2410.12082 (cross-list from cs.SD) [pdf, html, other]
Title: Learning to rumble: Automated elephant call classification, detection and endpointing using deep architectures
Christiaan M. Geldenhuys, Thomas R. Niesler
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)
[237] arXiv:2410.12399 (cross-list from cs.SD) [pdf, html, other]
Title: SF-Speech: Straightened Flow for Zero-Shot Voice Clone
Xuyuan Li, Zengqiang Shang, Hua Hua, Peiyang Shi, Chen Yang, Li Wang, Pengyuan Zhang
Comments: Accepted by IEEE Transactions on Audio, Speech and Language Processing
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[238] arXiv:2410.12416 (cross-list from cs.SD) [pdf, other]
Title: Enhancing Speech Emotion Recognition through Segmental Average Pooling of Self-Supervised Learning Features
Jonghwan Hyeon, Yung-Hwan Oh, Ho-Jin Choi
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[239] arXiv:2410.12668 (cross-list from cs.SD) [pdf, html, other]
Title: HeightCeleb - an enrichment of VoxCeleb dataset with speaker height information
Stanisław Kacprzak, Konrad Kowalczyk
Comments: Accepted at IEEE SLT 2024
Journal-ref: 2024 IEEE Spoken Language Technology Workshop (SLT), Macao, 2024, pp. 857-862
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[240] arXiv:2410.12811 (cross-list from cs.CV) [pdf, html, other]
Title: Decoding Emotions: Unveiling Facial Expressions through Acoustic Sensing with Contrastive Attention
Guangjing Wang, Juexing Wang, Ce Zhou, Weikang Ding, Huacheng Zeng, Tianxing Li, Qiben Yan
Comments: The extended version of the 2023 IEEE INFOCOM conference paper
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[241] arXiv:2410.12866 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Homogeneous Lexical Tone Decoding from Heterogeneous Intracranial Recordings
Di Wu, Siyuan Li, Chen Feng, Lu Cao, Yue Zhang, Jie Yang, Mohamad Sawan
Comments: ICLR2025 Poster (Preprint V2)
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)
[242] arXiv:2410.12948 (cross-list from cs.CL) [pdf, html, other]
Title: What Do Speech Foundation Models Not Learn About Speech?
Abdul Waheed, Hanin Atwany, Bhiksha Raj, Rita Singh
Comments: 20 Pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[243] arXiv:2410.12956 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Computational Analysis of Pansori Singing
Sangheon Park, Danbinaerin Han, Dasaem Jeong
Comments: Late-Breaking Demo Session of the 25th International Society for Music Information Retrieval (ISMIR) Conference, 2024
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[244] arXiv:2410.12957 (cross-list from cs.SD) [pdf, html, other]
Title: MuVi: Video-to-Music Generation with Semantic Alignment and Rhythmic Synchronization
Ruiqi Li, Siqi Zheng, Xize Cheng, Ziang Zhang, Shengpeng Ji, Zhou Zhao
Comments: Working in progress
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[245] arXiv:2410.13059 (cross-list from cs.SD) [pdf, html, other]
Title: AADNet: An End-to-End Deep Learning Model for Auditory Attention Decoding
Nhan Duc Thanh Nguyen, Huy Phan, Simon Geirnaert, Kaare Mikkelsen, Preben Kidmose
Comments: 11 pages, 6 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[246] arXiv:2410.13114 (cross-list from cs.SD) [pdf, html, other]
Title: Sound Check: Auditing Audio Datasets
William Agnew, Julia Barnett, Annie Chu, Rachel Hong, Michael Feffer, Robin Netzorg, Harry H. Jiang, Ezra Awumey, Sauvik Das
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Audio and Speech Processing (eess.AS)
[247] arXiv:2410.13179 (cross-list from cs.SD) [pdf, other]
Title: EH-MAM: Easy-to-Hard Masked Acoustic Modeling for Self-Supervised Speech Representation Learning
Ashish Seth, Ramaneswaran Selvakumar, S Sakshi, Sonal Kumar, Sreyan Ghosh, Dinesh Manocha
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[248] arXiv:2410.13267 (cross-list from cs.SD) [pdf, html, other]
Title: CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models
Shangda Wu, Yashan Wang, Ruibin Yuan, Zhancheng Guo, Xu Tan, Ge Zhang, Monan Zhou, Jing Chen, Xuefeng Mu, Yuejie Gao, Yuanliang Dong, Jiafeng Liu, Xiaobing Li, Feng Yu, Maosong Sun
Comments: 17 pages, 10 figures, 4 tables, accepted by NAACL 2025
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[249] arXiv:2410.13268 (cross-list from cs.CL) [pdf, html, other]
Title: Roadmap towards Superhuman Speech Understanding using Large Language Models
Fan Bu, Yuhao Zhang, Xidong Wang, Benyou Wang, Qun Liu, Haizhou Li
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[250] arXiv:2410.13282 (cross-list from cs.SD) [pdf, html, other]
Title: End-to-End Integration of Speech Emotion Recognition with Voice Activity Detection using Self-Supervised Learning Features
Natsuo Yamashita, Masaaki Yamamoto, Yohei Kawaguchi
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[251] arXiv:2410.13328 (cross-list from cs.SD) [pdf, html, other]
Title: Enhancing 1-Second 3D SELD Performance with Filter Bank Analysis and SCConv Integration in CST-Former
Zhehui Zhang
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[252] arXiv:2410.13419 (cross-list from cs.SD) [pdf, html, other]
Title: MeloTrans: A Text to Symbolic Music Generation Model Following Human Composition Habit
Yutian Wang, Wanyin Yang, Zhenrong Dai, Yilong Zhang, Kun Zhao, Hui Wang
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[253] arXiv:2410.13445 (cross-list from cs.CL) [pdf, html, other]
Title: Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASR
Abhishek Gupta, Amruta Parulekar, Sameep Chattopadhyay, Preethi Jyothi
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[254] arXiv:2410.13581 (cross-list from cs.SD) [pdf, html, other]
Title: Dynamic Range Compression and Its Effect on Music Genre Classification
Arlyn Reese Madsen III
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[255] arXiv:2410.13839 (cross-list from cs.SD) [pdf, html, other]
Title: Accelerating Codec-based Speech Synthesis with Multi-Token Prediction and Speculative Decoding
Tan Dat Nguyen, Ji-Hoon Kim, Jeongsoo Choi, Shukjae Choi, Jinseok Park, Younglo Lee, Joon Son Chung
Comments: Submitted to IEEE ICASSP 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[256] arXiv:2410.14101 (cross-list from cs.SD) [pdf, html, other]
Title: Multi-Source Spatial Knowledge Understanding for Immersive Visual Text-to-Speech
Shuwei He, Rui Liu
Comments: 5 pages, 1 figure, Accepted by ICASSP'2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[257] arXiv:2410.14122 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Robust Transcription: Exploring Noise Injection Strategies for Training Data Augmentation
Yonghyun Kim, Alexander Lerch
Comments: Accepted to the Late-Breaking Demo Session of the 25th International Society for Music Information Retrieval (ISMIR) Conference, 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[258] arXiv:2410.14411 (cross-list from cs.SD) [pdf, html, other]
Title: SNAC: Multi-Scale Neural Audio Codec
Hubert Siuzdak, Florian Grötschla, Luca A. Lanzendörfer
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[259] arXiv:2410.14590 (cross-list from cs.SD) [pdf, html, other]
Title: Embodied Exploration of Latent Spaces and Explainable AI
Elizabeth Wilson, Mika Satomi, Alex McLean, Deva Schubert, Juan Felipe Amaya Gonzalez
Comments: In Proceedings of Explainable AI for the Arts Workshop 2024 (XAIxArts 2024) arXiv:2406.14485
Subjects: Sound (cs.SD); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[260] arXiv:2410.14709 (cross-list from cs.CL) [pdf, html, other]
Title: A two-stage transliteration approach to improve performance of a multilingual ASR
Rohit Kumar
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[261] arXiv:2410.14945 (cross-list from cs.SD) [pdf, html, other]
Title: ImmerseDiffusion: A Generative Spatial Audio Latent Diffusion Model
Mojtaba Heydari, Mehrez Souden, Bruno Conejo, Joshua Atkins
Comments: ICASSP 2025 - IEEE International Conference on Acoustics, Speech, and Signal Processing, 2025
Subjects: Sound (cs.SD); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[262] arXiv:2410.14971 (cross-list from cs.AI) [pdf, html, other]
Title: BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation
Jilong Li, Zhenxi Song, Jiaqi Wang, Min Zhang, Zhiguo Zhang
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[263] arXiv:2410.14990 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Processing using Pattern Recognition for Music Genre Classification
Sivangi Chatterjee, Srishti Ganguly, Avik Bose, Hrithik Raj Prasad, Arijit Ghosal
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[264] arXiv:2410.14997 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Pronunciation and Accent Conversion through Knowledge Distillation And Synthetic Ground-Truth from Native TTS
Tuan Nam Nguyen, Seymanur Akti, Ngoc Quan Pham, Alexander Waibel
Comments: accepted at ICASSP 2025
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[265] arXiv:2410.15017 (cross-list from cs.CL) [pdf, html, other]
Title: DM-Codec: Distilling Multimodal Representations for Speech Tokenization
Md Mubtasim Ahasan, Md Fahim, Tasnim Mohiuddin, A K M Mahbubur Rahman, Aman Chadha, Tariq Iqbal, M Ashraful Amin, Md Mofijul Islam, Amin Ahsan Ali
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[266] arXiv:2410.15062 (cross-list from cs.SD) [pdf, html, other]
Title: PAT: Parameter-Free Audio-Text Aligner to Boost Zero-Shot Audio Classification
Ashish Seth, Ramaneswaran Selvakumar, Sonal Kumar, Sreyan Ghosh, Dinesh Manocha
Comments: 18 pages
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[267] arXiv:2410.15316 (cross-list from cs.CL) [pdf, html, other]
Title: Ichigo: Mixed-Modal Early-Fusion Realtime Voice Assistant
Alan Dao (Gia Tuan Dao), Dinh Bach Vu, Huy Hoang Ha
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[268] arXiv:2410.15342 (cross-list from cs.SD) [pdf, html, other]
Title: ConSinger: Efficient High-Fidelity Singing Voice Generation with Minimal Steps
Yulin Song, Guorui Sang, Jing Yu, Chuangbai Xiao
Comments: Singing voice synthesis, Consistency models, Shallow Diffusion Mechanism; Accepted by ICASSP 2025
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[269] arXiv:2410.15499 (cross-list from cs.AI) [pdf, html, other]
Title: Improving Voice Quality in Speech Anonymization With Just Perception-Informed Losses
Suhita Ghosh, Tim Thiele, Frederic Lorbeer, Frank Dreyer, Sebastian Stober
Comments: Accepted in NeurIPS 2024 Workshop (Audio Imagination)
Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[270] arXiv:2410.15500 (cross-list from cs.AI) [pdf, html, other]
Title: Anonymising Elderly and Pathological Speech: Voice Conversion Using DDSP and Query-by-Example
Suhita Ghosh, Melanie Jouaiti, Arnab Das, Yamini Sinha, Tim Polzehl, Ingo Siegert, Sebastian Stober
Comments: Accepted in Interspeech 2024
Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)
[271] arXiv:2410.15532 (cross-list from cs.SD) [pdf, html, other]
Title: Construction and Analysis of Impression Caption Dataset for Environmental Sounds
Yuki Okamoto, Ryotaro Nagase, Minami Okamoto, Yuki Saito, Keisuke Imoto, Takahiro Fukumori, Yoichi Yamashita
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[272] arXiv:2410.15573 (cross-list from cs.SD) [pdf, html, other]
Title: OpenMU: Your Swiss Army Knife for Music Understanding
Mengjie Zhao, Zhi Zhong, Zhuoyuan Mao, Shiqi Yang, Wei-Hsiang Liao, Shusuke Takahashi, Hiromi Wakaki, Yuki Mitsufuji
Comments: Resources: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[273] arXiv:2410.15577 (cross-list from cs.SD) [pdf, other]
Title: ALDAS: Audio-Linguistic Data Augmentation for Spoofed Audio Detection
Zahra Khanjani, Christine Mallinson, James Foulds, Vandana P Janeja
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[274] arXiv:2410.15608 (cross-list from cs.SD) [pdf, html, other]
Title: Moonshine: Speech Recognition for Live Transcription and Voice Commands
Nat Jeffries, Evan King, Manjunath Kudlur, Guy Nicholson, James Wang, Pete Warden
Comments: 7 pages, 6 figures, 3 tables
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[275] arXiv:2410.15609 (cross-list from cs.CL) [pdf, html, other]
Title: Interventional Speech Noise Injection for ASR Generalizable Spoken Language Understanding
Yeonjoon Jung, Jaeseong Lee, Seungtaek Choi, Dohyeon Lee, Minsoo Kim, Seung-won Hwang
Comments: 9 pages, 3 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[276] arXiv:2410.15620 (cross-list from cs.SD) [pdf, html, other]
Title: Acoustic Model Optimization over Multiple Data Sources: Merging and Valuation
Victor Junqiu Wei, Weicheng Wang, Di Jiang, Conghui Tan, Rongzhong Lian
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[277] arXiv:2410.15749 (cross-list from cs.SD) [pdf, html, other]
Title: Optimizing Neural Speech Codec for Low-Bitrate Compression via Multi-Scale Encoding
Peiji Yang, Fengping Wang, Yicheng Zhong, Huawei Wei, Zhisheng Wang
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[278] arXiv:2410.15929 (cross-list from cs.CL) [pdf, html, other]
Title: Yeah, Un, Oh: Continuous and Real-time Backchannel Prediction with Fine-tuning of Voice Activity Projection
Koji Inoue, Divesh Lala, Gabriel Skantze, Tatsuya Kawahara
Comments: This paper has been accepted for presentation at the main conference of 2025 Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics (NAACL 2025) and represents the author's version of the work
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[279] arXiv:2410.16278 (cross-list from cs.NI) [pdf, html, other]
Title: Edge Computing in Distributed Acoustic Sensing: An Application in Traffic Monitoring
Khanh Truong, Jo Eidsvik, Robin Andre Rørstadbotnen
Comments: 11 pages, 17 figures
Subjects: Networking and Internet Architecture (cs.NI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[280] arXiv:2410.16428 (cross-list from cs.SD) [pdf, html, other]
Title: Neural Scoring, Not Embedding: A Novel Framework for Robust Speaker Verification
Wan Lin, Junhui Chen, Tianhao Wang, Zhenyu Zhou, Lantian Li, Dong Wang
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[281] arXiv:2410.16438 (cross-list from cs.SD) [pdf, html, other]
Title: AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech Recognition
Zehua Liu, Xiaolou Li, Chen Chen, Li Guo, Lantian Li, Dong Wang
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[282] arXiv:2410.16505 (cross-list from cs.SD) [pdf, html, other]
Title: Do Audio-Language Models Understand Linguistic Variations?
Ramaneswaran Selvakumar, Sonal Kumar, Hemant Kumar Giri, Nishit Anand, Ashish Seth, Sreyan Ghosh, Dinesh Manocha
Comments: Accepted to NAACL 2025
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[283] arXiv:2410.16712 (cross-list from cs.SD) [pdf, html, other]
Title: DENOASR: Debiasing ASRs through Selective Denoising
Anand Kumar Rai, Siddharth D Jaiswal, Shubham Prakash, Bendi Pragnya Sree, Animesh Mukherjee
Comments: Paper accepted at IEEE ICKG 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[284] arXiv:2410.16785 (cross-list from cs.SD) [pdf, html, other]
Title: Annotation-Free MIDI-to-Audio Synthesis via Concatenative Synthesis and Generative Refinement
Osamu Take, Taketo Akama
Comments: Work in progress; 7 pages, 2 figures, 1 table
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[285] arXiv:2410.17006 (cross-list from cs.SD) [pdf, html, other]
Title: Variational autoencoders stabilise TCN performance when classifying weakly labelled bioacoustics data
Laia Garrobé Fonollosa, Douglas Gillespie, Lina Stankovic, Vladimir Stankovic, Luke Rendell
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)
[286] arXiv:2410.17081 (cross-list from cs.SD) [pdf, html, other]
Title: Continuous Speech Tokenizer in Text To Speech
Yixing Li, Ruobing Xie, Xingwu Sun, Yu Cheng, Zhanhui Kang
Comments: NAACL 2025 Findings Poster
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[287] arXiv:2410.17196 (cross-list from cs.CL) [pdf, html, other]
Title: VoiceBench: Benchmarking LLM-Based Voice Assistants
Yiming Chen, Xianghu Yue, Chen Zhang, Xiaoxue Gao, Robby T. Tan, Haizhou Li
Comments: Work in progress. Data is available at this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[288] arXiv:2410.17209 (cross-list from cs.SD) [pdf, html, other]
Title: Audio-to-Score Conversion Model Based on Whisper methodology
Hongyao Zhang, Bohang Sun
Comments: 5 pages, 7 figures
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[289] arXiv:2410.17400 (cross-list from cs.SD) [pdf, html, other]
Title: Discogs-VI: A Musical Version Identification Dataset Based on Public Editorial Metadata
R. Oguz Araz, Xavier Serra, Dmitry Bogdanov
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[290] arXiv:2410.17457 (cross-list from cs.SD) [pdf, html, other]
Title: mmWave-Whisper: Phone Call Eavesdropping and Transcription Using Millimeter-Wave Radar
Suryoday Basak, Abhijeeth Padarthi, Mahanth Gowda
Comments: 5 pages, 4 figures, 1 table
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[291] arXiv:2410.17485 (cross-list from cs.CL) [pdf, html, other]
Title: VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Text Supervised Fine-Tuning
Yifan Peng, Krishna C. Puvvada, Zhehuai Chen, Piotr Zelasko, He Huang, Kunal Dhawan, Ke Hu, Shinji Watanabe, Jagadeesh Balam, Boris Ginsburg
Comments: Accepted at NAACL 2025 main conference
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[292] arXiv:2410.17574 (cross-list from cs.LG) [pdf, html, other]
Title: Adversarial Domain Adaptation for Metal Cutting Sound Detection: Leveraging Abundant Lab Data for Scarce Industry Data
Mir Imtiaz Mostafiz (1), Eunseob Kim (2), Adrian Shuai Li (1), Elisa Bertino (1), Martin Byung-Guk Jun (2), Ali Shakouri (3) ((1) Department of Computer Science, Purdue University (2) School of Mechanical Engineering, Purdue University, (3) School of Electrical and Computer Engineering, Purdue University)
Comments: 8 pages, 3 figures, 3 tables, First two named Authors have equal contribution (Co-first author)
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[293] arXiv:2410.17584 (cross-list from cs.SD) [pdf, html, other]
Title: Exploring Tokenization Methods for Multitrack Sheet Music Generation
Yashan Wang, Shangda Wu, Xingjian Du, Maosong Sun
Comments: 3 pages, 1 figure, 1 table
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[294] arXiv:2410.17589 (cross-list from cs.SD) [pdf, html, other]
Title: Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generation
Junwon Lee, Modan Tailleur, Laurie M. Heller, Keunwoo Choi, Mathieu Lagrange, Brian McFee, Keisuke Imoto, Yuki Okamoto
Comments: accepted to NeurIPS 2024 Workshop: Audio Imagination
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[295] arXiv:2410.17799 (cross-list from cs.CL) [pdf, html, other]
Title: OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation
Qinglin Zhang, Luyao Cheng, Chong Deng, Qian Chen, Wen Wang, Siqi Zheng, Jiaqing Liu, Hai Yu, Chaohong Tan, Zhihao Du, Shiliang Zhang
Comments: Work in progress
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[296] arXiv:2410.17901 (cross-list from cs.CL) [pdf, html, other]
Title: ELAICHI: Enhancing Low-resource TTS by Addressing Infrequent and Low-frequency Character Bigrams
Srija Anand, Praveen Srinivasa Varadhan, Mehak Singal, Mitesh M. Khapra
Comments: 11 pages, 1 figure, 3 tables
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[297] arXiv:2410.18151 (cross-list from cs.SD) [pdf, html, other]
Title: Music102: An $D_{12}$-equivariant transformer for chord progression accompaniment
Weiliang Luo
Comments: 10 pages, 3 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[298] arXiv:2410.18203 (cross-list from cs.SD) [pdf, html, other]
Title: Vocal Melody Construction for Persian Lyrics Using LSTM Recurrent Neural Networks
Farshad Jafari, Farzad Didehvar, Amin Gheibi
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[299] arXiv:2410.18218 (cross-list from cs.AI) [pdf, html, other]
Title: Optimizing the role of human evaluation in LLM-based spoken document summarization systems
Margaret Kroll, Kelsey Kraus
Journal-ref: Proc. Interspeech 2024, 1935-1939 (2024)
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[300] arXiv:2410.18298 (cross-list from cs.LG) [pdf, html, other]
Title: Robust and Explainable Depression Identification from Speech Using Vowel-Based Ensemble Learning Approaches
Kexin Feng, Theodora Chaspari
Comments: accepted at the IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI 2024)
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[301] arXiv:2410.18322 (cross-list from cs.SD) [pdf, html, other]
Title: Unified Microphone Conversion: Many-to-Many Device Mapping via Feature-wise Linear Modulation
Myeonghoon Ryu, Hongseok Oh, Suji Lee, Han Park
Comments: Currently under review for ICASSP 2025
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[302] arXiv:2410.18363 (cross-list from cs.AI) [pdf, html, other]
Title: Contextual Biasing to Improve Domain-specific Custom Vocabulary Audio Transcription without Explicit Fine-Tuning of Whisper Model
Vishakha Lall, Yisi Liu
Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[303] arXiv:2410.18371 (cross-list from cs.SD) [pdf, html, other]
Title: Gibberish is All You Need for Membership Inference Detection in Contrastive Language-Audio Pretraining
Ruoxi Cheng, Yizhong Ding, Shuirong Cao, Shitong Shao, Zhiqiang Wang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[304] arXiv:2410.18395 (cross-list from cs.LG) [pdf, html, other]
Title: A contrastive-learning approach for auditory attention detection
Seyed Ali Alavi Bajestan, Mark Pitt, Donald S. Williamson
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[305] arXiv:2410.18607 (cross-list from cs.CL) [pdf, html, other]
Title: STTATTS: Unified Speech-To-Text And Text-To-Speech Model
Hawau Olamide Toyin, Hao Li, Hanan Aldarmaki
Comments: 11 pages, 4 Figures, EMNLP 2024 Findings
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[306] arXiv:2410.18628 (cross-list from cs.SD) [pdf, html, other]
Title: Wavetable Synthesis Using CVAE for Timbre Control Based on Semantic Label
Tsugumasa Yutani, Yuya Yamamoto, Shuyo Nakatani, Hiroko Terasawa
Comments: 6 pages, 4 figures, Accepted at APSIPA ASC 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[307] arXiv:2410.18850 (cross-list from cs.CL) [pdf, other]
Title: kNN For Whisper And Its Effect On Bias And Speaker Adaptation
Maya K. Nachesa, Vlad Niculae
Comments: Accepted to Findings of NAACL 2025. 7 pages incl. appendix, 2 figures, 6 tables
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[308] arXiv:2410.19134 (cross-list from cs.CL) [pdf, html, other]
Title: AlignCap: Aligning Speech Emotion Captioning to Human Preferences
Ziqi Liang, Haoxiang Shi, Hanhui Chen
Comments: Accepted to EMNLP2024 main conference
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[309] arXiv:2410.19199 (cross-list from cs.SI) [pdf, html, other]
Title: Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysis
Suparna De, Ionut Bostan, Nishanth Sastry
Journal-ref: 16th International Conference on Advances in Social Networks Analysis and Mining -ASONAM-2024
Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[310] arXiv:2410.19540 (cross-list from cs.SD) [pdf, html, other]
Title: CloserMusicDB: A Modern Multipurpose Dataset of High Quality Music
Aleksandra Piekarzewicz, Tomasz Sroka, Aleksander Tym, Mateusz Modrzejewski
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[311] arXiv:2410.19719 (cross-list from cs.SD) [pdf, html, other]
Title: Arabic Music Classification and Generation using Deep Learning
Mohamed Elshaarawy, Ashrakat Saeed, Mariam Sheta, Abdelrahman Said, Asem Bakr, Omar Bahaa, Walid Gomaa
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[312] arXiv:2410.19722 (cross-list from cs.SD) [pdf, html, other]
Title: Temporal Convolution-based Hybrid Model Approach with Representation Learning for Real-Time Acoustic Anomaly Detection
Sahan Dissanayaka, Manjusri Wickramasinghe, Pasindu Marasinghe
Comments: 10 pages, 10 figures, ICMLC2024
Journal-ref: ICMLC'24: Proceedings of the 2024 16th International Conference on Machine Learning and Computing, Pages 218 - 227
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[313] arXiv:2410.19772 (cross-list from eess.SP) [pdf, html, other]
Title: A Novel Numerical Method for Relaxing the Minimal Configurations of TOA-Based Joint Sensors and Sources Localization
Faxian Cao, Yongqiang Cheng, Adil Mehmood Khan, Zhijing Yang, Yingxiu Chang
Comments: 13 pages, 6 figures
Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS)
[314] arXiv:2410.19793 (cross-list from eess.SP) [pdf, html, other]
Title: Single-word Auditory Attention Decoding Using Deep Learning Model
Nhan Duc Thanh Nguyen, Huy Phan, Kaare Mikkelsen, Preben Kidmose
Comments: 5 pages, 3 figures
Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)
[315] arXiv:2410.19935 (cross-list from cs.CL) [pdf, html, other]
Title: Do Discrete Self-Supervised Representations of Speech Capture Tone Distinctions?
Opeyemi Osakuade, Simon King
Comments: Submitted to ICASSP 2025
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[316] arXiv:2410.20081 (cross-list from cs.LG) [pdf, html, other]
Title: emg2qwerty: A Large Dataset with Baselines for Touch Typing using Surface Electromyography
Viswanath Sivakumar, Jeffrey Seely, Alan Du, Sean R Bittner, Adam Berenzweig, Anuoluwapo Bolarinwa, Alexandre Gramfort, Michael I Mandel
Comments: Published at NeurIPS 2024 Datasets and Benchmarks Track
Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[317] arXiv:2410.20334 (cross-list from cs.CL) [pdf, html, other]
Title: Improving Speech-based Emotion Recognition with Contextual Utterance Analysis and LLMs
Enshi Zhang, Christian Poellabauer
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[318] arXiv:2410.20336 (cross-list from cs.CL) [pdf, html, other]
Title: Get Large Language Models Ready to Speak: A Late-fusion Approach for Speech Generation
Maohao Shen, Shun Zhang, Jilong Wu, Zhiping Xiu, Ehab AlBadawy, Yiting Lu, Mike Seltzer, Qing He
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[319] arXiv:2410.20352 (cross-list from cs.SD) [pdf, html, other]
Title: An approach to hummed-tune and song sequences matching
Loc Bao Pham, Huong Hoang Luong, Phu Thien Tran, Phuc Hoang Ngo, Vi Hoang Nguyen, Thinh Nguyen
Journal-ref: An approach to hummed tune and song sequences matching Communications in Computer and Information Science (2022) 690-697
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[320] arXiv:2410.20359 (cross-list from cs.SD) [pdf, html, other]
Title: Conditional GAN for Enhancing Diffusion Models in Efficient and Authentic Global Gesture Generation from Audios
Yongkang Cheng, Mingjiang Liang, Shaoli Huang, Gaoge Han, Jifeng Ning, Wei Liu
Comments: Accepted by WACV 2025 (Round 1)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Audio and Speech Processing (eess.AS)
[321] arXiv:2410.20478 (cross-list from cs.SD) [pdf, html, other]
Title: MusicFlow: Cascaded Flow Matching for Text Guided Music Generation
K R Prajwal, Bowen Shi, Matthew Lee, Apoorv Vyas, Andros Tjandra, Mahi Luthra, Baishan Guo, Huiyu Wang, Triantafyllos Afouras, David Kant, Wei-Ning Hsu
Comments: ICML 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[322] arXiv:2410.20515 (cross-list from cs.SD) [pdf, html, other]
Title: Symbotunes: unified hub for symbolic music generative models
Paweł Skierś, Maksymilian Łazarski, Michał Kopeć, Mateusz Modrzejewski
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[323] arXiv:2410.20518 (cross-list from cs.SD) [pdf, html, other]
Title: MidiTok Visualizer: a tool for visualization and analysis of tokenized MIDI symbolic music
Michał Wiszenko, Kacper Stefański, Piotr Malesa, Łukasz Pokorzyński, Mateusz Modrzejewski
Comments: in Extended Abstracts for the Late-Breaking Demo Sessionof the 25th Int. Society for Music Information Retrieval Conf., San Francisco, United States, 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[324] arXiv:2410.20540 (cross-list from cs.SD) [pdf, html, other]
Title: Automatic Estimation of Singing Voice Musical Dynamics
Jyoti Narang, Nazif Can Tamer, Viviana De La Vega, Xavier Serra
Comments: To be published in ISMIR 2024, 6 pages
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[325] arXiv:2410.20564 (cross-list from cs.HC) [pdf, html, other]
Title: Using Confidence Scores to Improve Eyes-free Detection of Speech Recognition Errors
Sadia Nowrin, Keith Vertanen
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[326] arXiv:2410.20742 (cross-list from cs.SD) [pdf, html, other]
Title: Mitigating Unauthorized Speech Synthesis for Voice Protection
Zhisheng Zhang, Qianyi Yang, Derui Wang, Pengyang Huang, Yuxin Cao, Kai Ye, Jie Hao
Comments: Accepted to ACM CCS Workshop (LAMPS) 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[327] arXiv:2410.20773 (cross-list from cs.SD) [pdf, html, other]
Title: An Ensemble Approach to Music Source Separation: A Comparative Analysis of Conventional and Hierarchical Stem Separation
Saarth Vardhan, Pavani R Acharya, Samarth S Rao, Oorjitha Ratna Jasthi, S Natarajan
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[328] arXiv:2410.20775 (cross-list from cs.SD) [pdf, html, other]
Title: Data-Efficient Low-Complexity Acoustic Scene Classification via Distilling and Progressive Pruning
Bing Han, Wen Huang, Zhengyang Chen, Anbai Jiang, Pingyi Fan, Cheng Lu, Zhiqiang Lv, Jia Liu, Wei-Qiang Zhang, Yanmin Qian
Comments: submitted to ICASSP 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[329] arXiv:2410.20852 (cross-list from cs.SD) [pdf, html, other]
Title: Atrial Fibrillation Detection System via Acoustic Sensing for Mobile Phones
Xuanyu Liu, Jiao Li, Haoxian Liu, Zongqi Yang, Yi Huang, Jin Zhang
Comments: This paper has been submitted to ACM Transactions on Sensor Networks (TOSN)
Subjects: Sound (cs.SD); Computational Engineering, Finance, and Science (cs.CE); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)
[330] arXiv:2410.20997 (cross-list from cs.SD) [pdf, html, other]
Title: SepMamba: State-space models for speaker separation using Mamba
Thor Højhus Avenstrup, Boldizsár Elek, István László Mádi, András Bence Schin, Morten Mørup, Bjørn Sand Jensen, Kenny Falkær Olsen
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[331] arXiv:2410.21233 (cross-list from cs.SD) [pdf, html, other]
Title: ST-ITO: Controlling Audio Effects for Style Transfer with Inference-Time Optimization
Christian J. Steinmetz, Shubhr Singh, Marco Comunità, Ilias Ibnyahya, Shanxin Yuan, Emmanouil Benetos, Joshua D. Reiss
Comments: Accepted to ISMIR 2024. Code available this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[332] arXiv:2410.21269 (cross-list from cs.SD) [pdf, html, other]
Title: OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup
Xize Cheng, Siqi Zheng, Zehan Wang, Minghui Fang, Ziang Zhang, Rongjie Huang, Ziyang Ma, Shengpeng Ji, Jialong Zuo, Tao Jin, Zhou Zhao
Comments: Working in progress
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[333] arXiv:2410.21276 (cross-list from cs.CL) [pdf, html, other]
Title: GPT-4o System Card
OpenAI: Aaron Hurst, Adam Lerer, Adam P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, Aleksander Mądry, Alex Baker-Whitcomb, Alex Beutel, Alex Borzunov, Alex Carney, Alex Chow, Alex Kirillov, Alex Nichol, Alex Paino, Alex Renzin, Alex Tachard Passos, Alexander Kirillov, Alexi Christakis, Alexis Conneau, Ali Kamali, Allan Jabri, Allison Moyer, Allison Tam, Amadou Crookes, Amin Tootoochian, Amin Tootoonchian, Ananya Kumar, Andrea Vallone, Andrej Karpathy, Andrew Braunstein, Andrew Cann, Andrew Codispoti, Andrew Galu, Andrew Kondrich, Andrew Tulloch, Andrey Mishchenko, Angela Baek, Angela Jiang, Antoine Pelisse, Antonia Woodford, Anuj Gosalia, Arka Dhar, Ashley Pantuliano, Avi Nayak, Avital Oliver, Barret Zoph, Behrooz Ghorbani, Ben Leimberger, Ben Rossen, Ben Sokolowsky, Ben Wang, Benjamin Zweig, Beth Hoover, Blake Samic, Bob McGrew, Bobby Spero, Bogo Giertler, Bowen Cheng, Brad Lightcap, Brandon Walkin, Brendan Quinn, Brian Guarraci, Brian Hsu, Bright Kellogg, Brydon Eastman, Camillo Lugaresi, Carroll Wainwright, Cary Bassin, Cary Hudson, Casey Chu, Chad Nelson, Chak Li, Chan Jun Shern, Channing Conger, Charlotte Barette, Chelsea Voss, Chen Ding, Cheng Lu, Chong Zhang, Chris Beaumont, Chris Hallacy, Chris Koch, Christian Gibson, Christina Kim, Christine Choi, Christine McLeavey, Christopher Hesse, Claudia Fischer, Clemens Winter, Coley Czarnecki, Colin Jarvis, Colin Wei, Constantin Koumouzelis, Dane Sherburn
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[334] arXiv:2410.21297 (cross-list from cs.SD) [pdf, html, other]
Title: Producer vs. Rapper: Who Dominates the Hip Hop Sound? A Case Study
Tim Ziemer, Nikita Kudakov, Christoph Reuter
Comments: many SOMs
Subjects: Sound (cs.SD); Distributed, Parallel, and Cluster Computing (cs.DC); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[335] arXiv:2410.21478 (cross-list from cs.SD) [pdf, html, other]
Title: Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications
Kemal Altwlkany, Hadžem Hadžić, Amar Kurić, Emanuel Lacic
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[336] arXiv:2410.21502 (cross-list from cs.SD) [pdf, html, other]
Title: Enhancing TTS Stability in Hebrew using Discrete Semantic Units
Ella Zeldes, Or Tal, Yossi Adi
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[337] arXiv:2410.21557 (cross-list from cs.SD) [pdf, html, other]
Title: A Novel Score-CAM based Denoiser for Spectrographic Signature Extraction without Ground Truth
Noel Elias
Journal-ref: 2023 International Joint Conference on Neural Networks (IJCNN), Gold Coast, Australia, 2023, pp. 1-8
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[338] arXiv:2410.21561 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Classification of Low Feature Spectrograms Utilizing Convolutional Neural Networks
Noel Elias
Journal-ref: 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA), Nassau, Bahamas, 2022, pp. 693-698
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[339] arXiv:2410.21641 (cross-list from cs.SD) [pdf, html, other]
Title: RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
Kehan Sui, Jinxu Xiang, Fang Jin
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[340] arXiv:2410.21876 (cross-list from cs.IR) [pdf, html, other]
Title: Application of Audio Fingerprinting Techniques for Real-Time Scalable Speech Retrieval and Speech Clusterization
Kemal Altwlkany, Sead Delalić, Adis Alihodžić, Elmedin Selmanović, Damir Hasić
Subjects: Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[341] arXiv:2410.21897 (cross-list from cs.SD) [pdf, html, other]
Title: Semi-Supervised Self-Learning Enhanced Music Emotion Recognition
Yifu Sun, Xulong Zhang, Monan Zhou, Wei Li
Comments: 12 pages, 2 figures
Journal-ref: Proceedings of the 11th Conference on Sound and Music Technology. CSMT 2024. Lecture Notes in Electrical Engineering. Springer, Singapore
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[342] arXiv:2410.22046 (cross-list from cs.SD) [pdf, html, other]
Title: CHORDONOMICON: A Dataset of 666,000 Songs and their Chord Progressions
Spyridon Kantarelis, Konstantinos Thomas, Vassilis Lyberatos, Edmund Dervakos, Giorgos Stamou
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[343] arXiv:2410.22066 (cross-list from cs.CL) [pdf, html, other]
Title: Sing it, Narrate it: Quality Musical Lyrics Translation
Zhuorui Ye, Jinhan Li, Rongwu Xu
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[344] arXiv:2410.22076 (cross-list from cs.SD) [pdf, html, other]
Title: USpeech: Ultrasound-Enhanced Speech with Minimal Human Effort via Cross-Modal Synthesis
Luca Jiang-Tao Yu, Running Zhao, Sijie Ji, Edith C.H. Ngai, Chenshu Wu
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[345] arXiv:2410.22124 (cross-list from cs.LG) [pdf, html, other]
Title: RankUp: Boosting Semi-Supervised Regression with an Auxiliary Ranking Classifier
Pin-Yen Huang, Szu-Wei Fu, Yu Tsao
Comments: Accepted at NeurIPS 2024 (Poster)
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[346] arXiv:2410.22179 (cross-list from cs.CL) [pdf, html, other]
Title: Robust and Unbounded Length Generalization in Autoregressive Transformer-Based Text-to-Speech
Eric Battenberg, RJ Skerry-Ryan, Daisy Stanton, Soroosh Mariooryad, Matt Shannon, Julian Salazar, David Kao
Comments: Accepted to NAACL 2025
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[347] arXiv:2410.22350 (cross-list from cs.MM) [pdf, other]
Title: Quality-Aware End-to-End Audio-Visual Neural Speaker Diarization
Mao-Kui He, Jun Du, Shu-Tong Niu, Qing-Feng Liu, Chin-Hui Lee
Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[348] arXiv:2410.22803 (cross-list from cs.SD) [pdf, html, other]
Title: DOA-Aware Audio-Visual Self-Supervised Learning for Sound Event Localization and Detection
Yoto Fujita, Yoshiaki Bando, Keisuke Imoto, Masaki Onishi, Kazuyoshi Yoshii
Comments: Accepted to APSIPA2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[349] arXiv:2410.22805 (cross-list from cs.SD) [pdf, html, other]
Title: Run-Time Adaptation of Neural Beamforming for Robust Speech Dereverberation and Denoising
Yoto Fujita, Aditya Arie Nugraha, Diego Di Carlo, Yoshiaki Bando, Mathieu Fontaine, Kazuyoshi Yoshii
Comments: Accepted to APSIPA2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[350] arXiv:2410.23005 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Musical Accompaniment Co-creation via Diffusion Transformers
Javier Nistal, Marco Pasini, Stefan Lattner
Comments: 5 pages; 1 table
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[351] arXiv:2410.23008 (cross-list from cs.SD) [pdf, html, other]
Title: SoundCollage: Automated Discovery of New Classes in Audio Datasets
Ryuhaerang Choi, Soumyajit Chatterjee, Dimitris Spathis, Sung-Ju Lee, Fahim Kawsar, Mohammad Malekzadeh
Comments: 5 pages, 2 figures. Accepted in IEEE ICASSP 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[352] arXiv:2410.23230 (cross-list from cs.CV) [pdf, html, other]
Title: Aligning Audio-Visual Joint Representations with an Agentic Workflow
Shentong Mo, Yibing Song
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[353] arXiv:2410.23279 (cross-list from cs.SD) [pdf, html, other]
Title: A Transformer Model for Segmentation, Classification, and Caller Identification of Marmoset Vocalization
Bin Wu, Shinnosuke Takamichi, Sakriani Sakti, Satoshi Nakamura
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[354] arXiv:2410.23776 (cross-list from cs.SD) [pdf, html, other]
Title: Neurobench: DCASE 2020 Acoustic Scene Classification benchmark on XyloAudio 2
Weijie Ke, Mina Khoei, Dylan Muir
Subjects: Sound (cs.SD); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)
[355] arXiv:2410.23796 (cross-list from cs.SD) [pdf, other]
Title: Improving snore detection under limited dataset through harmonic/percussive source separation and convolutional neural networks
F.D. Gonzalez-Martinez, J.J. Carabias-Orti, F.J. Canadas-Quesada, N. Ruiz-Reyes, D. Martinez-Munoz, S. Garcia-Galan
Journal-ref: Applied Acoustics, vol. 216, 15 January 2024, 109811
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[356] arXiv:2410.23815 (cross-list from cs.SD) [pdf, html, other]
Title: The NPU-HWC System for the ISCSLP 2024 Inspirational and Convincing Audio Generation Challenge
Dake Guo, Jixun Yao, Xinfa Zhu, Kangxiang Xia, Zhao Guo, Ziyu Zhang, Yao Wang, Jie Liu, Lei Xie
Comments: accepted by ISCSLP 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[357] arXiv:2410.23861 (cross-list from cs.CL) [pdf, html, other]
Title: Audio Is the Achilles' Heel: Red Teaming Audio Large Multimodal Models
Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari
Subjects: Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[358] arXiv:2410.24019 (cross-list from cs.CL) [pdf, html, other]
Title: Speech is More Than Words: Do Speech-to-Text Translation Systems Leverage Prosody?
Ioannis Tsiamas, Matthias Sperber, Andrew Finch, Sarthak Garg
Comments: WMT 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 358 entries
Showing up to 2000 entries per page: fewer | more | all