Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Sound

Authors and titles for July 2024

Total of 297 entries
Showing up to 1000 entries per page: fewer | more | all
[1] arXiv:2407.00188 [pdf, other]
Title: A Novel Labeled Human Voice Signal Dataset for Misbehavior Detection
Ali Raza (Department of Software Engineering The University Of Lahore, Lahore, Pakistan), Faizan Younas (Department of Computer Science & Information Technology, The University Of Lahore, Lahore, Pakistan)
Journal-ref: 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[2] arXiv:2407.00465 [pdf, html, other]
Title: Characterizing Continual Learning Scenarios and Strategies for Audio Analysis
Ruchi Bhatt, Pratibha Kumari, Dwarikanath Mahapatra, Abdulmotaleb El Saddik, Mukesh Saini
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[3] arXiv:2407.00531 [pdf, other]
Title: Interpreting Pretrained Speech Models for Automatic Speech Assessment of Voice Disorders
Hok-Shing Lau, Mark Huntly, Nathon Morgan, Adesua Iyenoma, Biao Zeng, Tim Bashford
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[4] arXiv:2407.00657 [pdf, html, other]
Title: Improving Real-Time Music Accompaniment Separation with MMDenseNet
Chun-Hsiang Wang, Chung-Che Wang, Jun-You Wang, Jyh-Shing Roger Jang, Yen-Hsun Chu
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[5] arXiv:2407.00766 [pdf, html, other]
Title: An Attribute Interpolation Method in Speech Synthesis by Model Merging
Masato Murata, Koichi Miyazaki, Tomoki Koriyama
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[6] arXiv:2407.00888 [pdf, html, other]
Title: Papez: Resource-Efficient Speech Separation with Auditory Working Memory
Hyunseok Oh, Juheon Yi, Youngki Lee
Comments: 5 pages. Accepted by ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[7] arXiv:2407.01143 [pdf, html, other]
Title: Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition
Oliver Schrüfer, Manuel Milling, Felix Burkhardt, Florian Eyben, Björn Schuller
Comments: accepted for Interspeech 2024, 5 pages
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[8] arXiv:2407.01291 [pdf, html, other]
Title: Lightweight Zero-shot Text-to-Speech with Mixture of Adapters
Kenichi Fujita, Takanori Ashihara, Marc Delcroix, Yusuke Ijima
Comments: 5 pages,3 figures, Accepted to INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[9] arXiv:2407.01317 [pdf, html, other]
Title: Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarios
Juan Ignacio Alvarez-Trejos, Beltrán Labrador, Alicia Lozano-Diez
Comments: Submitted to Odyssey 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[10] arXiv:2407.01452 [pdf, html, other]
Title: On Feature Learning for Titi Monkey Activity Detection
Aditya Ravuri, Jen Muir, Neil D. Lawrence
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[11] arXiv:2407.01499 [pdf, html, other]
Title: Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting
Scott H. Hawley
Comments: 6 pages text + 2 pages references, 10 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[12] arXiv:2407.01777 [pdf, html, other]
Title: Deepfake Audio Detection Using Spectrogram-based Feature and Ensemble of Deep Learning Models
Lam Pham, Phat Lam, Truong Nguyen, Huyen Nguyen, Alexander Schindler
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[13] arXiv:2407.01860 [pdf, html, other]
Title: Constant Directivity Loudspeaker Beamforming
Yuancheng Luo
Comments: Accepted at EUSIPCO 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[14] arXiv:2407.02156 [pdf, html, other]
Title: Towards Training Music Taggers on Synthetic Data
Nadine Kroher, Steven Manangu, Aggelos Pikrakis
Comments: 6 pages, 3 figures, accepted to 21st International Conference on Content-based Multimedia Indexing (CBMI) 2024, code available this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[15] arXiv:2407.02170 [pdf, html, other]
Title: GMM-ResNet2: Ensemble of Group ResNet Networks for Synthetic Speech Detection
Zhenchun Lei, Hui Yan, Changhong Liu, Yong Zhou, Minglei Ma
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[16] arXiv:2407.02277 [pdf, html, other]
Title: MelodyT5: A Unified Score-to-Score Transformer for Symbolic Music Processing
Shangda Wu, Yashan Wang, Xiaobing Li, Feng Yu, Maosong Sun
Comments: 9 pages, 2 figures, 3 tables, accepted by ISMIR 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[17] arXiv:2407.02318 [pdf, html, other]
Title: The Solution for Temporal Sound Localisation Task of ICCV 1st Perception Test Challenge 2023
Yurui Huang, Yang Yang, Shou Chen, Xiangyu Wu, Qingguo Chen, Jianfeng Lu
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[18] arXiv:2407.02857 [pdf, html, other]
Title: AudioTime: A Temporally-aligned Audio-text Benchmark Dataset
Zeyu Xie, Xuenan Xu, Zhizheng Wu, Mengyue Wu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[19] arXiv:2407.02869 [pdf, html, other]
Title: PicoAudio: Enabling Precise Timestamp and Frequency Controllability of Audio Events in Text-to-audio Generation
Zeyu Xie, Xuenan Xu, Zhizheng Wu, Mengyue Wu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[20] arXiv:2407.03026 [pdf, html, other]
Title: Qifusion-Net: Layer-adapted Stream/Non-stream Model for End-to-End Multi-Accent Speech Recognition
Jinming Chen, Jingyi Fang, Yuanzhong Zheng, Yaoxuan Wang, Haojun Fei
Comments: accpeted by interspeech 2014, 5 pages, 1 figure
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[21] arXiv:2407.03110 [pdf, html, other]
Title: A Toolchain for Comprehensive Audio/Video Analysis Using Deep Learning Based Multimodal Approach (A use case of riot or violent context detection)
Lam Pham, Phat Lam, Tin Nguyen, Hieu Tang, Alexander Schindler
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[22] arXiv:2407.03132 [pdf, html, other]
Title: Speaker- and Text-Independent Estimation of Articulatory Movements and Phoneme Alignments from Speech
Tobias Weise, Philipp Klumpp, Kubilay Can Demir, Paula Andrea Pérez-Toro, Maria Schuster, Elmar Noeth, Bjoern Heismann, Andreas Maier, Seung Hee Yang
Comments: to be published in Interspeech 2024 proceedings
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[23] arXiv:2407.03135 [pdf, html, other]
Title: GMM-ResNext: Combining Generative and Discriminative Models for Speaker Verification
Hui Yan, Zhenchun Lei, Changhong Liu, Yong Zhou
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[24] arXiv:2407.03188 [pdf, html, other]
Title: MuDiT & MuSiT: Alignment with Colloquial Expression in Description-to-Song Generation
Zihao Wang, Haoxuan Liu, Jiaxing Yu, Tao Zhang, Yan Liu, Kejun Zhang
Comments: 19 pages, 5 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[25] arXiv:2407.03361 [pdf, html, other]
Title: PianoBART: Symbolic Piano Music Generation and Understanding with Large-Scale Pre-Training
Xiao Liang, Zijian Zhao, Weichao Zeng, Yutong He, Fupeng He, Yiyi Wang, Chengying Gao
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[26] arXiv:2407.03440 [pdf, html, other]
Title: Advanced Framework for Animal Sound Classification With Features Optimization
Qiang Yang, Xiuying Chen, Changsheng Ma, Carlos M. Duarte, Xiangliang Zhang
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[27] arXiv:2407.03470 [pdf, html, other]
Title: Prosody-Driven Privacy-Preserving Dementia Detection
Dominika Woszczyk, Ranya Aloufi, Soteris Demetriou
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[28] arXiv:2407.03514 [pdf, html, other]
Title: Towards Attention-based Contrastive Learning for Audio Spoof Detection
Chirag Goel, Surya Koppisetti, Ben Colman, Ali Shahriyari, Gaurav Bharaj
Comments: Proc. INTERSPEECH 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[29] arXiv:2407.03736 [pdf, html, other]
Title: Semantic Grouping Network for Audio Source Separation
Shentong Mo, Yapeng Tian
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[30] arXiv:2407.03887 [pdf, html, other]
Title: Unsupervised speech enhancement with spectral kurtosis and double deep priors
Hien Ohnaka, Ryoichi Miyazaki
Comments: 11 pages, 12 figures, and 2 Tables, submitted to Acoustical Science and Technology
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[31] arXiv:2407.03892 [pdf, html, other]
Title: On the Effectiveness of Acoustic BPE in Decoder-Only TTS
Bohan Li, Feiyu Shen, Yiwei Guo, Shuai Wang, Xie Chen, Kai Yu
Comments: 5 pages, 3 tables, 1 figures. accepted to Interspeech 2024
Journal-ref: https://www.isca-archive.org/interspeech_2024/li24qa_interspeech.pdf
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[32] arXiv:2407.03966 [pdf, html, other]
Title: Serialized Output Training by Learned Dominance
Ying Shi, Lantian Li, Shi Yin, Dong Wang, Jiqing Han
Comments: accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[33] arXiv:2407.04051 [pdf, html, other]
Title: FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs
Keyu An, Qian Chen, Chong Deng, Zhihao Du, Changfeng Gao, Zhifu Gao, Yue Gu, Ting He, Hangrui Hu, Kai Hu, Shengpeng Ji, Yabin Li, Zerui Li, Heng Lu, Haoneng Luo, Xiang Lv, Bin Ma, Ziyang Ma, Chongjia Ni, Changhe Song, Jiaqi Shi, Xian Shi, Hao Wang, Wen Wang, Yuxuan Wang, Zhangyu Xiao, Zhijie Yan, Yexin Yang, Bin Zhang, Qinglin Zhang, Shiliang Zhang, Nan Zhao, Siqi Zheng
Comments: Work in progress. Authors are listed in alphabetical order by family name
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[34] arXiv:2407.04331 [pdf, html, other]
Title: MuseBarControl: Enhancing Fine-Grained Control in Symbolic Music Generation through Pre-Training and Counterfactual Loss
Yangyang Shu, Haiming Xu, Ziqin Zhou, Anton van den Hengel, Lingqiao Liu
Comments: Demo is available at: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[35] arXiv:2407.04333 [pdf, html, other]
Title: PAGURI: a user experience study of creative interaction with text-to-music models
Francesca Ronchini, Luca Comanducci, Gabriele Perego, Fabio Antonacci
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[36] arXiv:2407.04379 [pdf, html, other]
Title: A Mapping Strategy for Interacting with Latent Audio Synthesis Using Artistic Materials
Shuoyang Zheng, Anna Xambó Sedó, Nick Bryan-Kinns
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[37] arXiv:2407.04416 [pdf, html, other]
Title: Sound-VECaps: Improving Audio Generation with Visual Enhanced Captions
Yi Yuan, Dongya Jia, Xiaobin Zhuang, Yuanzhe Chen, Zhengxi Liu, Zhuo Chen, Yuping Wang, Yuxuan Wang, Xubo Liu, Xiyuan Kang, Mark D. Plumbley, Wenwu Wang
Comments: 5 pages with 1 appendix
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[38] arXiv:2407.04482 [pdf, html, other]
Title: Controlling Whisper: Universal Acoustic Adversarial Attacks to Control Speech Foundation Models
Vyas Raina, Mark Gales
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[39] arXiv:2407.04547 [pdf, html, other]
Title: Real-time Timbre Remapping with Differentiable DSP
Jordie Shier, Charalampos Saitis, Andrew Robertson, Andrew McPherson
Comments: Accepted for publication at the 24th International Conference on New Interfaces for Musical Expression in Utrecht, Netherlands
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[40] arXiv:2407.04578 [pdf, html, other]
Title: Resource-Efficient Speech Quality Prediction through Quantization Aware Training and Binary Activation Maps
Mattias Nilsson, Riccardo Miccini, Clément Laroche, Tobias Piechowiak, Friedemann Zenke
Comments: Accepted for Interspeech 2024
Journal-ref: Proceedings of Interspeech 2024
Subjects: Sound (cs.SD); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)
[41] arXiv:2407.04879 [pdf, html, other]
Title: All Neural Low-latency Directional Speech Extraction
Ashutosh Pandey, Sanha Lee, Juan Azcarreta, Daniel Wong, Buye Xu
Comments: Accepted for publication at INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[42] arXiv:2407.04936 [pdf, html, other]
Title: A Reference-free Metric for Language-Queried Audio Source Separation using Contrastive Language-Audio Pretraining
Feiyang Xiao, Jian Guan, Qiaoxi Zhu, Xubo Liu, Wenbo Wang, Shuhan Qi, Kejia Zhang, Jianyuan Sun, Wenwu Wang
Comments: Submitted to DCASE 2024 Workshop
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[43] arXiv:2407.04966 [pdf, html, other]
Title: A Layer-Anchoring Strategy for Enhancing Cross-Lingual Speech Emotion Recognition
Shreya G. Upadhyay, Carlos Busso, Chi-Chun Lee
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[44] arXiv:2407.05368 [pdf, html, other]
Title: Music Era Recognition Using Supervised Contrastive Learning and Artist Information
Qiqi He, Xuchen Song, Weituo Hao, Ju-Chiang Wang, Wei-Tsung Lu, Wei Li
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[45] arXiv:2407.05405 [pdf, html, other]
Title: Research on the Acoustic Emission Source Localization Methodology in Composite Materials based on Artificial Intelligence
Jongick Won, Hyuntaik Oh, Jae Sakong
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Data Analysis, Statistics and Probability (physics.data-an)
[46] arXiv:2407.05407 [pdf, html, other]
Title: CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
Zhihao Du, Qian Chen, Shiliang Zhang, Kai Hu, Heng Lu, Yexin Yang, Hangrui Hu, Siqi Zheng, Yue Gu, Ziyang Ma, Zhifu Gao, Zhijie Yan
Comments: work in progress. arXiv admin note: substantial text overlap with arXiv:2407.04051
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[47] arXiv:2407.05605 [pdf, html, other]
Title: Two-Path GMM-ResNet and GMM-SENet for ASV Spoofing Detection
Zhenchun Lei, Hui Yan, Changhong Liu, Minglei Ma, Yingen Yang
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[48] arXiv:2407.05608 [pdf, html, other]
Title: A Benchmark for Multi-speaker Anonymization
Xiaoxiao Miao, Ruijie Tao, Chang Zeng, Xin Wang
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[49] arXiv:2407.05782 [pdf, html, other]
Title: Sequential Contrastive Audio-Visual Learning
Ioannis Tsiamas, Santiago Pascual, Chunghsin Yeh, Joan Serrà
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[50] arXiv:2407.05870 [pdf, other]
Title: Cervical Auscultation Machine Learning for Dysphagia Assessment
An An Chia, Stacy Lum, Michelle Boo, Rex Tan, Balamurali B T, Jer-Ming Chen
Comments: International Conference on Signal Processing and Communications (SPCOM) July 01 - 04, 2024
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[51] arXiv:2407.06060 [pdf, html, other]
Title: MERGE -- A Bimodal Dataset for Static Music Emotion Recognition
Pedro Lima Louro, Hugo Redinho, Ricardo Santos, Ricardo Malheiro, Renato Panda, Rui Pedro Paiva
Comments: 16 pages, 4 figures, 13 tables, submitted to IEEE Transactions on Affective Computing
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[52] arXiv:2407.06078 [pdf, html, other]
Title: Few-Shot Keyword Spotting from Mixed Speech
Junming Yuan, Ying Shi, LanTian Li, Dong Wang, Askar Hamdulla
Comments: accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD)
[53] arXiv:2407.06291 [pdf, html, other]
Title: Transfer Learning with Pseudo Multi-Label Birdcall Classification for DS@GT BirdCLEF 2024
Anthony Miyaguchi, Adrian Cheung, Murilo Gustineli, Ashley Kim
Comments: Submitted and accepted into CLEF 2024 CEUR-WS proceedings
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[54] arXiv:2407.06310 [pdf, html, other]
Title: Homogeneous Speaker Features for On-the-Fly Dysarthric and Elderly Speaker Adaptation
Mengzhe Geng, Xurong Xie, Jiajun Deng, Zengrui Jin, Guinan Li, Tianzi Wang, Shujie Hu, Zhaoqing Li, Helen Meng, Xunying Liu
Comments: In submission to IEEE/ACM Transactions on Audio, Speech, and Language Processing
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[55] arXiv:2407.06524 [pdf, html, other]
Title: Improving Speech Enhancement by Integrating Inter-Channel and Band Features with Dual-branch Conformer
Jizhen Li, Xinmeng Xu, Weiping Tu, Yuhong Yang, Rong Zhu
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[56] arXiv:2407.06947 [pdf, html, other]
Title: Audio-Language Datasets of Scenes and Events: A Survey
Gijs Wijngaard, Elia Formisano, Michele Esposito, Michel Dumontier
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[57] arXiv:2407.07235 [pdf, html, other]
Title: Speech After Gender: A Trans-Feminine Perspective on Next Steps for Speech Science and Technology
Robin Netzorg, Alyssa Cote, Sumi Koshin, Klo Vivienne Garoute, Gopala Krishna Anumanchipalli
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[58] arXiv:2407.07397 [pdf, html, other]
Title: SimuSOE: A Simulated Snoring Dataset for Obstructive Sleep Apnea-Hypopnea Syndrome Evaluation during Wakefulness
Jie Lin, Xiuping Yang, Li Xiao, Xinhong Li, Weiyan Yi, Yuhong Yang, Weiping Tu, Xiong Chen
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[59] arXiv:2407.07408 [pdf, html, other]
Title: STONE: Self-supervised Tonality Estimator
Yuexuan Kong, Vincent Lostanlen, Gabriel Meseguer-Brocal, Stella Wong, Mathieu Lagrange, Romain Hennequin
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[60] arXiv:2407.07464 [pdf, html, other]
Title: Video-to-Audio Generation with Hidden Alignment
Manjie Xu, Chenxing Li, Xinyi Tu, Yong Ren, Rilin Chen, Yu Gu, Wei Liang, Dong Yu
Comments: this https URL
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[61] arXiv:2407.07598 [pdf, html, other]
Title: Targeted Augmented Data for Audio Deepfake Detection
Marcella Astrid, Enjie Ghorbel, Djamila Aouada
Comments: Accepted in EUSIPCO 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[62] arXiv:2407.07728 [pdf, html, other]
Title: SaMoye: Zero-shot Singing Voice Conversion Model Based on Feature Disentanglement and Enhancement
Zihao Wang, Le Ma, Yongsheng Feng, Xin Pan, Yuhang Jin, Kejun Zhang
Comments: 7 pages, 4 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[63] arXiv:2407.07825 [pdf, html, other]
Title: RT-LA-VocE: Real-Time Low-SNR Audio-Visual Speech Enhancement
Honglie Chen, Rodrigo Mira, Stavros Petridis, Maja Pantic
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[64] arXiv:2407.08239 [pdf, html, other]
Title: An Unsupervised Domain Adaptation Method for Locating Manipulated Region in partially fake Audio
Siding Zeng, Jiangyan Yi, Jianhua Tao, Yujie Chen, Shan Liang, Yong Ren, Xiaohui Zhang
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[65] arXiv:2407.08306 [pdf, html, other]
Title: Adversarial-MidiBERT: Symbolic Music Understanding Model Based on Unbias Pre-training and Mask Fine-tuning
Zijian Zhao
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[66] arXiv:2407.08647 [pdf, html, other]
Title: From Real to Cloned Singer Identification
Dorian Desblancs, Gabriel Meseguer-Brocal, Romain Hennequin, Manuel Moussallam
Comments: To be published at ISMIR 2024
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[67] arXiv:2407.08657 [pdf, other]
Title: Speech dereverberation constrained on room impulse response characteristics
Louis Bahrman (S2A, IDS), Mathieu Fontaine (S2A, IDS), Jonathan Le Roux (MERL), Gaël Richard (S2A, IDS)
Journal-ref: INTERSPEECH, Sep 2024, Kos Island, Greece
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[68] arXiv:2407.08658 [pdf, html, other]
Title: Evaluating Voice Command Pipelines for Drone Control: From STT and LLM to Direct Classification and Siamese Networks
Lucca Emmanuel Pineli Simões, Lucas Brandão Rodrigues, Rafaela Mota Silva, Gustavo Rodrigues da Silva
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI)
[69] arXiv:2407.08691 [pdf, html, other]
Title: ElasticAST: An Audio Spectrogram Transformer for All Length and Resolutions
Jiu Feng, Mehmet Hamza Erol, Joon Son Chung, Arda Senocak
Comments: Interspeech 2024. Code is available at this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[70] arXiv:2407.08951 [pdf, html, other]
Title: Audio Spotforming Using Nonnegative Tensor Factorization with Attractor-Based Regularization
Shoma Ayano, Li Li, Shogo Seki, Daichi Kitamura
Comments: Accepted at EUSIPCO2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[71] arXiv:2407.09099 [pdf, html, other]
Title: Music Proofreading with RefinPaint: Where and How to Modify Compositions given Context
Pedro Ramoneda, Martin Rocamora, Taketo Akama
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[72] arXiv:2407.09346 [pdf, html, other]
Title: A Preliminary Investigation on Flexible Singing Voice Synthesis Through Decomposed Framework with Inferrable Features
Lester Phillip Violeta, Taketo Akama
Comments: Preliminary investigations
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[73] arXiv:2407.09489 [pdf, html, other]
Title: ecVoice: Audio Text Extraction and Optimization of Video Based on Idioms Similarity Replacement
Jinwei Lin
Comments: APSIPA ASC 2023
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[74] arXiv:2407.09817 [pdf, html, other]
Title: Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition System
Lingwei Meng, Jiawen Kang, Yuejiao Wang, Zengrui Jin, Xixin Wu, Xunying Liu, Helen Meng
Comments: Accepted to INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[75] arXiv:2407.10048 [pdf, html, other]
Title: Whisper-SV: Adapting Whisper for Low-data-resource Speaker Verification
Li Zhang, Ning Jiang, Qing Wang, Yue Li, Quan Lu, Lei Xie
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[76] arXiv:2407.10182 [pdf, html, other]
Title: Few-Shot Bioacoustic Event Detection with Frame-Level Embedding Learning System
PengYuan Zhao, ChengWei Lu, Liang Zou
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[77] arXiv:2407.10255 [pdf, html, other]
Title: CUSIDE-T: Chunking, Simulating Future and Decoding for Transducer based Streaming ASR
Wenbo Zhao, Ziwei Li, Chuan Yu, Zhijian Ou
Comments: Accepted into ISCSLP 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[78] arXiv:2407.10328 [pdf, html, other]
Title: The Interpretation Gap in Text-to-Music Generation Models
Yongyi Zang, Yixiao Zhang
Comments: Under review
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[79] arXiv:2407.10373 [pdf, html, other]
Title: Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion
Jian Ma, Wenguan Wang, Yi Yang, Feng Zheng
Comments: ECCV 2024; Project page: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[80] arXiv:2407.10387 [pdf, html, other]
Title: Masked Generative Video-to-Audio Transformers with Enhanced Synchronicity
Santiago Pascual, Chunghsin Yeh, Ioannis Tsiamas, Joan Serrà
Comments: Accepted to ECCV 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[81] arXiv:2407.10446 [pdf, html, other]
Title: DDFAD: Dataset Distillation Framework for Audio Data
Wenbo Jiang, Rui Zhang, Hongwei Li, Xiaoyuan Liu, Haomiao Yang, Shui Yu
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Databases (cs.DB); Audio and Speech Processing (eess.AS)
[82] arXiv:2407.10462 [pdf, html, other]
Title: BandControlNet: Parallel Transformers-based Steerable Popular Music Generation with Fine-Grained Spatiotemporal Features
Jing Luo, Xinyu Yang, Dorien Herremans
Comments: Demo page: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[83] arXiv:2407.10468 [pdf, html, other]
Title: LiteFocus: Accelerated Diffusion Inference for Long Audio Synthesis
Zhenxiong Tan, Xinyin Ma, Gongfan Fang, Xinchao Wang
Comments: Interspeech 2024; Code: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[84] arXiv:2407.10646 [pdf, html, other]
Title: Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control
Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang
Comments: ISMIR 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[85] arXiv:2407.10828 [pdf, other]
Title: Towards Enhanced Classification of Abnormal Lung sound in Multi-breath: A Light Weight Multi-label and Multi-head Attention Classification Method
Yi-Wei Chua, Yun-Chien Cheng
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[86] arXiv:2407.11370 [pdf, html, other]
Title: A Pilot Study of GSLM-based Simulation of Foreign Accentuation Only Using Native Speech Corpora
Kentaro Onda, Joonyong Park, Nobuaki Minematsu, Daisuke Saito
Comments: Accepted to INTERSPEECH2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[87] arXiv:2407.11492 [pdf, html, other]
Title: MMSD-Net: Towards Multi-modal Stuttering Detection
Liangyu Nie, Sudarsana Reddy Kadiri, Ruchit Agrawal
Comments: Accepted at INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[88] arXiv:2407.11641 [pdf, html, other]
Title: Investigating the Effect of Label Topology and Training Criterion on ASR Performance and Alignment Quality
Tina Raissi, Christoph Lüscher, Simon Berger, Ralf Schlüter, Hermann Ney
Comments: Accepted for presentation at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[89] arXiv:2407.12563 [pdf, html, other]
Title: Audio Conditioning for Music Generation via Discrete Bottleneck Features
Simon Rouard, Yossi Adi, Jade Copet, Axel Roebel, Alexandre Défossez
Comments: 6 pages, 2 figures, accepted at ISMIR 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[90] arXiv:2407.12671 [pdf, html, other]
Title: GraphMuse: A Library for Symbolic Music Graph Processing
Emmanouil Karystinaios, Gerhard Widmer
Comments: Accepted at the 25th International Society for Music Information Retrieval Conference (ISMIR 2024)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Audio and Speech Processing (eess.AS)
[91] arXiv:2407.13035 [pdf, html, other]
Title: Pre-Trained Foundation Model representations to uncover Breathing patterns in Speech
Vikramjit Mitra, Anirban Chatterjee, Ke Zhai, Helen Weng, Ayuko Hill, Nicole Hay, Christopher Webb, Jamie Cheng, Erdrin Azemi
Comments: 8 pages, 6 figures, BioKDD workshop paper
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[92] arXiv:2407.13083 [pdf, html, other]
Title: Modeling and Driving Human Body Soundfields through Acoustic Primitives
Chao Huang, Dejan Markovic, Chenliang Xu, Alexander Richard
Comments: ECCV 2024. Project Page: this https URL
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[93] arXiv:2407.13198 [pdf, html, other]
Title: DiveSound: LLM-Assisted Automatic Taxonomy Construction for Diverse Audio Generation
Baihan Li, Zeyu Xie, Xuenan Xu, Yiwei Guo, Ming Yan, Ji Zhang, Kai Yu, Mengyue Wu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[94] arXiv:2407.13264 [pdf, html, other]
Title: Underwater Acoustic Signal Denoising Algorithms: A Survey of the State-of-the-art
Ruobin Gao, Maohan Liang, Heng Dong, Xuewen Luo, P. N. Suganthan
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[95] arXiv:2407.13266 [pdf, html, other]
Title: How Private is Low-Frequency Speech Audio in the Wild? An Analysis of Verbal Intelligibility by Humans and Machines
Ailin Liu, Pepijn Vunderink, Jose Vargas Quiros, Chirag Raman, Hayley Hung
Comments: This manuscript has been accepted by Interspeech 2024
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[96] arXiv:2407.13292 [pdf, html, other]
Title: Low-Resourced Speech Recognition for Iu Mien Language via Weakly-Supervised Phoneme-based Multilingual Pre-training
Lukuan Dong, Donghong Qin, Fengbo Bai, Fanhua Song, Yan Liu, Chen Xu, Zhijian Ou
Comments: Accepted into ISCSLP 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[97] arXiv:2407.13333 [pdf, html, other]
Title: Using Speech Foundational Models in Loss Functions for Hearing Aid Speech Enhancement
Robert Sutherland, George Close, Thomas Hain, Stefan Goetze, Jon Barker
Comments: Accepted for EUSIPCO 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[98] arXiv:2407.13439 [pdf, html, other]
Title: Reducing Barriers to the Use of Marginalised Music Genres in AI
Nick Bryan-Kinns, Zijin Li
Comments: In Proceedings of Explainable AI for the Arts Workshop 2024 (XAIxArts 2024) arXiv:2406.14485
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[99] arXiv:2407.13509 [pdf, html, other]
Title: Spontaneous Style Text-to-Speech Synthesis with Controllable Spontaneous Behaviors Based on Language Models
Weiqin Li, Peiji Yang, Yicheng Zhong, Yixuan Zhou, Zhisheng Wang, Zhiyong Wu, Xixin Wu, Helen Meng
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[100] arXiv:2407.14212 [pdf, html, other]
Title: Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2
Chun Xu, En-Wei Sun
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[101] arXiv:2407.14260 [pdf, other]
Title: Guitar Chord Diagram Suggestion for Western Popular Music
Alexandre d'Hooge, Louis Bigo (LaBRI, SCRIME), Ken Déguernel, Nicolas Martin
Journal-ref: Sound and Music Computing Conference, Jul 2024, Porto, Portugal
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
[102] arXiv:2407.14329 [pdf, html, other]
Title: Efficient Audio Captioning with Encoder-Level Knowledge Distillation
Xuenan Xu, Haohe Liu, Mengyue Wu, Wenwu Wang, Mark D. Plumbley
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[103] arXiv:2407.14355 [pdf, html, other]
Title: Enhancing Zero-shot Audio Classification using Sound Attribute Knowledge from Large Language Models
Xuenan Xu, Pingyue Zhang, Ming Yan, Ji Zhang, Mengyue Wu
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[104] arXiv:2407.14358 [pdf, html, other]
Title: Stable Audio Open
Zach Evans, Julian D. Parker, CJ Carr, Zack Zukowski, Josiah Taylor, Jordi Pons
Comments: Demo: this https URL Weights: this https URL Code: this https URL. arXiv admin note: text overlap with arXiv:2404.10301
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[105] arXiv:2407.14364 [pdf, html, other]
Title: Towards Assessing Data Replication in Music Generation with Music Similarity Metrics on Raw Audio
Roser Batlle-Roca, Wei-Hisang Liao, Xavier Serra, Yuki Mitsufuji, Emilia Gómez
Comments: Accepted at ISMIR 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[106] arXiv:2407.14525 [pdf, html, other]
Title: Morse Code-Enabled Speech Recognition for Individuals with Visual and Hearing Impairments
Ritabrata Roy Choudhury
Comments: 10 pages, 11 figures, 4 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
[107] arXiv:2407.14700 [pdf, html, other]
Title: Composer's Assistant 2: Interactive Multi-Track MIDI Infilling with Fine-Grained User Control
Martin E. Malandro
Comments: 8 pages, 6 figures, 2 tables. To be published in ISMIR 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[108] arXiv:2407.15060 [pdf, html, other]
Title: MusiConGen: Rhythm and Chord Control for Transformer-Based Text-to-Music Generation
Yun-Han Lan, Wen-Yi Hsiao, Hao-Chung Cheng, Yi-Hsuan Yang
Comments: Accepted by the 25th International Society for Music Information Retrieval (ISMIR)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[109] arXiv:2407.15216 [pdf, html, other]
Title: Explainability Paths for Sustained Artistic Practice with AI
Austin Tecks, Thomas Peschlow, Gabriel Vigliensoni
Comments: In Proceedings of Explainable AI for the Arts Workshop 2024 (XAIxArts 2024) arXiv:2406.14485
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[110] arXiv:2407.15300 [pdf, html, other]
Title: SELM: Enhancing Speech Emotion Recognition for Out-of-Domain Scenarios
Hazim Bukhari, Soham Deshmukh, Hira Dhamyal, Bhiksha Raj, Rita Singh
Comments: Accepted at INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[111] arXiv:2407.15672 [pdf, html, other]
Title: Computer Audition: From Task-Specific Machine Learning to Foundation Models
Andreas Triantafyllopoulos, Iosif Tsangko, Alexander Gebhard, Annamaria Mesaros, Tuomas Virtanen, Björn Schuller
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[112] arXiv:2407.16417 [pdf, html, other]
Title: On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysis
Eklavya Sarkar, Mathew Magimai.-Doss
Comments: Accepted at Interspeech 2024 satellite event (VIHAR 2024)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[113] arXiv:2407.16564 [pdf, html, other]
Title: Audio Prompt Adapter: Unleashing Music Editing Abilities for Text-to-Music with Lightweight Finetuning
Fang-Duo Tsai, Shih-Lun Wu, Haven Kim, Bo-Yu Chen, Hao-Chung Cheng, Yi-Hsuan Yang
Comments: Accepted by the 25th International Society for Music Information Retrieval (ISMIR)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[114] arXiv:2407.16639 [pdf, html, other]
Title: Distortion Recovery: A Two-Stage Method for Guitar Effect Removal
Ying-Shuo Lee, Yueh-Po Peng, Jui-Te Wu, Ming Cheng, Li Su, Yi-Hsuan Yang
Comments: DAFx 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[115] arXiv:2407.17167 [pdf, html, other]
Title: Zero-Shot vs. Few-Shot Multi-Speaker TTS Using Pre-trained Czech SpeechT5 Model
Jan Lehečka, Zdeněk Hanzlíček, Jindřich Matoušek, Daniel Tihelka
Comments: Accepted to TSD2024
Journal-ref: Text, Speech, and Dialogue. TSD 2024. Lecture Notes in Computer Science(), vol 15049
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[116] arXiv:2407.17172 [pdf, html, other]
Title: Speech Editing -- a Summary
Tobias Kässmann, Yining Liu, Danni Liu
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[117] arXiv:2407.17536 [pdf, other]
Title: Improved symbolic drum style classification with grammar-based hierarchical representations
Léo Géré (CNAM Paris, CEDRIC - VERTIGO), Philippe Rigaux (CEDRIC - VERTIGO, CNAM Paris), Nicolas Audebert (CEDRIC - VERTIGO, CNAM, IGN, LaSTIG)
Comments: International Society for Music Information Retrieval Conference 2024, Nov 2024, San Francisco, United States
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[118] arXiv:2407.17716 [pdf, html, other]
Title: Describe Where You Are: Improving Noise-Robustness for Speech Emotion Recognition with Text Description of the Environment
Seong-Gyun Leem, Daniel Fulford, Jukka-Pekka Onnela, David Gard, Carlos Busso
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[119] arXiv:2407.17844 [pdf, other]
Title: Innovative Speech-Based Deep Learning Approaches for Parkinson's Disease Classification: A Systematic Review
Lisanne van Gelderen, Cristian Tejedor-García
Comments: van Gelderen, L., & Tejedor-García, C. (2024). Innovative Speech-Based Deep Learning Approaches for Parkinson's Disease Classification: A Systematic Review. Applied Sciences, 14(17). doi:https://doi.org/10.3390/app14177873 This research was funded by the NWO research programme NGF AiNed Fellowship Grants under the project Responsible AI for Voice Diagnostics (RAIVD) - grant number NGF.1607.22.013
Journal-ref: Appl. Sci. 2024, 14(17), 7873
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[120] arXiv:2407.18058 [pdf, html, other]
Title: I can listen but cannot read: An evaluation of two-tower multimodal systems for instrument recognition
Yannis Vasilakis, Rachel Bittner, Johan Pauwels
Comments: Accepted to ISMIR 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[121] arXiv:2407.18062 [pdf, html, other]
Title: Audio Entailment: Assessing Deductive Reasoning for Audio Understanding
Soham Deshmukh, Shuo Han, Hazim Bukhari, Benjamin Elizalde, Hannes Gamper, Rita Singh, Bhiksha Raj
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[122] arXiv:2407.18424 [pdf, html, other]
Title: Model-driven Heart Rate Estimation and Heart Murmur Detection based on Phonocardiogram
Jingping Nie, Ran Liu, Behrooz Mahasseni, Erdrin Azemi, Vikramjit Mitra
Comments: 6 pages, 10 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[123] arXiv:2407.18461 [pdf, html, other]
Title: Enhancing Dysarthric Speech Recognition for Unseen Speakers via Prototype-Based Adaptation
Shiyao Wang, Shiwan Zhao, Jiaming Zhou, Aobo Kong, Yong Qin
Comments: accepted by Interspeech 2024
Journal-ref: INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[124] arXiv:2407.18517 [pdf, html, other]
Title: SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection
Yi Zhu, Surya Koppisetti, Trang Tran, Gaurav Bharaj
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[125] arXiv:2407.18541 [pdf, html, other]
Title: Towards Improving NAM-to-Speech Synthesis Intelligibility using Self-Supervised Speech Models
Neil Shah, Shirish Karande, Vineet Gandhi
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[126] arXiv:2407.18571 [pdf, html, other]
Title: Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks
Mahmoud Salhab, Haidar Harmanani
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[127] arXiv:2407.18879 [pdf, html, other]
Title: Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model
Hyun Jin Park, Dhruuv Agarwal, Neng Chen, Rentao Sun, Kurt Partridge, Justin Chen, Harry Zhang, Pai Zhu, Jacob Bartel, Kyle Kastner, Gary Wang, Andrew Rosenberg, Quan Wang
Comments: to be published in a Workshop at Interspeech 2024, Synthetic Data's Transformative Role in Foundational Speech Models
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[128] arXiv:2407.18985 [pdf, html, other]
Title: Implementation and Applications of WakeWords Integrated with Speaker Recognition: A Case Study
Alexandre Costa Ferro Filho, Elisa Ayumi Masasi de Oliveira, Iago Alves Brito, Pedro Martins Bittencourt
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[129] arXiv:2407.19224 [pdf, html, other]
Title: RAVSS: Robust Audio-Visual Speech Separation in Multi-Speaker Scenarios with Missing Visual Cues
Tianrui Pan, Jie Liu, Bohan Wang, Jie Tang, Gangshan Wu
Comments: Accepted by MM 2024
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[130] arXiv:2407.19265 [pdf, html, other]
Title: Towards Robust Few-shot Class Incremental Learning in Audio Classification using Contrastive Representation
Riyansha Singh, Parinita Nema, Vinod K Kurmi
Comments: INTERSPEECH 2024 accepted
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[131] arXiv:2407.19823 [pdf, html, other]
Title: Analyzing and reducing the synthetic-to-real transfer gap in Music Information Retrieval: the task of automatic drum transcription
Mickaël Zehren, Marco Alunno, Paolo Bientinesi
Comments: 21 pages, 4 figures
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[132] arXiv:2407.19862 [pdf, html, other]
Title: Wavespace: A Highly Explorable Wavetable Generator
Hazounne Lee, Kihong Kim, Sungho Lee, Kyogu Lee
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[133] arXiv:2407.19900 [pdf, html, other]
Title: Practical and Reproducible Symbolic Music Generation by Large Language Models with Structural Embeddings
Seungyeon Rhyu, Kichang Yang, Sungjun Cho, Jaehyeon Kim, Kyogu Lee, Moontae Lee
Comments: 9 pages, 6 figures, 4 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[134] arXiv:2407.20111 [pdf, html, other]
Title: Enhancing Anti-spoofing Countermeasures Robustness through Joint Optimization and Transfer Learning
Yikang Wang, Xingming Wang, Hiromitsu Nishizaki, Ming Li
Comments: 29 pages, 4 figures, Journal Papers
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[135] arXiv:2407.20176 [pdf, html, other]
Title: Emotion-Driven Melody Harmonization via Melodic Variation and Functional Representation
Jingyue Huang, Yi-Hsuan Yang
Comments: This work is the initial version of the ISMIR 2024 paper EMO-Disentanger
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[136] arXiv:2407.20445 [pdf, html, other]
Title: Futga: Towards Fine-grained Music Understanding through Temporally-enhanced Generative Augmentation
Junda Wu, Zachary Novack, Amit Namburi, Jiaheng Dai, Hao-Wen Dong, Zhouhang Xie, Carol Chen, Julian McAuley
Comments: 6 pages
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[137] arXiv:2407.20530 [pdf, html, other]
Title: SuperCodec: A Neural Speech Codec with Selective Back-Projection Network
Youqiang Zheng, Weiping Tu, Li Xiao, Xinmeng Xu
Comments: Accepted by ICASSP 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[138] arXiv:2407.20808 [pdf, html, other]
Title: Abusive Speech Detection in Indic Languages Using Acoustic Features
Anika A. Spiesberger, Andreas Triantafyllopoulos, Iosif Tsangko, Björn W. Schuller
Journal-ref: Proc. INTERSPEECH 2023, 2683-2687
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[139] arXiv:2407.20883 [pdf, html, other]
Title: PiCoGen: Generate Piano Covers with a Two-stage Approach
Chih-Pin Tan, Shuen-Huei Guan, Yi-Hsuan Yang
Comments: Published at ICMR 2024 (project page: this https URL)
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[140] arXiv:2407.20955 [pdf, html, other]
Title: Emotion-driven Piano Music Generation via Two-stage Disentanglement and Functional Representation
Jingyue Huang, Ke Chen, Yi-Hsuan Yang
Comments: Proceedings of the 25th International Society for Music Information Retrieval Conference, ISMIR 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[141] arXiv:2407.20989 [pdf, html, other]
Title: Contrasting Deep Learning Models for Direct Respiratory Insufficiency Detection Versus Blood Oxygen Saturation Estimation
Marcelo Matheus Gauy, Natalia Hitomi Koza, Ricardo Mikio Morita, Gabriel Rocha Stanzione, Arnaldo Candido Junior, Larissa Cristina Berti, Anna Sara Shafferman Levin, Ester Cerdeira Sabino, Flaviane Romani Fernandes Svartman, Marcelo Finger
Comments: 23 pages, 4 figures, in review at Journal of Biomedical Signal Processing and Control
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[142] arXiv:2407.21391 [pdf, other]
Title: Design and Development of Laughter Recognition System Based on Multimodal Fusion and Deep Learning
Fuzheng Zhao, Yu Bai
Comments: 7 pages,2 figures
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[143] arXiv:2407.21531 [pdf, html, other]
Title: Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation
Ziya Zhou, Yuhang Wu, Zhiyue Wu, Xinyue Zhang, Ruibin Yuan, Yinghao Ma, Lu Wang, Emmanouil Benetos, Wei Xue, Yike Guo
Comments: Accepted by ISMIR2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[144] arXiv:2407.21545 [pdf, html, other]
Title: Robust Lossy Audio Compression Identification
Hendrik Vincent Koops, Gianluca Micchi, Elio Quinton
Comments: Accepted to be published in the Proceedings of the 25th International Society for Music Information Retrieval Conference 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[145] arXiv:2407.21611 [pdf, html, other]
Title: Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism
Jiafeng Zhong, Bin Li, Jiangyan Yi
Comments: Accepted by interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[146] arXiv:2407.21615 [pdf, html, other]
Title: Between the AI and Me: Analysing Listeners' Perspectives on AI- and Human-Composed Progressive Metal Music
Pedro Sarmento, Jackson Loth, Mathieu Barthet
Comments: Reviewed pre-print accepted for publication at ISMIR 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[147] arXiv:2407.21658 [pdf, html, other]
Title: Beat this! Accurate beat tracking without DBN postprocessing
Francesco Foscarin, Jan Schlüter, Gerhard Widmer
Comments: Accepted at the 25th International Society for Music Information Retrieval Conference (ISMIR), 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[148] arXiv:2407.00003 (cross-list from q-bio.QM) [pdf, other]
Title: Cochlear Wave Propagation and Dynamics in the Human Base and Apex: Model-Based Estimates from Noninvasive Measurements
Samiya A Alkhairy
Comments: 7 pages, 2 figures, 9 equations. Published: Nonlinearity and Hearing: Advances in Theory and Experiment AIP Conf. Proc. 3062
Journal-ref: AIP Conference Proceedings, vol. 3062, no. 1. AIP Publishing, 2024
Subjects: Quantitative Methods (q-bio.QM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Tissues and Organs (q-bio.TO)
[149] arXiv:2407.00291 (cross-list from eess.AS) [pdf, html, other]
Title: FMSG-JLESS Submission for DCASE 2024 Task4 on Sound Event Detection with Heterogeneous Training Dataset and Potentially Missing Labels
Yang Xiao, Han Yin, Jisheng Bai, Rohan Kumar Das
Comments: Technical report for DCASE 2024 Challenge Task 4
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[150] arXiv:2407.00529 (cross-list from cs.LG) [pdf, html, other]
Title: Detecting and Identifying Selection Structure in Sequential Data
Yujia Zheng, Zeyu Tang, Yiwen Qiu, Bernhard Schölkopf, Kun Zhang
Comments: ICML 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Statistics Theory (math.ST); Machine Learning (stat.ML)
[151] arXiv:2407.00753 (cross-list from eess.AS) [pdf, html, other]
Title: FLY-TTS: Fast, Lightweight and High-Quality End-to-End Text-to-Speech Synthesis
Yinlin Guo, Yening Lv, Jinqiao Dou, Yan Zhang, Yuehai Wang
Comments: Accepted to Interspeech 2024. 5 pages, 1 figure
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[152] arXiv:2407.00756 (cross-list from eess.AS) [pdf, html, other]
Title: Less Forgetting for Better Generalization: Exploring Continual-learning Fine-tuning Methods for Speech Self-supervised Representations
Salah Zaiem, Titouan Parcollet, Slim Essid
Comments: 5 Pages
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[153] arXiv:2407.00826 (cross-list from cs.CL) [pdf, html, other]
Title: NAIST Simultaneous Speech Translation System for IWSLT 2024
Yuka Ko, Ryo Fukuda, Yuta Nishikawa, Yasumasa Kano, Tomoya Yanagita, Kosuke Doi, Mana Makinae, Haotian Tan, Makoto Sakai, Sakriani Sakti, Katsuhito Sudoh, Satoshi Nakamura
Comments: IWSLT 2024 system paper
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[154] arXiv:2407.00837 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Robust Speech Representation Learning for Thousands of Languages
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
Comments: Updated affiliations; 20 pages
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[155] arXiv:2407.00913 (cross-list from cs.CR) [pdf, html, other]
Title: SecureSpectra: Safeguarding Digital Identity from Deep Fake Threats via Intelligent Signatures
Oguzhan Baser, Kaan Kale, Sandeep P. Chinchali
Comments: 5 pages, 4 figures, Proc. INTERSPEECH 2024
Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[156] arXiv:2407.01257 (cross-list from cs.CL) [pdf, html, other]
Title: uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes
Abdul Waheed, Karima Kadaoui, Bhiksha Raj, Muhammad Abdul-Mageed
Comments: Work in progress
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[157] arXiv:2407.01494 (cross-list from cs.CV) [pdf, html, other]
Title: FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
Yiming Zhang, Yicheng Gu, Yanhong Zeng, Zhening Xing, Yuancheng Wang, Zhizheng Wu, Kai Chen
Comments: Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[158] arXiv:2407.01857 (cross-list from eess.AS) [pdf, html, other]
Title: SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling
Hiroshi Sato, Takafumi Moriya, Masato Mimura, Shota Horiguchi, Tsubasa Ochiai, Takanori Ashihara, Atsushi Ando, Kentaro Shinayama, Marc Delcroix
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[159] arXiv:2407.01909 (cross-list from cs.CL) [pdf, html, other]
Title: Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models
Zhiyuan Tang, Dong Wang, Shen Huang, Shidong Shang
Comments: Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[160] arXiv:2407.01911 (cross-list from cs.CL) [pdf, html, other]
Title: Investigating the Effects of Large-Scale Pseudo-Stereo Data and Different Speech Foundation Model on Dialogue Generative Spoken Language Model
Yu-Kuan Fu, Cheng-Kuang Lee, Hsiu-Hsuan Wang, Hung-yi Lee
Comments: submitted to interspeech 2024
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[161] arXiv:2407.02004 (cross-list from cs.CV) [pdf, html, other]
Title: SAVE: Segment Audio-Visual Easy way using Segment Anything Model
Khanh-Binh Nguyen, Chae Jung Park
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[162] arXiv:2407.02005 (cross-list from cs.CL) [pdf, html, other]
Title: An End-to-End Speech Summarization Using Large Language Model
Hengchao Shang, Zongyao Li, Jiaxin Guo, Shaojun Li, Zhiqiang Rao, Yuanchang Luo, Daimeng Wei, Hao Yang
Comments: InterSpeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[163] arXiv:2407.02049 (cross-list from eess.AS) [pdf, html, other]
Title: Accompanied Singing Voice Synthesis with Fully Text-controlled Melody
Ruiqi Li, Zhiqing Hong, Yongqi Wang, Lichao Zhang, Rongjie Huang, Siqi Zheng, Zhou Zhao
Comments: Working in progress
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[164] arXiv:2407.02052 (cross-list from eess.AS) [pdf, html, other]
Title: The USTC-NERCSLIP Systems for The ICMC-ASR Challenge
Minghui Wu, Luzhen Xu, Jie Zhang, Haitao Tang, Yanyan Yue, Ruizhi Liao, Jintao Zhao, Zhengzhe Zhang, Yichi Wang, Haoyin Yan, Hongliang Yu, Tongle Ma, Jiachen Liu, Chongliang Wu, Yongchao Li, Yanyong Zhang, Xin Fang, Yue Zhang
Comments: Accepted at ICASSP 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[165] arXiv:2407.02243 (cross-list from cs.CL) [pdf, html, other]
Title: Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization
Yuchen Hu, Chen Chen, Siyin Wang, Eng Siong Chng, Chao Zhang
Comments: 12 pages, Work in progress
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[166] arXiv:2407.02264 (cross-list from cs.CV) [pdf, html, other]
Title: SOAF: Scene Occlusion-aware Neural Acoustic Field
Huiyu Gao, Jiahao Ma, David Ahmedt-Aristizabal, Chuong Nguyen, Miaomiao Liu
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[167] arXiv:2407.02543 (cross-list from cs.CL) [pdf, html, other]
Title: Towards the Next Frontier in Speech Representation Learning Using Disentanglement
Varun Krishna, Sriram Ganapathy
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[168] arXiv:2407.02631 (cross-list from cs.CL) [pdf, html, other]
Title: Nollywood: Let's Go to the Movies!
John E. Ortega, Ibrahim Said Ahmad, William Chen
Comments: 8 pages, 4 figures, 2 tables
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[169] arXiv:2407.02749 (cross-list from eess.AS) [pdf, html, other]
Title: VAE-based Phoneme Alignment Using Gradient Annealing and SSL Acoustic Features
Tomoki Koriyama
Comments: Proceedings of Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[170] arXiv:2407.02937 (cross-list from cs.CL) [pdf, html, other]
Title: Probing the Feasibility of Multilingual Speaker Anonymization
Sarina Meyer, Florian Lux, Ngoc Thang Vu
Comments: accepted at Interspeech 2024
Journal-ref: Proc. Interspeech 2024, pp. 4448-4452
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[171] arXiv:2407.03005 (cross-list from cs.CL) [pdf, html, other]
Title: Human-like Linguistic Biases in Neural Speech Models: Phonetic Categorization and Phonotactic Constraints in Wav2Vec2.0
Marianne de Heer Kloots, Willem Zuidema
Comments: Accepted to Interspeech 2024. For code and materials, see this https URL
Journal-ref: Proc. INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[172] arXiv:2407.03169 (cross-list from cs.CL) [pdf, html, other]
Title: Investigating Decoder-only Large Language Models for Speech-to-text Translation
Chao-Wei Huang, Hui Lu, Hongyu Gong, Hirofumi Inaguma, Ilia Kulikov, Ruslan Mavlyutov, Sravya Popuri
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[173] arXiv:2407.03645 (cross-list from cs.CL) [pdf, other]
Title: Continual Learning Optimizations for Auto-regressive Decoder of Multilingual ASR systems
Chin Yuen Kwok, Jia Qi Yip, Eng Siong Chng
Comments: Proceedings of Interspeech
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[174] arXiv:2407.03648 (cross-list from eess.AS) [pdf, html, other]
Title: High Fidelity Text-Guided Music Editing via Single-Stage Flow Matching
Gael Le Lan, Bowen Shi, Zhaoheng Ni, Sidd Srinivasan, Anurag Kumar, Brian Ellis, David Kant, Varun Nagaraja, Ernie Chang, Wei-Ning Hsu, Yangyang Shi, Vikas Chandra
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[175] arXiv:2407.03656 (cross-list from eess.AS) [pdf, html, other]
Title: WildDESED: An LLM-Powered Dataset for Wild Domestic Environment Sound Event Detection System
Yang Xiao, Rohan Kumar Das
Comments: DCASE WS 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[176] arXiv:2407.03657 (cross-list from eess.AS) [pdf, html, other]
Title: UCIL: An Unsupervised Class Incremental Learning Approach for Sound Event Detection
Yang Xiao, Rohan Kumar Das
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[177] arXiv:2407.03661 (cross-list from eess.AS) [pdf, html, other]
Title: Configurable DOA Estimation using Incremental Learning
Yang Xiao, Rohan Kumar Das
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[178] arXiv:2407.03718 (cross-list from cs.CL) [pdf, html, other]
Title: Multi-Convformer: Extending Conformer with Multiple Convolution Kernels
Darshan Prabhu, Yifan Peng, Preethi Jyothi, Shinji Watanabe
Comments: Accepted to INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[179] arXiv:2407.03734 (cross-list from cs.CL) [pdf, html, other]
Title: Improving Self-supervised Pre-training using Accent-Specific Codebooks
Darshan Prabhu, Abhishek Gupta, Omkar Nitsure, Preethi Jyothi, Sriram Ganapathy
Comments: Accepted to INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[180] arXiv:2407.04047 (cross-list from cs.CL) [pdf, html, other]
Title: Improving Accented Speech Recognition using Data Augmentation based on Unsupervised Text-to-Speech Synthesis
Cong-Thanh Do, Shuhei Imai, Rama Doddipatla, Thomas Hain
Comments: Accepted to EUSIPCO 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[181] arXiv:2407.04270 (cross-list from eess.AS) [pdf, html, other]
Title: Who Finds This Voice Attractive? A Large-Scale Experiment Using In-the-Wild Data
Hitoshi Suda, Aya Watanabe, Shinnosuke Takamichi
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[182] arXiv:2407.04279 (cross-list from cs.CL) [pdf, html, other]
Title: BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks
Jieying Xue, Minh Phuong Nguyen, Blake Matheny, Le Minh Nguyen
Comments: Accepted in the 33rd International Conference on Artificial Neural Networks (ICANN 2024)
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[183] arXiv:2407.04280 (cross-list from cs.CL) [pdf, html, other]
Title: LearnerVoice: A Dataset of Non-Native English Learners' Spontaneous Speech
Haechan Kim, Junho Myung, Seoyoung Kim, Sungpah Lee, Dongyeop Kang, Juho Kim
Comments: Proceedings of Interspeech
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[184] arXiv:2407.04293 (cross-list from cs.CL) [pdf, html, other]
Title: Systematic Evaluation of Online Speaker Diarization Systems Regarding their Latency
Roman Aperdannier, Sigurd Schacht, Alexander Piazza
Comments: 6 pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[185] arXiv:2407.04368 (cross-list from cs.CL) [pdf, html, other]
Title: Romanization Encoding For Multilingual ASR
Wen Ding, Fei Jia, Hainan Xu, Yu Xi, Junjie Lai, Boris Ginsburg
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[186] arXiv:2407.04444 (cross-list from cs.CL) [pdf, html, other]
Title: TokenVerse: Towards Unifying Speech and NLP Tasks via Transducer-based ASR
Shashi Kumar, Srikanth Madikeri, Juan Zuluaga-Gomez, Iuliia Thorbecke, Esaú Villatoro-Tello, Sergio Burdisso, Petr Motlicek, Karthik Pandia, Aravind Ganapathiraju
Comments: Accepted at EMNLP 2024 (Main Conference)
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[187] arXiv:2407.04533 (cross-list from cs.CL) [pdf, html, other]
Title: Performance Analysis of Speech Encoders for Low-Resource SLU and ASR in Tunisian Dialect
Salima Mdhaffar, Haroun Elleuch, Fethi Bougares, Yannick Estève
Comments: Accepted in ArabicNLP 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[188] arXiv:2407.04675 (cross-list from eess.AS) [pdf, html, other]
Title: Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition
Ye Bai, Jingping Chen, Jitong Chen, Wei Chen, Zhuo Chen, Chuang Ding, Linhao Dong, Qianqian Dong, Yujiao Du, Kepan Gao, Lu Gao, Yi Guo, Minglun Han, Ting Han, Wenchao Hu, Xinying Hu, Yuxiang Hu, Deyu Hua, Lu Huang, Mingkun Huang, Youjia Huang, Jishuo Jin, Fanliu Kong, Zongwei Lan, Tianyu Li, Xiaoyang Li, Zeyang Li, Zehua Lin, Rui Liu, Shouda Liu, Lu Lu, Yizhou Lu, Jingting Ma, Shengtao Ma, Yulin Pei, Chen Shen, Tian Tan, Xiaogang Tian, Ming Tu, Bo Wang, Hao Wang, Yuping Wang, Yuxuan Wang, Hanzhang Xia, Rui Xia, Shuangyi Xie, Hongmin Xu, Meng Yang, Bihong Zhang, Jun Zhang, Wanyi Zhang, Yang Zhang, Yawei Zhang, Yijie Zheng, Ming Zou
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[189] arXiv:2407.04822 (cross-list from eess.AS) [pdf, html, other]
Title: YourMT3+: Multi-instrument Music Transcription with Enhanced Transformer Architectures and Cross-dataset Stem Augmentation
Sungkyun Chang, Emmanouil Benetos, Holger Kirchhoff, Simon Dixon
Comments: Accepted at IEEE International Workshop on Machine Learning for Signal Processing (MLSP) 2024, London
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[190] arXiv:2407.04849 (cross-list from cs.AR) [pdf, html, other]
Title: MUSIC-lite: Efficient MUSIC using Approximate Computing: An OFDM Radar Case Study
Rajat Bhattacharjya, Arnab Sarkar, Biswadip Maity, Nikil Dutt
Comments: Paper accepted at ESWEEK-CASES 2024 as a Late Breaking (LB) Result paper. The definitive version of the work will appear in IEEE Embedded Systems Letters
Subjects: Hardware Architecture (cs.AR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[191] arXiv:2407.05310 (cross-list from eess.SP) [pdf, html, other]
Title: Ternary Spike-based Neuromorphic Signal Processing System
Shuai Wang, Dehao Zhang, Ammar Belatreche, Yichen Xiao, Hongyu Qing, Wenjie We, Malu Zhang, Yang Yang
Subjects: Signal Processing (eess.SP); Neural and Evolutionary Computing (cs.NE); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[192] arXiv:2407.05421 (cross-list from eess.AS) [pdf, html, other]
Title: ASRRL-TTS: Agile Speaker Representation Reinforcement Learning for Text-to-Speech Speaker Adaptation
Ruibo Fu, Xin Qi, Zhengqi Wen, Jianhua Tao, Tao Wang, Chunyu Qiang, Zhiyong Wang, Yi Lu, Xiaopeng Wang, Shuchen Shi, Yukun Liu, Xuefei Liu, Shuai Zhang
Comments: The audio demo is available at this https URL
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[193] arXiv:2407.05471 (cross-list from eess.AS) [pdf, html, other]
Title: Fine-Grained and Interpretable Neural Speech Editing
Max Morrison, Cameron Churchwell, Nathan Pruyne, Bryan Pardo
Comments: Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[194] arXiv:2407.05516 (cross-list from eess.AS) [pdf, html, other]
Title: Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation
Jin Woo Lee, Jaehyun Park, Min Jun Choi, Kyogu Lee
Comments: 38th Conference on Neural Information Processing Systems (NeurIPS 2024)
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)
[195] arXiv:2407.05551 (cross-list from cs.CV) [pdf, html, other]
Title: Read, Watch and Scream! Sound Generation from Text and Video
Yujin Jeong, Yunji Kim, Sanghyuk Chun, Jiyoung Lee
Comments: Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[196] arXiv:2407.05744 (cross-list from eess.AS) [pdf, html, other]
Title: Automating Urban Soundscape Enhancements with AI: In-situ Assessment of Quality and Restorativeness in Traffic-Exposed Residential Areas
Bhan Lam, Zhen-Ting Ong, Kenneth Ooi, Wen-Hui Ong, Trevor Wong, Karn N. Watcharasupat, Vanessa Boey, Irene Lee, Joo Young Hong, Jian Kang, Kar Fye Alvin Lee, Georgios Christopoulos, Woon-Seng Gan
Comments: 41 pages, 4 figures. Preprint submitted to Building and Environment
Journal-ref: Building and Environment, vol. 266, p. 112106, Dec. 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[197] arXiv:2407.05746 (cross-list from cs.AI) [pdf, other]
Title: MSP-Podcast SER Challenge 2024: L'antenne du Ventoux Multimodal Self-Supervised Learning for Speech Emotion Recognition
Jarod Duret (LIA), Mickael Rouvier (LIA), Yannick Estève (LIA)
Journal-ref: Odyssey 2024, Jun 2024, Quebec, France
Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[198] arXiv:2407.05760 (cross-list from stat.AP) [pdf, html, other]
Title: Dirichlet process mixture model based on topologically augmented signal representation for clustering infant vocalizations
Guillem Bonafos, Clara Bourot, Pierre Pudlo, Jean-Marc Freyermuth, Laurence Reboul, Samuel Tronçon, Arnaud Rey
Subjects: Applications (stat.AP); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)
[199] arXiv:2407.06800 (cross-list from eess.AS) [pdf, html, other]
Title: Learn and Don't Forget: Adding a New Language to ASR Foundation Models
Mengjie Qian, Siyuan Tang, Rao Ma, Kate M. Knill, Mark J. F. Gales
Comments: Proceedings of Interspeech
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[200] arXiv:2407.06847 (cross-list from eess.AS) [pdf, html, other]
Title: Gaunt coefficients for complex and real spherical harmonics with applications to spherical array processing and Ambisonics
Archontis Politis
Subjects: Audio and Speech Processing (eess.AS); Graphics (cs.GR); Sound (cs.SD); Signal Processing (eess.SP)
[201] arXiv:2407.06901 (cross-list from cs.HC) [pdf, html, other]
Title: RespEar: Earable-Based Robust Respiratory Rate Monitoring
Yang Liu, Kayla-Jade Butkow, Jake Stuchbury-Wass, Adam Pullin, Dong Ma, Cecilia Mascolo
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[202] arXiv:2407.07015 (cross-list from cs.HC) [pdf, html, other]
Title: A Framework for Multimodal Medical Image Interaction
Laura Schütz, Sasan Matinfar, Gideon Schafroth, Navid Navab, Merle Fairhurst, Arthur Wagner, Benedikt Wiestler, Ulrich Eck, Nassir Navab
Comments: Accepted for publication in IEEE TVCG; presentation at IEEE ISMAR 2024
Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[203] arXiv:2407.07275 (cross-list from eess.AS) [pdf, html, other]
Title: Remastering Divide and Remaster: A Cinematic Audio Source Separation Dataset with Multilingual Support
Karn N. Watcharasupat, Chih-Wei Wu, Iroro Orife
Comments: Accepted to the 5th IEEE International Symposium on the Internet of Sounds. Camera-ready version
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[204] arXiv:2407.07425 (cross-list from cs.CL) [pdf, html, other]
Title: Out-of-distribution generalisation in spoken language understanding
Dejan Porjazovski, Anssi Moisio, Mikko Kurimo
Comments: Accepted for INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[205] arXiv:2407.07554 (cross-list from cs.GR) [pdf, html, other]
Title: Beat-It: Beat-Synchronized Multi-Condition 3D Dance Generation
Zikai Huang, Xuemiao Xu, Cheng Xu, Huaidong Zhang, Chenxi Zheng, Jing Qin, Shengfeng He
Comments: ECCV 2024
Subjects: Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[206] arXiv:2407.07566 (cross-list from cs.CL) [pdf, html, other]
Title: HebDB: a Weakly Supervised Dataset for Hebrew Speech Processing
Arnon Turetzky, Or Tal, Yael Segal-Feldman, Yehoshua Dissen, Ella Zeldes, Amit Roth, Eyal Cohen, Yosi Shrem, Bronya R. Chernyak, Olga Seleznova, Joseph Keshet, Yossi Adi
Comments: Accepted at Interspeech2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[207] arXiv:2407.07595 (cross-list from q-bio.NC) [pdf, html, other]
Title: Scaling Law in Neural Data: Non-Invasive Speech Decoding with 175 Hours of EEG Data
Motoshige Sato, Kenichi Tomeoka, Ilya Horiguchi, Kai Arulkumaran, Ryota Kanai, Shuntaro Sasai
Subjects: Neurons and Cognition (q-bio.NC); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[208] arXiv:2407.07801 (cross-list from eess.AS) [pdf, html, other]
Title: AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning
Jongsuk Kim, Jiwon Shin, Junmo Kim
Comments: Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[209] arXiv:2407.08016 (cross-list from eess.AS) [pdf, html, other]
Title: Source Tracing of Audio Deepfake Systems
Nicholas Klein, Tianxiang Chen, Hemlata Tak, Ricardo Casal, Elie Khoury
Comments: Accepted by INTERSPEECH 2024
Journal-ref: Proceedings of Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[210] arXiv:2407.08017 (cross-list from eess.AS) [pdf, html, other]
Title: Phonetic Richness for Improved Automatic Speaker Verification
Nicholas Klein, Ganesh Sivaraman, Elie Khoury
Comments: Accepted by EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[211] arXiv:2407.08130 (cross-list from cs.MM) [pdf, html, other]
Title: Spiking Tucker Fusion Transformer for Audio-Visual Zero-Shot Learning
Wenrui Li, Penghong Wang, Ruiqin Xiong, Xiaopeng Fan
Comments: Accepted by TIP
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[212] arXiv:2407.08551 (cross-list from cs.CL) [pdf, html, other]
Title: Autoregressive Speech Synthesis without Vector Quantization
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[213] arXiv:2407.08752 (cross-list from eess.AS) [pdf, other]
Title: From Modular to End-to-End Speaker Diarization
Federico Landini
Comments: Ph.D. thesis. Successfully defended on 27.06.2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[214] arXiv:2407.08889 (cross-list from eess.AS) [pdf, html, other]
Title: Diff-MST: Differentiable Mixing Style Transfer
Soumya Sai Vanka, Christian Steinmetz, Jean-Baptiste Rolland, Joshua Reiss, George Fazekas
Comments: Accepted to be published at the Proceedings of the 25th International Society for Music Information Retrieval Conference 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[215] arXiv:2407.09029 (cross-list from cs.MM) [pdf, html, other]
Title: Enhancing Emotion Recognition in Incomplete Data: A Novel Cross-Modal Alignment, Reconstruction, and Refinement Framework
Haoqin Sun, Shiwan Zhao, Shaokai Li, Xiangyu Kong, Xuechen Wang, Aobo Kong, Jiaming Zhou, Yong Chen, Wenjia Zeng, Yong Qin
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[216] arXiv:2407.09259 (cross-list from eess.SP) [pdf, html, other]
Title: Informed FastICA: Semi-Blind Minimum Variance Distortionless Beamformer
Zbyněk Koldovský, Jiří Málek, Jaroslav Čmejla, Stephen O'Regan
Comments: accepted for IWAENC 2024
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[217] arXiv:2407.09732 (cross-list from eess.AS) [pdf, html, other]
Title: Speech Slytherin: Examining the Performance and Efficiency of Mamba for Speech Separation, Recognition, and Synthesis
Xilin Jiang, Yinghao Aaron Li, Adrian Nicolas Florea, Cong Han, Nima Mesgarani
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[218] arXiv:2407.09886 (cross-list from eess.AS) [pdf, html, other]
Title: Speech-Copilot: Leveraging Large Language Models for Speech Processing via Task Decomposition, Modularization, and Program Generation
Chun-Yi Kuan, Chih-Kai Yang, Wei-Ping Huang, Ke-Han Lu, Hung-yi Lee
Comments: Accepted to SLT 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[219] arXiv:2407.10108 (cross-list from eess.AS) [pdf, html, other]
Title: Advancing Continual Learning for Robust Deepfake Audio Classification
Feiyi Dong, Qingchen Tang, Yichen Bai, Zihan Wang
Comments: Submitted to IEEE Tencon. 5 pages
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[220] arXiv:2407.10471 (cross-list from cs.CR) [pdf, html, other]
Title: GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis
Weizhi Liu, Yue Li, Dongdong Lin, Hui Tian, Haizhou Li
Comments: Accepted by ACM MM 2024
Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[221] arXiv:2407.10603 (cross-list from eess.AS) [pdf, html, other]
Title: Leave No Knowledge Behind During Knowledge Distillation: Towards Practical and Effective Knowledge Distillation for Code-Switching ASR Using Realistic Data
Liang-Hsuan Tseng, Zih-Ching Chen, Wei-Shun Chang, Cheng-Kuang Lee, Tsung-Ren Huang, Hung-yi Lee
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[222] arXiv:2407.10689 (cross-list from eess.SP) [pdf, other]
Title: Classification of Heart Sounds Using Multi-Branch Deep Convolutional Network and LSTM-CNN
Seyed Amir Latifi, Hassan Ghassemian, Maryam Imani
Comments: 19 pages,
Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[223] arXiv:2407.11012 (cross-list from cs.CL) [pdf, html, other]
Title: Exploring Gender-Specific Speech Patterns in Automatic Suicide Risk Assessment
Maurice Gerczuk, Shahin Amiriparian, Justina Lutz, Wolfgang Strube, Irina Papazova, Alkomiet Hasan, Björn W. Schuller
Comments: accepted at INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[224] arXiv:2407.11055 (cross-list from cs.LG) [pdf, html, other]
Title: Knowledge boosting during low-latency inference
Vidya Srinivas, Malek Itani, Tuochao Chen, Sefik Emre Eskimez, Takuya Yoshioka, Shyamnath Gollakota
Comments: Accepted by Interspeech 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[225] arXiv:2407.11333 (cross-list from cs.RO) [pdf, html, other]
Title: Disentangled Acoustic Fields For Multimodal Physical Scene Understanding
Jie Yin, Andrew Luo, Yilun Du, Anoop Cherian, Tim K. Marks, Jonathan Le Roux, Chuang Gan
Subjects: Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[226] arXiv:2407.11345 (cross-list from cs.CL) [pdf, html, other]
Title: Beyond Binary: Multiclass Paraphasia Detection with Generative Pretrained Transformers and End-to-End Models
Matthew Perez, Aneesha Sampath, Minxue Niu, Emily Mower Provost
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[227] arXiv:2407.11650 (cross-list from cs.CV) [pdf, html, other]
Title: Statistics-aware Audio-visual Deepfake Detector
Marcella Astrid, Enjie Ghorbel, Djamila Aouada
Comments: Accepted in ICIP 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[228] arXiv:2407.11745 (cross-list from eess.AS) [pdf, html, other]
Title: Universal Sound Separation with Self-Supervised Audio Masked Autoencoder
Junqi Zhao, Xubo Liu, Jinzheng Zhao, Yi Yuan, Qiuqiang Kong, Mark D. Plumbley, Wenwu Wang
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[229] arXiv:2407.11992 (cross-list from cs.HC) [pdf, html, other]
Title: Flowers Revisited: A Preliminary Replication of Flowers et al. 1997
Kajetan Enge, Liam Fabry, Robert Höldrich
Comments: 4 pages, 3 figures, to be presented as an extended abstract at the 29th International Conference on Auditory Display (2024) in Troy, New York, USA
Subjects: Human-Computer Interaction (cs.HC); Graphics (cs.GR); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[230] arXiv:2407.12000 (cross-list from cs.IT) [pdf, html, other]
Title: The Kolmogorov Complexity of Irish traditional dance music
Michael McGettrick, Paul McGettrick
Comments: 6 pages
Subjects: Information Theory (cs.IT); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[231] arXiv:2407.12206 (cross-list from cs.CL) [pdf, html, other]
Title: A Language Modeling Approach to Diacritic-Free Hebrew TTS
Amit Roth, Arnon Turetzky, Yossi Adi
Comments: Accepted at Interspeech24
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[232] arXiv:2407.12380 (cross-list from eess.AS) [pdf, html, other]
Title: PCQ: Emotion Recognition in Speech via Progressive Channel Querying
Xincheng Wang, Liejun Wang, Yinfeng Yu, Xinxin Jiao
Comments: Accepted for publication by International Conference On Intelligent Computing 2024. For data and code, see <a href="this https URL https URL</a>
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[233] arXiv:2407.12707 (cross-list from eess.AS) [pdf, html, other]
Title: TTSDS -- Text-to-Speech Distribution Score
Christoph Minixhofer, Ondřej Klejch, Peter Bell
Comments: Under review for SLT 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[234] arXiv:2407.12817 (cross-list from cs.CL) [pdf, html, other]
Title: Error Correction by Paying Attention to Both Acoustic and Confidence References for Automatic Speech Recognition
Yuchun Shu, Bo Hu, Yifeng He, Hao Shi, Longbiao Wang, Jianwu Dang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[235] arXiv:2407.13095 (cross-list from cs.CV) [pdf, html, other]
Title: Audio-visual Generalized Zero-shot Learning the Easy Way
Shentong Mo, Pedro Morgado
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[236] arXiv:2407.13142 (cross-list from cs.CL) [pdf, other]
Title: A light-weight and efficient punctuation and word casing prediction model for on-device streaming ASR
Jian You, Xiangfeng Li
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[237] arXiv:2407.13153 (cross-list from cs.CL) [pdf, html, other]
Title: Preset-Voice Matching for Privacy Regulated Speech-to-Speech Translation Systems
Daniel Platnick, Bishoy Abdelnour, Eamon Earl, Rahul Kumar, Zahra Rezaei, Thomas Tsangaris, Faraj Lagum
Comments: Accepted to the ACL PrivateNLP 2024 Workshop, 7 pages, 2 figures
Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[238] arXiv:2407.13220 (cross-list from eess.AS) [pdf, html, other]
Title: MEDIC: Zero-shot Music Editing with Disentangled Inversion Control
Huadai Liu, Jialei Wang, Xiangtai Li, Rongjie Huang, Yang Liu, Jiayang Xu, Zhou Zhao
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[239] arXiv:2407.13242 (cross-list from eess.AS) [pdf, html, other]
Title: Fade-in Reverberation in Multi-room Environments Using the Common-Slope Model
Kyung Yun Lee, Nils Meyer-Kahlen, Georg Götz, U. Peter Svensson, Sebastian J. Schlecht, Vesa Välimäki
Comments: 2024 AES 5th International Conference on Audio for Virtual and Augmented Reality
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[240] arXiv:2407.13435 (cross-list from cs.CL) [pdf, html, other]
Title: Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategies
Srija Anand, Praveen Srinivasa Varadhan, Ashwin Sankar, Giri Raju, Mitesh M. Khapra
Comments: Accepted at INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[241] arXiv:2407.13660 (cross-list from cs.LG) [pdf, html, other]
Title: CogniVoice: Multimodal and Multilingual Fusion Networks for Mild Cognitive Impairment Assessment from Spontaneous Speech
Jiali Cheng, Mohamed Elgaar, Nidhi Vakil, Hadi Amiri
Comments: INTERSPEECH 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[242] arXiv:2407.13676 (cross-list from cs.MM) [pdf, html, other]
Title: Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
Arda Senocak, Hyeonggon Ryu, Junsik Kim, Tae-Hyun Oh, Hanspeter Pfister, Joon Son Chung
Comments: Journal Extension of ICCV 2023 paper (arXiv:2309.10724). Code is available at this https URL
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[243] arXiv:2407.13782 (cross-list from eess.AS) [pdf, html, other]
Title: Self-supervised ASR Models and Features For Dysarthric and Elderly Speech Recognition
Shujie Hu, Xurong Xie, Mengzhe Geng, Zengrui Jin, Jiajun Deng, Guinan Li, Yi Wang, Mingyu Cui, Tianzi Wang, Helen Meng, Xunying Liu
Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[244] arXiv:2407.14006 (cross-list from eess.AS) [pdf, html, other]
Title: MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis
Qian Yang, Jialong Zuo, Zhe Su, Ziyue Jiang, Mingze Li, Zhou Zhao, Feiyang Chen, Zhefeng Wang, Baoxing Huai
Comments: Accepted by INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[245] arXiv:2407.14021 (cross-list from eess.AS) [pdf, html, other]
Title: GE2E-AC: Generalized End-to-End Loss Training for Accent Classification
Chihiro Watanabe, Hirokazu Kameoka
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Machine Learning (stat.ML)
[246] arXiv:2407.14056 (cross-list from cs.CL) [pdf, html, other]
Title: Rasa: Building Expressive Speech Synthesis Systems for Indian Languages in Low-resource Settings
Praveen Srinivasa Varadhan, Ashwin Sankar, Giri Raju, Mitesh M. Khapra
Comments: Accepted at INTERSPEECH 2024. First two authors listed contributed equally
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[247] arXiv:2407.14172 (cross-list from eess.AS) [pdf, other]
Title: Topology-Independent GEVD-Based Distributed Adaptive Node-Specific Signal Estimation in Ad-Hoc Wireless Acoustic Sensor Networks
Paul Didier, Toon van Waterschoot, Marc Moonen
Comments: Presented in the 2024 32nd European Signal Processing Conference (EUSIPCO)
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[248] arXiv:2407.14800 (cross-list from eess.AS) [pdf, html, other]
Title: Towards Realistic Emotional Voice Conversion using Controllable Emotional Intensity
Tianhua Qi, Shiyan Wang, Cheng Lu, Yan Zhao, Yuan Zong, Wenming Zheng
Comments: Accepted to INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[249] arXiv:2407.14940 (cross-list from cs.CL) [pdf, other]
Title: Conversational Rubert for Detecting Competitive Interruptions in ASR-Transcribed Dialogues
Dmitrii Galimzianov, Viacheslav Vyshegorodtsev
Comments: 9 pages, 1 figure, 3 tables
Journal-ref: Computer Science & Information Technology (CS & IT), ISSN : 2231 - 5403, Volume 14, Number 13, June 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[250] arXiv:2407.15188 (cross-list from eess.AS) [pdf, html, other]
Title: Overview of Speaker Modeling and Its Applications: From the Lens of Deep Speaker Representation Learning
Shuai Wang, Zhengyang Chen, Kong Aik Lee, Yanmin Qian, Haizhou Li
Comments: Accepted to TASLP
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[251] arXiv:2407.15310 (cross-list from eess.SP) [pdf, html, other]
Title: Can all variations within the unified mask-based beamformer framework achieve identical peak extraction performance?
Atsuo Hiroe, Katsutoshi Itoyama, Kazuhiro Nakadai
Comments: Submitted to EURASIP journal on Audio, Speech, and Music Processing
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[252] arXiv:2407.15423 (cross-list from eess.AS) [pdf, html, other]
Title: Integrating IP Broadcasting with Audio Tags: Workflow and Challenges
Rhys Burchett-Vass, Arshdeep Singh, Gabriel Bibbó, Mark D. Plumbley
Comments: Submitted to DCASE 2024 Workshop
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)
[253] arXiv:2407.15458 (cross-list from eess.AS) [pdf, html, other]
Title: EMO-Codec: An In-Depth Look at Emotion Preservation capacity of Legacy and Neural Codec Models With Subjective and Objective Evaluations
Wenze Ren, Yi-Cheng Lin, Huang-Cheng Chou, Haibin Wu, Yi-Chiao Wu, Chi-Chun Lee, Hung-yi Lee, Yu Tsao
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[254] arXiv:2407.15580 (cross-list from cs.LG) [pdf, html, other]
Title: Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealing
David Perera, Victor Letzelter, Théo Mariotte, Adrien Cortés, Mickael Chen, Slim Essid, Gaël Richard
Comments: NeurIPS 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Probability (math.PR); Machine Learning (stat.ML)
[255] arXiv:2407.15624 (cross-list from eess.AS) [pdf, html, other]
Title: DSP-informed bandwidth extension using locally-conditioned excitation and linear time-varying filter subnetworks
Shahan Nercessian, Alexey Lukin, Johannes Imort
Comments: 5 pages, 3 figures. Accepted to the 18th International Workshop on Acoustic Signal Enhancement (IWAENC 2024)
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[256] arXiv:2407.15641 (cross-list from eess.AS) [pdf, html, other]
Title: Generating Sample-Based Musical Instruments Using Neural Audio Codec Language Models
Shahan Nercessian, Johannes Imort, Ninon Devis, Frederik Blang
Comments: 8 pages, 2 figures. Accepted to the 25th Conference of the International Society for Music Information Retrieval (ISMIR)
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[257] arXiv:2407.15828 (cross-list from cs.CL) [pdf, html, other]
Title: J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language Modeling
Wataru Nakata, Kentaro Seki, Hitomi Yanaka, Yuki Saito, Shinnosuke Takamichi, Hiroshi Saruwatari
Comments: 8 pages, 6 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[258] arXiv:2407.15835 (cross-list from cs.CL) [pdf, html, other]
Title: dMel: Speech Tokenization made Simple
He Bai, Tatiana Likhomanenko, Ruixiang Zhang, Zijin Gu, Zakaria Aldeneh, Navdeep Jaitly
Comments: under review
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[259] arXiv:2407.15992 (cross-list from cs.CL) [pdf, html, other]
Title: Multimodal Input Aids a Bayesian Model of Phonetic Learning
Sophia Zhi, Roger P. Levy, Stephan C. Meylan
Comments: 12 pages, 5 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[260] arXiv:2407.16370 (cross-list from cs.CL) [pdf, html, other]
Title: Evolutionary Prompt Design for LLM-Based Post-ASR Error Correction
Rithik Sachdev, Zhong-Qiu Wang, Chao-Han Huck Yang
Comments: in submission
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[261] arXiv:2407.16447 (cross-list from eess.AS) [pdf, html, other]
Title: The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization
Samuele Cornell, Taejin Park, Steve Huang, Christoph Boeddeker, Xuankai Chang, Matthew Maciejewski, Matthew Wiesner, Paola Garcia, Shinji Watanabe
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[262] arXiv:2407.16554 (cross-list from cs.MM) [pdf, html, other]
Title: Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localization
Junyan Wu, Wei Lu, Xiangyang Luo, Rui Yang, Qian Wang, Xiaochun Cao
Comments: 9pages, 3figures. This paper has been accepted for ACM MM 2024
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[263] arXiv:2407.16643 (cross-list from eess.AS) [pdf, html, other]
Title: Synthesizer Sound Matching Using Audio Spectrogram Transformers
Fred Bruford, Frederik Blang, Shahan Nercessian
Comments: 4 pages, 1 figure. Accepted to the 27th International Conference on Digital Audio Effects (DAFx24)
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[264] arXiv:2407.16691 (cross-list from eess.AS) [pdf, html, other]
Title: Automatic Equalization for Individual Instrument Tracks Using Convolutional Neural Networks
Florian Mockenhaupt, Joscha Simon Rieber, Shahan Nercessian
Comments: 8 pages, 9 figures. Accepted to the 27th International Conference on Digital Audio Effects (DAFx24)
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[265] arXiv:2407.16889 (cross-list from cs.CY) [pdf, other]
Title: Towards better visualizations of urban sound environments: insights from interviews
Modan Tailleur (LS2N), Pierre Aumond (UMRAE), Vincent Tourre (AAU), Mathieu Lagrange (LS2N)
Journal-ref: INTERNOISE 2024, Aug 2024, Nantes (France), France
Subjects: Computers and Society (cs.CY); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[266] arXiv:2407.16899 (cross-list from cs.HC) [pdf, other]
Title: A Framework for AI assisted Musical Devices
Miguel Civit, Luis Munoz Saavedra, Francisco Jose Cuadrado, Charles Tijus, Maria J. Escalona
Comments: 11 pages, 5 figures
Journal-ref: IntechOpen (2023)
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[267] arXiv:2407.16956 (cross-list from cs.RO) [pdf, html, other]
Title: Long-Term, Store-Front Robotics: Interactive Music for Robotic Arm, Caxixi and Frame Drums
Richard Savery, Fouad Sukkar
Journal-ref: International Computer Music Conference 2024, Seoul, South Korea
Subjects: Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[268] arXiv:2407.16966 (cross-list from cs.HC) [pdf, html, other]
Title: Collaboration Between Robots, Interfaces and Humans: Practice-Based and Audience Perspectives
Anna Savery, Richard Savery
Journal-ref: International Computer Music Conference 2024, Seoul, South Korea
Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[269] arXiv:2407.17119 (cross-list from eess.AS) [pdf, html, other]
Title: Automatic Detection and Annotation of Sperm Whale Codas
Guy Gubnitsky, Yaly Mevorach, Shane Gero, David F. Gruber, Roee Diamant
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[270] arXiv:2407.17250 (cross-list from eess.AS) [pdf, html, other]
Title: Reduction of Nonlinear Distortion in Condenser Microphones Using a Simple Post-Processing Technique
Petr Honzík, Antonin Novak
Comments: 10 pages, 9 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[271] arXiv:2407.17605 (cross-list from cs.CL) [pdf, html, other]
Title: Coupling Speech Encoders with Downstream Text Models
Ciprian Chelba, Johan Schalkwyk
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[272] arXiv:2407.17997 (cross-list from cs.CL) [pdf, html, other]
Title: On the Effect of Purely Synthetic Training Data for Different Automatic Speech Recognition Architectures
Benedikt Hilmes, Nick Rossenbach, and Ralf Schlüter
Comments: Published at the SynData4GenAI 2024 workshop
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[273] arXiv:2407.18332 (cross-list from eess.AS) [pdf, other]
Title: Analyzing Speech Unit Selection for Textless Speech-to-Speech Translation
Jarod Duret (LIA), Yannick Estève (LIA), Titouan Parcollet (CAM)
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[274] arXiv:2407.18413 (cross-list from cs.NE) [pdf, html, other]
Title: Simulation of Neural Responses to Classical Music Using Organoid Intelligence Methods
Daniel Szelogowski
Comments: 10 pages, 9 figures
Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[275] arXiv:2407.18501 (cross-list from cs.CL) [pdf, other]
Title: The formation of perceptual space in early phonetic acquisition: a cross-linguistic modeling approach
Frank Lihui Tan, Youngah Do
Comments: 51 pages
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[276] arXiv:2407.18552 (cross-list from cs.MM) [pdf, other]
Title: Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention
Joe Dhanith P R, Shravan Venkatraman, Modigari Narendra, Vigya Sharma, Santhosh Malarvannan, Amir H. Gandomi
Comments: 38 Pages, 9 Tables, 12 Figures
Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[277] arXiv:2407.18732 (cross-list from eess.AS) [pdf, html, other]
Title: A Physics-Informed Neural Network-Based Approach for the Spatial Upsampling of Spherical Microphone Arrays
Federico Miotello, Ferdinando Terminiello, Mirco Pezzoli, Alberto Bernardini, Fabio Antonacci, Augusto Sarti
Comments: Accepted for publication at IWAENC 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[278] arXiv:2407.18926 (cross-list from eess.AS) [pdf, html, other]
Title: VoxMed: One-Step Respiratory Disease Classifier using Digital Stethoscope Sounds
Paridhi Mundra, Manik Sharma, Yashwardhan Chaudhuri, Orchid Chetia Phukan, Arun Balaji Buduru
Comments: Accepted to INTERSPEECH'24
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[279] arXiv:2407.18927 (cross-list from eess.AS) [pdf, html, other]
Title: ASGIR: Audio Spectrogram Transformer Guided Classification And Information Retrieval For Birds
Yashwardhan Chaudhuri, Paridhi Mundra, Arnesh Batra, Orchid Chetia Phukan, Arun Balaji Buduru
Comments: Accepted to INTERSPEECH'24
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[280] arXiv:2407.19485 (cross-list from eess.AS) [pdf, html, other]
Title: ctPuLSE: Close-Talk, and Pseudo-Label Based Far-Field, Speech Enhancement
Zhong-Qiu Wang
Comments: in submission
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[281] arXiv:2407.19677 (cross-list from cs.CY) [pdf, html, other]
Title: Navigating the United States Legislative Landscape on Voice Privacy: Existing Laws, Proposed Bills, Protection for Children, and Synthetic Data for AI
Satwik Dutta, John H.L. Hansen
Comments: 5 pages, 2 figures, accepted at the Interspeech SynData4GenAI 2024 workshop
Subjects: Computers and Society (cs.CY); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[282] arXiv:2407.19704 (cross-list from eess.IV) [pdf, html, other]
Title: UNQA: Unified No-Reference Quality Assessment for Audio, Image, Video, and Audio-Visual Content
Yuqin Cao, Xiongkuo Min, Yixuan Gao, Wei Sun, Weisi Lin, Guangtao Zhai
Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[283] arXiv:2407.19834 (cross-list from eess.AS) [pdf, html, other]
Title: Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting
Yuanxi Lin, Yuriy Evgenyevich Gapanyuk
Comments: Submitted to the APSIPA ASC 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[284] arXiv:2407.20535 (cross-list from cs.NE) [pdf, html, other]
Title: DeepSpeech models show Human-like Performance and Processing of Cochlear Implant Inputs
Cynthia R. Steinhardt, Menoua Keshishian, Nima Mesgarani, Kim Stachenfeld
Comments: NEURIPS preprint
Subjects: Neural and Evolutionary Computing (cs.NE); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[285] arXiv:2407.20592 (cross-list from cs.CV) [pdf, html, other]
Title: EgoSonics: Generating Synchronized Audio for Silent Egocentric Videos
Aashish Rai, Srinath Sridhar
Comments: preprint
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[286] arXiv:2407.20622 (cross-list from cs.CL) [pdf, html, other]
Title: Decoding Linguistic Representations of Human Brain
Yu Wang, Heyang Liu, Yuhao Wang, Chuan Xuan, Yixuan Hou, Sheng Feng, Hongcheng Liu, Yusheng Liao, Yanfeng Wang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[287] arXiv:2407.20765 (cross-list from physics.med-ph) [pdf, other]
Title: Integrating audiological datasets via federated merging of Auditory Profiles
Samira Saak, Dirk Oetting, Birger Kollmeier, Mareike Buhl
Subjects: Medical Physics (physics.med-ph); Sound (cs.SD); Audio and Speech Processing (eess.AS); Data Analysis, Statistics and Probability (physics.data-an)
[288] arXiv:2407.20962 (cross-list from cs.CV) [pdf, html, other]
Title: MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
Xiaowei Chi, Yatian Wang, Aosong Cheng, Pengjun Fang, Zeyue Tian, Yingqing He, Zhaoyang Liu, Xingqun Qi, Jiahao Pan, Rongyu Zhang, Mengfei Li, Ruibin Yuan, Yanbing Jiang, Wei Xue, Wenhan Luo, Qifeng Chen, Shanghang Zhang, Qifeng Liu, Yike Guo
Comments: 15 Pages. Dataset report
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[289] arXiv:2407.21054 (cross-list from cs.CL) [pdf, html, other]
Title: Sentiment Reasoning for Healthcare
Khai-Nguyen Nguyen, Khai Le-Duc, Bach Phan Tat, Duy Le, Long Vo-Dang, Truong-Son Hy
Comments: NeurIPS AIM-FM Workshop, 20 pages
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[290] arXiv:2407.21061 (cross-list from cs.CL) [pdf, html, other]
Title: Improving noisy student training for low-resource languages in End-to-End ASR using CycleGAN and inter-domain losses
Chia-Yu Li, Ngoc Thang Vu
Comments: 10 pages (2 for references), 4 figures, published in SIGUL2024@LREC-COLING 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[291] arXiv:2407.21066 (cross-list from cs.CL) [pdf, html, other]
Title: ELP-Adapters: Parameter Efficient Adapter Tuning for Various Speech Processing Tasks
Nakamasa Inoue, Shinta Otake, Takumi Hirose, Masanari Ohi, Rei Kawakami
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[292] arXiv:2407.21130 (cross-list from cs.LG) [pdf, html, other]
Title: Computational music analysis from first principles
Dmitri Tymoczko, Mark Newman
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[293] arXiv:2407.21211 (cross-list from eess.AS) [pdf, html, other]
Title: Leveraging Self-Supervised Models for Automatic Whispered Speech Recognition
Aref Farhadipour, Homa Asadi, Volker Dellwo
Comments: This paper was accepted at the ICCKE2024 conference
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[294] arXiv:2407.21453 (cross-list from cs.LG) [pdf, html, other]
Title: TinyChirp: Bird Song Recognition Using TinyML Models on Low-power Wireless Acoustic Sensors
Zhaolan Huang, Adrien Tousnakhoff, Polina Kozyr, Roman Rehausen, Felix Bießmann, Robert Lachlan, Cedric Adjih, Emmanuel Baccelli
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[295] arXiv:2407.21476 (cross-list from cs.CL) [pdf, html, other]
Title: On the Problem of Text-To-Speech Model Selection for Synthetic Data Generation in Automatic Speech Recognition
Nick Rossenbach, Ralf Schlüter, Sakriani Sakti
Comments: Accepted at the SynData4GenAI 2024 workshop
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[296] arXiv:2407.21491 (cross-list from cs.CL) [pdf, other]
Title: Generative Expressive Conversational Speech Synthesis
Rui Liu, Yifan Hu, Yi Ren, Xiang Yin, Haizhou Li
Comments: 14 pages, 6 figures, 8 tables. Accepted by ACM MM 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[297] arXiv:2407.21646 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agent
Shanbo Cheng, Zhichao Huang, Tom Ko, Hang Li, Ningxin Peng, Lu Xu, Qini Zhang
Comments: Authors are listed in alphabetical order by last name. Demonstrations and human-annotated test sets are available at this https URL
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 297 entries
Showing up to 1000 entries per page: fewer | more | all