Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Audio and Speech Processing

Authors and titles for June 2024

Total of 547 entries
Showing up to 2000 entries per page: fewer | more | all
[26] arXiv:2406.02562 [pdf, other]
Title: Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices
Gwantae Kim, Bokyeung Lee, Donghyeon Kim, Hanseok Ko
Comments: Table 2 is revised
Journal-ref: ICASSP 2024 Workshop(HSCMA 2024) paper
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[27] arXiv:2406.02563 [pdf, html, other]
Title: A cost minimization approach to fix the vocabulary size in a tokenizer for an End-to-End ASR system
Sunil Kumar Kopparapu, Ashish Panda
Comments: 5 pages, 4 figures
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[28] arXiv:2406.02566 [pdf, other]
Title: Combining X-Vectors and Bayesian Batch Active Learning: Two-Stage Active Learning Pipeline for Speech Recognition
Ognjen Kundacina, Vladimir Vincan, Dragisa Miskovic
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
[29] arXiv:2406.02569 [pdf, html, other]
Title: Cluster-to-Predict Affect Contours from Speech
Gökhan Kuşçu, Engin Erzin
Comments: 8 pages, 3 figures
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC)
[30] arXiv:2406.02572 [pdf, html, other]
Title: Selfsupervised learning for pathological speech detection
Shakeel Ahmad Sheikh
Comments: in Intersection of Book Chapter in Machine Leanring and Computational Social Sciences CRC (in progress) 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[31] arXiv:2406.02608 [pdf, html, other]
Title: PPINtonus: Early Detection of Parkinson's Disease Using Deep-Learning Tonal Analysis
Varun Reddy
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[32] arXiv:2406.02649 [pdf, html, other]
Title: Keyword-Guided Adaptation of Automatic Speech Recognition
Aviv Shamsian, Aviv Navon, Neta Glazer, Gill Hetz, Joseph Keshet
Comments: Accepted to InterSpeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[33] arXiv:2406.02652 [pdf, html, other]
Title: RepCNN: Micro-sized, Mighty Models for Wakeword Detection
Arnav Kundu, Prateeth Nayak, Priyanka Padmanabhan, Devang Naik
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[34] arXiv:2406.02859 [pdf, other]
Title: ConPCO: Preserving Phoneme Characteristics for Automatic Pronunciation Assessment Leveraging Contrastive Ordinal Regularization
Bi-Cheng Yan, Wei-Cheng Chao, Jiun-Ting Li, Yi-Cheng Wang, Hsin-Wei Wang, Meng-Shin Lin, Berlin Chen
Comments: This paper has been withdrawn because the authors aim to achieve better organization in writing and more detailed experimental analysis
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[35] arXiv:2406.02887 [pdf, html, other]
Title: USM RNN-T model weights binarization
Oleg Rybakov, Dmitriy Serdyuk, Chengjian Zheng
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[36] arXiv:2406.02925 [pdf, html, other]
Title: Task Arithmetic can Mitigate Synthetic-to-Real Gap in Automatic Speech Recognition
Hsuan Su, Hua Farn, Fan-Yun Sun, Shang-Tse Chen, Hung-yi Lee
Comments: EMNLP 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[37] arXiv:2406.02950 [pdf, html, other]
Title: 4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders
Yui Sudo, Muhammad Shakeel, Yosuke Fukumoto, Brian Yan, Jiatong Shi, Yifan Peng, Shinji Watanabe
Comments: submitted to IEEE/ACM Transactions on Audio Speech and Language Processing
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[38] arXiv:2406.03111 [pdf, html, other]
Title: Singing Voice Graph Modeling for SingFake Detection
Xuanjun Chen, Haibin Wu, Jyh-Shing Roger Jang, Hung-yi Lee
Comments: Accepted by Interspeech 2024; Our code is available at this https URL
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[39] arXiv:2406.03120 [pdf, html, other]
Title: RevRIR: Joint Reverberant Speech and Room Impulse Response Embedding using Contrastive Learning with Application to Room Shape Classification
Jacob Bitterman, Daniel Levi, Hilel Hagai Diamandi, Sharon Gannot, Tal Rosenwein
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[40] arXiv:2406.03155 [pdf, other]
Title: Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment
Christoph Boeddeker, Tobias Cord-Landwehr, Reinhold Haeb-Umbach
Comments: Accepted for Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[41] arXiv:2406.03205 [pdf, html, other]
Title: CoLLAB: A Collaborative Approach for Multilingual Abuse Detection
Orchid Chetia Phukan, Yashasvi Chaurasia, Arun Balaji Buduru, Rajesh Sharma
Subjects: Audio and Speech Processing (eess.AS)
[42] arXiv:2406.03228 [pdf, html, other]
Title: Reference Channel Selection by Multi-Channel Masking for End-to-End Multi-Channel Speech Enhancement
Wang Dai, Xiaofei Li, Archontis Politis, Tuomas Virtanen
Comments: Accepted by EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS)
[43] arXiv:2406.03272 [pdf, html, other]
Title: Multi-Microphone Speech Emotion Recognition using the Hierarchical Token-semantic Audio Transformer Architecture
Ohad Cohen, Gershon Hazan, Sharon Gannot
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
[44] arXiv:2406.03274 [pdf, other]
Title: Enhancing CTC-based speech recognition with diverse modeling units
Shiyi Han, Zhihong Lei, Mingbin Xu, Xingyu Na, Zhen Huang
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[45] arXiv:2406.03460 [pdf, html, other]
Title: The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement
Danilo de Oliveira, Simon Welker, Julius Richter, Timo Gerkmann
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[46] arXiv:2406.03514 [pdf, html, other]
Title: NeuRO: An Application for Code-Switched Autism Detection in Children
Mohd Mujtaba Akhtar, Girish, Orchid Chetia Phukan, Muskaan Singh
Comments: Accepted to INTERSPEECH 24 Show & Tell Demonstrations
Subjects: Audio and Speech Processing (eess.AS)
[47] arXiv:2406.03637 [pdf, html, other]
Title: Style Mixture of Experts for Expressive Text-To-Speech Synthesis
Ahad Jawaid, Shreeram Suresh Chandra, Junchen Lu, Berrak Sisman
Comments: Published in Audio Imagination: NeurIPS 2024 Workshop
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[48] arXiv:2406.03657 [pdf, html, other]
Title: UrBAN: Urban Beehive Acoustics and PheNotyping Dataset
Mahsa Abdollahi, Yi Zhu, Heitor R. Guimarães, Nico Coallier, Ségolène Maucourt, Pierre Giovenazzo, Tiago H. Falk
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[49] arXiv:2406.03899 [pdf, html, other]
Title: PLDNet: PLD-Guided Lightweight Deep Network Boosted by Efficient Attention for Handheld Dual-Microphone Speech Enhancement
Nan Zhou, Youhai Jiang, Jialin Tan, Chongmin Qi
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[50] arXiv:2406.04123 [pdf, html, other]
Title: Helsinki Speech Challenge 2024
Martin Ludvigsen, Elli Karvonen, Markus Juvonen, Samuli Siltanen
Subjects: Audio and Speech Processing (eess.AS)
[51] arXiv:2406.04212 [pdf, other]
Title: Sound Event Bounding Boxes
Janek Ebbers, Francois G. Germain, Gordon Wichern, Jonathan Le Roux
Comments: Accepted for publication at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[52] arXiv:2406.04269 [pdf, html, other]
Title: Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement
Wangyou Zhang, Kohei Saijo, Jee-weon Jung, Chenda Li, Shinji Watanabe, Yanmin Qian
Comments: 5 pages, 3 figures, 4 tables, Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[53] arXiv:2406.04281 [pdf, html, other]
Title: Total-Duration-Aware Duration Modeling for Text-to-Speech Systems
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Chung-Hsien Tsai, Canrun Li, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Jinyu Li, Sheng Zhao, Naoyuki Kanda
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[54] arXiv:2406.04353 [pdf, html, other]
Title: Introducing the Brand New QiandaoEar22 Dataset for Specific Ship Identification Using Ship-Radiated Noise
Xiaoyang Du, Feng Hong
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[55] arXiv:2406.04354 [pdf, html, other]
Title: QiandaoEar22: A high quality noise dataset for identifying specific ship from multiple underwater acoustic targets using ship-radiated noise
Xiaoyang Du, Feng Hong
Subjects: Audio and Speech Processing (eess.AS)
[56] arXiv:2406.04429 [pdf, html, other]
Title: InaGVAD : a Challenging French TV and Radio Corpus Annotated for Speech Activity Detection and Speaker Gender Segmentation
David Doukhan, Christine Maertens, William Le Personnic, Ludovic Speroni, Reda Dehak
Comments: Voice Activity Detection (VAD), Speaker Gender Segmentation, Audiovisual Speech Resource, Speaker Traits, Speech Overlap, Benchmark, X-vector, Gender Representation in the Media, Dataset
Journal-ref: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 8963-8974, Torino, Italia. ELRA and ICCL
Subjects: Audio and Speech Processing (eess.AS); Digital Libraries (cs.DL); Multimedia (cs.MM); Sound (cs.SD)
[57] arXiv:2406.04432 [pdf, html, other]
Title: LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition
Sreyan Ghosh, Sonal Kumar, Ashish Seth, Purva Chiniya, Utkarsh Tyagi, Ramani Duraiswami, Dinesh Manocha
Comments: InterSpeech 2024. Code and Data: this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[58] arXiv:2406.04467 [pdf, html, other]
Title: Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis
Théodor Lemerle, Nicolas Obin, Axel Roebel
Comments: Interspeech
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[59] arXiv:2406.04494 [pdf, html, other]
Title: Towards Naturalistic Voice Conversion: NaturalVoices Dataset with an Automatic Processing Pipeline
Ali N. Salman, Zongyang Du, Shreeram Suresh Chandra, Ismail Rasim Ulgen, Carlos Busso, Berrak Sisman
Subjects: Audio and Speech Processing (eess.AS)
[60] arXiv:2406.04552 [pdf, html, other]
Title: Flexible Multichannel Speech Enhancement for Noise-Robust Frontend
Ante Jukić, Jagadeesh Balam, Boris Ginsburg
Journal-ref: WASPAA 2023
Subjects: Audio and Speech Processing (eess.AS)
[61] arXiv:2406.04582 [pdf, html, other]
Title: Neural Codec-based Adversarial Sample Detection for Speaker Verification
Xuanjun Chen, Jiawei Du, Haibin Wu, Jyh-Shing Roger Jang, Hung-yi Lee
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[62] arXiv:2406.04615 [pdf, html, other]
Title: What do MLLMs hear? Examining reasoning with text and sound components in Multimodal Large Language Models
Enis Berk Çoban, Michael I. Mandel, Johanna Devaney
Comments: 9 pages
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[63] arXiv:2406.04633 [pdf, html, other]
Title: Boosting Diffusion Model for Spectrogram Up-sampling in Text-to-speech: An Empirical Study
Chong Zhang, Yanqing Liu, Yang Zheng, Sheng Zhao
Subjects: Audio and Speech Processing (eess.AS)
[64] arXiv:2406.04660 [pdf, html, other]
Title: URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement
Wangyou Zhang, Robin Scheibler, Kohei Saijo, Samuele Cornell, Chenda Li, Zhaoheng Ni, Anurag Kumar, Jan Pirklbauer, Marvin Sach, Shinji Watanabe, Tim Fingscheidt, Yanmin Qian
Comments: 6 pages, 3 figures, 3 tables. Accepted by Interspeech 2024. An extended version of the accepted manuscript with appendix
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[65] arXiv:2406.04904 [pdf, html, other]
Title: XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model
Edresson Casanova, Kelly Davis, Eren Gölge, Görkem Göknar, Iulian Gulea, Logan Hart, Aya Aljafari, Joshua Meyer, Reuben Morais, Samuel Olayemi, Julian Weber
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[66] arXiv:2406.04927 [pdf, html, other]
Title: LLM-based speaker diarization correction: A generalizable approach
Georgios Efstathiadis, Vijay Yadav, Anzar Abbas
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[67] arXiv:2406.04951 [pdf, html, other]
Title: The Database and Benchmark for the Source Speaker Tracing Challenge 2024
Ze Li, Yuke Lin, Tian Yao, Hongbin Suo, Pengyuan Zhang, Yanzhen Ren, Zexin Cai, Hiromitsu Nishizaki, Ming Li
Subjects: Audio and Speech Processing (eess.AS)
[68] arXiv:2406.04997 [pdf, html, other]
Title: On the social bias of speech self-supervised models
Yi-Cheng Lin, Tzu-Quan Lin, Hsi-Che Lin, Andy T. Liu, Hung-yi Lee
Comments: Accepted by INTERSPEECH 2024
Journal-ref: Proc. Interspeech 2024, 4638-4642
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[69] arXiv:2406.05065 [pdf, html, other]
Title: Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition
Yi-Cheng Lin, Haibin Wu, Huang-Cheng Chou, Chi-Chun Lee, Hung-yi Lee
Comments: Accepted by INTERSPEECH 2024
Journal-ref: Proc. Interspeech 2024, 4633-4637
Subjects: Audio and Speech Processing (eess.AS)
[70] arXiv:2406.05128 [pdf, html, other]
Title: Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis
Chin-Yun Yu, György Fazekas
Comments: Published at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[71] arXiv:2406.05199 [pdf, html, other]
Title: XANE: eXplainable Acoustic Neural Embeddings
Sri Harsha Dumpala, Dushyant Sharma, Chandramouli Shama Sastri, Stanislav Kruchinin, James Fosburgh, Patrick A. Naylor
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[72] arXiv:2406.05259 [pdf, html, other]
Title: A model of early word acquisition based on realistic-scale audiovisual naming events
Khazar Khorrami, Okko Räsänen
Comments: 22 pages, 4 figures, journal article, submitted for review
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[73] arXiv:2406.05286 [pdf, html, other]
Title: Signal processing algorithm effective for sound quality of hearing loss simulators
Toshio Irino, Shintaro Doan, Minami Ishikawa
Comments: This paper has been accepted for publication in Interspeech 2024
Journal-ref: Proc. Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[74] arXiv:2406.05298 [pdf, html, other]
Title: Spectral Codecs: Spectrogram-Based Audio Codecs for High Quality Speech Synthesis
Ryan Langman, Ante Jukić, Kunal Dhawan, Nithin Rao Koluguri, Boris Ginsburg
Subjects: Audio and Speech Processing (eess.AS)
[75] arXiv:2406.05314 [pdf, html, other]
Title: Relational Proxy Loss for Audio-Text based Keyword Spotting
Youngmoon Jung, Seungjin Lee, Joon-Young Yang, Jaeyoung Roh, Chang Woo Han, Hoon-Young Cho
Comments: 5 pages, 2 figures, Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)
[76] arXiv:2406.05325 [pdf, html, other]
Title: LDM-SVC: Latent Diffusion Model Based Zero-Shot Any-to-Any Singing Voice Conversion with Singer Guidance
Shihao Chen, Yu Gu, Jie Zhang, Na Li, Rilin Chen, Liping Chen, Lirong Dai
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[77] arXiv:2406.05339 [pdf, html, other]
Title: To what extent can ASV systems naturally defend against spoofing attacks?
Jee-weon Jung, Xin Wang, Nicholas Evans, Shinji Watanabe, Hye-jin Shim, Hemlata Tak, Sidhhant Arora, Junichi Yamagishi, Joon Son Chung
Comments: 5 pages, 3 figures, 3 tables, Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[78] arXiv:2406.05341 [pdf, html, other]
Title: Diversifying and Expanding Frequency-Adaptive Convolution Kernels for Sound Event Detection
Hyeonuk Nam, Seong-Hu Kim, Deokki Min, Junhyeok Lee, Yong-Hwa Park
Comments: Accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[79] arXiv:2406.05359 [pdf, html, other]
Title: Towards Lightweight Speaker Verification via Adaptive Neural Network Quantization
Bei Liu, Haoyu Wang, Yanmin Qian
Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[80] arXiv:2406.05401 [pdf, html, other]
Title: Should you use a probabilistic duration model in TTS? Probably! Especially for spontaneous speech
Shivam Mehta, Harm Lameris, Rajiv Punmiya, Jonas Beskow, Éva Székely, Gustav Eje Henter
Comments: 5 pages, 2 figures. Final version, accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Sound (cs.SD)
[81] arXiv:2406.05551 [pdf, html, other]
Title: Autoregressive Diffusion Transformer for Text-to-Speech Synthesis
Zhijun Liu, Shuai Wang, Sho Inoue, Qibing Bai, Haizhou Li
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[82] arXiv:2406.05672 [pdf, html, other]
Title: Text-aware and Context-aware Expressive Audiobook Speech Synthesis
Dake Guo, Xinfa Zhu, Liumeng Xue, Yongmao Zhang, Wenjie Tian, Lei Xie
Comments: Accepted by INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS)
[83] arXiv:2406.05699 [pdf, html, other]
Title: An Investigation of Noise Robustness for Flow-Matching-Based Zero-Shot TTS
Xiaofei Wang, Sefik Emre Eskimez, Manthan Thakker, Hemin Yang, Zirun Zhu, Min Tang, Yufei Xia, Jinzhu Li, Sheng Zhao, Jinyu Li, Naoyuki Kanda
Comments: Accepted to INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)
[84] arXiv:2406.05763 [pdf, html, other]
Title: WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark
Linhan Ma, Dake Guo, Kun Song, Yuepeng Jiang, Shuai Wang, Liumeng Xue, Weiming Xu, Huan Zhao, Binbin Zhang, Lei Xie
Comments: Accepted by INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS)
[85] arXiv:2406.05839 [pdf, html, other]
Title: MaLa-ASR: Multimedia-Assisted LLM-Based ASR
Guanrou Yang, Ziyang Ma, Fan Yu, Zhifu Gao, Shiliang Zhang, Xie Chen
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[86] arXiv:2406.05914 [pdf, html, other]
Title: Soundscape Captioning using Sound Affective Quality Network and Large Language Model
Yuanbo Hou, Qiaoqiao Ren, Andrew Mitchell, Wenwu Wang, Jian Kang, Tony Belpaeme, Dick Botteldooren
Comments: Code: this https URL
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[87] arXiv:2406.05947 [pdf, html, other]
Title: Accent Conversion with Articulatory Representations
Yashish M. Siriwardena, Nathan Swedlow, Audrey Howard, Evan Gitterman, Dan Darcy, Carol Espy-Wilson, Andrea Fanelli
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[88] arXiv:2406.05961 [pdf, html, other]
Title: BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation
Zihan Zhang, Xianjun Xia, Chuanzeng Huang, Yijian Xiao, Lei Xie
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[89] arXiv:2406.05965 [pdf, html, other]
Title: MakeSinger: A Semi-Supervised Training Method for Data-Efficient Singing Voice Synthesis via Classifier-free Diffusion Guidance
Semin Kim, Myeonghun Jeong, Hyeonseung Lee, Minchan Kim, Byoung Jin Choi, Nam Soo Kim
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[90] arXiv:2406.05968 [pdf, html, other]
Title: Prompting Large Language Models with Audio for General-Purpose Speech Summarization
Wonjune Kang, Deb Roy
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[91] arXiv:2406.05983 [pdf, html, other]
Title: Separate and Reconstruct: Asymmetric Encoder-Decoder for Speech Separation
Ui-Hyeop Shin, Sangyoun Lee, Taehan Kim, Hyung-Min Park
Comments: Accepted to NeurIPS 2024; Project Page: this https URL
Subjects: Audio and Speech Processing (eess.AS)
[92] arXiv:2406.06111 [pdf, html, other]
Title: JenGAN: Stacked Shifted Filters in GAN-Based Speech Synthesis
Hyunjae Cho, Junhyeok Lee, Wonbin Jung
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)
[93] arXiv:2406.06160 [pdf, html, other]
Title: The Effect of Training Dataset Size on Discriminative and Diffusion-Based Speech Enhancement Systems
Philippe Gonzalez, Zheng-Hua Tan, Jan Østergaard, Jesper Jensen, Tommy Sonne Alstrøm, Tobias May
Comments: Accepted version
Subjects: Audio and Speech Processing (eess.AS)
[94] arXiv:2406.06185 [pdf, html, other]
Title: EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation
Julius Richter, Yi-Chiao Wu, Steven Krenn, Simon Welker, Bunlong Lay, Shinji Watanabe, Alexander Richard, Timo Gerkmann
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[95] arXiv:2406.06220 [pdf, html, other]
Title: Label-Looping: Highly Efficient Decoding for Transducers
Vladimir Bataev, Hainan Xu, Daniel Galvez, Vitaly Lavrukhin, Boris Ginsburg
Comments: Accepted at IEEE SLT 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[96] arXiv:2406.06251 [pdf, html, other]
Title: Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning
Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu
Comments: Accepted by InterSpeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[97] arXiv:2406.06293 [pdf, html, other]
Title: Sample Rate Independent Recurrent Neural Networks for Audio Effects Processing
Alistair Carson, Alec Wright, Jatin Chowdhury, Vesa Välimäki, Stefan Bilbao
Comments: Accepted for publication in Proc. DAFx24, Guildford, UK, September 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[98] arXiv:2406.06619 [pdf, html, other]
Title: LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR
Zheshu Song, Jianheng Zhuo, Yifan Yang, Ziyang Ma, Shixiong Zhang, Xie Chen
Comments: 5 pages, 2 figures, conference
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[99] arXiv:2406.06634 [pdf, html, other]
Title: Sparse Binarization for Fast Keyword Spotting
Jonathan Svirsky, Uri Shaham, Ofir Lindenbaum
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[100] arXiv:2406.06646 [pdf, html, other]
Title: Emotion-Aware Speech Self-Supervised Representation Learning with Intensity Knowledge
Rui Liu, Zening Ma
Comments: Accepted by InterSpeech2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[101] arXiv:2406.06664 [pdf, html, other]
Title: ASTRA: Aligning Speech and Text Representations for Asr without Sampling
Neeraj Gaur, Rohan Agrawal, Gary Wang, Parisa Haghani, Andrew Rosenberg, Bhuvana Ramabhadran
Comments: To be published in Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[102] arXiv:2406.06774 [pdf, html, other]
Title: ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection
Orchid Chetia Phukan, Sarthak Jain, Shubham Singh, Muskaan Singh, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to INTERSPEECH 2024 Show & Tell Demonstrations
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[103] arXiv:2406.06781 [pdf, html, other]
Title: PERSONA: An Application for Emotion Recognition, Gender Recognition and Age Estimation
Devyani Koshal, Orchid Chetia Phukan, Sarthak Jain, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to INTERSPEECH 2024 Show & Tell Demonstrations
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[104] arXiv:2406.06798 [pdf, html, other]
Title: The Reasonable Effectiveness of Speaker Embeddings for Violence Detection
Sarthak Jain, Orchid Chetia Phukan, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to INTERSPEECH 24 Show & Tell Demonstrations
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[105] arXiv:2406.07090 [pdf, html, other]
Title: Spoken Language Corpora Augmentation with Domain-Specific Voice-Cloned Speech
Mateusz Czyżnikiewicz, Łukasz Bondaruk, Jakub Kubiak, Adam Wiącek, Łukasz Degórski, Marek Kubis, Paweł Skórzewski
Comments: Accepted to FedCSIS 2024
Subjects: Audio and Speech Processing (eess.AS)
[106] arXiv:2406.07096 [pdf, html, other]
Title: Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter
Andrei Andrusenko, Aleksandr Laptev, Vladimir Bataev, Vitaly Lavrukhin, Boris Ginsburg
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[107] arXiv:2406.07103 [pdf, html, other]
Title: MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms
Seung-bin Kim, Chan-yeong Lim, Jungwoo Heo, Ju-ho Kim, Hyun-seo Shin, Kyo-Won Koo, Ha-Jin Yu
Comments: 5 pages, accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[108] arXiv:2406.07133 [pdf, html, other]
Title: Translating speech with just images
Dan Oneata, Herman Kamper
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[109] arXiv:2406.07198 [pdf, html, other]
Title: Target Speech Diarization with Multimodal Prompts
Yidi Jiang, Ruijie Tao, Zhengyang Chen, Yanmin Qian, Haizhou Li
Comments: 13 pages, 7 figures
Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM)
[110] arXiv:2406.07237 [pdf, html, other]
Title: CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems
Haibin Wu, Yuan Tseng, Hung-yi Lee
Comments: Accepted to Interspeech 2024, project page: this https URL
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[111] arXiv:2406.07250 [pdf, html, other]
Title: Description and Discussion on DCASE 2024 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring
Tomoya Nishida, Noboru Harada, Daisuke Niizumi, Davide Albertini, Roberto Sannino, Simone Pradolini, Filippo Augusti, Keisuke Imoto, Kota Dohi, Harsh Purohit, Takashi Endo, Yohei Kawaguchi
Comments: anomaly detection, acoustic condition monitoring, domain shift, first-shot problem, DCASE Challenge. arXiv admin note: text overlap with arXiv:2305.07828
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[112] arXiv:2406.07310 [pdf, html, other]
Title: MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting
Zhiqi Ai, Zhiyong Chen, Shugong Xu
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[113] arXiv:2406.07410 [pdf, html, other]
Title: Clever Hans Effect Found in Automatic Detection of Alzheimer's Disease through Speech
Yin-Long Liu, Rui Feng, Jia-Hong Yuan, Zhen-Hua Ling
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[114] arXiv:2406.07422 [pdf, html, other]
Title: Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation
Hanzhao Li, Liumeng Xue, Haohan Guo, Xinfa Zhu, Yuanjun Lv, Lei Xie, Yunlin Chen, Hao Yin, Zhifei Li
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[115] arXiv:2406.07461 [pdf, html, other]
Title: Noise-robust Speech Separation with Fast Generative Correction
Helin Wang, Jesus Villalba, Laureano Moro-Velazquez, Jiarui Hai, Thomas Thebaud, Najim Dehak
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[116] arXiv:2406.07576 [pdf, html, other]
Title: Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models
Malo Maisonneuve, Corinne Fredouille, Muriel Lalain, Alain Ghio, Virginie Woisard
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[117] arXiv:2406.07816 [pdf, html, other]
Title: Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio
Lin Zhang, Xin Wang, Erica Cooper, Mireia Diez, Federico Landini, Nicholas Evans, Junichi Yamagishi
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[118] arXiv:2406.07842 [pdf, html, other]
Title: Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR
Yerbolat Khassanov, Zhipeng Chen, Tianfeng Chen, Tze Yuang Chong, Wei Li, Jun Zhang, Lu Lu, Yuxuan Wang
Comments: 5 pages, 2 figures, 4 tables
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[119] arXiv:2406.07845 [pdf, html, other]
Title: Target Speaker Extraction with Curriculum Learning
Yun Liu, Xuechen Liu, Xiaoxiao Miao, Junichi Yamagishi
Comments: Accepted for presentation at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[120] arXiv:2406.07846 [pdf, html, other]
Title: DualVC 3: Leveraging Language Model Generated Pseudo Context for End-to-end Low Latency Streaming Voice Conversion
Ziqian Ning, Shuai Wang, Pengcheng Zhu, Zhichao Wang, Jixun Yao, Lei Xie, Mengxiao Bi
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[121] arXiv:2406.07890 [pdf, html, other]
Title: Exploring Speech Foundation Models for Speaker Diarization in Child-Adult Dyadic Interactions
Anfeng Xu, Kevin Huang, Tiantian Feng, Lue Shen, Helen Tager-Flusberg, Shrikanth Narayanan
Comments: Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)
[122] arXiv:2406.07909 [pdf, html, other]
Title: Guiding Frame-Level CTC Alignments Using Self-knowledge Distillation
Eungbeom Kim, Hantae Kim, Kyogu Lee
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD); Machine Learning (stat.ML)
[123] arXiv:2406.07969 [pdf, html, other]
Title: LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning
Masaya Kawamura, Ryuichi Yamamoto, Yuma Shirahata, Takuya Hasumi, Kentaro Tachibana
Comments: Accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[124] arXiv:2406.08056 [pdf, html, other]
Title: DCASE 2024 Task 4: Sound Event Detection with Heterogeneous Data and Missing Labels
Samuele Cornell, Janek Ebbers, Constance Douwes, Irene Martín-Morató, Manu Harju, Annamaria Mesaros, Romain Serizel
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[125] arXiv:2406.08076 [pdf, html, other]
Title: VECL-TTS: Voice identity and Emotional style controllable Cross-Lingual Text-to-Speech
Ashishkumar Gudmalwar, Nirmesh Shah, Sai Akarsh, Pankaj Wasnik, Rajiv Ratn Shah
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[126] arXiv:2406.08111 [pdf, html, other]
Title: Audio-conditioned phonemic and prosodic annotation for building text-to-speech models from unlabeled speech data
Yuma Shirahata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana
Comments: Accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[127] arXiv:2406.08119 [pdf, other]
Title: Low-Complexity Acoustic Scene Classification Using Parallel Attention-Convolution Network
Yanxiong Li, Jiaxin Tan, Guoqing Chen, Jialong Li, Yongjie Si, Qianhua He
Comments: Accepted for publication on Interspeech 2024. 5 pages, 4 figures, 3 tables
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[128] arXiv:2406.08122 [pdf, other]
Title: Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor
Yongjie Si, Yanxiong Li, Jialong Li, Jiaxin Tan, Qianhua He
Comments: Accepted for publication on Interspeech 2024. 5 pages, 3 figures, 5 tables
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[129] arXiv:2406.08203 [pdf, html, other]
Title: LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation
Wenhao Guan, Kaidi Wang, Wangjin Zhou, Yang Wang, Feng Deng, Hui Wang, Lin Li, Qingyang Hong, Yong Qin
Comments: Accepted at Interspeech2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[130] arXiv:2406.08207 [pdf, html, other]
Title: Transformer-based Model for ASR N-Best Rescoring and Rewriting
Iwen E. Kang, Christophe Van Gysel, Man-Hung Siu
Comments: Interspeech '24
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[131] arXiv:2406.08266 [pdf, html, other]
Title: Refining Self-Supervised Learnt Speech Representation using Brain Activations
Hengyu Li, Kangdi Mei, Zhaoci Liu, Yang Ai, Liping Chen, Jie Zhang, Zhenhua Ling
Comments: accpeted by Interspeech2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[132] arXiv:2406.08328 [pdf, html, other]
Title: Multimodal Representation Loss Between Timed Text and Audio for Regularized Speech Separation
Tsun-An Hsieh, Heeyoul Choi, Minje Kim
Subjects: Audio and Speech Processing (eess.AS)
[133] arXiv:2406.08353 [pdf, html, other]
Title: Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques
Yuanchao Li, Peter Bell, Catherine Lai
Comments: Accepted to IEEE SLT 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD)
[134] arXiv:2406.08393 [pdf, html, other]
Title: SCDNet: Self-supervised Learning Feature-based Speaker Change Detection
Yue Li, Xinsheng Wang, Li Zhang, Lei Xie
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[135] arXiv:2406.08396 [pdf, html, other]
Title: Neural Blind Source Separation and Diarization for Distant Speech Recognition
Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe
Comments: 5 pages, 3 figures, accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[136] arXiv:2406.08402 [pdf, html, other]
Title: Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models
Chun-Yi Kuan, Wei-Ping Huang, Hung-yi Lee
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[137] arXiv:2406.08445 [pdf, html, other]
Title: SVSNet+: Enhancing Speaker Voice Similarity Assessment Models with Representations from Speech Foundation Models
Chun Yin, Tai-Shih Chi, Yu Tsao, Hsin-Min Wang
Comments: Accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[138] arXiv:2406.08517 [pdf, html, other]
Title: DB3V: A Dialect Dominated Dataset of Bird Vocalisation for Cross-corpus Bird Species Recognition
Xin Jing, Luyang Zhang, Jiangjian Xie, Alexander Gebhard, Alice Baird, Bjoern Schuller
Comments: accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[139] arXiv:2406.08802 [pdf, html, other]
Title: DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing
Neha Sahipjohn, Ashishkumar Gudmalwar, Nirmesh Shah, Pankaj Wasnik, Rajiv Ratn Shah
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[140] arXiv:2406.08820 [pdf, html, other]
Title: DisfluencySpeech -- Single-Speaker Conversational Speech Dataset with Paralanguage
Kyra Wang, Dorien Herremans
Comments: 4 pages, 1 figure, submitted to IEEE TENCON 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[141] arXiv:2406.08900 [pdf, html, other]
Title: On Improving Error Resilience of Neural End-to-End Speech Coders
Kishan Gupta, Nicola Pia, Srikanth Korse, Andreas Brendel, Guillaume Fuchs, Markus Multrus
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[142] arXiv:2406.08957 [pdf, html, other]
Title: Tool Wear Prediction in CNC Turning Operations using Ultrasonic Microphone Arrays and CNNs
Jan Steckel, Arne Aerts, Erik Verreycken, Dennis Laurijssen, Walter Daems
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)
[143] arXiv:2406.08974 [pdf, html, other]
Title: Cascaded noise reduction and acoustic echo cancellation based on an extended noise reduction
Arnout Roebben, Toon van Waterschoot, Marc Moonen
Comments: Accepted for publication in EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[144] arXiv:2406.08989 [pdf, html, other]
Title: ToneUnit: A Speech Discretization Approach for Tonal Language Speech Synthesis
Dehua Tao, Daxin Tan, Yu Ting Yeung, Xiao Chen, Tan Lee
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[145] arXiv:2406.09277 [pdf, html, other]
Title: End-to-end streaming model for low-latency speech anonymization
Waris Quamer, Ricardo Gutierrez-Osuna
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)
[146] arXiv:2406.09286 [pdf, html, other]
Title: FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching
Chaeyoung Jung, Suyeon Lee, Ji-Hoon Kim, Joon Son Chung
Comments: INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[147] arXiv:2406.09290 [pdf, html, other]
Title: Exploring Spoken Language Identification Strategies for Automatic Transcription of Multilingual Broadcast and Institutional Speech
Martina Valente, Fabio Brugnara, Giovanni Morrone, Enrico Zovato, Leonardo Badino
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[148] arXiv:2406.09443 [pdf, html, other]
Title: Comparative Analysis of Personalized Voice Activity Detection Systems: Assessing Real-World Effectiveness
Satyam Kumar, Sai Srujana Buddi, Utkarsh Oggy Sarawgi, Vineet Garg, Shivesh Ranjan, Ognjen (Oggi)Rudovic, Ahmed Hussen Abdelaziz, Saurabh Adya
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
[149] arXiv:2406.09444 [pdf, html, other]
Title: GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model
Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng
Comments: arXiv admin note: text overlap with arXiv:2310.13418
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[150] arXiv:2406.09494 [pdf, html, other]
Title: The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environments
Shareef Babu Kalluri, Prachi Singh, Pratik Roy Chowdhuri, Apoorva Kulkarni, Shikha Baghel, Pradyoth Hegde, Swapnil Sontakke, Deepak K T, S. R. Mahadeva Prasanna, Deepu Vijayasenan, Sriram Ganapathy
Comments: 5 pages, 3 figures, Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[151] arXiv:2406.09589 [pdf, html, other]
Title: Multi-Channel Multi-Speaker ASR Using Target Speaker's Solo Segment
Yiwen Shao, Shi-Xiong Zhang, Yong Xu, Meng Yu, Dong Yu, Daniel Povey, Sanjeev Khudanpur
Comments: Accepted for presentation at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[152] arXiv:2406.09634 [pdf, other]
Title: Efficient Personalization of Amplification in Hearing Aids via Multi-band Bayesian Machine Learning
Aoxin Ni, Edward Lobarinas, Nasser Kehtarnavaz
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[153] arXiv:2406.09676 [pdf, html, other]
Title: Optimizing Byte-level Representation for End-to-end ASR
Roger Hsiao, Liuhui Deng, Erik McDermott, Ruchir Travadi, Xiaodan Zhuang
Comments: 5 pages, 1 figure, IEEE SLT 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[154] arXiv:2406.09706 [pdf, html, other]
Title: A Multimodal Framework for the Assessment of the Schizophrenia Spectrum
Gowtham Premananth, Yashish M.Siriwardena, Philip Resnik, Sonia Bansal, Deanna L.Kelly, Carol Espy-Wilson
Comments: Accepted to be presented at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[155] arXiv:2406.09819 [pdf, html, other]
Title: Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments
Jihyun Kim, Stijn Kindt, Nilesh Madhu, Hong-Goo Kang
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[156] arXiv:2406.09821 [pdf, html, other]
Title: Low algorithmic delay implementation of convolutional beamformer for online joint source separation and dereverberation
Kaien Mo, Xianrui Wang, Yichen Yang, Shoji Makino, Jingdong Chen
Comments: 4 pages, 4 figures. Accepted by EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS)
[157] arXiv:2406.09873 [pdf, html, other]
Title: Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition
Yicong Jiang, Tianzi Wang, Xurong Xie, Juan Liu, Wei Sun, Nan Yan, Hui Chen, Lan Wang, Xunying Liu, Feng Tian
Comments: Accepted by interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[158] arXiv:2406.09894 [pdf, html, other]
Title: Period Singer: Integrating Periodic and Aperiodic Variational Autoencoders for Natural-Sounding End-to-End Singing Voice Synthesis
Taewoo Kim, Choongsang Cho, Young Han Lee
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[159] arXiv:2406.09998 [pdf, other]
Title: Understanding Pedestrian Movement Using Urban Sensing Technologies: The Promise of Audio-based Sensors
Chaeyeon Han, Pavan Seshadri, Yiwei Ding, Noah Posner, Bon Woo Koo, Animesh Agrawal, Alexander Lerch, Subhrajit Guhathakurta
Comments: submitted to Urban Informatics
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)
[160] arXiv:2406.09999 [pdf, html, other]
Title: ROAR: Reinforcing Original to Augmented Data Ratio Dynamics for Wav2Vec2.0 Based ASR
Vishwanath Pratap Singh, Federico Malato, Ville Hautamaki, Md. Sahidullah, Tomi Kinnunen
Comments: Accepted: Interspeech 2024
Journal-ref: Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[161] arXiv:2406.10073 [pdf, html, other]
Title: Detecting the terminality of speech-turn boundary for spoken interactions in French TV and Radio content
Rémi Uro, Marie Tahon, David Doukhan, Antoine Laurent, Albert Rilliard
Comments: keywords : Spoken interaction, Media, TV, Radio, Transition-Relevance Places, Turn Taking, Interruption. Accepted to InterSpeech 2024, Kos Island, Greece
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD)
[162] arXiv:2406.10082 [pdf, html, other]
Title: Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation
Andrew Rouditchenko, Yuan Gong, Samuel Thomas, Leonid Karlinsky, Hilde Kuehne, Rogerio Feris, James Glass
Comments: Interspeech 2024. Code this https URL
Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
[163] arXiv:2406.10177 [pdf, html, other]
Title: Inclusive ASR for Disfluent Speech: Cascaded Large-Scale Self-Supervised Learning with Targeted Fine-Tuning and Data Augmentation
Dena Mujtaba, Nihar R. Mahapatra, Megan Arney, J. Scott Yaruss, Caryn Herring, Jia Bin
Comments: Included in 2024 Proceedings of INTERSPEECH
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[164] arXiv:2406.10205 [pdf, html, other]
Title: AlignNet: Learning dataset score alignment functions to enable better training of speech quality estimators
Jaden Pieper, Stephen D. Voran
Comments: 5 pages, 2 figures, 3 tables
Journal-ref: Proceedings of Interspeech 2024. 1-5 September 2024, Kos, Greece
Subjects: Audio and Speech Processing (eess.AS)
[165] arXiv:2406.10316 [pdf, html, other]
Title: Gender Representation in TV and Radio: Automatic Information Extraction methods versus Manual Analyses
David Doukhan, Lena Dodson, Manon Conan, Valentin Pelloin, Aurélien Clamouse, Mélina Lepape, Géraldine Van Hille, Cécile Méadel, Marlène Coulomb-Gully
Comments: keywords : Gender representation, computational humanities, TV, Radio, face classification, speaker traits, ASR, media, SLU. Accepted to InterSpeech 2024, Kos Island, Greece, september 2024
Subjects: Audio and Speech Processing (eess.AS); Computers and Society (cs.CY); Multimedia (cs.MM); Sound (cs.SD)
[166] arXiv:2406.10401 [pdf, other]
Title: Evaluating Speaker Identity Coding in Self-supervised Models and Humans
Gasser Elbanna
Comments: Masters Thesis
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[167] arXiv:2406.10422 [pdf, html, other]
Title: Phoneme Discretized Saliency Maps for Explainable Detection of AI-Generated Voice
Shubham Gupta, Mirco Ravanelli, Pascal Germain, Cem Subakan
Comments: Proc. Interspeech 2024, 3295-3299, doi: https://doi.org/10.21437/Interspeech.2024-632
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[168] arXiv:2406.10448 [pdf, html, other]
Title: AVR: Synergizing Foundation Models for Audio-Visual Humor Detection
Sarthak Sharma, Orchid Chetia Phukan, Drishti Singh, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to INTERSPEECH 2024 Show & Tell Demonstrations
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[169] arXiv:2406.10507 [pdf, html, other]
Title: Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models
Ruchao Fan, Natarajan Balaji Shankar, Abeer Alwan
Comments: To appear in Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[170] arXiv:2406.10512 [pdf, html, other]
Title: SOA: Reducing Domain Mismatch in SSL Pipeline by Speech Only Adaptation for Low Resource ASR
Natarajan Balaji Shankar, Ruchao Fan, Abeer Alwan
Comments: Accepted to ICASSP 2024 SASB Workshop
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[171] arXiv:2406.10514 [pdf, html, other]
Title: GTR-Voice: Articulatory Phonetics Informed Controllable Expressive Speech Synthesis
Zehua Kcriss Li, Meiying Melissa Chen, Yi Zhong, Pinxin Liu, Zhiyao Duan
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[172] arXiv:2406.10549 [pdf, html, other]
Title: Lightweight Audio Segmentation for Long-form Speech Translation
Jaesong Lee, Soyoon Kim, Hanbyul Kim, Joon Son Chung
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[173] arXiv:2406.10591 [pdf, html, other]
Title: MINT: a Multi-modal Image and Narrative Text Dubbing Dataset for Foley Audio Content Planning and Generation
Ruibo Fu, Shuchen Shi, Hongming Guo, Tao Wang, Chunyu Qiang, Zhengqi Wen, Jianhua Tao, Xin Qi, Yi Lu, Xiaopeng Wang, Zhiyong Wang, Yukun Liu, Xuefei Liu, Shuai Zhang, Guanjun Li
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)
[174] arXiv:2406.10598 [pdf, html, other]
Title: Double Multi-Head Attention Multimodal System for Odyssey 2024 Speech Emotion Recognition Challenge
Federico Costa, Miquel India, Javier Hernando
Comments: Odyssey 2024: The Speaker and Language Recognition Workshop
Journal-ref: Proc. The Speaker and Language Recognition Workshop (Odyssey 2024), 266-273
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[175] arXiv:2406.10836 [pdf, html, other]
Title: Revisiting and Improving Scoring Fusion for Spoofing-aware Speaker Verification Using Compositional Data Analysis
Xin Wang, Tomi Kinnunen, Kong Aik Lee, Paul-Gauthier Noé, Junichi Yamagishi
Comments: Proceedings of Interspeech, DOI: https://doi.org/10.21437/Interspeech.2024-422. Code: this https URL
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[176] arXiv:2406.10844 [pdf, html, other]
Title: Multi-Scale Accent Modeling with Disentangling for Multi-Speaker Multi-Accent TTS Synthesis
Xuehao Zhou, Mingyang Zhang, Yi Zhou, Zhizheng Wu, Haizhou Li
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[177] arXiv:2406.11064 [pdf, html, other]
Title: Continual Test-time Adaptation for End-to-end Speech Recognition on Noisy Speech
Guan-Ting Lin, Wei-Ping Huang, Hung-yi Lee
Comments: Accepted by EMNLP 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[178] arXiv:2406.11169 [pdf, other]
Title: Self-Distillation Prototypes Network: Learning Robust Speaker Representations without Supervision
Yafeng Chen, Siqi Zheng, Hui Wang, Luyao Cheng, Qian Chen, Shiliang Zhang, Wen Wang
Comments: We update this paper to an earlier paper
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[179] arXiv:2406.11248 [pdf, other]
Title: Performance Improvement of Language-Queried Audio Source Separation Based on Caption Augmentation From Large Language Models for DCASE Challenge 2024 Task 9
Do Hyun Lee, Yoonah Song, Hong Kook Kim
Comments: DCASE 2024 Challenge Task 9, 4 pages
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[180] arXiv:2406.11376 [pdf, other]
Title: Spatially constrained vs. unconstrained filtering in neural spatiospectral filters for multichannel speech enhancement
Annika Briegleb, Walter Kellermann
Comments: Accepted to the 32nd European Signal Processing Conference (EUSIPCO 2024), Lyon, France. 5 pages, 4 figures
Subjects: Audio and Speech Processing (eess.AS)
[181] arXiv:2406.11401 [pdf, html, other]
Title: An Exploration of Length Generalization in Transformer-Based Speech Enhancement
Qiquan Zhang, Hongxu Zhu, Xinyuan Qian, Eliathamby Ambikairajah, Haizhou Li
Comments: Accepted by INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[182] arXiv:2406.11427 [pdf, html, other]
Title: DiTTo-TTS: Efficient and Scalable Zero-Shot Text-to-Speech with Diffusion Transformer
Keon Lee, Dong Won Kim, Jaehyeon Kim, Jaewoong Cho
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[183] arXiv:2406.11546 [pdf, html, other]
Title: GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinement
Yifan Yang, Zheshu Song, Jianheng Zhuo, Mingyu Cui, Jinpeng Li, Bo Yang, Yexing Du, Ziyang Ma, Xunying Liu, Ziyuan Wang, Ke Li, Shuai Fan, Kai Yu, Wei-Qiang Zhang, Guoguo Chen, Xie Chen
Comments: Under review
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[184] arXiv:2406.11619 [pdf, html, other]
Title: AV-CrossNet: an Audiovisual Complex Spectral Mapping Network for Speech Separation By Leveraging Narrow- and Cross-Band Modeling
Vahid Ahmadi Kalkhorani, Cheng Yu, Anurag Kumar, Ke Tan, Buye Xu, DeLiang Wang
Comments: 10 pages, 4 Figures, and 4 Tables
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[185] arXiv:2406.11727 [pdf, html, other]
Title: 1000 African Voices: Advancing inclusive multi-speaker multi-accent speech synthesis
Sewade Ogun, Abraham T. Owodunni, Tobi Olatunji, Eniola Alese, Babatunde Oladimeji, Tejumade Afonja, Kayode Olaleye, Naome A. Etori, Tosin Adewumi
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[186] arXiv:2406.12194 [pdf, html, other]
Title: Universal Score-based Speech Enhancement with High Content Preservation
Robin Scheibler, Yusuke Fujita, Yuma Shirahata, Tatsuya Komatsu
Comments: 5 pages, 5 figures, accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[187] arXiv:2406.12236 [pdf, html, other]
Title: Binaural Selective Attention Model for Target Speaker Extraction
Hanyu Meng, Qiquan Zhang, Xiangyu Zhang, Vidhyasaharan Sethu, Eliathamby Ambikairajah
Comments: Accepted by INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[188] arXiv:2406.12387 [pdf, html, other]
Title: Performant ASR Models for Medical Entities in Accented Speech
Tejumade Afonja, Tobi Olatunji, Sewade Ogun, Naome A. Etori, Abraham Owodunni, Moshood Yekini
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[189] arXiv:2406.12447 [pdf, html, other]
Title: Text-aware Speech Separation for Multi-talker Keyword Spotting
Haoyu Li, Baochen Yang, Yu Xi, Linfeng Yu, Tian Tan, Hao Li, Kai Yu
Comments: Accepted by INTERSPEECH2024
Subjects: Audio and Speech Processing (eess.AS)
[190] arXiv:2406.12503 [pdf, html, other]
Title: Unsupervised Online Continual Learning for Automatic Speech Recognition
Steven Vander Eeckt, Hugo Van hamme
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[191] arXiv:2406.12622 [pdf, html, other]
Title: Challenging margin-based speaker embedding extractors by using the variational information bottleneck
Themos Stafylakis, Anna Silnova, Johan Rohdin, Oldrich Plchot, Lukas Burget
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[192] arXiv:2406.12674 [pdf, html, other]
Title: Transcribe, Align and Segment: Creating speech datasets for low-resource languages
Taras Sereda
Subjects: Audio and Speech Processing (eess.AS)
[193] arXiv:2406.12688 [pdf, html, other]
Title: Speak in the Scene: Diffusion-based Acoustic Scene Transfer toward Immersive Speech Generation
Miseul Kim, Soo-Whan Chung, Youna Ji, Hong-Goo Kang, Min-Seok Choi
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[194] arXiv:2406.12721 [pdf, other]
Title: Sound event detection based on auxiliary decoder and maximum probability aggregation for DCASE Challenge 2024 Task 4
Sang Won Son, Jongyeon Park, Hong Kook Kim, Sulaiman Vesal, Jeong Eun Lim
Comments: DCASE 2024 challenge Task4, 4 pages
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[195] arXiv:2406.12931 [pdf, html, other]
Title: Automatic Speech Recognition for Biomedical Data in Bengali Language
Shariar Kabir, Nazmun Nahar, Shyamasree Saha, Mamunur Rashid
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[196] arXiv:2406.12937 [pdf, html, other]
Title: Self-Train Before You Transcribe
Robert Flynn, Anton Ragni
Comments: Accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[197] arXiv:2406.12946 [pdf, other]
Title: Instruction Data Generation and Unsupervised Adaptation for Speech Language Models
Vahid Noroozi, Zhehuai Chen, Somshubra Majumdar, Steve Huang, Jagadeesh Balam, Boris Ginsburg
Comments: Accepted for Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
[198] arXiv:2406.12998 [pdf, html, other]
Title: Coding Speech through Vocal Tract Kinematics
Cheol Jun Cho, Peter Wu, Tejas S. Prabhune, Dhruv Agarwal, Gopala K. Anumanchipalli
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
[199] arXiv:2406.13139 [pdf, html, other]
Title: Audio Fingerprinting with Holographic Reduced Representations
Yusuke Fujita, Tatsuya Komatsu
Comments: accepted at Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[200] arXiv:2406.13268 [pdf, html, other]
Title: CEC: A Noisy Label Detection Method for Speaker Recognition
Yao Shen, Yingying Gao, Yaqian Hao, Chenguang Hu, Fulin Zhang, Junlan Feng, Shilei Zhang
Comments: interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[201] arXiv:2406.13312 [pdf, html, other]
Title: Pushing the Limit of Sound Event Detection with Multi-Dilated Frequency Dynamic Convolution
Hyeonuk Nam, Yong-Hwa Park
Comments: Submitted to ICASSP 2025
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[202] arXiv:2406.13337 [pdf, html, other]
Title: Medical Spoken Named Entity Recognition
Khai Le-Duc, David Thulke, Hung-Phong Tran, Long Vo-Dang, Khai-Nguyen Nguyen, Truong-Son Hy, Ralf Schlüter
Comments: Preprint, 41 pages
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[203] arXiv:2406.13385 [pdf, html, other]
Title: Explainable by-design Audio Segmentation through Non-Negative Matrix Factorization and Probing
Martin Lebourdais, Théo Mariotte, Antonio Almudévar, Marie Tahon, Alfonso Ortega
Comments: Accepted at Interspeech 2024, 5 pages, 2 figures, 3 tables
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[204] arXiv:2406.13386 [pdf, html, other]
Title: Online Domain-Incremental Learning Approach to Classify Acoustic Scenes in All Locations
Manjunath Mulimani, Annamaria Mesaros
Comments: Accepted to EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[205] arXiv:2406.13471 [pdf, html, other]
Title: Diffusion-based Generative Modeling with Discriminative Guidance for Streamable Speech Enhancement
Chenda Li, Samuele Cornell, Shinji Watanabe, Yanmin Qian
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[206] arXiv:2406.13935 [pdf, html, other]
Title: CONMOD: Controllable Neural Frame-based Modulation Effects
Gyubin Lee, Hounsu Kim, Junwon Lee, Juhan Nam
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)
[207] arXiv:2406.14379 [pdf, html, other]
Title: Decoding Vocal Articulations from Acoustic Latent Representations
Mateo Cámara, Fernando Marcos, José Luis Blanco
Comments: Presented at AES Europe 2024 in Madrid
Subjects: Audio and Speech Processing (eess.AS)
[208] arXiv:2406.14576 [pdf, html, other]
Title: Towards Intelligent Speech Assistants in Operating Rooms: A Multimodal Model for Surgical Workflow Analysis
Kubilay Can Demir, Belen Lojo Rodriguez, Tobias Weise, Andreas Maier, Seung Hee Yang
Comments: 5 Pages, Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[209] arXiv:2406.14693 [pdf, html, other]
Title: Voice Disorder Analysis: a Transformer-based Approach
Alkis Koudounas, Gabriele Ciravegna, Marco Fantini, Giovanni Succo, Erika Crosetti, Tania Cerquitelli, Elena Baralis
Comments: Accepted at Interspeech 2024
Journal-ref: Proc. Interspeech 2024, 3040-3044
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)
[210] arXiv:2406.14850 [pdf, html, other]
Title: DExter: Learning and Controlling Performance Expression with Diffusion Models
Huan Zhang, Shreyan Chowdhury, Carlos Eduardo Cancino-Chacón, Jinhua Liang, Simon Dixon, Gerhard Widmer
Comments: in submission to appsci special session
Subjects: Audio and Speech Processing (eess.AS)
[211] arXiv:2406.15160 [pdf, html, other]
Title: Exploring Audio-Visual Information Fusion for Sound Event Localization and Detection In Low-Resource Realistic Scenarios
Ya Jiang, Qing Wang, Jun Du, Maocheng Hu, Pengfei Hu, Zeyan Liu, Shi Cheng, Zhaoxu Nian, Yuxuan Dong, Mingqi Cai, Xin Fang, Chin-Hui Lee
Comments: accepted by icme2024
Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[212] arXiv:2406.15209 [pdf, html, other]
Title: Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding
Mohan Li, Simon Keizer, Rama Doddipatla
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[213] arXiv:2406.15725 [pdf, html, other]
Title: Self Training and Ensembling Frequency Dependent Networks with Coarse Prediction Pooling and Sound Event Bounding Boxes
Hyeonuk Nam, Deokki Min, Seungdeok Choi, Inhan Choi, Yong-Hwa Park
Comments: DCASE 2024 Challenge Task 4 technical report, DCASE 2024 Workshop accepted
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[214] arXiv:2406.15752 [pdf, html, other]
Title: TacoLM: GaTed Attention Equipped Codec Language Model are Efficient Zero-Shot Text to Speech Synthesizers
Yakun Song, Zhuo Chen, Xiaofei Wang, Ziyang Ma, Guanrou Yang, Xie Chen
Comments: INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[215] arXiv:2406.15897 [pdf, html, other]
Title: Fusing Audio and Metadata Embeddings Improves Language-based Audio Retrieval
Paul Primus, Gerhard Widmer
Comments: In Proceedings of the 32nd European Signal Processing Conference, EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[216] arXiv:2406.16058 [pdf, html, other]
Title: Text-Queried Target Sound Event Localization
Jinzheng Zhao, Xinyuan Qian, Yong Xu, Haohe Liu, Yin Cao, Davide Berghi, Wenwu Wang
Comments: Accepted by EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS)
[217] arXiv:2406.16107 [pdf, html, other]
Title: Decoder-only Architecture for Streaming End-to-end Speech Recognition
Emiru Tsunoo, Hayato Futami, Yosuke Kashiwagi, Siddhant Arora, Shinji Watanabe
Comments: Accepted for Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[218] arXiv:2406.16120 [pdf, html, other]
Title: Contextualized End-to-end Automatic Speech Recognition with Intermediate Biasing Loss
Muhammad Shakeel, Yui Sudo, Yifan Peng, Shinji Watanabe
Comments: Accepted to INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[219] arXiv:2406.16128 [pdf, html, other]
Title: Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions
Moreno La Quatra, Maria Francesca Turco, Torbjørn Svendsen, Giampiero Salvi, Juan Rafael Orozco-Arroyave, Sabato Marco Siniscalchi
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[220] arXiv:2406.16314 [pdf, html, other]
Title: DreamVoice: Text-Guided Voice Conversion
Jiarui Hai, Karan Thakkar, Helin Wang, Zengyi Qin, Mounya Elhilali
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS)
[221] arXiv:2406.16315 [pdf, html, other]
Title: Song Data Cleansing for End-to-End Neural Singer Diarization Using Neural Analysis and Synthesis Framework
Hokuto Munakata, Ryo Terashima, Yusuke Fujita
Comments: INTERSPEECH 2024 accepted
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[222] arXiv:2406.16326 [pdf, html, other]
Title: RefXVC: Cross-Lingual Voice Conversion with Enhanced Reference Leveraging
Mingyang Zhang, Yi Zhou, Yi Ren, Chen Zhang, Xiang Yin, Haizhou Li
Comments: Manuscript under review by TASLP
Subjects: Audio and Speech Processing (eess.AS)
[223] arXiv:2406.16716 [pdf, html, other]
Title: One-Class Learning with Adaptive Centroid Shift for Audio Deepfake Detection
Hyun Myung Kim, Kangwook Jang, Hoirin Kim
Comments: Accepted by Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Sound (cs.SD)
[224] arXiv:2406.17159 [pdf, html, other]
Title: Exploring compressibility of transformer based text-to-music (TTM) models
Vasileios Moschopoulos, Thanasis Kotsiopoulos, Pablo Peso Parada, Konstantinos Nikiforidis, Alexandros Stergiadis, Gerasimos Papakostas, Md Asif Jalal, Jisi Zhang, Anastasios Drosou, Karthikeyan Saravanan
Comments: Proceedings of INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM); Sound (cs.SD)
[225] arXiv:2406.17266 [pdf, html, other]
Title: AG-LSEC: Audio Grounded Lexical Speaker Error Correction
Rohit Paturi, Xiang Li, Sundararajan Srinivasan
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
[226] arXiv:2406.17310 [pdf, html, other]
Title: High Fidelity Text-to-Speech Via Discrete Tokens Using Token Transducer and Group Masked Language Model
Joun Yeop Lee, Myeonghun Jeong, Minchan Kim, Ji-Hyun Lee, Hoon-Young Cho, Nam Soo Kim
Comments: Accepted by Interspeech2024
Subjects: Audio and Speech Processing (eess.AS)
[227] arXiv:2406.17618 [pdf, html, other]
Title: Towards Building an End-to-End Multilingual Automatic Lyrics Transcription Model
Jiawen Huang, Emmanouil Benetos
Comments: Accepted at EUSIPCO 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[228] arXiv:2406.18009 [pdf, html, other]
Title: E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Xu Tan, Yanqing Liu, Sheng Zhao, Naoyuki Kanda
Comments: Accepted to SLT 2024. Added evaluation data, see this https URL for more details
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[229] arXiv:2406.18065 [pdf, html, other]
Title: On Calibration of Speech Classification Models: Insights from Energy-Based Model Investigations
Yaqian Hao, Chenguang Hu, Yingying Gao, Shilei Zhang, Junlan Feng
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[230] arXiv:2406.18301 [pdf, html, other]
Title: MSR-86K: An Evolving, Multilingual Corpus with 86,300 Hours of Transcribed Audio for Speech Recognition Research
Song Li, Yongbin You, Xuezhi Wang, Zhengkun Tian, Ke Ding, Guanglu Wan
Comments: Accepted by InterSpeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[231] arXiv:2406.18679 [pdf, html, other]
Title: Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization
Xiang Li, Vivek Govindan, Rohit Paturi, Sundararajan Srinivasan
Comments: Accepted at INTERSPEECH 2024
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
[232] arXiv:2406.18731 [pdf, html, other]
Title: WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model
Yi Zhu, Tiago Falk
Comments: Under review; Model script available at this https URL
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
[233] arXiv:2406.18871 [pdf, html, other]
Title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment
Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee
Comments: Accepted to Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[234] arXiv:2406.18972 [pdf, html, other]
Title: Applying LLMs for Rescoring N-best ASR Hypotheses of Casual Conversations: Effects of Domain Adaptation and Context Carry-over
Atsunori Ogawa, Naoyuki Kamo, Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Takatomo Kano, Naohiro Tawara, Marc Delcroix
Comments: 5 pages
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[235] arXiv:2406.19135 [pdf, html, other]
Title: DEX-TTS: Diffusion-based EXpressive Text-to-Speech with Style Modeling on Time Variability
Hyun Joon Park, Jin Sob Kim, Wooseok Shin, Sung Won Han
Comments: Preprint
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)
[236] arXiv:2406.19363 [pdf, html, other]
Title: Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment
Rotem Rousso, Eyal Cohen, Joseph Keshet, Eleanor Chodroff
Journal-ref: Interspeech 2024
Subjects: Audio and Speech Processing (eess.AS)
[237] arXiv:2406.00021 (cross-list from cs.CL) [pdf, html, other]
Title: CrossVoice: Crosslingual Prosody Preserving Cascade-S2ST using Transfer Learning
Medha Hira, Arnav Goel, Anubha Gupta
Comments: 8 pages, Accepted at ICLR 2024 - Tiny Track
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[238] arXiv:2406.00022 (cross-list from cs.CL) [pdf, html, other]
Title: Multilingual Prosody Transfer: Comparing Supervised & Transfer Learning
Arnav Goel, Medha Hira, Anubha Gupta
Comments: 7 pages, Accepted to ICLR 2024 - Tiny Track
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[239] arXiv:2406.00146 (cross-list from cs.SD) [pdf, other]
Title: A Survey of Deep Learning Audio Generation Methods
Matej Božić, Marko Horvat
Comments: 14 pages, 2 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[240] arXiv:2406.00294 (cross-list from cs.SD) [pdf, html, other]
Title: Creative Text-to-Audio Generation via Synthesizer Programming
Manuel Cherep, Nikhil Singh, Jessica Shand
Comments: Accepted to ICML 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[241] arXiv:2406.00320 (cross-list from cs.SD) [pdf, html, other]
Title: Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching
Yongqi Wang, Wenxiang Guo, Rongjie Huang, Jiawei Huang, Zehan Wang, Fuming You, Ruiqi Li, Zhou Zhao
Comments: accepted by NeurIPS 2024
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[242] arXiv:2406.00497 (cross-list from cs.SD) [pdf, html, other]
Title: Recent Advances in End-to-End Simultaneous Speech Translation
Xiaoqian Liu, Guoqiang Hu, Yangfan Du, Erfeng He, Yingfeng Luo, Chen Xu, Tong Xiao, Jingbo Zhu
Comments: Accepted by IJCAI 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[243] arXiv:2406.00626 (cross-list from cs.MM) [pdf, html, other]
Title: Intelligent Text-Conditioned Music Generation
Zhouyao Xie, Nikhil Yadala, Xinyi Chen, Jing Xi Liu
Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[244] arXiv:2406.00654 (cross-list from cs.CL) [pdf, html, other]
Title: Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback
Chen Chen, Yuchen Hu, Wen Wu, Helin Wang, Eng Siong Chng, Chao Zhang
Comments: 19 pages, Preprint
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[245] arXiv:2406.00702 (cross-list from cs.SD) [pdf, other]
Title: Enhanced Heart Sound Classification Using Mel Frequency Cepstral Coefficients and Comparative Analysis of Single vs. Ensemble Classifier Strategies
Amir Masoud Rahmani, Amir Haider, Mohammad Adeli, Olfa Mzoughi, Entesar Gemeay, Mokhtar Mohammadi, Hamid Alinejad-Rokny, Parisa Khoshvaght, Mehdi Hosseinzadeh
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[246] arXiv:2406.00898 (cross-list from cs.SD) [pdf, html, other]
Title: Phonetic Error Analysis of Raw Waveform Acoustic Models with Parametric and Non-Parametric CNNs
Erfan Loweimi, Andrea Carmantini, Peter Bell, Steve Renals, Zoran Cvetkovic
Comments: 5 pages, 6 figures, 3 tables
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[247] arXiv:2406.00899 (cross-list from cs.CL) [pdf, html, other]
Title: YODAS: Youtube-Oriented Dataset for Audio and Speech
Xinjian Li, Shinnosuke Takamichi, Takaaki Saeki, William Chen, Sayaka Shiota, Shinji Watanabe
Comments: ASRU 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[248] arXiv:2406.00901 (cross-list from cs.MM) [pdf, html, other]
Title: Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach
Mahsa Kadkhodaei Elyaderani, Shahram Shirani
Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[249] arXiv:2406.00976 (cross-list from cs.CL) [pdf, html, other]
Title: Generative Pre-trained Speech Language Model with Efficient Hierarchical Transformer
Yongxin Zhu, Dan Su, Liqiang He, Linli Xu, Dong Yu
Comments: Accept in ACL2024-main
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[250] arXiv:2406.01253 (cross-list from cs.SD) [pdf, html, other]
Title: animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics
Julian C. Schäfer-Zimmermann, Vlad Demartsev, Baptiste Averly, Kiran Dhanjal-Adams, Mathieu Duteil, Gabriella Gall, Marius Faiß, Lily Johnson-Ulrich, Dan Stowell, Marta B. Manser, Marie A. Roch, Ariana Strandburg-Peshkin
Comments: Code available at: this https URL | Dataset available at: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM); Applications (stat.AP)
[251] arXiv:2406.01321 (cross-list from cs.SD) [pdf, html, other]
Title: Sequence-to-Sequence Multi-Modal Speech In-Painting
Mahsa Kadkhodaei Elyaderani, Shahram Shirani
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[252] arXiv:2406.01446 (cross-list from cs.CL) [pdf, other]
Title: Enabling ASR for Low-Resource Languages: A Comprehensive Dataset Creation Approach
Ara Yeroyan (Data Science Department, American University of Armenia), Nikolay Karpov (Nvidia, NeMo Conversational AI team)
Comments: 13 pages, 10 figures (including ablation studies), to be published in 2024 IEEE Spoken Language Technology Workshop. Additionally, the associated software package can be accessed at (this https URL) for practical applications and further development
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[253] arXiv:2406.01655 (cross-list from cs.SD) [pdf, html, other]
Title: TinySV: Speaker Verification in TinyML with On-device Learning
Massimo Pavan, Gioele Mombelli, Francesco Sinacori, Manuel Roveri
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[254] arXiv:2406.02004 (cross-list from cs.CR) [pdf, html, other]
Title: Efficiently Train ASR Models that Memorize Less and Perform Better with Per-core Clipping
Lun Wang, Om Thakkar, Zhong Meng, Nicole Rafidi, Rohit Prabhavalkar, Arun Narayanan
Comments: Accepted to Interspeech'24
Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[255] arXiv:2406.02014 (cross-list from q-bio.NC) [pdf, html, other]
Title: Understanding Auditory Evoked Brain Signal via Physics-informed Embedding Network with Multi-Task Transformer
Wanli Ma, Xuegang Tang, Jin Gu, Ying Wang, Yuling Xia
Subjects: Neurons and Cognition (q-bio.NC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[256] arXiv:2406.02092 (cross-list from cs.SD) [pdf, html, other]
Title: MaskSR: Masked Language Model for Full-band Speech Restoration
Xu Li, Qirui Wang, Xiaoyu Liu
Comments: Accepted by INTERSPEECH 2024. Demo page: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[257] arXiv:2406.02166 (cross-list from cs.SD) [pdf, html, other]
Title: Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervision
Saierdaer Yusuyin, Te Ma, Hao Huang, Wenbo Zhao, Zhijian Ou
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[258] arXiv:2406.02178 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations
Sarthak Yadav, Zheng-Hua Tan
Comments: Accepted at INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[259] arXiv:2406.02315 (cross-list from cs.SD) [pdf, html, other]
Title: An Independence-promoting Loss for Music Generation with Language Models
Jean-Marie Lemercier, Simon Rouard, Jade Copet, Yossi Adi, Alexandre Défossez
Comments: Accepted to ICML 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[260] arXiv:2406.02328 (cross-list from cs.SD) [pdf, html, other]
Title: SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models
Dongchao Yang, Dingdong Wang, Haohan Guo, Xueyuan Chen, Xixin Wu, Helen Meng
Comments: Accepted by InterSpeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[261] arXiv:2406.02565 (cross-list from cs.SD) [pdf, html, other]
Title: Sequence-to-sequence models in peer-to-peer learning: A practical application
Robert Šajina, Ivo Ipšić
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Audio and Speech Processing (eess.AS)
[262] arXiv:2406.02699 (cross-list from cs.LG) [pdf, html, other]
Title: Operational Latent Spaces
Scott H. Hawley, Austin R. Tackett
Comments: 7 pages, 6 figures. Accepted to AES International Symposium on AI and the Musician
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[263] arXiv:2406.02733 (cross-list from cs.CL) [pdf, html, other]
Title: Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation
Min-Jae Hwang, Ilia Kulikov, Benjamin Peloquin, Hongyu Gong, Peng-Jen Chen, Ann Lee
Comments: Accepted to ACL 2024 (findings)
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[264] arXiv:2406.02897 (cross-list from cs.SD) [pdf, html, other]
Title: LiveSpeech: Low-Latency Zero-shot Text-to-Speech via Autoregressive Modeling of Audio Discrete Codes
Trung Dang, David Aponte, Dung Tran, Kazuhito Koishida
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[265] arXiv:2406.02921 (cross-list from cs.CL) [pdf, html, other]
Title: Text Injection for Neural Contextual Biasing
Zhong Meng, Zelin Wu, Rohit Prabhavalkar, Cal Peyser, Weiran Wang, Nanxin Chen, Tara N. Sainath, Bhuvana Ramabhadran
Comments: 5 pages, 1 figure
Journal-ref: Interspeech 2024, Kos Island, Greece
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)
[266] arXiv:2406.02938 (cross-list from cs.RO) [pdf, html, other]
Title: Robots Have Been Seen and Not Heard: Effects of Consequential Sounds on Human-Perception of Robots
Aimee Allen (1), Tom Drummond (2), Dana Kulic (1) ((1) Monash University - Australia, (2) University of Melbourne - Australia)
Comments: 16 pages (5 supplementary), 9 figures
Subjects: Robotics (cs.RO); Audio and Speech Processing (eess.AS)
[267] arXiv:2406.02940 (cross-list from cs.SD) [pdf, html, other]
Title: Addressing Index Collapse of Large-Codebook Speech Tokenizer with Dual-Decoding Product-Quantized Variational Auto-Encoder
Haohan Guo, Fenglong Xie, Dongchao Yang, Hui Lu, Xixin Wu, Helen Meng
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[268] arXiv:2406.02951 (cross-list from cs.CV) [pdf, html, other]
Title: AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection
Trevine Oorloff, Surya Koppisetti, Nicolò Bonettini, Divyaraj Solanki, Ben Colman, Yaser Yacoob, Ali Shahriyari, Gaurav Bharaj
Comments: Accepted to CVPR 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[269] arXiv:2406.02963 (cross-list from cs.SD) [pdf, html, other]
Title: Dataset-Distillation Generative Model for Speech Emotion Recognition
Fabian Ritter-Gutierrez, Kuan-Po Huang, Jeremy H.M Wong, Dianwen Ng, Hung-yi Lee, Nancy F. Chen, Eng Siong Chng
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[270] arXiv:2406.03049 (cross-list from cs.CL) [pdf, html, other]
Title: StreamSpeech: Simultaneous Speech-to-Speech Translation with Multi-task Learning
Shaolei Zhang, Qingkai Fang, Shoutao Guo, Zhengrui Ma, Min Zhang, Yang Feng
Comments: Accepted to ACL 2024 main conference, Project Page: this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[271] arXiv:2406.03138 (cross-list from cs.SD) [pdf, html, other]
Title: A Frame-based Attention Interpretation Method for Relevant Acoustic Feature Extraction in Long Speech Depression Detection
Qingkun Deng, Saturnino Luz, Sofia de la Fuente Garcia
Comments: 5 pages, 3 figures. arXiv admin note: substantial text overlap with arXiv:2309.13476
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[272] arXiv:2406.03237 (cross-list from cs.SD) [pdf, html, other]
Title: Generalized Fake Audio Detection via Deep Stable Learning
Zhiyong Wang, Ruibo Fu, Zhengqi Wen, Yuankun Xie, Yukun Liu, Xiaopeng Wang, Xuefei Liu, Yongwei Li, Jianhua Tao, Yi Lu, Xin Qi, Shuchen Shi
Comments: accepted by INTERSPEECH2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[273] arXiv:2406.03240 (cross-list from cs.SD) [pdf, html, other]
Title: Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
Yuankun Xie, Ruibo Fu, Zhengqi Wen, Zhiyong Wang, Xiaopeng Wang, Haonnan Cheng, Long Ye, Jianhua Tao
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[274] arXiv:2406.03247 (cross-list from cs.SD) [pdf, html, other]
Title: Genuine-Focused Learning using Mask AutoEncoder for Generalized Fake Audio Detection
Xiaopeng Wang, Ruibo Fu, Zhengqi Wen, Zhiyong Wang, Yuankun Xie, Yukun Liu, Jianhua Tao, Xuefei Liu, Yongwei Li, Xin Qi, Yi Lu, Shuchen Shi
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[275] arXiv:2406.03251 (cross-list from cs.SD) [pdf, html, other]
Title: ASoBO: Attentive Beamformer Selection for Distant Speaker Diarization in Meetings
Theo Mariotte, Anthony Larcher, Silvio Montresor, Jean-Hugh Thomas
Comments: 5 pages, 2 figures, 2 tables, accepted at Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[276] arXiv:2406.03344 (cross-list from cs.SD) [pdf, html, other]
Title: Audio Mamba: Bidirectional State Space Model for Audio Representation Learning
Mehmet Hamza Erol, Arda Senocak, Jiu Feng, Joon Son Chung
Comments: Code is available at this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[277] arXiv:2406.03407 (cross-list from cs.LG) [pdf, html, other]
Title: Physics and geometry informed neural operator network with application to acoustic scattering
Siddharth Nair, Timothy F. Walsh, Greg Pickrell, Fabio Semperlotti
Comments: 20 pages of main text, 9 figures
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Computational Physics (physics.comp-ph)
[278] arXiv:2406.03510 (cross-list from cs.SD) [pdf, html, other]
Title: Speech-based Clinical Depression Screening: An Empirical Study
Yangbin Chen, Chenyang Xu, Chunfeng Liang, Yanbao Tao, Chuan Shi
Comments: 5 pages, 3 figures
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[279] arXiv:2406.03512 (cross-list from cs.SD) [pdf, html, other]
Title: Harder or Different? Understanding Generalization of Audio Deepfake Detection
Nicolas M. Müller, Nicholas Evans, Hemlata Tak, Philip Sperl, Konstantin Böttinger
Journal-ref: Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[280] arXiv:2406.03706 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Audio Codec-based Zero-Shot Text-to-Speech Synthesis with Multi-Modal Context and Large Language Model
Jinlong Xue, Yayue Deng, Yicheng Han, Yingming Gao, Ya Li
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[281] arXiv:2406.03714 (cross-list from cs.SD) [pdf, html, other]
Title: Retrieval Augmented Generation in Prompt-based Text-to-Speech Synthesis with Context-Aware Contrastive Language-Audio Pretraining
Jinlong Xue, Yayue Deng, Yingming Gao, Ya Li
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[282] arXiv:2406.03814 (cross-list from cs.CL) [pdf, html, other]
Title: Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastores
Jiaming Zhou, Shiwan Zhao, Hui Wang, Tian-Hao Zhang, Haoqin Sun, Xuechen Wang, Yong Qin
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[283] arXiv:2406.03822 (cross-list from cs.SD) [pdf, html, other]
Title: SilentCipher: Deep Audio Watermarking
Mayank Kumar Singh, Naoya Takahashi, Weihsiang Liao, Yuki Mitsufuji
Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)
[284] arXiv:2406.03872 (cross-list from cs.CL) [pdf, html, other]
Title: BLSP-Emo: Towards Empathetic Large Speech-Language Models
Chen Wang, Minpeng Liao, Zhongqiang Huang, Junhong Wu, Chengqing Zong, Jiajun Zhang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[285] arXiv:2406.03882 (cross-list from cs.CL) [pdf, html, other]
Title: Spontaneous Speech-Based Suicide Risk Detection Using Whisper and Large Language Models
Ziyun Cui, Chang Lei, Wen Wu, Yinan Duan, Diyang Qu, Ji Wu, Runsen Chen, Chao Zhang
Comments: Accepted by Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[286] arXiv:2406.04140 (cross-list from cs.SD) [pdf, html, other]
Title: STraDa: A Singer Traits Dataset
Yuexuan Kong, Viet-Anh Tran, Romain Hennequin
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[287] arXiv:2406.04350 (cross-list from cs.SD) [pdf, html, other]
Title: Prompt-guided Precise Audio Editing with Diffusion Models
Manjie Xu, Chenxing Li, Duzhen zhang, Dan Su, Wei Liang, Dong Yu
Comments: Accepted by ICML 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[288] arXiv:2406.04512 (cross-list from cs.CL) [pdf, html, other]
Title: To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation
Abdul Waheed, Karima Kadaoui, Muhammad Abdul-Mageed
Comments: Accepted at ACL'24 main
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[289] arXiv:2406.04541 (cross-list from cs.CL) [pdf, html, other]
Title: Label-Synchronous Neural Transducer for E2E Simultaneous Speech Translation
Keqi Deng, Philip C. Woodland
Comments: Accepted by ACL 2024 Main Conference
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[290] arXiv:2406.04589 (cross-list from cs.SD) [pdf, html, other]
Title: MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancement
Zizhen Lin, Xiaoting Chen, Junyu Wang
Comments: This paper was accepted by Interspeech 2024
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Information Theory (cs.IT); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[291] arXiv:2406.04595 (cross-list from cs.SD) [pdf, html, other]
Title: Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis
Xintong Wang, Mingqian Shi, Ye Wang
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[292] arXiv:2406.04673 (cross-list from cs.CV) [pdf, html, other]
Title: MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models
Sanjoy Chowdhury, Sayan Nag, K J Joseph, Balaji Vasan Srinivasan, Dinesh Manocha
Comments: Accepted at CVPR 2024 as Highlight paper. Webpage: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[293] arXiv:2406.04683 (cross-list from cs.SD) [pdf, html, other]
Title: PPPR: Portable Plug-in Prompt Refiner for Text to Audio Generation
Shuchen Shi, Ruibo Fu, Zhengqi Wen, Jianhua Tao, Tao Wang, Chunyu Qiang, Yi Lu, Xin Qi, Xuefei Liu, Yukun Liu, Yongwei Li, Zhiyong Wang, Xiaopeng Wang
Comments: accepted by INTERSPEECH2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[294] arXiv:2406.04791 (cross-list from cs.SD) [pdf, html, other]
Title: Speaker-Smoothed kNN Speaker Adaptation for End-to-End ASR
Shaojun Li, Daimeng Wei, Hengchao Shang, Jiaxin Guo, ZongYao Li, Zhanglin Wu, Zhiqiang Rao, Yuanchang Luo, Xianghui He, Hao Yang
Comments: Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[295] arXiv:2406.04840 (cross-list from cs.SD) [pdf, html, other]
Title: TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarking
Junzuo Zhou, Jiangyan Yi, Tao Wang, Jianhua Tao, Ye Bai, Chu Yuan Zhang, Yong Ren, Zhengqi Wen
Comments: acceped by interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[296] arXiv:2406.04930 (cross-list from cs.CV) [pdf, html, other]
Title: MA-AVT: Modality Alignment for Parameter-Efficient Audio-Visual Transformers
Tanvir Mahmud, Shentong Mo, Yapeng Tian, Diana Marculescu
Comments: Accepted in Efficient Deep Learning for Computer Vision CVPR Workshop 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[297] arXiv:2406.05370 (cross-list from cs.CL) [pdf, html, other]
Title: VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
Comments: Demo posted
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[298] arXiv:2406.05464 (cross-list from cs.SD) [pdf, html, other]
Title: DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[299] arXiv:2406.05515 (cross-list from cs.SD) [pdf, html, other]
Title: Mmm whatcha say? Uncovering distal and proximal context effects in first and second-language word perception using psychophysical reverse correlation
Paige Tuttösí, H. Henny Yeung, Yue Wang, Fenqi Wang, Guillaume Denis, Jean-Julien Aucouturier, Angelica Lim
Comments: Accepted to INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[300] arXiv:2406.05547 (cross-list from cs.SD) [pdf, html, other]
Title: Exploring the Benefits of Tokenization of Discrete Acoustic Units
Avihu Dekel, Raul Fernandez
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[301] arXiv:2406.05629 (cross-list from cs.CV) [pdf, html, other]
Title: Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
Mark Hamilton, Andrew Zisserman, John R. Hershey, William T. Freeman
Comments: Computer Vision and Pattern Recognition 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[302] arXiv:2406.05653 (cross-list from cs.SD) [pdf, html, other]
Title: Heart Sound Segmentation Using Deep Learning Techniques
Manas Madine
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[303] arXiv:2406.05681 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Expressive Zero-Shot Speech Synthesis with Hierarchical Prosody Modeling
Yuepeng Jiang, Tao Li, Fengyu Yang, Lei Xie, Meng Meng, Yujun Wang
Comments: 5 pages, 2 figures, accepted by Interspeech2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[304] arXiv:2406.05692 (cross-list from cs.SD) [pdf, html, other]
Title: SPA-SVC: Self-supervised Pitch Augmentation for Singing Voice Conversion
Bingsong Bai, Fengping Wang, Yingming Gao, Ya Li
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[305] arXiv:2406.05784 (cross-list from cs.SD) [pdf, html, other]
Title: Optimizing Multi-Stuttered Speech Classification: Leveraging Whisper's Encoder for Efficient Parameter Reduction in Automated Assessment
Huma Ameer, Seemab Latif, Iram Tariq Bhatti, Rabia Latif
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[306] arXiv:2406.05806 (cross-list from cs.CL) [pdf, html, other]
Title: Do Prompts Really Prompt? Exploring the Prompt Understanding Capability of Whisper
Chih-Kai Yang, Kuan-Po Huang, Hung-yi Lee
Comments: Accepted to 2024 IEEE Spoken Language Technology Workshop (SLT 2024)
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[307] arXiv:2406.05863 (cross-list from cs.SD) [pdf, other]
Title: Source -Free Domain Adaptation for Speaker Verification in Data-Scarce Languages and Noisy Channels
Shlomo Salo Elia, Aviad Malachi, Vered Aharonson, Gadi Pinkas
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[308] arXiv:2406.05876 (cross-list from cs.CL) [pdf, html, other]
Title: Zero-Shot End-To-End Spoken Question Answering In Medical Domain
Yanis Labrak, Adel Moumen, Richard Dufour, Mickael Rouvier
Comments: Accepted to INTERSPEECH 2024
Journal-ref: InterSpeech 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[309] arXiv:2406.05923 (cross-list from cs.SD) [pdf, html, other]
Title: Contrastive Learning from Synthetic Audio Doppelgangers
Manuel Cherep, Nikhil Singh
Comments: 17 pages, 6 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[310] arXiv:2406.06086 (cross-list from cs.SD) [pdf, html, other]
Title: RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection
Yujie Chen, Jiangyan Yi, Jun Xue, Chenglong Wang, Xiaohui Zhang, Shunbo Dong, Siding Zeng, Jianhua Tao, Lv Zhao, Cunhang Fan
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[311] arXiv:2406.06097 (cross-list from cs.SD) [pdf, other]
Title: StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection
Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
Comments: Accepted at ACL 2024 main conference
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[312] arXiv:2406.06139 (cross-list from cs.SD) [pdf, html, other]
Title: Thunder : Unified Regression-Diffusion Speech Enhancement with a Single Reverse Step using Brownian Bridge
Thanapat Trachu, Chawan Piansaddhayanon, Ekapol Chuangsuwanich
Comments: 5 pages, 3 figures, 4 tables, This paper will be submitted in the interspeech conference
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[313] arXiv:2406.06208 (cross-list from cs.SD) [pdf, html, other]
Title: Quantifying the effect of speech pathology on automatic and human speaker verification
Bence Mark Halpern, Thomas Tienkamp, Wen-Chin Huang, Lester Phillip Violeta, Teja Rebernik, Sebastiaan de Visscher, Max Witjes, Martijn Wieling, Defne Abur, Tomoki Toda
Comments: 5 pages, 2 figures, 2 tables. Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[314] arXiv:2406.06295 (cross-list from cs.SD) [pdf, html, other]
Title: Zero-Shot Audio Captioning Using Soft and Hard Prompts
Yiming Zhang, Xuenan Xu, Ruoyi Du, Haohe Liu, Yuan Dong, Zheng-Hua Tan, Wenwu Wang, Zhanyu Ma
Comments: Submitted to IEEE/ACM Transactions on Audio, Speech and Language Processing
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[315] arXiv:2406.06310 (cross-list from cs.SD) [pdf, html, other]
Title: Unsupervised Improved MVDR Beamforming for Sound Enhancement
Jacob Kealey, John Hershey, François Grondin
Comments: Proceedings of INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[316] arXiv:2406.06329 (cross-list from cs.CL) [pdf, html, other]
Title: A Parameter-efficient Language Extension Framework for Multilingual ASR
Wei Liu, Jingyong Hou, Dong Yang, Muyong Cao, Tan Lee
Comments: Accepted by Interspeech 2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[317] arXiv:2406.06332 (cross-list from cs.SD) [pdf, html, other]
Title: An automatic analysis of ultrasound vocalisations for the prediction of interaction context in captive Egyptian fruit bats
Andreas Triantafyllopoulos, Alexander Gebhard, Manuel Milling, Simon Rampp, Björn Schuller
Comments: Accepted at EUSIPCO 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[318] arXiv:2406.06339 (cross-list from cs.SD) [pdf, html, other]
Title: Audio-based Step-count Estimation for Running -- Windowing and Neural Network Baselines
Philipp Wagner, Andreas Triantafyllopoulos, Alexander Gebhard, Björn Schuller
Comments: Accepted at EUSIPCO 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[319] arXiv:2406.06341 (cross-list from cs.SD) [pdf, html, other]
Title: Predicting Heart Activity from Speech using Data-driven and Knowledge-based features
Gasser Elbanna, Zohreh Mostaani, Mathew Magimai.-Doss
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[320] arXiv:2406.06371 (cross-list from cs.CL) [pdf, html, other]
Title: mHuBERT-147: A Compact Multilingual HuBERT Model
Marcely Zanon Boito, Vivek Iyer, Nikolaos Lagos, Laurent Besacier, Ioan Calapodescu
Comments: Extended version of the Interspeech 2024 paper of same name
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[321] arXiv:2406.06375 (cross-list from cs.SD) [pdf, html, other]
Title: MOSA: Music Motion with Semantic Annotation Dataset for Cross-Modal Music Processing
Yu-Fen Huang, Nikki Moran, Simon Coleman, Jon Kelly, Shun-Hwa Wei, Po-Yin Chen, Yun-Hsin Huang, Tsung-Ping Chen, Yu-Chia Kuo, Yu-Chi Wei, Chih-Hsuan Li, Da-Yu Huang, Hsuan-Kai Kao, Ting-Wei Lin, Li Su
Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024. 14 pages, 7 figures. Dataset is available on: this https URL and this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[322] arXiv:2406.06403 (cross-list from cs.CL) [pdf, html, other]
Title: Meta Learning Text-to-Speech Synthesis in over 7000 Languages
Florian Lux, Sarina Meyer, Lyonel Behringer, Frank Zalkow, Phat Do, Matt Coler, Emanuël A. P. Habets, Ngoc Thang Vu
Comments: accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[323] arXiv:2406.06406 (cross-list from cs.CL) [pdf, html, other]
Title: Controlling Emotion in Text-to-Speech with Natural Language Prompts
Thomas Bott, Florian Lux, Ngoc Thang Vu
Comments: accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[324] arXiv:2406.06438 (cross-list from cs.CL) [pdf, html, other]
Title: Multimodal Contextualized Semantic Parsing from Speech
Jordan Voas, Raymond Mooney, David Harwath
Comments: 10 Pages, 3 figures, ACL 2024 Main
Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[325] arXiv:2406.06582 (cross-list from cs.CL) [pdf, html, other]
Title: Discrete Multimodal Transformers with a Pretrained Large Language Model for Mixed-Supervision Speech Processing
Viet Anh Trinh, Rosy Southwell, Yiwen Guan, Xinlu He, Zhiyong Wang, Jacob Whitehill
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[326] arXiv:2406.06601 (cross-list from cs.CL) [pdf, html, other]
Title: A Human-in-the-Loop Approach to Improving Cross-Text Prosody Transfer
Himanshu Maurya, Atli Sigurgeirsson
Comments: 4 pages (+1 references), 4 figures, to be presented at Interspeech 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[327] arXiv:2406.06612 (cross-list from cs.CV) [pdf, html, other]
Title: SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound
Rishit Dagli, Shivesh Prakash, Robert Wu, Houman Khosravani
Comments: Project Page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[328] arXiv:2406.06786 (cross-list from cs.SD) [pdf, html, other]
Title: BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound Classification
June-Woo Kim, Miika Toikkanen, Yera Choi, Seoung-Eun Moon, Ho-Young Jung
Comments: Accepted INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[329] arXiv:2406.06937 (cross-list from cs.CL) [pdf, html, other]
Title: A Non-autoregressive Generation Framework for End-to-End Simultaneous Speech-to-Speech Translation
Zhengrui Ma, Qingkai Fang, Shaolei Zhang, Shoutao Guo, Yang Feng, Min Zhang
Comments: ACL 2024; Codes and demos are at this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[330] arXiv:2406.06964 (cross-list from cs.CL) [pdf, html, other]
Title: Missingness-resilient Video-enhanced Multimodal Disfluency Detection
Payal Mohapatra, Shamika Likhite, Subrata Biswas, Bashima Islam, Qi Zhu
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[331] arXiv:2406.06979 (cross-list from cs.LG) [pdf, html, other]
Title: AudioMarkBench: Benchmarking Robustness of Audio Watermarking
Hongbin Liu, Moyang Guo, Zhengyuan Jiang, Lun Wang, Neil Zhenqiang Gong
Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[332] arXiv:2406.06992 (cross-list from cs.SD) [pdf, html, other]
Title: Scaling up masked audio encoder learning for general audio classification
Heinrich Dinkel, Zhiyong Yan, Yongqing Wang, Junbo Zhang, Yujun Wang, Bin Wang
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[333] arXiv:2406.07012 (cross-list from cs.SD) [pdf, html, other]
Title: Bridging Language Gaps in Audio-Text Retrieval
Zhiyong Yan, Heinrich Dinkel, Yongqing Wang, Jizhong Liu, Junbo Zhang, Yujun Wang, Bin Wang
Comments: interspeech2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[334] arXiv:2406.07060 (cross-list from cs.CL) [pdf, other]
Title: Reading Miscue Detection in Primary School through Automatic Speech Recognition
Lingyun Gao, Cristian Tejedor-Garcia, Helmer Strik, Catia Cucchiarini
Comments: Proc. INTERSPEECH 2024, 1-5 September 2024. Kos Island, Greece
Journal-ref: Proc. Interspeech 2024, 5153-5157
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[335] arXiv:2406.07131 (cross-list from cs.SD) [pdf, html, other]
Title: ICGAN: An implicit conditioning method for interpretable feature control of neural audio synthesis
Yunyi Liu, Craig Jin
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[336] arXiv:2406.07162 (cross-list from cs.SD) [pdf, html, other]
Title: EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark
Ziyang Ma, Mingjie Chen, Hezhao Zhang, Zhisheng Zheng, Wenxi Chen, Xiquan Li, Jiaxin Ye, Xie Chen, Thomas Hain
Comments: Accepted by INTERSPEECH 2024. GitHub Repository: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[337] arXiv:2406.07203 (cross-list from cs.SD) [pdf, html, other]
Title: ParaCLAP -- Towards a general language-audio model for computational paralinguistic tasks
Xin Jing, Andreas Triantafyllopoulos, Björn Schuller
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[338] arXiv:2406.07254 (cross-list from cs.SD) [pdf, html, other]
Title: SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark
Yuki Saito, Takuto Igarashi, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto, Kentaro Tachibana, Hiroshi Saruwatari
Comments: Accepted for INTERSPEECH 2024, corpus project page: this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[339] arXiv:2406.07256 (cross-list from cs.SD) [pdf, html, other]
Title: AS-70: A Mandarin stuttered speech dataset for automatic speech recognition and stuttering event detection
Rong Gong, Hongfei Xue, Lezhi Wang, Xin Xu, Qisheng Li, Lei Xie, Hui Bu, Shaomei Wu, Jiaming Zhou, Yong Qin, Binbin Zhang, Jun Du, Jia Bin, Ming Li
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[340] arXiv:2406.07280 (cross-list from cs.SD) [pdf, html, other]
Title: Noise-Robust Voice Conversion by Conditional Denoising Training Using Latent Variables of Recording Quality and Environment
Takuto Igarashi, Yuki Saito, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto, Kentaro Tachibana, Hiroshi Saruwatari
Comments: 5 pages, accepted for INTERSPEECH 2024, audio samples: this http URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[341] arXiv:2406.07289 (cross-list from cs.CL) [pdf, html, other]
Title: Can We Achieve High-quality Direct Speech-to-Speech Translation without Parallel Speech Data?
Qingkai Fang, Shaolei Zhang, Zhengrui Ma, Min Zhang, Yang Feng
Comments: ACL 2024 main conference. Project Page: this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[342] arXiv:2406.07330 (cross-list from cs.CL) [pdf, html, other]
Title: CTC-based Non-autoregressive Textless Speech-to-Speech Translation
Qingkai Fang, Zhengrui Ma, Yan Zhou, Min Zhang, Yang Feng
Comments: ACL 2024 Findings
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[343] arXiv:2406.07421 (cross-list from cs.SD) [pdf, html, other]
Title: A Comprehensive Investigation on Speaker Augmentation for Speaker Recognition
Zhenyu Zhou, Shibiao Xu, Shi Yin, Lantian Li, Dong Wang
Comments: to be published in INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[344] arXiv:2406.07437 (cross-list from cs.SD) [pdf, html, other]
Title: Graph-based multi-Feature fusion method for speech emotion recognition
Xueyu Liu, Jie Lin, Chao Wang
Comments: 25 pages,4 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[345] arXiv:2406.07466 (cross-list from cs.CL) [pdf, html, other]
Title: Multimodal Belief Prediction
John Murzaku, Adil Soubki, Owen Rambow
Comments: John Murzaku and Adil Soubki contributed equally to this work
Journal-ref: Interspeech 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[346] arXiv:2406.07497 (cross-list from cs.SD) [pdf, other]
Title: A methodological framework and exemplar protocol for the collection and analysis of repeated speech samples
Nicholas Cummins, Lauren L. White, Zahia Rahman, Catriona Lucas, Tian Pan, Ewan Carr, Faith Matcham, Johnny Downs, Richard J. Dobson, Thomas F. Quatieri, Judith Dineley
Comments: Main manuscript: 49 pages double spaced. 3 figures, 6 tables. Submitted to BMC Methods. Replacement with substantially revised version
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[347] arXiv:2406.07498 (cross-list from cs.SD) [pdf, html, other]
Title: RaD-Net 2: A causal two-stage repairing and denoising speech enhancement network with knowledge distillation and complex axial self-attention
Mingshuai Liu, Zhuangqi Chen, Xiaopeng Yan, Yuanjun Lv, Xianjun Xia, Chuanzeng Huang, Yijian Xiao, Lei Xie
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[348] arXiv:2406.07532 (cross-list from cs.SD) [pdf, html, other]
Title: Hearing Anything Anywhere
Mason Wang, Ryosuke Sawata, Samuel Clarke, Ruohan Gao, Shangzhe Wu, Jiajun Wu
Comments: CVPR 2024. The first two authors contributed equally. Project page: this https URL
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[349] arXiv:2406.07646 (cross-list from cs.SD) [pdf, html, other]
Title: Pre-training Feature Guided Diffusion Model for Speech Enhancement
Yiyuan Yang, Niki Trigoni, Andrew Markham
Comments: Accepted by Interspeech 2024 Conference
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[350] arXiv:2406.07663 (cross-list from eess.SY) [pdf, html, other]
Title: Broadband MEMS Microphone Arrays with Reduced Aperture Through 3D-Printed Waveguides
Dennis Laurijssen, Walter Daems, Jan Steckel
Subjects: Systems and Control (eess.SY); Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[351] arXiv:2406.07676 (cross-list from cs.SD) [pdf, html, other]
Title: FastAST: Accelerating Audio Spectrogram Transformer via Token Merging and Cross-Model Knowledge Distillation
Swarup Ranjan Behera, Abhishek Dhiman, Karthik Gowda, Aalekhya Satya Narayani
Comments: Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[352] arXiv:2406.07725 (cross-list from cs.SD) [pdf, html, other]
Title: The Interspeech 2024 Challenge on Speech Processing Using Discrete Units
Xuankai Chang, Jiatong Shi, Jinchuan Tian, Yuning Wu, Yuxun Tang, Yihan Wu, Shinji Watanabe, Yossi Adi, Xie Chen, Qin Jin
Comments: This manuscript has been accepted by Interspeech2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[353] arXiv:2406.07801 (cross-list from cs.CL) [pdf, html, other]
Title: PolySpeech: Exploring Unified Multitask Speech Models for Competitiveness with Single-task Models
Runyan Yang, Huibao Yang, Xiqing Zhang, Tiantian Ye, Ying Liu, Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng
Comments: 5 pages, 2 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[354] arXiv:2406.07803 (cross-list from cs.SD) [pdf, html, other]
Title: EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech
Deok-Hyeon Cho, Hyung-Seok Oh, Seung-Bin Kim, Sang-Hoon Lee, Seong-Whan Lee
Comments: Proceedings of Interspeech
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[355] arXiv:2406.07823 (cross-list from cs.CL) [pdf, html, other]
Title: PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding
Trang Le, Daniel Lazar, Suyoun Kim, Shan Jiang, Duc Le, Adithya Sagar, Aleksandr Livshits, Ahmed Aly, Akshat Shrivastava
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[356] arXiv:2406.07832 (cross-list from cs.SD) [pdf, html, other]
Title: SE/BN Adapter: Parametric Efficient Domain Adaptation for Speaker Recognition
Tianhao Wang, Lantian Li, Dong Wang
Comments: to be published in INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[357] arXiv:2406.07854 (cross-list from cs.SD) [pdf, html, other]
Title: Zero-Shot Fake Video Detection by Audio-Visual Consistency
Xiaolou Li, Zehua Liu, Chen Chen, Lantian Li, Li Guo, Dong Wang
Comments: to be published in INTERSPEECH 2024
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[358] arXiv:2406.07855 (cross-list from cs.CL) [pdf, html, other]
Title: VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment
Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
Comments: 15 pages, 5 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[359] arXiv:2406.07871 (cross-list from cs.CV) [pdf, html, other]
Title: Flexible Music-Conditioned Dance Generation with Style Description Prompts
Hongsong Wang, Yin Zhu, Xin Geng
Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[360] arXiv:2406.07900 (cross-list from cs.CL) [pdf, html, other]
Title: Exploring Self-Supervised Multi-view Contrastive Learning for Speech Emotion Recognition with Limited Annotations
Bulat Khaertdinov, Pedro Jeuris, Annanda Sousa, Enrique Hortal
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[361] arXiv:2406.07914 (cross-list from cs.SD) [pdf, html, other]
Title: Can Large Language Models Understand Spatial Audio?
Changli Tang, Wenyi Yu, Guangzhi Sun, Xianzhao Chen, Tian Tan, Wei Li, Jun Zhang, Lu Lu, Zejun Ma, Yuxuan Wang, Chao Zhang
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[362] arXiv:2406.07923 (cross-list from cs.SD) [pdf, html, other]
Title: CTC-aligned Audio-Text Embedding for Streaming Open-vocabulary Keyword Spotting
Sichen Jin, Youngmoon Jung, Seungjin Lee, Jaeyoung Roh, Changwoo Han, Hoonyoung Cho
Journal-ref: Proceedings of Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[363] arXiv:2406.08052 (cross-list from cs.SD) [pdf, html, other]
Title: FakeSound: Deepfake General Audio Detection
Zeyu Xie, Baihan Li, Xuenan Xu, Zheng Liang, Kai Yu, Mengyue Wu
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[364] arXiv:2406.08112 (cross-list from cs.SD) [pdf, html, other]
Title: Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio
Yi Lu, Yuankun Xie, Ruibo Fu, Zhengqi Wen, Jianhua Tao, Zhiyong Wang, Xin Qi, Xuefei Liu, Yongwei Li, Yukun Liu, Xiaopeng Wang, Shuchen Shi
Comments: Accepted by INTERSPEECH 2024. arXiv admin note: substantial text overlap with arXiv:2405.04880
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[365] arXiv:2406.08196 (cross-list from cs.SD) [pdf, html, other]
Title: FreeV: Free Lunch For Vocoders Through Pseudo Inversed Mel Filter
Yuanjun Lv, Hai Li, Ying Yan, Junhui Liu, Danming Xie, Lei Xie
Comments: Accepted by InterSpeech 2024; 5 pages, 5 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[366] arXiv:2406.08200 (cross-list from cs.SD) [pdf, html, other]
Title: Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding
Rui Wang, Liping Chen, Kong AiK Lee, Zhen-Hua Ling
Comments: accpeted by Interspeech2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[367] arXiv:2406.08336 (cross-list from cs.SD) [pdf, html, other]
Title: CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction
Xueyuan Chen, Dongchao Yang, Dingdong Wang, Xixin Wu, Zhiyong Wu, Helen Meng
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[368] arXiv:2406.08380 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Unsupervised Speech Recognition Without Pronunciation Models
Junrui Ni, Liming Wang, Yang Zhang, Kaizhi Qian, Heting Gao, Mark Hasegawa-Johnson, Chang D. Yoo
Comments: This work has been submitted to the IEEE for possible publication
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[369] arXiv:2406.08384 (cross-list from cs.SD) [pdf, other]
Title: Diff-A-Riff: Musical Accompaniment Co-creation via Latent Diffusion Models
Javier Nistal, Marco Pasini, Cyran Aouameur, Maarten Grachten, Stefan Lattner
Comments: 8 pages, 2 figures, 3 tables
Journal-ref: Proc. of the 25th International Society for Music Information Retrieval, 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[370] arXiv:2406.08416 (cross-list from cs.SD) [pdf, html, other]
Title: TokSing: Singing Voice Synthesis based on Discrete Tokens
Yuning Wu, Chunlei zhang, Jiatong Shi, Yuxun Tang, Shan Yang, Qin Jin
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[371] arXiv:2406.08454 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Musically Informed Evaluation of Piano Transcription Models
Patricia Hu, Lukáš Samuel Marták, Carlos Cancino-Chacón, Gerhard Widmer
Comments: Accepted at the 25th International Society for Music Information Retrieval Conference (ISMIR 2024)
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[372] arXiv:2406.08568 (cross-list from cs.SD) [pdf, html, other]
Title: Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesis
Wing-Zin Leung, Mattias Cross, Anton Ragni, Stefan Goetze
Comments: Accepted for Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[373] arXiv:2406.08619 (cross-list from cs.CL) [pdf, html, other]
Title: Self-Supervised Speech Representations are More Phonetic than Semantic
Kwanghee Choi, Ankita Pasad, Tomohiko Nakamura, Satoru Fukayama, Karen Livescu, Shinji Watanabe
Comments: Accepted to Interspeech 2024. Source code at this https URL
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[374] arXiv:2406.08623 (cross-list from cs.SD) [pdf, html, other]
Title: Emotion Manipulation Through Music -- A Deep Learning Interactive Visual Approach
Adel N. Abdalla, Jared Osborne, Razvan Andonie
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[375] arXiv:2406.08641 (cross-list from cs.SD) [pdf, html, other]
Title: ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets
Jiatong Shi, Shih-Heng Wang, William Chen, Martijn Bartelds, Vanya Bannihatti Kumar, Jinchuan Tian, Xuankai Chang, Dan Jurafsky, Karen Livescu, Hung-yi Lee, Shinji Watanabe
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[376] arXiv:2406.08644 (cross-list from eess.SP) [pdf, html, other]
Title: Toward Fully-End-to-End Listened Speech Decoding from EEG Signals
Jihwan Lee, Aditya Kommineni, Tiantian Feng, Kleanthis Avramidis, Xuan Shi, Sudarsana Kadiri, Shrikanth Narayanan
Comments: accepted to Interspeech2024
Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[377] arXiv:2406.08716 (cross-list from cs.SD) [pdf, html, other]
Title: TSE-PI: Target Sound Extraction under Reverberant Environments with Pitch Information
Yiwen Wang, Xihong Wu
Comments: Accepted by Interspeech2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[378] arXiv:2406.08761 (cross-list from cs.SD) [pdf, html, other]
Title: VISinger2+: End-to-End Singing Voice Synthesis Augmented by Self-Supervised Learning Representation
Yifeng Yu, Jiatong Shi, Yuning Wu, Shinji Watanabe
Comments: 4 pages, 2 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[379] arXiv:2406.08771 (cross-list from cs.SD) [pdf, html, other]
Title: MFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection
Da Mu, Zhicheng Zhang, Haobo Yue
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[380] arXiv:2406.08800 (cross-list from cs.SD) [pdf, html, other]
Title: Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?
Tiantian Feng, Dimitrios Dimitriadis, Shrikanth Narayanan
Comments: Accepted to 2024 INTERSPEECH; corrections to ActivityNet labels
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[381] arXiv:2406.08809 (cross-list from cs.SD) [pdf, html, other]
Title: Are We There Yet? A Brief Survey of Music Emotion Prediction Datasets, Models and Outstanding Challenges
Jaeyong Kang, Dorien Herremans
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[382] arXiv:2406.08812 (cross-list from cs.SD) [pdf, html, other]
Title: Generating Speakers by Prompting Listener Impressions for Pre-trained Multi-Speaker Text-to-Speech Systems
Zhengyang Chen, Xuechen Liu, Erica Cooper, Junichi Yamagishi, Yanmin Qian
Comments: Accepted for presentation at Interspeech 2024 (with more analysis in the final Appendix part)
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[383] arXiv:2406.08825 (cross-list from cs.SD) [pdf, html, other]
Title: Interpretable Temporal Class Activation Representation for Audio Spoofing Detection
Menglu Li, Xiao-Ping Zhang
Comments: 5 pages, 2 figures, Accepted to Interspeech2024
Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)
[384] arXiv:2406.08835 (cross-list from cs.SD) [pdf, html, other]
Title: EffectiveASR: A Single-Step Non-Autoregressive Mandarin Speech Recognition Architecture with High Accuracy and Inference Speed
Ziyang Zhuang, Chenfeng Miao, Kun Zou, Ming Fang, Tao Wei, Zijian Li, Ning Cheng, Wei Hu, Shaojun Wang, Jing Xiao
Comments: Submitted to ICASSP 2025
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[385] arXiv:2406.08904 (cross-list from cs.LG) [pdf, html, other]
Title: AdaPTwin: Low-Cost Adaptive Compression of Product Twins in Transformers
Emil Biju, Anirudh Sriram, Mert Pilanci
Comments: 12 pages, 3 figures, submitted to NeurIPS 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[386] arXiv:2406.08905 (cross-list from cs.SD) [pdf, html, other]
Title: SingOMD: Singing Oriented Multi-resolution Discrete Representation Construction from Speech Models
Yuxun Tang, Yuning Wu, Jiatong Shi, Qin Jin
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[387] arXiv:2406.08911 (cross-list from cs.CL) [pdf, html, other]
Title: An Initial Investigation of Language Adaptation for TTS Systems under Low-resource Scenarios
Cheng Gong, Erica Cooper, Xin Wang, Chunyu Qiang, Mengzhe Geng, Dan Wells, Longbiao Wang, Jianwu Dang, Marc Tessier, Aidan Pine, Korin Richmond, Junichi Yamagishi
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[388] arXiv:2406.08914 (cross-list from cs.SD) [pdf, html, other]
Title: Transcription-Free Fine-Tuning of Speech Separation Models for Noisy and Reverberant Multi-Speaker Automatic Speech Recognition
William Ravenscroft, George Close, Stefan Goetze, Thomas Hain, Mohammad Soleymanpour, Anurag Chowdhury, Mark C. Fuhs
Comments: 5 pages, 3 Figures, 3 Tables, Accepted for Interspeech 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[389] arXiv:2406.08920 (cross-list from cs.SD) [pdf, html, other]
Title: AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
Swapnil Bhosale, Haosen Yang, Diptesh Kanojia, Jiankang Deng, Xiatian Zhu
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[390] arXiv:2406.08931 (cross-list from cs.CL) [pdf, html, other]
Title: Exploring Multilingual Unseen Speaker Emotion Recognition: Leveraging Co-Attention Cues in Multitask Learning
Arnav Goel, Medha Hira, Anubha Gupta
Comments: 5 pages, Accepted to INTERSPEECH 2024. The first two authors contributed equally
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[391] arXiv:2406.09153 (cross-list from cs.CL) [pdf, html, other]
Title: LASER: Learning by Aligning Self-supervised Representations of Speech for Improving Content-related Tasks
Amit Meghanani, Thomas Hain
Comments: Accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[392] arXiv:2406.09154 (cross-list from cs.SD) [pdf, html, other]
Title: Diffusion Gaussian Mixture Audio Denoise
Pu Wang, Junhui Li, Jialu Li, Liangdong Guo, Youshan Zhang
Comments: INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[393] arXiv:2406.09156 (cross-list from cs.LG) [pdf, html, other]
Title: Towards Multilingual Audio-Visual Question Answering
Orchid Chetia Phukan, Priyabrata Mallick, Swarup Ranjan Behera, Aalekhya Satya Narayani, Arun Balaji Buduru, Rajesh Sharma
Comments: Accepted to Interspeech 2024
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[394] arXiv:2406.09161 (cross-list from cs.SD) [pdf, html, other]
Title: Complex Image-Generative Diffusion Transformer for Audio Denoising
Junhui Li, Pu Wang, Jialu Li, Youshan Zhang
Comments: INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[395] arXiv:2406.09167 (cross-list from cs.SD) [pdf, html, other]
Title: Vision Transformer Segmentation for Visual Bird Sound Denoising
Sahil Kumar, Jialu Li, Youshan Zhang
Comments: INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[396] arXiv:2406.09272 (cross-list from cs.CV) [pdf, html, other]
Title: Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos
Changan Chen, Puyuan Peng, Ami Baid, Zihui Xue, Wei-Ning Hsu, David Harwath, Kristen Grauman
Comments: Project page: this https URL. ECCV 2024 camera-ready version
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[397] arXiv:2406.09282 (cross-list from cs.CL) [pdf, html, other]
Title: On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models
Jinchuan Tian, Yifan Peng, William Chen, Kwanghee Choi, Karen Livescu, Shinji Watanabe
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[398] arXiv:2406.09326 (cross-list from cs.SD) [pdf, html, other]
Title: PianoMotion10M: Dataset and Benchmark for Hand Motion Generation in Piano Performance
Qijun Gan, Song Wang, Shengtao Wu, Jianke Zhu
Comments: Codes and Dataset: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[399] arXiv:2406.09345 (cross-list from cs.CL) [pdf, html, other]
Title: DiscreteSLU: A Large Language Model with Self-Supervised Discrete Speech Units for Spoken Language Understanding
Suwon Shon, Kwangyoun Kim, Yi-Te Hsu, Prashant Sridhar, Shinji Watanabe, Karen Livescu
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[400] arXiv:2406.09426 (cross-list from cs.SD) [pdf, other]
Title: Analyzing phonetic structure of Mandarin using Audacity
Shizheng Xu
Comments: audio source: this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[401] arXiv:2406.09569 (cross-list from cs.CL) [pdf, html, other]
Title: Speech ReaLLM -- Real-time Streaming Speech Recognition with Multimodal LLMs by Teaching the Flow of Time
Frank Seide, Morrie Doulaty, Yangyang Shi, Yashesh Gaur, Junteng Jia, Chunyang Wu
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[402] arXiv:2406.09617 (cross-list from cs.CL) [pdf, html, other]
Title: Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection
Shruti Palaskar, Oggi Rudovic, Sameer Dharur, Florian Pesce, Gautam Krishna, Aswin Sivaraman, Jack Berkowitz, Ahmed Hussen Abdelaziz, Saurabh Adya, Ahmed Tewfik
Comments: Accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[403] arXiv:2406.09618 (cross-list from cs.CL) [pdf, html, other]
Title: Multi-Modal Retrieval For Large Language Model Based Speech Recognition
Jari Kolehmainen, Aditya Gourav, Prashanth Gurunath Shivakumar, Yile Gu, Ankur Gandhe, Ariya Rastrow, Grant Strimel, Ivan Bulyko
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[404] arXiv:2406.09664 (cross-list from cs.SD) [pdf, html, other]
Title: Frequency-mix Knowledge Distillation for Fake Speech Detection
Cunhang Fan, Shunbo Dong, Jun Xue, Yujie Chen, Jiangyan Yi, Zhao Lv
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[405] arXiv:2406.09833 (cross-list from cs.AI) [pdf, html, other]
Title: SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering
Zhe Yang, Wenrui Li, Guanghui Cheng
Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[406] arXiv:2406.09844 (cross-list from cs.SD) [pdf, html, other]
Title: Vec-Tok-VC+: Residual-enhanced Robust Zero-shot Voice Conversion with Progressive Constraints in a Dual-mode Training Strategy
Linhan Ma, Xinfa Zhu, Yuanjun Lv, Zhichao Wang, Ziqian Wang, Wendi He, Hongbin Zhou, Lei Xie
Comments: Accepted by INTERSPEECH2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[407] arXiv:2406.09869 (cross-list from cs.SD) [pdf, html, other]
Title: MMM: Multi-Layer Multi-Residual Multi-Stream Discrete Speech Representation from Self-supervised Learning Model
Jiatong Shi, Xutai Ma, Hirofumi Inaguma, Anna Sun, Shinji Watanabe
Comments: Accepted by Interspeech2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[408] arXiv:2406.09928 (cross-list from cs.SD) [pdf, html, other]
Title: Personalized Speech Enhancement Without a Separate Speaker Embedding Model
Tanel Pärnamaa, Ando Saabas
Comments: Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[409] arXiv:2406.09950 (cross-list from cs.SD) [pdf, html, other]
Title: An efficient text augmentation approach for contextualized Mandarin speech recognition
Naijun Zheng, Xucheng Wan, Kai Liu, Ziqing Du, Zhou Huan
Comments: accepted to interspeech2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[410] arXiv:2406.09968 (cross-list from cs.LG) [pdf, html, other]
Title: Impact of Speech Mode in Automatic Pathological Speech Detection
Shakeel A. Sheikh, Ina Kodrasi
Comments: Accepted in EUSIPCO 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[411] arXiv:2406.10034 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Effective and Efficient Non-autoregressive Decoding Using Block-based Attention Mask
Tianzi Wang, Xurong Xie, Zhaoqing Li, Shoukang Hu, Zengrui Jin, Jiajun Deng, Mingyu Cui, Shujie Hu, Mengzhe Geng, Guinan Li, Helen Meng, Xunying Liu
Comments: 5 pages, 2 figures, 2 tables, Interspeech24 conference
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[412] arXiv:2406.10052 (cross-list from cs.SD) [pdf, html, other]
Title: Simul-Whisper: Attention-Guided Streaming Whisper with Truncation Detection
Haoyu Wang, Guoqiang Hu, Guodong Lin, Wei-Qiang Zhang, Jian Li
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[413] arXiv:2406.10056 (cross-list from cs.SD) [pdf, html, other]
Title: UniAudio 1.5: Large Language Model-driven Audio Codec is A Few-shot Audio Task Learner
Dongchao Yang, Haohan Guo, Yuanyuan Wang, Rongjie Huang, Xiang Li, Xu Tan, Xixin Wu, Helen Meng
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[414] arXiv:2406.10083 (cross-list from cs.CL) [pdf, html, other]
Title: On the Evaluation of Speech Foundation Models for Spoken Language Understanding
Siddhant Arora, Ankita Pasad, Chung-Ming Chien, Jionghao Han, Roshan Sharma, Jee-weon Jung, Hira Dhamyal, William Chen, Suwon Shon, Hung-yi Lee, Karen Livescu, Shinji Watanabe
Comments: Accepted at ACL Findings 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[415] arXiv:2406.10152 (cross-list from cs.SD) [pdf, html, other]
Title: Joint Speaker Features Learning for Audio-visual Multichannel Speech Separation and Recognition
Guinan Li, Jiajun Deng, Youjun Chen, Mengzhe Geng, Shujie Hu, Zhe Li, Zengrui Jin, Tianzi Wang, Xurong Xie, Helen Meng, Xunying Liu
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[416] arXiv:2406.10160 (cross-list from cs.SD) [pdf, html, other]
Title: One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model
Zhaoqing Li, Haoning Xu, Tianzi Wang, Shoukang Hu, Zengrui Jin, Shujie Hu, Jiajun Deng, Mingyu Cui, Mengzhe Geng, Xunying Liu
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[417] arXiv:2406.10223 (cross-list from cs.LG) [pdf, html, other]
Title: Diffusion Synthesizer for Efficient Multilingual Speech to Speech Translation
Nameer Hirschkind, Xiao Yu, Mahesh Kumar Nandwana, Joseph Liu, Eloi DuBois, Dao Le, Nicolas Thiebaut, Colin Sinclair, Kyle Spence, Charles Shang, Zoe Abrams, Morgan McGuire
Comments: Published in Interspeech 2024
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[418] arXiv:2406.10254 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Signal Processing In Large Language Models
Prateek Verma, Mert Pilanci
Comments: 12 pages, 3 figures
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[419] arXiv:2406.10272 (cross-list from cs.CL) [pdf, html, other]
Title: Connected Speech-Based Cognitive Assessment in Chinese and English
Saturnino Luz, Sofia De La Fuente Garcia, Fasih Haider, Davida Fromm, Brian MacWhinney, Alyssa Lanzi, Ya-Ning Chang, Chia-Ju Chou, Yi-Chien Liu
Comments: To appear in Proceedings of Interspeech 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[420] arXiv:2406.10276 (cross-list from cs.CL) [pdf, html, other]
Title: Soft Language Identification for Language-Agnostic Many-to-One End-to-End Speech Translation
Peidong Wang, Jian Xue, Jinyu Li, Junkun Chen, Aswin Shanmugam Subramanian
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[421] arXiv:2406.10283 (cross-list from cs.CL) [pdf, html, other]
Title: Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection
Zihan Pan, Tianchi Liu, Hardik B. Sailor, Qiongqiong Wang
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[422] arXiv:2406.10284 (cross-list from cs.CL) [pdf, html, other]
Title: Improving child speech recognition with augmented child-like speech
Yuanyuan Zhang, Zhengjun Yue, Tanvina Patel, Odette Scharenborg
Comments: 5 pages, 1 figure Accepted to INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[423] arXiv:2406.10325 (cross-list from cs.CL) [pdf, html, other]
Title: Enhancing Multilingual Voice Toxicity Detection with Speech-Text Alignment
Joseph Liu, Mahesh Kumar Nandwana, Janne Pylkkönen, Hannes Heikinheimo, Morgan McGuire
Comments: Accepted to INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[424] arXiv:2406.10735 (cross-list from cs.SD) [pdf, html, other]
Title: How Should We Extract Discrete Audio Tokens from Self-Supervised Models?
Pooneh Mousavi, Jarod Duret, Salah Zaiem, Luca Della Libera, Artem Ploujnikov, Cem Subakan, Mirco Ravanelli
Comments: 4 pages, 2 figures, 2 tables, Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[425] arXiv:2406.10741 (cross-list from cs.SD) [pdf, other]
Title: Speech Emotion Recognition Using CNN and Its Use Case in Digital Healthcare
Nishargo Nigar
Comments: Master's Thesis at Hamburg University of Technology
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[426] arXiv:2406.10873 (cross-list from cs.SD) [pdf, html, other]
Title: Optimizing Automatic Speech Assessment: W-RankSim Regularization and Hybrid Feature Fusion Strategies
Chung-Wen Wu, Berlin Chen
Comments: Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[427] arXiv:2406.10911 (cross-list from cs.SD) [pdf, html, other]
Title: SingMOS: An extensive Open-Source Singing Voice Dataset for MOS Prediction
Yuxun Tang, Jiatong Shi, Yuning Wu, Qin Jin
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[428] arXiv:2406.10932 (cross-list from cs.SD) [pdf, html, other]
Title: Imperceptible Rhythm Backdoor Attacks: Exploring Rhythm Transformation for Embedding Undetectable Vulnerabilities on Speech Recognition
Wenhan Yao, Jiangkun Yang, Yongqiang He, Jia Liu, Weiping Wen
Comments: Accepted by Neurocomputing
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[429] arXiv:2406.10956 (cross-list from cs.SD) [pdf, html, other]
Title: Robust Channel Learning for Large-Scale Radio Speaker Verification
Wenhao Yang, Jianguo Wei, Wenhuan Lu, Lei Li, Xugang Lu
Comments: 12 pages, 11 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[430] arXiv:2406.10970 (cross-list from cs.SD) [pdf, html, other]
Title: Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation
Or Tal, Alon Ziv, Itai Gat, Felix Kreuk, Yossi Adi
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[431] arXiv:2406.10993 (cross-list from cs.CL) [pdf, html, other]
Title: CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving
Bhavani Shankar, Preethi Jyothi, Pushpak Bhattacharyya
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[432] arXiv:2406.11006 (cross-list from cs.SD) [pdf, html, other]
Title: SPEAR: Receiver-to-Receiver Acoustic Neural Warping Field
Yuhang He, Shitong Xu, Jia-Xing Zhong, Sangyun Shin, Niki Trigoni, Andrew Markham
Comments: 9 pages, 5 figures in main paper
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[433] arXiv:2406.11022 (cross-list from cs.SD) [pdf, html, other]
Title: Outlier Reduction with Gated Attention for Improved Post-training Quantization in Large Sequence-to-sequence Speech Foundation Models
Dominik Wagner, Ilja Baumann, Korbinian Riedhammer, Tobias Bocklet
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[434] arXiv:2406.11025 (cross-list from cs.SD) [pdf, html, other]
Title: Large Language Models for Dysfluency Detection in Stuttered Speech
Dominik Wagner, Sebastian P. Bayerl, Ilja Baumann, Korbinian Riedhammer, Elmar Nöth, Tobias Bocklet
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[435] arXiv:2406.11037 (cross-list from cs.SD) [pdf, html, other]
Title: NAST: Noise Aware Speech Tokenization for Speech Language Models
Shoval Messica, Yossi Adi
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[436] arXiv:2406.11119 (cross-list from cs.SD) [pdf, other]
Title: Identification of Physical Properties in Acoustic Tubes Using Physics-Informed Neural Networks
Kazuya Yokota, Masataka Ogura, Masajiro Abe
Comments: 10 pages, 7 figures, The following article has been submitted to Mechanical Engineering Journal. After it is published, it will be found at this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[437] arXiv:2406.11175 (cross-list from cs.SD) [pdf, html, other]
Title: SMRU: Split-and-Merge Recurrent-based UNet for Acoustic Echo Cancellation and Noise Suppression
Zhihang Sun, Andong Li, Rilin Chen, Hao Zhang, Meng Yu, Yi Zhou, Dong Yu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[438] arXiv:2406.11364 (cross-list from cs.SD) [pdf, html, other]
Title: AnoPatch: Towards Better Consistency in Machine Anomalous Sound Detection
Anbai Jiang, Bing Han, Zhiqiang Lv, Yufeng Deng, Wei-Qiang Zhang, Xie Chen, Yanmin Qian, Jia Liu, Pingyi Fan
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[439] arXiv:2406.11462 (cross-list from cs.MM) [pdf, html, other]
Title: MusicScore: A Dataset for Music Score Modeling and Generation
Yuheng Lin, Zheqi Dai, Qiuqiang Kong
Comments: Dataset paper, dataset link: this https URL
Subjects: Multimedia (cs.MM); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[440] arXiv:2406.11568 (cross-list from cs.CL) [pdf, html, other]
Title: Towards an End-to-End Framework for Invasive Brain Signal Decoding with Large Language Models
Sheng Feng, Heyang Liu, Yu Wang, Yanfeng Wang
Journal-ref: Proceedings of Interspeech2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)
[441] arXiv:2406.11768 (cross-list from cs.SD) [pdf, html, other]
Title: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
Sreyan Ghosh, Sonal Kumar, Ashish Seth, Chandra Kiran Reddy Evuru, Utkarsh Tyagi, S Sakshi, Oriol Nieto, Ramani Duraiswami, Dinesh Manocha
Comments: Project Website: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[442] arXiv:2406.12141 (cross-list from cs.CL) [pdf, html, other]
Title: A dual task learning approach to fine-tune a multilingual semantic speech encoder for Spoken Language Understanding
Gaëlle Laperrière, Sahar Ghannay, Bassam Jabaian, Yannick Estève
Comments: In Proceedings of Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[443] arXiv:2406.12164 (cross-list from cs.SD) [pdf, html, other]
Title: A Mel Spectrogram Enhancement Paradigm Based on CWT in Speech Synthesis
Guoqiang Hu, Huaning Tan, Ruilai Li
Comments: Accepted by IALP 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[444] arXiv:2406.12209 (cross-list from cs.SD) [pdf, html, other]
Title: Interface Design for Self-Supervised Speech Models
Yi-Jen Shih, David Harwath
Comments: Accepted to Interspeech2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[445] arXiv:2406.12292 (cross-list from cs.SD) [pdf, html, other]
Title: JEN-1 DreamStyler: Customized Musical Concept Learning via Pivotal Parameters Tuning
Boyu Chen, Peike Li, Yao Yao, Alex Wang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[446] arXiv:2406.12317 (cross-list from cs.CL) [pdf, html, other]
Title: Finding Task-specific Subnetworks in Multi-task Spoken Language Understanding Model
Hayato Futami, Siddhant Arora, Yosuke Kashiwagi, Emiru Tsunoo, Shinji Watanabe
Comments: Accepted to Interspeech2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[447] arXiv:2406.12428 (cross-list from cs.CL) [pdf, html, other]
Title: PSLM: Parallel Generation of Text and Speech with LLMs for Low-Latency Spoken Dialogue Systems
Kentaro Mitsui, Koh Mitsuda, Toshiaki Wakatsuki, Yukiya Hono, Kei Sawada
Comments: 9 pages, 6 figures, 4 tables, accepted for Findings of EMNLP 2024. Demo samples: this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[448] arXiv:2406.12432 (cross-list from eess.SP) [pdf, other]
Title: Exploring Sensing Devices for Heart and Lung Sound Monitoring
Yasaman Torabi, Shahram Shirani, James P. Reilly
Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[449] arXiv:2406.12434 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Audio Codec-based Speech Separation
Jia Qi Yip, Shengkui Zhao, Dianwen Ng, Eng Siong Chng, Bin Ma
Comments: This paper was accepted by Interspeech 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[450] arXiv:2406.12544 (cross-list from cs.HC) [pdf, html, other]
Title: Integrating Representational Gestures into Automatically Generated Embodied Explanations and its Effects on Understanding and Interaction Quality
Amelie Sophie Robrecht, Hendric Voss, Lisa Gottschalk, Stefan Kopp
Subjects: Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[451] arXiv:2406.12611 (cross-list from cs.SD) [pdf, html, other]
Title: Rapid Language Adaptation for Multilingual E2E Speech Recognition Using Encoder Prompting
Yosuke Kashiwagi, Hayato Futami, Emiru Tsunoo, Siddhant Arora, Shinji Watanabe
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[452] arXiv:2406.12699 (cross-list from cs.SD) [pdf, html, other]
Title: Bridging the Gap: Integrating Pre-trained Speech Enhancement and Recognition Models for Robust Speech Recognition
Kuan-Chen Wang, You-Jin Li, Wei-Lun Chen, Yu-Wen Chen, Yi-Ching Wang, Ping-Cheng Yeh, Chao Zhang, Yu Tsao
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[453] arXiv:2406.12707 (cross-list from cs.CL) [pdf, html, other]
Title: Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction
Haoqiu Yan, Yongxin Zhu, Kai Zheng, Bing Liu, Haoyu Cao, Deqiang Jiang, Linli Xu
Comments: 9 pages, 3 figures, ACL24 accepted
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[454] arXiv:2406.12726 (cross-list from cs.SD) [pdf, html, other]
Title: ED-sKWS: Early-Decision Spiking Neural Networks for Rapid,and Energy-Efficient Keyword Spotting
Zeyang Song, Qianhui Liu, Qu Yang, Yizhou Peng, Haizhou Li
Comments: Accepted by INTERSPEECH2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[455] arXiv:2406.13179 (cross-list from cs.SD) [pdf, html, other]
Title: Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting
Shuai Wang, Dehao Zhang, Kexin Shi, Yuchen Wang, Wenjie Wei, Jibin Wu, Malu Zhang
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)
[456] arXiv:2406.13275 (cross-list from cs.SD) [pdf, html, other]
Title: Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding
Jizhong Liu, Gang Li, Junbo Zhang, Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Yujun Wang, Bin Wang
Comments: Accepted by Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[457] arXiv:2406.13340 (cross-list from cs.CL) [pdf, html, other]
Title: SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words
Junyi Ao, Yuancheng Wang, Xiaohai Tian, Dekun Chen, Jun Zhang, Lu Lu, Yuxuan Wang, Haizhou Li, Zhizheng Wu
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[458] arXiv:2406.13357 (cross-list from cs.CL) [pdf, html, other]
Title: Transferable speech-to-text large language model alignment module
Boyong Wu, Chao Yan, Haoran Pu
Comments: Accepted by InterSpeech 2024; 5 pages, 2 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[459] arXiv:2406.13384 (cross-list from cs.SD) [pdf, html, other]
Title: Straight Through Gumbel Softmax Estimator based Bimodal Neural Architecture Search for Audio-Visual Deepfake Detection
Aravinda Reddy PN, Raghavendra Ramachandra, Krothapalli Sreenivasa Rao, Pabitra Mitra, Vinod Rathod
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[460] arXiv:2406.13431 (cross-list from cs.CL) [pdf, html, other]
Title: Children's Speech Recognition through Discrete Token Enhancement
Vrunda N. Sukhadia, Shammur Absar Chowdhury
Comments: Accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[461] arXiv:2406.13470 (cross-list from eess.SP) [pdf, html, other]
Title: Automatic Voice Classification Of Autistic Subjects
Jessica Vacca, Natascia Brondino, Fabio Dell'Acqua, Anna Vizziello, Pietro Savazzi
Comments: Accepted for publication at EAI BODYNETS 2023 2024 - 18th EAI International Conference on Body Area Networks: Intelligent Edge Cloud for Dependable Globally Connected BAN, February 5-6, 2024 Milan, Italy
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[462] arXiv:2406.13502 (cross-list from cs.CL) [pdf, html, other]
Title: ManWav: The First Manchu ASR Model
Jean Seo, Minha Kang, Sungjoo Byun, Sangah Lee
Comments: ACL2024/Field Matters
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[463] arXiv:2406.13579 (cross-list from cs.SD) [pdf, other]
Title: Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data
Michael Doell, Dominik Kuehn, Vanessa Suessle, Matthew J. Burnett, Colleen T. Downs, Andreas Weinmann, Elke Hergenroether
Comments: preprint
Journal-ref: International Conferences in Central Europe on Computer Graphics, Visualization and Computer Vision 2024
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[464] arXiv:2406.13842 (cross-list from cs.CL) [pdf, html, other]
Title: Joint vs Sequential Speaker-Role Detection and Automatic Speech Recognition for Air-traffic Control
Alexander Blatt, Aravind Krishnan, Dietrich Klakow
Comments: Accepted at Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[465] arXiv:2406.13982 (cross-list from cs.SD) [pdf, html, other]
Title: Improved Remixing Process for Domain Adaptation-Based Speech Enhancement by Mitigating Data Imbalance in Signal-to-Noise Ratio
Li Li, Shogo Seki
Comments: Accepted at Interspeech2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[466] arXiv:2406.14092 (cross-list from cs.CL) [pdf, html, other]
Title: Seamless Language Expansion: Enhancing Multilingual Mastery in Self-Supervised Models
Jing Xu, Minglin Wu, Xixin Wu, Helen Meng
Comments: Accepted by Interspeech 2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[467] arXiv:2406.14176 (cross-list from cs.SD) [pdf, html, other]
Title: A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection
Kyungbok Lee, You Zhang, Zhiyao Duan
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[468] arXiv:2406.14177 (cross-list from cs.CL) [pdf, html, other]
Title: SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation
Sara Papi, Marco Gaido, Matteo Negri, Luisa Bentivogli
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[469] arXiv:2406.14294 (cross-list from cs.SD) [pdf, html, other]
Title: DASB - Discrete Audio and Speech Benchmark
Pooneh Mousavi, Luca Della Libera, Jarod Duret, Artem Ploujnikov, Cem Subakan, Mirco Ravanelli
Comments: 9 pages, 5 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[470] arXiv:2406.14333 (cross-list from cs.IR) [pdf, html, other]
Title: LARP: Language Audio Relational Pre-training for Cold-Start Playlist Continuation
Rebecca Salganik, Xiaohao Liu, Yunshan Ma, Jian Kang, Tat-Seng Chua
Subjects: Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[471] arXiv:2406.14464 (cross-list from cs.SD) [pdf, html, other]
Title: A Review of Common Online Speaker Diarization Methods
Roman Aperdannier, Sigurd Schacht, Alexander Piazza
Comments: 6 pages
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[472] arXiv:2406.14485 (cross-list from cs.AI) [pdf, other]
Title: Proceedings of The second international workshop on eXplainable AI for the Arts (XAIxArts)
Nick Bryan-Kinns, Corey Ford, Shuoyang Zheng, Helen Kennedy, Alan Chamberlain, Makayla Lewis, Drew Hemment, Zijin Li, Qiong Wu, Lanxi Xiao, Gus Xia, Jeba Rezwana, Michael Clemens, Gabriel Vigliensoni
Comments: Proceedings of The second international workshop on eXplainable AI for the Arts (XAIxArts)
Subjects: Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[473] arXiv:2406.14559 (cross-list from cs.SD) [pdf, html, other]
Title: Disentangled Representation Learning for Environment-agnostic Speaker Recognition
KiHyun Nam, Hee-Soo Heo, Jee-weon Jung, Joon Son Chung
Comments: Interspeech 2024. The official webpage can be found at this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[474] arXiv:2406.14686 (cross-list from cs.CL) [pdf, html, other]
Title: A Contrastive Learning Approach to Mitigate Bias in Speech Models
Alkis Koudounas, Flavio Giobergia, Eliana Pastor, Elena Baralis
Comments: Accepted at Interspeech 2024
Journal-ref: Proc. Interspeech 2024, 827-831
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[475] arXiv:2406.14701 (cross-list from cs.AI) [pdf, html, other]
Title: Speech Prefix-Tuning with RNNT Loss for Improving LLM Predictions
Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Neeraj Gaur, Zhong Meng
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[476] arXiv:2406.14875 (cross-list from cs.SD) [pdf, html, other]
Title: GLOBE: A High-quality English Corpus with Global Accents for Zero-shot Speaker Adaptive Text-to-Speech
Wenbin Wang, Yang Song, Sanjay Jha
Comments: Interspeech 2024, 4 pages, 3 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[477] arXiv:2406.14890 (cross-list from cs.CL) [pdf, html, other]
Title: InterBiasing: Boost Unseen Word Recognition through Biasing Intermediate Predictions
Yu Nakagome, Michael Hentschel
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[478] arXiv:2406.15119 (cross-list from cs.SD) [pdf, html, other]
Title: Speech Emotion Recognition under Resource Constraints with Data Distillation
Yi Chang, Zhao Ren, Zhonghao Zhao, Thanh Tam Nguyen, Kun Qian, Tanja Schultz, Björn W. Schuller
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[479] arXiv:2406.15249 (cross-list from cs.SD) [pdf, html, other]
Title: Machine Learning Techniques in Automatic Music Transcription: A Systematic Survey
Fatemeh Jamshidi, Gary Pike, Amit Das, Richard Chapman
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[480] arXiv:2406.15284 (cross-list from cs.CL) [pdf, html, other]
Title: The Greek podcast corpus: Competitive speech models for low-resourced languages with weakly supervised data
Georgios Paraskevopoulos, Chara Tsoukala, Athanasios Katsamanis, Vassilis Katsouros
Comments: To be presented at Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[481] arXiv:2406.15487 (cross-list from cs.CL) [pdf, other]
Title: Improving Text-To-Audio Models with Synthetic Captions
Zhifeng Kong, Sang-gil Lee, Deepanway Ghosal, Navonil Majumder, Ambuj Mehrish, Rafael Valle, Soujanya Poria, Bryan Catanzaro
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[482] arXiv:2406.15516 (cross-list from cs.CL) [pdf, html, other]
Title: System Description for the Displace Speaker Diarization Challenge 2023
Ali Aliyev
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[483] arXiv:2406.15537 (cross-list from q-bio.NC) [pdf, html, other]
Title: R&B -- Rhythm and Brain: Cross-subject Decoding of Music from Human Brain Activity
Matteo Ferrante, Matteo Ciferri, Nicola Toschi
Comments: The first two authors contributed equally to this work
Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[484] arXiv:2406.15647 (cross-list from cs.SD) [pdf, html, other]
Title: Generating Music with Structure Using Self-Similarity as Attention
Sophia Hager, Kathleen Hablutzel, Katherine M. Kinnaird
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[485] arXiv:2406.15668 (cross-list from cs.CL) [pdf, html, other]
Title: PI-Whisper: An Adaptive and Incremental ASR Framework for Diverse and Evolving Speaker Characteristics
Amir Nassereldine, Dancheng Liu, Chenhui Xu, Jinjun Xiong
Comments: 11 pages, 3 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[486] arXiv:2406.15723 (cross-list from cs.CL) [pdf, html, other]
Title: Acoustic Feature Mixup for Balanced Multi-aspect Pronunciation Assessment
Heejin Do, Wonjun Lee, Gary Geunbae Lee
Comments: Interspeech 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[487] arXiv:2406.15751 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Data
Yu-Hua Chen, Woosung Choi, Wei-Hsiang Liao, Marco Martínez-Ramírez, Kin Wai Cheuk, Yuki Mitsufuji, Jyh-Shing Roger Jang, Yi-Hsuan Yang
Comments: Accepted to DAFx 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[488] arXiv:2406.15754 (cross-list from cs.CV) [pdf, html, other]
Title: Multimodal Segmentation for Vocal Tract Modeling
Rishi Jain, Bohan Yu, Peter Wu, Tejas Prabhune, Gopala Anumanchipalli
Comments: Interspeech 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[489] arXiv:2406.15846 (cross-list from cs.CL) [pdf, html, other]
Title: Revisiting Interpolation Augmentation for Speech-to-Text Generation
Chen Xu, Jie Wang, Xiaoqian Liu, Qianqian Dong, Chunliang Zhang, Tong Xiao, Jingbo Zhu, Dapeng Man, Wu Yang
Comments: ACL 2024 Findings
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[490] arXiv:2406.15875 (cross-list from cs.SD) [pdf, html, other]
Title: AI-based Drone Assisted Human Rescue in Disaster Environments: Challenges and Opportunities
Narek Papyan, Michel Kulhandjian, Hovannes Kulhandjian, Levon Hakob Aslanyan
Journal-ref: Pattern Recognit. Image Anal. 34 (2024)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[491] arXiv:2406.15885 (cross-list from cs.SD) [pdf, html, other]
Title: The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models
Jiajia Li, Lu Yang, Mingni Tang, Cong Chen, Zuchao Li, Ping Wang, Hai Zhao
Comments: Accepted to ACL-Findings 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[492] arXiv:2406.15888 (cross-list from cs.CL) [pdf, html, other]
Title: Real-time Speech Summarization for Medical Conversations
Khai Le-Duc, Khai-Nguyen Nguyen, Long Vo-Dang, Truong-Son Hy
Comments: Interspeech 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[493] arXiv:2406.16000 (cross-list from cs.SD) [pdf, html, other]
Title: Predicting Individual Depression Symptoms from Acoustic Features During Speech
Sebastian Rodriguez, Sri Harsha Dumpala, Katerina Dikaios, Sheri Rempel, Rudolf Uher, Sageev Oore
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[494] arXiv:2406.16020 (cross-list from cs.SD) [pdf, html, other]
Title: AudioBench: A Universal Benchmark for Audio Large Language Models
Bin Wang, Xunlong Zou, Geyu Lin, Shuo Sun, Zhuohan Liu, Wenyu Zhang, Zhengyuan Liu, AiTi Aw, Nancy F. Chen
Comments: v4 - Add acknowledgment and slight update on structure; Code: this https URL
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[495] arXiv:2406.16099 (cross-list from cs.SD) [pdf, html, other]
Title: Speech Representation Analysis based on Inter- and Intra-Model Similarities
Yassine El Kheir, Ahmed Ali, Shammur Absar Chowdhury
Comments: 5 pages, Accepted to appear in ICASSP XAI-SA Workshop
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[496] arXiv:2406.16148 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Open Respiratory Acoustic Foundation Models: Pretraining and Benchmarking
Yuwei Zhang, Tong Xia, Jing Han, Yu Wu, Georgios Rizos, Yang Liu, Mohammed Mosuily, Jagmohan Chauhan, Cecilia Mascolo
Comments: accepted by NeurIPS 2024 Track Datasets and Benchmarks
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[497] arXiv:2406.16155 (cross-list from cs.SD) [pdf, html, other]
Title: Listen and Move: Improving GANs Coherency in Agnostic Sound-to-Video Generation
Rafael Redondo
Comments: Full paper of the homonym paper published in the ICCV 2023 workshop "AV4D: Visual Learning of Sounds in Spaces"
Journal-ref: Abstract version published in the ICCV 2023 workshop "AV4D: Visual Learning of Sounds in Spaces"
Subjects: Sound (cs.SD); Graphics (cs.GR); Audio and Speech Processing (eess.AS)
[498] arXiv:2406.16317 (cross-list from cs.SD) [pdf, other]
Title: SNR-Progressive Model with Harmonic Compensation for Low-SNR Speech Enhancement
Zhongshu Hou, Tong Lei, Qinwen Hu, Zhanzhong Cao, Ming Tang, Jing Lu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[499] arXiv:2406.16751 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Zero-Shot Text-To-Speech for Arabic Dialects
Khai Duy Doan, Abdul Waheed, Muhammad Abdul-Mageed
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[500] arXiv:2406.16808 (cross-list from cs.SD) [pdf, html, other]
Title: Exploring the Capability of Mamba in Speech Applications
Koichi Miyazaki, Yoshiki Masuyama, Masato Murata
Comments: Accepted at Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[501] arXiv:2406.16877 (cross-list from eess.SP) [pdf, html, other]
Title: Rational-Exponent Filters with Applications to Generalized Auditory Filterbanks
Samiya A Alkhairy
Comments: 14 pages, 9 figures, 2 tables, 32 equations. Submitted to IEEE TCAS-I
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)
[502] arXiv:2406.16990 (cross-list from cs.SD) [pdf, html, other]
Title: AND: Audio Network Dissection for Interpreting Deep Acoustic Models
Tung-Yu Wu, Yu-Xiang Lin, Tsui-Wei Weng
Comments: Accepted by ICML'24
Journal-ref: Forty-first International Conference on Machine Learning (2024)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[503] arXiv:2406.17103 (cross-list from cs.SD) [pdf, html, other]
Title: Maximum Likelihood Estimation of the Direction of Sound In A Reverberant Noisy Environment
Mohamed F. Mansour
Comments: 5 pages, 2 figures, conference
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[504] arXiv:2406.17111 (cross-list from cs.SD) [pdf, html, other]
Title: Sound Field Synthesis with Acoustic Waves
Mohamed F. Mansour
Comments: 17 pages, double-spaced, 5 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[505] arXiv:2406.17124 (cross-list from cs.SD) [pdf, html, other]
Title: Investigating Confidence Estimation Measures for Speaker Diarization
Anurag Chowdhury, Abhinav Misra, Mark C. Fuhs, Monika Woszczyna
Comments: Accepted in INTERSPEECH 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[506] arXiv:2406.17190 (cross-list from cs.SD) [pdf, html, other]
Title: Sound Tagging in Infant-centric Home Soundscapes
Mohammad Nur Hossain Khan, Jialu Li, Nancy L. McElwain, Mark Hasegawa-Johnson, Bashima Islam
Comments: Accepted in IEEE/ACM CHASE 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[507] arXiv:2406.17229 (cross-list from cs.SD) [pdf, html, other]
Title: Self-Supervised Embeddings for Detecting Individual Symptoms of Depression
Sri Harsha Dumpala, Katerina Dikaios, Abraham Nunes, Frank Rudzicz, Rudolf Uher, Sageev Oore
Comments: Accepted at INTERSPEECH 2024
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[508] arXiv:2406.17246 (cross-list from cs.SD) [pdf, html, other]
Title: Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing
Hye-jin Shim, Md Sahidullah, Jee-weon Jung, Shinji Watanabe, Tomi Kinnunen
Comments: 5 pages, 1 figure, 5 tables, ISCA Interspeech 2024 SynData4GenAI Workshop
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[509] arXiv:2406.17257 (cross-list from cs.CL) [pdf, html, other]
Title: Leveraging Parameter-Efficient Transfer Learning for Multi-Lingual Text-to-Speech Adaptation
Yingting Li, Ambuj Mehrish, Bryan Chew, Bo Cheng, Soujanya Poria
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[510] arXiv:2406.17329 (cross-list from eess.SP) [pdf, html, other]
Title: Speaker-Independent Acoustic-to-Articulatory Inversion through Multi-Channel Attention Discriminator
Woo-Jin Chung, Hong-Goo Kang
Comments: Accepted to INTERSPEECH 2024
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS); Biological Physics (physics.bio-ph)
[511] arXiv:2406.17363 (cross-list from cs.CL) [pdf, html, other]
Title: Leveraging Synthetic Audio Data for End-to-End Low-Resource Speech Translation
Yasmin Moslem
Comments: IWSLT 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[512] arXiv:2406.17376 (cross-list from cs.SD) [pdf, html, other]
Title: Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection
Duc-Tuan Truong, Ruijie Tao, Tuan Nguyen, Hieu-Thi Luong, Kong Aik Lee, Eng Siong Chng
Comments: Accepted by INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[513] arXiv:2406.17430 (cross-list from cs.CL) [pdf, html, other]
Title: Towards Probing Speech-Specific Risks in Large Multimodal Models: A Taxonomy, Benchmark, and Insights
Hao Yang, Lizhen Qu, Ehsan Shareghi, Gholamreza Haffari
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[514] arXiv:2406.17667 (cross-list from cs.SD) [pdf, html, other]
Title: This Paper Had the Smartest Reviewers -- Flattery Detection Utilising an Audio-Textual Transformer-Based Approach
Lukas Christ, Shahin Amiriparian, Friederike Hawighorst, Ann-Kathrin Schill, Angelo Boutalikakis, Lorenz Graf-Vlachy, Andreas König, Björn W. Schuller
Comments: Interspeech 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[515] arXiv:2406.17672 (cross-list from cs.SD) [pdf, html, other]
Title: SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond
Marco Comunità, Zhi Zhong, Akira Takahashi, Shiqi Yang, Mengjie Zhao, Koichi Saito, Yukara Ikemiya, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
Comments: 6 pages, 8 figures, 8 tables. Audio samples: this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[516] arXiv:2406.17722 (cross-list from cs.SD) [pdf, html, other]
Title: Spatial Voice Conversion: Voice Conversion Preserving Spatial Information and Non-target Signals
Kentaro Seki, Shinnosuke Takamichi, Norihiro Takamune, Yuki Saito, Kanami Imamura, Hiroshi Saruwatari
Comments: Accepted to Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[517] arXiv:2406.17800 (cross-list from q-bio.QM) [pdf, html, other]
Title: Fish Tracking, Counting, and Behaviour Analysis in Digital Aquaculture: A Comprehensive Review
Meng Cui, Xubo Liu, Haohe Liu, Jinzheng Zhao, Daoliang Li, Wenwu Wang
Subjects: Quantitative Methods (q-bio.QM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[518] arXiv:2406.17801 (cross-list from cs.SD) [pdf, html, other]
Title: A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge
Xiaopeng Wang, Yi Lu, Xin Qi, Zhiyong Wang, Yuankun Xie, Shuchen Shi, Ruibo Fu
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[519] arXiv:2406.17825 (cross-list from cs.CL) [pdf, other]
Title: Automatic speech recognition for the Nepali language using CNN, bidirectional LSTM and ResNet
Manish Dhakal, Arman Chhetri, Aman Kumar Gupta, Prabin Lamichhane, Suraj Pandey, Subarna Shakya
Comments: Accepted at 2022 International Conference on Inventive Computation Technologies (ICICT), IEEE
Journal-ref: 2022 International Conference on Inventive Computation Technologies (ICICT), pp. 515-521
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[520] arXiv:2406.17926 (cross-list from cs.CL) [pdf, html, other]
Title: FASA: a Flexible and Automatic Speech Aligner for Extracting High-quality Aligned Children Speech Data
Dancheng Liu, Jinjun Xiong
Comments: 4 pages, 1 figure
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[521] arXiv:2406.17932 (cross-list from cs.RO) [pdf, html, other]
Title: SonicSense: Object Perception from In-Hand Acoustic Vibration
Jiaxun Liu, Boyuan Chen
Comments: Our project website is at: this http URL
Subjects: Robotics (cs.RO); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[522] arXiv:2406.17935 (cross-list from cs.CL) [pdf, html, other]
Title: Sequential Editing for Lifelong Training of Speech Recognition Models
Devang Kulshreshtha, Saket Dingliwal, Brady Houston, Nikolaos Pappas, Srikanth Ronanki
Comments: INTERSPEECH 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[523] arXiv:2406.17957 (cross-list from cs.SD) [pdf, html, other]
Title: Improving Robustness of LLM-based Speech Synthesis by Learning Monotonic Alignment
Paarth Neekhara, Shehzeen Hussain, Subhankar Ghosh, Jason Li, Rafael Valle, Rohan Badlani, Boris Ginsburg
Comments: Published as a conference paper at INTERSPEECH 2024
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[524] arXiv:2406.18021 (cross-list from cs.SD) [pdf, html, other]
Title: SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR
Shuaishuai Ye, Shunfei Chen, Xinhui Hu, Xinkang Xu
Comments: Accepted by InterSpeech 2024; 5 pages, 2 figures
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[525] arXiv:2406.18067 (cross-list from cs.CL) [pdf, html, other]
Title: Exploring Energy-Based Models for Out-of-Distribution Detection in Dialect Identification
Yaqian Hao, Chenguang Hu, Yingying Gao, Shilei Zhang, Junlan Feng
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[526] arXiv:2406.18088 (cross-list from cs.CL) [pdf, html, other]
Title: LLM-Driven Multimodal Opinion Expression Identification
Bonian Jia, Huiyao Chen, Yueheng Sun, Meishan Zhang, Min Zhang
Comments: 5 pages, 3 Figures, Accept by Interspeech 2024
Journal-ref: Proceedings of Interspeech 2024
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[527] arXiv:2406.18089 (cross-list from cs.SD) [pdf, html, other]
Title: A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons
Tzu-Yun Hung, Jui-Te Wu, Yu-Chia Kuo, Yo-Wei Hsiao, Ting-Wei Lin, Li Su
Comments: 15 pages, 2 figures, 3 tables
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[528] arXiv:2406.18108 (cross-list from cs.CL) [pdf, html, other]
Title: Token-Weighted RNN-T for Learning from Flawed Data
Gil Keren, Wei Zhou, Ozlem Kalinli
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[529] arXiv:2406.18135 (cross-list from cs.CL) [pdf, other]
Title: Automatic Speech Recognition for Hindi
Anish Saha, A.G. Ramakrishnan
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[530] arXiv:2406.18313 (cross-list from cs.SD) [pdf, html, other]
Title: Advancing Airport Tower Command Recognition: Integrating Squeeze-and-Excitation and Broadcasted Residual Learning
Yuanxi Lin, Tonglin Zhou, Yang Xiao
Comments: Accepted by IALP 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[531] arXiv:2406.18373 (cross-list from cs.CL) [pdf, html, other]
Title: Dynamic Data Pruning for Automatic Speech Recognition
Qiao Xiao, Pingchuan Ma, Adriana Fernandez-Lopez, Boqian Wu, Lu Yin, Stavros Petridis, Mykola Pechenizkiy, Maja Pantic, Decebal Constantin Mocanu, Shiwei Liu
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[532] arXiv:2406.18621 (cross-list from cs.SD) [pdf, html, other]
Title: Towards Deep Active Learning in Avian Bioacoustics
Lukas Rauch, Denis Huseljic, Moritz Wirth, Jens Decke, Bernhard Sick, Christoph Scholz
Comments: accepted at IAL@ECML-PKDD24
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[533] arXiv:2406.18625 (cross-list from cs.SD) [pdf, html, other]
Title: Automatic Prediction of Amyotrophic Lateral Sclerosis Progression using Longitudinal Speech Transformer
Liming Wang, Yuan Gong, Nauman Dawalatabad, Marco Vilela, Katerina Placek, Brian Tracey, Yishu Gong, Alan Premasiri, Fernando Vieira, James Glass
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[534] arXiv:2406.18747 (cross-list from cs.SD) [pdf, html, other]
Title: A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stems
Karn N. Watcharasupat, Alexander Lerch
Comments: Accepted to the 25th International Society for Music Information Retrieval Conference (ISMIR 2024). Camera-ready version
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[535] arXiv:2406.18862 (cross-list from cs.SD) [pdf, html, other]
Title: Streaming Decoder-Only Automatic Speech Recognition with Discrete Speech Units: A Pilot Study
Peikun Chen, Sining Sun, Changhao Shan, Qing Yang, Lei Xie
Comments: Accepted for Interspeech 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[536] arXiv:2406.18910 (cross-list from cs.CL) [pdf, html, other]
Title: Factor-Conditioned Speaking-Style Captioning
Atsushi Ando, Takafumi Moriya, Shota Horiguchi, Ryo Masumura
Comments: Accepted to Interspeech 2024
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[537] arXiv:2406.18928 (cross-list from cs.SD) [pdf, html, other]
Title: Enhanced ASR Robustness to Packet Loss with a Front-End Adaptation Network
Yehoshua Dissen, Shiry Yonash, Israel Cohen, Joseph Keshet
Comments: Accepted for publication at INTERSPEECH 2024
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[538] arXiv:2406.19243 (cross-list from cs.SD) [pdf, html, other]
Title: Application of ASV for Voice Identification after VC and Duration Predictor Improvement in TTS Models
Borodin Kirill Nikolayevich, Kudryavtsev Vasiliy Dmitrievich, Mkrtchian Grach Maratovich, Gorodnichev Mikhail Genadievich, Korzh Dmitrii Sergeevich
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[539] arXiv:2406.19311 (cross-list from cs.CR) [pdf, html, other]
Title: Zero-Query Adversarial Attack on Black-box Automatic Speech Recognition Systems
Zheng Fang, Tao Wang, Lingchen Zhao, Shenyi Zhang, Bowen Li, Yunjie Ge, Qi Li, Chao Shen, Qian Wang
Comments: To appear in the Proceedings of The ACM Conference on Computer and Communications Security (CCS), 2024
Subjects: Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[540] arXiv:2406.19328 (cross-list from cs.SD) [pdf, html, other]
Title: Subtractive Training for Music Stem Insertion using Latent Diffusion Models
Ivan Villa-Renteria, Mason L. Wang, Zachary Shah, Zhe Li, Soohyun Kim, Neelesh Ramachandran, Mert Pilanci
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[541] arXiv:2406.19388 (cross-list from cs.SD) [pdf, html, other]
Title: Taming Data and Transformers for Audio Generation
Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Sergey Tulyakov, Vicente Ordonez
Comments: Project Webpage: this https URL
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[542] arXiv:2406.19464 (cross-list from cs.RO) [pdf, html, other]
Title: ManiWAV: Learning Robot Manipulation from In-the-Wild Audio-Visual Data
Zeyi Liu, Cheng Chi, Eric Cousineau, Naveen Kuppuswamy, Benjamin Burchfiel, Shuran Song
Comments: Conference on Robot Learning (CoRL) 2024; Project website: this https URL
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[543] arXiv:2406.19589 (cross-list from cs.SD) [pdf, html, other]
Title: Network Bending of Diffusion Models for Audio-Visual Generation
Luke Dzwonczyk, Carmine Emanuele Cella, David Ban
Comments: 8 pages, 5 figures, to be published in the proceedings of the 27th International Conference on Digital Audio Effects (DAFx24), for additional image and video examples see this https URL
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[544] arXiv:2406.19674 (cross-list from cs.CL) [pdf, html, other]
Title: Less is More: Accurate Speech Recognition & Translation without Web-Scale Data
Krishna C. Puvvada, Piotr Żelasko, He Huang, Oleksii Hrinchuk, Nithin Rao Koluguri, Kunal Dhawan, Somshubra Majumdar, Elena Rastorgueva, Zhehuai Chen, Vitaly Lavrukhin, Jagadeesh Balam, Boris Ginsburg
Comments: Accepted at Interspeech-2024
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[545] arXiv:2406.19706 (cross-list from cs.SD) [pdf, html, other]
Title: SAML: Speaker Adaptive Mixture of LoRA Experts for End-to-End ASR
Qiuming Zhao, Guangzhi Sun, Chao Zhang, Mingxing Xu, Thomas Fang Zheng
Comments: 5 pages, accepted by Interspeech 2024. arXiv admin note: substantial text overlap with arXiv:2309.09136
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[546] arXiv:2406.19954 (cross-list from cs.CL) [pdf, html, other]
Title: BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5
Zhehuai Chen, He Huang, Oleksii Hrinchuk, Krishna C. Puvvada, Nithin Rao Koluguri, Piotr Żelasko, Jagadeesh Balam, Boris Ginsburg
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[547] arXiv:2406.19959 (cross-list from cs.SD) [pdf, html, other]
Title: RealMAN: A Real-Recorded and Annotated Microphone Array Dataset for Dynamic Speech Enhancement and Localization
Bing Yang, Changsheng Quan, Yabo Wang, Pengyu Wang, Yujie Yang, Ying Fang, Nian Shao, Hui Bu, Xin Xu, Xiaofei Li
Comments: accepted by NIPS 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 547 entries
Showing up to 2000 entries per page: fewer | more | all