Audio and Speech Processing

Authors and titles for June 2024

[91] arXiv:2406.05983 [pdf, html, other]

Title: Separate and Reconstruct: Asymmetric Encoder-Decoder for Speech Separation

Ui-Hyeop Shin, Sangyoun Lee, Taehan Kim, Hyung-Min Park

Comments: Accepted to NeurIPS 2024; Project Page: this https URL

Subjects: Audio and Speech Processing (eess.AS)

[92] arXiv:2406.06111 [pdf, html, other]

Title: JenGAN: Stacked Shifted Filters in GAN-Based Speech Synthesis

Hyunjae Cho, Junhyeok Lee, Wonbin Jung

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[93] arXiv:2406.06160 [pdf, html, other]

Title: The Effect of Training Dataset Size on Discriminative and Diffusion-Based Speech Enhancement Systems

Philippe Gonzalez, Zheng-Hua Tan, Jan Østergaard, Jesper Jensen, Tommy Sonne Alstrøm, Tobias May

Comments: Accepted version

Subjects: Audio and Speech Processing (eess.AS)

[94] arXiv:2406.06185 [pdf, html, other]

Title: EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation

Julius Richter, Yi-Chiao Wu, Steven Krenn, Simon Welker, Bunlong Lay, Shinji Watanabe, Alexander Richard, Timo Gerkmann

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[95] arXiv:2406.06220 [pdf, html, other]

Title: Label-Looping: Highly Efficient Decoding for Transducers

Vladimir Bataev, Hainan Xu, Daniel Galvez, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted at IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[96] arXiv:2406.06251 [pdf, html, other]

Title: Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning

Chung-Ming Chien, Andros Tjandra, Apoorv Vyas, Matt Le, Bowen Shi, Wei-Ning Hsu

Comments: Accepted by InterSpeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[97] arXiv:2406.06293 [pdf, html, other]

Title: Sample Rate Independent Recurrent Neural Networks for Audio Effects Processing

Alistair Carson, Alec Wright, Jatin Chowdhury, Vesa Välimäki, Stefan Bilbao

Comments: Accepted for publication in Proc. DAFx24, Guildford, UK, September 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[98] arXiv:2406.06619 [pdf, html, other]

Title: LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR

Zheshu Song, Jianheng Zhuo, Yifan Yang, Ziyang Ma, Shixiong Zhang, Xie Chen

Comments: 5 pages, 2 figures, conference

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[99] arXiv:2406.06634 [pdf, html, other]

Title: Sparse Binarization for Fast Keyword Spotting

Jonathan Svirsky, Uri Shaham, Ofir Lindenbaum

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[100] arXiv:2406.06646 [pdf, html, other]

Title: Emotion-Aware Speech Self-Supervised Representation Learning with Intensity Knowledge

Rui Liu, Zening Ma

Comments: Accepted by InterSpeech2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[101] arXiv:2406.06664 [pdf, html, other]

Title: ASTRA: Aligning Speech and Text Representations for Asr without Sampling

Neeraj Gaur, Rohan Agrawal, Gary Wang, Parisa Haghani, Andrew Rosenberg, Bhuvana Ramabhadran

Comments: To be published in Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[102] arXiv:2406.06774 [pdf, html, other]

Title: ComFeAT: Combination of Neural and Spectral Features for Improved Depression Detection

Orchid Chetia Phukan, Sarthak Jain, Shubham Singh, Muskaan Singh, Arun Balaji Buduru, Rajesh Sharma

Comments: Accepted to INTERSPEECH 2024 Show & Tell Demonstrations

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[103] arXiv:2406.06781 [pdf, html, other]

Title: PERSONA: An Application for Emotion Recognition, Gender Recognition and Age Estimation

Devyani Koshal, Orchid Chetia Phukan, Sarthak Jain, Arun Balaji Buduru, Rajesh Sharma

Comments: Accepted to INTERSPEECH 2024 Show & Tell Demonstrations

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[104] arXiv:2406.06798 [pdf, html, other]

Title: The Reasonable Effectiveness of Speaker Embeddings for Violence Detection

Sarthak Jain, Orchid Chetia Phukan, Arun Balaji Buduru, Rajesh Sharma

Comments: Accepted to INTERSPEECH 24 Show & Tell Demonstrations

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[105] arXiv:2406.07090 [pdf, html, other]

Title: Spoken Language Corpora Augmentation with Domain-Specific Voice-Cloned Speech

Mateusz Czyżnikiewicz, Łukasz Bondaruk, Jakub Kubiak, Adam Wiącek, Łukasz Degórski, Marek Kubis, Paweł Skórzewski

Comments: Accepted to FedCSIS 2024

Subjects: Audio and Speech Processing (eess.AS)

[106] arXiv:2406.07096 [pdf, html, other]

Title: Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter

Andrei Andrusenko, Aleksandr Laptev, Vladimir Bataev, Vitaly Lavrukhin, Boris Ginsburg

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[107] arXiv:2406.07103 [pdf, html, other]

Title: MR-RawNet: Speaker verification system with multiple temporal resolutions for variable duration utterances using raw waveforms

Seung-bin Kim, Chan-yeong Lim, Jungwoo Heo, Ju-ho Kim, Hyun-seo Shin, Kyo-Won Koo, Ha-Jin Yu

Comments: 5 pages, accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[108] arXiv:2406.07133 [pdf, html, other]

Title: Translating speech with just images

Dan Oneata, Herman Kamper

Comments: Accepted at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[109] arXiv:2406.07198 [pdf, html, other]

Title: Target Speech Diarization with Multimodal Prompts

Yidi Jiang, Ruijie Tao, Zhengyang Chen, Yanmin Qian, Haizhou Li

Comments: 13 pages, 7 figures

Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM)

[110] arXiv:2406.07237 [pdf, html, other]

Title: CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems

Haibin Wu, Yuan Tseng, Hung-yi Lee

Comments: Accepted to Interspeech 2024, project page: this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[111] arXiv:2406.07250 [pdf, html, other]

Title: Description and Discussion on DCASE 2024 Challenge Task 2: First-Shot Unsupervised Anomalous Sound Detection for Machine Condition Monitoring

Tomoya Nishida, Noboru Harada, Daisuke Niizumi, Davide Albertini, Roberto Sannino, Simone Pradolini, Filippo Augusti, Keisuke Imoto, Kota Dohi, Harsh Purohit, Takashi Endo, Yohei Kawaguchi

Comments: anomaly detection, acoustic condition monitoring, domain shift, first-shot problem, DCASE Challenge. arXiv admin note: text overlap with arXiv:2305.07828

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[112] arXiv:2406.07310 [pdf, html, other]

Title: MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

Zhiqi Ai, Zhiyong Chen, Shugong Xu

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[113] arXiv:2406.07410 [pdf, html, other]

Title: Clever Hans Effect Found in Automatic Detection of Alzheimer's Disease through Speech

Yin-Long Liu, Rui Feng, Jia-Hong Yuan, Zhen-Hua Ling

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS)

[114] arXiv:2406.07422 [pdf, html, other]

Title: Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation

Hanzhao Li, Liumeng Xue, Haohan Guo, Xinfa Zhu, Yuanjun Lv, Lei Xie, Yunlin Chen, Hao Yin, Zhifei Li

Comments: Accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS)

[115] arXiv:2406.07461 [pdf, html, other]

Title: Noise-robust Speech Separation with Fast Generative Correction

Helin Wang, Jesus Villalba, Laureano Moro-Velazquez, Jiarui Hai, Thomas Thebaud, Najim Dehak

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS)