Audio and Speech Processing

Authors and titles for June 2024

[131] arXiv:2406.08266 [pdf, html, other]

Title: Refining Self-Supervised Learnt Speech Representation using Brain Activations

Hengyu Li, Kangdi Mei, Zhaoci Liu, Yang Ai, Liping Chen, Jie Zhang, Zhenhua Ling

Comments: accpeted by Interspeech2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[132] arXiv:2406.08328 [pdf, html, other]

Title: Multimodal Representation Loss Between Timed Text and Audio for Regularized Speech Separation

Tsun-An Hsieh, Heeyoul Choi, Minje Kim

Subjects: Audio and Speech Processing (eess.AS)

[133] arXiv:2406.08353 [pdf, html, other]

Title: Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques

Yuanchao Li, Peter Bell, Catherine Lai

Comments: Accepted to IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD)

[134] arXiv:2406.08393 [pdf, html, other]

Title: SCDNet: Self-supervised Learning Feature-based Speaker Change Detection

Yue Li, Xinsheng Wang, Li Zhang, Lei Xie

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[135] arXiv:2406.08396 [pdf, html, other]

Title: Neural Blind Source Separation and Diarization for Distant Speech Recognition

Yoshiaki Bando, Tomohiko Nakamura, Shinji Watanabe

Comments: 5 pages, 3 figures, accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[136] arXiv:2406.08402 [pdf, html, other]

Title: Understanding Sounds, Missing the Questions: The Challenge of Object Hallucination in Large Audio-Language Models

Chun-Yi Kuan, Wei-Ping Huang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[137] arXiv:2406.08445 [pdf, html, other]

Title: SVSNet+: Enhancing Speaker Voice Similarity Assessment Models with Representations from Speech Foundation Models

Chun Yin, Tai-Shih Chi, Yu Tsao, Hsin-Min Wang

Comments: Accepted to INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[138] arXiv:2406.08517 [pdf, html, other]

Title: DB3V: A Dialect Dominated Dataset of Bird Vocalisation for Cross-corpus Bird Species Recognition

Xin Jing, Luyang Zhang, Jiangjian Xie, Alexander Gebhard, Alice Baird, Bjoern Schuller

Comments: accepted by Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[139] arXiv:2406.08802 [pdf, html, other]

Title: DubWise: Video-Guided Speech Duration Control in Multimodal LLM-based Text-to-Speech for Dubbing

Neha Sahipjohn, Ashishkumar Gudmalwar, Nirmesh Shah, Pankaj Wasnik, Rajiv Ratn Shah

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[140] arXiv:2406.08820 [pdf, html, other]

Title: DisfluencySpeech -- Single-Speaker Conversational Speech Dataset with Paralanguage

Kyra Wang, Dorien Herremans

Comments: 4 pages, 1 figure, submitted to IEEE TENCON 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[141] arXiv:2406.08900 [pdf, html, other]

Title: On Improving Error Resilience of Neural End-to-End Speech Coders

Kishan Gupta, Nicola Pia, Srikanth Korse, Andreas Brendel, Guillaume Fuchs, Markus Multrus

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[142] arXiv:2406.08957 [pdf, html, other]

Title: Tool Wear Prediction in CNC Turning Operations using Ultrasonic Microphone Arrays and CNNs

Jan Steckel, Arne Aerts, Erik Verreycken, Dennis Laurijssen, Walter Daems

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[143] arXiv:2406.08974 [pdf, html, other]

Title: Cascaded noise reduction and acoustic echo cancellation based on an extended noise reduction

Arnout Roebben, Toon van Waterschoot, Marc Moonen

Comments: Accepted for publication in EUSIPCO 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[144] arXiv:2406.08989 [pdf, html, other]

Title: ToneUnit: A Speech Discretization Approach for Tonal Language Speech Synthesis

Dehua Tao, Daxin Tan, Yu Ting Yeung, Xiao Chen, Tan Lee

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[145] arXiv:2406.09277 [pdf, html, other]

Title: End-to-end streaming model for low-latency speech anonymization

Waris Quamer, Ricardo Gutierrez-Osuna

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[146] arXiv:2406.09286 [pdf, html, other]

Title: FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching

Chaeyoung Jung, Suyeon Lee, Ji-Hoon Kim, Joon Son Chung

Comments: INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[147] arXiv:2406.09290 [pdf, html, other]

Title: Exploring Spoken Language Identification Strategies for Automatic Transcription of Multilingual Broadcast and Institutional Speech

Martina Valente, Fabio Brugnara, Giovanni Morrone, Enrico Zovato, Leonardo Badino

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[148] arXiv:2406.09443 [pdf, html, other]

Title: Comparative Analysis of Personalized Voice Activity Detection Systems: Assessing Real-World Effectiveness

Satyam Kumar, Sai Srujana Buddi, Utkarsh Oggy Sarawgi, Vineet Garg, Shivesh Ranjan, Ognjen (Oggi)Rudovic, Ahmed Hussen Abdelaziz, Saurabh Adya

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[149] arXiv:2406.09444 [pdf, html, other]

Title: GenDistiller: Distilling Pre-trained Language Models based on an Autoregressive Generative Model

Yingying Gao, Shilei Zhang, Chao Deng, Junlan Feng

Comments: arXiv admin note: text overlap with arXiv:2310.13418

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[150] arXiv:2406.09494 [pdf, html, other]

Title: The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environments

Shareef Babu Kalluri, Prachi Singh, Pratik Roy Chowdhuri, Apoorva Kulkarni, Shikha Baghel, Pradyoth Hegde, Swapnil Sontakke, Deepak K T, S. R. Mahadeva Prasanna, Deepu Vijayasenan, Sriram Ganapathy

Comments: 5 pages, 3 figures, Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[151] arXiv:2406.09589 [pdf, html, other]

Title: Multi-Channel Multi-Speaker ASR Using Target Speaker's Solo Segment

Yiwen Shao, Shi-Xiong Zhang, Yong Xu, Meng Yu, Dong Yu, Daniel Povey, Sanjeev Khudanpur

Comments: Accepted for presentation at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS)

[152] arXiv:2406.09634 [pdf, other]

Title: Efficient Personalization of Amplification in Hearing Aids via Multi-band Bayesian Machine Learning

Aoxin Ni, Edward Lobarinas, Nasser Kehtarnavaz

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[153] arXiv:2406.09676 [pdf, html, other]

Title: Optimizing Byte-level Representation for End-to-end ASR

Roger Hsiao, Liuhui Deng, Erik McDermott, Ruchir Travadi, Xiaodan Zhuang

Comments: 5 pages, 1 figure, IEEE SLT 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[154] arXiv:2406.09706 [pdf, html, other]

Title: A Multimodal Framework for the Assessment of the Schizophrenia Spectrum

Gowtham Premananth, Yashish M.Siriwardena, Philip Resnik, Sonia Bansal, Deanna L.Kelly, Carol Espy-Wilson

Comments: Accepted to be presented at Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS)

[155] arXiv:2406.09819 [pdf, html, other]

Title: Enhanced Deep Speech Separation in Clustered Ad Hoc Distributed Microphone Environments

Jihyun Kim, Stijn Kindt, Nilesh Madhu, Hong-Goo Kang

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS)