Audio and Speech Processing

Authors and titles for October 2023

[1] arXiv:2310.00587 [pdf, other]

Title: Mechatronic Generation of Datasets for Acoustics Research

Austin Lu, Ethaniel Moore, Arya Nallanthighall, Kanad Sarkar, Manan Mittal, Ryan M. Corey, Paris Smaragdis, Andrew Singer

Comments: 5 pages, 5 figures, IWAENC 2022

Subjects: Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[2] arXiv:2310.00602 [pdf, other]

Title: Wavelet Scattering Transform for Improving Generalization in Low-Resourced Spoken Language Identification

Spandan Dey, Premjeet Singh, Goutam Saha

Comments: Accepted and presented in INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[3] arXiv:2310.01122 [pdf, other]

Title: A Fused Deep Denoising Sound Coding Strategy for Bilateral Cochlear Implants

Tom Gajecki, Waldo Nogueira

Subjects: Audio and Speech Processing (eess.AS)

[4] arXiv:2310.01128 [pdf, other]

Title: Disentangling Voice and Content with Self-Supervision for Speaker Recognition

Tianchi Liu, Kong Aik Lee, Qiongqiong Wang, Haizhou Li

Comments: Accepted to NeurIPS 2023 (main track)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[5] arXiv:2310.01353 [pdf, other]

Title: Scaling Up Music Information Retrieval Training with Semi-Supervised Learning

Yun-Ning Hung, Ju-Chiang Wang, Minz Won, Duc Le

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[6] arXiv:2310.01688 [pdf, other]

Title: One model to rule them all ? Towards End-to-End Joint Speaker Diarization and Speech Recognition

Samuele Cornell, Jee-weon Jung, Shinji Watanabe, Stefano Squartini

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[7] arXiv:2310.01839 [pdf, other]

Title: Preserving Phonemic Distinctions for Ordinal Regression: A Novel Loss Function for Automatic Pronunciation Assessment

Bi-Cheng Yan, Hsin-Wei Wang, Yi-Cheng Wang, Jiun-Ting Li, Chi-Han Lin, Berlin Chen

Comments: Accepted by ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[8] arXiv:2310.01867 [pdf, other]

Title: Audio-visual child-adult speaker classification in dyadic interactions

Anfeng Xu, Kevin Huang, Tiantian Feng, Helen Tager-Flusberg, Shrikanth Narayanan

Comments: In review for ICASSP 2024, 5 pages

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[9] arXiv:2310.02281 [pdf, other]

Title: End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations

Yajing Feng (CNRS-LISN), Laurence Devillers (CNRS-LISN, SU)

Journal-ref: 2023 11th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Sep 2023, Boston (MA), United States

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[10] arXiv:2310.02640 [pdf, other]

Title: The VoiceMOS Challenge 2023: Zero-shot Subjective Speech Quality Prediction for Multiple Domains

Erica Cooper, Wen-Chin Huang, Yu Tsao, Hsin-Min Wang, Tomoki Toda, Junichi Yamagishi

Comments: Accepted to ASRU 2023

Subjects: Audio and Speech Processing (eess.AS)

[11] arXiv:2310.02699 [pdf, html, other]

Title: Continual Contrastive Spoken Language Understanding

Umberto Cappellazzo, Enrico Fini, Muqiao Yang, Daniele Falavigna, Alessio Brutti, Bhiksha Raj

Comments: Accepted to ACL Findings 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[12] arXiv:2310.02732 [pdf, other]

Title: Discriminative Training of VBx Diarization

Dominik Klement, Mireia Diez, Federico Landini, Lukáš Burget, Anna Silnova, Marc Delcroix, Naohiro Tawara

Comments: Submitted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[13] arXiv:2310.02802 [pdf, other]

Title: VITS-Based Singing Voice Conversion Leveraging Whisper and multi-scale F0 Modeling

Ziqian Ning, Yuepeng Jiang, Zhichao Wang, Bin Zhang, Lei Xie

Subjects: Audio and Speech Processing (eess.AS)

[14] arXiv:2310.02971 [pdf, other]

Title: Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model

Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Kuo-Ming Huang, Chien-yu Huang, Shang-Wen Li, Hung-yi Lee

Comments: Accepted to IEEE ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Signal Processing (eess.SP)

[15] arXiv:2310.03018 [pdf, html, other]

Title: Zero Resource Code-switched Speech Benchmark Using Speech Utterance Pairs For Multiple Spoken Languages

Kuan-Po Huang, Chih-Kai Yang, Yu-Kuan Fu, Ewan Dunbar, Hung-yi Lee

Comments: Accepted by ICASSP 2024 (v2)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[16] arXiv:2310.03444 [pdf, other]

Title: VaSAB: The variable size adaptive information bottleneck for disentanglement on speech and singing voice

Frederik Bous, Axel Roebel

Comments: Submitted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[17] arXiv:2310.03455 [pdf, html, other]

Title: Performance and energy balance: a comprehensive study of state-of-the-art sound event detection systems

Francesca Ronchini, Romain Serizel

Comments: Accepted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[18] arXiv:2310.03480 [pdf, other]

Title: The ICASSP SP Cadenza Challenge: Music Demixing/Remixing for Hearing Aids

Gerardo Roa Dabike, Michael A. Akeroyd, Scott Bannister, Jon Barker, Trevor J. Cox, Bruno Fazenda, Jennifer Firth, Simone Graetzer, Alinka Greasley, Rebecca R. Vos, William M. Whitmer

Comments: 2-page paper for ICASSP 2024 SP Grand Challenge

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Signal Processing (eess.SP)

[19] arXiv:2310.03538 [pdf, other]

Title: Latent Filling: Latent Space Data Augmentation for Zero-shot Speech Synthesis

Jae-Sung Bae, Joun Yeop Lee, Ji-Hyun Lee, Seongkyu Mun, Taehwa Kang, Hoon-Young Cho, Chanwoo Kim

Comments: Accepted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS)

[20] arXiv:2310.03688 [pdf, other]

Title: Speaker localization using direct path dominance test based on sound field directivity

Boaz Rafaely, Koby Alhaiany

Journal-ref: Signal Processing, vol. 143, pp. 42 - 47, 2018

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[21] arXiv:2310.03889 [pdf, other]

Title: Audio Event-Relational Graph Representation Learning for Acoustic Scene Classification

Yuanbo Hou, Siyang Song, Chuang Yu, Wenwu Wang, Dick Botteldooren

Comments: IEEE Signal Processing Letters, doi: https://doi.org/10.1109/LSP.2023.3319233

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[22] arXiv:2310.03901 [pdf, other]

Title: Challenges and Insights: Exploring 3D Spatial Features and Complex Networks on the MISP Dataset

Yiwen Shao

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[23] arXiv:2310.04035 [pdf, other]

Title: A privacy-preserving method using secret key for convolutional neural network-based speech classification

Shoko Niwa, Sayaka Shiota, Hitoshi Kiya

Comments: To appear in the 31st European Signal Processing Conference (EUSIPCO 2023)

Subjects: Audio and Speech Processing (eess.AS)

[24] arXiv:2310.04169 [pdf, other]

Title: Spatial sampling and beamforming for spherical microphone arrays

Boaz Rafaely

Journal-ref: 2008 Hands-Free Speech Communication and Microphone Arrays, Trento, Italy, 2008, pp. 5-8

Subjects: Audio and Speech Processing (eess.AS)

[25] arXiv:2310.04191 [pdf, other]

Title: Zones of quiet in a broadband diffuse sound field

Boaz Rafaely

Journal-ref: J. Acoust. Soc. Am., vol. 110, no. 1, pp. 296-302, July 2001

Subjects: Audio and Speech Processing (eess.AS)

[26] arXiv:2310.04202 [pdf, other]

Title: Optimal model-based beamforming and independent steering for spherical loudspeaker arrays

Boaz Rafaely, Dima Khaykin

Journal-ref: in IEEE Trans. Audio, Speech, and Lang. Proc., vol. 19, no. 7, pp. 2234-2238, Sept. 2011

Subjects: Audio and Speech Processing (eess.AS)

[27] arXiv:2310.04249 [pdf, other]

Title: Analysis on the Influence of Synchronization Error on Fixed-filter Active Noise Control

Guo Yu

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[28] arXiv:2310.04481 [pdf, other]

Title: Acoustic and linguistic representations for speech continuous emotion recognition in call center conversations

Manon Macary, Marie Tahon, Yannick Estève, Daniel Luzzati

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[29] arXiv:2310.04567 [pdf, other]

Title: DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extraction

Jiarui Hai, Helin Wang, Dongchao Yang, Karan Thakkar, Najim Dehak, Mounya Elhilali

Comments: Submitted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[30] arXiv:2310.04657 [pdf, other]

Title: Spike-Triggered Contextual Biasing for End-to-End Mandarin Speech Recognition

Kaixun Huang, Ao Zhang, Binbin Zhang, Tianyi Xu, Xingchen Song, Lei Xie

Comments: Accepted by ASRU2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[31] arXiv:2310.04715 [pdf, other]

Title: An Exploration of Task-decoupling on Two-stage Neural Post Filter for Real-time Personalized Acoustic Echo Cancellation

Zihan Zhang, Jiayao Sun, Xianjun Xia, Ziqian Wang, Xiaopeng Yan, Yijian Xiao, Lei Xie

Comments: accepted to ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[32] arXiv:2310.04760 [pdf, other]

Title: Multi-objective Progressive Clustering for Semi-supervised Domain Adaptation in Speaker Verification

Ze Li, Yuke Lin, Ning Jiang, Xiaoyi Qin, Guoqing Zhao, Haiying Wu, Ming Li

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[33] arXiv:2310.04791 [pdf, other]

Title: Conditional Diffusion Model for Target Speaker Extraction

Theodor Nguyen, Guangzhi Sun, Xianrui Zheng, Chao Zhang, Philip C Woodland

Comments: 5 pages, 4 figures, submitted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[34] arXiv:2310.05078 [pdf, other]

Title: Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-supervised setting

Hemant Yadav, Erica Cooper, Junichi Yamagishi, Sunayana Sitaram, Rajiv Ratn Shah

Comments: Accepted to ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[35] arXiv:2310.05181 [pdf, html, other]

Title: Unified speech and gesture synthesis using flow matching

Shivam Mehta, Ruibo Tu, Simon Alexanderson, Jonas Beskow, Éva Székely, Gustav Eje Henter

Comments: 5 pages, 1 figure. Final version, accepted to IEEE ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Graphics (cs.GR); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)

[36] arXiv:2310.05203 [pdf, other]

Title: A Comparative Study of Voice Conversion Models with Large-Scale Speech and Singing Data: The T13 Systems for the Singing Voice Conversion Challenge 2023

Ryuichi Yamamoto, Reo Yoneyama, Lester Phillip Violeta, Wen-Chin Huang, Tomoki Toda

Comments: Accepted to ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[37] arXiv:2310.05534 [pdf, other]

Title: Thech. Report: Genuinization of Speech waveform PMF for speaker detection spoofing and countermeasures

Itshak Lapidot, Jean-Francois Bonastre

Comments: 17 pages, 11 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[38] arXiv:2310.05629 [pdf, other]

Title: Super Denoise Net: Speech Super Resolution with Noise Cancellation in Low Sampling Rate Noisy Environments

Junkang Yang, Hongqing Liu, Lu Gan, Yi Zhou

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[39] arXiv:2310.05799 [pdf, other]

Title: The First Cadenza Signal Processing Challenge: Improving Music for Those With a Hearing Loss

Gerardo Roa Dabike, Scott Bannister, Jennifer Firth, Simone Graetzer, Rebecca Vos, Michael A. Akeroyd, Jon Barker, Trevor J. Cox, Bruno Fazenda, Alinka Greasley, William Whitmer

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Signal Processing (eess.SP)

[40] arXiv:2310.05863 [pdf, other]

Title: Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models

Guangzhi Sun, Wenyi Yu, Changli Tang, Xianzhao Chen, Tian Tan, Wei Li, Lu Lu, Zejun Ma, Chao Zhang

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

[41] arXiv:2310.06248 [pdf, other]

Title: Discriminative Speech Recognition Rescoring with Pre-trained Language Models

Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yile Gu, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Comments: ASRU 2023

Subjects: Audio and Speech Processing (eess.AS)

[42] arXiv:2310.06554 [pdf, html, other]

Title: Modeling of Speech-dependent Own Voice Transfer Characteristics for Hearables with In-ear Microphones

Mattes Ohlenbusch, Christian Rollwage, Simon Doclo

Comments: 20 pages, 11 figures; Extended version of arXiv:2309.08294 (more detailed description of the problem, additional models considered, more systematic evaluation conducted on a different, larger dataset) -> Updated version (20th march 2024): major changes after internal review; in submission

Journal-ref: Acta Acust. 8 (2024)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[43] arXiv:2310.06652 [pdf, html, other]

Title: Privacy-oriented manipulation of speaker representations

Francisco Teixeira, Alberto Abad, Bhiksha Raj, Isabel Trancoso

Comments: Article published in IEEE Access

Journal-ref: IEEE Access, vol. 12, pp. 82949-82971, 2024

Subjects: Audio and Speech Processing (eess.AS)

[44] arXiv:2310.07284 [pdf, html, other]

Title: Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extraction

Xiang Hao, Jibin Wu, Jianwei Yu, Chenglin Xu, Kay Chen Tan

Comments: Under review, this https URL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[45] arXiv:2310.07295 [pdf, other]

Title: VSANet: Real-time Speech Enhancement Based on Voice Activity Detection and Causal Spatial Attention

Yuewei Zhang, Huanbin Zou, Jie Zhu

Comments: Accepted by ASRU 2023

Subjects: Audio and Speech Processing (eess.AS)

[46] arXiv:2310.07316 [pdf, other]

Title: Magnitude-and-phase-aware Speech Enhancement with Parallel Sequence Modeling

Yuewei Zhang, Huanbin Zou, Jie Zhu

Comments: Accepted by ASRU 2023

Subjects: Audio and Speech Processing (eess.AS)

[47] arXiv:2310.07363 [pdf, other]

Title: Damping Density of an Absorptive Shoebox Room Derived from the Image-Source Method

Sebastian J. Schlecht, Karolina Prawda, Rudolf Rabenstein, Maximilian Schäfer

Subjects: Audio and Speech Processing (eess.AS)

[48] arXiv:2310.07663 [pdf, other]

Title: Deep Video Inpainting Guided by Audio-Visual Self-Supervision

Kyuyeon Kim, Junsik Jung, Woo Jae Kim, Sung-Eui Yoon

Comments: Accepted at ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

[49] arXiv:2310.08104 [pdf, other]

Title: Voice Conversion for Stuttered Speech, Instruments, Unseen Languages and Textually Described Voices

Matthew Baas, Herman Kamper

Comments: 11 pages, 1 figure, 5 tables. Accepted at SACAIR 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[50] arXiv:2310.08225 [pdf, other]

Title: Fast Word Error Rate Estimation Using Self-Supervised Representations For Speech And Text

Chanho Park, Chengsong Lu, Mingjie Chen, Thomas Hain

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)