Audio and Speech Processing

Authors and titles for June 2023

[101] arXiv:2306.09714 [pdf, other]

Title: Use of a humanoid robot for auditory psychophysical testing

Luke Meyer, Laura Rachman, Gloria Araiza-Illan, Etienne Gaudrain, Deniz Başkent

Comments: 27 pages (single spaced), 7 figures, 82 references, published by Plos ONE

Journal-ref: PLOS ONE, 18(12), e0294328. 2023

Subjects: Audio and Speech Processing (eess.AS)

[102] arXiv:2306.09807 [pdf, other]

Title: FALL-E: A Foley Sound Synthesis Model and Strategies

Minsung Kang, Sangshin Oh, Hyeongi Moon, Kyungyun Lee, Ben Sangbae Chon

Comments: 5 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[103] arXiv:2306.09814 [pdf, other]

Title: Investigating the Utility of Surprisal from Large Language Models for Speech Synthesis Prosody

Sofoklis Kakouros, Juraj Šimko, Martti Vainio, Antti Suni

Comments: Accepted at SSW 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[104] arXiv:2306.09820 [pdf, other]

Title: Crowdsourcing and Evaluating Text-Based Audio Retrieval Relevances

Huang Xie, Khazar Khorrami, Okko Räsänen, Tuomas Virtanen

Comments: Accepted at DCASE 2023 Workshop

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[105] arXiv:2306.09947 [pdf, other]

Title: Knowledge Distillation for Efficient Audio-Visual Video Captioning

Özkan Çaylı, Xubo Liu, Volkan Kılıç, Wenwu Wang

Comments: European Signal Processing Conference (EUSIPCO 2023)

Subjects: Audio and Speech Processing (eess.AS)

[106] arXiv:2306.10065 [pdf, other]

Title: Taming Diffusion Models for Music-driven Conducting Motion Generation

Zhuoran Zhao, Jinbin Bai, Delong Chen, Debang Wang, Yubo Pan

Comments: Accepted by AAAI 2023 Summer Symposium with Best Paper Award

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)

[107] arXiv:2306.10090 [pdf, other]

Title: Improving Audio Caption Fluency with Automatic Error Correction

Hanxue Zhang, Zeyu Xie, Xuenan Xu, Mengyue Wu, Kai Yu

Comments: Accepted by NCMMSC 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[108] arXiv:2306.10097 [pdf, other]

Title: CML-TTS A Multilingual Dataset for Speech Synthesis in Low-Resource Languages

Frederico S. Oliveira, Edresson Casanova, Arnaldo Cândido Júnior, Anderson S. Soares, Arlindo R. Galvão Filho

Comments: 12 pages, 5 figures, Accepted at the 25th International Conference on Text, Speech and Dialogue (TSD 2022)

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[109] arXiv:2306.10152 [pdf, other]

Title: Low-Resource Text-to-Speech Using Specific Data and Noise Augmentation

Kishor Kayyar Lakshminarayana, Christian Dittmar, Nicola Pia, Emanuël Habets

Comments: Accepted for publication at EUSIPCO-2023, Helsinki

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[110] arXiv:2306.10268 [pdf, other]

Title: Reliability and repeatability of ISO 3382-3 metrics based on repeated acoustic measurements in open-plan offices

Manuj Yadav, Densil Cabrera, James Love, Jungsoo Kim, Jonothan Holmes, Hugo Caldwell, Richard de Dear

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[111] arXiv:2306.10269 [pdf, other]

Title: Two simultaneous talkers distract more than one in simulated multi-talker environments, regardless of overall sound levels typical of open-plan offices

Manuj Yadav, Densil Cabrera

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[112] arXiv:2306.10271 [pdf, other]

Title: Autophonic Loudness of Singers in Simulated Room Acoustic Environments

Manuj Yadav, Densil Cabrera

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[113] arXiv:2306.10499 [pdf, other]

Title: Channel-Spatial-Based Few-Shot Bird Sound Event Detection

Lingwen Liu, Yuxuan Feng, Haitao Fu, Yajie Yang, Xin Pan, Chenlei Jin

Comments: 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[114] arXiv:2306.10521 [pdf, other]

Title: LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Models

Zhichao Wang, Yuanzhe Chen, Lei Xie, Qiao Tian, Yuping Wang

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[115] arXiv:2306.10559 [pdf, other]

Title: SURT 2.0: Advances in Transducer-based Multi-talker Speech Recognition

Desh Raj, Daniel Povey, Sanjeev Khudanpur

Comments: 13 pages, 7 figures. To appear in IEEE TASLP. Project webpage: this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[116] arXiv:2306.10563 [pdf, other]

Title: Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition

Yuchen Hu, Ruizhe Li, Chen Chen, Chengwei Qin, Qiushi Zhu, Eng Siong Chng

Comments: 19 pages, 9 figures, Accepted by ACL 2023

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)

[117] arXiv:2306.10567 [pdf, other]

Title: MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition

Yuchen Hu, Chen Chen, Ruizhe Li, Heqing Zou, Eng Siong Chng

Comments: 14 pages, 5 figures, Accepted by ACL 2023

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)

[118] arXiv:2306.10588 [pdf, other]

Title: DuTa-VC: A Duration-aware Typical-to-atypical Voice Conversion Approach with Diffusion Probabilistic Model

Helin Wang, Thomas Thebaud, Jesus Villalba, Myra Sydnor, Becky Lammers, Najim Dehak, Laureano Moro-Velazquez

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[119] arXiv:2306.10860 [pdf, other]

Title: Rehearsal-Free Online Continual Learning for Automatic Speech Recognition

Steven Vander Eeckt, Hugo Van hamme

Comments: Accepted at INTERSPEECH 2023. 5 pages

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[120] arXiv:2306.11327 [pdf, other]

Title: eCat: An End-to-End Model for Multi-Speaker TTS & Many-to-Many Fine-Grained Prosody Transfer

Ammar Abbas, Sri Karlapati, Bastian Schnell, Penny Karanasou, Marcel Granero Moya, Amith Nagaraj, Ayman Boustati, Nicole Peinelt, Alexis Moinet, Thomas Drugman

Comments: Accepted to be published in the Proceedings of InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[121] arXiv:2306.11371 [pdf, html, other]

Title: Visually grounded few-shot word learning in low-resource settings

Leanne Nortje, Dan Oneata, Herman Kamper

Comments: Accepted to TASLP. arXiv admin note: substantial text overlap with arXiv:2305.15937

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[122] arXiv:2306.11408 [pdf, other]

Title: A Computation-efficient Online Secondary Path Modeling Technique for Modified FXLMS Algorithm

Junwei Ji, Dongyuan Shi, Woon-Seng Gan, Xiaoyi Shen, Zhengding Luo

Subjects: Audio and Speech Processing (eess.AS)

[123] arXiv:2306.11427 [pdf, other]

Title: Auditory Neural Response Inspired Sound Event Detection Based on Spectro-temporal Receptive Field

Deokki Min, Hyeonuk Nam, Yong-Hwa Park

Comments: Submitted to DCASE 2023 Workshop

Subjects: Audio and Speech Processing (eess.AS)

[124] arXiv:2306.11509 [pdf, other]

Title: Implicit neural representation with physics-informed neural networks for the reconstruction of the early part of room impulse responses

Mirco Pezzoli, Fabio Antonacci, Augusto Sarti

Comments: Accepted for publication at Forum Acusticum 2023

Journal-ref: Proceedings of the 10th Convention of the European Acoustics Association Forum Acusticum 2023 (pp. 2177-2184)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[125] arXiv:2306.11658 [pdf, other]

Title: Cross-lingual Prosody Transfer for Expressive Machine Dubbing

Jakub Swiatkowski, Duo Wang, Mikolaj Babianski, Patrick Lumban Tobing, Ravichander Vipperla, Vincent Pollet

Comments: Submitted to INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS)