Sound

Authors and titles for June 2023

[261] arXiv:2306.11327 (cross-list from eess.AS) [pdf, other]

Title: eCat: An End-to-End Model for Multi-Speaker TTS & Many-to-Many Fine-Grained Prosody Transfer

Ammar Abbas, Sri Karlapati, Bastian Schnell, Penny Karanasou, Marcel Granero Moya, Amith Nagaraj, Ayman Boustati, Nicole Peinelt, Alexis Moinet, Thomas Drugman

Comments: Accepted to be published in the Proceedings of InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[262] arXiv:2306.11504 (cross-list from cs.GR) [pdf, other]

Title: Align, Adapt and Inject: Sound-guided Unified Image Generation

Yue Yang, Kaipeng Zhang, Yuying Ge, Wenqi Shao, Zeyue Xue, Yu Qiao, Ping Luo

Comments: Tech Report

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[263] arXiv:2306.11509 (cross-list from eess.AS) [pdf, other]

Title: Implicit neural representation with physics-informed neural networks for the reconstruction of the early part of room impulse responses

Mirco Pezzoli, Fabio Antonacci, Augusto Sarti

Comments: Accepted for publication at Forum Acusticum 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[264] arXiv:2306.11764 (cross-list from eess.AS) [pdf, other]

Title: On Frequency-Wise Normalizations for Better Recording Device Generalization in Audio Spectrogram Transformers

Paul Primus and, Gerhard Widmer

Comments: EUSIPCO 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[265] arXiv:2306.12012 (cross-list from eess.AS) [pdf, other]

Title: Learning When to Trust Which Teacher for Weakly Supervised ASR

Aakriti Agrawal, Milind Rao, Anit Kumar Sahu, Gopinath Chennupati, Andreas Stolcke

Comments: Proceedings of INTERSPEECH 2023

Journal-ref: Proc. Interspeech, Aug. 2023, pp. 381-385

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[266] arXiv:2306.12015 (cross-list from eess.AS) [pdf, other]

Title: Federated Self-Learning with Weak Supervision for Speech Recognition

Milind Rao, Gopinath Chennupati, Gautam Tiwari, Anit Kumar Sahu, Anirudh Raju, Ariya Rastrow, Jasha Droppo

Comments: Proceedings of ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[267] arXiv:2306.12020 (cross-list from eess.AS) [pdf, other]

Title: Visual-Aware Text-to-Speech

Mohan Zhou, Yalong Bai, Wei Zhang, Ting Yao, Tiejun Zhao, Tao Mei

Comments: accepted as oral and top 3% paper by ICASSP 2023

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2023, 1-5

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[268] arXiv:2306.12286 (cross-list from eess.AS) [pdf, other]

Title: Diffusion Posterior Sampling for Informed Single-Channel Dereverberation

Jean-Marie Lemercier, Simon Welker, Timo Gerkmann

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[269] arXiv:2306.12443 (cross-list from eess.AS) [pdf, other]

Title: DEPAC: a Corpus for Depression and Anxiety Detection from Speech

Mashrura Tasnim, Malikeh Ehghaghi, Brian Diep, Jekaterina Novikova

Comments: Accepted to the Eighth Workshop on Computational Linguistics and Clinical Psychology (CLPsych) at NAACL 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[270] arXiv:2306.12444 (cross-list from eess.AS) [pdf, other]

Title: Factors Affecting the Performance of Automated Speaker Verification in Alzheimer's Disease Clinical Trials

Malikeh Ehghaghi, Marija Stanojevic, Ali Akram, Jekaterina Novikova

Comments: Accepted to the 5th Clinical Natural Language Processing Workshop (ClinicalNLP) at ACL 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

[271] arXiv:2306.12559 (cross-list from cs.CV) [pdf, other]

Title: Exploring the Role of Audio in Video Captioning

Yuhan Shen, Linjie Yang, Longyin Wen, Haichao Yu, Ehsan Elhamifar, Heng Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[272] arXiv:2306.12577 (cross-list from cs.CL) [pdf, other]

Title: NoRefER: a Referenceless Quality Metric for Automatic Speech Recognition via Semi-Supervised Language Model Fine-Tuning with Contrastive Learning

Kamer Ali Yuksel, Thiago Ferreira, Golara Javadi, Mohamed El-Badrashiny, Ahmet Gunduz

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[273] arXiv:2306.12867 (cross-list from eess.AS) [pdf, html, other]

Title: Wind Noise Reduction with a Diffusion-based Stochastic Regeneration Model

Jean-Marie Lemercier, Joachim Thiemann, Raphael Koning, Timo Gerkmann

Comments: Accepted to VDE 15th ITG conference on Speech Communication

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[274] arXiv:2306.12913 (cross-list from eess.AS) [pdf, other]

Title: Implicit spoken language diarization

Jagabandhu Mishra, Amartya Chowdhury, S. R. Mahadeva Prasanna

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[275] arXiv:2306.12925 (cross-list from cs.CL) [pdf, other]

Title: AudioPaLM: A Large Language Model That Can Speak and Listen

Paul K. Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, Ankur Bapna, Zalán Borsos, Félix de Chaumont Quitry, Peter Chen, Dalia El Badawy, Wei Han, Eugene Kharitonov, Hannah Muckenhirn, Dirk Padfield, James Qin, Danny Rozenberg, Tara Sainath, Johan Schalkwyk, Matt Sharifi, Michelle Tadmor Ramanovich, Marco Tagliasacchi, Alexandru Tudor, Mihajlo Velimirović, Damien Vincent, Jiahui Yu, Yongqiang Wang, Vicky Zayats, Neil Zeghidour, Yu Zhang, Zhishuai Zhang, Lukas Zilka, Christian Frank

Comments: Technical report

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[276] arXiv:2306.13592 (cross-list from cs.MM) [pdf, other]

Title: TACOformer:Token-channel compounded Cross Attention for Multimodal Emotion Recognition

Xinda Li

Comments: Accepted by IJCAI 2023- AI4TS workshop

Subjects: Multimedia (cs.MM); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[277] arXiv:2306.13734 (cross-list from eess.AS) [pdf, other]

Title: The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios

Samuele Cornell, Matthew Wiesner, Shinji Watanabe, Desh Raj, Xuankai Chang, Paola Garcia, Matthew Maciejewski, Yoshiki Masuyama, Zhong-Qiu Wang, Stefano Squartini, Sanjeev Khudanpur

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[278] arXiv:2306.13804 (cross-list from cs.CL) [pdf, other]

Title: Cross-Language Speech Emotion Recognition Using Multimodal Dual Attention Transformers

Syed Aun Muhammad Zaidi, Siddique Latif, Junaid Qadir

Comments: Under Review IEEE TAC

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[279] arXiv:2306.14170 (cross-list from cs.MM) [pdf, other]

Title: AV-SepFormer: Cross-Attention SepFormer for Audio-Visual Target Speaker Extraction

Jiuxin Lin, Xinyu Cai, Heinrich Dinkel, Jun Chen, Zhiyong Yan, Yongqing Wang, Junbo Zhang, Zhiyong Wu, Yujun Wang, Helen Meng

Comments: Accepted by ICASSP2023

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[280] arXiv:2306.14310 (cross-list from cs.CL) [pdf, other]

Title: Addressing Cold Start Problem for End-to-end Automatic Speech Scoring

Jungbae Park, Seungtaek Choi

Comments: Accepted at Interspeech 2023, 4 pages, 1 page for reference

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[281] arXiv:2306.14517 (cross-list from cs.CL) [pdf, other]

Title: Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognition

Samuel Cahyawijaya, Holy Lovenia, Willy Chung, Rita Frieske, Zihan Liu, Pascale Fung

Comments: Accepted in INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[282] arXiv:2306.15161 (cross-list from eess.AS) [pdf, other]

Title: Wespeaker baselines for VoxSRC2023

Shuai Wang, Chengdong Liang, Xu Xiang, Bing Han, Zhengyang Chen, Hongji Wang, Wen Ding

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[283] arXiv:2306.15304 (cross-list from eess.AS) [pdf, other]

Title: GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech

Yahuan Cong, Haoyu Zhang, Haopeng Lin, Shichao Liu, Chunfeng Wang, Yi Ren, Xiang Yin, Zejun Ma

Comments: Accepted by INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[284] arXiv:2306.15354 (cross-list from cs.CL) [pdf, other]

Title: 3D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglement

Siqi Zheng, Luyao Cheng, Yafeng Chen, Hui Wang, Qian Chen

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[285] arXiv:2306.15440 (cross-list from eess.AS) [pdf, other]

Title: Post-Processing Independent Evaluation of Sound Event Detection Systems

Janek Ebbers, Reinhold Haeb-Umbach, Romain Serizel

Comments: submitted to DCASE Workshop 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[286] arXiv:2306.15687 (cross-list from eess.AS) [pdf, other]

Title: Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale

Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari, Rashel Moritz, Mary Williamson, Vimal Manohar, Yossi Adi, Jay Mahadeokar, Wei-Ning Hsu

Comments: Accepted to NeurIPS 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[287] arXiv:2306.15808 (cross-list from cs.MM) [pdf, other]

Title: Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

Kai Chieh Chang, Mark Hasegawa-Johnson, Nancy L. McElwain, Bashima Islam

Comments: Preprint for APSIPA2023

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[288] arXiv:2306.16003 (cross-list from cs.GR) [pdf, html, other]

Title: Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models

Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro

Comments: ICASSP 2024

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[289] arXiv:2306.16069 (cross-list from eess.AS) [pdf, other]

Title: Two-Stage Voice Anonymization for Enhanced Privacy

Francesco Nespoli, Daniel Barreda, Joerg Bitzer, Patrick A. Naylor

Comments: submitted to INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[290] arXiv:2306.16071 (cross-list from eess.AS) [pdf, other]

Title: Long-term Conversation Analysis: Exploring Utility and Privacy

Francesco Nespoli, Jule Pohlhausen, Patrick A. Naylor, Joerg Bitzer

Comments: Submitted to ITG Conference on Speech Communication, 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[291] arXiv:2306.16696 (cross-list from eess.AS) [pdf, other]

Title: Computationally-efficient and perceptually-motivated rendering of diffuse reflections in room acoustics simulation

Stephan D. Ewert, Nico Gößling, Oliver Buttler, Steven van de Par, Hongmei Hu

Comments: This work has been submitted to Forum Acusticum 2023 for publication

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[292] arXiv:2306.16710 (cross-list from cs.CL) [pdf, other]

Title: Automatic Speech Recognition of Non-Native Child Speech for Language Learning Applications

Simone Wills, Yu Bai, Cristian Tejedor-Garcia, Catia Cucchiarini, Helmer Strik

Comments: Published on SLATE 2023, Esmad, Politecnico Do Porto, Portugal, 26-28 June, 2023, pp: 11:1-11:8

Journal-ref: 12th Symposium on Languages, Applications and Technologies (SLATE 2023) (p. 7:1-7:8)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[293] arXiv:2306.16903 (cross-list from cs.CL) [pdf, other]

Title: Leveraging Cross-Utterance Context For ASR Decoding

Robert Flynn, Anton Ragni

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[294] arXiv:2306.17005 (cross-list from eess.AS) [pdf, other]

Title: High-Quality Automatic Voice Over with Accurate Alignment: Supervision through Self-Supervised Discrete Speech Units

Junchen Lu, Berrak Sisman, Mingyang Zhang, Haizhou Li

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[295] arXiv:2306.17012 (cross-list from eess.AS) [pdf, other]

Title: Evaluation of Virtual Acoustic Environments with Different Acoustic Level of Detail

Stefan Fichna, Steven van de Par, Stephan D. Ewert

Comments: This work has been submitted to the I3DA 2023 International Conference on Immersive and 3D Audio for possible publication. Revised version after review

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[296] arXiv:2306.17103 (cross-list from cs.CL) [pdf, html, other]

Title: LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPT

Le Zhuo, Ruibin Yuan, Jiahao Pan, Yinghao Ma, Yizhi LI, Ge Zhang, Si Liu, Roger Dannenberg, Jie Fu, Chenghua Lin, Emmanouil Benetos, Wei Xue, Yike Guo

Comments: 9 pages, 2 figures, 5 tables, accepted by ISMIR 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[297] arXiv:2306.17199 (cross-list from eess.AS) [pdf, other]

Title: Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data

Jarod Duret (LIA), Titouan Parcollet (CAM), Yannick Estève (LIA)

Journal-ref: Speech Synthesis Workshop (SSW), Aug 2023, Grenoble, France

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[298] arXiv:2306.17252 (cross-list from eess.AS) [pdf, html, other]

Title: Singing Voice Synthesis Using Differentiable LPC and Glottal-Flow-Inspired Wavetables

Chin-Yun Yu, György Fazekas

Comments: 9 pages, 4 figures. Published at ISMIR 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[299] arXiv:2306.17317 (cross-list from eess.AS) [pdf, other]

Title: Modified Parametric Multichannel Wiener Filter \\for Low-latency Enhancement of Speech Mixtures with Unknown Number of Speakers

Ning Guo, Tomohiro Nakatani, Shoko Araki, Takehiro Moriya

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[300] arXiv:2306.17700 (cross-list from eess.AS) [pdf, other]

Title: Beyond Neural-on-Neural Approaches to Speaker Gender Protection

Loes van Bemmel, Zhuoran Liu, Nik Vaessen, Martha Larson

Journal-ref: 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY); Machine Learning (cs.LG); Sound (cs.SD)

[301] arXiv:2306.17792 (cross-list from cs.CL) [pdf, other]

Title: Towards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibition

Andrei-Marius Avram, Răzvan-Alexandru Smădu, Vasile Păiş, Dumitru-Clementin Cercel, Radu Ion, Dan Tufiş

Comments: Accepted at TSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[302] arXiv:2306.17799 (cross-list from cs.CV) [pdf, html, other]

Title: A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition

Yuntao Shou, Huan Liu, Xiangyong Cao, Deyu Meng, Bo Dong

Comments: 13 pages, 5 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)