Audio and Speech Processing

Authors and titles for June 2023

[151] arXiv:2306.16696 [pdf, other]

Title: Computationally-efficient and perceptually-motivated rendering of diffuse reflections in room acoustics simulation

Stephan D. Ewert, Nico Gößling, Oliver Buttler, Steven van de Par, Hongmei Hu

Comments: This work has been submitted to Forum Acusticum 2023 for publication

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[152] arXiv:2306.16860 [pdf, other]

Title: Deep Learning-based F0 Synthesis for Speaker Anonymization

Ünal Ege Gaznepoglu, Nils Peters

Comments: 5 pages, 4 figures, 6 tables, accepted to EUSIPCO 2023

Subjects: Audio and Speech Processing (eess.AS)

[153] arXiv:2306.17005 [pdf, other]

Title: High-Quality Automatic Voice Over with Accurate Alignment: Supervision through Self-Supervised Discrete Speech Units

Junchen Lu, Berrak Sisman, Mingyang Zhang, Haizhou Li

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[154] arXiv:2306.17012 [pdf, other]

Title: Evaluation of Virtual Acoustic Environments with Different Acoustic Level of Detail

Stefan Fichna, Steven van de Par, Stephan D. Ewert

Comments: This work has been submitted to the I3DA 2023 International Conference on Immersive and 3D Audio for possible publication. Revised version after review

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[155] arXiv:2306.17199 [pdf, other]

Title: Learning Multilingual Expressive Speech Representation for Prosody Prediction without Parallel Data

Jarod Duret (LIA), Titouan Parcollet (CAM), Yannick Estève (LIA)

Journal-ref: Speech Synthesis Workshop (SSW), Aug 2023, Grenoble, France

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[156] arXiv:2306.17252 [pdf, html, other]

Title: Singing Voice Synthesis Using Differentiable LPC and Glottal-Flow-Inspired Wavetables

Chin-Yun Yu, György Fazekas

Comments: 9 pages, 4 figures. Published at ISMIR 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[157] arXiv:2306.17317 [pdf, other]

Title: Modified Parametric Multichannel Wiener Filter \\for Low-latency Enhancement of Speech Mixtures with Unknown Number of Speakers

Ning Guo, Tomohiro Nakatani, Shoko Araki, Takehiro Moriya

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[158] arXiv:2306.17700 [pdf, other]

Title: Beyond Neural-on-Neural Approaches to Speaker Gender Protection

Loes van Bemmel, Zhuoran Liu, Nik Vaessen, Martha Larson

Journal-ref: 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY); Machine Learning (cs.LG); Sound (cs.SD)

[159] arXiv:2306.00044 (cross-list from cs.LG) [pdf, other]

Title: How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning

Hye-jin Shim, Rosa González Hautamäki, Md Sahidullah, Tomi Kinnunen

Comments: Interspeech 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[160] arXiv:2306.00107 (cross-list from cs.SD) [pdf, html, other]

Title: MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training

Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao Ma, Xingran Chen, Hanzhi Yin, Chenghao Xiao, Chenghua Lin, Anton Ragni, Emmanouil Benetos, Norbert Gyenge, Roger Dannenberg, Ruibo Liu, Wenhu Chen, Gus Xia, Yemin Shi, Wenhao Huang, Zili Wang, Yike Guo, Jie Fu

Comments: accepted by ICLR 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[161] arXiv:2306.00110 (cross-list from cs.SD) [pdf, other]

Title: MuseCoco: Generating Symbolic Music from Text

Peiling Lu, Xin Xu, Chenfei Kang, Botao Yu, Chengyi Xing, Xu Tan, Jiang Bian

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[162] arXiv:2306.00208 (cross-list from cs.CL) [pdf, other]

Title: Strategies for improving low resource speech to text translation relying on pre-trained ASR models

Santosh Kesiraju, Marek Sarvas, Tomas Pavlicek, Cecile Macaire, Alejandro Ciuba

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2306.00281 (cross-list from cs.LG) [pdf, other]

Title: Transfer Learning for Underrepresented Music Generation

Anahita Doosti, Matthew Guzdial

Comments: 5 pages, 3 figures, International Conference on Computational Creativity

Journal-ref: Proceedings of the 2023 International Conference on Computational Creativity

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2306.00410 (cross-list from cs.CL) [pdf, other]

Title: Towards hate speech detection in low-resource languages: Comparing ASR to acoustic word embeddings on Wolof and Swahili

Christiaan Jacobs, Nathanaël Carraz Rakotonirina, Everlyn Asiko Chimoto, Bruce A. Bassett, Herman Kamper

Comments: Accepted to Interspeech 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[165] arXiv:2306.00482 (cross-list from cs.CY) [pdf, other]

Title: Inspecting Spoken Language Understanding from Kids for Basic Math Learning at Home

Eda Okur, Roddy Fuentes Alba, Saurav Sahay, Lama Nachman

Comments: Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA) at ACL 2023

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); History and Overview (math.HO)

[166] arXiv:2306.00489 (cross-list from cs.SD) [pdf, other]

Title: Speech inpainting: Context-based speech synthesis guided by video

Juan F. Montesinos, Daniel Michelsanti, Gloria Haro, Zheng-Hua Tan, Jesper Jensen

Comments: Accepted in Interspeech23

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[167] arXiv:2306.00535 (cross-list from cs.CL) [pdf, other]

Title: The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech

Phat Do, Matt Coler, Jelske Dijkstra, Esther Klabbers

Comments: Accepted at INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[168] arXiv:2306.00561 (cross-list from cs.SD) [pdf, other]

Title: Masked Autoencoders with Multi-Window Local-Global Attention Are Better Audio Learners

Sarthak Yadav, Sergios Theodoridis, Lars Kai Hansen, Zheng-Hua Tan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[169] arXiv:2306.00614 (cross-list from cs.SD) [pdf, other]

Title: Adaptation and Optimization of Automatic Speech Recognition (ASR) for the Maritime Domain in the Field of VHF Communication

Emin Cagatay Nakilcioglu, Maximilian Reimann, Ole John

Journal-ref: Proceedings of the COMPIT Conference 22 (2023) 345-354

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[170] arXiv:2306.00648 (cross-list from cs.SD) [pdf, other]

Title: EmoMix: Emotion Mixing via Diffusion Models for Emotional Speech Synthesis

Haobin Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by 24th Annual Conference of the International Speech Communication Association (INTERSPEECH 2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[171] arXiv:2306.00680 (cross-list from cs.SD) [pdf, other]

Title: Encoder-decoder multimodal speaker change detection

Jee-weon Jung, Soonshin Seo, Hee-Soo Heo, Geonmin Kim, You Jin Kim, Young-ki Kwon, Minjae Lee, Bong-Jin Lee

Comments: 5 pages, accepted for presentation at INTERSPEECH 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[172] arXiv:2306.00689 (cross-list from cs.SD) [pdf, other]

Title: Stuttering Detection Using Speaker Representations and Self-supervised Contextual Embeddings

Shakeel A. Sheikh, Md Sahidullah, Fabrice Hirsch, Slim Ouni

Comments: Accepted in International Journal of Speech Technology, Springer 2023 substantial overlap with arXiv:2204.01564

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[173] arXiv:2306.00697 (cross-list from cs.CL) [pdf, other]

Title: How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics

Joonyong Park, Shinnosuke Takamichi, Tomohiko Nakamura, Kentaro Seki, Detai Xin, Hiroshi Saruwatari

Comments: Accepted to INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[174] arXiv:2306.00721 (cross-list from cs.SD) [pdf, other]

Title: UnDiff: Unsupervised Voice Restoration with Unconditional Diffusion Model

Anastasiia Iashchenko, Pavel Andreev, Ivan Shchekotov, Nicholas Babaev, Dmitry Vetrov

Comments: Accepted to Interspeech 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[175] arXiv:2306.00755 (cross-list from cs.CL) [pdf, other]

Title: Enhancing the Unified Streaming and Non-streaming Model with Contrastive Learning

Yuting Yang, Yuke Li, Binbin Du

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)