Audio and Speech Processing

Authors and titles for June 2023

[26] arXiv:2306.01538 [pdf, other]

Title: On Crowdsourcing-design with Comparison Category Rating for Evaluating Speech Enhancement Algorithms

Angélica S. Z. Suárez, Clément Laroche, Line H. Clemmensen, Sneha Das

Comments: Published at ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS)

[27] arXiv:2306.01861 [pdf, other]

Title: Non-uniform Speaker Disentanglement For Depression Detection From Raw Speech Signals

Jinhan Wang, Vijay Ravi, Abeer Alwan

Comments: Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS)

[28] arXiv:2306.01916 [pdf, other]

Title: In-the-wild Speech Emotion Conversion Using Disentangled Self-Supervised Representations and Neural Vocoder-based Resynthesis

Navin Raj Prabhu, Nale Lehmann-Willenbrock, Timo Gerkmann

Comments: Submitted to 15th ITG Conference on Speech Communication

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[29] arXiv:2306.01957 [pdf, other]

Title: Speaker-independent neural formant synthesis

Pablo Pérez Zarazaga, Zofia Malisz, Gustav Eje Henter, Lauri Juvela

Comments: 5 pages, 4 figures. Article accepted at INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS)

[30] arXiv:2306.01981 [pdf, other]

Title: SGEM: Test-Time Adaptation for Automatic Speech Recognition via Sequential-Level Generalized Entropy Minimization

Changhun Kim, Joonhyung Park, Hajin Shim, Eunho Yang

Comments: INTERSPEECH 2023 Oral Presentation; Code is available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[31] arXiv:2306.02044 [pdf, other]

Title: Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously

Cheng-Han Chiang, Wei-Ping Huang, Hung-yi Lee

Comments: Interspeech 2023 camera-ready version

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[32] arXiv:2306.02053 [pdf, other]

Title: Few-shot Class-incremental Audio Classification Using Stochastic Classifier

Yanxiong Li, Wenchang Cao, Jialong Li, Wei Xie, Qianhua He

Comments: 5 pages, 3 figures, 4 tables. Accepted for publication in INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS)

[33] arXiv:2306.02054 [pdf, other]

Title: Low-Complexity Acoustic Scene Classification Using Data Augmentation and Lightweight ResNet

Yanxiong Li, Wenchang Cao, Wei Xie, Qisheng Huang, Wenfeng Pang, Qianhua He

Comments: 5 pages, 5 figures, 4 tables. Accepted for publication in the 16th IEEE International Conference on Signal Processing (IEEE ICSP)

Subjects: Audio and Speech Processing (eess.AS)

[34] arXiv:2306.02207 [pdf, other]

Title: SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts

Haibin Wu, Kai-Wei Chang, Yuan-Kuei Wu, Hung-yi Lee

Comments: Work in progress. The first three authors contributed equally

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[35] arXiv:2306.02344 [pdf, other]

Title: Influence of Lossy Speech Codecs on Hearing-aid, Binaural Sound Source Localisation using DNNs

Siyuan Song, Stijn Kindt, Jasper Maes, Alexander Bohlender. Nilesh Madhu

Subjects: Audio and Speech Processing (eess.AS)

[36] arXiv:2306.02372 [pdf, other]

Title: SingNet: A Real-time Singing Voice Beat and Downbeat Tracking System

Mojtaba Heydari, Ju-Chiang Wang, Zhiyao Duan

Comments: Accepted for 2023 International Conference on Acoustics, Speech, and Signal Processing (ICASSP-2023)

Subjects: Audio and Speech Processing (eess.AS)

[37] arXiv:2306.02450 [pdf, other]

Title: End-To-End Deep Learning-based Adaptation Control for Linear Acoustic Echo Cancellation

Thomas Haubner, Andreas Brendel, Walter Kellermann

Comments: This article has been submitted to IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS)

[38] arXiv:2306.02541 [pdf, other]

Title: OTF: Optimal Transport based Fusion of Supervised and Self-Supervised Learning Models for Automatic Speech Recognition

Li Fu, Siqi Li, Qingtao Li, Fangzhu Li, Liping Deng, Lu Fan, Meng Chen, Youzheng Wu, Xiaodong He

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS)

[39] arXiv:2306.02591 [pdf, other]

Title: Divided spectro-temporal attention for sound event localization and detection in real scenes for DCASE2023 challenge

Yusun Shul, Byeong-Yun Ko, Jung-Woo Choi

Subjects: Audio and Speech Processing (eess.AS)

[40] arXiv:2306.02596 [pdf, other]

Title: A Novel Interpretable and Generalizable Re-synchronization Model for Cued Speech based on a Multi-Cuer Corpus

Lufei Gao, Shan Huang, Li Liu

Comments: 5 pages, 4 figures, Accepted to INTERSPEECH2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[41] arXiv:2306.02778 [pdf, other]

Title: EffCRN: An Efficient Convolutional Recurrent Network for High-Performance Speech Enhancement

Marvin Sach, Jan Franzen, Bruno Defraene, Kristoff Fluyt, Maximilian Strake, Wouter Tirry, Tim Fingscheidt

Comments: 5 pages, 5 figures, accepted for Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS)

[42] arXiv:2306.02892 [pdf, other]

Title: Vocoder drift in x-vector-based speaker anonymization

Michele Panariello, Massimiliano Todisco, Nicholas Evans

Comments: Accepted at INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS)

[43] arXiv:2306.02972 [pdf, other]

Title: Simultaneous or Sequential Training? How Speech Representations Cooperate in a Multi-Task Self-Supervised Learning System

Khazar Khorrami, María Andrea Cruz Blandón, Tuomas Virtanen, Okko Räsänen

Comments: 5 pages, accepted by EUSIPCO 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[44] arXiv:2306.03014 [pdf, other]

Title: On the Behavior of Intrusive and Non-intrusive Speech Enhancement Metrics in Predictive and Generative Settings

Danilo de Oliveira, Julius Richter, Jean-Marie Lemercier, Tal Peer, Timo Gerkmann

Comments: Submitted to ITG Conference on Speech Communication

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[45] arXiv:2306.03258 [pdf, html, other]

Title: LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading

Yochai Yemini, Aviv Shamsian, Lior Bracha, Sharon Gannot, Ethan Fetaya

Comments: ICLR 2024

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[46] arXiv:2306.03465 [pdf, other]

Title: A generative framework for conversational laughter: Its 'language model' and laughter sound synthesis

Hiroki Mori, Shunya Kimura

Comments: Submitted to INTERSPEECH

Journal-ref: Proc. Interspeech 2023 (2023) 3372-3376

Subjects: Audio and Speech Processing (eess.AS)

[47] arXiv:2306.03509 [pdf, other]

Title: Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias

Ziyue Jiang, Yi Ren, Zhenhui Ye, Jinglin Liu, Chen Zhang, Qian Yang, Shengpeng Ji, Rongjie Huang, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[48] arXiv:2306.03664 [pdf, other]

Title: Experimenting with Additive Margins for Contrastive Self-Supervised Speaker Verification

Theo Lepage, Reda Dehak

Comments: accepted at INTERSPEECH 2023, 20th-24th August 2023, Dublin, Ireland

Journal-ref: Proc. INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[49] arXiv:2306.03773 [pdf, other]

Title: Some voices are too common: Building fair speech recognition systems using the Common Voice dataset

Lucas Maison, Yannick Estève

Comments: 5 pages, 3 figures. Accepted to Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[50] arXiv:2306.03778 [pdf, other]

Title: Streaming Speech-to-Confusion Network Speech Recognition

Denis Filimonov, Prabhat Pandey, Ariya Rastrow, Ankur Gandhe, Andreas Stolcke

Comments: Submitted to Interspeech 2023

Journal-ref: Proc. Interspeech, Aug. 2023, pp. 4099-4103

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[51] arXiv:2306.03789 [pdf, other]

Title: On the Robustness of Arabic Speech Dialect Identification

Peter Sullivan, AbdelRahim Elmadany, Muhammad Abdul-Mageed

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[52] arXiv:2306.04054 [pdf, other]

Title: RescueSpeech: A German Corpus for Speech Recognition in Search and Rescue Domain

Sangeet Sagar, Mirco Ravanelli, Bernd Kiefer, Ivana Kruijff Korbayova, Josef van Genabith

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[53] arXiv:2306.04186 [pdf, other]

Title: Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Tasks

Xian Li, Nian Shao, Xiaofei Li

Comments: Submitted to IEEE TASLP. arXiv admin note: text overlap with arXiv:2204.12076

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[54] arXiv:2306.04987 [pdf, other]

Title: Convolutional Recurrent Neural Network with Attention for 3D Speech Enhancement

Han Yin, Jisheng Bai, Mou Wang, Siwei Huang, Yafei Jia, Jianfeng Chen

Comments: Published on IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC 2023)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[55] arXiv:2306.05004 [pdf, other]

Title: VIFS: An End-to-End Variational Inference for Foley Sound Synthesis

Junhyeok Lee, Hyeonuk Nam, Yong-Hwa Park

Comments: DCASE 2023 Challenge Task 7

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[56] arXiv:2306.05245 [pdf, other]

Title: Matching Latent Encoding for Audio-Text based Keyword Spotting

Kumari Nishu, Minsik Cho, Devang Naik

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[57] arXiv:2306.05446 [pdf, other]

Title: Latent Phrase Matching for Dysarthric Speech

Colin Lea, Dianna Yee, Jaya Narain, Zifang Huang, Lauren Tooley, Jeffrey P. Bigham, Leah Findlater

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[58] arXiv:2306.05621 [pdf, other]

Title: Acoustic Scene Clustering Using Joint Optimization of Deep Embedding Learning and Clustering Iteration

Yanxiong Li, Mingle Liu, Wucheng Wang, Yuhan Zhang, Qianhua He

Comments: 9 pages, 6 figures, 11 tables. Accepted for publication in IEEE TMM

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[59] arXiv:2306.05624 [pdf, other]

Title: Domestic Activities Classification from Audio Recordings Using Multi-scale Dilated Depthwise Separable Convolutional Network

Yufei Zeng, Yanxiong Li, Zhenfeng Zhou, Ruiqi Wang, Difeng Lu

Comments: 5 pages, 2 figures, 4 tables. Accepted for publication in IEEE MMSP2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[60] arXiv:2306.05709 [pdf, other]

Title: Learning Emotional Representations from Imbalanced Speech Data for Speech Emotion Recognition and Emotional Text-to-Speech

Shijun Wang, Jón Guðnason, Damian Borth

Comments: Accepted by INTERSPEECH2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[61] arXiv:2306.05812 [pdf, other]

Title: HRTF upsampling with a generative adversarial network using a gnomonic equiangular projection

Aidan O. T. Hogg, Mads Jenkins, He Liu, Isaac Squires, Samuel J. Cooper, Lorenzo Picinali

Comments: 15 pages, 9 figures, Preprint (Accepted to IEEE/ACM Transactions on Audio, Speech, and Language Processing on the 15 Feb 2024)

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[62] arXiv:2306.05861 [pdf, other]

Title: Efficient Encoder-Decoder and Dual-Path Conformer for Comprehensive Feature Learning in Speech Enhancement

Junyu Wang

Comments: Accepted at Interspeech2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[63] arXiv:2306.05887 [pdf, other]

Title: An Efficient Speech Separation Network Based on Recurrent Fusion Dilated Convolution and Channel Attention

Junyu Wang

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[64] arXiv:2306.05915 [pdf, other]

Title: Speaker Embeddings as Individuality Proxy for Voice Stress Detection

Zihan Wu, Neil Scheidwasser-Clow, Karl El Hajal, Milos Cernak

Comments: 5 pages, 2 figures. Accepted at Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[65] arXiv:2306.06461 [pdf, other]

Title: Semi-supervsied Learning-based Sound Event Detection using Freuqency Dynamic Convolution with Large Kernel Attention for DCASE Challenge 2023 Task 4

Ji Won Kim, Sang Won Son, Yoonah Song, Hong Kook Kim, Il Hoon Song, Jeong Eun Lim

Comments: DCASE 2023 Challenge Task 4A, 5 pages

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[66] arXiv:2306.06495 [pdf, other]

Title: Audio-Visual Speech Enhancement With Selective Off-Screen Speech Extraction

Tomoya Yoshinaga, Keitaro Tanaka, Shigeo Morishima

Comments: Accepted by EUSIPCO 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[67] arXiv:2306.06524 [pdf, other]

Title: What Can an Accent Identifier Learn? Probing Phonetic and Prosodic Information in a Wav2vec2-based Accent Identification Model

Mu Yang, Ram C. M. C. Shekar, Okim Kang, John H. L. Hansen

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[68] arXiv:2306.06814 [pdf, other]

Title: HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models

Ji-Sang Hwang, Sang-Hoon Lee, Seong-Whan Lee

Comments: 11 pages, 5 figures, 5 tables, under review

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[69] arXiv:2306.06954 [pdf, other]

Title: Multi-View Frequency-Attention Alternative to CNN Frontends for Automatic Speech Recognition

Belen Alastruey, Lukas Drude, Jahn Heymann, Simon Wiesler

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[70] arXiv:2306.07090 [pdf, other]

Title: Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformation

Jinzi Qi, Hugo Van hamme

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Quantitative Methods (q-bio.QM)

[71] arXiv:2306.07489 [pdf, other]

Title: PauseSpeech: Natural Speech Synthesis via Pre-trained Language Model and Pause-based Prosody Modeling

Ji-Sang Hwang, Sang-Hoon Lee, Seong-Whan Lee

Comments: 13 pages, 4 figures, 3 tables, under reivew

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP)

[72] arXiv:2306.07501 [pdf, other]

Title: Speaker Verification Across Ages: Investigating Deep Speaker Embedding Sensitivity to Age Mismatch in Enrollment and Test Speech

Vishwanath Pratap Singh, Md Sahidullah, Tomi Kinnunen

Journal-ref: Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[73] arXiv:2306.07562 [pdf, html, other]

Title: Statistical Beamformer Exploiting Non-stationarity and Sparsity with Spatially Constrained ICA for Robust Speech Recognition

Ui-Hyeop Shin, Hyung-Min Park

Comments: Accepted by TASLP

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[74] arXiv:2306.07655 [pdf, other]

Title: Malafide: a novel adversarial convolutive noise attack against deepfake and spoofing detection systems

Michele Panariello, Wanying Ge, Hemlata Tak, Massimiliano Todisco, Nicholas Evans

Comments: Accepted at INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[75] arXiv:2306.07691 [pdf, other]

Title: StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

Yinghao Aaron Li, Cong Han, Vinay S. Raghavan, Gavin Mischler, Nima Mesgarani

Comments: NeurIPS 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)