Audio and Speech Processing

Authors and titles for June 2023

[351] arXiv:2306.15464 (cross-list from cs.SD) [pdf, other]

Title: Large-scale unsupervised audio pre-training for video-to-speech synthesis

Triantafyllos Kefalas, Yannis Panagakis, Maja Pantic

Comments: Corrected typos. This work has been submitted to the IEEE for possible publication

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[352] arXiv:2306.15808 (cross-list from cs.MM) [pdf, other]

Title: Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data

Kai Chieh Chang, Mark Hasegawa-Johnson, Nancy L. McElwain, Bashima Islam

Comments: Preprint for APSIPA2023

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[353] arXiv:2306.15875 (cross-list from cs.SD) [pdf, other]

Title: Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion

Zhe Ye, Terui Mao, Li Dong, Diqun Yan

Comments: Accepted by INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, pp. 4923-4927

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[354] arXiv:2306.15942 (cross-list from cs.SD) [pdf, other]

Title: Enhanced Neural Beamformer with Spatial Information for Target Speech Extraction

Aoqi Guo, Junnan Wu, Peng Gao, Wenbo Zhu, Qinwen Guo, Dazhi Gao, Yujun Wang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[355] arXiv:2306.16003 (cross-list from cs.GR) [pdf, html, other]

Title: Text-driven Talking Face Synthesis by Reprogramming Audio-driven Models

Jeongsoo Choi, Minsu Kim, Se Jin Park, Yong Man Ro

Comments: ICASSP 2024

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[356] arXiv:2306.16007 (cross-list from cs.CL) [pdf, other]

Title: Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition

Yuang Li, Yu Wu, Jinyu Li, Shujie Liu

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[357] arXiv:2306.16009 (cross-list from cs.CL) [pdf, other]

Title: Accelerating Transducers through Adjacent Token Merging

Yuang Li, Yu Wu, Jinyu Li, Shujie Liu

Comments: Interspeech 2023

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[358] arXiv:2306.16022 (cross-list from cs.SD) [pdf, html, other]

Title: Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound

Xinfeng Li, Junning Ze, Chen Yan, Yushi Cheng, Xiaoyu Ji, Wenyuan Xu

Comments: Published in Internet of Things Journal (IoT-J)

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[359] arXiv:2306.16054 (cross-list from cs.SD) [pdf, other]

Title: Improving Primate Sounds Classification using Binary Presorting for Deep Learning

Michael Kölle, Steffen Illium, Maximilian Zorn, Jonas Nüßlein, Patrick Suchostawski, Claudia Linnhoff-Popien

Comments: DeLTA

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[360] arXiv:2306.16081 (cross-list from cs.SD) [pdf, other]

Title: Graph neural networks for sound source localization on distributed microphone networks

Eric Grinstein, Mike Brookes, Patrick A. Naylor

Comments: Presented as a poster at ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[361] arXiv:2306.16083 (cross-list from cs.SD) [pdf, other]

Title: UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data

Heeseung Kim, Sungwon Kim, Jiheum Yeom, Sungroh Yoon

Comments: INTERSPEECH 2023, Oral

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[362] arXiv:2306.16241 (cross-list from cs.SD) [pdf, other]

Title: Focus on the Sound around You: Monaural Target Speaker Extraction via Distance and Speaker Information

Jiuxin Lin, Peng Wang, Heinrich Dinkel, Jun Chen, Zhiyong Wu, Zhiyong Yan, Yongqing Wang, Junbo Zhang, Yujun Wang

Comments: Proc. INTERSPEECH 2023, 2488-2492, doi: https://doi.org/10.21437/Interspeech.2023-218

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[363] arXiv:2306.16250 (cross-list from cs.SD) [pdf, other]

Title: MC-SpEx: Towards Effective Speaker Extraction with Multi-Scale Interfusion and Conditional Speaker Modulation

Jun Chen, Wei Rao, Zilin Wang, Jiuxin Lin, Yukai Ju, Shulin He, Yannan Wang, Zhiyong Wu

Comments: Accepted by InterSpeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[364] arXiv:2306.16398 (cross-list from cs.SD) [pdf, other]

Title: Cascaded encoders for fine-tuning ASR models on overlapped speech

Richard Rose, Oscar Chang, Olivier Siohan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[365] arXiv:2306.16710 (cross-list from cs.CL) [pdf, other]

Title: Automatic Speech Recognition of Non-Native Child Speech for Language Learning Applications

Simone Wills, Yu Bai, Cristian Tejedor-Garcia, Catia Cucchiarini, Helmer Strik

Comments: Published on SLATE 2023, Esmad, Politecnico Do Porto, Portugal, 26-28 June, 2023, pp: 11:1-11:8

Journal-ref: 12th Symposium on Languages, Applications and Technologies (SLATE 2023) (p. 7:1-7:8)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[366] arXiv:2306.16760 (cross-list from cs.SD) [pdf, other]

Title: Transfer Learning with Semi-Supervised Dataset Annotation for Birdcall Classification

Anthony Miyaguchi, Nathan Zhong, Murilo Gustineli, Chris Hayduk

Comments: BirdCLEF working note submission to Multimedia Retrieval in Nature (LifeCLEF) for CLEF 2023

Journal-ref: CEUR-WS Vol-3497 (2023) 2091-2106

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[367] arXiv:2306.16903 (cross-list from cs.CL) [pdf, other]

Title: Leveraging Cross-Utterance Context For ASR Decoding

Robert Flynn, Anton Ragni

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[368] arXiv:2306.16955 (cross-list from cs.SD) [pdf, other]

Title: Predicting Music Hierarchies with a Graph-Based Neural Decoder

Francesco Foscarin, Daniel Harasim, Gerhard Widmer

Comments: To be published in the Proceedings of the International Society for Music Information Retrieval Conference (ISMIR)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[369] arXiv:2306.16962 (cross-list from cs.SD) [pdf, other]

Title: Speech-based Age and Gender Prediction with Transformers

Felix Burkhardt, Johannes Wagner, Hagen Wierstorf, Florian Eyben, Björn Schuller

Comments: 5 pages, submitted to 15th ITG Conference on Speech Communication

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[370] arXiv:2306.16967 (cross-list from cs.SD) [pdf, other]

Title: On the relevance of acoustic measurements for creating realistic virtual acoustic environments

Siegfried Gündert, Stephan D. Ewert, Steven van de Par

Comments: This work has been submitted to the I3DA 2023 International Conference (IEEE Xplore Digital Library) for possible publication

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Medical Physics (physics.med-ph)

[371] arXiv:2306.17103 (cross-list from cs.CL) [pdf, html, other]

Title: LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPT

Le Zhuo, Ruibin Yuan, Jiahao Pan, Yinghao Ma, Yizhi LI, Ge Zhang, Si Liu, Roger Dannenberg, Jie Fu, Chenghua Lin, Emmanouil Benetos, Wei Xue, Yike Guo

Comments: 9 pages, 2 figures, 5 tables, accepted by ISMIR 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[372] arXiv:2306.17203 (cross-list from cs.SD) [pdf, other]

Title: Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

Simian Luo, Chuanhao Yan, Chenxu Hu, Hang Zhao

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[373] arXiv:2306.17424 (cross-list from cs.SD) [pdf, other]

Title: Audio Embeddings as Teachers for Music Classification

Yiwei Ding, Alexander Lerch

Comments: Accepted at the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 9 pages, 2 figures

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[374] arXiv:2306.17477 (cross-list from cs.SD) [pdf, html, other]

Title: Beyond-Voice: Towards Continuous 3D Hand Pose Tracking on Commercial Home Assistant Devices

Yin Li, Rohan Reddy, Cheng Zhang, Rajalakshmi Nandakumar

Comments: Accepted by IPSN 2024

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[375] arXiv:2306.17500 (cross-list from cs.SD) [pdf, other]

Title: Empirical Interpretation of the Relationship Between Speech Acoustic Context and Emotion Recognition

Anna Ollerenshaw, Md Asif Jalal, Rosanna Milner, Thomas Hain

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[376] arXiv:2306.17670 (cross-list from cs.NE) [pdf, html, other]

Title: Learning Delays in Spiking Neural Networks using Dilated Convolutions with Learnable Spacings

Ilyass Hammouamri, Ismail Khalfaoui-Hassani, Timothée Masquelier

Journal-ref: ICLR 2024

Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[377] arXiv:2306.17792 (cross-list from cs.CL) [pdf, other]

Title: Towards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibition

Andrei-Marius Avram, Răzvan-Alexandru Smădu, Vasile Păiş, Dumitru-Clementin Cercel, Radu Ion, Dan Tufiş

Comments: Accepted at TSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[378] arXiv:2306.17799 (cross-list from cs.CV) [pdf, html, other]

Title: A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition

Yuntao Shou, Huan Liu, Xiangyong Cao, Deyu Meng, Bo Dong

Comments: 13 pages, 5 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)