Audio and Speech Processing

Authors and titles for September 2022

[51] arXiv:2209.12002 [pdf, other]

Title: Spatial-aware Speaker Diarization for Multi-channel Multi-party Meeting

Jie Wang, Yuji Liu, Binling Wang, Yiming Zhi, Song Li, Shipeng Xia, Jiayang Zhang, Feng Tong, Lin Li, Qingyang Hong

Comments: Accepted by Interspeech 2022. arXiv admin note: text overlap with arXiv:2202.05744

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[52] arXiv:2209.12702 [pdf, other]

Title: End-to-End Lyrics Recognition with Self-supervised Learning

Xiangyu Zhang, Shuyue Stella Li, Zhanhong He, Roberto Togneri, Leibny Paola Garcia

Comments: 4 pages, 2 figures, 3 tables

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[53] arXiv:2209.12826 [pdf, other]

Title: Multi-encoder attention-based architectures for sound recognition with partial visual assistance

Wim Boes, Hugo Van hamme

Comments: Submitted to EURASIP Journal on Audio, Speech, and Music Processing

Journal-ref: EURASIP Journal on Audio, Speech, and Music Processing; 2022; 25

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

[54] arXiv:2209.12843 [pdf, other]

Title: Impact of temporal resolution on convolutional recurrent networks for audio tagging and sound event detection

Wim Boes, Hugo Van hamme

Comments: Submitted to DCASE 2022 Workshop

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[55] arXiv:2209.13112 [pdf, other]

Title: Automated Sex Classification of Children's Voices and Changes in Differentiating Factors with Age

Fuling Chen, Roberto Togneri, Murray Maybery, Diana Weiting Tan

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[56] arXiv:2209.13146 [pdf, other]

Title: Predicting Affective Vocal Bursts with Finetuned wav2vec 2.0

Bagus Tris Atmaja, Akira Sasou

Subjects: Audio and Speech Processing (eess.AS)

[57] arXiv:2209.13211 [pdf, other]

Title: Hyperbolic Timbre Embedding for Musical Instrument Sound Synthesis Based on Variational Autoencoders

Futa Nakashima, Tomohiko Nakamura, Norihiro Takamune, Satoru Fukayama, Hiroshi Saruwatari

Comments: 8 pages, 4 figures, to be published in Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2022

Journal-ref: 2022 Asia Pacific Signal and Information Processing Association Annual Summit and Conference

Subjects: Audio and Speech Processing (eess.AS)

[58] arXiv:2209.14150 [pdf, other]

Title: Speech Enhancement Using Self-Supervised Pre-Trained Model and Vector Quantization

Xiao-Ying Zhao, Qiu-Shi Zhu, Jie Zhang

Comments: Accepted to APSIPA ASC 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[59] arXiv:2209.14275 [pdf, other]

Title: Audio Retrieval with WavText5K and CLAP Training

Soham Deshmukh, Benjamin Elizalde, Huaming Wang

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[60] arXiv:2209.14335 [pdf, other]

Title: Text Independent Speaker Identification System for Access Control

Oluyemi E. Adetoyi

Comments: 4 pages

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[61] arXiv:2209.15032 [pdf, other]

Title: Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0

Marie Kunešová, Markéta Řezáčková

Comments: This preprint is a pre-review version of the paper and does not contain any post-submission improvements or corrections. The Version of Record of this contribution is published in the proceedings of the International Conference on Text, Speech, and Dialogue (TSD 2022), LNAI volume 13502, and is available online at this https URL

Journal-ref: International Conference on Text, Speech, and Dialogue (TSD 2022), LNAI volume 13502

Subjects: Audio and Speech Processing (eess.AS)

[62] arXiv:2209.15174 [pdf, other]

Title: Music Source Separation with Band-split RNN

Yi Luo, Jianwei Yu

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[63] arXiv:2209.15449 [pdf, other]

Title: End-to-End Label Uncertainty Modeling in Speech Emotion Recognition using Bayesian Neural Networks and Label Distribution Learning

Navin Raj Prabhu, Nale Lehmann-Willenbrock, Timo Gerkman

Comments: Accepted Paper at IEEE Transactions on Affective Computing, June 2023. Contains main paper with supplementary material. arXiv admin note: text overlap with arXiv:2207.12135

Journal-ref: IEEE Transactions on Affective Computing, June 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[64] arXiv:2209.15472 [pdf, other]

Title: Binaural Speech Enhancement Using STOI-Optimal Masks

Vikas Tokala, Mike Brookes, Patrick A. Naylor

Comments: Accepted at IWAENC 2022

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[65] arXiv:2209.00130 (cross-list from cs.SD) [pdf, other]

Title: Evaluating generative audio systems and their metrics

Ashvala Vinay, Alexander Lerch

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[66] arXiv:2209.00182 (cross-list from cs.SD) [pdf, other]

Title: What is missing in deep music generation? A study of repetition and structure in popular music

Shuqi Dai, Huiran Yu, Roger B. Dannenberg

Comments: In Proceedings of the 23rd Int. Society for Music Information Retrieval (ISMIR) 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[67] arXiv:2209.00260 (cross-list from cs.CL) [pdf, other]

Title: Deep Sparse Conformer for Speech Recognition

Xianchao Wu

Comments: 5 pages, 1 figure

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2209.00261 (cross-list from cs.CL) [pdf, other]

Title: Attention Enhanced Citrinet for Speech Recognition

Xianchao Wu

Comments: 5 pages, 3 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2209.00277 (cross-list from cs.CV) [pdf, other]

Title: Video-Guided Curriculum Learning for Spoken Video Grounding

Yan Xia, Zhou Zhao, Shangwei Ye, Yang Zhao, Haoyuan Li, Yi Ren

Comments: Accepted by ACM MM 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[70] arXiv:2209.00291 (cross-list from cs.SD) [pdf, other]

Title: Generating Coherent Drum Accompaniment With Fills And Improvisations

Rishabh Dahale, Vaibhav Talwadker, Preeti Rao, Prateek Verma

Comments: 8 pages, 7 figures, 23rd International Society for Music Information Retrieval Conference (ISMIR 2022), Bengaluru, India

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[71] arXiv:2209.00353 (cross-list from cs.SD) [pdf, other]

Title: AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System

Li Yi, Haochen Hu, Jingwei Zhao, Gus Xia

Comments: Accepted by ISMIR 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[72] arXiv:2209.00642 (cross-list from cs.CV) [pdf, other]

Title: Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild

Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay, Vinay P Namboodiri, C. V. Jawahar

Comments: Accepted in ACM-MM 2022, 9 pages, 2 pages supplementary, 7 Figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2209.01250 (cross-list from cs.CL) [pdf, other]

Title: Improving Contextual Recognition of Rare Words with an Alternate Spelling Prediction Model

Jennifer Drexler Fox, Natalie Delworth

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[74] arXiv:2209.01374 (cross-list from cs.SD) [pdf, other]

Title: Identify The Beehive Sound Using Deep Learning

Shah Jafor Sadeek Quaderi, Sadia Afrin Labonno, Sadia Mostafa, Shamim Akhter

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[75] arXiv:2209.01478 (cross-list from cs.SD) [pdf, other]

Title: Equivariant Self-Supervision for Musical Tempo Estimation

Elio Quinton

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[76] arXiv:2209.01751 (cross-list from cs.SD) [pdf, other]

Title: Exploiting Pre-trained Feature Networks for Generative Adversarial Networks in Audio-domain Loop Generation

Yen-Tung Yeh, Bo-Yu Chen, Yi-Hsuan Yang

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[77] arXiv:2209.01768 (cross-list from cs.MM) [pdf, other]

Title: Predict-and-Update Network: Audio-Visual Speech Recognition Inspired by Human Speech Perception

Jiadong Wang, Xinyuan Qian, Haizhou Li

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2209.01996 (cross-list from cs.SD) [pdf, other]

Title: Bridging Music and Text with Crowdsourced Music Comments: A Sequence-to-Sequence Framework for Thematic Music Comments Generation

Peining Zhang, Junliang Guo, Linli Xu, Mu You, Junming Yin

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[79] arXiv:2209.02030 (cross-list from cs.CL) [pdf, other]

Title: Distilling the Knowledge of BERT for CTC-based ASR

Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2209.02604 (cross-list from cs.MM) [pdf, other]

Title: Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

Yihe Liu, Ziqi Yuan, Huisheng Mao, Zhiyun Liang, Wanqiuyue Yang, Yuanzhe Qiu, Tie Cheng, Xiaoteng Li, Hua Xu, Kai Gao

Comments: 16pages, 7 figures, accepted by ICMI 2022

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[81] arXiv:2209.02696 (cross-list from cs.SD) [pdf, other]

Title: Instrument Separation of Symbolic Music by Explicitly Guided Diffusion Model

Sangjun Han, Hyeongrae Ihm, DaeHan Ahn, Woohyung Lim

Comments: Submitted to NeurIPS 2022 Workshop on Machine Learning for Creativity and Design

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[82] arXiv:2209.02768 (cross-list from eess.IV) [pdf, other]

Title: Prospectively accelerated dynamic speech MRI at 3 Tesla using a self-navigated spiral based manifold regularized scheme

Rushdi Zahid Rusho, Abdul Haseeb Ahmed, Stanley Kruger, Wahidul Alam, David Meyer, David Howard, Brad Story, Mathews Jacob, Sajan Goud Lingala

Comments: 32 pages, 10 figures

Subjects: Image and Video Processing (eess.IV); Audio and Speech Processing (eess.AS); Medical Physics (physics.med-ph)

[83] arXiv:2209.02785 (cross-list from cs.SD) [pdf, other]

Title: Read it to me: An emotionally aware Speech Narration Application

Rishibha Bansal

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[84] arXiv:2209.02855 (cross-list from cs.SD) [pdf, other]

Title: The Role of Vocal Persona in Natural and Synthesized Speech

Camille Noufi, Lloyd May, Jonathan Berger

Comments: To be published in the proceedings of the 17th IEEE International Conference on Automatic Face and Gesture Recognition as part of the Workshop on Socially Interactive Human-like Virtual Agents (SIVA '23)

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[85] arXiv:2209.02871 (cross-list from cs.SD) [pdf, other]

Title: Improving Choral Music Separation through Expressive Synthesized Data from Sampled Instruments

Ke Chen, Hao-Wen Dong, Yi Luo, Julian McAuley, Taylor Berg-Kirkpatrick, Miller Puckette, Shlomo Dubnov

Comments: Camera Ready for Proceedings of the 23rd International Society for Music Information Retrieval Conference, ISMIR 2022

Journal-ref: The 23rd International Society for Music Information Retrieval Conference, 2022

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[86] arXiv:2209.03143 (cross-list from cs.SD) [pdf, other]

Title: AudioLM: a Language Modeling Approach to Audio Generation

Zalán Borsos, Raphaël Marinier, Damien Vincent, Eugene Kharitonov, Olivier Pietquin, Matt Sharifi, Dominik Roblek, Olivier Teboul, David Grangier, Marco Tagliasacchi, Neil Zeghidour

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[87] arXiv:2209.03275 (cross-list from cs.SD) [pdf, html, other]

Title: Multimodal Speech Enhancement Using Burst Propagation

Mohsin Raza, Leandro A. Passos, Ahmed Khubaib, Ahsan Adeel

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[88] arXiv:2209.03338 (cross-list from cs.MM) [pdf, other]

Title: ESSYS* Sharing #UC: An Emotion-driven Audiovisual Installation

Sérgio M. Rebelo, Mariana Seiça, Pedro Martins, João Bicker, Penousal Machado

Comments: Paper to be published in 2022 IEEE VIS Arts Program (VISAP 2022). For the associated supplementary materials, see this https URL

Journal-ref: 2022 IEEE VIS Arts Program (VISAP 2022)

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[89] arXiv:2209.03711 (cross-list from cs.SD) [pdf, other]

Title: What Did I Just Hear? Detecting Pornographic Sounds in Adult Videos Using Neural Networks

Holy Lovenia, Dessi Puji Lestari, Rita Frieske

Comments: Published in AudioMostly 2022, ACM

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[90] arXiv:2209.03727 (cross-list from cs.SD) [pdf, other]

Title: Developing a multi-variate prediction model for the detection of COVID-19 from Crowd-sourced Respiratory Voice Data

Wafaa Aljbawi, Sami O. Simmons, Visara Urovi

Comments: 9 pages, 6 figures, poster presented at the European Respiratory Society, Barcelona, September 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[91] arXiv:2209.03787 (cross-list from cs.CL) [pdf, other]

Title: Goodness of Pronunciation Pipelines for OOV Problem

Ankit Grover

Comments: 47 pages, 24 Figures, 1 Table

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2209.03807 (cross-list from cs.SD) [pdf, other]

Title: Hardware Accelerator and Neural Network Co-Optimization for Ultra-Low-Power Audio Processing Devices

Christoph Gerum, Adrian Frischknecht, Tobias Hald, Paul Palomero Bernardo, Konstantin Lübeck, Oliver Bringmann

Comments: Accepted Version for: EUROMICRO DSD 2022

Subjects: Sound (cs.SD); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[93] arXiv:2209.03901 (cross-list from cs.SD) [pdf, other]

Title: Dyadic Interaction Assessment from Free-living Audio for Depression Severity Assessment

Bishal Lamichhane, Nidal Moukaddam, Ankit B. Patel, Ashutosh Sabharwal

Comments: Accepted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[94] arXiv:2209.03952 (cross-list from cs.SD) [pdf, other]

Title: TF-GridNet: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separation

Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe

Comments: in IEEE ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[95] arXiv:2209.04062 (cross-list from cs.CL) [pdf, other]

Title: Non-autoregressive Error Correction for CTC-based ASR with Phone-conditioned Masked LM

Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara

Comments: Accepted in Interspeech2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[96] arXiv:2209.04071 (cross-list from cs.AI) [pdf, other]

Title: Audio Analytics-based Human Trafficking Detection Framework for Autonomous Vehicles

Sagar Dasgupta, Kazi Shakib, Mizanur Rahman, Silvana V Croope, Steven Jones

Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2209.04075 (cross-list from cs.SD) [pdf, other]

Title: Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification

Finley Walden, Sagar Dasgupta, Mizanur Rahman, Mhafuzul Islam

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[98] arXiv:2209.04077 (cross-list from cs.SD) [pdf, other]

Title: Prediction method of Soundscape Impressions using Environmental Sounds and Aerial Photographs

Yusuke Ono, Sunao Hara, Masanobu Abe

Comments: Submitted APSIPA ASC 2022

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[99] arXiv:2209.04093 (cross-list from cs.CV) [pdf, other]

Title: Learning Audio-Visual embedding for Person Verification in the Wild

Peiwen Sun, Shanshan Zhang, Zishan Liu, Yougen Yuan, Taotao Zhang, Honggang Zhang, Pengfei Hu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[100] arXiv:2209.04109 (cross-list from cs.SD) [pdf, other]

Title: MATT: A Multiple-instance Attention Mechanism for Long-tail Music Genre Classification

Xiaokai Liu, Menghua Zhang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)