Audio and Speech Processing

Authors and titles for September 2022

[1] arXiv:2209.00423 [pdf, other]

Title: Spoofing-Aware Attention based ASV Back-end with Multiple Enrollment Utterances and a Sampling Strategy for the SASV Challenge 2022

Chang Zeng, Lin Zhang, Meng Liu, Junichi Yamagishi

Comments: Accepted by InterSpeech2022

Subjects: Audio and Speech Processing (eess.AS)

[2] arXiv:2209.00485 [pdf, other]

Title: Joint Speaker Encoder and Neural Back-end Model for Fully End-to-End Automatic Speaker Verification with Multiple Enrollment Utterances

Chang Zeng, Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi

Comments: Submitted to TASLP

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[3] arXiv:2209.00506 [pdf, other]

Title: On the potential of jointly-optimised solutions to spoofing attack detection and automatic speaker verification

Wanying Ge, Hemlata Tak, Massimiliano Todisco, Nicholas Evans

Comments: Accepted to IberSPEECH 2022 Conference

Subjects: Audio and Speech Processing (eess.AS)

[4] arXiv:2209.00619 [pdf, other]

Title: diaLogic: Non-Invasive Speaker-Focused Data Acquisition for Team Behavior Modeling

Ryan Duke, Alex Doboli

Subjects: Audio and Speech Processing (eess.AS)

[5] arXiv:2209.00733 [pdf, other]

Title: A Wavelet Transform Based Scheme to Extract Speech Pitch and Formant Frequencies

Seyedamiryousef Hosseini Goki, Mahdieh Ghazvini, Sajad Hamzenejadi

Journal-ref: 2019 7th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[6] arXiv:2209.00805 [pdf, other]

Title: Multi-scale temporal-frequency attention for music source separation

Lianwu Chen, Xiguang Zheng, Chen Zhang, Liang Guo, Bing Yu

Subjects: Audio and Speech Processing (eess.AS)

[7] arXiv:2209.00934 [pdf, other]

Title: TB or not TB? Acoustic cough analysis for tuberculosis classification

Geoffrey Frost, Grant Theron, Thomas Niesler

Comments: Accepted for publication at Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[8] arXiv:2209.00937 [pdf, other]

Title: Inverse-free Online Independent Vector Analysis with Flexible Iterative Source Steering

Taishi Nakashima, Nobutaka Ono

Comments: 5 pages, 2 figures. Submitted to APSIPA 2022

Subjects: Audio and Speech Processing (eess.AS)

[9] arXiv:2209.01702 [pdf, other]

Title: Time-domain speech super-resolution with GAN based modeling for telephony speaker verification

Saurabh Kataria, Jesús Villalba, Laureano Moro-Velázquez, Piotr Żelasko, Najim Dehak

Comments: Submit to IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS)

[10] arXiv:2209.01762 [pdf, other]

Title: Movement Detection of Tongue and Related Body Parts Using IR-UWB Radar

Sunghwa Lee, Younghoon Shin

Comments: Submitted to the 13th International Conference on ICT Convergence (ICTC)

Subjects: Audio and Speech Processing (eess.AS)

[11] arXiv:2209.01802 [pdf, other]

Title: Sound Event Localization and Detection for Real Spatial Sound Scenes: Event-Independent Network and Data Augmentation Chains

Jinbo Hu, Yin Cao, Ming Wu, Qiuqiang Kong, Feiran Yang, Mark D. Plumbley, Jun Yang

Comments: Submitted to DCASE 2022 Workshop. Code is available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[12] arXiv:2209.01978 [pdf, other]

Title: Investigation into Target Speaking Rate Adaptation for Voice Conversion

Michael Kuhlmann, Fritz Seebauer, Janek Ebbers, Petra Wagner, Reinhold Haeb-Umbach

Comments: Accepted to INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS)

[13] arXiv:2209.04175 [pdf, other]

Title: Streaming Target-Speaker ASR with Neural Transducer

Takafumi Moriya, Hiroshi Sato, Tsubasa Ochiai, Marc Delcroix, Takahiro Shinozaki

Comments: Accepted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[14] arXiv:2209.04473 [pdf, other]

Title: Reconstructing the Dynamic Directivity of Unconstrained Speech

Camille Noufi, Dejan Markovic, Peter Dodds

Comments: In proceedings of I3DA 2023 - The 2023 International Conference on Immersive and 3D Audio. DOI coming soon

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[15] arXiv:2209.04974 [pdf, other]

Title: VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition

Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Comments: 6 pages, 2 figure, 3 tables, v2: Appendix A has been added

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[16] arXiv:2209.05110 [pdf, other]

Title: Continuous head-related transfer function representation based on hyperspherical harmonics

Adam Szwajcowski

Comments: Submitted to Archives of Acoustics 4.06.2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[17] arXiv:2209.05161 [pdf, other]

Title: How Much Does Prosody Help Turn-taking? Investigations using Voice Activity Projection Models

Erik Ekstedt, Gabriel Skantze

Comments: SIGDIAL 2022 Best Paper Award Winner

Subjects: Audio and Speech Processing (eess.AS)

[18] arXiv:2209.05273 [pdf, other]

Title: The 2022 Far-field Speaker Verification Challenge: Exploring domain mismatch and semi-supervised learning under the far-field scenario

Xiaoyi Qin, Ming Li, Hui Bu, Shrikanth Narayanan, Haizhou Li

Subjects: Audio and Speech Processing (eess.AS)

[19] arXiv:2209.05281 [pdf, other]

Title: Modeling Dependent Structure for Utterances in ASR Evaluation

Zhe Liu, Fuchun Peng

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[20] arXiv:2209.05735 [pdf, other]

Title: Learning ASR pathways: A sparse multilingual ASR model

Mu Yang, Andros Tjandra, Chunxi Liu, David Zhang, Duc Le, Ozlem Kalinli

Comments: Accepted by ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[21] arXiv:2209.06058 [pdf, other]

Title: Streaming End-to-End Multilingual Speech Recognition with Joint Language Identification

Chao Zhang, Bo Li, Tara Sainath, Trevor Strohman, Sepand Mavandadi, Shuo-yiin Chang, Parisa Haghani

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[22] arXiv:2209.06265 [pdf, other]

Title: Automated detection of pronunciation errors in non-native English speech employing deep learning

Daniel Korzekwa

Comments: PhD Thesis, in English + extended summary in Polish

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Other Quantitative Biology (q-bio.OT)

[23] arXiv:2209.06337 [pdf, other]

Title: Deep Speech Synthesis from Articulatory Representations

Peter Wu, Shinji Watanabe, Louis Goldstein, Alan W Black, Gopala K. Anumanchipalli

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Quantitative Methods (q-bio.QM)

[24] arXiv:2209.06410 [pdf, other]

Title: A Universally-Deployable ASR Frontend for Joint Acoustic Echo Cancellation, Speech Enhancement, and Voice Separation

Tom O'Malley, Arun Narayanan, Quan Wang

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[25] arXiv:2209.06581 [pdf, other]

Title: Applying wav2vec2 for Speech Recognition on Bengali Common Voices Dataset

H.A.Z. Sameen Shahgir, Khondker Salman Sayeed, Tanjeem Azwad Zaman

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[26] arXiv:2209.06789 [pdf, other]

Title: Decoupled Pronunciation and Prosody Modeling in Meta-Learning-Based Multilingual Speech Synthesis

Yukun Peng, Zhenhua Ling

Comments: Submitted to Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS)

[27] arXiv:2209.06913 [pdf, other]

Title: ESSumm: Extractive Speech Summarization from Untranscribed Meeting

Jun Wang

Comments: Interspeech 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[28] arXiv:2209.07180 [pdf, other]

Title: Open Challenges in Synthetic Speech Detection

Luca Cuccovillo, Christoforos Papastergiopoulos, Anastasios Vafeiadis, Artem Yaroshchuk, Patrick Aichroth, Konstantinos Votis, Dimitrios Tzovaras

Journal-ref: in IEEE International Workshop on Information Forensics and Security (WIFS), December 12-16, 2022, Shanghai, China, pp.1-6

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[29] arXiv:2209.07196 [pdf, other]

Title: Environment Classification via Blind Roomprints Estimation

Malte Baum, Luca Cuccovillo, Artem Yaroshchuk, Patrick Aichroth

Journal-ref: in IEEE International Workshop on Information Forensics and Security (WIFS), December 12-16, 2022, Shanghai, China, pp.1-6

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[30] arXiv:2209.07548 [pdf, html, other]

Title: Open Set Recognition For Music Genre Classification

Kevin Liu, Julien DeMori, Kobi Abayomi

Comments: 9 pages, 5 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Optimization and Control (math.OC)

[31] arXiv:2209.08119 [pdf, other]

Title: An Automatic Speech Recognition System for Bengali Language based on Wav2Vec2 and Transfer Learning

Tushar Talukder Showrav

Comments: BUET DL Sprint, 4 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[32] arXiv:2209.08326 [pdf, other]

Title: Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition

Ye Bai, Jie Li, Wenjing Han, Hao Ni, Kaituo Xu, Zhuo Zhang, Cheng Yi, Xiaorui Wang

Comments: accepted in INTERSPEECH 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[33] arXiv:2209.08379 [pdf, other]

Title: Representation Learning Strategies to Model Pathological Speech: Effect of Multiple Spectral Resolutions

Gabriel Figueiredo Miller, Juan Camilo Vásquez-Correa, Juan Rafael Orozco-Arroyave, Elmar Nöth

Comments: 7 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Quantitative Methods (q-bio.QM)

[34] arXiv:2209.09512 [pdf, other]

Title: A Combined Model for Noise Reduction of Lung Sound Signals Based on Empirical Mode Decomposition and Artificial Neural Network

Mozhde Firoozi Pouyani, Mansour Vali, Mohammad Amin Ghasemi

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[35] arXiv:2209.09756 [pdf, other]

Title: ESPnet-ONNX: Bridging a Gap Between Research and Production

Masao Someki, Yosuke Higuchi, Tomoki Hayashi, Shinji Watanabe

Comments: Accepted to APSIPA ASC 2022

Subjects: Audio and Speech Processing (eess.AS)

[36] arXiv:2209.09967 [pdf, other]

Title: Language-based Audio Retrieval Task in DCASE 2022 Challenge

Huang Xie, Samuel Lipping, Tuomas Virtanen

Comments: Update for arXiv:2206.06108 mistakenly submitted as a new article

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[37] arXiv:2209.10088 [pdf, other]

Title: Boosting Star-GANs for Voice Conversion with Contrastive Discriminator

Shijing Si, Jianzong Wang, Xulong Zhang, Xiaoyang Qu, Ning Cheng, Jing Xiao

Comments: 12 pages, 3 figures, Accepted by ICONIP 2022

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

[38] arXiv:2209.10147 [pdf, other]

Title: The ReturnZero System for VoxCeleb Speaker Recognition Challenge 2022

Sangwon Suh, Sunjong Park

Comments: 4 pages, 4 tables, technical report

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

[39] arXiv:2209.10357 [pdf, other]

Title: GIST-AiTeR System for the Diarization Task of the 2022 VoxCeleb Speaker Recognition Challenge

Dongkeon Park, Yechan Yu, Kyeong Wan Park, Ji Won Kim, Hong Kook Kim

Comments: 2022 VoxSRC Track4

Subjects: Audio and Speech Processing (eess.AS)

[40] arXiv:2209.10446 [pdf, other]

Title: Mandarin Singing Voice Synthesis with Denoising Diffusion Probabilistic Wasserstein GAN

Yin-Ping Cho, Yu Tsao, Hsin-Min Wang, Yi-Wen Liu

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[41] arXiv:2209.10479 [pdf, other]

Title: An Initial study on Birdsong Re-synthesis Using Neural Vocoders

Rhythm Bhatia, Tomi H. Kinnunen

Comments: To appear in 24th International Conference on Speech and Computer (SPECOM), GURUGRAM, INDIA

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[42] arXiv:2209.10591 [pdf, other]

Title: Assessing ASR Model Quality on Disordered Speech using BERTScore

Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek

Comments: Accepted to Interspeech 2022 Workshop on Speech for Social Good

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[43] arXiv:2209.10890 [pdf, other]

Title: EPIC TTS Models: Empirical Pruning Investigations Characterizing Text-To-Speech Models

Perry Lam, Huayun Zhang, Nancy F. Chen, Berrak Sisman

Journal-ref: Interspeech 2022, 823-827 (2022)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[44] arXiv:2209.11061 [pdf, other]

Title: Cross-domain Voice Activity Detection with Self-Supervised Representations

Sina Alisamir, Fabien Ringeval, Francois Portet

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[45] arXiv:2209.11296 [pdf, other]

Title: Isolation performance metrics for personal sound zone reproduction systems

Yue Qiao, Léo Guadagnin, Edgar Choueiri

Subjects: Audio and Speech Processing (eess.AS)

[46] arXiv:2209.11433 [pdf, other]

Title: The Kriston AI System for the VoxCeleb Speaker Recognition Challenge 2022

Qutang Cai, Guoqiang Hong, Zhijian Ye, Ximin Li, Haizhou Li

Comments: System description of VoxSRC 2022: track 1, 2 and 4

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[47] arXiv:2209.11494 [pdf, other]

Title: MMS-MSG: A Multi-purpose Multi-Speaker Mixture Signal Generator

Tobias Cord-Landwehr, Thilo von Neumann, Christoph Boeddeker, Reinhold Haeb-Umbach

Comments: Accepted at IWAENC 2022

Subjects: Audio and Speech Processing (eess.AS)

[48] arXiv:2209.11666 [pdf, other]

Title: Stereo InSE-NET: Stereo Audio Quality Predictor Transfer Learned from Mono InSE-NET

Arijit Biswas, Guanxin Jiang

Comments: Accepted to 153rd Audio Engineering Society (AES), New York, NY, USA, October 2022

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[49] arXiv:2209.11866 [pdf, html, other]

Title: ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed

Meiying Chen, Zhiyao Duan

Comments: Audio samples: this https URL Code: this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[50] arXiv:2209.11969 [pdf, other]

Title: NWPU-ASLP System for the VoicePrivacy 2022 Challenge

Jixun Yao, Qing Wang, Li Zhang, Pengcheng Guo, Yuhao Liang, Lei Xie

Comments: VoicePrivacy 2022 Challenge

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[51] arXiv:2209.12002 [pdf, other]

Title: Spatial-aware Speaker Diarization for Multi-channel Multi-party Meeting

Jie Wang, Yuji Liu, Binling Wang, Yiming Zhi, Song Li, Shipeng Xia, Jiayang Zhang, Feng Tong, Lin Li, Qingyang Hong

Comments: Accepted by Interspeech 2022. arXiv admin note: text overlap with arXiv:2202.05744

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[52] arXiv:2209.12702 [pdf, other]

Title: End-to-End Lyrics Recognition with Self-supervised Learning

Xiangyu Zhang, Shuyue Stella Li, Zhanhong He, Roberto Togneri, Leibny Paola Garcia

Comments: 4 pages, 2 figures, 3 tables

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[53] arXiv:2209.12826 [pdf, other]

Title: Multi-encoder attention-based architectures for sound recognition with partial visual assistance

Wim Boes, Hugo Van hamme

Comments: Submitted to EURASIP Journal on Audio, Speech, and Music Processing

Journal-ref: EURASIP Journal on Audio, Speech, and Music Processing; 2022; 25

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

[54] arXiv:2209.12843 [pdf, other]

Title: Impact of temporal resolution on convolutional recurrent networks for audio tagging and sound event detection

Wim Boes, Hugo Van hamme

Comments: Submitted to DCASE 2022 Workshop

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[55] arXiv:2209.13112 [pdf, other]

Title: Automated Sex Classification of Children's Voices and Changes in Differentiating Factors with Age

Fuling Chen, Roberto Togneri, Murray Maybery, Diana Weiting Tan

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[56] arXiv:2209.13146 [pdf, other]

Title: Predicting Affective Vocal Bursts with Finetuned wav2vec 2.0

Bagus Tris Atmaja, Akira Sasou

Subjects: Audio and Speech Processing (eess.AS)

[57] arXiv:2209.13211 [pdf, other]

Title: Hyperbolic Timbre Embedding for Musical Instrument Sound Synthesis Based on Variational Autoencoders

Futa Nakashima, Tomohiko Nakamura, Norihiro Takamune, Satoru Fukayama, Hiroshi Saruwatari

Comments: 8 pages, 4 figures, to be published in Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2022

Journal-ref: 2022 Asia Pacific Signal and Information Processing Association Annual Summit and Conference

Subjects: Audio and Speech Processing (eess.AS)

[58] arXiv:2209.14150 [pdf, other]

Title: Speech Enhancement Using Self-Supervised Pre-Trained Model and Vector Quantization

Xiao-Ying Zhao, Qiu-Shi Zhu, Jie Zhang

Comments: Accepted to APSIPA ASC 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[59] arXiv:2209.14275 [pdf, other]

Title: Audio Retrieval with WavText5K and CLAP Training

Soham Deshmukh, Benjamin Elizalde, Huaming Wang

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[60] arXiv:2209.14335 [pdf, other]

Title: Text Independent Speaker Identification System for Access Control

Oluyemi E. Adetoyi

Comments: 4 pages

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[61] arXiv:2209.15032 [pdf, other]

Title: Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0

Marie Kunešová, Markéta Řezáčková

Comments: This preprint is a pre-review version of the paper and does not contain any post-submission improvements or corrections. The Version of Record of this contribution is published in the proceedings of the International Conference on Text, Speech, and Dialogue (TSD 2022), LNAI volume 13502, and is available online at this https URL

Journal-ref: International Conference on Text, Speech, and Dialogue (TSD 2022), LNAI volume 13502

Subjects: Audio and Speech Processing (eess.AS)

[62] arXiv:2209.15174 [pdf, other]

Title: Music Source Separation with Band-split RNN

Yi Luo, Jianwei Yu

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[63] arXiv:2209.15449 [pdf, other]

Title: End-to-End Label Uncertainty Modeling in Speech Emotion Recognition using Bayesian Neural Networks and Label Distribution Learning

Navin Raj Prabhu, Nale Lehmann-Willenbrock, Timo Gerkman

Comments: Accepted Paper at IEEE Transactions on Affective Computing, June 2023. Contains main paper with supplementary material. arXiv admin note: text overlap with arXiv:2207.12135

Journal-ref: IEEE Transactions on Affective Computing, June 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[64] arXiv:2209.15472 [pdf, other]

Title: Binaural Speech Enhancement Using STOI-Optimal Masks

Vikas Tokala, Mike Brookes, Patrick A. Naylor

Comments: Accepted at IWAENC 2022

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[65] arXiv:2209.00130 (cross-list from cs.SD) [pdf, other]

Title: Evaluating generative audio systems and their metrics

Ashvala Vinay, Alexander Lerch

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[66] arXiv:2209.00182 (cross-list from cs.SD) [pdf, other]

Title: What is missing in deep music generation? A study of repetition and structure in popular music

Shuqi Dai, Huiran Yu, Roger B. Dannenberg

Comments: In Proceedings of the 23rd Int. Society for Music Information Retrieval (ISMIR) 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[67] arXiv:2209.00260 (cross-list from cs.CL) [pdf, other]

Title: Deep Sparse Conformer for Speech Recognition

Xianchao Wu

Comments: 5 pages, 1 figure

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2209.00261 (cross-list from cs.CL) [pdf, other]

Title: Attention Enhanced Citrinet for Speech Recognition

Xianchao Wu

Comments: 5 pages, 3 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2209.00277 (cross-list from cs.CV) [pdf, other]

Title: Video-Guided Curriculum Learning for Spoken Video Grounding

Yan Xia, Zhou Zhao, Shangwei Ye, Yang Zhao, Haoyuan Li, Yi Ren

Comments: Accepted by ACM MM 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[70] arXiv:2209.00291 (cross-list from cs.SD) [pdf, other]

Title: Generating Coherent Drum Accompaniment With Fills And Improvisations

Rishabh Dahale, Vaibhav Talwadker, Preeti Rao, Prateek Verma

Comments: 8 pages, 7 figures, 23rd International Society for Music Information Retrieval Conference (ISMIR 2022), Bengaluru, India

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[71] arXiv:2209.00353 (cross-list from cs.SD) [pdf, other]

Title: AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System

Li Yi, Haochen Hu, Jingwei Zhao, Gus Xia

Comments: Accepted by ISMIR 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[72] arXiv:2209.00642 (cross-list from cs.CV) [pdf, other]

Title: Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild

Sindhu B Hegde, K R Prajwal, Rudrabha Mukhopadhyay, Vinay P Namboodiri, C. V. Jawahar

Comments: Accepted in ACM-MM 2022, 9 pages, 2 pages supplementary, 7 Figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2209.01250 (cross-list from cs.CL) [pdf, other]

Title: Improving Contextual Recognition of Rare Words with an Alternate Spelling Prediction Model

Jennifer Drexler Fox, Natalie Delworth

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[74] arXiv:2209.01374 (cross-list from cs.SD) [pdf, other]

Title: Identify The Beehive Sound Using Deep Learning

Shah Jafor Sadeek Quaderi, Sadia Afrin Labonno, Sadia Mostafa, Shamim Akhter

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[75] arXiv:2209.01478 (cross-list from cs.SD) [pdf, other]

Title: Equivariant Self-Supervision for Musical Tempo Estimation

Elio Quinton

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[76] arXiv:2209.01751 (cross-list from cs.SD) [pdf, other]

Title: Exploiting Pre-trained Feature Networks for Generative Adversarial Networks in Audio-domain Loop Generation

Yen-Tung Yeh, Bo-Yu Chen, Yi-Hsuan Yang

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[77] arXiv:2209.01768 (cross-list from cs.MM) [pdf, other]

Title: Predict-and-Update Network: Audio-Visual Speech Recognition Inspired by Human Speech Perception

Jiadong Wang, Xinyuan Qian, Haizhou Li

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2209.01996 (cross-list from cs.SD) [pdf, other]

Title: Bridging Music and Text with Crowdsourced Music Comments: A Sequence-to-Sequence Framework for Thematic Music Comments Generation

Peining Zhang, Junliang Guo, Linli Xu, Mu You, Junming Yin

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[79] arXiv:2209.02030 (cross-list from cs.CL) [pdf, other]

Title: Distilling the Knowledge of BERT for CTC-based ASR

Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2209.02604 (cross-list from cs.MM) [pdf, other]

Title: Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

Yihe Liu, Ziqi Yuan, Huisheng Mao, Zhiyun Liang, Wanqiuyue Yang, Yuanzhe Qiu, Tie Cheng, Xiaoteng Li, Hua Xu, Kai Gao

Comments: 16pages, 7 figures, accepted by ICMI 2022

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[81] arXiv:2209.02696 (cross-list from cs.SD) [pdf, other]

Title: Instrument Separation of Symbolic Music by Explicitly Guided Diffusion Model

Sangjun Han, Hyeongrae Ihm, DaeHan Ahn, Woohyung Lim

Comments: Submitted to NeurIPS 2022 Workshop on Machine Learning for Creativity and Design

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[82] arXiv:2209.02768 (cross-list from eess.IV) [pdf, other]

Title: Prospectively accelerated dynamic speech MRI at 3 Tesla using a self-navigated spiral based manifold regularized scheme

Rushdi Zahid Rusho, Abdul Haseeb Ahmed, Stanley Kruger, Wahidul Alam, David Meyer, David Howard, Brad Story, Mathews Jacob, Sajan Goud Lingala

Comments: 32 pages, 10 figures

Subjects: Image and Video Processing (eess.IV); Audio and Speech Processing (eess.AS); Medical Physics (physics.med-ph)

[83] arXiv:2209.02785 (cross-list from cs.SD) [pdf, other]

Title: Read it to me: An emotionally aware Speech Narration Application

Rishibha Bansal

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[84] arXiv:2209.02855 (cross-list from cs.SD) [pdf, other]

Title: The Role of Vocal Persona in Natural and Synthesized Speech

Camille Noufi, Lloyd May, Jonathan Berger

Comments: To be published in the proceedings of the 17th IEEE International Conference on Automatic Face and Gesture Recognition as part of the Workshop on Socially Interactive Human-like Virtual Agents (SIVA '23)

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[85] arXiv:2209.02871 (cross-list from cs.SD) [pdf, other]

Title: Improving Choral Music Separation through Expressive Synthesized Data from Sampled Instruments

Ke Chen, Hao-Wen Dong, Yi Luo, Julian McAuley, Taylor Berg-Kirkpatrick, Miller Puckette, Shlomo Dubnov

Comments: Camera Ready for Proceedings of the 23rd International Society for Music Information Retrieval Conference, ISMIR 2022

Journal-ref: The 23rd International Society for Music Information Retrieval Conference, 2022

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[86] arXiv:2209.03143 (cross-list from cs.SD) [pdf, other]

Title: AudioLM: a Language Modeling Approach to Audio Generation

Zalán Borsos, Raphaël Marinier, Damien Vincent, Eugene Kharitonov, Olivier Pietquin, Matt Sharifi, Dominik Roblek, Olivier Teboul, David Grangier, Marco Tagliasacchi, Neil Zeghidour

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[87] arXiv:2209.03275 (cross-list from cs.SD) [pdf, html, other]

Title: Multimodal Speech Enhancement Using Burst Propagation

Mohsin Raza, Leandro A. Passos, Ahmed Khubaib, Ahsan Adeel

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[88] arXiv:2209.03338 (cross-list from cs.MM) [pdf, other]

Title: ESSYS* Sharing #UC: An Emotion-driven Audiovisual Installation

Sérgio M. Rebelo, Mariana Seiça, Pedro Martins, João Bicker, Penousal Machado

Comments: Paper to be published in 2022 IEEE VIS Arts Program (VISAP 2022). For the associated supplementary materials, see this https URL

Journal-ref: 2022 IEEE VIS Arts Program (VISAP 2022)

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[89] arXiv:2209.03711 (cross-list from cs.SD) [pdf, other]

Title: What Did I Just Hear? Detecting Pornographic Sounds in Adult Videos Using Neural Networks

Holy Lovenia, Dessi Puji Lestari, Rita Frieske

Comments: Published in AudioMostly 2022, ACM

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[90] arXiv:2209.03727 (cross-list from cs.SD) [pdf, other]

Title: Developing a multi-variate prediction model for the detection of COVID-19 from Crowd-sourced Respiratory Voice Data

Wafaa Aljbawi, Sami O. Simmons, Visara Urovi

Comments: 9 pages, 6 figures, poster presented at the European Respiratory Society, Barcelona, September 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[91] arXiv:2209.03787 (cross-list from cs.CL) [pdf, other]

Title: Goodness of Pronunciation Pipelines for OOV Problem

Ankit Grover

Comments: 47 pages, 24 Figures, 1 Table

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2209.03807 (cross-list from cs.SD) [pdf, other]

Title: Hardware Accelerator and Neural Network Co-Optimization for Ultra-Low-Power Audio Processing Devices

Christoph Gerum, Adrian Frischknecht, Tobias Hald, Paul Palomero Bernardo, Konstantin Lübeck, Oliver Bringmann

Comments: Accepted Version for: EUROMICRO DSD 2022

Subjects: Sound (cs.SD); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[93] arXiv:2209.03901 (cross-list from cs.SD) [pdf, other]

Title: Dyadic Interaction Assessment from Free-living Audio for Depression Severity Assessment

Bishal Lamichhane, Nidal Moukaddam, Ankit B. Patel, Ashutosh Sabharwal

Comments: Accepted to INTERSPEECH 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[94] arXiv:2209.03952 (cross-list from cs.SD) [pdf, other]

Title: TF-GridNet: Making Time-Frequency Domain Models Great Again for Monaural Speaker Separation

Zhong-Qiu Wang, Samuele Cornell, Shukjae Choi, Younglo Lee, Byeong-Yeol Kim, Shinji Watanabe

Comments: in IEEE ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[95] arXiv:2209.04062 (cross-list from cs.CL) [pdf, other]

Title: Non-autoregressive Error Correction for CTC-based ASR with Phone-conditioned Masked LM

Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara

Comments: Accepted in Interspeech2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[96] arXiv:2209.04071 (cross-list from cs.AI) [pdf, other]

Title: Audio Analytics-based Human Trafficking Detection Framework for Autonomous Vehicles

Sagar Dasgupta, Kazi Shakib, Mizanur Rahman, Silvana V Croope, Steven Jones

Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2209.04075 (cross-list from cs.SD) [pdf, other]

Title: Improving the Environmental Perception of Autonomous Vehicles using Deep Learning-based Audio Classification

Finley Walden, Sagar Dasgupta, Mizanur Rahman, Mhafuzul Islam

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[98] arXiv:2209.04077 (cross-list from cs.SD) [pdf, other]

Title: Prediction method of Soundscape Impressions using Environmental Sounds and Aerial Photographs

Yusuke Ono, Sunao Hara, Masanobu Abe

Comments: Submitted APSIPA ASC 2022

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[99] arXiv:2209.04093 (cross-list from cs.CV) [pdf, other]

Title: Learning Audio-Visual embedding for Person Verification in the Wild

Peiwen Sun, Shanshan Zhang, Zishan Liu, Yougen Yuan, Taotao Zhang, Honggang Zhang, Pengfei Hu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[100] arXiv:2209.04109 (cross-list from cs.SD) [pdf, other]

Title: MATT: A Multiple-instance Attention Mechanism for Long-tail Music Genre Classification

Xiaokai Liu, Menghua Zhang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)