Audio and Speech Processing

Authors and titles for February 2022

[151] arXiv:2202.05718 (cross-list from cs.SD) [pdf, other]

Title: Audio Defect Detection in Music with Deep Networks

Daniel Wolff, Rémi Mignot, Axel Roebel

Comments: 6 pages

Journal-ref: Proceedings of the 22nd International Society for Music Information Retrieval Conference, Online, 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[152] arXiv:2202.05725 (cross-list from cs.CR) [pdf, other]

Title: On the Detection of Adaptive Adversarial Attacks in Speaker Verification Systems

Zesheng Chen

Journal-ref: IEEE Internet of Things Journal, 2023

Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[153] arXiv:2202.05756 (cross-list from cs.SD) [pdf, other]

Title: A Novel Speech Intelligibility Enhancement Model based on CanonicalCorrelation and Deep Learning

Tassadaq Hussain, Muhammad Diyan, Mandar Gogate, Kia Dashtipour, Ahsan Adeel, Yu Tsao, Amir Hussain

Comments: arXiv admin note: substantial text overlap with arXiv:2202.04172

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[154] arXiv:2202.05817 (cross-list from cs.SD) [pdf, other]

Title: The HaMSE Ontology: Using Semantic Technologies to support Music Representation Interoperability and Musicological Analysis

Andrea Poltronieri, Aldo Gangemi

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[155] arXiv:2202.05993 (cross-list from cs.SD) [pdf, other]

Title: Wav2Vec2.0 on the Edge: Performance Evaluation

Santosh Gondi

Comments: 9 pages

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[156] arXiv:2202.06034 (cross-list from cs.SD) [pdf, other]

Title: Deep Performer: Score-to-Audio Music Performance Synthesis

Hao-Wen Dong, Cong Zhou, Taylor Berg-Kirkpatrick, Julian McAuley

Comments: ICASSP 2022 final version with appendix

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[157] arXiv:2202.06045 (cross-list from cs.CL) [pdf, other]

Title: USTED: Improving ASR with a Unified Speech and Text Encoder-Decoder

Bolaji Yusuf, Ankur Gandhe, Alex Sokolov

Comments: 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2022)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[158] arXiv:2202.06180 (cross-list from cs.SD) [pdf, other]

Title: Learning long-term music representations via hierarchical contextual constraints

Shiqi Wei, Gus Xia

Comments: Accepted by ISMIR2021

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[159] arXiv:2202.06369 (cross-list from cs.LG) [pdf, other]

Title: Incremental user embedding modeling for personalized text classification

Ruixue Lian, Che-Wei Huang, Yuqing Tang, Qilong Gu, Chengyuan Ma, Chenlei Guo

Comments: Accepted to International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[160] arXiv:2202.06406 (cross-list from cs.CV) [pdf, other]

Title: Visual Sound Localization in the Wild by Cross-Modal Interference Erasing

Xian Liu, Rui Qian, Hang Zhou, Di Hu, Weiyao Lin, Ziwei Liu, Bolei Zhou, Xiaowei Zhou

Comments: Accepted by AAAI Conference on Artificial Intelligence (AAAI) 2022. 16 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[161] arXiv:2202.06707 (cross-list from eess.SP) [pdf, other]

Title: Spiking Cochlea with System-level Local Automatic Gain Control

Ilya Kiselev, Chang Gao, Shih-Chii Liu

Comments: Accepted for publication at the IEEE Transactions on Circuits and Systems I - Regular Papers, 2022

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[162] arXiv:2202.06850 (cross-list from cs.SD) [pdf, other]

Title: Multi-Task Deep Residual Echo Suppression with Echo-aware Loss

Shimin Zhang, Ziteng Wang, Jiayao Sun, Yihui Fu, Biao Tian, Qiang Fu, Lei Xie

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2202.06875 (cross-list from cs.CV) [pdf, other]

Title: Visual Acoustic Matching

Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman

Comments: Project page: this https URL. Accepted at CVPR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2202.07219 (cross-list from cs.SD) [pdf, other]

Title: Multi-style Training for South African Call Centre Audio

Walter Heymans, Marelie H. Davel, Charl van Heerden

Comments: 9 pages, 8 tables, Southern African Conference for Artificial Intelligence Research 2021, Part of the Communications in Computer and Information Science book series (CCIS, volume 1551, pp 111-124), Springer

Journal-ref: Artificial Intelligence Research 2022

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[165] arXiv:2202.07273 (cross-list from cs.SD) [pdf, other]

Title: SpeechPainter: Text-conditioned Speech Inpainting

Zalán Borsos, Matt Sharifi, Marco Tagliasacchi

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[166] arXiv:2202.07359 (cross-list from cs.CL) [pdf, other]

Title: textless-lib: a Library for Textless Spoken Language Processing

Eugene Kharitonov, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Paden Tomasello, Ann Lee, Ali Elkahky, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi

Comments: The library is available here this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[167] arXiv:2202.07382 (cross-list from cs.SD) [pdf, other]

Title: Phase Vocoder Done Right

Zdenek Prusa, Nicki Holighaus

Subjects: Sound (cs.SD); Mathematical Software (cs.MS); Audio and Speech Processing (eess.AS)

[168] arXiv:2202.07428 (cross-list from eess.IV) [pdf, other]

Title: Learning Contextually Fused Audio-visual Representations for Audio-visual Speech Recognition

Zi-Qiang Zhang, Jie Zhang, Jian-Shu Zhang, Ming-Hui Wu, Xin Fang, Li-Rong Dai

Comments: 5 pages

Subjects: Image and Video Processing (eess.IV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2202.07479 (cross-list from cs.SD) [pdf, other]

Title: Audio Inpainting via $\ell_1$-Minimization and Dictionary Learning

Shristi Rajbamshi, Georg Tauböck, Peter Balazs, Nicki Holighaus

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2202.07484 (cross-list from cs.SD) [pdf, other]

Title: Phase-Based Signal Representations for Scattering

Daniel Haider, Peter Balazs, Nicki Holighaus

Journal-ref: 29th European Signal Processing Conference (EUSIPCO) 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[171] arXiv:2202.07498 (cross-list from cs.SD) [pdf, other]

Title: Non-iterative Filter Bank Phase (Re)Construction

Zdeněk Průša, Nicki Holighaus

Subjects: Sound (cs.SD); Mathematical Software (cs.MS); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[172] arXiv:2202.07765 (cross-list from cs.LG) [pdf, other]

Title: General-purpose, long-context autoregressive modeling with Perceiver AR

Curtis Hawthorne, Andrew Jaegle, Cătălina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, João Carreira, Jesse Engel

Comments: ICML 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2202.07790 (cross-list from cs.SD) [pdf, other]

Title: Speech Denoising in the Waveform Domain with Self-Attention

Zhifeng Kong, Wei Ping, Ambrish Dantrey, Bryan Catanzaro

Comments: Published in ICASSP 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Listen to audio samples from CleanUNet at: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[174] arXiv:2202.07841 (cross-list from cs.SD) [pdf, other]

Title: Learning Deep Direct-Path Relative Transfer Function for Binaural Sound Source Localization

Bing Yang, Hong Liu, Xiaofei Li

Comments: Accepted by TASLP 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2202.07855 (cross-list from cs.SD) [pdf, other]

Title: Conversational Speech Recognition By Learning Conversation-level Characteristics

Kun Wei, Yike Zhang, Sining Sun, Lei Xie, Long Ma

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[176] arXiv:2202.07859 (cross-list from cs.SD) [pdf, other]

Title: SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localization

Bing Yang, Hong Liu, Xiaofei Li

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[177] arXiv:2202.07894 (cross-list from cs.CL) [pdf, other]

Title: Knowledge Transfer from Large-scale Pretrained Language Models to End-to-end Speech Recognizers

Yotaro Kubo, Shigeki Karita, Michiel Bacchiani

Comments: To be presented in ICASSP 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[178] arXiv:2202.07907 (cross-list from cs.SD) [pdf, other]

Title: Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesis

Tao Wang, Ruibo Fu, Jiangyan Yi, Jianhua Tao, Zhengqi Wen

Comments: 5 pages, 7 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[179] arXiv:2202.07931 (cross-list from cs.SD) [pdf, other]

Title: DBT-Net: Dual-branch federative magnitude and phase estimation with attention-in-attention transformer for monaural speech enhancement

Guochen Yu, Andong Li, Hui Wang, Yutian Wang, Yuxuan Ke, Chengshi Zheng

Comments: 15 pages;Accepted by IEEE/ACM Trans. Audio. Speech, Lang. Process

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[180] arXiv:2202.07968 (cross-list from cs.SD) [pdf, other]

Title: On loss functions and evaluation metrics for music source separation

Enric Gusó, Jordi Pons, Santiago Pascual, Joan Serrà

Comments: Accepted to ICASSP 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[181] arXiv:2202.07991 (cross-list from cs.SD) [pdf, other]

Title: ADIMA: Abuse Detection In Multilingual Audio

Vikram Gupta, Rini Sharon, Ramit Sawhney, Debdoot Mukherjee

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[182] arXiv:2202.08183 (cross-list from eess.SP) [pdf, other]

Title: Increasing loudness in audio signals: a perceptually motivated approach to preserve audio quality

A. Jeannerot, N. de Koeijer, P. Martínez-Nuevo, M. B. Møller, J. Dyreby, P. Prandoni

Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS)

[183] arXiv:2202.08423 (cross-list from cs.SD) [pdf, other]

Title: Chord-Conditioned Melody Harmonization with Controllable Harmonicity

Shangda Wu, Xiaobing Li, Maosong Sun

Comments: 5 pages, 7 figures, accepted by ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[184] arXiv:2202.08433 (cross-list from cs.SD) [pdf, html, other]

Title: ADD 2022: the First Audio Deep Synthesis Detection Challenge

Jiangyan Yi, Ruibo Fu, Jianhua Tao, Shuai Nie, Haoxin Ma, Chenglong Wang, Tao Wang, Zhengkun Tian, Xiaohui Zhang, Ye Bai, Cunhang Fan, Shan Liang, Shiming Wang, Shuai Zhang, Xinrui Yan, Le Xu, Zhengqi Wen, Haizhou Li, Zheng Lian, Bin Liu

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[185] arXiv:2202.08509 (cross-list from cs.SD) [pdf, other]

Title: A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning

Hengshun Zhou, Jun Du, Chao-Han Huck Yang, Shifu Xiong, Chin-Hui Lee

Comments: Accepted to ICASSP 2022. H. Zhou et al

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[186] arXiv:2202.08862 (cross-list from cs.SD) [pdf, other]

Title: RemixIT: Continual self-training of speech enhancement models via bootstrapped remixing

Efthymios Tzinis, Yossi Adi, Vamsi Krishna Ithapu, Buye Xu, Paris Smaragdis, Anurag Kumar

Comments: To appear in IEEE Journal of Selected Topics in Signal Processing

Journal-ref: J-STSP-SLSAP-00040-2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[187] arXiv:2202.08898 (cross-list from cs.SD) [pdf, other]

Title: Word Embeddings for Automatic Equalization in Audio Mixing

Satvik Venkatesh, David Moffat, Eduardo Reck Miranda

Comments: 10 pages, 5 Figures, 3 tables; More experimental validation; Published in the Journal of the Audio Engineering Society

Journal-ref: J.Audio.Eng.Soc. 70 (2022) 753-763

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[188] arXiv:2202.08900 (cross-list from cs.SD) [pdf, other]

Title: Attributable-Watermarking of Speech Generative Models

Yongbaek Cho, Changhoon Kim, Yezhou Yang, Yi Ren

Comments: Accepted to International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[189] arXiv:2202.08974 (cross-list from cs.SD) [pdf, other]

Title: Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models

Sarala Padi, Seyed Omid Sadjadi, Dinesh Manocha, Ram D. Sriram

Comments: arXiv admin note: substantial text overlap with arXiv:2108.02510

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Robotics (cs.RO); Audio and Speech Processing (eess.AS)

[190] arXiv:2202.08981 (cross-list from cs.SD) [pdf, other]

Title: A Summary of the ComParE COVID-19 Challenges

Harry Coppock, Alican Akman, Christian Bergler, Maurice Gerczuk, Chloë Brown, Jagmohan Chauhan, Andreas Grammenos, Apinan Hasthanasombat, Dimitris Spathis, Tong Xia, Pietro Cicuta, Jing Han, Shahin Amiriparian, Alice Baird, Lukas Stappen, Sandra Ottl, Panagiotis Tzirakis, Anton Batliner, Cecilia Mascolo, Björn W. Schuller

Comments: 18 pages, 13 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[191] arXiv:2202.09003 (cross-list from cs.CL) [pdf, other]

Title: End-to-end contextual asr based on posterior distribution adaptation for hybrid ctc/attention system

Zhengyi Zhang, Pan Zhou

Comments: 5 pages, 5 tabels, 1 figure

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[192] arXiv:2202.09102 (cross-list from cs.SD) [pdf, other]

Title: Predicting Sex and Stroke Success -- Computer-aided Player Grunt Analysis in Tennis Matches

Lukas Stappen, Manuel Milling, Valentin Munst, Korakot Hoffmann, Bjorn W. Schuller

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[193] arXiv:2202.09108 (cross-list from cs.CL) [pdf, other]

Title: Large-Scale Acoustic Characterization of Singaporean Children's English Pronunciation

Yuling Gu, Nancy F. Chen

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[194] arXiv:2202.09198 (cross-list from cs.SD) [pdf, other]

Title: Deep-Learning Architectures for Multi-Pitch Estimation: Towards Reliable Evaluation

Christof Weiß, Geoffroy Peeters

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[195] arXiv:2202.09619 (cross-list from cs.SD) [pdf, other]

Title: Evaluation of Neuromorphic Spike Encoding of Sound Using Information Theory

Ahmad El Ferdaoussi, Éric Plourde, Jean Rouat

Comments: 10 pages, 7 figures, internal report

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[196] arXiv:2202.09729 (cross-list from cs.SD) [pdf, other]

Title: It's Raw! Audio Generation with State-Space Models

Karan Goel, Albert Gu, Chris Donahue, Christopher Ré

Comments: 23 pages, 7 figures, 7 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[197] arXiv:2202.09750 (cross-list from cs.SD) [pdf, other]

Title: Enhancing Affective Representations of Music-Induced EEG through Multimodal Supervision and latent Domain Adaptation

Kleanthis Avramidis, Christos Garoufis, Athanasia Zlatintsi, Petros Maragos

Comments: 5 pages, 3 figures, IEEE ICASSP 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[198] arXiv:2202.09907 (cross-list from cs.SD) [pdf, other]

Title: towards automatic transcription of polyphonic electric guitar music:a new dataset and a multi-loss transformer model

Yu-Hua Chen, Wen-Yi Hsiao, Tsu-Kuang Hsieh, Jyh-Shing Roger Jang, Yi-Hsuan Yang

Comments: to be published at ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[199] arXiv:2202.09950 (cross-list from cs.SD) [pdf, other]

Title: CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editing

Tao Wang, Jiangyan Yi, Ruibo Fu, Jianhua Tao, Zhengqi Wen

Comments: under review, 14 pages, 14 figures, demo page is available at this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[200] arXiv:2202.10020 (cross-list from cs.SD) [pdf, other]

Title: AVQVC: One-shot Voice Conversion by Vector Quantization with applying contrastive learning

Huaizhen Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: 4 pages paper

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)