Audio and Speech Processing

Authors and titles for February 2022

[101] arXiv:2202.00874 (cross-list from cs.SD) [pdf, other]

Title: HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection

Ke Chen, Xingjian Du, Bilei Zhu, Zejun Ma, Taylor Berg-Kirkpatrick, Shlomo Dubnov

Comments: Preprint version for ICASSP 2022, Singapore

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[102] arXiv:2202.00875 (cross-list from eess.SP) [pdf, other]

Title: ISS2: An Extension of Iterative Source Steering Algorithm for Majorization-Minimization-Based Independent Vector Analysis

Rintaro Ikeshita, Tomohiro Nakatani

Comments: Accepted for publication in the 30th European Signal Processing Conference (EUSIPCO 2022)

Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS)

[103] arXiv:2202.01078 (cross-list from cs.SD) [pdf, other]

Title: Melody Extraction from Polyphonic Music by Deep Learning Approaches: A Review

Gurunath Reddy M, K. Sreenivasa Rao, Partha Pratim Das

Comments: 72 pages

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[104] arXiv:2202.01107 (cross-list from cs.CL) [pdf, other]

Title: Keyword localisation in untranscribed speech using visually grounded speech models

Kayode Olaleye, Dan Oneata, Herman Kamper

Comments: 10 figures, 5 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[105] arXiv:2202.01286 (cross-list from cs.CL) [pdf, other]

Title: ASR-Aware End-to-end Neural Diarization

Aparna Khare, Eunjung Han, Yuguang Yang, Andreas Stolcke

Comments: To appear in ICASSP 2022

Journal-ref: Proc. IEEE ICASSP, May 2022, pp. 8092-8096

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[106] arXiv:2202.01367 (cross-list from cs.SD) [pdf, other]

Title: Real-time Emergency Vehicle Event Detection Using Audio Data

Zubayer Islam, Mohamed Abdel-Aty

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[107] arXiv:2202.01582 (cross-list from cs.SD) [pdf, other]

Title: A Psychoacoustic Quality Criterion for Path-Traced Sound Propagation

Chunxiao Cao, Zili An, Zhong Ren, Dinesh Manocha, Kun Zhou

Comments: 12 pages, 10 figures. To be published in IEEE TVCG

Subjects: Sound (cs.SD); Graphics (cs.GR); Audio and Speech Processing (eess.AS)

[108] arXiv:2202.01614 (cross-list from cs.SD) [pdf, other]

Title: The RoyalFlush System of Speech Recognition for M2MeT Challenge

Shuaishuai Ye, Peiyao Wang, Shunfei Chen, Xinhui Hu, Xinkang Xu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[109] arXiv:2202.01624 (cross-list from cs.SD) [pdf, other]

Title: MFA: TDNN with Multi-scale Frequency-channel Attention for Text-independent Speaker Verification with Short Utterances

Tianchi Liu, Rohan Kumar Das, Kong Aik Lee, Haizhou Li

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[110] arXiv:2202.01646 (cross-list from cs.SD) [pdf, other]

Title: Improving Lyrics Alignment through Joint Pitch Detection

Jiawen Huang, Emmanouil Benetos, Sebastian Ewert

Comments: To appear in Proc. ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[111] arXiv:2202.01784 (cross-list from cs.SD) [pdf, other]

Title: Robust Audio Anomaly Detection

Wo Jae Lee, Karim Helwani, Arvindh Krishnaswamy, Srikanth Tenneti

Comments: Accepted paper at RobustML Workshop@ICLR 2021

Journal-ref: RobustML Workshop - ICLR 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[112] arXiv:2202.01855 (cross-list from cs.CL) [pdf, other]

Title: Self-supervised Learning with Random-projection Quantizer for Speech Recognition

Chung-Cheng Chiu, James Qin, Yu Zhang, Jiahui Yu, Yonghui Wu

Comments: ICML 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[113] arXiv:2202.02112 (cross-list from cs.SD) [pdf, other]

Title: Musical Audio Similarity with Self-supervised Convolutional Neural Networks

Carl Thomé, Sebastian Piwell, Oscar Utterbäck

Comments: ISMIR LBD 2021

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[114] arXiv:2202.02115 (cross-list from cs.SD) [pdf, other]

Title: Polyphonic pitch detection with convolutional recurrent neural networks

Carl Thomé, Sven Ahlbäck

Comments: MIREX 2017

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[115] arXiv:2202.02441 (cross-list from cs.SD) [pdf, other]

Title: SEED: Sound Event Early Detection via Evidential Uncertainty

Xujiang Zhao, Xuchao Zhang, Wei Cheng, Wenchao Yu, Yuncong Chen, Haifeng Chen, Feng Chen

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[116] arXiv:2202.02500 (cross-list from cs.SD) [pdf, other]

Title: A Neural Beam Filter for Real-time Multi-channel Speech Enhancement

Wenzhe Liu, Andong Li, Chengshi Zheng, Xiaodong Li

Comments: 5 pages, 4 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[117] arXiv:2202.02545 (cross-list from cs.SD) [pdf, other]

Title: Optimization of a Real-Time Wavelet-Based Algorithm for Improving Speech Intelligibility

Tianqu Kang, Anh-Dung Dinh, Binghong Wang, Tianyuan Du, Yijia Chen, Kevin Chau (Hong Kong University of Science and Technology)

Comments: 16 pages, 7 figures, 4 tables

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[118] arXiv:2202.02611 (cross-list from cs.LG) [pdf, other]

Title: Privacy-preserving Speech Emotion Recognition through Semi-Supervised Federated Learning

Vasileios Tsouvalas, Tanir Ozcelebi, Nirvana Meratnia

Comments: arXiv admin note: text overlap with arXiv:2107.06877

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[119] arXiv:2202.02751 (cross-list from cs.LG) [pdf, other]

Title: Tubes Among Us: Analog Attack on Automatic Speaker Identification

Shimaa Ahmed, Yash Wani, Ali Shahin Shamsabadi, Mohammad Yaghini, Ilia Shumailov, Nicolas Papernot, Kassem Fawaz

Comments: Published at USENIX Security 2023 this https URL

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[120] arXiv:2202.03007 (cross-list from cs.CV) [pdf, other]

Title: Learning Sound Localization Better From Semantically Similar Samples

Arda Senocak, Hyeonggon Ryu, Junsik Kim, In So Kweon

Comments: Accepted to ICASSP 2022. SOTA performance in Audio-Visual Sound Localization. 5 Pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[121] arXiv:2202.03218 (cross-list from cs.CL) [pdf, other]

Title: Efficient Adapter Transfer of Self-Supervised Speech Models for Automatic Speech Recognition

Bethan Thomas, Samuel Kessler, Salah Karout

Comments: 5 Pages, 4 figures. Accepted to ICASSP 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[122] arXiv:2202.03416 (cross-list from cs.SD) [pdf, other]

Title: Deep Impulse Responses: Estimating and Parameterizing Filters with Deep Networks

Alexander Richard, Peter Dodds, Vamsi Krishna Ithapu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[123] arXiv:2202.03514 (cross-list from cs.SD) [pdf, other]

Title: Maximizing Audio Event Detection Model Performance on Small Datasets Through Knowledge Transfer, Data Augmentation, And Pretraining: An Ablation Study

Daniel Tompkins, Kshitiz Kumar, Jian Wu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[124] arXiv:2202.03647 (cross-list from cs.SD) [pdf, other]

Title: Summary On The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Grand Challenge

Fan Yu, Shiliang Zhang, Pengcheng Guo, Yihui Fu, Zhihao Du, Siqi Zheng, Weilong Huang, Lei Xie, Zheng-Hua Tan, DeLiang Wang, Yanmin Qian, Kong Aik Lee, Zhijie Yan, Bin Ma, Xin Xu, Hui Bu

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[125] arXiv:2202.03725 (cross-list from cs.CL) [pdf, other]

Title: A two-step approach to leverage contextual data: speech recognition in air-traffic communications

Iuliia Nigmatulina, Juan Zuluaga-Gomez, Amrutha Prasad, Seyyed Saeed Sarfjoo, Petr Motlicek

Comments: 20XX IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. arXiv admin note: text overlap with arXiv:2108.12156

Journal-ref: ICASSP 2022

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[126] arXiv:2202.03896 (cross-list from cs.SD) [pdf, other]

Title: Speech Emotion Recognition using Self-Supervised Features

Edmilson Morais, Ron Hoory, Weizhong Zhu, Itai Gat, Matheus Damasceno, Hagai Aronowitz

Comments: 5 pages, 4 figures, 2 tables, ICASSP 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[127] arXiv:2202.04215 (cross-list from cs.ET) [pdf, other]

Title: QAC: Quantum-computing Aided Composition

Omar Costa Hamido

Comments: Pre-publication draft, to appear in book 'Quantum Computer Music', E. R. Miranda (Ed.)

Subjects: Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS); Quantum Physics (quant-ph)

[128] arXiv:2202.04261 (cross-list from cs.SD) [pdf, other]

Title: The Volcspeech system for the ICASSP 2022 multi-channel multi-party meeting transcription challenge

Chen Shen, Yi Liu, Wenzhi Fan, Bin Wang, Shixue Wen, Yao Tian, Jun Zhang, Jingsheng Yang, Zejun Ma

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[129] arXiv:2202.04303 (cross-list from cs.LG) [pdf, other]

Title: TinyM$^2$Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices

Hasib-Al Rashid, Pretom Roy Ovi, Carl Busart, Aryya Gangopadhyay, Tinoosh Mohsenin

Comments: tinyML Research Symposium 2022

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[130] arXiv:2202.04328 (cross-list from cs.SD) [pdf, other]

Title: CAU_KU team's submission to ADD 2022 Challenge task 1: Low-quality fake audio detection through frequency feature masking

Il-Youp Kwak, Sunmook Choi, Jonghoon Yang, Yerin Lee, Seungsang Oh

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[131] arXiv:2202.04393 (cross-list from cs.SD) [pdf, other]

Title: Binaural Audio Rendering in the Spherical Harmonic Domain: A Summary of the Mathematics and its Pitfalls

Jens Ahrens

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[132] arXiv:2202.04405 (cross-list from eess.SP) [pdf, other]

Title: Time-Frequency Mask Aware Bi-directional LSTM: A Deep Learning Approach for Underwater Acoustic Signal Separation

Jie Chen, Chang Liu, Jiawu Xie, Jie An, Nan Huang

Comments: 28 pages, 14 figures

Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[133] arXiv:2202.04464 (cross-list from cs.SD) [pdf, other]

Title: Conditional Drums Generation using Compound Word Representations

Dimos Makris, Guo Zixun, Maximos Kaliakatsos-Papakostas, Dorien Herremans

Comments: Accepted for the 11th International Conference on Artificial Intelligence in Music, Sound, Art and Design (EvoMUSART), 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[134] arXiv:2202.04528 (cross-list from cs.SD) [pdf, other]

Title: Multimodal Audio-Visual Information Fusion using Canonical-Correlated Graph Neural Network for Energy-Efficient Speech Enhancement

Leandro Aparecido Passos, João Paulo Papa, Javier Del Ser, Amir Hussain, Ahsan Adeel

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[135] arXiv:2202.04774 (cross-list from cs.SD) [pdf, other]

Title: SHAS: Approaching optimal Segmentation for End-to-End Speech Translation

Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa, Marta R. Costa-jussà

Comments: Accepted to Interspeech 2022. For an additional 2-page Appendix refer to v1

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[136] arXiv:2202.04814 (cross-list from cs.SD) [pdf, other]

Title: Royalflush Speaker Diarization System for ICASSP 2022 Multi-channel Multi-party Meeting Transcription Challenge

Jingguang Tian, Xinhui Hu, Xinkang Xu

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[137] arXiv:2202.04882 (cross-list from cs.SD) [pdf, other]

Title: Auditory Model based Phase-Aware Bayesian Spectral Amplitude Estimator for Single-Channel Speech Enhancement

Suman Samui, Indrajit Chakrabarti, Soumya K. Ghosh

Comments: Submitted to IEEE

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[138] arXiv:2202.04947 (cross-list from cs.CV) [pdf, other]

Title: OWL (Observe, Watch, Listen): Audiovisual Temporal Context for Localizing Actions in Egocentric Videos

Merey Ramazanova, Victor Escorcia, Fabian Caba Heilbron, Chen Zhao, Bernard Ghanem

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[139] arXiv:2202.04958 (cross-list from cs.SD) [pdf, other]

Title: Sound masking degrades perception of self-location during stepping: A case for sound-transparent spacesuits for Mars

Jose Berengueres, Maryam Al Kuwaiti, Ahmed Yasir, Kenjiro Tadakuma

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[140] arXiv:2202.04971 (cross-list from cs.AR) [pdf, other]

Title: ASRPU: A Programmable Accelerator for Low-Power Automatic Speech Recognition

Dennis Pinto, Jose-María Arnau, Antonio González

Comments: 11 pages, 11 figures

Subjects: Hardware Architecture (cs.AR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[141] arXiv:2202.04981 (cross-list from cs.SD) [pdf, other]

Title: Barwise Compression Schemes for Audio-Based Music Structure Analysis

Axel Marmoret, Jérémy E. Cohen, Frédéric Bimbot

Comments: Published at the 2022 Sound and Music Computing (SMC) conference, 8 pages, 6 figures, 1 table, code available at this https URL. arXiv admin note: substantial text overlap with arXiv:2110.14437

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[142] arXiv:2202.04989 (cross-list from cs.SD) [pdf, other]

Title: Semi-Supervised Convolutive NMF for Automatic Piano Transcription

Haoran Wu, Axel Marmoret, Jérémy E. Cohen

Comments: Published at the 2022 Sound and Music Computing (SMC) conference, 7 pages, 5 figures, 3 tables, code available at this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[143] arXiv:2202.05209 (cross-list from cs.CL) [pdf, other]

Title: Improving Automatic Speech Recognition for Non-Native English with Transfer Learning and Language Model Decoding

Peter Sullivan, Toshiko Shibano, Muhammad Abdul-Mageed

Comments: arXiv admin note: substantial text overlap with arXiv:2110.00678

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[144] arXiv:2202.05236 (cross-list from cs.SD) [pdf, other]

Title: Learnable Nonlinear Compression for Robust Speaker Verification

Xuechen Liu, Md Sahidullah, Tomi Kinnunen

Comments: Accepted by ICASSP2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[145] arXiv:2202.05272 (cross-list from cs.SD) [pdf, other]

Title: Single-channel speech enhancement by using psychoacoustical model inspired fusion framework

Suman Samui

Comments: arXiv admin note: text overlap with arXiv:2202.04882

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[146] arXiv:2202.05332 (cross-list from cs.SD) [pdf, other]

Title: An Initial Description of Capabilities and Constraints for a Computational Auditory System (an Artificial Ear) for Cognitive Architectures

Frank E. Ritter, Mathieu Brener

Comments: 13 pages, 2 figures, 2 tables Keywords: computational auditory system, artificial ear, cognitive architecture

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[147] arXiv:2202.05416 (cross-list from cs.SD) [pdf, other]

Title: FAAG: Fast Adversarial Audio Generation through Interactive Attack Optimisation

Yuantian Miao, Chao Chen, Lei Pan, Jun Zhang, Yang Xiang

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[148] arXiv:2202.05539 (cross-list from cs.SD) [pdf, other]

Title: A Sonification of the zCOSMOS Galaxy Dataset

S. Bardelli, Claudia Ferretti, Luca Andrea Ludovico, Giorgio Presti, Maurizio Rinaldi

Comments: 18 pages, 6 figures

Journal-ref: proceedings of "Interactive Cultural Heritage and Arts", Held as Part of the 23rd HCI International Conference, in Lecture Notes in Computer Science book series (LNCS, volume 12794), 2021

Subjects: Sound (cs.SD); Instrumentation and Methods for Astrophysics (astro-ph.IM); Computers and Society (cs.CY); Audio and Speech Processing (eess.AS); Physics Education (physics.ed-ph); Physics and Society (physics.soc-ph)

[149] arXiv:2202.05626 (cross-list from cs.SD) [pdf, other]

Title: Audio-Based Deep Learning Frameworks for Detecting COVID-19

Dat Ngo, Lam Pham, Truong Hoang, Sefki Kolozali, Delaram Jarchi

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[150] arXiv:2202.05662 (cross-list from cs.CR) [pdf, other]

Title: A Novel Chaos-based Light-weight Image Encryption Scheme for Multi-modal Hearing Aids

Awais Aziz Shah, Ahsan Adeel, Jawad Ahmad, Ahmed Al-Dubai, Mandar Gogate, Abhijeet Bishnu, Muhammad Diyan, Tassadaq Hussain, Kia Dashtipour, Tharm Ratnarajah, Amir Hussain

Subjects: Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[151] arXiv:2202.05718 (cross-list from cs.SD) [pdf, other]

Title: Audio Defect Detection in Music with Deep Networks

Daniel Wolff, Rémi Mignot, Axel Roebel

Comments: 6 pages

Journal-ref: Proceedings of the 22nd International Society for Music Information Retrieval Conference, Online, 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[152] arXiv:2202.05725 (cross-list from cs.CR) [pdf, other]

Title: On the Detection of Adaptive Adversarial Attacks in Speaker Verification Systems

Zesheng Chen

Journal-ref: IEEE Internet of Things Journal, 2023

Subjects: Cryptography and Security (cs.CR); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[153] arXiv:2202.05756 (cross-list from cs.SD) [pdf, other]

Title: A Novel Speech Intelligibility Enhancement Model based on CanonicalCorrelation and Deep Learning

Tassadaq Hussain, Muhammad Diyan, Mandar Gogate, Kia Dashtipour, Ahsan Adeel, Yu Tsao, Amir Hussain

Comments: arXiv admin note: substantial text overlap with arXiv:2202.04172

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[154] arXiv:2202.05817 (cross-list from cs.SD) [pdf, other]

Title: The HaMSE Ontology: Using Semantic Technologies to support Music Representation Interoperability and Musicological Analysis

Andrea Poltronieri, Aldo Gangemi

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[155] arXiv:2202.05993 (cross-list from cs.SD) [pdf, other]

Title: Wav2Vec2.0 on the Edge: Performance Evaluation

Santosh Gondi

Comments: 9 pages

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[156] arXiv:2202.06034 (cross-list from cs.SD) [pdf, other]

Title: Deep Performer: Score-to-Audio Music Performance Synthesis

Hao-Wen Dong, Cong Zhou, Taylor Berg-Kirkpatrick, Julian McAuley

Comments: ICASSP 2022 final version with appendix

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[157] arXiv:2202.06045 (cross-list from cs.CL) [pdf, other]

Title: USTED: Improving ASR with a Unified Speech and Text Encoder-Decoder

Bolaji Yusuf, Ankur Gandhe, Alex Sokolov

Comments: 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2022)

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[158] arXiv:2202.06180 (cross-list from cs.SD) [pdf, other]

Title: Learning long-term music representations via hierarchical contextual constraints

Shiqi Wei, Gus Xia

Comments: Accepted by ISMIR2021

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[159] arXiv:2202.06369 (cross-list from cs.LG) [pdf, other]

Title: Incremental user embedding modeling for personalized text classification

Ruixue Lian, Che-Wei Huang, Yuqing Tang, Qilong Gu, Chengyuan Ma, Chenlei Guo

Comments: Accepted to International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[160] arXiv:2202.06406 (cross-list from cs.CV) [pdf, other]

Title: Visual Sound Localization in the Wild by Cross-Modal Interference Erasing

Xian Liu, Rui Qian, Hang Zhou, Di Hu, Weiyao Lin, Ziwei Liu, Bolei Zhou, Xiaowei Zhou

Comments: Accepted by AAAI Conference on Artificial Intelligence (AAAI) 2022. 16 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[161] arXiv:2202.06707 (cross-list from eess.SP) [pdf, other]

Title: Spiking Cochlea with System-level Local Automatic Gain Control

Ilya Kiselev, Chang Gao, Shih-Chii Liu

Comments: Accepted for publication at the IEEE Transactions on Circuits and Systems I - Regular Papers, 2022

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[162] arXiv:2202.06850 (cross-list from cs.SD) [pdf, other]

Title: Multi-Task Deep Residual Echo Suppression with Echo-aware Loss

Shimin Zhang, Ziteng Wang, Jiayao Sun, Yihui Fu, Biao Tian, Qiang Fu, Lei Xie

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2202.06875 (cross-list from cs.CV) [pdf, other]

Title: Visual Acoustic Matching

Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman

Comments: Project page: this https URL. Accepted at CVPR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2202.07219 (cross-list from cs.SD) [pdf, other]

Title: Multi-style Training for South African Call Centre Audio

Walter Heymans, Marelie H. Davel, Charl van Heerden

Comments: 9 pages, 8 tables, Southern African Conference for Artificial Intelligence Research 2021, Part of the Communications in Computer and Information Science book series (CCIS, volume 1551, pp 111-124), Springer

Journal-ref: Artificial Intelligence Research 2022

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[165] arXiv:2202.07273 (cross-list from cs.SD) [pdf, other]

Title: SpeechPainter: Text-conditioned Speech Inpainting

Zalán Borsos, Matt Sharifi, Marco Tagliasacchi

Comments: Submitted to Interspeech 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[166] arXiv:2202.07359 (cross-list from cs.CL) [pdf, other]

Title: textless-lib: a Library for Textless Spoken Language Processing

Eugene Kharitonov, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Paden Tomasello, Ann Lee, Ali Elkahky, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi

Comments: The library is available here this https URL

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[167] arXiv:2202.07382 (cross-list from cs.SD) [pdf, other]

Title: Phase Vocoder Done Right

Zdenek Prusa, Nicki Holighaus

Subjects: Sound (cs.SD); Mathematical Software (cs.MS); Audio and Speech Processing (eess.AS)

[168] arXiv:2202.07428 (cross-list from eess.IV) [pdf, other]

Title: Learning Contextually Fused Audio-visual Representations for Audio-visual Speech Recognition

Zi-Qiang Zhang, Jie Zhang, Jian-Shu Zhang, Ming-Hui Wu, Xin Fang, Li-Rong Dai

Comments: 5 pages

Subjects: Image and Video Processing (eess.IV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[169] arXiv:2202.07479 (cross-list from cs.SD) [pdf, other]

Title: Audio Inpainting via $\ell_1$-Minimization and Dictionary Learning

Shristi Rajbamshi, Georg Tauböck, Peter Balazs, Nicki Holighaus

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2202.07484 (cross-list from cs.SD) [pdf, other]

Title: Phase-Based Signal Representations for Scattering

Daniel Haider, Peter Balazs, Nicki Holighaus

Journal-ref: 29th European Signal Processing Conference (EUSIPCO) 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[171] arXiv:2202.07498 (cross-list from cs.SD) [pdf, other]

Title: Non-iterative Filter Bank Phase (Re)Construction

Zdeněk Průša, Nicki Holighaus

Subjects: Sound (cs.SD); Mathematical Software (cs.MS); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[172] arXiv:2202.07765 (cross-list from cs.LG) [pdf, other]

Title: General-purpose, long-context autoregressive modeling with Perceiver AR

Curtis Hawthorne, Andrew Jaegle, Cătălina Cangea, Sebastian Borgeaud, Charlie Nash, Mateusz Malinowski, Sander Dieleman, Oriol Vinyals, Matthew Botvinick, Ian Simon, Hannah Sheahan, Neil Zeghidour, Jean-Baptiste Alayrac, João Carreira, Jesse Engel

Comments: ICML 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2202.07790 (cross-list from cs.SD) [pdf, other]

Title: Speech Denoising in the Waveform Domain with Self-Attention

Zhifeng Kong, Wei Ping, Ambrish Dantrey, Bryan Catanzaro

Comments: Published in ICASSP 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Listen to audio samples from CleanUNet at: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[174] arXiv:2202.07841 (cross-list from cs.SD) [pdf, other]

Title: Learning Deep Direct-Path Relative Transfer Function for Binaural Sound Source Localization

Bing Yang, Hong Liu, Xiaofei Li

Comments: Accepted by TASLP 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2202.07855 (cross-list from cs.SD) [pdf, other]

Title: Conversational Speech Recognition By Learning Conversation-level Characteristics

Kun Wei, Yike Zhang, Sining Sun, Lei Xie, Long Ma

Comments: ICASSP 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[176] arXiv:2202.07859 (cross-list from cs.SD) [pdf, other]

Title: SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localization

Bing Yang, Hong Liu, Xiaofei Li

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[177] arXiv:2202.07894 (cross-list from cs.CL) [pdf, other]

Title: Knowledge Transfer from Large-scale Pretrained Language Models to End-to-end Speech Recognizers

Yotaro Kubo, Shigeki Karita, Michiel Bacchiani

Comments: To be presented in ICASSP 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[178] arXiv:2202.07907 (cross-list from cs.SD) [pdf, other]

Title: Singing-Tacotron: Global duration control attention and dynamic filter for End-to-end singing voice synthesis

Tao Wang, Ruibo Fu, Jiangyan Yi, Jianhua Tao, Zhengqi Wen

Comments: 5 pages, 7 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[179] arXiv:2202.07931 (cross-list from cs.SD) [pdf, other]

Title: DBT-Net: Dual-branch federative magnitude and phase estimation with attention-in-attention transformer for monaural speech enhancement

Guochen Yu, Andong Li, Hui Wang, Yutian Wang, Yuxuan Ke, Chengshi Zheng

Comments: 15 pages;Accepted by IEEE/ACM Trans. Audio. Speech, Lang. Process

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[180] arXiv:2202.07968 (cross-list from cs.SD) [pdf, other]

Title: On loss functions and evaluation metrics for music source separation

Enric Gusó, Jordi Pons, Santiago Pascual, Joan Serrà

Comments: Accepted to ICASSP 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[181] arXiv:2202.07991 (cross-list from cs.SD) [pdf, other]

Title: ADIMA: Abuse Detection In Multilingual Audio

Vikram Gupta, Rini Sharon, Ramit Sawhney, Debdoot Mukherjee

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[182] arXiv:2202.08183 (cross-list from eess.SP) [pdf, other]

Title: Increasing loudness in audio signals: a perceptually motivated approach to preserve audio quality

A. Jeannerot, N. de Koeijer, P. Martínez-Nuevo, M. B. Møller, J. Dyreby, P. Prandoni

Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS)

[183] arXiv:2202.08423 (cross-list from cs.SD) [pdf, other]

Title: Chord-Conditioned Melody Harmonization with Controllable Harmonicity

Shangda Wu, Xiaobing Li, Maosong Sun

Comments: 5 pages, 7 figures, accepted by ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[184] arXiv:2202.08433 (cross-list from cs.SD) [pdf, html, other]

Title: ADD 2022: the First Audio Deep Synthesis Detection Challenge

Jiangyan Yi, Ruibo Fu, Jianhua Tao, Shuai Nie, Haoxin Ma, Chenglong Wang, Tao Wang, Zhengkun Tian, Xiaohui Zhang, Ye Bai, Cunhang Fan, Shan Liang, Shiming Wang, Shuai Zhang, Xinrui Yan, Le Xu, Zhengqi Wen, Haizhou Li, Zheng Lian, Bin Liu

Comments: Accepted by ICASSP 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[185] arXiv:2202.08509 (cross-list from cs.SD) [pdf, other]

Title: A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning

Hengshun Zhou, Jun Du, Chao-Han Huck Yang, Shifu Xiong, Chin-Hui Lee

Comments: Accepted to ICASSP 2022. H. Zhou et al

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[186] arXiv:2202.08862 (cross-list from cs.SD) [pdf, other]

Title: RemixIT: Continual self-training of speech enhancement models via bootstrapped remixing

Efthymios Tzinis, Yossi Adi, Vamsi Krishna Ithapu, Buye Xu, Paris Smaragdis, Anurag Kumar

Comments: To appear in IEEE Journal of Selected Topics in Signal Processing

Journal-ref: J-STSP-SLSAP-00040-2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[187] arXiv:2202.08898 (cross-list from cs.SD) [pdf, other]

Title: Word Embeddings for Automatic Equalization in Audio Mixing

Satvik Venkatesh, David Moffat, Eduardo Reck Miranda

Comments: 10 pages, 5 Figures, 3 tables; More experimental validation; Published in the Journal of the Audio Engineering Society

Journal-ref: J.Audio.Eng.Soc. 70 (2022) 753-763

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[188] arXiv:2202.08900 (cross-list from cs.SD) [pdf, other]

Title: Attributable-Watermarking of Speech Generative Models

Yongbaek Cho, Changhoon Kim, Yezhou Yang, Yi Ren

Comments: Accepted to International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2022

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[189] arXiv:2202.08974 (cross-list from cs.SD) [pdf, other]

Title: Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models

Sarala Padi, Seyed Omid Sadjadi, Dinesh Manocha, Ram D. Sriram

Comments: arXiv admin note: substantial text overlap with arXiv:2108.02510

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Robotics (cs.RO); Audio and Speech Processing (eess.AS)

[190] arXiv:2202.08981 (cross-list from cs.SD) [pdf, other]

Title: A Summary of the ComParE COVID-19 Challenges

Harry Coppock, Alican Akman, Christian Bergler, Maurice Gerczuk, Chloë Brown, Jagmohan Chauhan, Andreas Grammenos, Apinan Hasthanasombat, Dimitris Spathis, Tong Xia, Pietro Cicuta, Jing Han, Shahin Amiriparian, Alice Baird, Lukas Stappen, Sandra Ottl, Panagiotis Tzirakis, Anton Batliner, Cecilia Mascolo, Björn W. Schuller

Comments: 18 pages, 13 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[191] arXiv:2202.09003 (cross-list from cs.CL) [pdf, other]

Title: End-to-end contextual asr based on posterior distribution adaptation for hybrid ctc/attention system

Zhengyi Zhang, Pan Zhou

Comments: 5 pages, 5 tabels, 1 figure

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[192] arXiv:2202.09102 (cross-list from cs.SD) [pdf, other]

Title: Predicting Sex and Stroke Success -- Computer-aided Player Grunt Analysis in Tennis Matches

Lukas Stappen, Manuel Milling, Valentin Munst, Korakot Hoffmann, Bjorn W. Schuller

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[193] arXiv:2202.09108 (cross-list from cs.CL) [pdf, other]

Title: Large-Scale Acoustic Characterization of Singaporean Children's English Pronunciation

Yuling Gu, Nancy F. Chen

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[194] arXiv:2202.09198 (cross-list from cs.SD) [pdf, other]

Title: Deep-Learning Architectures for Multi-Pitch Estimation: Towards Reliable Evaluation

Christof Weiß, Geoffroy Peeters

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[195] arXiv:2202.09619 (cross-list from cs.SD) [pdf, other]

Title: Evaluation of Neuromorphic Spike Encoding of Sound Using Information Theory

Ahmad El Ferdaoussi, Éric Plourde, Jean Rouat

Comments: 10 pages, 7 figures, internal report

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[196] arXiv:2202.09729 (cross-list from cs.SD) [pdf, other]

Title: It's Raw! Audio Generation with State-Space Models

Karan Goel, Albert Gu, Chris Donahue, Christopher Ré

Comments: 23 pages, 7 figures, 7 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[197] arXiv:2202.09750 (cross-list from cs.SD) [pdf, other]

Title: Enhancing Affective Representations of Music-Induced EEG through Multimodal Supervision and latent Domain Adaptation

Kleanthis Avramidis, Christos Garoufis, Athanasia Zlatintsi, Petros Maragos

Comments: 5 pages, 3 figures, IEEE ICASSP 2022

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[198] arXiv:2202.09907 (cross-list from cs.SD) [pdf, other]

Title: towards automatic transcription of polyphonic electric guitar music:a new dataset and a multi-loss transformer model

Yu-Hua Chen, Wen-Yi Hsiao, Tsu-Kuang Hsieh, Jyh-Shing Roger Jang, Yi-Hsuan Yang

Comments: to be published at ICASSP 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[199] arXiv:2202.09950 (cross-list from cs.SD) [pdf, other]

Title: CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editing

Tao Wang, Jiangyan Yi, Ruibo Fu, Jianhua Tao, Zhengqi Wen

Comments: under review, 14 pages, 14 figures, demo page is available at this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[200] arXiv:2202.10020 (cross-list from cs.SD) [pdf, other]

Title: AVQVC: One-shot Voice Conversion by Vector Quantization with applying contrastive learning

Huaizhen Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: 4 pages paper

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)