Sound

Authors and titles for March 2023

[1] arXiv:2303.00204 [pdf, other]

Title: PCF: ECAPA-TDNN with Progressive Channel Fusion for Speaker Verification

Zhenduo Zhao, Zhuo Li, Wenchao Wang, Pengyuan Zhang

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[2] arXiv:2303.00264 [pdf, other]

Title: Distance-based Weight Transfer from Near-field to Far-field Speaker Verification

Li Zhang, Qing Wang, Hongji Wang, Yue Li, Wei Rao, Yannan Wang, Lei Xie

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[3] arXiv:2303.00332 [pdf, other]

Title: CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking

Hui Wang, Siqi Zheng, Yafeng Chen, Luyao Cheng, Qian Chen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[4] arXiv:2303.00502 [pdf, other]

Title: On the Audio-visual Synchronization for Lip-to-Speech Synthesis

Zhe Niu, Brian Mak

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[5] arXiv:2303.00510 [pdf, html, other]

Title: A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit

Mina Huh, Ruchira Ray, Corey Karnei

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[6] arXiv:2303.00747 [pdf, other]

Title: WhisperX: Time-Accurate Speech Transcription of Long-Form Audio

Max Bain, Jaesung Huh, Tengda Han, Andrew Zisserman

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[7] arXiv:2303.01125 [pdf, html, other]

Title: Distilling Multi-Level X-vector Knowledge for Small-footprint Speaker Verification

Xuechen Liu, Md Sahidullah, Tomi Kinnunen

Comments: Submitted to Data & Knowledge Engineering at Dec. 2023. Copyright may be transferred without notice

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[8] arXiv:2303.01126 [pdf, other]

Title: Speaker-Aware Anti-Spoofing

Xuechen Liu, Md Sahidullah, Kong Aik Lee, Tomi Kinnunen

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[9] arXiv:2303.01211 [pdf, other]

Title: Learning From Yourself: A Self-Distillation Method for Fake Speech Detection

Jun Xue, Cunhang Fan, Jiangyan Yi, Chenglong Wang, Zhengqi Wen, Dan Zhang, Zhao Lv

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[10] arXiv:2303.01507 [pdf, other]

Title: Defending against Adversarial Audio via Diffusion Model

Shutong Wu, Jiongxiao Wang, Wei Ping, Weili Nie, Chaowei Xiao

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[11] arXiv:2303.01508 [pdf, other]

Title: Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensities

Shijun Wang, Jón Guðnason, Damian Borth

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[12] arXiv:2303.01639 [pdf, other]

Title: WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech Interactions

Jun Rekimoto

Comments: ACM CHI 2023 paper

Journal-ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), April 23--28, 2023

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[13] arXiv:2303.01664 [pdf, other]

Title: Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representations

Yuma Koizumi, Heiga Zen, Shigeki Karita, Yifan Ding, Kohei Yatabe, Nobuyuki Morioka, Yu Zhang, Wei Han, Ankur Bapna, Michiel Bacchiani

Comments: Accepted to WASPAA 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[14] arXiv:2303.01665 [pdf, other]

Title: LooperGP: A Loopable Sequence Model for Live Coding Performance using GuitarPro Tablature

Sara Adkins, Pedro Sarmento, Mathieu Barthet

Comments: The Version of Record of this contribution is published in Proceedings of EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Journal-ref: EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[15] arXiv:2303.01694 [pdf, other]

Title: DWFormer: Dynamic Window transFormer for Speech Emotion Recognition

Shuaiqi Chen, Xiaofen Xing, Weibin Zhang, Weidong Chen, Xiangmin Xu

Comments: 4 pages, 5 figures, 3 tables, accepted by 2023 International Conference on Acoustics, Speech, and Signal Processing (ICASSP2023)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[16] arXiv:2303.01812 [pdf, other]

Title: Unified Keyword Spotting and Audio Tagging on Mobile Devices with Transformers

Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Junbo Zhang, Yujun Wang

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[17] arXiv:2303.01864 [pdf, other]

Title: Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints

Paul Magron, Tuomas Virtanen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[18] arXiv:2303.01875 [pdf, other]

Title: Decoding and Visualising Intended Emotion in an Expressive Piano Performance

Shreyan Chowdhury, Gerhard Widmer

Comments: Extended version of Late-Breaking Demo Session paper accepted at ISMIR 2022 (23rd Int. Society for Music Information Retrieval Conf., Bengaluru, India, 2022)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[19] arXiv:2303.01879 [pdf, other]

Title: Low-Complexity Audio Embedding Extractors

Florian Schmid, Khaled Koutini, Gerhard Widmer

Comments: In Proceedings of the 31st European Signal Processing Conference, EUSIPCO 2023. Source Code available at: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[20] arXiv:2303.01884 [pdf, other]

Title: AutoMatch: A Large-scale Audio Beat Matching Benchmark for Boosting Deep Learning Assistant Video Editing

Sen Pei, Jingya Yu, Qi Chen, Wozhou He

Comments: 11 pages, 5 figures

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[21] arXiv:2303.02348 [pdf, other]

Title: The DKU Post-Challenge Audio-Visual Wake Word Spotting System for the 2021 MISP Challenge: Deep Analysis

Haoxu Wang, Ming Cheng, Qiang Fu, Ming Li

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[22] arXiv:2303.02396 [pdf, other]

Title: A General Framework for Learning Procedural Audio Models of Environmental Sounds

Danzel Serrano, Mark Cartwright

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[23] arXiv:2303.02599 [pdf, other]

Title: Hybrid Y-Net Architecture for Singing Voice Separation

Rashen Fernando, Pamudu Ranasinghe, Udula Ranasinghe, Janaka Wijayakulasooriya, Pantaleon Perera

Comments: Submitted for EUSIPCO23: 5 Pages, 7 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[24] arXiv:2303.02665 [pdf, other]

Title: Heterogeneous Graph Learning for Acoustic Event Classification

Amir Shirian, Mona Ahmadian, Krishna Somandepalli, Tanaya Guha

Comments: arXiv admin note: text overlap with arXiv:2207.07935

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[25] arXiv:2303.02673 [pdf, other]

Title: Time-frequency Network for Robust Speaker Recognition

Jiguo Li, Tianzi Zhang, Xiaobin Liu, Lirong Zheng

Comments: 5pages, 3 figures

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[26] arXiv:2303.03005 [pdf, other]

Title: Scaling strategies for on-device low-complexity source separation with Conv-Tasnet

Mohamed Nabih Ali, Francesco Paissan, Daniele Falavigna, Alessio Brutti

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[27] arXiv:2303.03183 [pdf, other]

Title: Utilizing synthetic training data for the supervised classification of rat ultrasonic vocalizations

K. Jack Scott, Lucinda J. Speers, David K. Bilkey

Comments: 25 pages, 5 main figures, 2 tables

Journal-ref: J Acoust Soc Am 1 January 2024 155 (1)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[28] arXiv:2303.03591 [pdf, other]

Title: Approach to Learning Generalized Audio Representation Through Batch Embedding Covariance Regularization and Constant-Q Transforms

Ankit Shah, Shuyi Chen, Kejun Zhou, Yue Chen, Bhiksha Raj

Comments: Technical report, 10 pages

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[29] arXiv:2303.03666 [pdf, other]

Title: Face: Fast, Accurate and Context-Aware Audio Annotation and Classification

M. Mehrdad Morsali, Hoda Mohammadzade, Saeed Bagheri Shouraki

Comments: 9 pages, 4 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[30] arXiv:2303.03717 [pdf, other]

Title: Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation

Bac Nguyen, Stefan Uhlich, Fabien Cardinaux

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[31] arXiv:2303.03732 [pdf, other]

Title: A Multi-Stage Triple-Path Method for Speech Separation in Noisy and Reverberant Environments

Zhaoxi Mu, Xinyu Yang, Xiangyuan Yang, Wenjing Zhu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[32] arXiv:2303.03737 [pdf, other]

Title: Multi-Dimensional and Multi-Scale Modeling for Speech Separation Optimized by Discriminative Learning

Zhaoxi Mu, Xinyu Yang, Wenjing Zhu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[33] arXiv:2303.03857 [pdf, html, other]

Title: Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study

Yi Yuan, Haohe Liu, Jinhua Liang, Xubo Liu, Mark D. Plumbley, Wenwu Wang

Comments: Updated for EUSIPCO 2023 proceedings version

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[34] arXiv:2303.03870 [pdf, html, other]

Title: DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning

Aneesh Bhattacharya, Manas Paranjape, Uttaran Bhattacharya, Aniket Bera

Comments: 11 pages, 7 figures, 3 tables. To appear as part of the proceedings of the 38th Annual AAAI Conference on Artificial Intelligence, 2024

Journal-ref: In Proceedings of the 38th Annual AAAI Conference on Artificial Intelligence, 2024, Vancouver, Canada

Subjects: Sound (cs.SD); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[35] arXiv:2303.04104 [pdf, other]

Title: An Inception-Residual-Based Architecture with Multi-Objective Loss for Detecting Respiratory Anomalies

Dat Ngo, Lam Pham, Huy Phan, Minh Tran, Delaram Jarchi, Sefki Kolozali

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[36] arXiv:2303.04255 [pdf, other]

Title: Self-supervised speech representation learning for keyword-spotting with light-weight transformers

Chenyang Gao, Yue Gu, Francesco Caliva, Yuzong Liu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[37] arXiv:2303.04485 [pdf, other]

Title: Onsets and Velocities: Affordable Real-Time Piano Transcription Using Convolutional Neural Networks

Andres Fernandez

Comments: Accepted at EUSIPCO 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[38] arXiv:2303.04585 [pdf, other]

Title: Exploring Efficient-Tuned Learning Audio Representation Method from BriVL

Sen Fang, Yangjian Wu, Bowen Gao, Jingwen Cai, Teik Toe Teoh

Comments: 13 pages, 2023.3 Finished

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[39] arXiv:2303.05134 [pdf, other]

Title: hierarchical network with decoupled knowledge distillation for speech emotion recognition

Ziping Zhao, Huan Wang, Haishuai Wang, Bjorn Schuller

Comments: 5 pages,4 figures,icassp 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[40] arXiv:2303.05322 [pdf, other]

Title: Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation

Qi Chen, Ziyang Ma, Tao Liu, Xu Tan, Qu Lu, Xie Chen, Kai Yu

Comments: 4 pages. Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[41] arXiv:2303.05338 [pdf, other]

Title: MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning

Ruize Xu, Ruoxuan Feng, Shi-Xiong Zhang, Di Hu

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[42] arXiv:2303.05397 [pdf, html, other]

Title: TOLD: A Novel Two-Stage Overlap-Aware Framework for Speaker Diarization

Jiaming Wang, Zhihao Du, Shiliang Zhang

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[43] arXiv:2303.05678 [pdf, other]

Title: Improving Weakly Supervised Sound Event Detection with Causal Intervention

Yifei Xin, Dongchao Yang, Fan Cui, Yujun Wang, Yuexian Zou

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[44] arXiv:2303.05681 [pdf, other]

Title: Improving Text-Audio Retrieval by Text-aware Attention Pooling and Prior Matrix Revised Loss

Yifei Xin, Dongchao Yang, Yuexian Zou

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[45] arXiv:2303.05758 [pdf, other]

Title: MIXPGD: Hybrid Adversarial Training for Speech Recognition Systems

Aminul Huq, Weiyi Zhang, Xiaolin Hu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[46] arXiv:2303.06379 [pdf, other]

Title: TaylorAECNet: A Taylor Style Neural Network for Full-Band Echo Cancellation

Weiming Xu, Zhihao Guo

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[47] arXiv:2303.06982 [pdf, html, other]

Title: Analysing the Masked predictive coding training criterion for pre-training a Speech Representation Model

Hemant Yadav, Sunayana Sitaram, Rajiv Ratn Shah

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[48] arXiv:2303.07072 [pdf, other]

Title: A two-stage speaker extraction algorithm under adverse acoustic conditions using a single-microphone

Aviad Eisenberg, Sharon Gannot, Shlomo E. Chazan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[49] arXiv:2303.07578 [pdf, other]

Title: VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation

Rohan Badlani, Akshit Arora, Subhankar Ghosh, Rafael Valle, Kevin J. Shih, João Felipe Santos, Boris Ginsburg, Bryan Catanzaro

Comments: Presentation accepted at ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[50] arXiv:2303.07626 [pdf, other]

Title: CAT: Causal Audio Transformer for Audio Classification

Xiaoyu Liu, Hanlin Lu, Jianbo Yuan, Xinyu Li

Comments: Accepted to ICASSP 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)