Audio and Speech Processing

Authors and titles for March 2023

[101] arXiv:2303.18023 [pdf, other]

Title: Multiple Hankel matrix rank minimization for audio inpainting

Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Journal-ref: 2023 46th International Conference on Telecommunications and Signal Processing (TSP)

Subjects: Audio and Speech Processing (eess.AS)

[102] arXiv:2303.00069 (cross-list from cs.CL) [pdf, other]

Title: ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus

Ajinkya Kulkarni, Atharva Kulkarni, Sara Abedalmonem Mohammad Shatnawi, Hanan Aldarmaki

Comments: None

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[103] arXiv:2303.00146 (cross-list from cs.HC) [pdf, other]

Title: I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

Yuanchao Li, Koji Inoue, Leimin Tian, Changzeng Fu, Carlos Ishi, Hiroshi Ishiguro, Tatsuya Kawahara, Catherine Lai

Comments: Accepted to CHI2023 Late-Breaking Work

Subjects: Human-Computer Interaction (cs.HC); Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[104] arXiv:2303.00171 (cross-list from cs.LG) [pdf, other]

Title: DTW-SiameseNet: Dynamic Time Warped Siamese Network for Mispronunciation Detection and Correction

Raviteja Anantha, Kriti Bhasin, Daniela de la Parra Aguilar, Prabal Vashisht, Becci Williamson, Srinivas Chappidi

Comments: Preprint version

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[105] arXiv:2303.00204 (cross-list from cs.SD) [pdf, other]

Title: PCF: ECAPA-TDNN with Progressive Channel Fusion for Speaker Verification

Zhenduo Zhao, Zhuo Li, Wenchao Wang, Pengyuan Zhang

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[106] arXiv:2303.00264 (cross-list from cs.SD) [pdf, other]

Title: Distance-based Weight Transfer from Near-field to Far-field Speaker Verification

Li Zhang, Qing Wang, Hongji Wang, Yue Li, Wei Rao, Yannan Wang, Lei Xie

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[107] arXiv:2303.00332 (cross-list from cs.SD) [pdf, other]

Title: CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking

Hui Wang, Siqi Zheng, Yafeng Chen, Luyao Cheng, Qian Chen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[108] arXiv:2303.00456 (cross-list from cs.CL) [pdf, other]

Title: N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space

Rao Ma, Mark J. F. Gales, Kate M. Knill, Mengjie Qian

Comments: Proceedings of INTERSPEECH

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[109] arXiv:2303.00502 (cross-list from cs.SD) [pdf, other]

Title: On the Audio-visual Synchronization for Lip-to-Speech Synthesis

Zhe Niu, Brian Mak

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[110] arXiv:2303.00510 (cross-list from cs.SD) [pdf, html, other]

Title: A Comparison of Speech Data Augmentation Methods Using S3PRL Toolkit

Mina Huh, Ruchira Ray, Corey Karnei

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[111] arXiv:2303.00628 (cross-list from cs.CL) [pdf, other]

Title: MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation

Mohamed Anwar, Bowen Shi, Vedanuj Goswami, Wei-Ning Hsu, Juan Pino, Changhan Wang

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[112] arXiv:2303.00744 (cross-list from cs.CV) [pdf, other]

Title: READ Avatars: Realistic Emotion-controllable Audio Driven Avatars

Jack Saunders, Vinay Namboodiri

Comments: 13 Pages, 8 Figures For demo video see this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[113] arXiv:2303.00747 (cross-list from cs.SD) [pdf, other]

Title: WhisperX: Time-Accurate Speech Transcription of Long-Form Audio

Max Bain, Jaesung Huh, Tengda Han, Andrew Zisserman

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[114] arXiv:2303.00786 (cross-list from cs.CL) [pdf, other]

Title: Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training

Eric Sun, Jinyu Li, Yuxuan Hu, Yimeng Zhu, Long Zhou, Jian Xue, Peidong Wang, Linquan Liu, Shujie Liu, Edward Lin, Yifan Gong

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[115] arXiv:2303.00802 (cross-list from cs.CL) [pdf, other]

Title: Synthetic Cross-accent Data Augmentation for Automatic Speech Recognition

Philipp Klumpp, Pooja Chitkara, Leda Sarı, Prashant Serai, Jilong Wu, Irina-Elena Veliche, Rongqing Huang, Qing He

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[116] arXiv:2303.00978 (cross-list from cs.CL) [pdf, other]

Title: Leveraging Large Text Corpora for End-to-End Speech Summarization

Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Tomohiro Tanaka, Atsunori Ogawa, Marc Delcroix, Ryo Masumura

Comments: Accepted to ICASSP 2023

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[117] arXiv:2303.01037 (cross-list from cs.CL) [pdf, other]

Title: Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages

Yu Zhang, Wei Han, James Qin, Yongqiang Wang, Ankur Bapna, Zhehuai Chen, Nanxin Chen, Bo Li, Vera Axelrod, Gary Wang, Zhong Meng, Ke Hu, Andrew Rosenberg, Rohit Prabhavalkar, Daniel S. Park, Parisa Haghani, Jason Riesa, Ginger Perng, Hagen Soltau, Trevor Strohman, Bhuvana Ramabhadran, Tara Sainath, Pedro Moreno, Chung-Cheng Chiu, Johan Schalkwyk, Françoise Beaufays, Yonghui Wu

Comments: 20 pages, 7 figures, 8 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[118] arXiv:2303.01086 (cross-list from cs.CL) [pdf, other]

Title: LiteG2P: A fast, light and high accuracy model for grapheme-to-phoneme conversion

Chunfeng Wang, Peisong Huang, Yuxiang Zou, Haoyu Zhang, Shichao Liu, Xiang Yin, Zejun Ma

Comments: Accepted by ICASSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[119] arXiv:2303.01125 (cross-list from cs.SD) [pdf, html, other]

Title: Distilling Multi-Level X-vector Knowledge for Small-footprint Speaker Verification

Xuechen Liu, Md Sahidullah, Tomi Kinnunen

Comments: Submitted to Data & Knowledge Engineering at Dec. 2023. Copyright may be transferred without notice

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[120] arXiv:2303.01126 (cross-list from cs.SD) [pdf, other]

Title: Speaker-Aware Anti-Spoofing

Xuechen Liu, Md Sahidullah, Kong Aik Lee, Tomi Kinnunen

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[121] arXiv:2303.01211 (cross-list from cs.SD) [pdf, other]

Title: Learning From Yourself: A Self-Distillation Method for Fake Speech Detection

Jun Xue, Cunhang Fan, Jiangyan Yi, Chenglong Wang, Zhengqi Wen, Dan Zhang, Zhao Lv

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[122] arXiv:2303.01249 (cross-list from cs.CL) [pdf, other]

Title: Language-Universal Adapter Learning with Knowledge Distillation for End-to-End Multilingual Speech Recognition

Zhijie Shen, Wu Guo, Bin Gu

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[123] arXiv:2303.01261 (cross-list from cs.CL) [pdf, html, other]

Title: ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations

Neil Shah, Saiteja Kosgi, Vishal Tambrahalli, Neha Sahipjohn, Niranjan Pedanekar, Vineet Gandhi

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[124] arXiv:2303.01507 (cross-list from cs.SD) [pdf, other]

Title: Defending against Adversarial Audio via Diffusion Model

Shutong Wu, Jiongxiao Wang, Wei Ping, Weili Nie, Chaowei Xiao

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[125] arXiv:2303.01508 (cross-list from cs.SD) [pdf, other]

Title: Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensities

Shijun Wang, Jón Guðnason, Damian Borth

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[126] arXiv:2303.01639 (cross-list from cs.SD) [pdf, other]

Title: WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech Interactions

Jun Rekimoto

Comments: ACM CHI 2023 paper

Journal-ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), April 23--28, 2023

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[127] arXiv:2303.01664 (cross-list from cs.SD) [pdf, other]

Title: Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representations

Yuma Koizumi, Heiga Zen, Shigeki Karita, Yifan Ding, Kohei Yatabe, Nobuyuki Morioka, Yu Zhang, Wei Han, Ankur Bapna, Michiel Bacchiani

Comments: Accepted to WASPAA 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[128] arXiv:2303.01665 (cross-list from cs.SD) [pdf, other]

Title: LooperGP: A Loopable Sequence Model for Live Coding Performance using GuitarPro Tablature

Sara Adkins, Pedro Sarmento, Mathieu Barthet

Comments: The Version of Record of this contribution is published in Proceedings of EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Journal-ref: EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[129] arXiv:2303.01694 (cross-list from cs.SD) [pdf, other]

Title: DWFormer: Dynamic Window transFormer for Speech Emotion Recognition

Shuaiqi Chen, Xiaofen Xing, Weibin Zhang, Weidong Chen, Xiangmin Xu

Comments: 4 pages, 5 figures, 3 tables, accepted by 2023 International Conference on Acoustics, Speech, and Signal Processing (ICASSP2023)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[130] arXiv:2303.01758 (cross-list from cs.HC) [pdf, other]

Title: SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks

Naoki Kimura, Michinari Kono, Jun Rekimoto

Comments: ACM CHI 2019 paper

Journal-ref: CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019)

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[131] arXiv:2303.01812 (cross-list from cs.SD) [pdf, other]

Title: Unified Keyword Spotting and Audio Tagging on Mobile Devices with Transformers

Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Junbo Zhang, Yujun Wang

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[132] arXiv:2303.01864 (cross-list from cs.SD) [pdf, other]

Title: Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints

Paul Magron, Tuomas Virtanen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[133] arXiv:2303.01875 (cross-list from cs.SD) [pdf, other]

Title: Decoding and Visualising Intended Emotion in an Expressive Piano Performance

Shreyan Chowdhury, Gerhard Widmer

Comments: Extended version of Late-Breaking Demo Session paper accepted at ISMIR 2022 (23rd Int. Society for Music Information Retrieval Conf., Bengaluru, India, 2022)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[134] arXiv:2303.01879 (cross-list from cs.SD) [pdf, other]

Title: Low-Complexity Audio Embedding Extractors

Florian Schmid, Khaled Koutini, Gerhard Widmer

Comments: In Proceedings of the 31st European Signal Processing Conference, EUSIPCO 2023. Source Code available at: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[135] arXiv:2303.01884 (cross-list from cs.SD) [pdf, other]

Title: AutoMatch: A Large-scale Audio Beat Matching Benchmark for Boosting Deep Learning Assistant Video Editing

Sen Pei, Jingya Yu, Qi Chen, Wozhou He

Comments: 11 pages, 5 figures

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[136] arXiv:2303.02348 (cross-list from cs.SD) [pdf, other]

Title: The DKU Post-Challenge Audio-Visual Wake Word Spotting System for the 2021 MISP Challenge: Deep Analysis

Haoxu Wang, Ming Cheng, Qiang Fu, Ming Li

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[137] arXiv:2303.02396 (cross-list from cs.SD) [pdf, other]

Title: A General Framework for Learning Procedural Audio Models of Environmental Sounds

Danzel Serrano, Mark Cartwright

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[138] arXiv:2303.02599 (cross-list from cs.SD) [pdf, other]

Title: Hybrid Y-Net Architecture for Singing Voice Separation

Rashen Fernando, Pamudu Ranasinghe, Udula Ranasinghe, Janaka Wijayakulasooriya, Pantaleon Perera

Comments: Submitted for EUSIPCO23: 5 Pages, 7 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[139] arXiv:2303.02665 (cross-list from cs.SD) [pdf, other]

Title: Heterogeneous Graph Learning for Acoustic Event Classification

Amir Shirian, Mona Ahmadian, Krishna Somandepalli, Tanaya Guha

Comments: arXiv admin note: text overlap with arXiv:2207.07935

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[140] arXiv:2303.02673 (cross-list from cs.SD) [pdf, other]

Title: Time-frequency Network for Robust Speaker Recognition

Jiguo Li, Tianzi Zhang, Xiaobin Liu, Lirong Zheng

Comments: 5pages, 3 figures

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[141] arXiv:2303.03005 (cross-list from cs.SD) [pdf, other]

Title: Scaling strategies for on-device low-complexity source separation with Conv-Tasnet

Mohamed Nabih Ali, Francesco Paissan, Daniele Falavigna, Alessio Brutti

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[142] arXiv:2303.03017 (cross-list from eess.SP) [pdf, other]

Title: Variational Inference of Structured Line Spectra Exploiting Group-Sparsity

Jakob Möderl, Franz Pernkopf, Klaus Witrisal, Erik Leitinger

Comments: 13 Pages, 5 Figures. Submitted to IEEE Transactions on Signal Processing on 6th of March, 2023. Update 31.05.2023: Fixed wrong/missing internal references

Subjects: Signal Processing (eess.SP); Audio and Speech Processing (eess.AS)

[143] arXiv:2303.03144 (cross-list from cs.MM) [pdf, other]

Title: IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide

Comments: 11 pages, 8 figures, 5 Tables

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[144] arXiv:2303.03183 (cross-list from cs.SD) [pdf, other]

Title: Utilizing synthetic training data for the supervised classification of rat ultrasonic vocalizations

K. Jack Scott, Lucinda J. Speers, David K. Bilkey

Comments: 25 pages, 5 main figures, 2 tables

Journal-ref: J Acoust Soc Am 1 January 2024 155 (1)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[145] arXiv:2303.03267 (cross-list from cs.CL) [pdf, other]

Title: Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

Yingting Li, Ambuj Mehrish, Shuai Zhao, Rishabh Bhardwaj, Amir Zadeh, Navonil Majumder, Rada Mihalcea, Soujanya Poria

Comments: ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[146] arXiv:2303.03591 (cross-list from cs.SD) [pdf, other]

Title: Approach to Learning Generalized Audio Representation Through Batch Embedding Covariance Regularization and Constant-Q Transforms

Ankit Shah, Shuyi Chen, Kejun Zhou, Yue Chen, Bhiksha Raj

Comments: Technical report, 10 pages

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[147] arXiv:2303.03600 (cross-list from cs.CL) [pdf, other]

Title: Adaptive Knowledge Distillation between Text and Speech Pre-trained Models

Jinjie Ni, Yukun Ma, Wen Wang, Qian Chen, Dianwen Ng, Han Lei, Trung Hieu Nguyen, Chong Zhang, Bin Ma, Erik Cambria

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[148] arXiv:2303.03666 (cross-list from cs.SD) [pdf, other]

Title: Face: Fast, Accurate and Context-Aware Audio Annotation and Classification

M. Mehrdad Morsali, Hoda Mohammadzade, Saeed Bagheri Shouraki

Comments: 9 pages, 4 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[149] arXiv:2303.03717 (cross-list from cs.SD) [pdf, other]

Title: Improving Self-Supervised Learning for Audio Representations by Feature Diversity and Decorrelation

Bac Nguyen, Stefan Uhlich, Fabien Cardinaux

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[150] arXiv:2303.03732 (cross-list from cs.SD) [pdf, other]

Title: A Multi-Stage Triple-Path Method for Speech Separation in Noisy and Reverberant Environments

Zhaoxi Mu, Xinyu Yang, Xiangyuan Yang, Wenjing Zhu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[151] arXiv:2303.03737 (cross-list from cs.SD) [pdf, other]

Title: Multi-Dimensional and Multi-Scale Modeling for Speech Separation Optimized by Discriminative Learning

Zhaoxi Mu, Xinyu Yang, Wenjing Zhu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[152] arXiv:2303.03857 (cross-list from cs.SD) [pdf, html, other]

Title: Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study

Yi Yuan, Haohe Liu, Jinhua Liang, Xubo Liu, Mark D. Plumbley, Wenwu Wang

Comments: Updated for EUSIPCO 2023 proceedings version

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[153] arXiv:2303.03870 (cross-list from cs.SD) [pdf, html, other]

Title: DanceAnyWay: Synthesizing Beat-Guided 3D Dances with Randomized Temporal Contrastive Learning

Aneesh Bhattacharya, Manas Paranjape, Uttaran Bhattacharya, Aniket Bera

Comments: 11 pages, 7 figures, 3 tables. To appear as part of the proceedings of the 38th Annual AAAI Conference on Artificial Intelligence, 2024

Subjects: Sound (cs.SD); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[154] arXiv:2303.03926 (cross-list from cs.CL) [pdf, other]

Title: Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

Comments: We encourage readers to listen to the audio samples on our demo page: \url{this https URL}

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[155] arXiv:2303.04068 (cross-list from cs.DB) [pdf, other]

Title: VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building [Technical Report]

Maureen Daum, Enhao Zhang, Dong He, Stephen Mussmann, Brandon Haynes, Ranjay Krishna, Magdalena Balazinska

Subjects: Databases (cs.DB); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[156] arXiv:2303.04104 (cross-list from cs.SD) [pdf, other]

Title: An Inception-Residual-Based Architecture with Multi-Objective Loss for Detecting Respiratory Anomalies

Dat Ngo, Lam Pham, Huy Phan, Minh Tran, Delaram Jarchi, Sefki Kolozali

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[157] arXiv:2303.04255 (cross-list from cs.SD) [pdf, other]

Title: Self-supervised speech representation learning for keyword-spotting with light-weight transformers

Chenyang Gao, Yue Gu, Francesco Caliva, Yuzong Liu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[158] arXiv:2303.04289 (cross-list from cs.CL) [pdf, other]

Title: Do Prosody Transfer Models Transfer Prosody?

Atli Thor Sigurgeirsson, Simon King

Comments: Accepted in ICASSP 2023, 5 pages, 2 figures, 3 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[159] arXiv:2303.04439 (cross-list from cs.CV) [pdf, other]

Title: A Light Weight Model for Active Speaker Detection

Junhua Liao, Haihan Duan, Kanghui Feng, Wanbing Zhao, Yanbing Yang, Liangyin Chen

Comments: Accepted by CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[160] arXiv:2303.04485 (cross-list from cs.SD) [pdf, other]

Title: Onsets and Velocities: Affordable Real-Time Piano Transcription Using Convolutional Neural Networks

Andres Fernandez

Comments: Accepted at EUSIPCO 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[161] arXiv:2303.04585 (cross-list from cs.SD) [pdf, other]

Title: Exploring Efficient-Tuned Learning Audio Representation Method from BriVL

Sen Fang, Yangjian Wu, Bowen Gao, Jingwen Cai, Teik Toe Teoh

Comments: 13 pages, 2023.3 Finished

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[162] arXiv:2303.05007 (cross-list from cs.CR) [pdf, other]

Title: Towards Robust Image-in-Audio Deep Steganography

Jaume Ros, Margarita Geleta, Jordi Pons, Xavier Giro-i-Nieto

Comments: 8 pages, 5 figures, 2 tables

Subjects: Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[163] arXiv:2303.05134 (cross-list from cs.SD) [pdf, other]

Title: hierarchical network with decoupled knowledge distillation for speech emotion recognition

Ziping Zhao, Huan Wang, Haishuai Wang, Bjorn Schuller

Comments: 5 pages,4 figures,icassp 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[164] arXiv:2303.05321 (cross-list from cs.CV) [pdf, other]

Title: WASD: A Wilder Active Speaker Detection Dataset

Tiago Roxo, Joana C. Costa, Pedro R. M. Inácio, Hugo Proença

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[165] arXiv:2303.05322 (cross-list from cs.SD) [pdf, other]

Title: Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation

Qi Chen, Ziyang Ma, Tao Liu, Xu Tan, Qu Lu, Xie Chen, Kai Yu

Comments: 4 pages. Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[166] arXiv:2303.05338 (cross-list from cs.SD) [pdf, other]

Title: MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning

Ruize Xu, Ruoxuan Feng, Shi-Xiong Zhang, Di Hu

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[167] arXiv:2303.05397 (cross-list from cs.SD) [pdf, html, other]

Title: TOLD: A Novel Two-Stage Overlap-Aware Framework for Speaker Diarization

Jiaming Wang, Zhihao Du, Shiliang Zhang

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[168] arXiv:2303.05678 (cross-list from cs.SD) [pdf, other]

Title: Improving Weakly Supervised Sound Event Detection with Causal Intervention

Yifei Xin, Dongchao Yang, Fan Cui, Yujun Wang, Yuexian Zou

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[169] arXiv:2303.05681 (cross-list from cs.SD) [pdf, other]

Title: Improving Text-Audio Retrieval by Text-aware Attention Pooling and Prior Matrix Revised Loss

Yifei Xin, Dongchao Yang, Yuexian Zou

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[170] arXiv:2303.05758 (cross-list from cs.SD) [pdf, other]

Title: MIXPGD: Hybrid Adversarial Training for Speech Recognition Systems

Aminul Huq, Weiyi Zhang, Xiaolin Hu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[171] arXiv:2303.05958 (cross-list from cs.CL) [pdf, other]

Title: Robust Knowledge Distillation from RNN-T Models With Noisy Training Labels Using Full-Sum Loss

Mohammad Zeineldeen, Kartik Audhkhasi, Murali Karthick Baskar, Bhuvana Ramabhadran

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[172] arXiv:2303.06379 (cross-list from cs.SD) [pdf, other]

Title: TaylorAECNet: A Taylor Style Neural Network for Full-Band Echo Cancellation

Weiming Xu, Zhihao Guo

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[173] arXiv:2303.06585 (cross-list from cs.CL) [pdf, other]

Title: Improving the Intent Classification accuracy in Noisy Environment

Mohamed Nabih Ali, Alessio Brutti, Daniele Falavigna

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[174] arXiv:2303.06982 (cross-list from cs.SD) [pdf, html, other]

Title: Analysing the Masked predictive coding training criterion for pre-training a Speech Representation Model

Hemant Yadav, Sunayana Sitaram, Rajiv Ratn Shah

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[175] arXiv:2303.07067 (cross-list from cs.LG) [pdf, other]

Title: Cross-device Federated Learning for Mobile Health Diagnostics: A First Study on COVID-19 Detection

Tong Xia, Jing Han, Abhirup Ghosh, Cecilia Mascolo

Comments: This paper has been accepted by IEEE ICASSP 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[176] arXiv:2303.07072 (cross-list from cs.SD) [pdf, other]

Title: A two-stage speaker extraction algorithm under adverse acoustic conditions using a single-microphone

Aviad Eisenberg, Sharon Gannot, Shlomo E. Chazan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[177] arXiv:2303.07538 (cross-list from cs.LG) [pdf, other]

Title: HiSSNet: Sound Event Detection and Speaker Identification via Hierarchical Prototypical Networks for Low-Resource Headphones

N Shashaank, Berker Banar, Mohammad Rasool Izadi, Jeremy Kemmerer, Shuo Zhang, Chuan-Che Huang

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[178] arXiv:2303.07578 (cross-list from cs.SD) [pdf, other]

Title: VANI: Very-lightweight Accent-controllable TTS for Native and Non-native speakers with Identity Preservation

Rohan Badlani, Akshit Arora, Subhankar Ghosh, Rafael Valle, Kevin J. Shih, João Felipe Santos, Boris Ginsburg, Bryan Catanzaro

Comments: Presentation accepted at ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[179] arXiv:2303.07624 (cross-list from cs.CL) [pdf, other]

Title: I3D: Transformer architectures with input-dependent dynamic depth for speech recognition

Yifan Peng, Jaesong Lee, Shinji Watanabe

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[180] arXiv:2303.07626 (cross-list from cs.SD) [pdf, other]

Title: CAT: Causal Audio Transformer for Audio Classification

Xiaoyu Liu, Hanlin Lu, Jianbo Yuan, Xinyu Li

Comments: Accepted to ICASSP 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[181] arXiv:2303.07643 (cross-list from cs.SD) [pdf, other]

Title: Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification

Zuheng Kang, Yayun He, Jianzong Wang, Junqing Peng, Xiaoyang Qu, Jing Xiao

Comments: Accepted by ICASSP 2023. International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[182] arXiv:2303.07650 (cross-list from cs.CL) [pdf, other]

Title: Cross-lingual Alzheimer's Disease detection based on paralinguistic and pre-trained features

Xuchu Chen, Yu Pu, Jinpeng Li, Wei-Qiang Zhang

Comments: accepted by ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[183] arXiv:2303.07682 (cross-list from cs.SD) [pdf, other]

Title: QI-TTS: Questioning Intonation Control for Emotional Speech Synthesis

Haobin Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[184] arXiv:2303.07687 (cross-list from cs.SD) [pdf, other]

Title: Dynamic Alignment Mask CTC: Improved Mask-CTC with Aligned Cross Entropy

Xulong Zhang, Haobin Tang, Jianzong Wang, Ning Cheng, Jian Luo, Jing Xiao

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[185] arXiv:2303.07711 (cross-list from cs.SD) [pdf, other]

Title: Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis

Chunyu Qiang, Peng Yang, Hao Che, Ying Zhang, Xiaorui Wang, Zhongyuan Wang

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[186] arXiv:2303.07726 (cross-list from cs.CL) [pdf, other]

Title: Good Neighbors Are All You Need for Chinese Grapheme-to-Phoneme Conversion

Jungjun Kim, Changjin Han, Gyuhyeon Nam, Gyeongsu Chae

Comments: Accepted to ICASSP 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[187] arXiv:2303.07739 (cross-list from eess.SP) [pdf, other]

Title: Detecting post-stroke aphasia using EEG-based neural envelope tracking of natural speech

Pieter De Clercq, Jill Kries, Ramtin Mehraram, Jonas Vanthornhout, Tom Francart, Maaike Vandermosten

Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[188] arXiv:2303.07794 (cross-list from cs.SD) [pdf, other]

Title: DiffuseRoll: Multi-track multi-category music generation based on diffusion model

Hongfei Wang

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[189] arXiv:2303.07902 (cross-list from cs.SD) [pdf, html, other]

Title: BLAT: Bootstrapping Language-Audio Pre-training based on AudioSet Tag-guided Synthetic Data

Xuenan Xu, Zhiling Zhang, Zelin Zhou, Pingyue Zhang, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[190] arXiv:2303.07924 (cross-list from cs.LG) [pdf, other]

Title: Improving Accented Speech Recognition with Multi-Domain Training

Lucas Maison, Yannick Estève

Comments: 5 pages, 2 figures. Accepted to ICASSP 2023

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[191] arXiv:2303.08026 (cross-list from cs.SD) [pdf, other]

Title: A Study on Bias and Fairness In Deep Speaker Recognition

Amirhossein Hajavi, Ali Etemad

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[192] arXiv:2303.08239 (cross-list from cs.SD) [pdf, other]

Title: Facilitating deep acoustic phenotyping: A basic coding scheme of infant vocalisations preluding computational analysis, machine learning and clinical reasoning

Tomas Kulvicius, Sigrun Lang, Claudius AA Widmann, Nina Hansmann, Daniel Holzinger, Luise Poustka, Dajie Zhang, Peter B Marschik

Comments: This paper is in German

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[193] arXiv:2303.08268 (cross-list from cs.RO) [pdf, other]

Title: Chat with the Environment: Interactive Multimodal Perception Using Large Language Models

Xufeng Zhao, Mengdi Li, Cornelius Weber, Muhammad Burhan Hafez, Stefan Wermter

Comments: IROS2023, Detroit. See the project website at this https URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[194] arXiv:2303.08295 (cross-list from eess.SP) [pdf, other]

Title: A large-scale multimodal dataset of human speech recognition

Yao Ge, Chong Tang, Haobo Li, Zikang Zhang, Wenda Li, Kevin Chetty, Daniele Faccio, Qammer H. Abbasi, Muhammad Imran

Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[195] arXiv:2303.08329 (cross-list from cs.SD) [pdf, other]

Title: Cross-speaker Emotion Transfer by Manipulating Speech Style Latents

Suhee Jo, Younggun Lee, Yookyung Shin, Yeongtae Hwang, Taesu Kim

Comments: accepted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[196] arXiv:2303.08342 (cross-list from cs.SD) [pdf, html, other]

Title: Autonomous Soundscape Augmentation with Multimodal Fusion of Visual and Participant-linked Inputs

Kenneth Ooi, Karn N. Watcharasupat, Bhan Lam, Zhen-Ting Ong, Woon-Seng Gan

Comments: [v1] 5 pages, 2 figures. Submitted to 2023 IEEE International Conference on Acoustics, Speech and Signal Processing. [v2] 5 pages, 2 figures. Fixed incorrect author list in citation #30

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Jun. 2023, pp. 1-5

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[197] arXiv:2303.08362 (cross-list from cs.SD) [pdf, other]

Title: Transfer Learning Based Diagnosis and Analysis of Lung Sound Aberrations

Hafsa Gulzar, Jiyun Li, Arslan Manzoor, Sadaf Rehmat, Usman Amjad, Hadiqa Jalil Khan

Comments: 12 pages, 9 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[198] arXiv:2303.08385 (cross-list from cs.SD) [pdf, other]

Title: Generating symbolic music using diffusion models

Lilac Atassi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[199] arXiv:2303.08536 (cross-list from cs.MM) [pdf, other]

Title: Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring

Joanna Hong, Minsu Kim, Jeongsoo Choi, Yong Man Ro

Comments: Accepted at CVPR 2023. Implementation available: this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[200] arXiv:2303.08561 (cross-list from cs.SD) [pdf, other]

Title: Enhancing Unsupervised Audio Representation Learning via Adversarial Sample Generation

Yulin Pan, Xiangteng He, Biao Gong, Yuxin Peng, Yiliang Lv

Comments: 8 pages, 4 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)