Audio and Speech Processing

Authors and titles for March 2023

[116] arXiv:2303.00978 (cross-list from cs.CL) [pdf, other]

Title: Leveraging Large Text Corpora for End-to-End Speech Summarization

Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Tomohiro Tanaka, Atsunori Ogawa, Marc Delcroix, Ryo Masumura

Comments: Accepted to ICASSP 2023

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[117] arXiv:2303.01037 (cross-list from cs.CL) [pdf, other]

Title: Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages

Yu Zhang, Wei Han, James Qin, Yongqiang Wang, Ankur Bapna, Zhehuai Chen, Nanxin Chen, Bo Li, Vera Axelrod, Gary Wang, Zhong Meng, Ke Hu, Andrew Rosenberg, Rohit Prabhavalkar, Daniel S. Park, Parisa Haghani, Jason Riesa, Ginger Perng, Hagen Soltau, Trevor Strohman, Bhuvana Ramabhadran, Tara Sainath, Pedro Moreno, Chung-Cheng Chiu, Johan Schalkwyk, Françoise Beaufays, Yonghui Wu

Comments: 20 pages, 7 figures, 8 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[118] arXiv:2303.01086 (cross-list from cs.CL) [pdf, other]

Title: LiteG2P: A fast, light and high accuracy model for grapheme-to-phoneme conversion

Chunfeng Wang, Peisong Huang, Yuxiang Zou, Haoyu Zhang, Shichao Liu, Xiang Yin, Zejun Ma

Comments: Accepted by ICASSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[119] arXiv:2303.01125 (cross-list from cs.SD) [pdf, html, other]

Title: Distilling Multi-Level X-vector Knowledge for Small-footprint Speaker Verification

Xuechen Liu, Md Sahidullah, Tomi Kinnunen

Comments: Submitted to Data & Knowledge Engineering at Dec. 2023. Copyright may be transferred without notice

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[120] arXiv:2303.01126 (cross-list from cs.SD) [pdf, other]

Title: Speaker-Aware Anti-Spoofing

Xuechen Liu, Md Sahidullah, Kong Aik Lee, Tomi Kinnunen

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[121] arXiv:2303.01211 (cross-list from cs.SD) [pdf, other]

Title: Learning From Yourself: A Self-Distillation Method for Fake Speech Detection

Jun Xue, Cunhang Fan, Jiangyan Yi, Chenglong Wang, Zhengqi Wen, Dan Zhang, Zhao Lv

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[122] arXiv:2303.01249 (cross-list from cs.CL) [pdf, other]

Title: Language-Universal Adapter Learning with Knowledge Distillation for End-to-End Multilingual Speech Recognition

Zhijie Shen, Wu Guo, Bin Gu

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[123] arXiv:2303.01261 (cross-list from cs.CL) [pdf, html, other]

Title: ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations

Neil Shah, Saiteja Kosgi, Vishal Tambrahalli, Neha Sahipjohn, Niranjan Pedanekar, Vineet Gandhi

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[124] arXiv:2303.01507 (cross-list from cs.SD) [pdf, other]

Title: Defending against Adversarial Audio via Diffusion Model

Shutong Wu, Jiongxiao Wang, Wei Ping, Weili Nie, Chaowei Xiao

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[125] arXiv:2303.01508 (cross-list from cs.SD) [pdf, other]

Title: Fine-grained Emotional Control of Text-To-Speech: Learning To Rank Inter- And Intra-Class Emotion Intensities

Shijun Wang, Jón Guðnason, Damian Borth

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[126] arXiv:2303.01639 (cross-list from cs.SD) [pdf, other]

Title: WESPER: Zero-shot and Realtime Whisper to Normal Voice Conversion for Whisper-based Speech Interactions

Jun Rekimoto

Comments: ACM CHI 2023 paper

Journal-ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), April 23--28, 2023

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[127] arXiv:2303.01664 (cross-list from cs.SD) [pdf, other]

Title: Miipher: A Robust Speech Restoration Model Integrating Self-Supervised Speech and Text Representations

Yuma Koizumi, Heiga Zen, Shigeki Karita, Yifan Ding, Kohei Yatabe, Nobuyuki Morioka, Yu Zhang, Wei Han, Ankur Bapna, Michiel Bacchiani

Comments: Accepted to WASPAA 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[128] arXiv:2303.01665 (cross-list from cs.SD) [pdf, other]

Title: LooperGP: A Loopable Sequence Model for Live Coding Performance using GuitarPro Tablature

Sara Adkins, Pedro Sarmento, Mathieu Barthet

Comments: The Version of Record of this contribution is published in Proceedings of EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Journal-ref: EvoMUSART: International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) 2023

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[129] arXiv:2303.01694 (cross-list from cs.SD) [pdf, other]

Title: DWFormer: Dynamic Window transFormer for Speech Emotion Recognition

Shuaiqi Chen, Xiaofen Xing, Weibin Zhang, Weidong Chen, Xiangmin Xu

Comments: 4 pages, 5 figures, 3 tables, accepted by 2023 International Conference on Acoustics, Speech, and Signal Processing (ICASSP2023)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[130] arXiv:2303.01758 (cross-list from cs.HC) [pdf, other]

Title: SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks

Naoki Kimura, Michinari Kono, Jun Rekimoto

Comments: ACM CHI 2019 paper

Journal-ref: CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019)

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[131] arXiv:2303.01812 (cross-list from cs.SD) [pdf, other]

Title: Unified Keyword Spotting and Audio Tagging on Mobile Devices with Transformers

Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Junbo Zhang, Yujun Wang

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[132] arXiv:2303.01864 (cross-list from cs.SD) [pdf, other]

Title: Spectrogram Inversion for Audio Source Separation via Consistency, Mixing, and Magnitude Constraints

Paul Magron, Tuomas Virtanen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[133] arXiv:2303.01875 (cross-list from cs.SD) [pdf, other]

Title: Decoding and Visualising Intended Emotion in an Expressive Piano Performance

Shreyan Chowdhury, Gerhard Widmer

Comments: Extended version of Late-Breaking Demo Session paper accepted at ISMIR 2022 (23rd Int. Society for Music Information Retrieval Conf., Bengaluru, India, 2022)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[134] arXiv:2303.01879 (cross-list from cs.SD) [pdf, other]

Title: Low-Complexity Audio Embedding Extractors

Florian Schmid, Khaled Koutini, Gerhard Widmer

Comments: In Proceedings of the 31st European Signal Processing Conference, EUSIPCO 2023. Source Code available at: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[135] arXiv:2303.01884 (cross-list from cs.SD) [pdf, other]

Title: AutoMatch: A Large-scale Audio Beat Matching Benchmark for Boosting Deep Learning Assistant Video Editing

Sen Pei, Jingya Yu, Qi Chen, Wozhou He

Comments: 11 pages, 5 figures

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[136] arXiv:2303.02348 (cross-list from cs.SD) [pdf, other]

Title: The DKU Post-Challenge Audio-Visual Wake Word Spotting System for the 2021 MISP Challenge: Deep Analysis

Haoxu Wang, Ming Cheng, Qiang Fu, Ming Li

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[137] arXiv:2303.02396 (cross-list from cs.SD) [pdf, other]

Title: A General Framework for Learning Procedural Audio Models of Environmental Sounds

Danzel Serrano, Mark Cartwright

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[138] arXiv:2303.02599 (cross-list from cs.SD) [pdf, other]

Title: Hybrid Y-Net Architecture for Singing Voice Separation

Rashen Fernando, Pamudu Ranasinghe, Udula Ranasinghe, Janaka Wijayakulasooriya, Pantaleon Perera

Comments: Submitted for EUSIPCO23: 5 Pages, 7 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[139] arXiv:2303.02665 (cross-list from cs.SD) [pdf, other]

Title: Heterogeneous Graph Learning for Acoustic Event Classification

Amir Shirian, Mona Ahmadian, Krishna Somandepalli, Tanaya Guha

Comments: arXiv admin note: text overlap with arXiv:2207.07935

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[140] arXiv:2303.02673 (cross-list from cs.SD) [pdf, other]

Title: Time-frequency Network for Robust Speaker Recognition

Jiguo Li, Tianzi Zhang, Xiaobin Liu, Lirong Zheng

Comments: 5pages, 3 figures

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)