Sound

Authors and titles for March 2023

[51] arXiv:2303.07643 [pdf, other]

Title: Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification

Zuheng Kang, Yayun He, Jianzong Wang, Junqing Peng, Xiaoyang Qu, Jing Xiao

Comments: Accepted by ICASSP 2023. International Conference on Acoustics, Speech and Signal Processing (ICASSP 2023)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[52] arXiv:2303.07667 [pdf, other]

Title: Improving Music Genre Classification from Multi-Modal Properties of Music and Genre Correlations Perspective

Ganghui Ru, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD)

[53] arXiv:2303.07682 [pdf, other]

Title: QI-TTS: Questioning Intonation Control for Emotional Speech Synthesis

Haobin Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[54] arXiv:2303.07687 [pdf, other]

Title: Dynamic Alignment Mask CTC: Improved Mask-CTC with Aligned Cross Entropy

Xulong Zhang, Haobin Tang, Jianzong Wang, Ning Cheng, Jian Luo, Jing Xiao

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[55] arXiv:2303.07711 [pdf, other]

Title: Improving Prosody for Cross-Speaker Style Transfer by Semi-Supervised Style Extractor and Hierarchical Modeling in Speech Synthesis

Chunyu Qiang, Peng Yang, Hao Che, Ying Zhang, Xiaorui Wang, Zhongyuan Wang

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[56] arXiv:2303.07794 [pdf, other]

Title: DiffuseRoll: Multi-track multi-category music generation based on diffusion model

Hongfei Wang

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[57] arXiv:2303.07902 [pdf, html, other]

Title: BLAT: Bootstrapping Language-Audio Pre-training based on AudioSet Tag-guided Synthetic Data

Xuenan Xu, Zhiling Zhang, Zelin Zhou, Pingyue Zhang, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[58] arXiv:2303.08026 [pdf, other]

Title: A Study on Bias and Fairness In Deep Speaker Recognition

Amirhossein Hajavi, Ali Etemad

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[59] arXiv:2303.08239 [pdf, other]

Title: Facilitating deep acoustic phenotyping: A basic coding scheme of infant vocalisations preluding computational analysis, machine learning and clinical reasoning

Tomas Kulvicius, Sigrun Lang, Claudius AA Widmann, Nina Hansmann, Daniel Holzinger, Luise Poustka, Dajie Zhang, Peter B Marschik

Comments: This paper is in German

Journal-ref: Kindheit und EntwicklungVol, 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2303.08329 [pdf, other]

Title: Cross-speaker Emotion Transfer by Manipulating Speech Style Latents

Suhee Jo, Younggun Lee, Yookyung Shin, Yeongtae Hwang, Taesu Kim

Comments: accepted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[61] arXiv:2303.08342 [pdf, html, other]

Title: Autonomous Soundscape Augmentation with Multimodal Fusion of Visual and Participant-linked Inputs

Kenneth Ooi, Karn N. Watcharasupat, Bhan Lam, Zhen-Ting Ong, Woon-Seng Gan

Comments: [v1] 5 pages, 2 figures. Submitted to 2023 IEEE International Conference on Acoustics, Speech and Signal Processing. [v2] 5 pages, 2 figures. Fixed incorrect author list in citation #30

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Jun. 2023, pp. 1-5

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[62] arXiv:2303.08362 [pdf, other]

Title: Transfer Learning Based Diagnosis and Analysis of Lung Sound Aberrations

Hafsa Gulzar, Jiyun Li, Arslan Manzoor, Sadaf Rehmat, Usman Amjad, Hadiqa Jalil Khan

Comments: 12 pages, 9 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[63] arXiv:2303.08385 [pdf, other]

Title: Generating symbolic music using diffusion models

Lilac Atassi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[64] arXiv:2303.08561 [pdf, other]

Title: Enhancing Unsupervised Audio Representation Learning via Adversarial Sample Generation

Yulin Pan, Xiangteng He, Biao Gong, Yuxin Peng, Yiliang Lv

Comments: 8 pages, 4 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[65] arXiv:2303.08607 [pdf, other]

Title: PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor

Yuning Wu, Jiatong Shi, Tao Qian, Dongji Gao, Qin Jin

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[66] arXiv:2303.08610 [pdf, other]

Title: Blind Estimation of Audio Processing Graph

Sungho Lee, Jaehyun Park, Seungryeol Paik, Kyogu Lee

Comments: Accepted to ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2303.09048 [pdf, other]

Title: Improving Perceptual Quality, Intelligibility, and Acoustics on VoIP Platforms

Joseph Konan, Ojas Bhargave, Shikhar Agnihotri, Hojeong Lee, Ankit Shah, Shuo Han, Yunyang Zeng, Amanda Shu, Haohui Liu, Xuankai Chang, Hamza Khalid, Minseon Gwak, Kawon Lee, Minjeong Kim, Bhiksha Raj

Comments: Under review at European Association for Signal Processing. 5 pages

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[68] arXiv:2303.10316 [pdf, other]

Title: Zero-shot Sound Event Classification Using a Sound Attribute Vector with Global and Local Feature Learning

Yi-Han Lin, Xunquan Chen, Ryoichi Takashima, Tetsuya Takiguchi

Comments: Accepted by ICASSP2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2303.10351 [pdf, other]

Title: Weight-sharing Supernet for Searching Specialized Acoustic Event Classification Networks Across Device Constraints

Guan-Ting Lin, Qingming Tang, Chieh-Chi Kao, Viktor Rozgic, Chao Wang

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[70] arXiv:2303.10445 [pdf, other]

Title: EarCough: Enabling Continuous Subject Cough Event Detection on Hearables

Xiyuxing Zhang, Yuntao Wang, Jingru Zhang, Yaqing Yang, Shwetak Patel, Yuanchun Shi

Comments: This paper has been accepted by ACM CHI 2023

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[71] arXiv:2303.10446 [pdf, html, other]

Title: Content Adaptive Front End For Audio Classification

Prateek Verma, Chris Chafe

Comments: 5 pages, 4 figures. 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing, Rhodes, Greece; Minor Edits

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[72] arXiv:2303.10539 [pdf, other]

Title: Textless Speech-to-Music Retrieval Using Emotion Similarity

SeungHeon Doh, Minz Won, Keunwoo Choi, Juhan Nam

Comments: To Appear IEEE ICASSP 2023

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[73] arXiv:2303.10667 [pdf, other]

Title: Audio-Text Models Do Not Yet Leverage Natural Language

Ho-Hsiang Wu, Oriol Nieto, Juan Pablo Bello, Justin Salamon

Comments: Copyright 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[74] arXiv:2303.10757 [pdf, other]

Title: Multiscale Audio Spectrogram Transformer for Efficient Audio Classification

Wentao Zhu, Mohamed Omar

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[75] arXiv:2303.10897 [pdf, other]

Title: Relate auditory speech to EEG by shallow-deep attention-based network

Fan Cui, Liyong Guo, Lang He, Jiyao Liu, ErCheng Pei, Yujun Wang, Dongmei Jiang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)

[76] arXiv:2303.10912 [pdf, other]

Title: Exploring Representation Learning for Small-Footprint Keyword Spotting

Fan Cui, Liyong Guo, Quandong Wang, Peng Gao, Yujun Wang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[77] arXiv:2303.11020 [pdf, other]

Title: DS-TDNN: Dual-stream Time-delay Neural Network with Global-aware Filter for Speaker Verification

Yangfu Li, Jiapan Gan, Xiaodan Lin

Comments: 13 pages 4 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[78] arXiv:2303.11510 [pdf, other]

Title: ICASSP 2023 Deep Noise Suppression Challenge

Harishchandra Dubey, Ashkan Aazami, Vishak Gopal, Babak Naderi, Sebastian Braun, Ross Cutler, Alex Ju, Mehdi Zohourian, Min Tang, Hannes Gamper, Mehrsa Golestaneh, Robert Aichner

Comments: 6 pages, 1 figure. arXiv admin note: text overlap with arXiv:2202.13288

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[79] arXiv:2303.11692 [pdf, other]

Title: ByteCover3: Accurate Cover Song Identification on Short Queries

Xingjian Du, Zijie Wang, Xia Liang, Huidong Liang, Bilei Zhu, Zejun Ma

Comments: Accepeted by ICASSP 2023

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[80] arXiv:2303.11816 [pdf, other]

Title: Personalized Lightweight Text-to-Speech: Voice Cloning with Adaptive Structured Pruning

Sung-Feng Huang, Chia-ping Chen, Zhi-Sheng Chen, Yu-Pao Tsai, Hung-yi Lee

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[81] arXiv:2303.12300 [pdf, other]

Title: Exploring Turkish Speech Recognition via Hybrid CTC/Attention Architecture and Multi-feature Fusion Network

Zeyu Ren, Nurmement Yolwas, Huiru Wang, Wushour Slamu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[82] arXiv:2303.12692 [pdf, other]

Title: Dual-Quaternions: Theory and Applications in Sound

Benjamin Kenwright

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[83] arXiv:2303.12984 [pdf, other]

Title: LMCodec: A Low Bitrate Speech Codec With Causal Transformer Models

Teerapat Jenrungrot, Michael Chinen, W. Bastiaan Kleijn, Jan Skoglund, Zalán Borsos, Neil Zeghidour, Marco Tagliasacchi

Comments: 5 pages, accepted to ICASSP 2023, project page: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[84] arXiv:2303.13072 [pdf, other]

Title: Beyond Universal Transformer: block reusing with adaptor in Transformer for automatic speech recognition

Haoyu Tang, Zhaoyi Liu, Chang Zeng, Xinfeng Li

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[85] arXiv:2303.13272 [pdf, other]

Title: Frame-Level Multi-Label Playing Technique Detection Using Multi-Scale Network and Self-Attention Mechanism

Dichucheng Li, Mingjin Che, Wenwu Meng, Yulun Wu, Yi Yu, Fan Xia, Wei Li

Comments: Accepted to ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[86] arXiv:2303.13336 [pdf, other]

Title: A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI

Chenshuang Zhang, Chaoning Zhang, Sheng Zheng, Mengchun Zhang, Maryam Qamar, Sung-Ho Bae, In So Kweon

Comments: 18 pages

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[87] arXiv:2303.13631 [pdf, html, other]

Title: In-depth analysis of music structure as a text network

Ping-Rui Tsai, Yen-Ting Chou, Nathan-Christopher Wang, Hui-Ling Chen, Hong-Yue Huang, Zih-Jia Luo, Tzay-Ming Hong

Comments: 7 pages, 8 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[88] arXiv:2303.13881 [pdf, other]

Title: Symbolic Music Structure Analysis with Graph Representations and Changepoint Detection Methods

Carlos Hernandez-Olivan, Sonia Rubio Llamas, Jose R. Beltran

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[89] arXiv:2303.13909 [pdf, other]

Title: Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis

Takuhiro Kaneko, Hirokazu Kameoka, Kou Tanaka, Shogo Seki

Comments: Accepted to ICASSP 2023. Project page: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[90] arXiv:2303.14593 [pdf, other]

Title: Time-domain Speech Enhancement Assisted by Multi-resolution Frequency Encoder and Decoder

Hao Shi, Masato Mimura, Longbiao Wang, Jianwu Dang, Tatsuya Kawahara

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[91] arXiv:2303.15161 [pdf, other]

Title: Data Augmentation for Environmental Sound Classification Using Diffusion Probabilistic Model with Top-k Selection Discriminator

Yunhao Chen, Yunjie Zhu, Zihui Yan, Jianlu Shen, Zhen Ren, Yifan Huang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2303.15306 [pdf, other]

Title: Pitchclass2vec: Symbolic Music Structure Segmentation with Chord Embeddings

Nicolas Lazzari, Andrea Poltronieri, Valentina Presutti

Journal-ref: Proceedings of the 1st Workshop on Artificial Intelligence and Creativity co-located with 21th International Conference of the Italian Association for Artificial Intelligence(AIxIA 2022), Udine, Italy, November 28 - December 3, 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[93] arXiv:2303.15734 [pdf, html, other]

Title: Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approach

Ibrahim Khan, Thai Van Nguyen, Chollakorn Nimpattanavong, Ruck Thawonmas

Comments: In the updated version, the description of the association between the distance between the two players (PD) and the instrument's volume on page 3 has been revised

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[94] arXiv:2303.15940 [pdf, other]

Title: TransAudio: Towards the Transferable Adversarial Audio Attack via Learning Contextualized Perturbations

Qi Gege, Yuefeng Chen, Xiaofeng Mao, Yao Zhu, Binyuan Hui, Xiaodan Li, Rong Zhang, Hui Xue

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[95] arXiv:2303.17949 [pdf, other]

Title: Unsupervised Anomaly Detection and Localization of Machine Audio: A GAN-based Approach

Anbai Jiang, Wei-Qiang Zhang, Yufeng Deng, Pingyi Fan, Jia Liu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[96] arXiv:2303.00069 (cross-list from cs.CL) [pdf, other]

Title: ClArTTS: An Open-Source Classical Arabic Text-to-Speech Corpus

Ajinkya Kulkarni, Atharva Kulkarni, Sara Abedalmonem Mohammad Shatnawi, Hanan Aldarmaki

Comments: None

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2303.00091 (cross-list from eess.AS) [pdf, other]

Title: Improving Medical Speech-to-Text Accuracy with Vision-Language Pre-training Model

Jaeyoung Huh, Sangjoon Park, Jeong Eun Lee, Jong Chul Ye

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Image and Video Processing (eess.IV)

[98] arXiv:2303.00146 (cross-list from cs.HC) [pdf, html, other]

Title: I Know Your Feelings Before You Do: Predicting Future Affective Reactions in Human-Computer Dialogue

Yuanchao Li, Koji Inoue, Leimin Tian, Changzeng Fu, Carlos Ishi, Hiroshi Ishiguro, Tatsuya Kawahara, Catherine Lai

Comments: Accepted to CHI2023 Late-Breaking Work

Subjects: Human-Computer Interaction (cs.HC); Robotics (cs.RO); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[99] arXiv:2303.00455 (cross-list from eess.AS) [pdf, other]

Title: First-shot anomaly sound detection for machine condition monitoring: A domain generalization baseline

Noboru Harada, Daisuke Niizumi, Yasunori Ohishi, Daiki Takeuchi, Masahiro Yasuda

Comments: 5 pages, 2 figures

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[100] arXiv:2303.00456 (cross-list from cs.CL) [pdf, other]

Title: N-best T5: Robust ASR Error Correction using Multiple Input Hypotheses and Constrained Decoding Space

Rao Ma, Mark J. F. Gales, Kate M. Knill, Mengjie Qian

Comments: Proceedings of INTERSPEECH

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[101] arXiv:2303.00529 (cross-list from eess.AS) [pdf, other]

Title: Extending DNN-based Multiplicative Masking to Deep Subband Filtering for Improved Dereverberation

Jean-Marie Lemercier, Julian Tobergte, Timo Gerkmann

Comments: Accepted at ISCA Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[102] arXiv:2303.00550 (cross-list from eess.AS) [pdf, other]

Title: Towards domain generalisation in ASR with elitist sampling and ensemble knowledge distillation

Rehan Ahmad, Md Asif Jalal, Muhammad Umar Farooq, Anna Ollerenshaw, Thomas Hain

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[103] arXiv:2303.00645 (cross-list from eess.AS) [pdf, other]

Title: audb -- Sharing and Versioning of Audio and Annotation Data in Python

Hagen Wierstorf, Johannes Wagner, Florian Eyben, Felix Burkhardt, Björn W. Schuller

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[104] arXiv:2303.00733 (cross-list from eess.AS) [pdf, other]

Title: SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks

Kai-Wei Chang, Yu-Kai Wang, Hua Shen, Iu-thing Kang, Wei-Cheng Tseng, Shang-Wen Li, Hung-yi Lee

Comments: Project website: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[105] arXiv:2303.00744 (cross-list from cs.CV) [pdf, other]

Title: READ Avatars: Realistic Emotion-controllable Audio Driven Avatars

Jack Saunders, Vinay Namboodiri

Comments: 13 Pages, 8 Figures For demo video see this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[106] arXiv:2303.00802 (cross-list from cs.CL) [pdf, other]

Title: Synthetic Cross-accent Data Augmentation for Automatic Speech Recognition

Philipp Klumpp, Pooja Chitkara, Leda Sarı, Prashant Serai, Jilong Wu, Irina-Elena Veliche, Rongqing Huang, Qing He

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[107] arXiv:2303.00830 (cross-list from eess.AS) [pdf, other]

Title: DISPLACE Challenge: DIarization of SPeaker and LAnguage in Conversational Environments

Shikha Baghel, Shreyas Ramoji, Sidharth, Ranjana H, Prachi Singh, Somil Jain, Pratik Roy Chowdhuri, Kaustubh Kulkarni, Swapnil Padhi, Deepu Vijayasenan, Sriram Ganapathy

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[108] arXiv:2303.01037 (cross-list from cs.CL) [pdf, other]

Title: Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages

Yu Zhang, Wei Han, James Qin, Yongqiang Wang, Ankur Bapna, Zhehuai Chen, Nanxin Chen, Bo Li, Vera Axelrod, Gary Wang, Zhong Meng, Ke Hu, Andrew Rosenberg, Rohit Prabhavalkar, Daniel S. Park, Parisa Haghani, Jason Riesa, Ginger Perng, Hagen Soltau, Trevor Strohman, Bhuvana Ramabhadran, Tara Sainath, Pedro Moreno, Chung-Cheng Chiu, Johan Schalkwyk, Françoise Beaufays, Yonghui Wu

Comments: 20 pages, 7 figures, 8 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[109] arXiv:2303.01086 (cross-list from cs.CL) [pdf, other]

Title: LiteG2P: A fast, light and high accuracy model for grapheme-to-phoneme conversion

Chunfeng Wang, Peisong Huang, Yuxiang Zou, Haoyu Zhang, Shichao Liu, Xiang Yin, Zejun Ma

Comments: Accepted by ICASSP2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[110] arXiv:2303.01192 (cross-list from eess.AS) [pdf, other]

Title: Improving Transformer-based End-to-End Speaker Diarization by Assigning Auxiliary Losses to Attention Heads

Ye-Rin Jeoung, Joon-Young Yang, Jeong-Hwan Choi, Joon-Hyuk Chang

Comments: 5 pages, ICASSP2023 (Accepted)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[111] arXiv:2303.01249 (cross-list from cs.CL) [pdf, other]

Title: Language-Universal Adapter Learning with Knowledge Distillation for End-to-End Multilingual Speech Recognition

Zhijie Shen, Wu Guo, Bin Gu

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[112] arXiv:2303.01261 (cross-list from cs.CL) [pdf, html, other]

Title: ParrotTTS: Text-to-Speech synthesis by exploiting self-supervised representations

Neil Shah, Saiteja Kosgi, Vishal Tambrahalli, Neha Sahipjohn, Niranjan Pedanekar, Vineet Gandhi

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[113] arXiv:2303.01758 (cross-list from cs.HC) [pdf, other]

Title: SottoVoce: An Ultrasound Imaging-Based Silent Speech Interaction Using Deep Neural Networks

Naoki Kimura, Michinari Kono, Jun Rekimoto

Comments: ACM CHI 2019 paper

Journal-ref: CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019)

Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[114] arXiv:2303.01849 (cross-list from eess.AS) [pdf, other]

Title: An investigation into the adaptability of a diffusion-based TTS model

Haolin Chen, Philip N. Garner

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[115] arXiv:2303.02523 (cross-list from eess.AS) [pdf, other]

Title: Requirements for Mass Adoption of Assistive Listening Technology by the General Public

Thomas B. Kaufmann, Mehdi Foroogozar, Julie Liss, Visar Berisha

Comments: Accepted to ICASSP 2023

Journal-ref: 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW), Rhodes Island, Greece, 2023, pp. 1-5

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[116] arXiv:2303.02719 (cross-list from eess.AS) [pdf, other]

Title: A Comparative Study of Self-Supervised Speech Representations in Read and Spontaneous TTS

Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely

Comments: 5 pages, 2 figures. ICASSP Workshop SASB (Self-Supervision in Audio, Speech and Beyond)2023

Journal-ref: Proceedings of the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)

[117] arXiv:2303.02939 (cross-list from eess.AS) [pdf, other]

Title: FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model

Ruiqing Xue, Yanqing Liu, Lei He, Xu Tan, Linquan Liu, Edward Lin, Sheng Zhao

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[118] arXiv:2303.03049 (cross-list from eess.AS) [pdf, other]

Title: Cross-Lingual Transfer Learning for Alzheimer's Detection From Spontaneous Speech

Bastiaan Tamm, Rik Vandenberghe, Hugo Van hamme

Comments: 2 pages, submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[119] arXiv:2303.03144 (cross-list from cs.MM) [pdf, other]

Title: IPA-CLIP: Integrating Phonetic Priors into Vision and Language Pretraining

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide

Comments: 11 pages, 8 figures, 5 Tables

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[120] arXiv:2303.03177 (cross-list from eess.AS) [pdf, other]

Title: Pre-trained Model Representations and their Robustness against Noise for Speech Emotion Analysis

Vikramjit Mitra, Vasudha Kowtha, Hsiang-Yun Sherry Chien, Erdrin Azemi, Carlos Avendano

Comments: 5 pages, conference

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[121] arXiv:2303.03267 (cross-list from cs.CL) [pdf, other]

Title: Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding

Yingting Li, Ambuj Mehrish, Shuai Zhao, Rishabh Bhardwaj, Amir Zadeh, Navonil Majumder, Rada Mihalcea, Soujanya Poria

Comments: ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[122] arXiv:2303.03329 (cross-list from eess.AS) [pdf, other]

Title: End-to-End Speech Recognition: A Survey

Rohit Prabhavalkar, Takaaki Hori, Tara N. Sainath, Ralf Schlüter, Shinji Watanabe

Comments: Submitted to IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[123] arXiv:2303.03600 (cross-list from cs.CL) [pdf, other]

Title: Adaptive Knowledge Distillation between Text and Speech Pre-trained Models

Jinjie Ni, Yukun Ma, Wen Wang, Qian Chen, Dianwen Ng, Han Lei, Trung Hieu Nguyen, Chong Zhang, Bin Ma, Erik Cambria

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[124] arXiv:2303.03689 (cross-list from eess.AS) [pdf, other]

Title: AST-SED: An Effective Sound Event Detection Method Based on Audio Spectrogram Transformer

Kang Li, Yan Song, Li-Rong Dai, Ian McLoughlin, Xin Fang, Lin Liu

Comments: accepted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[125] arXiv:2303.03849 (cross-list from eess.AS) [pdf, other]

Title: TS-SEP: Joint Diarization and Separation Conditioned on Estimated Speaker Embeddings

Christoph Boeddeker, Aswin Shanmugam Subramanian, Gordon Wichern, Reinhold Haeb-Umbach, Jonathan Le Roux

Comments: Submitted to IEEE/ACM TASLP

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[126] arXiv:2303.03869 (cross-list from eess.AS) [pdf, other]

Title: Kernel interpolation of acoustic transfer functions with adaptive kernel for directed and residual reverberations

Juliano G. C. Ribeiro, Shoichi Koyama, Hiroshi Saruwatari

Comments: To appear in ICASSP 2023

Journal-ref: 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[127] arXiv:2303.03926 (cross-list from cs.CL) [pdf, other]

Title: Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling

Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

Comments: We encourage readers to listen to the audio samples on our demo page: \url{this https URL}

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[128] arXiv:2303.04068 (cross-list from cs.DB) [pdf, other]

Title: VOCALExplore: Pay-as-You-Go Video Data Exploration and Model Building [Technical Report]

Maureen Daum, Enhao Zhang, Dong He, Stephen Mussmann, Brandon Haynes, Ranjay Krishna, Magdalena Balazinska

Subjects: Databases (cs.DB); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[129] arXiv:2303.04289 (cross-list from cs.CL) [pdf, other]

Title: Do Prosody Transfer Models Transfer Prosody?

Atli Thor Sigurgeirsson, Simon King

Comments: Accepted in ICASSP 2023, 5 pages, 2 figures, 3 tables

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[130] arXiv:2303.04439 (cross-list from cs.CV) [pdf, other]

Title: A Light Weight Model for Active Speaker Detection

Junhua Liao, Haihan Duan, Kanghui Feng, Wanbing Zhao, Yanbing Yang, Liangyin Chen

Comments: Accepted by CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[131] arXiv:2303.05007 (cross-list from cs.CR) [pdf, other]

Title: Towards Robust Image-in-Audio Deep Steganography

Jaume Ros, Margarita Geleta, Jordi Pons, Xavier Giro-i-Nieto

Comments: 8 pages, 5 figures, 2 tables

Subjects: Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[132] arXiv:2303.05023 (cross-list from eess.AS) [pdf, other]

Title: X-SepFormer: End-to-end Speaker Extraction Network with Explicit Optimization on Speaker Confusion

Kai Liu, Ziqing Du, Xucheng Wan, Huan Zhou

Comments: Accepted by ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD)

[133] arXiv:2303.05321 (cross-list from cs.CV) [pdf, other]

Title: WASD: A Wilder Active Speaker Detection Dataset

Tiago Roxo, Joana C. Costa, Pedro R. M. Inácio, Hugo Proença

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[134] arXiv:2303.05737 (cross-list from eess.AS) [pdf, other]

Title: Clinical BERTScore: An Improved Measure of Automatic Speech Recognition Performance in Clinical Settings

Joel Shor, Ruyue Agnes Bi, Subhashini Venugopalan, Steven Ibara, Roman Goldenberg, Ehud Rivlin

Journal-ref: Clinical NLP Workshop, ACL 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[135] arXiv:2303.05896 (cross-list from eess.AS) [pdf, other]

Title: Distribution Preserving Source Separation With Time Frequency Predictive Models

Pedro J. Villasana T., Janusz Klejsa, Lars Villemoes, Per Hedelin

Comments: 5 pages, 4 figures, pre-review version submitted to EUSIPCO 2023

Journal-ref: 2023 31st European Signal Processing Conference (EUSIPCO)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[136] arXiv:2303.05958 (cross-list from cs.CL) [pdf, other]

Title: Robust Knowledge Distillation from RNN-T Models With Noisy Training Labels Using Full-Sum Loss

Mohammad Zeineldeen, Kartik Audhkhasi, Murali Karthick Baskar, Bhuvana Ramabhadran

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[137] arXiv:2303.06026 (cross-list from eess.AS) [pdf, other]

Title: wav2vec and its current potential to Automatic Speech Recognition in German for the usage in Digital History: A comparative assessment of available ASR-technologies for the use in cultural heritage contexts

Michael Fleck, Wolfgang Göderle

Comments: 11 pages, 2 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[138] arXiv:2303.06585 (cross-list from cs.CL) [pdf, other]

Title: Improving the Intent Classification accuracy in Noisy Environment

Mohamed Nabih Ali, Alessio Brutti, Daniele Falavigna

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[139] arXiv:2303.06806 (cross-list from eess.AS) [pdf, other]

Title: Neural Diarization with Non-autoregressive Intermediate Attractors

Yusuke Fujita, Tatsuya Komatsu, Robin Scheibler, Yusuke Kida, Tetsuji Ogawa

Comments: ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[140] arXiv:2303.07067 (cross-list from cs.LG) [pdf, other]

Title: Cross-device Federated Learning for Mobile Health Diagnostics: A First Study on COVID-19 Detection

Tong Xia, Jing Han, Abhirup Ghosh, Cecilia Mascolo

Comments: This paper has been accepted by IEEE ICASSP 2023

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[141] arXiv:2303.07143 (cross-list from eess.AS) [pdf, other]

Title: Multi-Microphone Speaker Separation by Spatial Regions

Julian Wechsler, Srikanth Raj Chetupalli, Wolfgang Mack, Emanuël A. P. Habets

Comments: Submitted to the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[142] arXiv:2303.07442 (cross-list from eess.AS) [pdf, other]

Title: A processing framework to access large quantities of whispered speech found in ASMR

Pablo Perez Zarazaga, Gustav Eje Henter, Zofia Malisz

Comments: Accepted at ICASSP 2023, 5 pages, 2 figures, 2 tables

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[143] arXiv:2303.07449 (cross-list from eess.AS) [pdf, other]

Title: Blind Acoustic Room Parameter Estimation Using Phase Features

Christopher Ick, Adib Mehrabi, Wenyu Jin

Comments: 4 pages + 1 page bibliography, 3 figures, to be published in proceedings of ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[144] arXiv:2303.07458 (cross-list from eess.AS) [pdf, other]

Title: Online Binaural Speech Separation of Moving Speakers With a Wavesplit Network

Cong Han, Nima Mesgarani

Comments: To appear in ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[145] arXiv:2303.07486 (cross-list from eess.AS) [pdf, other]

Title: Guided Speech Enhancement Network

Yang Yang, Shao-Fu Shih, Hakan Erdogan, Jamie Menjay Lin, Chehung Lee, Yunpeng Li, George Sung, Matthias Grundmann

Comments: Accepted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[146] arXiv:2303.07533 (cross-list from eess.AS) [pdf, other]

Title: Speech Intelligibility Classifiers from 550k Disordered Speech Samples

Subhashini Venugopalan, Jimmy Tobin, Samuel J. Yang, Katie Seaver, Richard J.N. Cave, Pan-Pan Jiang, Neil Zeghidour, Rus Heywood, Jordan Green, Michael P. Brenner

Comments: ICASSP 2023 camera-ready

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[147] arXiv:2303.07538 (cross-list from cs.LG) [pdf, other]

Title: HiSSNet: Sound Event Detection and Speaker Identification via Hierarchical Prototypical Networks for Low-Resource Headphones

N Shashaank, Berker Banar, Mohammad Rasool Izadi, Jeremy Kemmerer, Shuo Zhang, Chuan-Che Huang

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[148] arXiv:2303.07569 (cross-list from eess.AS) [pdf, other]

Title: Towards Real-Time Single-Channel Speech Separation in Noisy and Reverberant Environments

Julian Neri, Sebastian Braun

Comments: to appear in ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[149] arXiv:2303.07592 (cross-list from eess.AS) [pdf, other]

Title: Lightweight feature encoder for wake-up word detection based on self-supervised speech representation

Hyungjun Lim, Younggwan Kim, Kiho Yeom, Eunjoo Seo, Hoodong Lee, Stanley Jungkyu Choi, Honglak Lee

Comments: Accepted by ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[150] arXiv:2303.07621 (cross-list from eess.AS) [pdf, other]

Title: Two-stage Neural Network for ICASSP 2023 Speech Signal Improvement Challenge

Mingshuai Liu, Shubo Lv, Zihan Zhang, Runduo Han, Xiang Hao, Xianjun Xia, Li Chen, Yijian Xiao, Lei Xie

Comments: Accepted by ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)