Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Audio and Speech Processing

Authors and titles for October 2022

Total of 381 entries
Showing up to 2000 entries per page: fewer | more | all
[51] arXiv:2210.12701 [pdf, other]
Title: Speaker Identification from emotional and noisy speech data using learned voice segregation and Speech VGG
Shibani Hamsa, Ismail Shahin, Youssef Iraqi, Ernesto Damiani, Naoufel Werghi
Comments: Journal
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[52] arXiv:2210.12740 [pdf, other]
Title: HiFi-WaveGAN: Generative Adversarial Network with Auxiliary Spectrogram-Phase Loss for High-Fidelity Singing Voice Generation
Chunhui Wang, Chang Zeng, Jun Chen, Xing He
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[53] arXiv:2210.12995 [pdf, other]
Title: TridentSE: Guiding Speech Enhancement with 32 Global Tokens
Dacheng Yin, Zhiyuan Zhao, Chuanxin Tang, Zhiwei Xiong, Chong Luo
Comments: 5 pages, 2 figures, 3 tables
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[54] arXiv:2210.13127 [pdf, other]
Title: A Novel Frame Structure for Cloud-Based Audio-Visual Speech Enhancement in Multimodal Hearing-aids
Abhijeet Bishnu, Ankit Gupta, Mandar Gogate, Kia Dashtipour, Ahsan Adeel, Amir Hussain, Mathini Sellathurai, Tharmalingam Ratnarajah
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[55] arXiv:2210.13144 [pdf, other]
Title: Weak-Supervised Dysarthria-invariant Features for Spoken Language Understanding using an FHVAE and Adversarial Training
Jinzi Qi, Hugo Van hamme
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[56] arXiv:2210.13189 [pdf, other]
Title: Can Visual Context Improve Automatic Speech Recognition for an Embodied Agent?
Pradip Pramanick, Chayan Sarkar
Comments: Accepted in EMNLP '22
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
[57] arXiv:2210.13248 [pdf, other]
Title: Brouhaha: multi-task training for voice activity detection, speech-to-noise ratio, and C50 room acoustics estimation
Marvin Lavechin, Marianne Métais, Hadrien Titeux, Alodie Boissonnet, Jade Copet, Morgane Rivière, Elika Bergelson, Alejandrina Cristia, Emmanuel Dupoux, Hervé Bredin
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[58] arXiv:2210.13273 [pdf, other]
Title: An Acoustical Machine Learning Approach to Determine Abrasive Belt Wear of Wide Belt Sanders
Maximilian Bundscherer, Thomas H. Schmitt, Sebastian Bayerl, Thomas Auerbach, Tobias Bocklet
Comments: Conference IEEE SENSORS 2022
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[59] arXiv:2210.13318 [pdf, other]
Title: Time-Domain Speech Enhancement for Robust Automatic Speech Recognition
Yufeng Yang, Ashutosh Pandey, DeLiang Wang
Comments: Accepted by Interspeech 2023, 5 pages, 2 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[60] arXiv:2210.13438 [pdf, other]
Title: High Fidelity Neural Audio Compression
Alexandre Défossez, Jade Copet, Gabriel Synnaeve, Yossi Adi
Comments: Preprint
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Machine Learning (stat.ML)
[61] arXiv:2210.13690 [pdf, other]
Title: Highly Efficient Real-Time Streaming and Fully On-Device Speaker Diarization with Multi-Stage Clustering
Quan Wang, Yiling Huang, Han Lu, Guanlong Zhao, Ignacio Lopez Moreno
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[62] arXiv:2210.13700 [pdf, other]
Title: Does Joint Training Really Help Cascaded Speech Translation?
Viet Anh Khoa Tran, David Thulke, Yingbo Gao, Christian Herold, Hermann Ney
Comments: Accepted to EMNLP 2022
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)
[63] arXiv:2210.13756 [pdf, other]
Title: Mixed-EVC: Mixed Emotion Synthesis and Control in Voice Conversion
Kun Zhou, Berrak Sisman, Carlos Busso, Bin Ma, Haizhou Li
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[64] arXiv:2210.13761 [pdf, other]
Title: Streaming Parrotron for on-device speech-to-speech conversion
Oleg Rybakov, Fadi Biadsy, Xia Zhang, Liyang Jiang, Phoenix Meadowlark, Shivani Agrawal
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[65] arXiv:2210.13771 [pdf, other]
Title: Disentangled Speech Representation Learning for One-Shot Cross-lingual Voice Conversion Using $\beta$-VAE
Hui Lu, Disong Wang, Xixin Wu, Zhiyong Wu, Xunying Liu, Helen Meng
Comments: Accepted at SLT 2022
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[66] arXiv:2210.14041 [pdf, other]
Title: Enhanced Fuzzy Decomposition of Sound Into Sines, Transients, and Noise
Leonardo Fierro, Vesa Välimäki
Comments: Submitted for publication to the Journal of Audio Engineering Society on October 20th, 2022
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[67] arXiv:2210.14090 [pdf, other]
Title: EBEN: Extreme bandwidth extension network applied to speech signals captured with noise-resilient body-conduction microphones
Julien Hauret, Thomas Joubaud, Véronique Zimpfer, Éric Bavu
Comments: 5 pages, 5 figures, accepted to ICASSP 2023
Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[68] arXiv:2210.14321 [pdf, other]
Title: Artificial ASMR: A Cyber-Psychological Approach
Zexin Fang, Bin Han, C. Clark Cao, Hans. D. Schotten
Comments: Accepted by IEEE MLSP 2023
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Signal Processing (eess.SP)
[69] arXiv:2210.14406 [pdf, other]
Title: RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech
Kyumin Park, Keon Lee, Daeyoung Kim, Dongyeop Kang
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)
[70] arXiv:2210.14501 [pdf, other]
Title: Effect of different splitting criteria on the performance of speech emotion recognition
Bagus Tris Atmaja, Akira Sasou
Comments: Accepted at TENCON 2021
Journal-ref: TENCON 2021, pp 760-764
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[71] arXiv:2210.14515 [pdf, other]
Title: UFO2: A unified pre-training framework for online and offline speech recognition
Li Fu, Siqi Li, Qingtao Li, Liping Deng, Fangzhu Li, Lu Fan, Meng Chen, Xiaodong He
Comments: Accepted by ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[72] arXiv:2210.14536 [pdf, other]
Title: Position tracking of a varying number of sound sources with sliding permutation invariant training
David Diaz-Guerra, Archontis Politis, Tuomas Virtanen
Comments: Accepted for publication at the 31st European Signal Processing Conference (EUSIPCO 2023)
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[73] arXiv:2210.14564 [pdf, other]
Title: AdaMS: Deep Metric Learning with Adaptive Margin and Adaptive Scale for Acoustic Word Discrimination
Myunghun Jung, Hoirin Kim
Comments: INTERSPEECH 2023
Subjects: Audio and Speech Processing (eess.AS); Information Retrieval (cs.IR); Machine Learning (cs.LG); Sound (cs.SD)
[74] arXiv:2210.14567 [pdf, other]
Title: Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarization
Hexin Liu, Haihua Xu, Leibny Paola Garcia, Andy W. H. Khong, Yi He, Sanjeev Khudanpur
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[75] arXiv:2210.14581 [pdf, other]
Title: Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function
Qing Wang, Hang Chen, Ya Jiang, Zhe Wang, Yuyang Wang, Jun Du, Chin-Hui Lee
Comments: 5 pages, 3 figures, accepted by ISCSLP 2022
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Image and Video Processing (eess.IV)
[76] arXiv:2210.14648 [pdf, other]
Title: Masked Modeling Duo: Learning Representations by Encouraging Both Networks to Model the Input
Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi, Noboru Harada, Kunio Kashino
Comments: 6 pages, 3 figures, and 6 tables. To appear at ICASSP2023
Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)
[77] arXiv:2210.14666 [pdf, other]
Title: Xiaoicesing 2: A High-Fidelity Singing Voice Synthesizer Based on Generative Adversarial Network
Chunhui Wang, Chang Zeng, Xing He
Comments: submitted to icassp2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[78] arXiv:2210.14711 [pdf, other]
Title: Weighted Pressure Matching Based on Kernel Interpolation For Sound Field Reproduction
Shoichi Koyama, Kazuyuki Arikawa
Comments: Presented at 24th International Congress on Acoustics (ICA) 2022
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[79] arXiv:2210.14755 [pdf, other]
Title: Multitask Detection of Speaker Changes, Overlapping Speech and Voice Activity Using wav2vec 2.0
Marie Kunešová, Zbyněk Zajíc
Comments: To appear at ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[80] arXiv:2210.14800 [pdf, other]
Title: Naturalistic Head Motion Generation from Speech
Trisha Mittal, Zakaria Aldeneh, Masha Fedzechkina, Anurag Ranjan, Barry-John Theobald
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Sound (cs.SD)
[81] arXiv:2210.14995 [pdf, other]
Title: Privacy-preserving Automatic Speaker Diarization
Francisco Teixeira, Alberto Abad, Bhiksha Raj, Isabel Trancoso
Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Sound (cs.SD)
[82] arXiv:2210.15001 [pdf, other]
Title: Acoustically-Driven Phoneme Removal That Preserves Vocal Affect Cues
Camille Noufi, Jonathan Berger, Karen J. Parker, Daniel L. Bowling
Comments: To be seen in proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (DOI coming soon)
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[83] arXiv:2210.15158 [pdf, other]
Title: Streaming Voice Conversion Via Intermediate Bottleneck Features And Non-streaming Teacher Guidance
Yuanzhe Chen, Ming Tu, Tang Li, Xin Li, Qiuqiang Kong, Jiaxin Li, Zhichao Wang, Qiao Tian, Yuping Wang, Yuxuan Wang
Comments: The paper has been submitted to ICASSP2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[84] arXiv:2210.15195 [pdf, other]
Title: Masked Autoencoders Are Articulatory Learners
Ahmed Adel Attia, Carol Espy-Wilson
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[85] arXiv:2210.15196 [pdf, other]
Title: HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields
You Zhang, Yuxiang Wang, Zhiyao Duan
Comments: 5 pages, accepted by ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Graphics (cs.GR); Sound (cs.SD)
[86] arXiv:2210.15228 [pdf, other]
Title: Solving Audio Inverse Problems with a Diffusion Model
Eloi Moliner, Jaakko Lehtinen, Vesa Välimäki
Comments: Accetpted at ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[87] arXiv:2210.15272 [pdf, other]
Title: A Fast and Accurate Pitch Estimation Algorithm Based on the Pseudo Wigner-Ville Distribution
Yisi Liu, Peter Wu, Alan W Black, Gopala K. Anumanchipalli
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[88] arXiv:2210.15282 [pdf, other]
Title: Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition
Steven Vander Eeckt, Hugo Van hamme
Comments: Accepted at ICASSP 2023. 5 pages
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[89] arXiv:2210.15310 [pdf, other]
Title: Learning Music Representations with wav2vec 2.0
Alessandro Ragano, Emmanouil Benetos, Andrew Hines
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[90] arXiv:2210.15324 [pdf, other]
Title: Robust Data2vec: Noise-robust Speech Representation Learning for ASR by Combining Regression and Improved Contrastive Learning
Qiu-Shi Zhu, Long Zhou, Jie Zhang, Shu-Jie Liu, Yu-Chen Hu, Li-Rong Dai
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[91] arXiv:2210.15336 [pdf, other]
Title: Multi-class Detection of Pathological Speech with Latent Features: How does it perform on unseen data?
Dominik Wagner, Ilja Baumann, Franziska Braun, Sebastian P. Bayerl, Elmar Nöth, Korbinian Riedhammer, Tobias Bocklet
Comments: INTERSPEECH 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[92] arXiv:2210.15366 [pdf, other]
Title: Multi-dimensional Edge-based Audio Event Relational Graph Representation Learning for Acoustic Scene Classification
Yuanbo Hou, Siyang Song, Chuang Yu, Yuxin Song, Wenwu Wang, Dick Botteldooren
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[93] arXiv:2210.15385 [pdf, other]
Title: Self-Supervised Training of Speaker Encoder with Multi-Modal Diverse Positive Pairs
Ruijie Tao, Kong Aik Lee, Rohan Kumar Das, Ville Hautamäki, Haizhou Li
Comments: 13 pages
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[94] arXiv:2210.15425 [pdf, other]
Title: HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words
Arnav Kundu, Mohammad Samragh Razlighi, Minsik Cho, Priyanka Padmanabhan, Devang Naik
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[95] arXiv:2210.15428 [pdf, other]
Title: Time-Domain Based Embeddings for Spoofed Audio Representation
Matan Karo, Arie Yeredor, Itshak Lapidot
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[96] arXiv:2210.15445 [pdf, other]
Title: Efficient Utilization of Large Pre-Trained Models for Low Resource ASR
Peter Vieting, Christoph Lüscher, Julian Dierkes, Ralf Schlüter, Hermann Ney
Comments: Accepted at ICASSP SASB 2023
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[97] arXiv:2210.15512 [pdf, other]
Title: Exploiting spatial information with the informed complex-valued spatial autoencoder for target speaker extraction
Annika Briegleb, Mhd Modar Halimeh, Walter Kellermann
Comments: Accepted to 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece. 5 pages, 2 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[98] arXiv:2210.15631 [pdf, other]
Title: Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang
Comments: Accepted by ASRU 2023
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[99] arXiv:2210.15715 [pdf, other]
Title: Simulating realistic speech overlaps improves multi-talker ASR
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Comments: v2: fix minor typo
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[100] arXiv:2210.15754 [pdf, other]
Title: Proceedings of the ACII Affective Vocal Bursts Workshop and Competition 2022 (A-VB): Understanding a critically understudied modality of emotional expression
Alice Baird, Panagiotis Tzirakis, Jeffrey A. Brooks, Christopher B. Gregory, Björn Schuller, Anton Batliner, Dacher Keltner, Alan Cowen
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[101] arXiv:2210.15781 [pdf, other]
Title: A Compact End-to-End Model with Local and Global Context for Spoken Language Identification
Fei Jia, Nithin Rao Koluguri, Jagadeesh Balam, Boris Ginsburg
Comments: Accepted to INTERSPEECH 2023
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[102] arXiv:2210.15793 [pdf, html, other]
Title: Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution
Chin-Yun Yu, Sung-Lin Yeh, György Fazekas, Hao Tang
Comments: Published at ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[103] arXiv:2210.15822 [pdf, other]
Title: UX-NET: Filter-and-Process-based Improved U-Net for Real-time Time-domain Audio Separation
Kashyap Patel, Anton Kovalyov, Issa Panahi
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[104] arXiv:2210.15876 [pdf, other]
Title: Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition
Yist Y. Lin, Tao Han, Haihua Xu, Van Tung Pham, Yerbolat Khassanov, Tze Yuang Chong, Yi He, Lu Lu, Zejun Ma
Comments: 5 pages, 3 figures, 4 tables
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[105] arXiv:2210.15887 [pdf, other]
Title: Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs
Reo Yoneyama, Ryuichi Yamamoto, Kentaro Tachibana
Comments: Acceptted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[106] arXiv:2210.15903 [pdf, other]
Title: Speaker recognition with two-step multi-modal deep cleansing
Ruijie Tao, Kong Aik Lee, Zhan Shi, Haizhou Li
Comments: 5 pages, 3 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[107] arXiv:2210.15941 [pdf, other]
Title: Influence of Utterance and Speaker Characteristics on the Classification of Children with Cleft Lip and Palate
Ilja Baumann, Dominik Wagner, Franziska Braun, Sebastian P. Bayerl, Elmar Nöth, Korbinian Riedhammer, Tobias Bocklet
Comments: INTERSPEECH 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[108] arXiv:2210.15964 [pdf, other]
Title: Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesis
Yuma Shirahata, Ryuichi Yamamoto, Eunwoo Song, Ryo Terashima, Jae-Min Kim, Kentaro Tachibana
Comments: ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[109] arXiv:2210.15975 [pdf, other]
Title: Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform
Masaya Kawamura, Yuma Shirahata, Ryuichi Yamamoto, Kentaro Tachibana
Comments: Accepted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[110] arXiv:2210.15978 [pdf, other]
Title: End-to-end Ensemble-based Feature Selection for Paralinguistics Tasks
Tamás Grósz, Mittul Singh, Sudarsana Reddy Kadiri, Hemant Kathania, Mikko Kurimo
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[111] arXiv:2210.15982 [pdf, other]
Title: Dysfluencies Seldom Come Alone -- Detection as a Multi-Label Problem
Sebastian P. Bayerl, Dominik Wagner, Florian Hönig, Tobias Bocklet, Elmar Nöth, Korbinian Riedhammer
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[112] arXiv:2210.15987 [pdf, other]
Title: NNSVS: A Neural Network-Based Singing Voice Synthesis Toolkit
Ryuichi Yamamoto, Reo Yoneyama, Tomoki Toda
Comments: Accepted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[113] arXiv:2210.16022 [pdf, other]
Title: SG-VAD: Stochastic Gates Based Speech Activity Detection
Jonathan Svirsky, Ofir Lindenbaum
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[114] arXiv:2210.16028 [pdf, other]
Title: Laugh Betrays You? Learning Robust Speaker Representation From Speech Containing Non-Verbal Fragments
Yuke Lin, Xiaoyi Qin, Huahua Cui, Zhenyi Zhu, Ming Li
Comments: see 2308.07056 which is a newer version of this work
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[115] arXiv:2210.16032 [pdf, other]
Title: Parameter-efficient transfer learning of pre-trained Transformer models for speaker verification using adapters
Junyi Peng, Themos Stafylakis, Rongzhi Gu, Oldřich Plchot, Ladislav Mošner, Lukáš Burget, Jan Černocký
Comments: submitted to ICASSP2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[116] arXiv:2210.16127 [pdf, other]
Title: Target-Speaker Voice Activity Detection via Sequence-to-Sequence Prediction
Ming Cheng, Weiqing Wang, Yucong Zhang, Xiaoyi Qin, Ming Li
Comments: Accepted by ICASSP2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[117] arXiv:2210.16238 [pdf, other]
Title: Contextual-Utterance Training for Automatic Speech Recognition
Alejandro Gomez-Alanis, Lukas Drude, Andreas Schwarz, Rupak Vignesh Swaminathan, Simon Wiesler
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)
[118] arXiv:2210.16428 [pdf, other]
Title: Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention
Xubo Liu, Qiushi Huang, Xinhao Mei, Haohe Liu, Qiuqiang Kong, Jianyuan Sun, Shengchen Li, Tom Ko, Yu Zhang, Lilian H. Tang, Mark D. Plumbley, Volkan Kılıç, Wenwu Wang
Comments: INTERSPEECH 2023
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)
[119] arXiv:2210.16450 [pdf, other]
Title: The Secret Source : Incorporating Source Features to Improve Acoustic-to-Articulatory Speech Inversion
Yashish M. Siriwardena, Carol Espy-Wilson
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[120] arXiv:2210.16454 [pdf, other]
Title: Learning to Compute the Articulatory Representations of Speech with the MIRRORNET
Yashish M. Siriwardena, Carol Espy-Wilson, Shihab Shamma
Comments: Interspeech 2023
Journal-ref: Interspeech 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[121] arXiv:2210.16481 [pdf, other]
Title: Accelerating RNN-T Training and Inference Using CTC guidance
Yongqiang Wang, Zhehuai Chen, Chengjian Zheng, Yu Zhang, Wei Han, Parisa Haghani
Comments: submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[122] arXiv:2210.16498 [pdf, other]
Title: Articulatory Representation Learning Via Joint Factor Analysis and Neural Matrix Factorization
Jiachen Lian, Alan W Black, Yijing Lu, Louis Goldstein, Shinji Watanabe, Gopala K. Anumanchipalli
Comments: Accepted to 2023 ICASSP. Camera Ready
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[123] arXiv:2210.16611 [pdf, other]
Title: Application of Knowledge Distillation to Multi-task Speech Representation Learning
Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser
Comments: Speech representation learning, multi-task training, wav2vec, HuBERT, knowledge distillation
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
[124] arXiv:2210.16622 [pdf, other]
Title: Discriminative Speaker Representation via Contrastive Learning with Class-Aware Attention in Angular Space
Zhe Li, Man-Wai Mak, Helen Mei-Ling Meng
Comments: Accepted by ICASSP 2023, 5 pages, 2 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[125] arXiv:2210.16636 [pdf, other]
Title: Speaker Representation Learning via Contrastive Loss with Maximal Speaker Separability
Zhe Li, Man-Wai Mak
Comments: Accept by APSIPA ASC 2022, 6 pages, 2 figures
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[126] arXiv:2210.16663 [pdf, other]
Title: BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model
Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
Comments: v1: Accepted to Findings of EMNLP2022, v2: Minor corrections and clearer derivation of Eq. (21)
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)
[127] arXiv:2210.16726 [pdf, other]
Title: Improvements to Embedding-Matching Acoustic-to-Word ASR Using Multiple-Hypothesis Pronunciation-Based Embeddings
Hao Yen, Woojay Jeon
Comments: Accepted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[128] arXiv:2210.16739 [pdf, other]
Title: DuDe: Dual-Decoder Multilingual ASR for Indian Languages using Common Label Set
Arunkumar A, Mudit Batra, Umesh S
Comments: Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[129] arXiv:2210.16743 [pdf, other]
Title: WeKws: A production first small-footprint end-to-end Keyword Spotting Toolkit
Jie Wang, Menglong Xu, Jingyong Hou, Binbin Zhang, Xiao-Lei Zhang, Lei Xie, Fuping Pan
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[130] arXiv:2210.16871 [pdf, other]
Title: Improved acoustic-to-articulatory inversion using representations from pretrained self-supervised learning models
Sathvik Udupa, Siddarth C, Prasanta Kumar Ghosh
Comments: submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[131] arXiv:2210.16881 [pdf, other]
Title: Real-Time MRI Video synthesis from time aligned phonemes with sequence-to-sequence networks
Sathvik Udupa, Prasanta Kumar Ghosh
Comments: submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[132] arXiv:2210.17153 [pdf, html, other]
Title: Towards Developing State-of-the-Art TTS Synthesisers for 13 Indian Languages with Signal Processing aided Alignments
Anusha Prakash, S Umesh, Hema A Murthy
Comments: Version 1 uploaded
Journal-ref: IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Taipei, Taiwan, 2023, pp. 1-8
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[133] arXiv:2210.17154 [pdf, other]
Title: Minimum Processing Near-end Listening Enhancement
Andreas Jonas Fuglsig, Jesper Jensen, Zheng-Hua Tan, Lars Søndergaard Bertelsen, Jens Christian Lindof, Jan Østergaard
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)
[134] arXiv:2210.17189 [pdf, other]
Title: DiaCorrect: End-to-end error correction for speaker diarization
Jiangyu Han, Yuhang Cao, Heng Lu, Yanhua Long
Comments: This paper has been superseded by arXiv:2309.08377 (merged from arXiv:2210.17189)
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[135] arXiv:2210.17287 [pdf, other]
Title: Diffiner: A Versatile Diffusion-based Generative Refiner for Speech Enhancement
Ryosuke Sawata, Naoki Murata, Yuhta Takida, Toshimitsu Uesaka, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji
Comments: Accepted by Interspeech 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[136] arXiv:2210.17310 [pdf, other]
Title: Convolution-Based Channel-Frequency Attention for Text-Independent Speaker Verification
Jingyu Li, Yusheng Tian, Tan Lee
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[137] arXiv:2210.17316 [pdf, other]
Title: There is more than one kind of robustness: Fooling Whisper with adversarial examples
Raphael Olivier, Bhiksha Raj
Comments: Accepted at InterSpeech 2023
Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
[138] arXiv:2210.17326 [pdf, other]
Title: Model Compression for DNN-based Speaker Verification Using Weight Quantization
Jingyu Li, Wei Liu, Zhaoyang Zhang, Jiong Wang, Tan Lee
Comments: Accepted by INTERSPEECH2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[139] arXiv:2210.17327 [pdf, other]
Title: Diffusion-based Generative Speech Source Separation
Robin Scheibler, Youna Ji, Soo-Whan Chung, Jaeuk Byun, Soyeon Choe, Min-Seok Choi
Comments: 5 pages, 3 figures, 2 tables. Submitted to ICASSP 2023
Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)
[140] arXiv:2210.17338 [pdf, other]
Title: VoicePrivacy 2022 System Description: Speaker Anonymization with Feature-matched F0 Trajectories
Ünal Ege Gaznepoglu, Anna Leschanowsky, Nils Peters
Comments: 4 pages, 4 figures, 2 tables, submitted to VoicePrivacy Challenge 2022
Subjects: Audio and Speech Processing (eess.AS); Cryptography and Security (cs.CR); Sound (cs.SD)
[141] arXiv:2210.17456 [pdf, other]
Title: Audio-Visual Speech Enhancement and Separation by Utilizing Multi-Modal Self-Supervised Embeddings
I-Chun Chern, Kuo-Hsuan Hung, Yi-Ting Chen, Tassadaq Hussain, Mandar Gogate, Amir Hussain, Yu Tsao, Jen-Cheng Hou
Comments: ICASSP AMHAT 2023
Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)
[142] arXiv:2210.00169 (cross-list from cs.SD) [pdf, other]
Title: Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition
Jash Rathod, Nauman Dawalatabad, Shatrughan Singh, Dhananjaya Gowda
Comments: Published in INTERSPEECH 2022
Journal-ref: Proc. Interspeech 2022, 1691-1695
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[143] arXiv:2210.00705 (cross-list from cs.CL) [pdf, other]
Title: SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model
Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath
Comments: Accepted to IEEE SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[144] arXiv:2210.00721 (cross-list from cs.SD) [pdf, other]
Title: Efficient acoustic feature transformation in mismatched environments using a Guided-GAN
Walter Heymans, Marelie H. Davel, Charl van Heerden
Comments: Final published version available at: Efficient acoustic feature transformation in mismatched environments using a Guided-GAN. Speech Communication, 143, pp.10-20
Journal-ref: Speech Communication, 143, pp.10-20 (2022)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[145] arXiv:2210.00753 (cross-list from cs.SD) [pdf, other]
Title: Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection
Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang
Comments: Accepted by SLT 2022
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[146] arXiv:2210.01116 (cross-list from cs.RO) [pdf, other]
Title: That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation
Abitha Thankaraj, Lerrel Pinto
Comments: Videos and audio data are best seen on our project website: this http URL
Subjects: Robotics (cs.RO); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[147] arXiv:2210.01205 (cross-list from cs.LG) [pdf, other]
Title: Diagnosis of Parkinson's Disease Based on Voice Signals Using SHAP and Hard Voting Ensemble Method
Paria Ghaheri, Hamid Nasiri, Ahmadreza Shateri, Arman Homafar
Subjects: Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[148] arXiv:2210.01256 (cross-list from cs.SD) [pdf, other]
Title: And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?
Mathilde Abrassart, Guillaume Doras
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[149] arXiv:2210.01353 (cross-list from cs.SD) [pdf, other]
Title: Pay Self-Attention to Audio-Visual Navigation
Yinfeng Yu, Lele Cao, Fuchun Sun, Xiaohong Liu, Liejun Wang
Comments: Main paper (10 pages and 7 figures) and appendix (21 figures and 4 tables). Accepted for publication by BMVC 2022. For data and code, see this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[150] arXiv:2210.01448 (cross-list from cs.SD) [pdf, other]
Title: Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings
Tenglong Ao, Qingzhe Gao, Yuke Lou, Baoquan Chen, Libin Liu
Comments: SIGGRAPH Asia 2022 (Journal Track); Project Page: this https URL
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Audio and Speech Processing (eess.AS)
[151] arXiv:2210.01512 (cross-list from cs.CL) [pdf, other]
Title: Code-Switching without Switching: Language Agnostic End-to-End Speech Translation
Christian Huber, Enes Yavuz Ugan, Alexander Waibel
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[152] arXiv:2210.01703 (cross-list from cs.SD) [pdf, other]
Title: Improving Label-Deficient Keyword Spotting Through Self-Supervised Pretraining
Holger Severin Bovbjerg, Zheng-Hua Tan
Comments: To be published at ICASSP2023 Workshop on Self-supervision in Audio, Speech and Beyond, 10th of June 2023, Rhodes, Greece. Copyright (c) 2023 IEEE. 5 pages, 3 figures, 3 tables
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[153] arXiv:2210.01719 (cross-list from cs.SD) [pdf, html, other]
Title: Learning Temporal Resolution in Spectrogram for Audio Classification
Haohe Liu, Xubo Liu, Qiuqiang Kong, Wenwu Wang, Mark D. Plumbley
Comments: Accepted by the 38th Annual AAAI Conference on Artificial Intelligence
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[154] arXiv:2210.02287 (cross-list from cs.SD) [pdf, other]
Title: TC-SKNet with GridMask for Low-complexity Classification of Acoustic scene
Luyuan Xie, Yan Zhong, Lin Yang, Zhaoyu Yan, Zhonghai Wu, Junjie Wang
Comments: Accepted to APSIPA ASC 2022
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[155] arXiv:2210.02437 (cross-list from cs.SD) [pdf, other]
Title: ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild
Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, Kong Aik Lee
Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing
Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[156] arXiv:2210.02527 (cross-list from cs.LG) [pdf, other]
Title: Toward Knowledge-Driven Speech-Based Models of Depression: Leveraging Spectrotemporal Variations in Speech Vowels
Kexin Feng, Theodora Chaspari
Comments: oral presentation for BHI 2022
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[157] arXiv:2210.02545 (cross-list from cs.CL) [pdf, other]
Title: JoeyS2T: Minimalistic Speech-to-Text Modeling with JoeyNMT
Mayumi Ohta, Julia Kreutzer, Stefan Riezler
Comments: EMNLP 2022 demo track
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[158] arXiv:2210.02642 (cross-list from cs.SD) [pdf, other]
Title: Feasibility on Detecting Door Slamming towards Monitoring Early Signs of Domestic Violence
Osian Morgan, Hakan Kayan, Charith Perera
Comments: In Proceedings of the 2022 IEEE/ACM Seventh International Conference on Internet-of-Things Design and Implementation (IoTDI) 2022
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[159] arXiv:2210.02731 (cross-list from cs.SD) [pdf, other]
Title: PSVRF: Learning to restore Pitch-Shifted Voice without reference
Yangfu Li, Xiaodan Lin, Jiaxin Yang
Comments: Have some errors
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[160] arXiv:2210.02746 (cross-list from cs.SD) [pdf, other]
Title: The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio Detection
Daniele Mari, Federica Latora, Simone Milani
Comments: Accepted at WIFS 2022
Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[161] arXiv:2210.02829 (cross-list from cs.SD) [pdf, other]
Title: Melody Infilling with User-Provided Structural Context
Chih-Pin Tan, Alvin W.Y. Su, Yi-Hsuan Yang
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[162] arXiv:2210.02833 (cross-list from cs.IR) [pdf, other]
Title: Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval
Benno Weck, Miguel Pérez Fernández, Holger Kirchhoff, Xavier Serra
Comments: 5 pages, 2 figures. Accepted at Detection and Classification of Acoustic Scenes and Events 2022 (DCASE2022)
Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[163] arXiv:2210.02904 (cross-list from cs.SD) [pdf, other]
Title: WakeUpNet: A Mobile-Transformer based Framework for End-to-End Streaming Voice Trigger
Zixing Zhang, Thorin Farnsworth, Senling Lin, Salah Karout
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[164] arXiv:2210.03027 (cross-list from cs.SD) [pdf, other]
Title: AnimeTAB: A new guitar tablature dataset of anime and game music
Yuecheng Zhou, Yaolong Ju, Lingyun Xie
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[165] arXiv:2210.03255 (cross-list from cs.SD) [pdf, other]
Title: Damage Control During Domain Adaptation for Transducer Based Automatic Speech Recognition
Somshubra Majumdar, Shantanu Acharya, Vitaly Lavrukhin, Boris Ginsburg
Comments: To appear in Proc. SLT 2022, Jan 09-12, 2023, Doha, Qatar
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[166] arXiv:2210.03360 (cross-list from cs.SD) [pdf, other]
Title: The PerspectiveLiberator -- an upmixing 6DoF rendering plugin for single-perspective Ambisonic room impulse responses
Kaspar Müller, Franz Zotter
Comments: 4 pages, submitted to conference: DAGA 2021, Vienna, Austria, 2021
Journal-ref: Fortschritte der Akustik - DAGA 2021, Vienna, Austria, 2021, vol. 47, pp. 306-309
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[167] arXiv:2210.03363 (cross-list from cs.SD) [pdf, other]
Title: Model-based estimation of in-car-communication feedback applied to speech zone detection
Kaspar Müller, Simon Doclo, Jan Østergaard, Tobias Wolff
Comments: 5 pages, submitted to International Workshop on Acoustic Signal Enhancement (IWAENC), Bamberg, Germany, 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[168] arXiv:2210.03580 (cross-list from cs.CL) [pdf, other]
Title: Cloud-based Automatic Speech Recognition Systems for Southeast Asian Languages
Lei Wang, Rong Tong, Cheung Chi Leung, Sunil Sivadas, Chongjia Ni, Bin Ma
Comments: Published by the 2017 IEEE International Conference on Orange Technologies (ICOT 2017)
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[169] arXiv:2210.03603 (cross-list from cs.CL) [pdf, other]
Title: Pronunciation Modeling of Foreign Words for Mandarin ASR by Considering the Effect of Language Transfer
Lei Wang, Rong Tong
Comments: Published by INTERSPEECH 2014
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[170] arXiv:2210.03730 (cross-list from cs.CL) [pdf, other]
Title: SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei
Comments: 14 pages, accepted by EMNLP 2022
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[171] arXiv:2210.03799 (cross-list from cs.SD) [pdf, other]
Title: Supervised and Unsupervised Learning of Audio Representations for Music Understanding
Matthew C. McCallum, Filip Korzeniowski, Sergio Oramas, Fabien Gouyon, Andreas F. Ehmann
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[172] arXiv:2210.04062 (cross-list from cs.SD) [pdf, other]
Title: CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li
Comments: Accepted by Interspeech 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[173] arXiv:2210.04600 (cross-list from cs.CL) [pdf, other]
Title: YFACC: A Yor\`ub\'a speech-image dataset for cross-lingual keyword localisation through visual grounding
Kayode Olaleye, Dan Oneata, Herman Kamper
Comments: Accepted to IEEE SLT 2022
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[174] arXiv:2210.05037 (cross-list from cs.SD) [pdf, other]
Title: Automated Audio Captioning via Fusion of Low- and High- Dimensional Features
Jianyuan Sun, Xubo Liu, Xinhao Mei, Mark D. Plumbley, Volkan Kilic, Wenwu Wang
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[175] arXiv:2210.05076 (cross-list from cs.SD) [pdf, other]
Title: ConchShell: A Generative Adversarial Networks that Turns Pictures into Piano Music
Wanpeng Fan, Yuanzhi Su, Yuxin Huang
Comments: 5 pages
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[176] arXiv:2210.05092 (cross-list from cs.SD) [pdf, other]
Title: The DKU-Tencent System for the VoxCeleb Speaker Recognition Challenge 2022
Xiaoyi Qin, Na Li, Yuke Lin, Yiwei Ding, Chao Weng, Dan Su, Ming Li
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[177] arXiv:2210.05148 (cross-list from cs.SD) [pdf, other]
Title: DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability
Kin Wai Cheuk, Ryosuke Sawata, Toshimitsu Uesaka, Naoki Murata, Naoya Takahashi, Shusuke Takahashi, Dorien Herremans, Yuki Mitsufuji
Journal-ref: Proceedings of ICASSP - IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. IEEE, 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[178] arXiv:2210.05200 (cross-list from cs.CL) [pdf, other]
Title: CTC Alignments Improve Autoregressive Translation
Brian Yan, Siddharth Dalmia, Yosuke Higuchi, Graham Neubig, Florian Metze, Alan W Black, Shinji Watanabe
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[179] arXiv:2210.05254 (cross-list from cs.SD) [pdf, other]
Title: Deep Spectro-temporal Artifacts for Detecting Synthesized Speech
Xiaohui Liu, Meng Liu, Lin Zhang, Linjuan Zhang, Chang Zeng, Kai Li, Nan Li, Kong Aik Lee, Longbiao Wang, Jianwu Dang
Comments: 7 pages, 1 figures, Accecpted by Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[180] arXiv:2210.05265 (cross-list from cs.SD) [pdf, other]
Title: MFCCA:Multi-Frame Cross-Channel attention for multi-speaker ASR in Multi-party meeting scenario
Fan Yu, Shiliang Zhang, Pengcheng Guo, Yuhao Liang, Zhihao Du, Yuxiao Lin, Lei Xie
Comments: Accepted by SLT 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[181] arXiv:2210.05271 (cross-list from cs.SD) [pdf, other]
Title: GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion Models
Matthew Baas, Herman Kamper
Comments: 6 pages, 2 figures, 2 tables. Accepted at IEEE SLT 2022
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[182] arXiv:2210.05291 (cross-list from cs.CL) [pdf, other]
Title: On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding
Gaëlle Laperrière, Valentin Pelloin, Mickaël Rouvier, Themos Stafylakis, Yannick Estève
Comments: Accepted in IEEE SLT 2022. This work was performed using HPC resources from GENCI/IDRIS (grant 2022 AD011012565) and received funding from the EU H2020 research and innovation programme under the Marie Sklodowska-Curie ESPERANTO project (grant agreement No 101007666), through the SELMA project (grant No 957017) and from the French ANR through the AISSPER project (ANR-19-CE23-0004)
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[183] arXiv:2210.05614 (cross-list from cs.SD) [pdf, other]
Title: An Experimental Study on Private Aggregation of Teacher Ensemble Learning for End-to-End Speech Recognition
Chao-Han Huck Yang, I-Fan Chen, Andreas Stolcke, Sabato Marco Siniscalchi, Chin-Hui Lee
Comments: 5 pages. Accepted to IEEE SLT 2022. A first version draft was finished in Aug 2021
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)
[184] arXiv:2210.05785 (cross-list from cs.CL) [pdf, other]
Title: Scaling Up Deliberation for Multilingual ASR
Ke Hu, Bo Li, Tara N. Sainath
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[185] arXiv:2210.05793 (cross-list from cs.LG) [pdf, other]
Title: Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR
Dongseong Hwang, Khe Chai Sim, Yu Zhang, Trevor Strohman
Comments: 8 pages, 2 figures
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[186] arXiv:2210.05917 (cross-list from cs.SD) [pdf, other]
Title: Enemy Spotted: in-game gun sound dataset for gunshot classification and localization
Junwoo Park, Youngwoo Cho, Gyuhyeon Sim, Hojoon Lee, Jaegul Choo
Comments: Accepted at IEEE Conference on Games (GoG) 2022
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[187] arXiv:2210.06007 (cross-list from cs.SD) [pdf, other]
Title: JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAE
Yueh-Kao Wu, Ching-Yu Chiu, Yi-Hsuan Yang
Comments: Accepted at ISMIR 2022
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[188] arXiv:2210.06091 (cross-list from cs.CL) [pdf, other]
Title: Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge
Shuhao Deng, Chengfei Li, Jinfeng Bai, Qingqing Zhang, Wei-Qiang Zhang, Runyan Yang, Gaofeng Cheng, Pengyuan Zhang, Yonghong Yan
Comments: accepted by ISCSLP 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[189] arXiv:2210.06105 (cross-list from cs.SD) [pdf, other]
Title: SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection
Piotr Kawa, Marcin Plata, Piotr Syga
Comments: Accepted by TrustCom 2022: The 21st IEEE International Conference on Trust, Security and Privacy in Computing and Communications
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[190] arXiv:2210.06111 (cross-list from cs.SD) [pdf, other]
Title: THUEE system description for NIST 2020 SRE CTS challenge
Yu Zheng, Jinghan Peng, Miao Zhao, Yufeng Ma, Min Liu, Xinyue Ma, Tianyu Liang, Tianlong Kong, Liang He, Minqiang Xu
Comments: 3 pages, 1 table; System desciption of NIST 2020 SRE CTS challenge
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[191] arXiv:2210.06177 (cross-list from cs.CV) [pdf, other]
Title: VCSE: Time-Domain Visual-Contextual Speaker Extraction Network
Junjie Li, Meng Ge, Zexu Pan, Longbiao Wang, Jianwu Dang
Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[192] arXiv:2210.06229 (cross-list from cs.CL) [pdf, other]
Title: Towards visually prompted keyword localisation for zero-resource spoken languages
Leanne Nortje, Herman Kamper
Comments: Accepted to IEEE SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[193] arXiv:2210.06244 (cross-list from cs.CL) [pdf, other]
Title: A context-aware knowledge transferring strategy for CTC-based ASR
Ke-Han Lu, Kuan-Yu Chen
Comments: Accepted by SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[194] arXiv:2210.06324 (cross-list from cs.CL) [pdf, other]
Title: SQuId: Measuring Speech Naturalness in Many Languages
Thibault Sellam, Ankur Bapna, Joshua Camp, Diana Mackinnon, Ankur P. Parikh, Jason Riesa
Comments: Accepted at ICASSP 2023, with additional material in the appendix
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[195] arXiv:2210.06341 (cross-list from cs.CL) [pdf, other]
Title: TaskMix: Data Augmentation for Meta-Learning of Spoken Intent Understanding
Surya Kant Sahu
Comments: Accepted at Findings of AACL-IJCNLP 2022
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[196] arXiv:2210.06354 (cross-list from cs.CL) [pdf, other]
Title: Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similarity
Swapnil Bhosale, Rupayan Chakraborty, Sunil Kumar Kopparapu
Comments: 9 pages, 8 figures,
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[197] arXiv:2210.06368 (cross-list from cs.SD) [pdf, other]
Title: Individualized Conditioning and Negative Distances for Speaker Separation
Tao Sun, Nidal Abuhajar, Shuyu Gong, Zhewei Wang, Charles D. Smith, Xianhui Wang, Li Xu, Jundong Liu
Comments: Accepted to ICMLA 2022
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[198] arXiv:2210.06472 (cross-list from cs.HC) [pdf, other]
Title: Inner speech recognition through electroencephalographic signals
Francesca Gasparini, Elisa Cazzaniga, Aurora Saibene
Comments: Submitted to the Italian Workshop on Artificial Intelligence for Human Machine Interaction (AIxHMI 2022), December 02, 2022, Udine, Italy
Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS); Neurons and Cognition (q-bio.NC)
[199] arXiv:2210.06936 (cross-list from cs.CL) [pdf, other]
Title: Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models
Haoyu Wang, Wei-Qiang Zhang, Hongbin Suo, Yulong Wan
Comments: accepted by ISCSLP 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[200] arXiv:2210.07002 (cross-list from cs.SD) [pdf, other]
Title: Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy
Sarina Meyer, Pascal Tilli, Pavel Denisov, Florian Lux, Julia Koch, Ngoc Thang Vu
Comments: IEEE Spoken Language Technology Workshop 2022
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[201] arXiv:2210.07055 (cross-list from cs.CV) [pdf, other]
Title: Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors
Vladimir Iashin, Weidi Xie, Esa Rahtu, Andrew Zisserman
Comments: Accepted as a spotlight presentation for the BMVC 2022. Code: this https URL Project page: this https URL
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[202] arXiv:2210.07185 (cross-list from cs.CL) [pdf, other]
Title: On the Utility of Self-supervised Models for Prosody-related Tasks
Guan-Ting Lin, Chi-Luen Feng, Wei-Ping Huang, Yuan Tseng, Tzu-Han Lin, Chen-An Li, Hung-yi Lee, Nigel G. Ward
Comments: Accepted to IEEE SLT 2022
Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[203] arXiv:2210.07189 (cross-list from cs.CL) [pdf, other]
Title: On Compressing Sequences for Self-Supervised Speech Models
Yen Meng, Hsuan-Jui Chen, Jiatong Shi, Shinji Watanabe, Paola Garcia, Hung-yi Lee, Hao Tang
Comments: Accepted to IEEE SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[204] arXiv:2210.07323 (cross-list from cs.CL) [pdf, other]
Title: Experiments on Turkish ASR with Self-Supervised Speech Representation Learning
Ali Safaya, Engin Erzin
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[205] arXiv:2210.07353 (cross-list from cs.CL) [pdf, other]
Title: JOIST: A Joint Speech and Text Streaming Model For ASR
Tara N. Sainath, Rohit Prabhavalkar, Ankur Bapna, Yu Zhang, Zhouyuan Huo, Zhehuai Chen, Bo Li, Weiran Wang, Trevor Strohman
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[206] arXiv:2210.07499 (cross-list from cs.CL) [pdf, other]
Title: Bayes risk CTC: Controllable CTC alignment in Sequence-to-Sequence tasks
Jinchuan Tian, Brian Yan, Jianwei Yu, Chao Weng, Dong Yu, Shinji Watanabe
Journal-ref: International Conference on Learning Representations (ICLR), 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[207] arXiv:2210.07508 (cross-list from cs.SD) [pdf, other]
Title: Hierarchical Diffusion Models for Singing Voice Neural Vocoder
Naoya Takahashi, Mayank Kumar, Singh, Yuki Mitsufuji
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[208] arXiv:2210.07546 (cross-list from cs.SD) [pdf, other]
Title: Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario
Emily R. Bartusiak, Edward J. Delp
Comments: Accepted to the 2022 IEEE International Conference on Machine Learning and Applications
Journal-ref: IEEE International Conference on Machine Learning and Applications, pp. 1-8, December 2022, Nassau, The Bahamas
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[209] arXiv:2210.07559 (cross-list from cs.SD) [pdf, other]
Title: Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesis
Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, Hiroshi Saruwatari
Comments: Accepted to APSIPA ASC 2022
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[210] arXiv:2210.07642 (cross-list from cs.SD) [pdf, other]
Title: Training speech emotion classifier without categorical annotations
Meysam Shamsi, Marie Tahon
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[211] arXiv:2210.07685 (cross-list from cs.SD) [pdf, other]
Title: Full-Stack Bioacoustics: Field Kit to AI to Action (Workshop report)
Dan Stowell, Caitlin Black, Florencia Noriega, Sarab S. Sethi
Comments: Workshop report: Lorentz Center, Leiden, the Netherlands, 1-5 August 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[212] arXiv:2210.07692 (cross-list from cs.SD) [pdf, other]
Title: Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantization
Manuele Rusci, Marco Fariselli, Martin Croome, Francesco Paci, Eric Flamand
Comments: Accepted at the ITEM Workshop 2022 (located at ECML-PKDD2022)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)
[213] arXiv:2210.07764 (cross-list from cs.CV) [pdf, other]
Title: Intel Labs at Ego4D Challenge 2022: A Better Baseline for Audio-Visual Diarization
Kyle Min
Comments: Validation report for the Ego4D challenge at ECCV 2022
Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[214] arXiv:2210.07839 (cross-list from cs.MM) [pdf, other]
Title: Contrastive Audio-Visual Masked Autoencoder
Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James Glass
Comments: Accepted at ICLR 2023 as a notable top 25% paper. Code and pretrained models are at this https URL
Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[215] arXiv:2210.07852 (cross-list from cs.CL) [pdf, other]
Title: Bringing NURC/SP to Digital Life: the Role of Open-source Automatic Speech Recognition Models
Lucas Rafael Stefanel Gris, Arnaldo Candido Junior, Vinícius G. dos Santos, Bruno A. Papa Dias, Marli Quadros Leite, Flaviane Romani Fernandes Svartman, Sandra Aluísio
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[216] arXiv:2210.07978 (cross-list from cs.SD) [pdf, other]
Title: Improving generalizability of distilled self-supervised speech processing models under distorted settings
Kuan-Po Huang, Yu-Kuan Fu, Tsu-Yuan Hsu, Fabian Ritter Gutierrez, Fan-Lin Wang, Liang-Hsuan Tseng, Yu Zhang, Hung-yi Lee
Comments: Accepted by IEEE SLT2022
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[217] arXiv:2210.08182 (cross-list from cs.SD) [pdf, other]
Title: Learning Invariant Representation and Risk Minimized for Unsupervised Accent Domain Adaptation
Chendong Zhao, Jianzong Wang, Xiaoyang Qu, Haoqian Wang, Jing Xiao
Comments: Accepted to 2022 IEEE Spoken Language Technology Workshop (SLT 2022)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[218] arXiv:2210.08520 (cross-list from cs.SD) [pdf, other]
Title: A Policy-based Approach to the SpecAugment Method for Low Resource E2E ASR
Rui Li, Guodong Ma, Dexin Zhao, Ranran Zeng, Xiaoyu Li, Hao Huang
Comments: Accepted to APSIPA ASC 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[219] arXiv:2210.08610 (cross-list from cs.SD) [pdf, other]
Title: Robust, General, and Low Complexity Acoustic Scene Classification Systems and An Effective Visualization for Presenting a Sound Scene Context
Lam Pham, Dusan Salovic, Anahid Jalali, Alexander Schindler, Khoa Tran, Canh Vu, Phu X. Nguyen
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[220] arXiv:2210.08634 (cross-list from cs.CL) [pdf, other]
Title: SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning
Tzu-hsun Feng, Annie Dong, Ching-Feng Yeh, Shu-wen Yang, Tzu-Quan Lin, Jiatong Shi, Kai-Wei Chang, Zili Huang, Haibin Wu, Xuankai Chang, Shinji Watanabe, Abdelrahman Mohamed, Shang-Wen Li, Hung-yi Lee
Comments: Accepted by 2022 SLT Workshop
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[221] arXiv:2210.08834 (cross-list from cs.SD) [pdf, other]
Title: How to Leverage DNN-based speech enhancement for multi-channel speaker verification?
Sandipana Dowerah (MULTISPEECH), Romain Serizel (MULTISPEECH), Denis Jouvet (MULTISPEECH), Mohammad Mohammadamini (LIA), Driss Matrouf (LIA)
Journal-ref: 4th International Conference on Advances in Signal Processing and Artificial Intelligence (ASPAI' 2022), Oct 2022, Corfu, Greece
Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[222] arXiv:2210.08992 (cross-list from cs.CL) [pdf, other]
Title: Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition
Enes Yavuz Ugan, Christian Huber, Juan Hussain, Alexander Waibel
Comments: 18 pages
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[223] arXiv:2210.09173 (cross-list from cs.SD) [pdf, other]
Title: Visual onoma-to-wave: environmental sound synthesis from visual onomatopoeias and sound-source images
Hien Ohnaka, Shinnosuke Takamichi, Keisuke Imoto, Yuki Okamoto, Kazuki Fujii, Hiroshi Saruwatari
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[224] arXiv:2210.09188 (cross-list from cs.SD) [pdf, other]
Title: Sub-8-bit quantization for on-device speech recognition: a regularization-free approach
Kai Zhen, Martin Radfar, Hieu Duy Nguyen, Grant P. Strimel, Nathan Susanj, Athanasios Mouchtaris
Comments: Accepted for publication at IEEE SLT'22
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[225] arXiv:2210.09396 (cross-list from cs.CL) [pdf, other]
Title: Affective Idiosyncratic Responses to Music
Sky CH-Wang, Evan Li, Oliver Li, Smaranda Muresan, Zhou Yu
Comments: EMNLP 2022 Main Conference; see Github this https URL
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[226] arXiv:2210.09510 (cross-list from cs.CL) [pdf, other]
Title: Towards Personalization of CTC Speech Recognition Models with Contextual Adapters and Adaptive Boosting
Saket Dingliwal, Monica Sunkara, Sravan Bodapati, Srikanth Ronanki, Jeff Farris, Katrin Kirchhoff
Comments: To appear in SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[227] arXiv:2210.09524 (cross-list from cs.SD) [pdf, other]
Title: SVLDL: Improved Speaker Age Estimation Using Selective Variance Label Distribution Learning
Zuheng Kang, Jianzong Wang, Junqing Peng, Jing Xiao
Comments: Accepted by SLT 2022. The 2022 IEEE Spoken Language Technology Workshop (SLT 2022)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[228] arXiv:2210.09529 (cross-list from cs.SD) [pdf, other]
Title: A Hybrid System of Sound Event Detection Transformer and Frame-wise Model for DCASE 2022 Task 4
Yiming Li, Zhifang Guo, Zhirong Ye, Xiangdong Wang, Hong Liu, Yueliang Qian, Rui Tao, Long Yan, Kazushige Ouchi
Comments: 5 pages, 2 figures, accepted for publication in DCASE2022 Workshop
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[229] arXiv:2210.09556 (cross-list from cs.CL) [pdf, other]
Title: Discrete Cross-Modal Alignment Enables Zero-Shot Speech Translation
Chen Wang, Yuchen Liu, Boxing Chen, Jiajun Zhang, Wei Luo, Zhongqiang Huang, Chengqing Zong
Comments: Accepted by the main conference of EMNLP 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[230] arXiv:2210.09815 (cross-list from cs.SD) [pdf, other]
Title: Improving robustness of spontaneous speech synthesis with linguistic speech regularization and pseudo-filled-pause insertion
Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, Hiroshi Saruwatari
Comments: Accepted to SSW12
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[231] arXiv:2210.09916 (cross-list from cs.SD) [pdf, other]
Title: Mid-attribute speaker generation using optimal-transport-based interpolation of Gaussian mixture models
Aya Watanabe, Shinnosuke Takamichi, Yuki Saito, Detai Xin, Hiroshi Saruwatari
Comments: Submitted to ICASSP 2023. Demo: this https URL
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[232] arXiv:2210.09951 (cross-list from cs.SD) [pdf, other]
Title: HMM vs. CTC for Automatic Speech Recognition: Comparison Based on Full-Sum Training from Scratch
Tina Raissi, Wei Zhou, Simon Berger, Ralf Schlüter, Hermann Ney
Comments: Accepted for Presentation at IEEE SLT 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[233] arXiv:2210.10027 (cross-list from cs.CL) [pdf, other]
Title: Maestro-U: Leveraging joint speech-text representation learning for zero supervised speech ASR
Zhehuai Chen, Ankur Bapna, Andrew Rosenberg, Yu Zhang, Bhuvana Ramabhadran, Pedro Moreno, Nanxin Chen
Comments: Accepted by SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[234] arXiv:2210.10191 (cross-list from cs.CL) [pdf, other]
Title: Simple and Effective Unsupervised Speech Translation
Changhan Wang, Hirofumi Inaguma, Peng-Jen Chen, Ilia Kulikov, Yun Tang, Wei-Ning Hsu, Michael Auli, Juan Pino
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[235] arXiv:2210.10196 (cross-list from cs.SD) [pdf, other]
Title: BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Sounds
Youshan Zhang, Jialu Li
Comments: WACV 2023
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
[236] arXiv:2210.10231 (cross-list from cs.SD) [pdf, other]
Title: Speaker- and Age-Invariant Training for Child Acoustic Modeling Using Adversarial Multi-Task Learning
Mostafa Shahin, Beena Ahmed, Julien Epps
Comments: Submitted to ICASSP2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[237] arXiv:2210.10252 (cross-list from cs.CL) [pdf, other]
Title: A Data-Driven Investigation of Noise-Adaptive Utterance Generation with Linguistic Modification
Anupama Chingacham, Vera Demberg, Dietrich Klakow
Comments: Accepted to SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[238] arXiv:2210.10314 (cross-list from cs.SD) [pdf, other]
Title: Two-stage training method for Japanese electrolaryngeal speech enhancement based on sequence-to-sequence voice conversion
Ding Ma, Lester Phillip Violeta, Kazuhiro Kobayashi, Tomoki Toda
Comments: Accepted to SLT 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[239] arXiv:2210.10349 (cross-list from cs.SD) [pdf, other]
Title: Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generation
Botao Yu, Peiling Lu, Rui Wang, Wei Hu, Xu Tan, Wei Ye, Shikun Zhang, Tao Qin, Tie-Yan Liu
Comments: Accepted by the Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022)
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[240] arXiv:2210.10506 (cross-list from cs.SD) [pdf, other]
Title: Audio Tampering Detection Based on Shallow and Deep Feature Representation Learning
Zhifeng Wang, Yao Yang, Chunyan Zeng, Shuai Kong, Shixiong Feng, Nan Zhao
Comments: Audio tampering detection, 21 pages, 4 figures
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[241] arXiv:2210.10526 (cross-list from cs.LG) [pdf, other]
Title: Propagating Variational Model Uncertainty for Bioacoustic Call Label Smoothing
Georgios Rizos, Jenna Lawson, Simon Mitchell, Pranay Shah, Xin Wen, Cristina Banks-Leite, Robert Ewers, Bjoern W. Schuller
Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[242] arXiv:2210.10742 (cross-list from cs.SD) [pdf, other]
Title: End-to-End Integration of Speech Recognition, Dereverberation, Beamforming, and Self-Supervised Learning Representation
Yoshiki Masuyama, Xuankai Chang, Samuele Cornell, Shinji Watanabe, Nobutaka Ono
Comments: Accepted to IEEE SLT 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[243] arXiv:2210.10857 (cross-list from cs.SD) [pdf, other]
Title: Modeling Animal Vocalizations through Synthesizers
Masato Hagiwara, Maddie Cusimano, Jen-Yu Liu
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[244] arXiv:2210.10879 (cross-list from cs.LG) [pdf, other]
Title: G-Augment: Searching for the Meta-Structure of Data Augmentation Policies for ASR
Gary Wang, Ekin D.Cubuk, Andrew Rosenberg, Shuyang Cheng, Ron J. Weiss, Bhuvana Ramabhadran, Pedro J. Moreno, Quoc V. Le, Daniel S. Park
Comments: 6 pages, accepted at SLT 2022. Updated with copyright
Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[245] arXiv:2210.10985 (cross-list from cs.SD) [pdf, other]
Title: Large-scale learning of generalised representations for speaker recognition
Jee-weon Jung, Hee-Soo Heo, Bong-Jin Lee, Jaesong Lee, Hye-jin Shim, Youngki Kwon, Joon Son Chung, Shinji Watanabe
Comments: 5pages, 5 tables, submitted to ICASSP
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[246] arXiv:2210.11068 (cross-list from cs.LG) [pdf, other]
Title: Frequency of Interest-based Noise Attenuation Method to Improve Anomaly Detection Performance
YeongHyeon Park, Myung Jin Kim, Won Seok Park
Comments: 5 pages, 4 figures, 4 tables
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[247] arXiv:2210.11096 (cross-list from cs.SD) [pdf, other]
Title: Robust One-Shot Singing Voice Conversion
Naoya Takahashi, Mayank Kumar Singh, Yuki Mitsufuji
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[248] arXiv:2210.11328 (cross-list from cs.SD) [pdf, other]
Title: Play It Back: Iterative Attention for Audio Recognition
Alexandros Stergiou, Dima Damen
Comments: Accepted at IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2023
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[249] arXiv:2210.11429 (cross-list from cs.SD) [pdf, other]
Title: Text Enhancement for Paragraph Processing in End-to-End Code-switching TTS
Chunyu Qiang, Jianhua Tao, Ruibo Fu, Zhengqi Wen, Jiangyan Yi, Tao Wang, Shiming Wang
Comments: accepted in ISCSLP 2021
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[250] arXiv:2210.11642 (cross-list from cs.CL) [pdf, other]
Title: Improving Semi-supervised End-to-end Automatic Speech Recognition using CycleGAN and Inter-domain Losses
Chia-Yu Li, Ngoc Thang Vu
Comments: 6 pages + 2 references, 6 figures, accepted by SLT2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[251] arXiv:2210.11722 (cross-list from cs.SD) [pdf, other]
Title: Adaptive re-calibration of channel-wise features for Adversarial Audio Classification
Vardhan Dongre, Abhinav Thimma Reddy, Nikhitha Reddeddy
Comments: 7 pages, 8 figures, 4 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[252] arXiv:2210.11835 (cross-list from cs.CL) [pdf, other]
Title: A Textless Metric for Speech-to-Speech Comparison
Laurent Besacier, Swen Ribeiro, Olivier Galibert, Ioan Calapodescu
Comments: link to supplementary material: this https URL
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[253] arXiv:2210.11885 (cross-list from cs.CL) [pdf, other]
Title: Deep LSTM Spoken Term Detection using Wav2Vec 2.0 Recognizer
Jan Švec, Jan Lehečka, Luboš Šmídl
Journal-ref: \v{S}vec, J., Lehe\v{c}ka, J., \v{S}m\'idl, L. (2022) Deep LSTM Spoken Term Detection using Wav2Vec 2.0 Recognizer. Proc. Interspeech 2022, 1886-1890
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[254] arXiv:2210.11895 (cross-list from cs.CL) [pdf, other]
Title: Spoken Term Detection and Relevance Score Estimation using Dot-Product of Pronunciation Embeddings
Jan Švec, Luboš Šmídl, Josef V. Psutka, Aleš Pražák
Journal-ref: \v{S}vec, J., \v{S}m\'idl, L., Psutka, J.V., Pra\v{z}\'ak, A. (2021) Spoken Term Detection and Relevance Score Estimation Using Dot-Product of Pronunciation Embeddings. Proc. Interspeech 2021, 4398-4402
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[255] arXiv:2210.12108 (cross-list from cs.SD) [pdf, other]
Title: Adversarial Permutation Invariant Training for Universal Sound Separation
Emilian Postolache, Jordi Pons, Santiago Pascual, Joan Serrà
Comments: Demo page: this http URL, Accepted at ICASSP-23
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[256] arXiv:2210.12134 (cross-list from cs.CL) [pdf, other]
Title: Audio-to-Intent Using Acoustic-Textual Subword Representations from End-to-End ASR
Pranay Dighe, Prateeth Nayak, Oggi Rudovic, Erik Marchi, Xiaochuan Niu, Ahmed Tewfik
Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[257] arXiv:2210.12214 (cross-list from cs.SD) [pdf, other]
Title: Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation
Thien Nguyen, Nathalie Tran, Liuhui Deng, Thiago Fraga da Silva, Matthew Radzihovsky, Roger Hsiao, Henry Mason, Stefan Braun, Erik McDermott, Dogan Can, Pawel Swietojanski, Lyan Verwimp, Sibel Oyman, Tresi Arvizo, Honza Silovsky, Arnab Ghoshal, Mathieu Martel, Bharat Ram Ambati, Mohamed Ali
Comments: 5 pages, 1 figure, submitted to ICASSP 2023, *: equal contributions
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[258] arXiv:2210.12223 (cross-list from cs.CL) [pdf, other]
Title: Low-Resource Multilingual and Zero-Shot Multispeaker TTS
Florian Lux, Julia Koch, Ngoc Thang Vu
Comments: Accepted to AACL 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[259] arXiv:2210.12300 (cross-list from cs.SD) [pdf, other]
Title: BEANS: The Benchmark of Animal Sounds
Masato Hagiwara, Benjamin Hoffman, Jen-Yu Liu, Maddie Cusimano, Felix Effenberger, Katie Zacarian
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[260] arXiv:2210.12335 (cross-list from cs.CL) [pdf, other]
Title: Guided contrastive self-supervised pre-training for automatic speech recognition
Aparna Khare, Minhua Wu, Saurabhchand Bhati, Jasha Droppo, Roland Maas
Comments: To appear in SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[261] arXiv:2210.12345 (cross-list from cs.SD) [pdf, other]
Title: Neural Sound Field Decomposition with Super-resolution of Sound Direction
Qiuqiang Kong, Shilei Liu, Junjie Shi, Xuzhou Ye, Yin Cao, Qiaoxi Zhu, Yong Xu, Yuxuan Wang
Comments: 12 pages
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[262] arXiv:2210.12357 (cross-list from cs.CL) [pdf, other]
Title: Information-Transport-based Policy for Simultaneous Translation
Shaolei Zhang, Yang Feng
Comments: Accept to EMNLP 2022 main conference. 22 pages, 16 figures, 8 tables
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[263] arXiv:2210.12430 (cross-list from cs.SD) [pdf, other]
Title: Speech Emotion Recognition via an Attentive Time-Frequency Neural Network
Cheng Lu, Wenming Zheng, Hailun Lian, Yuan Zong, Chuangao Tang, Sunan Li, Yan Zhao
Comments: This paper has been accepted as a regular paper on IEEE Transactions on Computational Social Systems
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[264] arXiv:2210.12541 (cross-list from cs.SD) [pdf, other]
Title: GCT: Gated Contextual Transformer for Sequential Audio Tagging
Yuanbo Hou, Yun Wang, Wenwu Wang, Dick Botteldooren
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[265] arXiv:2210.12635 (cross-list from cs.SD) [pdf, other]
Title: Quantitative Evidence on Overlooked Aspects of Enrollment Speaker Embeddings for Target Speaker Separation
Xiaoyu Liu, Xu Li, Joan Serrà
Comments: Submitted version to ICASSP 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[266] arXiv:2210.12648 (cross-list from cs.IR) [pdf, other]
Title: Clarinet: A Music Retrieval System
Kshitij Alwadhi, Rohan Sharma, Siddhant Sharma
Subjects: Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[267] arXiv:2210.12857 (cross-list from cs.CL) [pdf, other]
Title: Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings
Jian Zhu, Zuoyu Tian, Yadong Liu, Cong Zhang, Chia-wen Lo
Comments: Findings of EMNLP 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[268] arXiv:2210.12921 (cross-list from cs.CL) [pdf, other]
Title: Investigating self-supervised, weakly supervised and fully supervised training approaches for multi-domain automatic speech recognition: a study on Bangladeshi Bangla
Ahnaf Mozib Samin, M. Humayon Kobir, Md. Mushtaq Shahriyar Rafee, M. Firoz Ahmed, Mehedi Hasan, Partha Ghosh, Shafkat Kibria, M. Shahidur Rahman
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[269] arXiv:2210.13030 (cross-list from cs.CL) [pdf, other]
Title: Self-supervised Rewiring of Pre-trained Speech Encoders: Towards Faster Fine-tuning with Less Labels in Speech Processing
Hao Yang, Jinming Zhao, Gholamreza Haffari, Ehsan Shareghi
Comments: 8 pages, 3 figures
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[270] arXiv:2210.13067 (cross-list from cs.SD) [pdf, other]
Title: 10 hours data is all you need
Zeping Min, Qian Ge, Zhong Li
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[271] arXiv:2210.13168 (cross-list from cs.CL) [pdf, other]
Title: Proficiency assessment of L2 spoken English using wav2vec 2.0
Stefano Bannò, Marco Matassoni
Comments: Accepted at SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[272] arXiv:2210.13352 (cross-list from cs.CL) [pdf, other]
Title: ESB: A Benchmark For Multi-Domain End-to-End Speech Recognition
Sanchit Gandhi, Patrick von Platen, Alexander M. Rush
Comments: 25 pages, 1 figure, submitted to ICLR 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[273] arXiv:2210.13397 (cross-list from cs.CL) [pdf, other]
Title: Development of Hybrid ASR Systems for Low Resource Medical Domain Conversational Telephone Speech
Christoph Lüscher, Mohammad Zeineldeen, Zijian Yang, Tina Raissi, Peter Vieting, Khai Le-Duc, Weiyue Wang, Ralf Schlüter, Hermann Ney
Comments: ASR System Paper for HYKIST project
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[274] arXiv:2210.13567 (cross-list from cs.CV) [pdf, other]
Title: I see what you hear: a vision-inspired method to localize words
Mohammad Samragh, Arnav Kundu, Ting-Yao Hu, Minsik Cho, Aman Chadha, Ashish Shrivastava, Oncel Tuzel, Devang Naik
Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[275] arXiv:2210.13576 (cross-list from cs.SD) [pdf, other]
Title: Spectral Clustering-aware Learning of Embeddings for Speaker Diarisation
Evonne P.C. Lee, Guangzhi Sun, Chao Zhang, Philip C. Woodland
Comments: To appear in ICASSP 2023, 5 pages
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[276] arXiv:2210.13623 (cross-list from cs.AI) [pdf, other]
Title: Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook
Baihan Lin
Comments: To appear in Expert Systems with Applications. Accompanying INTERSPEECH 2022 Tutorial on the same topic. Including latest advancements in large language models (LLMs)
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[277] arXiv:2210.13732 (cross-list from cs.LG) [pdf, other]
Title: Evaluating and Optimizing Hearing-Aid Self-Fitting Methods using Population Coverage
Dhruv Vyas, Erik Jorgensen, Yu-Hsiang Wu, Octav Chipara
Subjects: Machine Learning (cs.LG); Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[278] arXiv:2210.13803 (cross-list from cs.SD) [pdf, other]
Title: Adapitch: Adaption Multi-Speaker Text-to-Speech Conditioned on Pitch Disentangling with Untranscribed Data
Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao
Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[279] arXiv:2210.13805 (cross-list from cs.SD) [pdf, other]
Title: Improving Speech Representation Learning via Speech-level and Phoneme-level Masking Approach
Xulong Zhang, Jianzong Wang, Ning Cheng, Kexin Zhu, Jing Xiao
Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[280] arXiv:2210.13811 (cross-list from cs.SD) [pdf, other]
Title: MetaSpeech: Speech Effects Switch Along with Environment for Metaverse
Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao
Comments: Accepted by AI2OT2022, The Third International Workshop on Artificial Intelligence Applications in Internet of Things
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[281] arXiv:2210.13932 (cross-list from cs.SD) [pdf, other]
Title: CoLoC: Conditioned Localizer and Classifier for Sound Event Localization and Detection
Sławomir Kapka, Jakub Tkaczuk
Comments: 5 pages, conference
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[282] arXiv:2210.13944 (cross-list from cs.AI) [pdf, other]
Title: A Survey on Artificial Intelligence for Music Generation: Agents, Domains and Perspectives
Carlos Hernandez-Olivan, Javier Hernandez-Olivan, Jose R. Beltran
Comments: Under review
Subjects: Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[283] arXiv:2210.14085 (cross-list from cs.SD) [pdf, other]
Title: Audio MFCC-gram Transformers for respiratory insufficiency detection in COVID-19
Marcelo Matheus Gauy, Marcelo Finger
Journal-ref: SIMP\'OSIO BRASILEIRO DE TECNOLOGIA DA INFORMA\c{C}\~AO E DA LINGUAGEM HUMANA (STIL), 13. , 2021, Evento Online. Anais [...]. Porto Alegre: Sociedade Brasileira de Computa\c{c}\~ao, 2021 . p. 143-152
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[284] arXiv:2210.14252 (cross-list from cs.SD) [pdf, other]
Title: Dynamic Speech Endpoint Detection with Regression Targets
Dawei Liang, Hang Su, Tarun Singh, Jay Mahadeokar, Shanil Puri, Jiedan Zhu, Edison Thomaz, Mike Seltzer
Comments: Manuscript submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[285] arXiv:2210.14446 (cross-list from cs.CL) [pdf, other]
Title: Smart Speech Segmentation using Acousto-Linguistic Features with look-ahead
Piyush Behre, Naveen Parihar, Sharman Tan, Amy Shah, Eva Sharma, Geoffrey Liu, Shuangyu Chang, Hosam Khalil, Chris Basoglu, Sayan Pathak
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[286] arXiv:2210.14448 (cross-list from cs.SD) [pdf, other]
Title: The NPU-ASLP System for The ISCSLP 2022 Magichub Code-Swiching ASR Challenge
Yuhao Liang, Peikun Chen, Fan Yu, Xinfa Zhu, Tianyi Xu, Lei Xie
Comments: Submitted to ISCSLP 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[287] arXiv:2210.14474 (cross-list from cs.SD) [pdf, other]
Title: SCP-GAN: Self-Correcting Discriminator Optimization for Training Consistency Preserving Metric GAN on Speech Enhancement Tasks
Vasily Zadorozhnyy, Qiang Ye, Kazuhito Koishida
Comments: 5 pages (4 - manuscript and 1 - references), 2 figures, 2 tables
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[288] arXiv:2210.14476 (cross-list from eess.SP) [pdf, other]
Title: Sinusoidal Frequency Estimation by Gradient Descent
Ben Hayes, Charalampos Saitis, György Fazekas
Comments: Submitted to ICASSP 2023
Subjects: Signal Processing (eess.SP); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[289] arXiv:2210.14493 (cross-list from cs.SD) [pdf, other]
Title: AVES: Animal Vocalization Encoder based on Self-Supervision
Masato Hagiwara
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[290] arXiv:2210.14495 (cross-list from cs.SD) [pdf, other]
Title: Two-stage dimensional emotion recognition by fusing predictions of acoustic and text networks using SVM
Bagus Tris Atmaja, Masato Akagi
Comments: Published in Speech Communications
Journal-ref: Speech Commun., vol. 126, pp. 9-21, Feb. 2021
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[291] arXiv:2210.14509 (cross-list from cs.SD) [pdf, other]
Title: Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement
Jianqiao Cui, Stefan Bleeck
Comments: 5 pages, 6 figures, references added
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[292] arXiv:2210.14514 (cross-list from cs.CL) [pdf, other]
Title: Improving Speech-to-Speech Translation Through Unlabeled Text
Xuan-Phi Nguyen, Sravya Popuri, Changhan Wang, Yun Tang, Ilia Kulikov, Hongyu Gong
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[293] arXiv:2210.14602 (cross-list from cs.SD) [pdf, other]
Title: Efficient Data Mosaicing with Simulation-based Inference
Andrew Gambardella, Youngjun Choi, Doyo Choi, Jinjoon Lee
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Applications (stat.AP)
[294] arXiv:2210.14636 (cross-list from cs.SD) [pdf, other]
Title: Fast Yet Effective Speech Emotion Recognition with Self-distillation
Zhao Ren, Thanh Tam Nguyen, Yi Chang, Björn W. Schuller
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[295] arXiv:2210.14644 (cross-list from cs.SD) [pdf, other]
Title: Speaker Diarization Based on Multi-channel Microphone Array in Small-scale Meeting
Yuxuan Du, Ruohua Zhou
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[296] arXiv:2210.14653 (cross-list from cs.SD) [pdf, other]
Title: TSUP Speaker Diarization System for Conversational Short-phrase Speaker Diarization Challenge
Bowen Pang, Huan Zhao, Gaosheng Zhang, Xiaoyue Yang, Yang Sun, Li Zhang, Qing Wang, Lei Xie
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[297] arXiv:2210.14661 (cross-list from cs.SD) [pdf, other]
Title: Full-band General Audio Synthesis with Score-based Diffusion
Santiago Pascual, Gautam Bhattacharya, Chunghsin Yeh, Jordi Pons, Joan Serrà
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[298] arXiv:2210.14682 (cross-list from cs.SD) [pdf, other]
Title: In search of strong embedding extractors for speaker diarisation
Jee-weon Jung, Hee-Soo Heo, Bong-Jin Lee, Jaesung Huh, Andrew Brown, Youngki Kwon, Shinji Watanabe, Joon Son Chung
Comments: 5pages, 1 figure, 2 tables, submitted to ICASSP
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[299] arXiv:2210.14691 (cross-list from cs.SD) [pdf, other]
Title: Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition
Wei Wang, Chao Zhang, Xiaopei Wu
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[300] arXiv:2210.14716 (cross-list from cs.SD) [pdf, other]
Title: Pretrained audio neural networks for Speech emotion recognition in Portuguese
Marcelo Matheus Gauy, Marcelo Finger
Journal-ref: First Workshop on Automatic Speech Recognition for Spontaneous and Prepared Speech Speech emotion recognition in Portuguese (SER 2022)
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[301] arXiv:2210.14723 (cross-list from cs.SD) [pdf, other]
Title: Semi-Supervised Learning Based on Reference Model for Low-resource TTS
Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao
Comments: Accepted by NMIC2022, The Fourth International Workshop on Network Meets Intelligent Computations
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[302] arXiv:2210.14725 (cross-list from cs.CL) [pdf, other]
Title: Linguistic-Enhanced Transformer with CTC Embedding for Speech Recognition
Xulong Zhang, Jianzong Wang, Ning Cheng, Mengyuan Zhao, Zhiyong Zhang, Jing Xiao
Comments: Accepted by ECAISS2022, The Fourth International Workshop on Edge Computing and Artificial Intelligence based Sensor-Cloud System
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[303] arXiv:2210.14742 (cross-list from cs.CL) [pdf, other]
Title: Monotonic segmental attention for automatic speech recognition
Albert Zeyer, Robin Schmitt, Wei Zhou, Ralf Schlüter, Hermann Ney
Comments: accepted at SLT: this https URL
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[304] arXiv:2210.14850 (cross-list from cs.SD) [pdf, other]
Title: Text-to-speech synthesis from dark data with evaluation-in-the-loop data selection
Kentaro Seki, Shinnosuke Takamichi, Takaaki Saeki, Hiroshi Saruwatari
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[305] arXiv:2210.14977 (cross-list from cs.SD) [pdf, other]
Title: Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learning
Yi Chang, Zhao Ren, Thanh Tam Nguyen, Kun Qian, Björn W. Schuller
Comments: Accepted by ICASSP 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[306] arXiv:2210.15131 (cross-list from cs.SD) [pdf, other]
Title: Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representations
Haohan Guo, Fenglong Xie, Xixin Wu, Hui Lu, Helen Meng
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[307] arXiv:2210.15135 (cross-list from cs.CL) [pdf, other]
Title: Training Autoregressive Speech Recognition Models with Limited in-domain Supervision
Chak-Fai Li, Francis Keith, William Hartmann, Matthew Snover
Comments: Submitted to IEEE ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[308] arXiv:2210.15140 (cross-list from cs.SD) [pdf, other]
Title: V-Cloak: Intelligibility-, Naturalness- & Timbre-Preserving Real-Time Voice Anonymization
Jiangyi Deng (1), Fei Teng (1), Yanjiao Chen (1), Xiaofu Chen (2), Zhaohui Wang (2), Wenyuan Xu (1) ((1) Zhejiang University, (2) Wuhan University)
Comments: Accepted by USENIX Security Symposium 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)
[309] arXiv:2210.15143 (cross-list from cs.SD) [pdf, other]
Title: Audio Signal Enhancement with Learning from Positive and Unlabelled Data
Nobutaka Ito, Masashi Sugiyama
Comments: Accepted to ICASSP2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[310] arXiv:2210.15173 (cross-list from cs.SD) [pdf, other]
Title: Articulation GAN: Unsupervised modeling of articulatory learning
Gašper Beguš, Alan Zhou, Peter Wu, Gopala K Anumanchipalli
Comments: ICASSP 2023
Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[311] arXiv:2210.15226 (cross-list from cs.CL) [pdf, other]
Title: Iterative pseudo-forced alignment by acoustic CTC loss for self-supervised ASR domain adaptation
Fernando López, Jordi Luque
Comments: 5 pages, 4 figures, IberSPEECH2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[312] arXiv:2210.15261 (cross-list from cs.SD) [pdf, other]
Title: A knowledge-driven vowel-based approach of depression classification from speech using data augmentation
Kexin Feng, Theodora Chaspari
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[313] arXiv:2210.15283 (cross-list from cs.SD) [pdf, other]
Title: On Out-of-Distribution Detection for Audio with Deep Nearest Neighbors
Zaharah Bukhsh, Aaqib Saeed
Comments: Accepted at ICASSP'23. Webpage: this https URL, Code: this https URL
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[314] arXiv:2210.15285 (cross-list from cs.SD) [pdf, other]
Title: SAN: a robust end-to-end ASR model architecture
Zeping Min, Qian Ge, Guanhua Huang
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[315] arXiv:2210.15305 (cross-list from cs.SD) [pdf, other]
Title: Deformable Temporal Convolutional Networks for Monaural Noisy Reverberant Speech Separation
William Ravenscroft, Stefan Goetze, Thomas Hain
Comments: Accepted for ICASSP 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[316] arXiv:2210.15306 (cross-list from cs.SD) [pdf, other]
Title: Rigid-Body Sound Synthesis with Differentiable Modal Resonators
Rodrigo Diaz, Ben Hayes, Charalampos Saitis, György Fazekas, Mark Sandler
Comments: 5 pages
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[317] arXiv:2210.15356 (cross-list from cs.SD) [pdf, other]
Title: Convolutive Block-Matching Segmentation Algorithm with Application to Music Structure Analysis
Axel Marmoret (1,2), Jérémy E. Cohen (3), Frédéric Bimbot (1) ((1) Univ. Rennes 1, Inria, CNRS, IRISA, France, (2) IMT Atlantique, Lab-STICC, UMR CNRS 6285, F-29238 Brest, France, (3) CREATIS, Univ Lyon, CNRS)
Comments: 4 pages, 7 figures. Accepted for publication at WASPAA 2023. The associated toolbox is available at this https URL
Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
[318] arXiv:2210.15360 (cross-list from cs.CL) [pdf, other]
Title: FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis
Yifan Hu, Rui Liu, Guanglai Gao, Haizhou Li
Comments: 5 pages, 4 figures, 1 table. Submitted to ICASSP 2023. We release the source code at: this https URL
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[319] arXiv:2210.15364 (cross-list from cs.SD) [pdf, other]
Title: Explicit Intensity Control for Accented Text-to-speech
Rui Liu, Haolin Zuo, De Hu, Guanglai Gao, Haizhou Li
Comments: 5 pages, 3 figures. Submitted to ICASSP 2023. arXiv admin note: text overlap with arXiv:2209.10804
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[320] arXiv:2210.15368 (cross-list from cs.SD) [pdf, other]
Title: A Training and Inference Strategy Using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech
Li-Wei Chen, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang
Comments: Accepted by Interspeech 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[321] arXiv:2210.15370 (cross-list from cs.SD) [pdf, other]
Title: CasNet: Investigating Channel Robustness for Speech Separation
Fan-Lin Wang, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[322] arXiv:2210.15386 (cross-list from cs.SD) [pdf, other]
Title: Opening the Black Box of wav2vec Feature Encoder
Kwanghee Choi, Eun Jung Yeo
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[323] arXiv:2210.15387 (cross-list from cs.CL) [pdf, other]
Title: Automatic Severity Classification of Dysarthric speech by using Self-supervised Model with Multi-task Learning
Eun Jung Yeo, Kwanghee Choi, Sunhee Kim, Minhwa Chung
Comments: Accepted to ICASSP 2023
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[324] arXiv:2210.15398 (cross-list from cs.CL) [pdf, other]
Title: Make More of Your Data: Minimal Effort Data Augmentation for Automatic Speech Recognition and Translation
Tsz Kin Lam, Shigehiko Schamoni, Stefan Riezler
Comments: Accepted at ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[325] arXiv:2210.15418 (cross-list from cs.SD) [pdf, other]
Title: FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversion
Jingyi li, Weiping tu, Li xiao
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[326] arXiv:2210.15441 (cross-list from cs.SD) [pdf, other]
Title: Toroidal Probabilistic Spherical Discriminant Analysis
Anna Silnova, Niko Brümmer, Albert Swart, Lukáš Burget
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)
[327] arXiv:2210.15447 (cross-list from cs.SD) [pdf, other]
Title: Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech
Takaaki Saeki, Heiga Zen, Zhehuai Chen, Nobuyuki Morioka, Gary Wang, Yu Zhang, Ankur Bapna, Andrew Rosenberg, Bhuvana Ramabhadran
Comments: To appear in ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[328] arXiv:2210.15533 (cross-list from cs.SD) [pdf, other]
Title: Source-Filter HiFi-GAN: Fast and Pitch Controllable High-Fidelity Neural Vocoder
Reo Yoneyama, Yi-Chiao Wu, Tomoki Toda
Comments: Accepted to ICASSP 2023
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[329] arXiv:2210.15563 (cross-list from cs.CV) [pdf, html, other]
Title: Multimodal Transformer Distillation for Audio-Visual Synchronization
Xuanjun Chen, Haibin Wu, Chung-Che Wang, Hung-yi Lee, Jyh-Shing Roger Jang
Comments: Accepted by ICASSP 2024
Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[330] arXiv:2210.15638 (cross-list from cs.SD) [pdf, other]
Title: LyricJam Sonic: A Generative System for Real-Time Composition and Musical Improvisation
Olga Vechtomova, Gaurav Sahu
Comments: 15 pages, 9 figures, 2 tables
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[331] arXiv:2210.15707 (cross-list from cs.SD) [pdf, other]
Title: FedAudio: A Federated Learning Benchmark for Audio Tasks
Tuo Zhang, Tiantian Feng, Samiul Alam, Sunwoo Lee, Mi Zhang, Shrikanth S. Narayanan, Salman Avestimehr
Subjects: Sound (cs.SD); Distributed, Parallel, and Cluster Computing (cs.DC); Audio and Speech Processing (eess.AS)
[332] arXiv:2210.15734 (cross-list from cs.CL) [pdf, other]
Title: Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models
Siddhant Arora, Siddharth Dalmia, Brian Yan, Florian Metze, Alan W Black, Shinji Watanabe
Comments: Accepted at EMNLP 2022 Findings. Our code and models will be publicly available as part of the ESPnet-SLU toolkit: this https URL and the release can be followed here: this https URL
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[333] arXiv:2210.15750 (cross-list from cs.SD) [pdf, other]
Title: One-Shot Acoustic Matching Of Audio Signals -- Learning to Hear Music In Any Room/ Concert Hall
Prateek Verma, Chris Chafe, Jonathan Berger
Comments: 5 pages, 1 figure; fixed up broken url; added acknowledgments
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[334] arXiv:2210.15759 (cross-list from cs.CL) [pdf, other]
Title: Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challenge
Ewan Dunbar, Nicolas Hamilakis, Emmanuel Dupoux
Journal-ref: Journal: IEEE Journal of Selected Topics in Signal Processing Publication Date: OCTOBER 2022 Volume: 16, Issue: 6 On Page(s): 1211-1226 Print ISSN: 1932-4553 Online ISSN: 1941-0484 Digital Object Identifier: 10.1109/JSTSP.2022.3206084
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[335] arXiv:2210.15775 (cross-list from cs.CL) [pdf, other]
Title: Evaluating context-invariance in unsupervised speech representations
Mark Hallap, Emmanuel Dupoux, Ewan Dunbar
Comments: INTERSPEECH 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[336] arXiv:2210.15828 (cross-list from cs.SD) [pdf, other]
Title: On the Role of Visual Context in Enriching Music Representations
Kleanthis Avramidis, Shanti Stewart, Shrikanth Narayanan
Comments: 5 pages, 4 figures, 1 table
Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[337] arXiv:2210.15834 (cross-list from cs.SD) [pdf, other]
Title: GM-TCNet: Gated Multi-scale Temporal Convolutional Network using Emotion Causality for Speech Emotion Recognition
Jia-Xin Ye, Xin-Cheng Wen, Xuan-Ze Wang, Yong Xu, Yan Luo, Chang-Li Wu, Li-Yan Chen, Kun-Hong Liu
Comments: The source code is available at: this https URL
Journal-ref: speech communication, 145, November 2022, 21-35
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)
[338] arXiv:2210.15849 (cross-list from cs.SD) [pdf, html, other]
Title: Hierarchical speaker representation for target speaker extraction
Shulin He, Huaiwen Zhang, Wei Rao, Kanghao Zhang, Yukai Ju, Yang Yang, Xueliang Zhang
Comments: Accepted to ICASSP 2024
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[339] arXiv:2210.15853 (cross-list from cs.SD) [pdf, other]
Title: Speech Enhancement with Intelligent Neural Homomorphic Synthesis
Shulin He, Wei Rao, Jinjiang Liu, Jun Chen, Yukai Ju, Xueliang Zhang, Yannan Wang, Shidong Shang
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[340] arXiv:2210.15868 (cross-list from cs.SD) [pdf, other]
Title: Residual Adapters for Few-Shot Text-to-Speech Speaker Adaptation
Nobuyuki Morioka, Heiga Zen, Nanxin Chen, Yu Zhang, Yifan Ding
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[341] arXiv:2210.15936 (cross-list from cs.SD) [pdf, other]
Title: A comprehensive study on self-supervised distillation for speaker representation learning
Zhengyang Chen, Yao Qian, Bing Han, Yanmin Qian, Michael Zeng
Comments: Accepted by SLT2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[342] arXiv:2210.15937 (cross-list from cs.CL) [pdf, other]
Title: On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment Analysis
Atsushi Ando, Ryo Masumura, Akihiko Takashima, Satoshi Suzuki, Naoki Makishima, Keita Suzuki, Takafumi Moriya, Takanori Ashihara, Hiroshi Sato
Comments: Accepted to SLT 2022
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[343] arXiv:2210.15960 (cross-list from cs.SD) [pdf, other]
Title: Exploring the Effects of Channel Sparsity on Neural Network Pruning for Acoustic Scene Classification
Yiqiang Cai, Shengchen Li
Comments: Accepted by CSMT 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[344] arXiv:2210.15988 (cross-list from cs.SD) [pdf, other]
Title: Spectrograms Are Sequences of Patches
Leyi Zhao, Yi Li
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[345] arXiv:2210.16029 (cross-list from cs.CL) [pdf, other]
Title: Assessing Phrase Break of ESL speech with Pre-trained Language Models
Zhiyi Wang, Shaoguang Mao, Wenshan Wu, Yan Xia
Comments: Under Review, ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[346] arXiv:2210.16043 (cross-list from cs.CL) [pdf, other]
Title: Analyzing Acoustic Word Embeddings from Pre-trained Self-supervised Speech Models
Ramon Sanabria, Hao Tang, Sharon Goldwater
Comments: Accepted to IEEE ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[347] arXiv:2210.16045 (cross-list from cs.SD) [pdf, other]
Title: Towards zero-shot Text-based voice editing using acoustic context conditioning, utterance embeddings, and reference encoders
Jason Fong, Yun Wang, Prabhav Agrawal, Vimal Manohar, Jilong Wu, Thilo Köhler, Qing He
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[348] arXiv:2210.16173 (cross-list from cs.SD) [pdf, other]
Title: Deep Learning Object Detection Approaches to Signal Identification
Luke Wood, Kevin Anderson, Peter Gerstoft, Richard Bell, Raghab Subbaraman, Dinesh Bharadia
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[349] arXiv:2210.16192 (cross-list from cs.SD) [pdf, other]
Title: Pretraining Respiratory Sound Representations using Metadata and Contrastive Learning
Ilyass Moummad, Nicolas Farrugia
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[350] arXiv:2210.16231 (cross-list from cs.SD) [pdf, other]
Title: Universal speaker recognition encoders for different speech segments duration
Sergey Novoselov, Vladimir Volokhov, Galina Lavrentyeva
Comments: Submitted to ICASSP'23
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[351] arXiv:2210.16264 (cross-list from cs.CL) [pdf, other]
Title: Efficient Speech Translation with Dynamic Latent Perceivers
Ioannis Tsiamas, Gerard I. Gállego, José A. R. Fonollosa, Marta R. Costa-jussà
Comments: ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[352] arXiv:2210.16318 (cross-list from cs.SD) [pdf, other]
Title: Filter and evolve: progressive pseudo label refining for semi-supervised automatic speech recognition
Zezhong Jin, Dading Zhong, Xiao Song, Zhaoyi Liu, Naipeng Ye, Qingcheng Zeng
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[353] arXiv:2210.16394 (cross-list from cs.SD) [pdf, other]
Title: HeartSiam: A Domain Invariant Model for Heart Sound Classification
Reza Yousefi Mashhoor, Ahmad Ayatollahi
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
[354] arXiv:2210.16472 (cross-list from cs.SD) [pdf, other]
Title: Learning Audio-Visual Dynamics Using Scene Graphs for Audio Source Separation
Moitreya Chatterjee, Narendra Ahuja, Anoop Cherian
Comments: Accepted at NeurIPS 2022
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[355] arXiv:2210.16537 (cross-list from cs.CL) [pdf, other]
Title: Phonemic Representation and Transcription for Speech to Text Applications for Under-resourced Indigenous African Languages: The Case of Kiswahili
Ebbie Awino, Lilian Wanzare, Lawrence Muchemi, Barack Wanjawa, Edward Ombui, Florence Indede, Owen McOnyango, Benard Okal
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[356] arXiv:2210.16539 (cross-list from cs.CL) [pdf, other]
Title: Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection
Yi Wang, Jiajun Deng, Tianzi Wang, Bo Zheng, Shoukang Hu, Xunying Liu, Helen Meng
Comments: Accepted ICASSP 2023 (will update with IEEE vision later)
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[357] arXiv:2210.16554 (cross-list from cs.CL) [pdf, other]
Title: End-to-end Spoken Language Understanding with Tree-constrained Pointer Generator
Guangzhi Sun, Chao Zhang, Philip C. Woodland
Comments: 5 pages, to appear in ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[358] arXiv:2210.16587 (cross-list from cs.SD) [pdf, other]
Title: Relating Human Perception of Musicality to Prediction in a Predictive Coding Model
Nikolas McNeal, Jennifer Huang, Aniekan Umoren, Shuqi Dai, Roger Dannenberg, Richard Randall, Tai Sing Lee
Comments: 5 pages, 5 figures, currently in peer review
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[359] arXiv:2210.16642 (cross-list from cs.SD) [pdf, other]
Title: Unifying the Discrete and Continuous Emotion labels for Speech Emotion Recognition
Roshan Sharma, Hira Dhamyal, Bhiksha Raj, Rita Singh
Comments: Under Review at ICASSP 2023
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[360] arXiv:2210.16643 (cross-list from cs.CL) [pdf, other]
Title: XNOR-FORMER: Learning Accurate Approximations in Long Speech Transformers
Roshan Sharma, Bhiksha Raj
Comments: Under review at ICASSP 2023
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[361] arXiv:2210.16755 (cross-list from cs.CL) [pdf, other]
Title: token2vec: A Joint Self-Supervised Pre-training Framework Using Unpaired Speech and Text
Xianghu Yue, Junyi Ao, Xiaoxue Gao, Haizhou Li
Comments: Submitted to ICASSP 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[362] arXiv:2210.16777 (cross-list from cs.SD) [pdf, other]
Title: Symmetric Saliency-based Adversarial Attack To Speaker Identification
Jiadi Yao, Xing Chen, Xiao-Lei Zhang, Wei-Qiang Zhang, Kunde Yang
Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[363] arXiv:2210.16791 (cross-list from cs.SD) [pdf, other]
Title: Adaptive Speech Quality Aware Complex Neural Network for Acoustic Echo Cancellation with Supervised Contrastive Learning
Bozhong Liu, Xiaoxi Yu, Hantao Huang
Comments: Submitted to International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2023. Under review
Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
[364] arXiv:2210.16805 (cross-list from cs.SD) [pdf, other]
Title: SRTNet: Time Domain Speech Enhancement Via Stochastic Refinement
Zhibin Qiu, Mengfan Fu, Yinfeng Yu, LiLi Yin, Fuchun Sun, Hao Huang
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[365] arXiv:2210.16849 (cross-list from cs.SD) [pdf, other]
Title: TT-Net: Dual-path transformer based sound field translation in the spherical harmonic domain
Yiwen Wang, Zijian Lan, Xihong Wu, Tianshu Qu
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[366] arXiv:2210.16984 (cross-list from cs.SD) [pdf, other]
Title: Synthesizer Preset Interpolation using Transformer Auto-Encoders
Gwendal Le Vaillant, Thierry Dutoit
Comments: Accepted to IEEE ICASSP 2023
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[367] arXiv:2210.17016 (cross-list from cs.SD) [pdf, other]
Title: Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit
Hongji Wang, Chengdong Liang, Shuai Wang, Zhengyang Chen, Binbin Zhang, Xu Xiang, Yanlei Deng, Yanmin Qian
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[368] arXiv:2210.17017 (cross-list from cs.CL) [pdf, other]
Title: Blank Collapse: Compressing CTC emission for the faster decoding
Minkyu Jung, Ohhyeok Kwon, Seunghyun Seo, Soonshin Seo
Comments: Accepted in Interspeech 2023
Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[369] arXiv:2210.17027 (cross-list from cs.SD) [pdf, other]
Title: Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation
Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[370] arXiv:2210.17049 (cross-list from cs.CL) [pdf, other]
Title: Modular Hybrid Autoregressive Transducer
Zhong Meng, Tongzhou Chen, Rohit Prabhavalkar, Yu Zhang, Gary Wang, Kartik Audhkhasi, Jesse Emond, Trevor Strohman, Bhuvana Ramabhadran, W. Ronny Huang, Ehsan Variani, Yinghui Huang, Pedro J. Moreno
Comments: 8 pages, 1 figure, in SLT 2022
Journal-ref: 2022 IEEE Spoken Language Technology Workshop (SLT), Doha, Qatar
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
[371] arXiv:2210.17079 (cross-list from cs.SD) [pdf, other]
Title: FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition
Xingchen Song, Di Wu, Binbin Zhang, Zhiyong Wu, Wenpeng Li, Dongfang Li, Pengshen Zhang, Zhendong Peng, Fuping Pan, Changbao Zhu, Zhongqin Wu
Comments: 8 pages, plus 3 appendix
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[372] arXiv:2210.17098 (cross-list from cs.SD) [pdf, other]
Title: Structured State Space Decoder for Speech Recognition and Synthesis
Koichi Miyazaki, Masato Murata, Tomoki Koriyama
Comments: Submitted to ICASSP 2023
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[373] arXiv:2210.17143 (cross-list from cs.SD) [pdf, other]
Title: Exploring Train and Test-Time Augmentations for Audio-Language Learning
Eungbeom Kim, Jinhee Kim, Yoori Oh, Kyungsu Kim, Minju Park, Jaeheon Sim, Jinwoo Lee, Kyogu Lee
Comments: 5 pages, 4 figures
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
[374] arXiv:2210.17152 (cross-list from cs.SD) [pdf, other]
Title: Audio Time-Scale Modification with Temporal Compressing Networks
Ernie Chu, Ju-Ting Chen, Chia-Ping Chen
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[375] arXiv:2210.17183 (cross-list from cs.SD) [pdf, other]
Title: Self-Supervised Hierarchical Metrical Structure Modeling
Junyan Jiang, Gus Xia
Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[376] arXiv:2210.17222 (cross-list from cs.SD) [pdf, other]
Title: Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection
Luigi Attorresi, Davide Salvi, Clara Borrelli, Paolo Bestagini, Stefano Tubaro
Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[377] arXiv:2210.17264 (cross-list from cs.SD) [pdf, html, other]
Title: Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation
Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, Georgia Maniati, Panos Kakoulidis, June Sig Sung, Inchul Hwang, Spyros Raptis, Aimilios Chalamandaris, Pirros Tsiakoulis
Comments: Fundamental changes to the model described and experimental procedure
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
[378] arXiv:2210.17305 (cross-list from cs.SD) [pdf, other]
Title: AccentSpeech: Learning Accent from Crowd-sourced Data for Target Speaker TTS with Accents
Yongmao Zhang, Zhichao Wang, Peiji Yang, Hongshen Sun, Zhisheng Wang, Lei Xie
Comments: Accepted by ISCSLP2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[379] arXiv:2210.17349 (cross-list from cs.SD) [pdf, other]
Title: Robust MelGAN: A robust universal neural vocoder for high-fidelity TTS
Kun Song, Jian Cong, Xinsheng Wang, Yongmao Zhang, Lei Xie, Ning Jiang, Haiying Wu
Comments: Accepted by ISCSLP 2022
Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)
[380] arXiv:2210.17367 (cross-list from cs.SD) [pdf, other]
Title: Analysis and Detection of Singing Techniques in Repertoires of J-POP Solo Singers
Yuya Yamamoto, Juhan Nam, Hiroko Terasawa
Comments: Accepted at ISMIR 2022, appendix website: this https URL
Subjects: Sound (cs.SD); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
[381] arXiv:2210.17416 (cross-list from cs.CV) [pdf, other]
Title: Efficient Similarity-based Passive Filter Pruning for Compressing CNNs
Arshdeep Singh, Mark D. Plumbley
Comments: Submitted to ICASSP 2023
Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)
Total of 381 entries
Showing up to 2000 entries per page: fewer | more | all