Audio and Speech Processing

Authors and titles for August 2021

[51] arXiv:2108.12531 [pdf, other]

Title: Speech Representations and Phoneme Classification for Preserving the Endangered Language of Ladin

Zane Durante, Leena Mathur, Eric Ye, Sichong Zhao, Tejas Ramdas, Khalil Iskarous

Comments: Accepted to ICSA MLSLP 2021 (held with Interspeech 2021)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[52] arXiv:2108.12953 [pdf, other]

Title: Multi-Channel Transformer Transducer for Speech Recognition

Feng-Ju Chang, Martin Radfar, Athanasios Mouchtaris, Maurizio Omologo

Journal-ref: Published in INTERSPEECH 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[53] arXiv:2108.13087 [pdf, other]

Title: InSE-NET: A Perceptually Coded Audio Quality Model based on CNN

Guanxin Jiang, Arijit Biswas, Christian Bergler, Andreas Maier

Comments: Accepted to 151st Audio Engineering Society (AES), Las Vegas, NV, USA, October 2021

Subjects: Audio and Speech Processing (eess.AS)

[54] arXiv:2108.13320 [pdf, other]

Title: Neural HMMs are all you need (for high-quality attention-free TTS)

Shivam Mehta, Éva Székely, Jonas Beskow, Gustav Eje Henter

Comments: 5 pages, 2 figures; final version for ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)

[55] arXiv:2108.13326 [pdf, other]

Title: Artificial bandwidth extension using deep neural network and $H^\infty$ sampled-data control theory

Deepika Gupta, Hanumant Singh Shekhawat

Subjects: Audio and Speech Processing (eess.AS)

[56] arXiv:2108.13559 [pdf, other]

Title: Music Demixing Challenge 2021

Yuki Mitsufuji, Giorgio Fabbro, Stefan Uhlich, Fabian-Robert Stöter, Alexandre Défossez, Minseok Kim, Woosung Choi, Chin-Yun Yu, Kin-Wai Cheuk

Journal-ref: Frontiers in Signal Processing, 28 January 2022

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[57] arXiv:2108.13816 [pdf, other]

Title: Maximum F1-score training for end-to-end mispronunciation detection and diagnosis of L2 English speech

Bi-Cheng Yan, Shao-Wei Fan Jiang, Fu-An Chao, Berlin Chen

Comments: Accepted by IEEE International Conference on Multimedia and Expo (ICME 2022)

Subjects: Audio and Speech Processing (eess.AS)

[58] arXiv:2108.13985 [pdf, other]

Title: Neural Sequence-to-Sequence Speech Synthesis Using a Hidden Semi-Markov Model Based Structured Attention Mechanism

Yoshihiko Nankaku, Kenta Sumiya, Takenori Yoshimura, Shinji Takaki, Kei Hashimoto, Keiichiro Oura, Keiichi Tokuda

Comments: 5 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS)

[59] arXiv:2108.00084 (cross-list from cs.CL) [pdf, other]

Title: The History of Speech Recognition to the Year 2030

Awni Hannun

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2108.00190 (cross-list from cs.SD) [pdf, other]

Title: Sequence-to-Sequence Voice Reconstruction for Silent Speech in a Tonal Language

Huiyan Li, Haohong Lin, You Wang, Hengyang Wang, Ming Zhang, Han Gao, Qing Ai, Zhiyuan Luo, Guang Li

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[61] arXiv:2108.00378 (cross-list from cs.SD) [pdf, other]

Title: SurpriseNet: Melody Harmonization Conditioning on User-controlled Surprise Contours

Yi-Wei Chen, Hung-Shin Lee, Yen-Hsing Chen, Hsin-Min Wang

Comments: Proceedings of the 22nd International Society for Music Information Retrieval Conference, ISMIR 2021

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[62] arXiv:2108.00500 (cross-list from cs.SD) [pdf, other]

Title: End to End Bangla Speech Synthesis

Prithwiraj Bhattacharjee, Rajan Saha Raju, Arif Ahmad, M. Shahidur Rahman

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[63] arXiv:2108.00768 (cross-list from cs.IR) [pdf, other]

Title: Cross-cultural Mood Perception in Pop Songs and its Alignment with Mood Detection Algorithms

Harin Lee, Frank Hoeger, Marc Schoenwiesner, Minsu Park, Nori Jacoby

Comments: 8 pages, 5 figures, to be included as proceedings for the 22nd International Society of Music Information Retrieval (ISMIR)

Journal-ref: Proceedings of the 22nd International Society for Music Information Retrieval Conference, Nov. 2021, pp. 366-373

Subjects: Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[64] arXiv:2108.01043 (cross-list from cs.SD) [pdf, other]

Title: Musical Speech: A Transformer-based Composition Tool

Jason d'Eon, Sri Harsha Dumpala, Chandramouli Shama Sastry, Dani Oore, Sageev Oore

Comments: NeurIPS 2020 Demonstration Track; extended for PMLR

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[65] arXiv:2108.01115 (cross-list from physics.med-ph) [pdf, other]

Title: Triangular body-cover model of the vocal folds with coordinated activation of the five intrinsic laryngeal muscles

Gabriel A. Alzamendi, Sean D. Peterson, Byron D. Erath, Robert E. Hillman, Matías Zañartu

Comments: Primitive version, 54 pages, 8 figures, 4 tables. The present manuscript has been submitted to the Journal of the Acoustical Society of America (JASA)

Subjects: Medical Physics (physics.med-ph); Sound (cs.SD); Audio and Speech Processing (eess.AS); Biological Physics (physics.bio-ph)

[66] arXiv:2108.01129 (cross-list from cs.CL) [pdf, other]

Title: Decoupling recognition and transcription in Mandarin ASR

Jiahong Yuan, Xingyu Cai, Dongji Gao, Renjie Zheng, Liang Huang, Kenneth Church

Comments: submitted to ASRU 2021

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2108.01154 (cross-list from cs.SD) [pdf, other]

Title: Speaker Adaptation with Continuous Vocoder-based DNN-TTS

Ali Raheem Mandeel, Mohammed Salah Al-Radhi, Tamás Gábor Csapó

Comments: 10 pages, 3 figures, 23RD INTERNATIONAL CONFERENCE ON SPEECH AND COMPUTER SPECOM 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2108.01208 (cross-list from cs.CL) [pdf, other]

Title: User-Initiated Repetition-Based Recovery in Multi-Utterance Dialogue Systems

Hoang Long Nguyen, Vincent Renkens, Joris Pelemans, Srividya Pranavi Potharaju, Anil Kumar Nalamalapu, Murat Akbacak

Comments: Will be published in Interspeech 2021

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2108.01216 (cross-list from cs.SD) [pdf, other]

Title: DarkGAN: Exploiting Knowledge Distillation for Comprehensible Audio Synthesis with GANs

Javier Nistal, Stefan Lattner, Gaël Richard

Comments: 9 pages, 3 figures, 2 tables, accepted to ISMIR2021

Journal-ref: 22nd International Society for Music Information Retrieval (ISMIR 2021)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[70] arXiv:2108.01245 (cross-list from cs.SD) [pdf, other]

Title: The Performance Evaluation of Attention-Based Neural ASR under Mixed Speech Input

Bradley He, Martin Radfar

Comments: 5 pages, 3 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[71] arXiv:2108.01283 (cross-list from cs.SD) [pdf, other]

Title: An analysis of Iranian Music Intervals based on Pitch Histogram

Sepideh Shafiei

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[72] arXiv:2108.01374 (cross-list from cs.SD) [pdf, other]

Title: EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generation

Hsiao-Tzu Hung, Joann Ching, Seungheon Doh, Nabin Kim, Juhan Nam, Yi-Hsuan Yang

Comments: The paper has been accepted for publication at ISMIR 2021

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[73] arXiv:2108.01450 (cross-list from cs.SD) [pdf, other]

Title: Is Disentanglement enough? On Latent Representations for Controllable Music Generation

Ashis Pati, Alexander Lerch

Comments: To be published in: Proceedings of 22nd International Society for Music Information Retrieval Conference (ISMIR), Online, 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[74] arXiv:2108.01576 (cross-list from cs.SD) [pdf, other]

Title: A Benchmarking Initiative for Audio-Domain Music Generation Using the Freesound Loop Dataset

Tun-Min Hung, Bo-Yu Chen, Yen-Tung Yeh, Yi-Hsuan Yang

Comments: The paper has been accepted for publication at ISMIR 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[75] arXiv:2108.01711 (cross-list from cs.SD) [pdf, other]

Title: Improving Music Performance Assessment with Contrastive Learning

Pavan Seshadri, Alexander Lerch

Comments: To appear at 22nd International Society for Music Information Retrieval Conference, Online, 2021

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[76] arXiv:2108.01769 (cross-list from cs.CV) [pdf, other]

Title: An Empirical Evaluation of End-to-End Polyphonic Optical Music Recognition

Sachinda Edirisooriya, Hao-Wen Dong, Julian McAuley, Taylor Berg-Kirkpatrick

Comments: Accepted to ISMIR 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[77] arXiv:2108.01812 (cross-list from cs.CL) [pdf, other]

Title: Improving Distinction between ASR Errors and Speech Disfluencies with Feature Space Interpolation

Seongmin Park, Dongchan Shin, Sangyoun Paik, Subong Choi, Alena Kazakova, Jihwa Lee

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2108.01831 (cross-list from cs.SD) [pdf, other]

Title: Information Sieve: Content Leakage Reduction in End-to-End Prosody For Expressive Speech Synthesis

Xudong Dai, Cheng Gong, Longbiao Wang, Kaili Zhang

Comments: Accepted By Interspeech 2021

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[79] arXiv:2108.02034 (cross-list from cs.CL) [pdf, other]

Title: Dyn-ASR: Compact, Multilingual Speech Recognition via Spoken Language and Accent Identification

Sangeeta Ghangam, Daniel Whitenack, Joshua Nemecek

Comments: Accepted to IEEE WF-IOT 2021

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2108.02148 (cross-list from cs.SD) [pdf, other]

Title: Pervasive Hand Gesture Recognition for Smartphones using Non-audible Sound and Deep Learning

Ahmed Ibrahim, Ayman El-Refai, Sara Ahmed, Mariam Aboul-Ela, Hesham M. Eraqi, Mohamed Moustafa

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[81] arXiv:2108.02271 (cross-list from cs.SD) [pdf, other]

Title: Daft-Exprt: Cross-Speaker Prosody Transfer on Any Text for Expressive Speech Synthesis

Julian Zaïdi, Hugo Seuté, Benjamin van Niekerk, Marc-André Carbonneau

Comments: Submitted to Interspeech 2022, 5 pages, 5 figures, 2 tables

Journal-ref: Proc. Interspeech (2022) 4591-4595

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[82] arXiv:2108.02370 (cross-list from cs.DC) [pdf, other]

Title: Spotify Danceability and Popularity Analysis using SAP

Virginia Ochi, Ricardo Estrada, Teezal Gaji, Wendy Gadea, Emily Duong

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[83] arXiv:2108.02510 (cross-list from cs.SD) [pdf, other]

Title: Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentation

Sarala Padi, Seyed Omid Sadjadi, Dinesh Manocha, Ram D. Sriram

Comments: Accepted at ACM/SIGCHI ICMI'21

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[84] arXiv:2108.02539 (cross-list from cs.SD) [pdf, other]

Title: SLoClas: A Database for Joint Sound Localization and Classification

Xinyuan Qian, Bidisha Sharma, Amine El Abridi, Haizhou Li

Comments: Submitted to O-COCOSDA 2021

Subjects: Sound (cs.SD); Databases (cs.DB); Audio and Speech Processing (eess.AS)

[85] arXiv:2108.02576 (cross-list from cs.SD) [pdf, other]

Title: Performer Identification From Symbolic Representation of Music Using Statistical Models

Syed Rifat Mahmud Rafee, Gyorgy Fazekas, Geraint A.Wiggins

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[86] arXiv:2108.02607 (cross-list from cs.CV) [pdf, other]

Title: UniCon: Unified Context Network for Robust Active Speaker Detection

Yuanhang Zhang, Susan Liang, Shuang Yang, Xiao Liu, Zhongqin Wu, Shiguang Shan, Xilin Chen

Comments: 10 pages, 6 figures; to appear at ACM Multimedia 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[87] arXiv:2108.02625 (cross-list from cs.SD) [pdf, other]

Title: MSTRE-Net: Multistreaming Acoustic Modeling for Automatic Lyrics Transcription

Emir Demirel, Sven Ahlbäck, Simon Dixon

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[88] arXiv:2108.03008 (cross-list from cs.SD) [pdf, other]

Title: An Empirical Study on End-to-End Singing Voice Synthesis with Encoder-Decoder Architectures

Dengfeng Ke, Yuxing Lu, Xudong Liu, Yanyan Xu, Jing Sun, Cheng-Hao Cai

Comments: 27 pages, 4 figures, 5 tables

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[89] arXiv:2108.03168 (cross-list from eess.SP) [pdf, other]

Title: Pattern Recognition in Vital Signs Using Spectrograms

Sidharth Srivatsav Sribhashyam, Md Sirajus Salekin, Dmitry Goldgof, Ghada Zamzmi, Mark Last, Yu Sun

Comments: Accepted in the IEEE International Conference on Systems, Man, and Cybernetics (SMC 2021)

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[90] arXiv:2108.03256 (cross-list from cs.CV) [pdf, other]

Title: The Right to Talk: An Audio-Visual Transformer Approach

Thanh-Dat Truong, Chi Nhan Duong, The De Vu, Hoang Anh Pham, Bhiksha Raj, Ngan Le, Khoa Luu

Comments: Accepted to ICCV 2021

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[91] arXiv:2108.03340 (cross-list from cs.CL) [pdf, other]

Title: Tiny Neural Models for Seq2Seq

Arun Kandoor

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2108.03456 (cross-list from cs.SD) [pdf, other]

Title: A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis

Liwei Lin, Qiuqiang Kong, Junyan Jiang, Gus Xia

Comments: Accepted by ISMIR2021

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[93] arXiv:2108.03569 (cross-list from cs.SD) [pdf, other]

Title: Deep Single Shot Musical Instrument Identification using Scalograms

Debdutta Chatterjee, Arindam Dutta, Dibakar Sil, Aniruddha Chandra

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[94] arXiv:2108.03818 (cross-list from cs.SD) [pdf, other]

Title: Time-Frequency Localization Using Deep Convolutional Maxout Neural Network in Persian Speech Recognition

Arash Dehghani, Seyyed Ali Seyyedsalehi

Journal-ref: Neural Process Lett (2022)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[95] arXiv:2108.04325 (cross-list from cs.CV) [pdf, other]

Title: AnyoneNet: Synchronized Speech and Talking Head Generation for Arbitrary Person

Xinsheng Wang, Qicong Xie, Jihua Zhu, Lei Xie, Scharenborg

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[96] arXiv:2108.04605 (cross-list from cs.AI) [pdf, other]

Title: A Novel Markovian Framework for Integrating Absolute and Relative Ordinal Emotion Information

Jingyao Wu, Ting Dang, Vidhyasaharan Sethu, Eliathamby Ambikairajah

Comments: This work has been submitted to IEEE for possible publication

Subjects: Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[97] arXiv:2108.04692 (cross-list from cs.CL) [pdf, other]

Title: Automated Audio Captioning using Transfer Learning and Reconstruction Latent Space Similarity Regularization

Andrew Koh, Fuzhao Xue, Eng Siong Chng

Comments: to be submitted to icassp 2022

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[98] arXiv:2108.05080 (cross-list from cs.CV) [pdf, other]

Title: FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Dataset

Hasam Khalid, Shahroz Tariq, Minha Kim, Simon S. Woo

Comments: Part of Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (NeurIPS Datasets and Benchmarks 2021)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[99] arXiv:2108.05470 (cross-list from cs.SD) [pdf, other]

Title: On The Compensation Between Magnitude and Phase in Speech Separation

Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux

Comments: in IEEE Signal Processing Letters

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[100] arXiv:2108.05553 (cross-list from cs.SD) [pdf, other]

Title: Deep Neural Network Voice Activity Detector for Downsampled Audio Data: An Experiment Report

Mikael Ovaska (1), Joni Kultanen (1), Teemu Autto (1), Joonas Uusnäkki (1), Antti Kariluoto (1), Joonas Himmanen (1), Mikko Virtaneva (2), Pasi Kaitila (2), Pekka Abrahamsson (1) ((1) University of Jyväskylä, (2) Workspace Oy)

Comments: Pre-print. 7 Pages, 2 figures and 5 tables

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)