Audio and Speech Processing

Authors and titles for February 2020

[1] arXiv:2002.00139 [pdf, other]

Title: Analysis of Deep Feature Loss based Enhancement for Speaker Verification

Saurabh Kataria, Phani Sankar Nidadavolu, Jesús Villalba, Najim Dehak

Comments: 8 pages; accepted in Odyssey2020 workshop

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[2] arXiv:2002.00198 [pdf, other]

Title: Transforming Spectrum and Prosody for Emotional Voice Conversion with Non-Parallel Training Data

Kun Zhou, Berrak Sisman, Haizhou Li

Comments: accepted by Speaker Odyssey 2020 in Tokyo, Japan

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[3] arXiv:2002.00417 [pdf, other]

Title: WaveTTS: Tacotron-based TTS with Joint Time-Frequency Domain Loss

Rui Liu, Berrak Sisman, Feilong Bao, Guanglai Gao, Haizhou Li

Comments: To appear at Odyssey 2020, Tokyo, Japan

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[4] arXiv:2002.00544 [pdf, other]

Title: Tensor-to-Vector Regression for Multi-channel Speech Enhancement based on Tensor-Train Network

Jun Qi, Hu Hu, Yannan Wang, Chao-Han Huck Yang, Sabato Marco Siniscalchi, Chin-Hui Lee

Comments: Accepted to ICASSP 2020. Update reproducible code

Journal-ref: IEEE ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Sound (cs.SD)

[5] arXiv:2002.00551 [pdf, other]

Title: End-to-End Automatic Speech Recognition Integrated With CTC-Based Voice Activity Detection

Takenori Yoshimura, Tomoki Hayashi, Kazuya Takeda, Shinji Watanabe

Comments: Submitted to ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[6] arXiv:2002.00641 [pdf, other]

Title: Time Difference of Arrival Estimation from Frequency-Sliding Generalized Cross-Correlations Using Convolutional Neural Networks

Luca Comanducci, Maximo Cobos, Fabio Antonacci, Augusto Sarti

Comments: Paper accepted for presentation in ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[7] arXiv:2002.00924 [pdf, other]

Title: Within-sample variability-invariant loss for robust speaker recognition under noisy environments

Danwei Cai, Weicheng Cai, Ming Li

Comments: Accepted at ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[8] arXiv:2002.01107 [pdf, other]

Title: Acoustic anomaly detection via latent regularized gaussian mixture generative adversarial networks

Chengwei Chen, Pan Chen, Lingyu Yang, Jinyuan Mo, Haichuan Song, Yuan Xie, Lizhuang Ma

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)

[9] arXiv:2002.01322 [pdf, other]

Title: Training Keyword Spotters with Limited and Synthesized Speech Data

James Lin, Kevin Kilgour, Dominik Roblek, Matthew Sharifi

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[10] arXiv:2002.01323 [pdf, other]

Title: Detecting Emotion Primitives from Speech and their use in discerning Categorical Emotions

Vasudha Kowtha, Vikramjit Mitra, Chris Bartels, Erik Marchi, Sue Booker, William Caruso, Sachin Kajarekar, Devang Naik

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[11] arXiv:2002.01440 [pdf, other]

Title: Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT

Francois Grondin, Hao Tang, James Glass

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[12] arXiv:2002.01626 [pdf, other]

Title: Spatial and spectral deep attention fusion for multi-channel speech separation using deep embedding features

Cunhang Fan, Bin Liu, Jianhua Tao, Jiangyan Yi, Zhengqi Wen

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[13] arXiv:2002.01869 [pdf, other]

Title: Prediction of head motion from speech waveforms with a canonical-correlation-constrained autoencoder

JinHong Lu, Hiroshi Shimodaira

Comments: head motion synthesis, speech-driven animation, deep canonically correlated autoencoder

Journal-ref: Proc. Interspeech 2020, 1301-1305

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[14] arXiv:2002.01953 [pdf, other]

Title: BOFFIN TTS: Few-Shot Speaker Adaptation by Bayesian Optimization

Henry B.Moss, Vatsal Aggarwal, Nishant Prateek, Javier González, Roberto Barra-Chicote

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[15] arXiv:2002.02562 [pdf, other]

Title: Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T Loss

Qian Zhang, Han Lu, Hasim Sak, Anshuman Tripathi, Erik McDermott, Stephen Koo, Shankar Kumar

Comments: This is the final version of the paper submitted to the ICASSP 2020 on Oct 21, 2019

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[16] arXiv:2002.02735 [pdf, other]

Title: LEAP System for SRE19 CTS Challenge -- Improvements and Error Analysis

Shreyas Ramoji, Prashant Krishnan, Bhargavram Mysore, Prachi Singh, Sriram Ganapathy

Comments: Published In Proc. Odyssey 2020, the Speaker and Language Recognition Workshop. Link to GitHub Implementation: this https URL

Journal-ref: in Proc. Odyssey 2020 The Speaker and Language Recognition Workshop, 281--288

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[17] arXiv:2002.02848 [pdf, other]

Title: Unsupervised pretraining transfers well across languages

Morgane Rivière, Armand Joulin, Pierre-Emmanuel Mazaré, Emmanuel Dupoux

Comments: 6 pages. Accepted at ICASSP 2020. However the 2 pages of supplementary materials will appear only in the arxiv version

Journal-ref: ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[18] arXiv:2002.03520 [pdf, other]

Title: An empirical analysis of information encoded in disentangled neural speaker representations

Raghuveer Peri, Haoqi Li, Krishna Somandepalli, Arindam Jati, Shrikanth Narayanan

Comments: Submitted to Speaker Odyssey 2020

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[19] arXiv:2002.03562 [pdf, other]

Title: NPLDA: A Deep Neural PLDA Model for Speaker Verification

Shreyas Ramoji, Prashant Krishnan, Sriram Ganapathy

Comments: Published in Odyssey 2020, the Speaker and Language Recognition Workshop (VOiCES Special Session). Link to GitHub Implementation: this https URL. arXiv admin note: substantial text overlap with arXiv:2001.07034

Journal-ref: in Proc. Odyssey 2020 The Speaker and Language Recognition Workshop, Pages 202-209

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[20] arXiv:2002.03566 [pdf, other]

Title: Emotion Recognition Using Speaker Cues

Ismail Shahin

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[21] arXiv:2002.03785 [pdf, other]

Title: Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis

Guangzhi Sun, Yu Zhang, Ron J. Weiss, Yuan Cao, Heiga Zen, Yonghui Wu

Comments: to appear in ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[22] arXiv:2002.03788 [pdf, other]

Title: Generating diverse and natural text-to-speech samples using a quantized fine-grained VAE and auto-regressive prosody prior

Guangzhi Sun, Yu Zhang, Ron J. Weiss, Yuan Cao, Heiga Zen, Andrew Rosenberg, Bhuvana Ramabhadran, Yonghui Wu

Comments: To appear in ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[23] arXiv:2002.03801 [pdf, other]

Title: An initial investigation on optimizing tandem speaker verification and countermeasure systems using reinforcement learning

Anssi Kanervisto, Ville Hautamäki, Tomi Kinnunen, Junichi Yamagishi

Comments: Odyssey 2020 The Speaker and Language Recognition Workshop. Code available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[24] arXiv:2002.03802 [pdf, other]

Title: A Speaker Verification Backend for Improved Calibration Performance across Varying Conditions

Luciana Ferrer, Mitchell McLaren

Comments: arXiv admin note: substantial text overlap with arXiv:1911.11622

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[25] arXiv:2002.03808 [pdf, other]

Title: Vocoder-free End-to-End Voice Conversion with Transformer Network

June-Woo Kim, Ho-Young Jung, Minho Lee

Comments: Work in progress

Journal-ref: 2020 International Joint Conference on Neural Networks (IJCNN)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[26] arXiv:2002.03851 [pdf, other]

Title: Continuous Silent Speech Recognition using EEG

Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[27] arXiv:2002.03854 [pdf, other]

Title: Attentional networks for music generation

Gullapalli Keerti, A N Vaishnavi, Prerana Mukherjee, A Sree Vidya, Gattineni Sai Sreenithya, Deeksha Nayab

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[28] arXiv:2002.03921 [pdf, other]

Title: End-to-End Multi-speaker Speech Recognition with Transformer

Xuankai Chang, Wangyou Zhang, Yanmin Qian, Jonathan Le Roux, Shinji Watanabe

Comments: To appear in ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[29] arXiv:2002.03977 [pdf, other]

Title: Multimodal active speaker detection and virtual cinematography for video conferencing

Ross Cutler, Ramin Mehran, Sam Johnson, Cha Zhang, Adam Kirk, Oliver Whyte, Adarsh Kowdle

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Multimedia (cs.MM); Machine Learning (stat.ML)

[30] arXiv:2002.04857 [pdf, other]

Title: Deep Feature Embedding and Hierarchical Classification for Audio Scene Classification

Lam Pham, Ian McLoughlin, Huy Phan, Ramaswamy Palaniappan, Alfred Mertins

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[31] arXiv:2002.04933 [pdf, other]

Title: Content Based Singing Voice Extraction From a Musical Mixture

Pritish Chandna, Merlijn Blaauw, Jordi Bonada, Emilia Gomez

Comments: To be published in ICASSP 2020

Journal-ref: 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[32] arXiv:2002.04971 [pdf, other]

Title: FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA

Shehzeen Hussain, Mojan Javaheripi, Paarth Neekhara, Ryan Kastner, Farinaz Koushanfar

Comments: Published as a conference paper at ICCAD 2019

Journal-ref: @inproceedings {1143,booktitle = {IEEE/ACM 2019 International Conference On Computer Aided Design (ICCAD)},year = {2019},month = {November}}

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[33] arXiv:2002.04992 [pdf, other]

Title: Phoneme Boundary Detection using Learnable Segmental Features

Felix Kreuk, Yaniv Sheena, Joseph Keshet, Yossi Adi

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[34] arXiv:2002.05033 [pdf, other]

Title: Active Learning for Sound Event Detection

Shuyang Zhao, Toni Heittola, Tuomas Virtanen

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[35] arXiv:2002.05039 [pdf, other]

Title: x-vectors meet emotions: A study on dependencies between emotion and speaker recognition

Raghavendra Pappagari, Tianzi Wang, Jesus Villalba, Nanxin Chen, Najim Dehak

Comments: 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[36] arXiv:2002.05150 [pdf, other]

Title: Attentional Speech Recognition Models Misbehave on Out-of-domain Utterances

Phillip Keung, Wei Niu, Yichao Lu, Julian Salazar, Vikas Bhardwaj

Comments: Artifacts like our filtered Audio BNC dataset can be found at this https URL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[37] arXiv:2002.05314 [pdf, other]

Title: Self-supervised learning for audio-visual speaker diarization

Yifan Ding, Yong Xu, Shi-Xiong Zhang, Yahuan Cong, Liqiang Wang

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Machine Learning (stat.ML)

[38] arXiv:2002.05412 [pdf, other]

Title: Comparison of user models based on GMM-UBM and i-vectors for speech, handwriting, and gait assessment of Parkinson's disease patients

J. C. Vasquez-Correa, T. Bocklet, J. R. Orozco-Arroyave, E. Nöth

Comments: Proceedings of ICASSP (2019)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[39] arXiv:2002.05604 [pdf, other]

Title: Efficient And Scalable Neural Residual Waveform Coding With Collaborative Quantization

Kai Zhen, Mi Suk Lee, Jongmo Sung, Seungkwon Beack, Minje Kim

Comments: Accepted in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) , Barcelona, Spain, May 4-8, 2020

Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM); Sound (cs.SD); Signal Processing (eess.SP)

[40] arXiv:2002.05831 [pdf, other]

Title: Consistency-aware multi-channel speech enhancement using deep neural networks

Yoshiki Masuyama, Masahito Togami, Tatsuya Komatsu

Comments: To appear at the 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[41] arXiv:2002.05832 [pdf, other]

Title: Phase reconstruction based on recurrent phase unwrapping with deep neural networks

Yoshiki Masuyama, Kohei Yatabe, Yuma Koizumi, Yasuhiro Oikawa, Noboru Harada

Comments: To appear at the 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[42] arXiv:2002.05843 [pdf, other]

Title: Real-time speech enhancement using equilibriated RNN

Daiki Takeuchi, Kohei Yatabe, Yuma Koizumi, Yasuhiro Oikawa, Noboru Harada

Comments: To appear in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2020)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[43] arXiv:2002.05865 [pdf, other]

Title: A Sequence Matching Network for Polyphonic Sound Event Localization and Detection

Thi Ngoc Tho Nguyen, Douglas L. Jones, Woon-Seng Gan

Comments: to be published in 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[44] arXiv:2002.05873 [pdf, other]

Title: Speech Enhancement using Self-Adaptation and Multi-Head Self-Attention

Yuma Koizumi, Kohei Yatabe, Marc Delcroix, Yoshiki Masuyama, Daiki Takeuchi

Comments: 5 pages, to appear in IEEE ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[45] arXiv:2002.05879 [pdf, other]

Title: Stable Training of DNN for Speech Enhancement based on Perceptually-Motivated Black-Box Cost Function

Masaki Kawanaka, Yuma Koizumi, Ryoichi Miyazaki, Kohei Yatabe

Comments: accepted to the 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020)

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Machine Learning (stat.ML)

[46] arXiv:2002.05994 [pdf, other]

Title: Sound Event Localization based on Sound Intensity Vector Refined By DNN-Based Denoising and Source Separation

Masahiro Yasuda, Yuma Koizumi, Shoichiro Saito, Hisashi Uematsu, Keisuke Imoto

Comments: 5 pages, 3 figures, to appear in IEEE ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[47] arXiv:2002.06049 [pdf, other]

Title: An Adaptive X-vector Model for Text-independent Speaker Verification

Bin Gu, Wu Guo, Lirong Dai, Jun Du

Comments: 6 pages, 3 figures

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[48] arXiv:2002.06165 [pdf, other]

Title: Unsupervised Speaker Adaptation using Attention-based Speaker Memory for End-to-End ASR

Leda Sarı, Niko Moritz, Takaaki Hori, Jonathan Le Roux

Comments: To appear in Proc. ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[49] arXiv:2002.06220 [pdf, other]

Title: Speaker Diarization with Region Proposal Network

Zili Huang, Shinji Watanabe, Yusuke Fujita, Paola Garcia, Yiwen Shao, Daniel Povey, Sanjeev Khudanpur

Comments: Accepted to ICASSP 2020

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[50] arXiv:2002.06239 [pdf, other]

Title: Boosted Locality Sensitive Hashing: Discriminative Binary Codes for Source Separation

Sunwoo Kim, Haici Yang, Minje Kim

Journal-ref: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)