Audio and Speech Processing

Authors and titles for October 2020

[101] arXiv:2010.13956 [pdf, other]

Title: Recent Developments on ESPnet Toolkit Boosted by Conformer

Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[102] arXiv:2010.13995 [pdf, other]

Title: One-class Learning Towards Synthetic Voice Spoofing Detection

You Zhang, Fei Jiang, Zhiyao Duan

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[103] arXiv:2010.14122 [pdf, other]

Title: Phase Aware Speech Enhancement using Realisation of Complex-valued LSTM

Raktim Gautam Goswami, Sivaganesh Andhavarapu, K Sri Rama Murty

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)

[104] arXiv:2010.14150 [pdf, other]

Title: FragmentVC: Any-to-Any Voice Conversion by End-to-End Extracting and Fusing Fine-Grained Voice Fragments With Attention

Yist Y. Lin, Chung-Ming Chien, Jheng-Hao Lin, Hung-yi Lee, Lin-shan Lee

Comments: To appear in the proceedings of ICASSP 2021, equal contribution from first two authors

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG)

[105] arXiv:2010.14151 [pdf, other]

Title: Parallel waveform synthesis based on generative adversarial networks with voicing-aware conditional discriminators

Ryuichi Yamamoto, Eunwoo Song, Min-Jae Hwang, Jae-Min Kim

Comments: Accepted to the conference of ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD); Signal Processing (eess.SP)

[106] arXiv:2010.14230 [pdf, other]

Title: A Comparison of Discrete Latent Variable Models for Speech Representation Learning

Henry Zhou, Alexei Baevski, Michael Auli

Comments: 7 pages, 4 figures

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

[107] arXiv:2010.14233 [pdf, other]

Title: Align-Refine: Non-Autoregressive Speech Recognition via Iterative Realignment

Ethan A. Chi, Julian Salazar, Katrin Kirchhoff

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[108] arXiv:2010.14337 [pdf, other]

Title: Acoustic echo cancellation with the dual-signal transformation LSTM network

Nils L. Westhausen, Bernd T. Meyer

Comments: Submitted in to ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS)

[109] arXiv:2010.14420 [pdf, other]

Title: SSLIDE: Sound Source Localization for Indoors based on Deep Learning

Yifan Wu, Roshan Ayyalasomayajula, Michael J. Bianco, Dinesh Bharadia, Peter Gerstoft

Comments: This paper has been accepted by ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[110] arXiv:2010.14606 [pdf, other]

Title: Cascaded encoders for unifying streaming and non-streaming ASR

Arun Narayanan, Tara N. Sainath, Ruoming Pang, Jiahui Yu, Chung-Cheng Chiu, Rohit Prabhavalkar, Ehsan Variani, Trevor Strohman

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[111] arXiv:2010.14725 [pdf, other]

Title: CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition

Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao

Comments: Accepted to ICASSP2021, camera ready version

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[112] arXiv:2010.14751 [pdf, other]

Title: An iterative framework for self-supervised deep speaker representation learning

Danwei Cai, Weiqing Wang, Ming Li

Comments: arXiv admin note: text overlap with arXiv:2010.12731

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[113] arXiv:2010.14764 [pdf, other]

Title: Effective Decoder Masking for Transformer Based End-to-End Speech Recognition

Shi-Yan Weng, Berlin Chen

Comments: More extensions and experiments are under exploration

Subjects: Audio and Speech Processing (eess.AS)

[114] arXiv:2010.14791 [pdf, other]

Title: One In A Hundred: Select The Best Predicted Sequence from Numerous Candidates for Streaming Speech Recognition

Zhengkun Tian, Jiangyan Yi, Ye Bai, Jianhua Tao, Shuai Zhang, Zhengqi Wen

Subjects: Audio and Speech Processing (eess.AS)

[115] arXiv:2010.15006 [pdf, other]

Title: Replay and Synthetic Speech Detection with Res2net Architecture

Xu Li, Na Li, Chao Weng, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Comments: Accepted to ICASSP2021

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI)

[116] arXiv:2010.15049 [pdf, other]

Title: Optimizing Short-Time Fourier Transform Parameters via Gradient Descent

An Zhao, Krishna Subramani, Paris Smaragdis

Comments: Accepted for ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[117] arXiv:2010.15084 [pdf, other]

Title: Speech Synthesis and Control Using Differentiable DSP

Giorgio Fabbro, Vladimir Golkov, Thomas Kemp, Daniel Cremers

Comments: 6 pages, 3 figures, for associated audio files, see this https URL

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[118] arXiv:2010.15306 [pdf, other]

Title: ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection

Kazuki Shimada, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Yuki Mitsufuji

Comments: 5 pages, 5 figures, accepted for publication in IEEE ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[119] arXiv:2010.15311 [pdf, other]

Title: DeviceTTS: A Small-Footprint, Fast, Stable Network for On-Device Text-to-Speech

Zhiying Huang, Hao Li, Ming Lei

Comments: 5 pages, 1 figure, Submitted to ICASSP2021

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[120] arXiv:2010.15446 [pdf, other]

Title: Progressive Voice Trigger Detection: Accuracy vs Latency

Siddharth Sigtia, John Bridle, Hywel Richards, Pascal Clark, Erik Marchi, Vineet Garg

Comments: Camera Ready Version: ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Sound (cs.SD)

[121] arXiv:2010.15508 [pdf, other]

Title: FullSubNet: A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement

Xiang Hao, Xiangdong Su, Radu Horaud, Xiaofei Li

Comments: 5 pages, submitted to 2021 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[122] arXiv:2010.15521 [pdf, other]

Title: UNetGAN: A Robust Speech Enhancement Approach in Time Domain for Extremely Low Signal-to-noise Ratio Condition

Xiang Hao, Xiangdong Su, Zhiyu Wang, Hui Zhang, Batushiren

Comments: Published in Interspeech 2019

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[123] arXiv:2010.16038 [pdf, other]

Title: Adversarial defense for deep speaker recognition using hybrid adversarial training

Monisankha Pal, Arindam Jati, Raghuveer Peri, Chin-Cheng Hsu, Wael AbdAlmageed, Shrikanth Narayanan

Comments: Submitted to ICASSP 2021

Subjects: Audio and Speech Processing (eess.AS)

[124] arXiv:2010.16131 [pdf, other]

Title: Comparison of Speaker Role Recognition and Speaker Enrollment Protocol for conversational Clinical Interviews

Rachid Riad, Hadrien Titeux, Laurie Lemoine, Justine Montillot, Agnes Sliwinski, Jennifer Hamet Bagnou, Xuan Nga Cao, Anne-Catherine Bachoud-Lévi, Emmanuel Dupoux

Comments: Submitted to ICASSP 2021,1 pages of supplementary material appear only in the arxiv version

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[125] arXiv:2010.16140 [pdf, other]

Title: Beamforming for measurements under disturbed propagation conditions using numerically calculated Green's functions

Marius Lehmann, Daniel Ernst, Marc Schneider, Carsten Spehr, Markus Lummer

Comments: Preprint subitted to "Journal of Sound and Vibration"

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[126] arXiv:2010.16318 [pdf, other]

Title: Interpreting glottal flow dynamics for detecting COVID-19 from voice

Soham Deshmukh, Mahmoud Al Ismail, Rita Singh

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[127] arXiv:2010.16386 [pdf, other]

Title: Audio Dequantization Using (Co)Sparse (Non)Convex Methods

Pavel Záviška, Pavel Rajmic, Ondřej Mokrý

Journal-ref: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD); Signal Processing (eess.SP)

[128] arXiv:2010.00059 (cross-list from cs.SD) [pdf, other]

Title: The MIDI Degradation Toolkit: Symbolic Music Augmentation and Correction

Andrew McLeod, James Owers, Kazuyoshi Yoshii

Comments: Authors 1 and 2 contributed equally to this work. Accepted by International Society for Music Information Retrieval Conference (ISMIR), 2020

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[129] arXiv:2010.00475 (cross-list from cs.SD) [pdf, other]

Title: FSD50K: An Open Dataset of Human-Labeled Sound Events

Eduardo Fonseca, Xavier Favory, Jordi Pons, Frederic Font, Xavier Serra

Comments: Accepted version in TASLP. Main updates include: estimation of the amount of label noise in FSD50K, SNR comparison between FSD50K and AudioSet, improved description of evaluation metrics including equations, clarification of experimental methodology and some results, some content moved to Appendix for readability. this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[130] arXiv:2010.00823 (cross-list from cs.SD) [pdf, other]

Title: Deep Composer Classification Using Symbolic Representation

Sunghyeon Kim, Hyeyoon Lee, Sunjong Park, Jinho Lee, Keunwoo Choi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[131] arXiv:2010.01440 (cross-list from cs.LG) [pdf, other]

Title: Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia

Utkarsh Sarawgi, Wazeer Zulfikar, Rishab Khincha, Pattie Maes

Comments: To appear at NeurIPS Machine Learning for Health (ML4H) 2020

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[132] arXiv:2010.01569 (cross-list from cs.HC) [pdf, other]

Title: A Course on Controllers

Bill Verplank, Craig Sapp, Max Mathews

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[133] arXiv:2010.01570 (cross-list from cs.HC) [pdf, other]

Title: Problems and Prospects for Intimate Musical Control of Computers

David Wessel, Matthew Wright

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[134] arXiv:2010.01571 (cross-list from cs.HC) [pdf, other]

Title: Input Devices for Musical Expression: Borrowing Tools from HCI

Nicola Orio, Norbert Schnell, Marcelo M. Wanderley

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[135] arXiv:2010.01572 (cross-list from cs.SD) [pdf, other]

Title: Resonant Processing of Instrumental Sound Controlled by Spatial Position

Camille Goudeseune, Guy Garnett, Timothy Johnson

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[136] arXiv:2010.01574 (cross-list from cs.HC) [pdf, other]

Title: The Accordiatron: A MIDI Controller For Interactive Music

Michael Gurevich, Stephan von Muehlen

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[137] arXiv:2010.01575 (cross-list from cs.HC) [pdf, other]

Title: Tangible Music Interfaces Using Passive Magnetic Tags

Joseph A. Paradiso, Kai-yuh Hsiao, Ari Benbasat

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[138] arXiv:2010.01576 (cross-list from cs.HC) [pdf, other]

Title: Body, Clothes, Water, and Toys: Media Towards Natural Music Expressions with Digital Sounds

Kenji Mase, Tomoko Yonezawa

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[139] arXiv:2010.01577 (cross-list from cs.HC) [pdf, other]

Title: The MATRIX: A Novel Controller for Musical Expression

Dan Overholt

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[140] arXiv:2010.01578 (cross-list from cs.HC) [pdf, other]

Title: Creating Contexts of Creativity: Musical Composition with Modular Components

Gideon D'Arcangelo

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[141] arXiv:2010.01579 (cross-list from cs.HC) [pdf, other]

Title: New Musical Interfaces and New Music-making Paradigms

Sergi Jordà

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[142] arXiv:2010.01703 (cross-list from cs.SD) [pdf, other]

Title: Multi-microphone Complex Spectral Mapping for Utterance-wise and Continuous Speech Separation

Zhong-Qiu Wang, Peidong Wang, DeLiang Wang

Comments: 14 pages, 6 figures. To appear in IEEE/ACM Transactions on Audio, Speech, and Language Processing. Sound demo this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[143] arXiv:2010.01815 (cross-list from cs.SD) [pdf, other]

Title: High-resolution Piano Transcription with Pedals by Regressing Onset and Offset Times

Qiuqiang Kong, Bochen Li, Xuchen Song, Yuan Wan, Yuxuan Wang

Comments: 12 pages

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[144] arXiv:2010.02207 (cross-list from cs.HC) [pdf, other]

Title: The Interactive Dance Club: Avoiding Chaos In A Multi Participant Environment

Ryan Ulyate, David Bianciardi

Comments: Proceedings of the International Conference on New Interfaces for Musical Expression, 2001

Subjects: Human-Computer Interaction (cs.HC); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[145] arXiv:2010.02417 (cross-list from cs.LG) [pdf, other]

Title: Pay Attention to the cough: Early Diagnosis of COVID-19 using Interpretable Symptoms Embeddings with Cough Sound Signal Processing

Ankit Pal, Malaikannan Sankarasubbu

Comments: Preprint Version

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[146] arXiv:2010.02806 (cross-list from cs.CL) [pdf, other]

Title: Textual Supervision for Visually Grounded Spoken Language Understanding

Bertrand Higy, Desmond Elliott, Grzegorz Chrupała

Comments: Findings of EMNLP 2020

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[147] arXiv:2010.02977 (cross-list from cs.SD) [pdf, html, other]

Title: VoiceGrad: Non-Parallel Any-to-Many Voice Conversion with Annealed Langevin Dynamics

Hirokazu Kameoka, Takuhiro Kaneko, Kou Tanaka, Nobukatsu Hojo, Shogo Seki

Comments: For more details on the baseline method used for comparison, please refer to our article in arXiv:2008.12604

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[148] arXiv:2010.03136 (cross-list from cs.SD) [pdf, other]

Title: Improving the efficiency of spectral features extraction by structuring the audio files

Dishant Parikh, Saurabh Sachdev

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[149] arXiv:2010.03164 (cross-list from cs.SD) [pdf, other]

Title: Adversarial attacks on audio source separation

Naoya Takahashi, Shota Inoue, Yuki Mitsufuji

Comments: Accepted at ICASSP 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[150] arXiv:2010.03190 (cross-list from cs.SD) [pdf, other]

Title: Generative Melody Composition with Human-in-the-Loop Bayesian Optimization

Yijun Zhou, Yuki Koyama, Masataka Goto, Takeo Igarashi

Comments: 10 pages, 2 figures, Proceedings of the 2020 Joint Conference on AI Music Creativity (CSMC-MuMe 2020)

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)