Sound

Authors and titles for June 2023

[101] arXiv:2306.12789 [pdf, other]

Title: Russian assimilatory palatalization is incomplete neutralization

Sejin Oh, Jason A. Shaw, Karthik Durvasula, Alexei Kochotov

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[102] arXiv:2306.12820 [pdf, other]

Title: NoisyILRMA: Diffuse-Noise-Aware Independent Low-Rank Matrix Analysis for Fast Blind Source Extraction

Koki Nishida, Norihiro Takamune, Rintaro Ikeshita, Daichi Kitamura, Hiroshi Saruwatari, Tomohiro Nakatani

Comments: 5 pages, 3 figures, accepted for European Signal Processing Conference 2023 (EUSIPCO 2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[103] arXiv:2306.12957 [pdf, other]

Title: Siamese SIREN: Audio Compression with Implicit Neural Representations

Luca A. Lanzendörfer, Roger Wattenhofer

Comments: Published as a workshop paper at ICML 2023 neural compression workshop

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[104] arXiv:2306.13512 [pdf, other]

Title: DISCO-10M: A Large-Scale Music Dataset

Luca A. Lanzendörfer, Florian Grötschla, Emil Funke, Roger Wattenhofer

Comments: NeurIPS 2023 Track on Datasets and Benchmarks

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[105] arXiv:2306.13691 [pdf, other]

Title: Modulation Graphs in Popular Music

Jason I. Brown, Ian George

Comments: 17 pages, 6 figures, 6 tables

Subjects: Sound (cs.SD)

[106] arXiv:2306.13863 [pdf, other]

Title: Improving End-to-End Neural Diarization Using Conversational Summary Representations

Samuel J. Broughton, Lahiru Samarakoon

Comments: 5 pages, 1 figure, INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[107] arXiv:2306.13953 [pdf, other]

Title: An Analysis of Personalized Speech Recognition System Development for the Deaf and Hard-of-Hearing

Lester Phillip Violeta, Tomoki Toda

Comments: Submitted to APSIPA 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[108] arXiv:2306.14145 [pdf, other]

Title: DSE-TTS: Dual Speaker Embedding for Cross-Lingual Text-to-Speech

Sen Liu, Yiwei Guo, Chenpeng Du, Xie Chen, Kai Yu

Comments: Accepted to Interspeech 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[109] arXiv:2306.14191 [pdf, other]

Title: PrimaDNN': A Characteristics-aware DNN Customization for Singing Technique Detection

Yuya Yamamoto, Juhan Nam, Hiroko Terasawa

Comments: Accepted at EUSIPCO 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[110] arXiv:2306.14276 [pdf, other]

Title: Aeroacoustic Source Localization

Weicheng Xue, Bing Yang, Shaohong Jia

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[111] arXiv:2306.14422 [pdf, other]

Title: The Singing Voice Conversion Challenge 2023

Wen-Chin Huang, Lester Phillip Violeta, Songxiang Liu, Jiatong Shi, Tomoki Toda

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[112] arXiv:2306.14647 [pdf, other]

Title: Mono-to-stereo through parametric stereo generation

Joan Serrà, Davide Scaini, Santiago Pascual, Daniel Arteaga, Jordi Pons, Jeroen Breebaart, Giulio Cengarle

Comments: 7 pages, 1 figure; accepted for ISMIR23

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[113] arXiv:2306.14929 [pdf, other]

Title: A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomalies

Dat Ngo, Lam Pham, Huy Phan, Minh Tran, Delaram Jarchi

Comments: arXiv admin note: text overlap with arXiv:2303.04104

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[114] arXiv:2306.15212 [pdf, other]

Title: TranssionADD: A multi-frame reinforcement based sequence tagging model for audio deepfake detection

Jie Liu, Zhiba Su, Hui Huang, Caiyan Wan, Quanxiu Wang, Jiangli Hong, Benlai Tang, Fengjie Zhu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[115] arXiv:2306.15389 [pdf, other]

Title: Multi-perspective Information Fusion Res2Net with RandomSpecmix for Fake Speech Detection

Shunbo Dong, Jun Xue, Cunhang Fan, Kang Zhu, Yujie Chen, Zhao Lv

Comments: Accepted by DADA2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[116] arXiv:2306.15412 [pdf, other]

Title: RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music

Haojie Wei, Xueke Cao, Tangpeng Dan, Yueguo Chen

Comments: This paper has been accepted by INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[117] arXiv:2306.15464 [pdf, other]

Title: Large-scale unsupervised audio pre-training for video-to-speech synthesis

Triantafyllos Kefalas, Yannis Panagakis, Maja Pantic

Comments: Corrected typos. This work has been submitted to the IEEE for possible publication

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[118] arXiv:2306.15875 [pdf, other]

Title: Fake the Real: Backdoor Attack on Deep Speech Classification via Voice Conversion

Zhe Ye, Terui Mao, Li Dong, Diqun Yan

Comments: Accepted by INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, pp. 4923-4927

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[119] arXiv:2306.15942 [pdf, other]

Title: Enhanced Neural Beamformer with Spatial Information for Target Speech Extraction

Aoqi Guo, Junnan Wu, Peng Gao, Wenbo Zhu, Qinwen Guo, Dazhi Gao, Yujun Wang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[120] arXiv:2306.16022 [pdf, html, other]

Title: Enrollment-stage Backdoor Attacks on Speaker Recognition Systems via Adversarial Ultrasound

Xinfeng Li, Junning Ze, Chen Yan, Yushi Cheng, Xiaoyu Ji, Wenyuan Xu

Comments: Published in Internet of Things Journal (IoT-J)

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Audio and Speech Processing (eess.AS)

[121] arXiv:2306.16054 [pdf, other]

Title: Improving Primate Sounds Classification using Binary Presorting for Deep Learning

Michael Kölle, Steffen Illium, Maximilian Zorn, Jonas Nüßlein, Patrick Suchostawski, Claudia Linnhoff-Popien

Comments: DeLTA

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[122] arXiv:2306.16081 [pdf, other]

Title: Graph neural networks for sound source localization on distributed microphone networks

Eric Grinstein, Mike Brookes, Patrick A. Naylor

Comments: Presented as a poster at ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[123] arXiv:2306.16083 [pdf, other]

Title: UnitSpeech: Speaker-adaptive Speech Synthesis with Untranscribed Data

Heeseung Kim, Sungwon Kim, Jiheum Yeom, Sungroh Yoon

Comments: INTERSPEECH 2023, Oral

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[124] arXiv:2306.16241 [pdf, other]

Title: Focus on the Sound around You: Monaural Target Speaker Extraction via Distance and Speaker Information

Jiuxin Lin, Peng Wang, Heinrich Dinkel, Jun Chen, Zhiyong Wu, Zhiyong Yan, Yongqing Wang, Junbo Zhang, Yujun Wang

Comments: Proc. INTERSPEECH 2023, 2488-2492, doi: https://doi.org/10.21437/Interspeech.2023-218

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[125] arXiv:2306.16250 [pdf, other]

Title: MC-SpEx: Towards Effective Speaker Extraction with Multi-Scale Interfusion and Conditional Speaker Modulation

Jun Chen, Wei Rao, Zilin Wang, Jiuxin Lin, Yukai Ju, Shulin He, Yannan Wang, Zhiyong Wu

Comments: Accepted by InterSpeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[126] arXiv:2306.16398 [pdf, other]

Title: Cascaded encoders for fine-tuning ASR models on overlapped speech

Richard Rose, Oscar Chang, Olivier Siohan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[127] arXiv:2306.16760 [pdf, other]

Title: Transfer Learning with Semi-Supervised Dataset Annotation for Birdcall Classification

Anthony Miyaguchi, Nathan Zhong, Murilo Gustineli, Chris Hayduk

Comments: BirdCLEF working note submission to Multimedia Retrieval in Nature (LifeCLEF) for CLEF 2023

Journal-ref: CEUR-WS Vol-3497 (2023) 2091-2106

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[128] arXiv:2306.16955 [pdf, other]

Title: Predicting Music Hierarchies with a Graph-Based Neural Decoder

Francesco Foscarin, Daniel Harasim, Gerhard Widmer

Comments: To be published in the Proceedings of the International Society for Music Information Retrieval Conference (ISMIR)

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[129] arXiv:2306.16962 [pdf, other]

Title: Speech-based Age and Gender Prediction with Transformers

Felix Burkhardt, Johannes Wagner, Hagen Wierstorf, Florian Eyben, Björn Schuller

Comments: 5 pages, submitted to 15th ITG Conference on Speech Communication

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[130] arXiv:2306.16967 [pdf, other]

Title: On the relevance of acoustic measurements for creating realistic virtual acoustic environments

Siegfried Gündert, Stephan D. Ewert, Steven van de Par

Comments: This work has been submitted to the I3DA 2023 International Conference (IEEE Xplore Digital Library) for possible publication

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Medical Physics (physics.med-ph)

[131] arXiv:2306.17203 [pdf, other]

Title: Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models

Simian Luo, Chuanhao Yan, Chenxu Hu, Hang Zhao

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[132] arXiv:2306.17424 [pdf, other]

Title: Audio Embeddings as Teachers for Music Classification

Yiwei Ding, Alexander Lerch

Comments: Accepted at the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), 9 pages, 2 figures

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[133] arXiv:2306.17477 [pdf, html, other]

Title: Beyond-Voice: Towards Continuous 3D Hand Pose Tracking on Commercial Home Assistant Devices

Yin Li, Rohan Reddy, Cheng Zhang, Rajalakshmi Nandakumar

Comments: Accepted by IPSN 2024

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[134] arXiv:2306.17500 [pdf, other]

Title: Empirical Interpretation of the Relationship Between Speech Acoustic Context and Emotion Recognition

Anna Ollerenshaw, Md Asif Jalal, Rosanna Milner, Thomas Hain

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[135] arXiv:2306.00044 (cross-list from cs.LG) [pdf, other]

Title: How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning

Hye-jin Shim, Rosa González Hautamäki, Md Sahidullah, Tomi Kinnunen

Comments: Interspeech 2023

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[136] arXiv:2306.00160 (cross-list from eess.AS) [pdf, other]

Title: Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Model

Héctor Martel, Julius Richter, Kai Li, Xiaolin Hu, Timo Gerkmann

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[137] arXiv:2306.00208 (cross-list from cs.CL) [pdf, other]

Title: Strategies for improving low resource speech to text translation relying on pre-trained ASR models

Santosh Kesiraju, Marek Sarvas, Tomas Pavlicek, Cecile Macaire, Alejandro Ciuba

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[138] arXiv:2306.00281 (cross-list from cs.LG) [pdf, other]

Title: Transfer Learning for Underrepresented Music Generation

Anahita Doosti, Matthew Guzdial

Comments: 5 pages, 3 figures, International Conference on Computational Creativity

Journal-ref: Proceedings of the 2023 International Conference on Computational Creativity

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[139] arXiv:2306.00331 (cross-list from eess.AS) [pdf, other]

Title: A Multi-dimensional Deep Structured State Space Approach to Speech Enhancement Using Small-footprint Models

Pin-Jui Ku, Chao-Han Huck Yang, Sabato Marco Siniscalchi, Chin-Hui Lee

Comments: Accepted to Interspeech 2023. Code will be released at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Sound (cs.SD); Signal Processing (eess.SP); Systems and Control (eess.SY)

[140] arXiv:2306.00410 (cross-list from cs.CL) [pdf, other]

Title: Towards hate speech detection in low-resource languages: Comparing ASR to acoustic word embeddings on Wolof and Swahili

Christiaan Jacobs, Nathanaël Carraz Rakotonirina, Everlyn Asiko Chimoto, Bruce A. Bassett, Herman Kamper

Comments: Accepted to Interspeech 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[141] arXiv:2306.00426 (cross-list from eess.AS) [pdf, other]

Title: Speaker verification using attentive multi-scale convolutional recurrent network

Yanxiong Li, Zhongjie Jiang, Wenchang Cao, Qisheng Huang

Comments: 21 pages, 6 figures, 8 tables. Accepted for publication in Applied Soft Computing

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[142] arXiv:2306.00482 (cross-list from cs.CY) [pdf, other]

Title: Inspecting Spoken Language Understanding from Kids for Basic Math Learning at Home

Eda Okur, Roddy Fuentes Alba, Saurav Sahay, Lama Nachman

Comments: Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA) at ACL 2023

Subjects: Computers and Society (cs.CY); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS); History and Overview (math.HO)

[143] arXiv:2306.00634 (cross-list from eess.AS) [pdf, other]

Title: A Teacher-Student approach for extracting informative speaker embeddings from speech mixtures

Tobias Cord-Landwehr, Christoph Boeddeker, Cătălin Zorilă, Rama Doddipatla, Reinhold Haeb-Umbach

Comments: Proceedings of INTERSPEECH

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[144] arXiv:2306.00736 (cross-list from eess.AS) [pdf, other]

Title: Spoken Language Identification System for English-Mandarin Code-Switching Child-Directed Speech

Shashi Kant Gupta, Sushant Hiray, Prashant Kukde

Comments: Accepted by Interspeech 2023, 5 pages, 1 figure, 4 tables

Journal-ref: Proc. INTERSPEECH 2023, 4114--4118

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[145] arXiv:2306.00755 (cross-list from cs.CL) [pdf, other]

Title: Enhancing the Unified Streaming and Non-streaming Model with Contrastive Learning

Yuting Yang, Yuke Li, Binbin Du

Comments: Accepted by INTERSPEECH 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[146] arXiv:2306.00812 (cross-list from eess.AS) [pdf, other]

Title: Harmonic enhancement using learnable comb filter for light-weight full-band speech enhancement model

Xiaohuai Le, Tong Lei, Li Chen, Yiqing Guo, Chao He, Cheng Chen, Xianjun Xia, Hua Gao, Yijian Xiao, Piao Ding, Shenyi Song, Jing Lu

Comments: accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Sound (cs.SD)

[147] arXiv:2306.00952 (cross-list from eess.AS) [pdf, other]

Title: Meta-Learning Framework for End-to-End Imposter Identification in Unseen Speaker Recognition

Ashutosh Chaubey, Sparsh Sinha, Susmita Ghose

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[148] arXiv:2306.00996 (cross-list from eess.AS) [pdf, other]

Title: Weakly-supervised forced alignment of disfluent speech using phoneme-level modeling

Theodoros Kouzelis, Georgios Paraskevopoulos, Athanasios Katsamanis, Vassilis Katsouros

Comments: Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[149] arXiv:2306.00998 (cross-list from eess.AS) [pdf, other]

Title: Towards Selection of Text-to-speech Data to Augment ASR Training

Shuo Liu, Leda Sarı, Chunyang Wu, Gil Keren, Yuan Shangguan, Jay Mahadeokar, Ozlem Kalinli

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[150] arXiv:2306.01002 (cross-list from eess.AS) [pdf, other]

Title: Adaptive ship-radiated noise recognition with learnable fine-grained wavelet transform

Yuan Xie, Jiawei Ren, Ji Xu

Journal-ref: Ocean Engineering 265 (2022): 112626

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)