Sound

Authors and titles for August 2023

[51] arXiv:2308.09454 [pdf, other]

Title: Exploring Sampling Techniques for Generating Melodies with a Transformer Language Model

Mathias Rose Bjare, Stefan Lattner, Gerhard Widmer

Comments: 7 pages, 5 figures, 1 table, accepted at the 24th Int. Society for Music Information Retrieval Conf., Milan, Italy, 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[52] arXiv:2308.09514 [pdf, other]

Title: Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning

Miguel Sarabia, Elena Menyaylenko, Alessandro Toso, Skyler Seto, Zakaria Aldeneh, Shadi Pirhosseinloo, Luca Zappella, Barry-John Theobald, Nicholas Apostoloff, Jonathan Sheaffer

Journal-ref: Proceedings of INTERSPEECH (2023), pp. 3724-3728

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[53] arXiv:2308.09944 [pdf, html, other]

Title: Spatial Reconstructed Local Attention Res2Net with F0 Subband for Fake Speech Detection

Cunhang Fan, Jun Xue, Jianhua Tao, Jiangyan Yi, Chenglong Wang, Chengshi Zheng, Zhao Lv

Comments: Accept by Neural Networks

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[54] arXiv:2308.10388 [pdf, other]

Title: Neural Architectures Learning Fourier Transforms, Signal Processing and Much More....

Prateek Verma

Comments: 12 pages, 6 figures. Technical Report at Stanford University; Presented on 14th August 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[55] arXiv:2308.10415 [pdf, other]

Title: TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition

Hakan Erdogan, Scott Wisdom, Xuankai Chang, Zalán Borsos, Marco Tagliasacchi, Neil Zeghidour, John R. Hershey

Comments: INTERSPEECH 2023, project webpage with audio demos at this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[56] arXiv:2308.10543 [pdf, other]

Title: An Anchor-Point Based Image-Model for Room Impulse Response Simulation with Directional Source Radiation and Sensor Directivity Patterns

Chao Pan, Lei Zhang, Yilong Lu, Jilu Jin, Lin Qiu, Jingdong Chen, Jacob Benesty

Comments: 19 pages, 8 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[57] arXiv:2308.10682 [pdf, other]

Title: LibriWASN: A Data Set for Meeting Separation, Diarization, and Recognition with Asynchronous Recording Devices

Joerg Schmalenstroeer, Tobias Gburrek, Reinhold Haeb-Umbach

Comments: Accepted for presentation at the ITG conference on Speech Communication 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[58] arXiv:2308.11084 [pdf, other]

Title: PMVC: Data Augmentation-Based Prosody Modeling for Expressive Voice Conversion

Yimin Deng, Huaizhen Tang, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by the 31st ACM International Conference on Multimedia (MM2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[59] arXiv:2308.11241 [pdf, other]

Title: An Effective Transformer-based Contextual Model and Temporal Gate Pooling for Speaker Identification

Harunori Kawano, Sota Shimizu

Comments: 5 pages, 3 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[60] arXiv:2308.11276 [pdf, other]

Title: Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning

Shansong Liu, Atin Sakkeer Hussain, Chenshuo Sun, Ying Shan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[61] arXiv:2308.11380 [pdf, html, other]

Title: Convoifilter: A case study of doing cocktail party speech recognition

Thai-Binh Nguyen, Alexander Waibel

Comments: Accepted at HSCMA 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[62] arXiv:2308.11456 [pdf, other]

Title: Deep learning-based denoising streamed from mobile phones improves speech-in-noise understanding for hearing aid users

Peter Udo Diehl, Hannes Zilly, Felix Sattler, Yosef Singer, Kevin Kepp, Mark Berry, Henning Hasemann, Marlene Zippel, Müge Kaya, Paul Meyer-Rachner, Annett Pudszuhn, Veit M. Hofmann, Matthias Vormann, Elias Sprengel

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[63] arXiv:2308.11530 [pdf, html, other]

Title: Leveraging Language Model Capabilities for Sound Event Detection

Hualei Wang, Jianguo Mao, Zhifang Guo, Jiarui Wan, Hong Liu, Xiangdong Wang

Comments: 5 pages, 4 figures, accept by interspeech2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[64] arXiv:2308.11800 [pdf, other]

Title: Complex-valued neural networks for voice anti-spoofing

Nicolas M. Müller, Philip Sperl, Konstantin Böttinger

Comments: Interspeech 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[65] arXiv:2308.11940 [pdf, html, other]

Title: Audio Generation with Multiple Conditional Diffusion Model

Zhifang Guo, Jianguo Mao, Rui Tao, Long Yan, Kazushige Ouchi, Hong Liu, Xiangdong Wang

Comments: Accepted by AAAI 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[66] arXiv:2308.11957 [pdf, other]

Title: CED: Consistent ensemble distillation for audio tagging

Heinrich Dinkel, Yongqing Wang, Zhiyong Yan, Junbo Zhang, Yujun Wang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2308.12307 [pdf, other]

Title: Modeling Bends in Popular Music Guitar Tablatures

Alexandre D'Hooge, Louis Bigo, Ken Déguernel

Journal-ref: 24th International Society for Music Information Retrieval Conference, International Society for Music Information Retrieval, Nov 2023, Milan, Italy

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[68] arXiv:2308.12408 [pdf, other]

Title: An Initial Exploration: Learning to Generate Realistic Audio for Silent Video

Matthew Martel, Jackson Wagner

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[69] arXiv:2308.12478 [pdf, other]

Title: Attention-Based Acoustic Feature Fusion Network for Depression Detection

Xiao Xu, Yang Wang, Xinru Wei, Fei Wang, Xizhe Zhang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[70] arXiv:2308.12599 [pdf, other]

Title: Exploiting Time-Frequency Conformers for Music Audio Enhancement

Yunkee Chae, Junghyun Koo, Sungho Lee, Kyogu Lee

Comments: Accepted by ACM Multimedia 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[71] arXiv:2308.12615 [pdf, other]

Title: Naaloss: Rethinking the objective of speech enhancement

Kuan-Hsun Ho, En-Lun Yu, Jeih-weih Hung, Berlin Chen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[72] arXiv:2308.12688 [pdf, other]

Title: Whombat: An open-source annotation tool for machine learning development in bioacoustics

Santiago Martinez Balvanera, Oisin Mac Aodha, Matthew J. Weldy, Holly Pringle, Ella Browning, Kate E. Jones

Comments: 17 pages, 2 figures, 2 tables, to be submitted to Methods in Ecology and Evolution

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2308.12734 [pdf, other]

Title: Real-time Detection of AI-Generated Speech for DeepFake Voice Conversion

Jordan J. Bird, Ahmad Lotfi

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[74] arXiv:2308.12770 [pdf, html, other]

Title: WavMark: Watermarking for Audio Generation

Guangyu Chen, Yu Wu, Shujie Liu, Tao Liu, Xiaoyong Du, Furu Wei

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[75] arXiv:2308.12792 [pdf, other]

Title: Sparks of Large Audio Models: A Survey and Outlook

Siddique Latif, Moazzam Shoukat, Fahad Shamshad, Muhammad Usama, Yi Ren, Heriberto Cuayáhuitl, Wenwu Wang, Xulong Zhang, Roberto Togneri, Erik Cambria, Björn W. Schuller

Comments: Under review, Repo URL: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[76] arXiv:2308.12859 [pdf, other]

Title: Towards Automated Animal Density Estimation with Acoustic Spatial Capture-Recapture

Yuheng Wang, Juan Ye, David L. Borchers

Comments: 35 pages, 5 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Methodology (stat.ME)

[77] arXiv:2308.12882 [pdf, html, other]

Title: LCANets++: Robust Audio Classification using Multi-layer Neural Networks with Lateral Competition

Sayanton V. Dibbo, Juston S. Moore, Garrett T. Kenyon, Michael A. Teti

Comments: Accepted at 2024 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops (ICASSPW)

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[78] arXiv:2308.12982 [pdf, other]

Title: A Survey of AI Music Generation Tools and Models

Yueyue Zhu, Jared Baca, Banafsheh Rekabdar, Reza Rawassizadeh

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[79] arXiv:2308.13007 [pdf, other]

Title: Generalizable Zero-Shot Speaker Adaptive Speech Synthesis with Disentangled Representations

Wenbin Wang, Yang Song, Sanjay Jha

Comments: 5 pages, 3 figures. Accepted by Interspeech 2023, Oral

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[80] arXiv:2308.13201 [pdf, other]

Title: Deep Active Audio Feature Learning in Resource-Constrained Environments

Md Mohaimenuzzaman, Christoph Bergmeir, Bernd Meyer

Journal-ref: IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 32, 2024

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[81] arXiv:2308.13365 [pdf, html, other]

Title: Expressive paragraph text-to-speech synthesis with multi-step variational autoencoder

Xuyuan Li, Zengqiang Shang, Peiyang Shi, Hua Hua, Ta Li, Pengyuan Zhang

Comments: accepted at Interspeech 2024

Journal-ref: Proceedings of Interspeech 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[82] arXiv:2308.13736 [pdf, other]

Title: A Comprehensive Survey for Evaluation Methodologies of AI-Generated Music

Zeyu Xiong, Weitao Wang, Jing Yu, Yue Lin, Ziyan Wang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[83] arXiv:2308.13941 [pdf, other]

Title: A small vocabulary database of ultrasound image sequences of vocal tract dynamics

Margareth Castillo, Felipe Rubio, Dagoberto Porras, Sonia H. Contreras-Ortiz, Alexander Sepúlveda

Journal-ref: STSIVA-2019, Bucaramanga, Colombia, 2019

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[84] arXiv:2308.14059 [pdf, other]

Title: Multi-Subdomain Adversarial Network for Cross-Subject EEG-based Emotion Recognition

Guang Lin, Jianhai Zhang

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[85] arXiv:2308.14063 [pdf, other]

Title: Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds

Hejing Zhang, Jian Guan, Qiaoxi Zhu, Feiyang Xiao, Youde Liu

Comments: Published in INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[86] arXiv:2308.14317 [pdf, other]

Title: Symbolic & Acoustic: Multi-domain Music Emotion Modeling for Instrumental Music

Kexin Zhu, Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by 19th International Conference on Advanced Data Mining and Applications. (ADMA 2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[87] arXiv:2308.14319 [pdf, other]

Title: Voice Conversion with Denoising Diffusion Probabilistic GAN Models

Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by 19th International Conference on Advanced Data Mining and Applications. (ADMA 2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[88] arXiv:2308.14360 [pdf, html, other]

Title: InstructME: An Instruction Guided Music Edit And Remix Framework with Latent Diffusion Models

Bing Han, Junyu Dai, Weituo Hao, Xinyan He, Dong Guo, Jitong Chen, Yuxuan Wang, Yanmin Qian, Xuchen Song

Comments: Demo samples are available at this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[89] arXiv:2308.14568 [pdf, other]

Title: Time-Frequency Transformer: A Novel Time Frequency Joint Learning Method for Speech Emotion Recognition

Yong Wang, Cheng Lu, Yuan Zong, Hailun Lian, Yan Zhao, Sunan Li

Comments: Accepted by International Conference on Neural Information Processing (ICONIP2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[90] arXiv:2308.14909 [pdf, other]

Title: Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech

Hyungchan Yoon, Changhwan Kim, Eunwoo Song, Hyun-Wook Yoon, Hong-Goo Kang

Comments: INTERSPEECH 2023

Journal-ref: Proc. INTERSPEECH 2023, 4299-4303

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[91] arXiv:2308.14970 [pdf, other]

Title: Audio Deepfake Detection: A Survey

Jiangyan Yi, Chenglong Wang, Jianhua Tao, Xiaohui Zhang, Chu Yuan Zhang, Yan Zhao

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2308.15422 [pdf, other]

Title: A Review of Differentiable Digital Signal Processing for Music & Speech Synthesis

Ben Hayes, Jordie Shier, György Fazekas, Andrew McPherson, Charalampos Saitis

Comments: Under review for Frontiers in Signal Processing

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[93] arXiv:2308.15726 [pdf, other]

Title: AGS: An Dataset and Taxonomy for Domestic Scene Sound Event Recognition

Nan Che, Chenrui Liu, Fei Yu

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[94] arXiv:2308.15742 [pdf, other]

Title: ASTER: Automatic Speech Recognition System Accessibility Testing for Stutterers

Yi Liu, Yuekang Li, Gelei Deng, Felix Juefei-Xu, Yao Du, Cen Zhang, Chengwei Liu, Yeting Li, Lei Ma, Yang Liu

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Software Engineering (cs.SE); Audio and Speech Processing (eess.AS)

[95] arXiv:2308.15990 [pdf, other]

Title: Dual-path Transformer Based Neural Beamformer for Target Speech Extraction

Aoqi Guo, Sichong Qian, Baoxiang Li, Dazhi Gao

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[96] arXiv:2308.16021 [pdf, other]

Title: CALM: Contrastive Cross-modal Speaking Style Modeling for Expressive Text-to-Speech Synthesis

Yi Meng, Xiang Li, Zhiyong Wu, Tingtian Li, Zixun Sun, Xinyu Xiao, Chi Sun, Hui Zhan, Helen Meng

Comments: Accepted by InterSpeech 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2308.16177 [pdf, other]

Title: General Purpose Audio Effect Removal

Matthew Rice, Christian J. Steinmetz, George Fazekas, Joshua D. Reiss

Comments: Preprint. Accepted to IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[98] arXiv:2308.16389 [pdf, html, other]

Title: The Biased Journey of MSD_AUDIO.ZIP

Haven Kim, Keunwoo Choi, Mateusz Modrzejewski, Cynthia C. S. Liem

Comments: Late-breaking/Demo ISMIR 2023

Subjects: Sound (cs.SD); Computers and Society (cs.CY); Audio and Speech Processing (eess.AS)

[99] arXiv:2308.16421 [pdf, other]

Title: Sequential Pitch Distributions for Raga Detection

Vishwaas Narasinh, Senthil Raja G

Comments: 16 pages, 6 figures, AI Music Creativity

Journal-ref: AIMC 2023. Retrieved from https://aimc2023.pubpub.org/pub/j9v30p0j

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[100] arXiv:2308.16569 [pdf, other]

Title: LightGrad: Lightweight Diffusion Probabilistic Model for Text-to-Speech

Jie Chen, Xingchen Song, Zhendong Peng, Binbin Zhang, Fuping Pan, Zhiyong Wu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)