Sound

Authors and titles for May 2024

[1] arXiv:2405.00233 [pdf, html, other]

Title: SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound

Haohe Liu, Xuenan Xu, Yi Yuan, Mengyue Wu, Wenwu Wang, Mark D. Plumbley

Comments: Accepted by Journal of Selected Topics in Signal Processing (JSTSP). Demo and code: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[2] arXiv:2405.00248 [pdf, html, other]

Title: Who is Authentic Speaker

Qiang Huang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[3] arXiv:2405.00307 [pdf, other]

Title: Active Learning with Task Adaptation Pre-training for Speech Emotion Recognition

Dongyuan Li, Ying Zhang, Yusong Wang, Funakoshi Kataro, Manabu Okumura

Comments: Accepted by Journal of Natural Language Processing. arXiv admin note: text overlap with arXiv:2310.00283

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[4] arXiv:2405.00603 [pdf, html, other]

Title: Learning Expressive Disentangled Speech Representations with Soft Speech Units and Adversarial Style Augmentation

Yimin Deng, Jianzong Wang, Xulong Zhang, Ning Cheng, Jing Xiao

Comments: Accepted by the 2024 International Joint Conference on Neural Networks (IJCNN 2024)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[5] arXiv:2405.00930 [pdf, html, other]

Title: MAIN-VC: Lightweight Speech Representation Disentanglement for One-shot Voice Conversion

Pengcheng Li, Jianzong Wang, Xulong Zhang, Yong Zhang, Jing Xiao, Ning Cheng

Comments: Accepted by the 2024 International Joint Conference on Neural Networks (IJCNN 2024)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[6] arXiv:2405.01004 [pdf, other]

Title: Deep Learning Models in Speech Recognition: Measuring GPU Energy Consumption, Impact of Noise and Model Quantization for Edge Deployment

Aditya Chakravarty

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[7] arXiv:2405.01242 [pdf, html, other]

Title: TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms

Yueyuan Sui, Minghui Zhao, Junxi Xia, Xiaofan Jiang, Stephen Xia

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[8] arXiv:2405.01815 [pdf, html, other]

Title: Toward end-to-end interpretable convolutional neural networks for waveform signals

Linh Vu, Thu Tran, Wern-Han Lim, Raphael Phan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[9] arXiv:2405.01988 [pdf, html, other]

Title: Joint sentiment analysis of lyrics and audio in music

Lea Schaab, Anna Kruspe

Comments: published at DAGA 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[10] arXiv:2405.02119 [pdf, other]

Title: EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments

Denise Moussa, Germans Hirsch, Christian Riess

Comments: Accepted at TIFS

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[11] arXiv:2405.02132 [pdf, html, other]

Title: Unveiling the Potential of LLM-Based ASR on Chinese Open-Source Datasets

Xuelong Geng, Tianyi Xu, Kun Wei, Bingshen Mu, Hongfei Xue, He Wang, Yangze Li, Pengcheng Guo, Yuhang Dai, Longhao Li, Mingchen Shao, Lei Xie

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[12] arXiv:2405.02151 [pdf, html, other]

Title: GMP-TL: Gender-augmented Multi-scale Pseudo-label Enhanced Transfer Learning for Speech Emotion Recognition

Yu Pan, Yuguang Yang, Heng Lu, Lei Ma, Jianjun Zhao

Comments: Accepted to SLT2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[13] arXiv:2405.02179 [pdf, html, other]

Title: Training-Free Deepfake Voice Recognition by Leveraging Large-Scale Pre-Trained Models

Alessandro Pianese, Davide Cozzolino, Giovanni Poggi, Luisa Verdoliva

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[14] arXiv:2405.02333 [pdf, other]

Title: Speech Technology Services for Oral History Research

Christoph Draxler, Henk van den Heuvel, Arjan van Hessen, Pavel Ircing, Jan Lehečka

Comments: 5 pages plus references, 3 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[15] arXiv:2405.02675 [pdf, html, other]

Title: Quranic Audio Dataset: Crowdsourced and Labeled Recitation from Non-Arabic Speakers

Raghad Salameh, Mohamad Al Mdfaa, Nursultan Askarbekuly, Manuel Mazzara

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[16] arXiv:2405.02801 [pdf, html, other]

Title: Mozart's Touch: A Lightweight Multi-modal Music Generation Framework Based on Pre-Trained Large Models

Jiajun Li, Tianze Xu, Xuesong Chen, Xinrui Yao, Shuchang Liu

Comments: 10 pages, 2 figures, submitted to AIGC 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[17] arXiv:2405.02821 [pdf, html, other]

Title: Sim2Real Transfer for Audio-Visual Navigation with Frequency-Adaptive Acoustic Field Prediction

Changan Chen, Jordi Ramos, Anshul Tomar, Kristen Grauman

Comments: Camera ready version for IROS 2024. Project page: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO); Audio and Speech Processing (eess.AS)

[18] arXiv:2405.02991 [pdf, html, other]

Title: Steered Response Power for Sound Source Localization: A Tutorial Review

Eric Grinstein, Elisa Tengan, Bilgesu Çakmak, Thomas Dietzen, Leonardo Nunes, Toon van Waterschoot, Mike Brookes, Patrick A. Naylor

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[19] arXiv:2405.02996 [pdf, html, other]

Title: RepAugment: Input-Agnostic Representation-Level Augmentation for Respiratory Sound Classification

June-Woo Kim, Miika Toikkanen, Sangmin Bae, Minseok Kim, Ho-Young Jung

Comments: Accepted EMBC 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[20] arXiv:2405.03118 [pdf, html, other]

Title: Determined Multichannel Blind Source Separation with Clustered Source Model

Jianyu Wang, Shanzheng Guan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[21] arXiv:2405.03178 [pdf, html, other]

Title: POPDG: Popular 3D Dance Generation with PopDanceSet

Zhenye Luo, Min Ren, Xuecai Hu, Yongzhen Huang, Li Yao

Comments: Accepted by IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[22] arXiv:2405.03322 [pdf, html, other]

Title: Enhancing Aeroacoustic Wind Tunnel Studies through Massive Channel Upscaling with MEMS Microphones

Daniel Ernst, Armin Goudarzi, Reinhard Geisler, Florian Philipp, Thomas Ahlefeldt, Carsten Spehr

Comments: 30th AIAA/CEAS Aeroacoustics Conference

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Instrumentation and Detectors (physics.ins-det)

[23] arXiv:2405.03385 [pdf, other]

Title: Fully Reversing the Shoebox Image Source Method: From Impulse Responses to Room Parameters

Tom Sprunck (IRMA, MACARON), Antoine Deleforge (IRMA, MACARON), Yannick Privat (IECL, SPHINX, IUF), Cédric Foy (UMRAE, Cerema Direction Est)

Journal-ref: IEEE transactions on acoustics, speech, and signal processing, 2025, 33, pp.1022-1033

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP); Classical Physics (physics.class-ph)

[24] arXiv:2405.03484 [pdf, html, other]

Title: Whispy: Adapting STT Whisper Models to Real-Time Environments

Antonio Bevilacqua, Paolo Saviano, Alessandro Amirante, Simon Pietro Romano

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[25] arXiv:2405.03567 [pdf, html, other]

Title: Deep Space Separable Distillation for Lightweight Acoustic Scene Classification

ShuQi Ye, Yuan Tian

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[26] arXiv:2405.03952 [pdf, html, other]

Title: HAFFormer: A Hierarchical Attention-Free Framework for Alzheimer's Disease Detection From Spontaneous Speech

Zhongren Dong, Zixing Zhang, Weixiang Xu, Jing Han, Jianjun Ou, Björn W. Schuller

Journal-ref: publised at ICASSP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[27] arXiv:2405.03953 [pdf, html, other]

Title: Intelligent Cardiac Auscultation for Murmur Detection via Parallel-Attentive Models with Uncertainty Estimation

Zixing Zhang, Tao Pang, Jing Han, Björn W. Schuller

Journal-ref: published at ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[28] arXiv:2405.03956 [pdf, html, other]

Title: Adaptive Speech Emotion Representation Learning Based On Dynamic Graph

Yingxue Gao, Huan Zhao, Zixing Zhang

Journal-ref: published at ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[29] arXiv:2405.04124 [pdf, html, other]

Title: Comparative Study of State-based Neural Networks for Virtual Analog Audio Effects Modeling

Riccardo Simionato, Stefano Fasciani

Comments: Submitted to EURASIP Journal on Audio, Speech, and Music Processing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI)

[30] arXiv:2405.04181 [pdf, html, other]

Title: Detecting music deepfakes is easy but actually hard

Darius Afchar, Gabriel Meseguer-Brocal, Romain Hennequin

Comments: Under review

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[31] arXiv:2405.04471 [pdf, html, other]

Title: Universal Spatial Audio Transcoder

Amaia Sagasti, Davide Scaini, Daniel Arteaga

Comments: 12 pages, 8 figures. Accepted for presentation at the AES 156th Convention, Madrid, Spain (June 2024)

Journal-ref: Audio Engineering Society 156th Convention, Madrid (2024). https://aes2.org/publications/elibrary-page/?id=22517

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[32] arXiv:2405.04880 [pdf, html, other]

Title: The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio

Yuankun Xie, Yi Lu, Ruibo Fu, Zhengqi Wen, Zhiyong Wang, Jianhua Tao, Xin Qi, Xiaopeng Wang, Yukun Liu, Haonan Cheng, Long Ye, Yi Sun

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[33] arXiv:2405.05126 [pdf, html, other]

Title: Exploring Speech Pattern Disorders in Autism using Machine Learning

Chuanbo Hu, Jacob Thrasher, Wenqi Li, Mindi Ruan, Xiangxu Yu, Lynn K Paul, Shuo Wang, Xin Li

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[34] arXiv:2405.05240 [pdf, other]

Title: An LSTM-Based Chord Generation System Using Chroma Histogram Representations

Jack Hardwick

Comments: 6 pages, 4 figures, 1 table

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[35] arXiv:2405.05467 [pdf, html, other]

Title: AFEN: Respiratory Disease Classification using Ensemble Learning

Rahul Nadkarni, Emmanouil Nikolakakis, Razvan Marinescu

Comments: Under Review Process for MLForHC 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[36] arXiv:2405.05498 [pdf, html, other]

Title: The RoyalFlush Automatic Speech Diarization and Recognition System for In-Car Multi-Channel Automatic Speech Recognition Challenge

Jingguang Tian, Shuaishuai Ye, Shunfei Chen, Yang Xiang, Zhaohui Yin, Xinhui Hu, Xinkang Xu

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[37] arXiv:2405.06289 [pdf, html, other]

Title: Look Once to Hear: Target Speech Hearing with Noisy Examples

Bandhav Veluri, Malek Itani, Tuochao Chen, Takuya Yoshioka, Shyamnath Gollakota

Comments: Best paper honorable mention at CHI 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[38] arXiv:2405.06573 [pdf, html, other]

Title: An Investigation of Incorporating Mamba for Speech Enhancement

Rong Chao, Wen-Huang Cheng, Moreno La Quatra, Sabato Marco Siniscalchi, Chao-Han Huck Yang, Szu-Wei Fu, Yu Tsao

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[39] arXiv:2405.06747 [pdf, html, other]

Title: Music Emotion Prediction Using Recurrent Neural Networks

Xinyu Chang, Xiangyu Zhang, Haoruo Zhang, Yulu Ran

Comments: 15 pages, 13 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[40] arXiv:2405.06804 [pdf, html, other]

Title: Time-of-arrival Estimation and Phase Unwrapping of Head-related Transfer Functions With Integer Linear Programming

Chin-Yun Yu, Johan Pauwels, György Fazekas

Comments: Published at Audio Engineering Society 156th Convention, 2024 June, Madrid, Spain

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[41] arXiv:2405.06995 [pdf, html, other]

Title: Benchmarking Cross-Domain Audio-Visual Deception Detection

Xiaobao Guo, Zitong Yu, Nithish Muthuchamy Selvaraj, Bingquan Shen, Adams Wai-Kin Kong, Alex C. Kot

Comments: 12 pages

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[42] arXiv:2405.07029 [pdf, other]

Title: A framework of text-dependent speaker verification for chinese numerical string corpus

Litong Zheng, Feng Hong, Weijie Xu, Wan Zheng

Comments: arXiv admin note: text overlap with arXiv:2312.01645

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[43] arXiv:2405.07034 [pdf, other]

Title: Towards an Accessible and Rapidly Trainable Rhythm Sequencer Using a Generative Stacked Autoencoder

Alex Wastnidge

Comments: 7 pages, 7 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[44] arXiv:2405.07354 [pdf, html, other]

Title: SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset

Sushant Gautam, Mehdi Houshmand Sarkhoosh, Jan Held, Cise Midoglu, Anthony Cioppa, Silvio Giancola, Vajira Thambawita, Michael A. Riegler, Pål Halvorsen, Mubarak Shah

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[45] arXiv:2405.07442 [pdf, other]

Title: Rene: A Pre-trained Multi-modal Architecture for Auscultation of Respiratory Diseases

Pengfei Zhang, Zhihang Zheng, Shichen Zhang, Minghao Yang, Shaojun Tang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Quantitative Methods (q-bio.QM)

[46] arXiv:2405.07682 [pdf, html, other]

Title: FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generation

Jianyi Chen, Wei Xue, Xu Tan, Zhen Ye, Qifeng Liu, Yike Guo

Comments: IJCAI 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[47] arXiv:2405.08021 [pdf, html, other]

Title: Diff-ETS: Learning a Diffusion Probabilistic Model for Electromyography-to-Speech Conversion

Zhao Ren, Kevin Scheck, Qinhan Hou, Stefano van Gogh, Michael Wand, Tanja Schultz

Comments: Accepted by EMBC 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[48] arXiv:2405.08342 [pdf, other]

Title: Abnormal Respiratory Sound Identification Using Audio-Spectrogram Vision Transformer

Whenty Ariyanti, Kai-Chun Liu, Kuan-Yu Chen, Yu Tsao

Comments: Published in 2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)

Journal-ref: 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (2023) 1-4

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[49] arXiv:2405.08596 [pdf, html, other]

Title: Towards Robust Audio Deepfake Detection: A Evolving Benchmark for Continual Learning

Xiaohui Zhang, Jiangyan Yi, Jianhua Tao

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[50] arXiv:2405.08679 [pdf, html, other]

Title: Investigating Design Choices in Joint-Embedding Predictive Architectures for General Audio Representation Learning

Alain Riou, Stefan Lattner, Gaëtan Hadjeres, Geoffroy Peeters

Comments: Self-supervision in Audio, Speech and Beyond workshop, IEEE International Conference on Acoustics, Speech, and Signal Processing, 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[51] arXiv:2405.08838 [pdf, html, other]

Title: PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset

Yang Hou, Haitao Fu, Chuankai Chen, Zida Li, Haoyu Zhang, Jianjun Zhao

Comments: 13 page, 4 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[52] arXiv:2405.09062 [pdf, html, other]

Title: Naturalistic Music Decoding from EEG Data via Latent Diffusion Models

Emilian Postolache, Natalia Polouliakh, Hiroaki Kitano, Akima Connelly, Emanuele Rodolà, Luca Cosmo, Taketo Akama

Comments: Accepted at ICASSP-25

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[53] arXiv:2405.09171 [pdf, html, other]

Title: Hierarchical Emotion Prediction and Control in Text-to-Speech Synthesis

Sho Inoue, Kun Zhou, Shuai Wang, Haizhou Li

Comments: This is accepted to IEEE ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[54] arXiv:2405.09224 [pdf, html, other]

Title: Perception-Inspired Graph Convolution for Music Understanding Tasks

Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer

Comments: Accepted at the 33rd International Joint Conference on Artificial Intelligence (IJCAI-24)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[55] arXiv:2405.09241 [pdf, html, other]

Title: SMUG-Explain: A Framework for Symbolic Music Graph Explanations

Emmanouil Karystinaios, Francesco Foscarin, Gerhard Widmer

Comments: In Proceedings of the Sound and Music Computing Conference 2024 (SMC2024), Porto, Portugal

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[56] arXiv:2405.09470 [pdf, html, other]

Title: Towards Evaluating the Robustness of Automatic Speech Recognition Systems via Audio Style Transfer

Weifei Jin, Yuxin Cao, Junjie Su, Qi Shen, Kai Ye, Derui Wang, Jie Hao, Ziyao Liu

Comments: Accepted to SecTL (AsiaCCS Workshop) 2024

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[57] arXiv:2405.09901 [pdf, html, other]

Title: Whole-Song Hierarchical Generation of Symbolic Music Using Cascaded Diffusion Models

Ziyu Wang, Lejun Min, Gus Xia

Comments: Proceedings of the International Conference on Learning Representations (ICLR 2024)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[58] arXiv:2405.10211 [pdf, html, other]

Title: Building a Luganda Text-to-Speech Model From Crowdsourced Data

Sulaiman Kagumire, Andrew Katumba, Joyce Nakatumba-Nabende, John Quinn

Comments: Presented at the AfricaNLP workshop at ICLR 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[59] arXiv:2405.11554 [pdf, html, other]

Title: DAC-JAX: A JAX Implementation of the Descript Audio Codec

David Braun

Comments: 5 pages, 3 figures, 2 tables

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2405.12031 [pdf, html, other]

Title: Neighborhood Attention Transformer with Progressive Channel Fusion for Speaker Verification

Nian Li, Jianguo Wei

Comments: 8 pages, 2 figures, 3 tables; added github link

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[61] arXiv:2405.12666 [pdf, html, other]

Title: SYMPLEX: Controllable Symbolic Music Generation using Simplex Diffusion with Vocabulary Priors

Nicolas Jonason, Luca Casini, Bob L.T. Sturm

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[62] arXiv:2405.12957 [pdf, html, other]

Title: Enhancing the analysis of murine neonatal ultrasonic vocalizations: Development, evaluation, and application of different mathematical models

Rudolf Herdt, Louisa Kinzel, Johann Georg Maaß, Marvin Walther, Henning Fröhlich, Tim Schubert, Peter Maass, Christian Patrick Schaaf

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[63] arXiv:2405.13162 [pdf, other]

Title: Non-autoregressive real-time Accent Conversion model with voice cloning

Vladimir Nechaev, Sergey Kosyakov

Comments: 8 pages, 6 figures, 3 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[64] arXiv:2405.13428 [pdf, html, other]

Title: Ambisonizer: Neural Upmixing as Spherical Harmonics Generation

Yongyi Zang, Yifan Wang, Minglun Lee

Comments: Under review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[65] arXiv:2405.13527 [pdf, html, other]

Title: End-to-End Real-World Polyphonic Piano Audio-to-Score Transcription with Hierarchical Decoding

Wei Zeng, Xian He, Ye Wang

Comments: 8 pages, 5 figures, accepted by IJCAI 2024 - AI, Arts & Creativity Track

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[66] arXiv:2405.13636 [pdf, html, other]

Title: Audio Mamba: Pretrained Audio State Space Model For Audio Tagging

Jiaju Lin, Haoxuan Hu

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[67] arXiv:2405.13661 [pdf, html, other]

Title: Timbre Perception, Representation, and its Neuroscientific Exploration: A Comprehensive Review

Hong Zhang, Jie Lin, Shengxuan Chen

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2405.14290 [pdf, html, other]

Title: Frequency-Domain Sound Field from the Perspective of Band-Limited Functions

Takahiro Iwami, Akira Omoto

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[69] arXiv:2405.14489 [pdf, html, other]

Title: End-to-End User-Defined Keyword Spotting using Shifted Delta Coefficients

Kesavaraj V, Anuprabha M, Anil Kumar Vuppala

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[70] arXiv:2405.14679 [pdf, html, other]

Title: Leveraging Real Electric Guitar Tones and Effects to Improve Robustness in Guitar Tablature Transcription Modeling

Hegel Pedroza, Wallace Abreu, Ryan Corey, Iran Roman

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[71] arXiv:2405.15096 [pdf, html, other]

Title: Music Genre Classification: Training an AI model

Keoikantse Mogonediwa

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[72] arXiv:2405.15103 [pdf, html, other]

Title: The Rarity of Musical Audio Signals Within the Space of Possible Audio Generation

Nick Collins

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[73] arXiv:2405.15338 [pdf, html, other]

Title: SoundLoCD: An Efficient Conditional Discrete Contrastive Latent Diffusion Model for Text-to-Sound Generation

Xinlei Niu, Jing Zhang, Christian Walder, Charles Patrick Martin

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[74] arXiv:2405.15655 [pdf, html, other]

Title: HiddenSpeaker: Generate Imperceptible Unlearnable Audios for Speaker Verification System

Zhisheng Zhang, Pengyang Huang

Comments: Accepted by IJCNN 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[75] arXiv:2405.15863 [pdf, html, other]

Title: QA-MDT: Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

Chang Li, Ruoyu Wang, Lijuan Liu, Jun Du, Yixuan Sun, Zilu Guo, Zhenrong Zhang, Yuan Jiang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[76] arXiv:2405.16000 [pdf, html, other]

Title: Carnatic Raga Identification System using Rigorous Time-Delay Neural Network

Sanjay Natesan, Homayoon Beigi

Comments: 7 pages, 2 tables, 3 figures

Journal-ref: Recognition Technologies, Inc. Technical Report (2024), RTI-20240524-01

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[77] arXiv:2405.16687 [pdf, html, other]

Title: Reconstructing the Charlie Parker Omnibook using an audio-to-score automatic transcription pipeline

Xavier Riley, Simon Dixon

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[78] arXiv:2405.16797 [pdf, other]

Title: A Real-Time Voice Activity Detection Based On Lightweight Neural

Jidong Jia, Pei Zhao, Di Wang

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[79] arXiv:2405.17028 [pdf, html, other]

Title: RSET: Remapping-based Sorting Method for Emotion Transfer Speech Synthesis

Haoxiang Shi, Jianzong Wang, Xulong Zhang, Ning Cheng, Jun Yu, Jing Xiao

Comments: Accepted by the 8th APWeb-WAIM International Joint Conference on Web and Big Data

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2405.17206 [pdf, html, other]

Title: A Novel Fusion Architecture for PD Detection Using Semi-Supervised Speech Embeddings

Tariq Adnan, Abdelrahman Abdelkader, Zipei Liu, Ekram Hossain, Sooyong Park, MD Saiful Islam, Ehsan Hoque

Comments: 31 pages, 6 figures, and 8 tables

Subjects: Sound (cs.SD); Machine Learning (cs.LG)

[81] arXiv:2405.17413 [pdf, other]

Title: Enhancing Music Genre Classification through Multi-Algorithm Analysis and User-Friendly Visualization

Navin Kamuni, Dheerendra Panwar

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[82] arXiv:2405.17615 [pdf, html, other]

Title: Listenable Maps for Zero-Shot Audio Classifiers

Francesco Paissan, Luca Della Libera, Mirco Ravanelli, Cem Subakan

Comments: Accepted to NeurIPS 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[83] arXiv:2405.18153 [pdf, html, other]

Title: A Data-Centric Framework for Machine Listening Projects: Addressing Large-Scale Data Acquisition and Labeling through Active Learning

Javier Naranjo-Alcazar, Jordi Grau-Haro, Ruben Ribes-Serrano, Pedro Zuccarello

Comments: Paper accepted at 8th Future of Information and Communication Conference 2025, 28-29 April, Berlin

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[84] arXiv:2405.18213 [pdf, html, other]

Title: NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fields

Amandine Brunetto, Sascha Hornauer, Fabien Moutarde

Comments: Project Page: this https URL

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[85] arXiv:2405.18386 [pdf, html, other]

Title: Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning

Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A. Martínez-Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon

Comments: Code and demo are available at: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[86] arXiv:2405.18503 [pdf, html, other]

Title: SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation

Koichi Saito, Dongjun Kim, Takashi Shibuya, Chieh-Hsin Lai, Zhi Zhong, Yuhta Takida, Yuki Mitsufuji

Comments: Audio samples: this https URL. Codes: this https URL. Checkpoints: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[87] arXiv:2405.18726 [pdf, html, other]

Title: Reverse the auditory processing pathway: Coarse-to-fine audio reconstruction from fMRI

Che Liu, Changde Du, Xiaoyu Chen, Huiguang He

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[88] arXiv:2405.19342 [pdf, html, other]

Title: Sonos Voice Control Bias Assessment Dataset: A Methodology for Demographic Bias Assessment in Voice Assistants

Chloé Sekkat, Fanny Leroy, Salima Mdhaffar, Blake Perry Smith, Yannick Estève, Joseph Dureau, Alice Coucke

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[89] arXiv:2405.19343 [pdf, html, other]

Title: Luganda Speech Intent Recognition for IoT Applications

Andrew Katumba, Sudi Murindanyi, John Trevor Kasule, Elvis Mugume

Comments: Presented as a conference paper at ICLR 2024/AfricaNLP

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[90] arXiv:2405.19796 [pdf, html, other]

Title: Explainable Attribute-Based Speaker Verification

Xiaoliang Wu, Chau Luu, Peter Bell, Ajitha Rajan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[91] arXiv:2405.20059 [pdf, html, other]

Title: Spectral Mapping of Singing Voices: U-Net-Assisted Vocal Segmentation

Adam Sorrenti

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[92] arXiv:2405.20101 [pdf, html, other]

Title: Fill in the Gap! Combining Self-supervised Representation Learning with Neural Audio Synthesis for Speech Inpainting

Ihab Asaad, Maxime Jacquelin, Olivier Perrotin, Laurent Girin, Thomas Hueber

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[93] arXiv:2405.20172 [pdf, html, other]

Title: Iterative Feature Boosting for Explainable Speech Emotion Recognition

Alaa Nfissi, Wassim Bouachir, Nizar Bouguila, Brian Mishara

Comments: Published in: 2023 International Conference on Machine Learning and Applications (ICMLA)

Journal-ref: 2023 International Conference on Machine Learning and Applications (ICMLA), Jacksonville, FL, USA, 2023, pp. 543-549

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[94] arXiv:2405.20289 [pdf, html, other]

Title: DITTO-2: Distilled Diffusion Inference-Time T-Optimization for Music Generation

Zachary Novack, Julian McAuley, Taylor Berg-Kirkpatrick, Nicholas Bryan

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[95] arXiv:2405.20884 [pdf, html, other]

Title: Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learning

Brandon Colelough, Andrew Zheng

Comments: 16 pages, 8 pictures, 3 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[96] arXiv:2405.20887 [pdf, html, other]

Title: On the Condition Monitoring of Bolted Joints through Acoustic Emission and Deep Transfer Learning: Generalization, Ordinal Loss and Super-Convergence

Emmanuel Ramasso, Rafael de O. Teloli, Romain Marcel

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[97] arXiv:2405.00367 (cross-list from cs.IR) [pdf, other]

Title: Distance Sampling-based Paraphraser Leveraging ChatGPT for Text Data Manipulation

Yoori Oh, Yoseob Han, Kyogu Lee

Comments: Accepted at SIGIR 2024 short paper track

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[98] arXiv:2405.00384 (cross-list from cs.CV) [pdf, html, other]

Title: Visual and audio scene classification for detecting discrepancies in video: a baseline method and experimental protocol

Konstantinos Apostolidis, Jakob Abesser, Luca Cuccovillo, Vasileios Mezaris

Comments: Accepted for publication, 3rd ACM Int. Workshop on Multimedia AI against Disinformation (MAD'24) at ACM ICMR'24, June 10, 2024, Phuket, Thailand. This is the "accepted version"

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[99] arXiv:2405.00934 (cross-list from eess.AS) [pdf, html, other]

Title: Benchmarking Representations for Speech, Music, and Acoustic Events

Moreno La Quatra, Alkis Koudounas, Lorenzo Vaiani, Elena Baralis, Luca Cagliero, Paolo Garza, Sabato Marco Siniscalchi

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Sound (cs.SD)

[100] arXiv:2405.00966 (cross-list from cs.CL) [pdf, html, other]

Title: Efficient Compression of Multitask Multilingual Speech Models

Thomas Palmeira Ferraz

Comments: Master Thesis

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)