Sound

Authors and titles for June 2023

[51] arXiv:2306.06546 [pdf, other]

Title: High-Fidelity Audio Compression with Improved RVQGAN

Rithesh Kumar, Prem Seetharaman, Alejandro Luebs, Ishaan Kumar, Kundan Kumar

Comments: Accepted at NeurIPS 2023 (spotlight)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[52] arXiv:2306.06652 [pdf, other]

Title: Audio-Visual Mandarin Electrolaryngeal Speech Voice Conversion

Yung-Lun Chien, Hsin-Hao Chen, Ming-Chi Yen, Shu-Wei Tsai, Hsin-Min Wang, Yu Tsao, Tai-Shih Chi

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[53] arXiv:2306.06653 [pdf, other]

Title: Mandarin Electrolaryngeal Speech Voice Conversion using Cross-domain Features

Hsin-Hao Chen, Yung-Lun Chien, Ming-Chi Yen, Shu-Wei Tsai, Yu Tsao, Tai-shih Chi, Hsin-Min Wang

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[54] arXiv:2306.06760 [pdf, other]

Title: Estimating the Uncertainty in Emotion Attributes using Deep Evidential Regression

Wen Wu, Chao Zhang, Philip C. Woodland

Comments: Accepted by ACL 2023

Journal-ref: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[55] arXiv:2306.06945 [pdf, html, other]

Title: Underwater Acoustic Target Recognition based on Smoothness-inducing Regularization and Spectrogram-based Data Augmentation

Ji Xu, Yuan Xie, Wenchao Wang

Journal-ref: Ocean Engineering, 2023, 281: 114926

Subjects: Sound (cs.SD); Machine Learning (cs.LG)

[56] arXiv:2306.07547 [pdf, html, other]

Title: UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding

Chenpeng Du, Yiwei Guo, Feiyu Shen, Zhijun Liu, Zheng Liang, Xie Chen, Shuai Wang, Hui Zhang, Kai Yu

Comments: Accepted to AAAI 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[57] arXiv:2306.07744 [pdf, other]

Title: Contrastive Learning-Based Audio to Lyrics Alignment for Multiple Languages

Simon Durand, Daniel Stoller, Sebastian Ewert

Comments: 5 pages, accepted at the International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2023

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 2023, pp. 1-5

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[58] arXiv:2306.07791 [pdf, other]

Title: Unlocking Foundation Models for Privacy-Enhancing Speech Understanding: An Early Study on Low Resource Speech Training Leveraging Label-guided Synthetic Speech Content

Tiantian Feng, Digbalay Bose, Xuan Shi, Shrikanth Narayanan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[59] arXiv:2306.08010 [pdf, other]

Title: Domain Information Control at Inference Time for Acoustic Scene Classification

Shahed Masoudian, Khaled Koutini, Markus Schedl, Gerhard Widmer, Navid Rekabsaz

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[60] arXiv:2306.08012 [pdf, other]

Title: A Novel Scheme to classify Read and Spontaneous Speech

Sunil Kumar Kopparapu

Comments: 14 pages, 8 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[61] arXiv:2306.08329 [pdf, other]

Title: Research on an improved Conformer end-to-end Speech Recognition Model with R-Drop Structure

Weidong Ji, Shijie Zan, Guohui Zhou, Xu Wang

Comments: 15 pages, 9 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[62] arXiv:2306.08454 [pdf, other]

Title: Gesper: A Restoration-Enhancement Framework for General Speech Reconstruction

Wenzhe Liu, Yupeng Shi, Jun Chen, Wei Rao, Shulin He, Andong Li, Yannan Wang, Zhiyong Wu

Comments: Accepted by InterSpeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[63] arXiv:2306.08480 [pdf, other]

Title: Combining piano performance dimensions for score difficulty classification

Pedro Ramoneda, Dasaem Jeong, Vsevolod Eremenko, Nazif Can Tamer, Marius Miron, Xavier Serra

Comments: 36 pages

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[64] arXiv:2306.08620 [pdf, html, other]

Title: Anticipatory Music Transformer

John Thickstun, David Hall, Chris Donahue, Percy Liang

Comments: TMLR accepted version

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[65] arXiv:2306.08845 [pdf, other]

Title: Unsupervised speech intelligibility assessment with utterance level alignment distance between teacher and learner Wav2Vec-2.0 representations

Nayan Anand, Meenakshi Sirigiraju, Chiranjeevi Yarra

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[66] arXiv:2306.08850 [pdf, other]

Title: Exploring Isolated Musical Notes as Pre-training Data for Predominant Instrument Recognition in Polyphonic Music

Lifan Zhong, Erica Cooper, Junichi Yamagishi, Nobuaki Minematsu

Comments: Submitted to APSIPA 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2306.08956 [pdf, other]

Title: Multi-Loss Convolutional Network with Time-Frequency Attention for Speech Enhancement

Liang Wan, Hongqing Liu, Yi Zhou, Jie Ji

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Machine Learning (stat.ML)

[68] arXiv:2306.08998 [pdf, other]

Title: Team AcieLee: Technical Report for EPIC-SOUNDS Audio-Based Interaction Recognition Challenge 2023

Yuqi Li, Yizhi Luo, Xiaoshuai Hao, Chuanguang Yang, Zhulin An, Dantong Song, Wei Yi

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[69] arXiv:2306.09025 [pdf, other]

Title: CoverHunter: Cover Song Identification with Refined Attention and Alignments

Feng Liu, Deyi Tuo, Yinan Xu, Xintong Han

Comments: 6 pages, 3 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[70] arXiv:2306.09106 [pdf, other]

Title: Audio Tagging on an Embedded Hardware Platform

Gabriel Bibbo, Arshdeep Singh, Mark D. Plumbley

Comments: Submitted to DCASE 2023 Workshop

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[71] arXiv:2306.09126 [pdf, other]

Title: STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

Kazuki Shimada, Archontis Politis, Parthasaarathy Sudarsanam, Daniel Krause, Kengo Uchida, Sharath Adavanne, Aapo Hakala, Yuichiro Koyama, Naoya Takahashi, Shusuke Takahashi, Tuomas Virtanen, Yuki Mitsufuji

Comments: 27 pages, 9 figures, accepted for publication in NeurIPS 2023 Track on Datasets and Benchmarks

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[72] arXiv:2306.09223 [pdf, other]

Title: Few-shot bioacoustic event detection at the DCASE 2023 challenge

Ines Nolasco, Burooj Ghani, Shubhr Singh, Ester Vidaña-Vila, Helen Whitehead, Emily Grout, Michael Emmerson, Frants Jensen, Ivan Kiskin, Joe Morford, Ariana Strandburg-Peshkin, Lisa Gill, Hanna Pamuła, Vincent Lostanlen, Dan Stowell

Comments: submitted to DCASE 2023 workshop

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[73] arXiv:2306.09382 [pdf, other]

Title: Sound Demixing Challenge 2023 Music Demixing Track Technical Report: TFC-TDF-UNet v3

Minseok Kim, Jun Hyung Lee, Soonyoung Jung

Comments: 5 pages, 4 tables

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[74] arXiv:2306.09517 [pdf, other]

Title: Competitive and Resource Efficient Factored Hybrid HMM Systems are Simpler Than You Think

Tina Raissi, Christoph Lüscher, Moritz Gunz, Ralf Schlüter, Hermann Ney

Comments: Accepted for presentation at InterSpeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[75] arXiv:2306.09635 [pdf, other]

Title: CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Models

Hao-Wen Dong, Xiaoyu Liu, Jordi Pons, Gautam Bhattacharya, Santiago Pascual, Joan Serrà, Taylor Berg-Kirkpatrick, Julian McAuley

Comments: Accepted by WASPAA 2023. Demo: this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[76] arXiv:2306.09906 [pdf, other]

Title: Correlation Clustering of Bird Sounds

David Stein, Bjoern Andres

Comments: 13 pages

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[77] arXiv:2306.09944 [pdf, other]

Title: RealImpact: A Dataset of Impact Sound Fields for Real Objects

Samuel Clarke, Ruohan Gao, Mason Wang, Mark Rau, Julia Xu, Jui-Hsien Wang, Doug L. James, Jiajun Wu

Comments: CVPR 2023 (Highlight). Project page: this https URL

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Audio and Speech Processing (eess.AS)

[78] arXiv:2306.09979 [pdf, other]

Title: Evaluation of Speech Representations for MOS prediction

Frederico S. Oliveira, Edresson Casanova, Arnaldo Cândido Júnior, Lucas R. S. Gris, Anderson S. Soares, Arlindo R. Galvão Filho

Comments: 12 pages, 4 figures, Accepted to the 26th International Conference of Text, Speech and Dialogue (TSD2023)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[79] arXiv:2306.10091 [pdf, other]

Title: Acoustic Identification of Ae. aegypti Mosquitoes using Smartphone Apps and Residual Convolutional Neural Networks

Kayuã Oleques Paim, Ricardo Rohweder, Mariana Recamonde-Mendoza, Rodrigo Brandão Mansilha1, Weverton Cordeiro

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[80] arXiv:2306.10093 [pdf, other]

Title: Musico-acoustic Depictions of Laminar and Turbulent Flows in Ligeti Piano Etude No. 9 and a Novel Method of Analysis

Noah Chuipka

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS); Fluid Dynamics (physics.flu-dyn)

[81] arXiv:2306.10240 [pdf, other]

Title: Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separation

Yoshiaki Bando, Yoshiki Masuyama, Aditya Arie Nugraha, Kazuyoshi Yoshii

Comments: 5 pages, 2 figures, accepted to EUSIPCO 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[82] arXiv:2306.10359 [pdf, other]

Title: Text-Driven Foley Sound Generation With Latent Diffusion Model

Yi Yuan, Haohe Liu, Xubo Liu, Xiyuan Kang, Peipei Wu, Mark D. Plumbley, Wenwu Wang

Comments: Submit to DCASE-workshop 2023, an extension and supersedes the previous technical report arXiv:2305.15905

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[83] arXiv:2306.10493 [pdf, other]

Title: MOSPC: MOS Prediction Based on Pairwise Comparison

Kexin Wang, Yunlong Zhao, Qianqian Dong, Tom Ko, Mingxuan Wang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[84] arXiv:2306.10548 [pdf, other]

Title: MARBLE: Music Audio Representation Benchmark for Universal Evaluation

Ruibin Yuan, Yinghao Ma, Yizhi Li, Ge Zhang, Xingran Chen, Hanzhi Yin, Le Zhuo, Yiqi Liu, Jiawen Huang, Zeyue Tian, Binyue Deng, Ningzhi Wang, Chenghua Lin, Emmanouil Benetos, Anton Ragni, Norbert Gyenge, Roger Dannenberg, Wenhu Chen, Gus Xia, Wei Xue, Si Liu, Shi Wang, Ruibo Liu, Yike Guo, Jie Fu

Comments: camera-ready version for NeurIPS 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[85] arXiv:2306.10684 [pdf, other]

Title: Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding

Zengjie Song, Zhaoxiang Zhang

Comments: Accepted to IEEE Transactions on Neural Networks and Learning Systems (T-NNLS)

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[86] arXiv:2306.10718 [pdf, other]

Title: Algorithms of Sampling-Frequency-Independent Layers for Non-integer Strides

Kanami Imamura, Tomohiko Nakamura, Norihiro Takamune, Kohei Yatabe, Hiroshi Saruwatari

Comments: 5 pages, 3 figures, accepted for European Signal Processing Conference 2023 (EUSIPCO 2023)

Journal-ref: European Signal Processing Conference, Sep. 2023, pp. 326--330

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[87] arXiv:2306.10772 [pdf, other]

Title: Learning an Interpretable End-to-End Network for Real-Time Acoustic Beamforming

Hao Liang, Guanxing Zhou, Xiaotong Tu, Andreas Jakobsson, Xinghao Ding, Yue Huang

Comments: 12 pages, 9 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[88] arXiv:2306.10785 [pdf, other]

Title: Multitrack Music Transcription with a Time-Frequency Perceiver

Wei-Tsung Lu, Ju-Chiang Wang, Yun-Ning Hung

Comments: ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[89] arXiv:2306.10843 [pdf, html, other]

Title: Female mosquito detection by means of AI techniques inside release containers in the context of a Sterile Insect Technique program

Javier Naranjo-Alcazar, Jordi Grau-Haro, David Almenar, Pedro Zuccarello

Comments: Accepted EUSIPCO 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[90] arXiv:2306.10886 [pdf, other]

Title: Vocal Timbre Effects with Differentiable Digital Signal Processing

David Südholt, Cumhur Erkut

Comments: Accepted for publication in Proc DAFx 2023, Copenhagen, Denmark. Sound Examples: this https URL Code: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[91] arXiv:2306.11277 [pdf, other]

Title: Frequency & Channel Attention for Computationally Efficient Sound Event Detection

Hyeonuk Nam, Seong-Hu Kim, Deokki Min, Yong-Hwa Park

Comments: Accepted to DCASE 2023 workshop

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2306.11282 [pdf, other]

Title: Phase Repair for Time-Domain Convolutional Neural Networks in Music Super-Resolution

Yenan Zhang, Guilly Kolkman, Hiroshi Watanabe

Comments: Under review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[93] arXiv:2306.11309 [pdf, other]

Title: Multi-pass Training and Cross-information Fusion for Low-resource End-to-end Accented Speech Recognition

Xuefei Wang, Yanhua Long, Yijie Li, Haoran Wei

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[94] arXiv:2306.11389 [pdf, other]

Title: Pipeline for recording datasets and running neural networks on the Bela embedded hardware platform

Teresa Pelinski, Rodrigo Diaz, Adán L. Benito Temprano, Andrew McPherson

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[95] arXiv:2306.11629 [pdf, other]

Title: Sound reconstruction from human brain activity via a generative model with brain-like auditory features

Jong-Yun Park, Mitsuaki Tsukamoto, Misato Tanaka, Yukiyasu Kamitani

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[96] arXiv:2306.12249 [pdf, other]

Title: Knowledge-based Multimodal Music Similarity

Andrea Poltronieri

Comments: 11 pages, 1 figure

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[97] arXiv:2306.12259 [pdf, other]

Title: Automatic Speech Disentanglement for Voice Conversion using Rank Module and Speech Augmentation

Zhonghua Liu, Shijun Wang, Ning Chen

Comments: Accepted by INTERSPEECH2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[98] arXiv:2306.12300 [pdf, other]

Title: A Multimodal Prototypical Approach for Unsupervised Sound Classification

Saksham Singh Kushwaha, Magdalena Fuentes

Comments: Accepted to INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[99] arXiv:2306.12714 [pdf, other]

Title: Toward Leveraging Pre-Trained Self-Supervised Frontends for Automatic Singing Voice Understanding Tasks: Three Case Studies

Yuya Yamamoto

Comments: Accepted at APSIPA ASC 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[100] arXiv:2306.12785 [pdf, other]

Title: MFCCGAN: A Novel MFCC-Based Speech Synthesizer Using Adversarial Learning

Mohammad Reza Hasanabadi Majid Behdad Davood Gharavian

Comments: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)