Sound

Authors and titles for September 2023

[51] arXiv:2309.06141 [pdf, other]

Title: SynVox2: Towards a privacy-friendly VoxCeleb2 dataset

Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi, Nicholas Evans, Massimiliano Todisco, Jean-François Bonastre, Mickael Rouvier

Comments: conference

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[52] arXiv:2309.06649 [pdf, other]

Title: Differentiable Modelling of Percussive Audio with Transient and Spectral Synthesis

Jordie Shier, Franco Caspe, Andrew Robertson, Mark Sandler, Charalampos Saitis, Andrew McPherson

Comments: To be published in The Proceedings of Forum Acusticum, Sep 2023, Turin, Italy

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[53] arXiv:2309.06672 [pdf, other]

Title: Attention-based Encoder-Decoder End-to-End Neural Diarization with Embedding Enhancer

Zhengyang Chen, Bing Han, Shuai Wang, Yanmin Qian

Comments: IEEE/ACM Transactions on Audio Speech and Language Processing Under Review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[54] arXiv:2309.06723 [pdf, other]

Title: PIAVE: A Pose-Invariant Audio-Visual Speaker Extraction Network

Qinghua Liu, Meng Ge, Zhizheng Wu, Haizhou Li

Comments: Interspeech 2023

Journal-ref: Proc. INTERSPEECH 2023, 3719-3723

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[55] arXiv:2309.06780 [pdf, html, other]

Title: Distinguishing Neural Speech Synthesis Models Through Fingerprints in Speech Waveforms

Chu Yuan Zhang, Jiangyan Yi, Jianhua Tao, Chenglong Wang, Xinrui Yan

Comments: Accepted by CCL 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[56] arXiv:2309.06787 [pdf, other]

Title: DCTTS: Discrete Diffusion Model with Contrastive Learning for Text-to-speech Generation

Zhichao Wu, Qiulin Li, Sixing Liu, Qun Yang

Comments: 5 pages, submitted to ICASSP

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[57] arXiv:2309.06858 [pdf, html, other]

Title: EMALG: An Enhanced Mandarin Lombard Grid Corpus with Meaningful Sentences

Baifeng Li, Qingmu Liu, Yuhong Yang, Hongyang Chen, Weiping Tu, Song Lin

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[58] arXiv:2309.07115 [pdf, html, other]

Title: Getting More for Less: Using Weak Labels and AV-Mixup for Robust Audio-Visual Speaker Verification

Anith Selvakumar, Homa Fashandi

Comments: Accepted to INTERSPEECH 2024

Journal-ref: Proc. Interspeech 2024, 4728-4732

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[59] arXiv:2309.07195 [pdf, other]

Title: Diffusion models for audio semantic communication

Eleonora Grassucci, Christian Marinoni, Andrea Rodriguez, Danilo Comminiello

Comments: Submitted to IEEE ICASSP 2024

Subjects: Sound (cs.SD); Emerging Technologies (cs.ET); Audio and Speech Processing (eess.AS)

[60] arXiv:2309.07314 [pdf, other]

Title: AudioSR: Versatile Audio Super-resolution at Scale

Haohe Liu, Ke Chen, Qiao Tian, Wenwu Wang, Mark D. Plumbley

Comments: Under review. Demo and code: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[61] arXiv:2309.07391 [pdf, html, other]

Title: EnCodecMAE: Leveraging neural codecs for universal audio representation learning

Leonardo Pepino, Pablo Riera, Luciana Ferrer

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[62] arXiv:2309.07405 [pdf, other]

Title: FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec

Zhihao Du, Shiliang Zhang, Kai Hu, Siqi Zheng

Comments: 5 pages, 3 figures, submitted to ICASSP 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[63] arXiv:2309.07416 [pdf, html, other]

Title: BANC: Towards Efficient Binaural Audio Neural Codec for Overlapping Speech

Anton Ratnarajah, Shi-Xiong Zhang, Dong Yu

Comments: More results and source code are available at this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[64] arXiv:2309.07419 [pdf, other]

Title: Mandarin Lombard Flavor Classification

Qingmu Liu, Yuhong Yang, Baifeng Li, Hongyang Chen, Weiping Tu, Song Lin

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[65] arXiv:2309.07432 [pdf, html, other]

Title: SpatialCodec: Neural Spatial Speech Coding

Zhongweiyang Xu, Yong Xu, Vinay Kothapally, Heming Wang, Muqiao Yang, Dong Yu

Comments: Accepted by ICASSP2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[66] arXiv:2309.07458 [pdf, other]

Title: Analysis of Speech Separation Performance Degradation on Emotional Speech Mixtures

Jia Qi Yip, Dianwen Ng, Bin Ma, Chng Eng Siong

Comments: Accepted by APSIPA ASC 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2309.07500 [pdf, other]

Title: Outlier-aware Inlier Modeling and Multi-scale Scoring for Anomalous Sound Detection via Multitask Learning

Yucong Zhang, Hongbin Suo, Yulong Wan, Ming Li

Comments: accepted at INTERSPEECH 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[68] arXiv:2309.07525 [pdf, html, other]

Title: SingFake: Singing Voice Deepfake Detection

Yongyi Zang, You Zhang, Mojtaba Heydari, Zhiyao Duan

Comments: Accepted at ICASSP 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[69] arXiv:2309.07566 [pdf, html, other]

Title: Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer

Yongqi Wang, Jionghao Bai, Rongjie Huang, Ruiqi Li, Zhiqing Hong, Zhou Zhao

Comments: accepted by ACL SRW 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[70] arXiv:2309.07598 [pdf, other]

Title: AAS-VC: On the Generalization Ability of Automatic Alignment Search based Non-autoregressive Sequence-to-sequence Voice Conversion

Wen-Chin Huang, Kazuhiro Kobayashi, Tomoki Toda

Comments: Submitted to ICASSP 2024. Demo: this https URL. Code: this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[71] arXiv:2309.07615 [pdf, other]

Title: Multilingual Audio Captioning using machine translated data

Matéo Cousin, Étienne Labbé, Thomas Pellegrini

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[72] arXiv:2309.07658 [pdf, other]

Title: DDSP-based Neural Waveform Synthesis of Polyphonic Guitar Performance from String-wise MIDI Input

Nicolas Jonason, Xin Wang, Erica Cooper, Lauri Juvela, Bob L. T. Sturm, Junichi Yamagishi

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2309.07765 [pdf, html, other]

Title: Echotune: A Modular Extractor Leveraging the Variable-Length Nature of Speech in ASR Tasks

Sizhou Chen, Songyang Gao, Sen Fang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[74] arXiv:2309.07861 [pdf, other]

Title: CiwaGAN: Articulatory information exchange

Gašper Beguš, Thomas Lu, Alan Zhou, Peter Wu, Gopala K. Anumanchipalli

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[75] arXiv:2309.08027 [pdf, other]

Title: Comparative Assessment of Markov Models and Recurrent Neural Networks for Jazz Music Generation

Conrad Hsu, Ross Greer

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[76] arXiv:2309.08049 [pdf, html, other]

Title: VoicePAT: An Efficient Open-source Evaluation Toolkit for Voice Privacy Research

Sarina Meyer, Xiaoxiao Miao, Ngoc Thang Vu

Comments: Accepted by OJSP-ICASSP 2024 this https URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[77] arXiv:2309.08051 [pdf, html, other]

Title: Retrieval-Augmented Text-to-Audio Generation

Yi Yuan, Haohe Liu, Xubo Liu, Qiushi Huang, Mark D. Plumbley, Wenwu Wang

Comments: Accepted by ICASSP 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[78] arXiv:2309.08072 [pdf, html, other]

Title: SSL-Net: A Synergistic Spectral and Learning-based Network for Efficient Bird Sound Classification

Yiyuan Yang, Kaichen Zhou, Niki Trigoni, Andrew Markham

Comments: Accepted by IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2024)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[79] arXiv:2309.08099 [pdf, other]

Title: Characterizing the temporal dynamics of universal speech representations for generalizable deepfake detection

Yi Zhu, Saurabh Powar, Tiago H. Falk

Comments: Submitted to ICASSP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[80] arXiv:2309.08108 [pdf, other]

Title: Foundation Model Assisted Automatic Speech Emotion Recognition: Transcribing, Annotating, and Augmenting

Tiantian Feng, Shrikanth Narayanan

Comments: Under review

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[81] arXiv:2309.08127 [pdf, other]

Title: Diversity-based core-set selection for text-to-speech with linguistic and acoustic features

Kentaro Seki, Shinnosuke Takamichi, Takaaki Saeki, Hiroshi Saruwatari

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[82] arXiv:2309.08144 [pdf, other]

Title: Two-Step Knowledge Distillation for Tiny Speech Enhancement

Rayan Daod Nathoo, Mikolaj Kegler, Marko Stamenovic

Comments: Under review ICASSP 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[83] arXiv:2309.08146 [pdf, other]

Title: Syn-Att: Synthetic Speech Attribution via Semi-Supervised Unknown Multi-Class Ensemble of CNNs

Md Awsafur Rahman, Bishmoy Paul, Najibul Haque Sarker, Zaber Ibn Abdul Hakim, Shaikh Anowarul Fattah, Mohammad Saquib

Comments: Winning Solution of IEEE SP Cup at ICASSP 2022

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[84] arXiv:2309.08166 [pdf, html, other]

Title: Residual Speaker Representation for One-Shot Voice Conversion

Le Xu, Jiangyan Yi, Tao Wang, Yong Ren, Rongxiu Zhong, Zhengqi Wen, Jianhua Tao

Comments: Accepted by INTERSPEECH2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[85] arXiv:2309.08200 [pdf, html, other]

Title: TF-SepNet: An Efficient 1D Kernel Design in CNNs for Low-Complexity Acoustic Scene Classification

Yiqiang Cai, Peihong Zhang, Shengchen Li

Comments: Accepted by the 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2024)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[86] arXiv:2309.08208 [pdf, other]

Title: HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methods

Hyun-seo Shin, Jungwoo Heo, Ju-ho Kim, Chan-yeong Lim, Wonbin Kim, Ha-Jin Yu

Comments: Submitted to 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024)

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[87] arXiv:2309.08398 [pdf, html, other]

Title: Exploring Meta Information for Audio-based Zero-shot Bird Classification

Alexander Gebhard, Andreas Triantafyllopoulos, Teresa Bez, Lukas Christ, Alexander Kathan, Björn W. Schuller

Comments: Accepted at ICASSP 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[88] arXiv:2309.08408 [pdf, other]

Title: Audio-Visual Active Speaker Extraction for Sparsely Overlapped Multi-talker Speech

Junjie Li, Ruijie Tao, Zexu Pan, Meng Ge, Shuai Wang, Haizhou Li

Comments: Submitted to ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[89] arXiv:2309.08751 [pdf, html, other]

Title: Diverse Neural Audio Embeddings -- Bringing Features back !

Prateek Verma

Comments: 6 pages, 1 figure, 2 table, Under Review for 50th IEEE ICASSP 2025, Hyderabad, India

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[90] arXiv:2309.08773 [pdf, other]

Title: Enhance audio generation controllability through representation similarity regularization

Yangyang Shi, Gael Le Lan, Varun Nagaraja, Zhaoheng Ni, Xinhao Mei, Ernie Chang, Forrest Iandola, Yang Liu, Vikas Chandra

Comments: 5 pages

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[91] arXiv:2309.08837 [pdf, other]

Title: FastGraphTTS: An Ultrafast Syntax-Aware Speech Synthesis Framework

Jianzong Wang, Xulong Zhang, Aolan Sun, Ning Cheng, Jing Xiao

Comments: Accepted by The 35th IEEE International Conference on Tools with Artificial Intelligence. (ICTAI 2023)

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[92] arXiv:2309.08839 [pdf, other]

Title: Contrastive Latent Space Reconstruction Learning for Audio-Text Retrieval

Kaiyi Luo, Xulong Zhang, Jianzong Wang, Huaxiong Li, Ning Cheng, Jing Xiao

Comments: Accepted by The 35th IEEE International Conference on Tools with Artificial Intelligence. (ICTAI 2023)

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[93] arXiv:2309.08971 [pdf, html, other]

Title: Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detection

Ilyass Moummad, Romain Serizel, Nicolas Farrugia

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[94] arXiv:2309.09075 [pdf, other]

Title: Music Generation based on Generative Adversarial Networks with Transformer

Ziyi Jiang, Ruoxue Wu, Zhenghan Chen, Xiaoxuan Liang

Comments: arXiv admin note: This version has been removed by arXiv administrators due to copyright infringement

Subjects: Sound (cs.SD)

[95] arXiv:2309.09085 [pdf, html, other]

Title: SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription

Yongyi Zang, Yi Zhong, Frank Cwitkowitz, Zhiyao Duan

Comments: Accepted to ICASSP 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[96] arXiv:2309.09088 [pdf, html, other]

Title: Enhancing GAN-Based Vocoders with Contrastive Learning Under Data-limited Condition

Haoming Guo, Seth Z. Zhao, Jiachen Lian, Gopala Anumanchipalli, Gerald Friedland

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2309.09136 [pdf, other]

Title: Enhancing Quantised End-to-End ASR Models via Personalisation

Qiuming Zhao, Guangzhi Sun, Chao Zhang, Mingxing Xu, Thomas Fang Zheng

Comments: 5 pages, submitted to ICASSP 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[98] arXiv:2309.09223 [pdf, html, other]

Title: Zero- and Few-shot Sound Event Localization and Detection

Kazuki Shimada, Kengo Uchida, Yuichiro Koyama, Takashi Shibuya, Shusuke Takahashi, Yuki Mitsufuji, Tatsuya Kawahara

Comments: 5 pages, 4 figures, accepted for publication in IEEE ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[99] arXiv:2309.09288 [pdf, other]

Title: Sound Source Distance Estimation in Diverse and Dynamic Acoustic Conditions

Saksham Singh Kushwaha, Iran R. Roman, Magdalena Fuentes, Juan Pablo Bello

Comments: Accepted in WASPAA 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[100] arXiv:2309.09329 [pdf, other]

Title: A Few-Shot Approach to Dysarthric Speech Intelligibility Level Classification Using Transformers

Paleti Nikhil Chowdary, Vadlapudi Sai Aravind, Gorantla V N S L Vishnu Vardhan, Menta Sai Akshay, Menta Sai Aashish, Jyothish Lal. G

Comments: Paper has been presented at ICCCNT 2023 and the final version will be published in IEEE Digital Library Xplore

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[101] arXiv:2309.09413 [pdf, other]

Title: Are Soft Prompts Good Zero-shot Learners for Speech Recognition?

Dianwen Ng, Chong Zhang, Ruixi Zhang, Yukun Ma, Fabian Ritter-Gutierrez, Trung Hieu Nguyen, Chongjia Ni, Shengkui Zhao, Eng Siong Chng, Bin Ma

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[102] arXiv:2309.09469 [pdf, html, other]

Title: Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks

Zeyang Song, Jibin Wu, Malu Zhang, Mike Zheng Shou, Haizhou Li

Comments: Accepted by ICASSP2024

Subjects: Sound (cs.SD); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[103] arXiv:2309.09470 [pdf, other]

Title: Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment

Zheng-Yan Sheng, Yang Ai, Yan-Nian Chen, Zhen-Hua Ling

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[104] arXiv:2309.09623 [pdf, other]

Title: HumTrans: A Novel Open-Source Dataset for Humming Melody Transcription and Beyond

Shansong Liu, Xu Li, Dian Li, Ying Shan

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[105] arXiv:2309.09627 [pdf, html, other]

Title: Electrolaryngeal Speech Intelligibility Enhancement Through Robust Linguistic Encoders

Lester Phillip Violeta, Wen-Chin Huang, Ding Ma, Ryuichi Yamamoto, Kazuhiro Kobayashi, Tomoki Toda

Comments: Accepted to ICASSP 2024. Demo page: this http URL

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[106] arXiv:2309.09652 [pdf, html, other]

Title: Speeding Up Speech Synthesis In Diffusion Models By Reducing Data Distribution Recovery Steps Via Content Transfer

Peter Ochieng

Comments: 10 pages

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[107] arXiv:2309.09705 [pdf, other]

Title: Synth-AC: Enhancing Audio Captioning with Synthetic Supervision

Feiyang Xiao, Qiaoxi Zhu, Jian Guan, Xubo Liu, Haohe Liu, Kejia Zhang, Wenwu Wang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[108] arXiv:2309.09837 [pdf, other]

Title: Frame-to-Utterance Convergence: A Spectra-Temporal Approach for Unified Spoofing Detection

Awais Khan, Khalid Mahmood Malik, Shah Nawaz

Subjects: Sound (cs.SD); Computers and Society (cs.CY); Audio and Speech Processing (eess.AS)

[109] arXiv:2309.10280 [pdf, other]

Title: Crowdotic: A Privacy-Preserving Hospital Waiting Room Crowd Density Estimation with Non-speech Audio

Forsad Al Hossain, Tanjid Hasan Tonmoy, Andrew A. Lover, George A. Corey, Mohammad Arif Ul Alam, Tauhidur Rahman

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[110] arXiv:2309.10379 [pdf, other]

Title: PDPCRN: Parallel Dual-Path CRN with Bi-directional Inter-Branch Interactions for Multi-Channel Speech Enhancement

Jiahui Pan, Shulin He, Tianci Wu, Hui Zhang, Xueliang Zhang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[111] arXiv:2309.10393 [pdf, other]

Title: Hierarchical Modeling of Spatial Cues via Spherical Harmonics for Multi-Channel Speech Enhancement

Jiahui Pan, Shulin He, Hui Zhang, Xueliang Zhang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[112] arXiv:2309.10456 [pdf, other]

Title: Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagation

Luyao Cheng, Siqi Zheng, Qinglin Zhang, Hui Wang, Yafeng Chen, Qian Chen, Shiliang Zhang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[113] arXiv:2309.10485 [pdf, html, other]

Title: Exploring Sentence Type Effects on the Lombard Effect and Intelligibility Enhancement: A Comparative Study of Natural and Grid Sentences

Hongyang Chen, Yuhong Yang, Zhongyuan Wang, Weiping Tu, Haojun Ai, Song Lin

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[114] arXiv:2309.10560 [pdf, other]

Title: Bridging the Spoof Gap: A Unified Parallel Aggregation Network for Voice Presentation Attacks

Awais Khan, Khalid Mahmood Malik

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[115] arXiv:2309.10597 [pdf, other]

Title: Motif-Centric Representation Learning for Symbolic Music

Yuxuan Wu, Roger B. Dannenberg, Gus Xia

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[116] arXiv:2309.10674 [pdf, html, other]

Title: USED: Universal Speaker Extraction and Diarization

Junyi Ao, Mehmet Sinan Yıldırım, Ruijie Tao, Meng Ge, Shuai Wang, Yanmin Qian, Haizhou Li

Comments: Accepted to TASLP

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[117] arXiv:2309.10719 [pdf, html, other]

Title: Harmony and Duality: An introduction to Music Theory

Maksim Lipyanskiy

Comments: 75 pages, 72 figures

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[118] arXiv:2309.10738 [pdf, other]

Title: MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation

Xinda Wu, Zhijie Huang, Kejun Zhang, Jiaxing Yu, Xu Tan, Tieyao Zhang, Zihao Wang, Lingyun Sun

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[119] arXiv:2309.10740 [pdf, html, other]

Title: ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation

Yatong Bai, Trung Dang, Dung Tran, Kazuhito Koishida, Somayeh Sojoudi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[120] arXiv:2309.10832 [pdf, other]

Title: Efficient Multi-Channel Speech Enhancement with Spherical Harmonics Injection for Directional Encoding

Jiahui Pan, Pengjie Shen, Hui Zhang, Xueliang Zhang

Comments: arXiv admin note: text overlap with arXiv:2309.10393

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[121] arXiv:2309.10930 [pdf, other]

Title: Test-Time Training for Speech

Sri Harsha Dumpala, Chandramouli Sastry, Sageev Oore

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[122] arXiv:2309.10993 [pdf, other]

Title: Directional Source Separation for Robust Speech Recognition on Smart Glasses

Tiantian Feng, Ju Lin, Yiteng Huang, Weipeng He, Kaustubh Kalgaonkar, Niko Moritz, Li Wan, Xin Lei, Ming Sun, Frank Seide

Comments: Submitted to ICASSP 2024

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[123] arXiv:2309.11140 [pdf, other]

Title: Investigating Personalization Methods in Text to Music Generation

Manos Plitsis, Theodoros Kouzelis, Georgios Paraskevopoulos, Vassilis Katsouros, Yannis Panagakis

Comments: Submitted to ICASSP 2024, Examples at this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[124] arXiv:2309.11500 [pdf, html, other]

Title: Auto-ACD: A Large-scale Dataset for Audio-Language Representation Learning

Luoyi Sun, Xuenan Xu, Mengyue Wu, Weidi Xie

Comments: Accepted by ACM MM 2024

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[125] arXiv:2309.11725 [pdf, other]

Title: FluentEditor: Text-based Speech Editing by Considering Acoustic and Prosody Consistency

Rui Liu, Jiatian Xi, Ziyue Jiang, Haizhou Li

Comments: Submitted to ICASSP'2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[126] arXiv:2309.11845 [pdf, other]

Title: TMac: Temporal Multi-Modal Graph Learning for Acoustic Event Classification

Meng Liu, Ke Liang, Dayu Hu, Hao Yu, Yue Liu, Lingyuan Meng, Wenxuan Tu, Sihang Zhou, Xinwang Liu

Comments: This work has been accepted by ACM MM 2023 for publication

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[127] arXiv:2309.11849 [pdf, other]

Title: A Discourse-level Multi-scale Prosodic Model for Fine-grained Emotion Analysis

Xianhao Wei, Jia Jia, Xiang Li, Zhiyong Wu, Ziyi Wang

Comments: ChinaMM 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[128] arXiv:2309.11895 [pdf, other]

Title: Audio Contrastive based Fine-tuning

Yang Wang, Qibin Liang, Chenghao Xiao, Yizhi Li, Noura Al Moubayed, Chenghua Lin

Comments: Under review

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[129] arXiv:2309.11977 [pdf, html, other]

Title: Improving Language Model-Based Zero-Shot Text-to-Speech Synthesis with Multi-Scale Acoustic Prompts

Shun Lei, Yixuan Zhou, Liyang Chen, Dan Luo, Zhiyong Wu, Xixin Wu, Shiyin Kang, Tao Jiang, Yahui Zhou, Yuxing Han, Helen Meng

Comments: Accepted bt ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[130] arXiv:2309.12111 [pdf, other]

Title: Passage Summarization with Recurrent Models for Audio-Sheet Music Retrieval

Luis Carvalho, Gerhard Widmer

Comments: In Proceedings of the 24th Conference of the International Society for Music Information Retrieval (ISMIR 2023), Milan, Italy

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[131] arXiv:2309.12134 [pdf, other]

Title: Self-Supervised Contrastive Learning for Robust Audio-Sheet Music Retrieval Systems

Luis Carvalho, Tobias Washüttl, Gerhard Widmer

Journal-ref: Proceedings of the 14th ACM Multimedia Systems Conference (MMSys '23), June 7-10, 2023, Vancouver, BC, Canada

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[132] arXiv:2309.12158 [pdf, other]

Title: Towards Robust and Truly Large-Scale Audio-Sheet Music Retrieval

Luis Carvalho, Gerhard Widmer

Comments: Proceedings of the IEEE 6th International Conference on Multimedia Information Processing and Retrieval (MIPR)

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[133] arXiv:2309.12242 [pdf, other]

Title: Weakly-supervised Automated Audio Captioning via text only training

Theodoros Kouzelis, Vassilis Katsouros

Comments: DCASE Workshop 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[134] arXiv:2309.12283 [pdf, other]

Title: Performance Conditioning for Diffusion-Based Multi-Instrument Music Synthesis

Ben Maman, Johannes Zeitler, Meinard Müller, Amit H. Bermano

Comments: 5 pages, project page available at this http URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[135] arXiv:2309.12521 [pdf, html, other]

Title: Profile-Error-Tolerant Target-Speaker Voice Activity Detection

Dongmei Wang, Xiong Xiao, Naoyuki Kanda, Midia Yousefi, Takuya Yoshioka, Jian Wu

Comments: Submission for ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[136] arXiv:2309.12672 [pdf, other]

Title: CrossSinger: A Cross-Lingual Multi-Singer High-Fidelity Singing Voice Synthesizer Trained on Monolingual Singers

Xintong Wang, Chang Zeng, Jun Chen, Chunhui Wang

Comments: Accepted by ASRU2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[137] arXiv:2309.12802 [pdf, other]

Title: Deepfake audio as a data augmentation technique for training automatic speech to text transcription models

Alexandre R. Ferreira, Cláudio E. C. Campelo

Comments: 9 pages, 6 figures, 7 tables

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[138] arXiv:2309.13085 [pdf, other]

Title: Does My Dog ''Speak'' Like Me? The Acoustic Correlation between Pet Dogs and Their Human Owners

Jieyi Huang, Chunhao Zhang, Yufei Wang, Mengyue Wu, Kenny Zhu

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[139] arXiv:2309.13086 [pdf, other]

Title: Towards Lexical Analysis of Dog Vocalizations via Online Videos

Yufei Wang, Chunhao Zhang, Jieyi Huang, Mengyue Wu, Kenny Zhu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[140] arXiv:2309.13166 [pdf, other]

Title: Invisible Watermarking for Audio Generation Diffusion Models

Xirong Cao, Xiang Li, Divyesh Jadav, Yanzhao Wu, Zhehui Chen, Chen Zeng, Wenqi Wei

Comments: This is an invited paper for IEEE TPS, part of the IEEE CIC/CogMI/TPS 2023 conference

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[141] arXiv:2309.13343 [pdf, other]

Title: Two vs. Four-Channel Sound Event Localization and Detection

Julia Wilkins, Magdalena Fuentes, Luca Bondi, Shabnam Ghaffarzadegan, Ali Abavisani, Juan Pablo Bello

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[142] arXiv:2309.13373 [pdf, other]

Title: Asca: less audio data is more insightful

Xiang Li, Junhao Chen, Chao Li, Hongwu Lv

Comments: 6 pages,3 figures

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[143] arXiv:2309.13509 [pdf, other]

Title: Coco-Nut: Corpus of Japanese Utterance and Voice Characteristics Description for Prompt-based Control

Aya Watanabe, Shinnosuke Takamichi, Yuki Saito, Wataru Nakata, Detai Xin, Hiroshi Saruwatari

Comments: Submitted to ASRU2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[144] arXiv:2309.13573 [pdf, other]

Title: The second multi-channel multi-party meeting transcription challenge (M2MeT) 2.0): A benchmark for speaker-attributed ASR

Yuhao Liang, Mohan Shi, Fan Yu, Yangze Li, Shiliang Zhang, Zhihao Du, Qian Chen, Lei Xie, Yanmin Qian, Jian Wu, Zhuo Chen, Kong Aik Lee, Zhijie Yan, Hui Bu

Comments: 8 pages, Accepted by ASRU2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[145] arXiv:2309.13907 [pdf, other]

Title: HiGNN-TTS: Hierarchical Prosody Modeling with Graph Neural Networks for Expressive Long-form TTS

Dake Guo, Xinfa Zhu, Liumeng Xue, Tao Li, Yuanjun Lv, Yuepeng Jiang, Lei Xie

Comments: Accepted by ASRU2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[146] arXiv:2309.13920 [pdf, other]

Title: Real-Time Emergency Vehicle Detection using Mel Spectrograms and Regular Expressions

Alberto Pacheco-Gonzalez, Raymundo Torres, Raul Chacon, Isidro Robledo

Comments: in Spanish language

Journal-ref: Revista Electro, Vol. 45, pp. 184-189, 2023

Subjects: Sound (cs.SD); Formal Languages and Automata Theory (cs.FL); Symbolic Computation (cs.SC); Audio and Speech Processing (eess.AS)

[147] arXiv:2309.13972 [pdf, other]

Title: Audio classification with Dilated Convolution with Learnable Spacings

Ismail Khalfaoui-Hassani, Timothée Masquelier, Thomas Pellegrini

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[148] arXiv:2309.14094 [pdf, other]

Title: VoiceLens: Controllable Speaker Generation and Editing with Flow

Yao Shi, Ming Li

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[149] arXiv:2309.14130 [pdf, html, other]

Title: On the Relation between Internal Language Model and Sequence Discriminative Training for Neural Transducers

Zijian Yang, Wei Zhou, Ralf Schlüter, Hermann Ney

Comments: accepted at ICASSP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[150] arXiv:2309.14149 [pdf, other]

Title: Multi-Domain Adaptation by Self-Supervised Learning for Speaker Verification

Wan Lin, Lantian Li, Dong Wang

Comments: submitted to ICASSP 2024

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)