Audio and Speech Processing

Authors and titles for March 2023

[251] arXiv:2303.14044 (cross-list from cs.GR) [pdf, other]

Title: MusicFace: Music-driven Expressive Singing Face Synthesis

Pengfei Liu, Wenjin Deng, Hengda Li, Jintai Wang, Yinglin Zheng, Yiwei Ding, Xiaohu Guo, Ming Zeng

Comments: Accepted to CVMJ

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[252] arXiv:2303.14307 (cross-list from cs.CV) [pdf, other]

Title: Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels

Pingchuan Ma, Alexandros Haliassos, Adriana Fernandez-Lopez, Honglie Chen, Stavros Petridis, Maja Pantic

Comments: Accepted to ICASSP 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[253] arXiv:2303.14593 (cross-list from cs.SD) [pdf, other]

Title: Time-domain Speech Enhancement Assisted by Multi-resolution Frequency Encoder and Decoder

Hao Shi, Masato Mimura, Longbiao Wang, Jianwu Dang, Tatsuya Kawahara

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[254] arXiv:2303.15161 (cross-list from cs.SD) [pdf, other]

Title: Data Augmentation for Environmental Sound Classification Using Diffusion Probabilistic Model with Top-k Selection Discriminator

Yunhao Chen, Yunjie Zhu, Zihui Yan, Jianlu Shen, Zhen Ren, Yifan Huang

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[255] arXiv:2303.15306 (cross-list from cs.SD) [pdf, other]

Title: Pitchclass2vec: Symbolic Music Structure Segmentation with Chord Embeddings

Nicolas Lazzari, Andrea Poltronieri, Valentina Presutti

Journal-ref: Proceedings of the 1st Workshop on Artificial Intelligence and Creativity co-located with 21th International Conference of the Italian Association for Artificial Intelligence(AIxIA 2022), Udine, Italy, November 28 - December 3, 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[256] arXiv:2303.15705 (cross-list from cs.CL) [pdf, other]

Title: Translate the Beauty in Songs: Jointly Learning to Align Melody and Translate Lyrics

Chengxi Li, Kai Fan, Jiajun Bu, Boxing Chen, Zhongqiang Huang, Zhi Yu

Comments: 13 pages

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[257] arXiv:2303.15734 (cross-list from cs.SD) [pdf, html, other]

Title: Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approach

Ibrahim Khan, Thai Van Nguyen, Chollakorn Nimpattanavong, Ruck Thawonmas

Comments: In the updated version, the description of the association between the distance between the two players (PD) and the instrument's volume on page 3 has been revised

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[258] arXiv:2303.15940 (cross-list from cs.SD) [pdf, other]

Title: TransAudio: Towards the Transferable Adversarial Audio Attack via Learning Contextualized Perturbations

Qi Gege, Yuefeng Chen, Xiaofeng Mao, Yao Zhu, Binyuan Hui, Xiaodan Li, Rong Zhang, Hui Xue

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[259] arXiv:2303.15944 (cross-list from cs.LG) [pdf, other]

Title: Cluster-Guided Unsupervised Domain Adaptation for Deep Speaker Embedding

Haiquan Mao, Feng Hong, Man-wai Mak

Subjects: Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[260] arXiv:2303.16024 (cross-list from cs.CV) [pdf, other]

Title: Egocentric Auditory Attention Localization in Conversations

Fiona Ryan, Hao Jiang, Abhinav Shukla, James M. Rehg, Vamsi Krishna Ithapu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[261] arXiv:2303.16031 (cross-list from cs.CR) [pdf, other]

Title: A Universal Identity Backdoor Attack against Speaker Verification based on Siamese Network

Haodong Zhao, Wei Du, Junjie Guo, Gongshen Liu

Comments: Accepted by the Interspeech 2022. The first two authors contributed equally to this work

Subjects: Cryptography and Security (cs.CR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[262] arXiv:2303.16501 (cross-list from cs.CV) [pdf, other]

Title: AVFormer: Injecting Vision into Frozen Speech Models for Zero-Shot AV-ASR

Paul Hongsuck Seo, Arsha Nagrani, Cordelia Schmid

Comments: CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[263] arXiv:2303.16897 (cross-list from cs.CV) [pdf, other]

Title: Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos

Kun Su, Kaizhi Qian, Eli Shlizerman, Antonio Torralba, Chuang Gan

Comments: CVPR 2023. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[264] arXiv:2303.17200 (cross-list from cs.CV) [pdf, other]

Title: SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision

Xubo Liu, Egor Lakomkin, Konstantinos Vougioukas, Pingchuan Ma, Honglie Chen, Ruiming Xie, Morrie Doulaty, Niko Moritz, Jáchym Kolář, Stavros Petridis, Maja Pantic, Christian Fuegen

Comments: IEEE/CVF CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[265] arXiv:2303.17490 (cross-list from cs.CV) [pdf, other]

Title: Sound to Visual Scene Generation by Audio-to-Visual Latent Alignment

Kim Sung-Bin, Arda Senocak, Hyunwoo Ha, Andrew Owens, Tae-Hyun Oh

Comments: CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[266] arXiv:2303.17517 (cross-list from cs.CL) [pdf, other]

Title: Hindi as a Second Language: Improving Visually Grounded Speech with Semantically Similar Samples

Hyeonggon Ryu, Arda Senocak, In So Kweon, Joon Son Chung

Comments: ICASSP 2023

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[267] arXiv:2303.17611 (cross-list from cs.HC) [pdf, other]

Title: Transformer-based Self-supervised Multimodal Representation Learning for Wearable Emotion Recognition

Yujin Wu, Mohamed Daoudi, Ali Amad

Comments: Accepted IEEE Transactions On Affective Computing

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[268] arXiv:2303.17799 (cross-list from cs.CL) [pdf, other]

Title: Dialog act guided contextual adapter for personalized speech recognition

Feng-Ju Chang, Thejaswi Muniyappa, Kanthashree Mysore Sathyendra, Kai Wei, Grant P. Strimel, Ross McGowan

Comments: Accepted at ICASSP 2023

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[269] arXiv:2303.17949 (cross-list from cs.SD) [pdf, other]

Title: Unsupervised Anomaly Detection and Localization of Machine Audio: A GAN-based Approach

Anbai Jiang, Wei-Qiang Zhang, Yufeng Deng, Pingyi Fan, Jia Liu

Comments: Accepted by ICASSP 2023

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[270] arXiv:2303.18110 (cross-list from cs.CL) [pdf, other]

Title: The Edinburgh International Accents of English Corpus: Towards the Democratization of English ASR

Ramon Sanabria, Nikolay Bogoychev, Nina Markl, Andrea Carmantini, Ondrej Klejch, Peter Bell

Comments: Accepted to IEEE ICASSP 2023

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)