Sound

Authors and titles for October 2022

[1] arXiv:2210.00169 [pdf, other]

Title: Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition

Jash Rathod, Nauman Dawalatabad, Shatrughan Singh, Dhananjaya Gowda

Comments: Published in INTERSPEECH 2022

Journal-ref: Proc. Interspeech 2022, 1691-1695

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2] arXiv:2210.00721 [pdf, other]

Title: Efficient acoustic feature transformation in mismatched environments using a Guided-GAN

Walter Heymans, Marelie H. Davel, Charl van Heerden

Comments: Final published version available at: Efficient acoustic feature transformation in mismatched environments using a Guided-GAN. Speech Communication, 143, pp.10-20

Journal-ref: Speech Communication, 143, pp.10-20 (2022)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[3] arXiv:2210.00753 [pdf, other]

Title: Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection

Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang

Comments: Accepted by SLT 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[4] arXiv:2210.01256 [pdf, other]

Title: And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?

Mathilde Abrassart, Guillaume Doras

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[5] arXiv:2210.01353 [pdf, other]

Title: Pay Self-Attention to Audio-Visual Navigation

Yinfeng Yu, Lele Cao, Fuchun Sun, Xiaohong Liu, Liejun Wang

Comments: Main paper (10 pages and 7 figures) and appendix (21 figures and 4 tables). Accepted for publication by BMVC 2022. For data and code, see this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[6] arXiv:2210.01448 [pdf, other]

Title: Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings

Tenglong Ao, Qingzhe Gao, Yuke Lou, Baoquan Chen, Libin Liu

Comments: SIGGRAPH Asia 2022 (Journal Track); Project Page: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Audio and Speech Processing (eess.AS)

[7] arXiv:2210.01703 [pdf, other]

Title: Improving Label-Deficient Keyword Spotting Through Self-Supervised Pretraining

Holger Severin Bovbjerg, Zheng-Hua Tan

Comments: To be published at ICASSP2023 Workshop on Self-supervision in Audio, Speech and Beyond, 10th of June 2023, Rhodes, Greece. Copyright (c) 2023 IEEE. 5 pages, 3 figures, 3 tables

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[8] arXiv:2210.01719 [pdf, html, other]

Title: Learning Temporal Resolution in Spectrogram for Audio Classification

Haohe Liu, Xubo Liu, Qiuqiang Kong, Wenwu Wang, Mark D. Plumbley

Comments: Accepted by the 38th Annual AAAI Conference on Artificial Intelligence

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[9] arXiv:2210.02287 [pdf, other]

Title: TC-SKNet with GridMask for Low-complexity Classification of Acoustic scene

Luyuan Xie, Yan Zhong, Lin Yang, Zhaoyu Yan, Zhonghai Wu, Junjie Wang

Comments: Accepted to APSIPA ASC 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[10] arXiv:2210.02437 [pdf, other]

Title: ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild

Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, Kong Aik Lee

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[11] arXiv:2210.02642 [pdf, other]

Title: Feasibility on Detecting Door Slamming towards Monitoring Early Signs of Domestic Violence

Osian Morgan, Hakan Kayan, Charith Perera

Comments: In Proceedings of the 2022 IEEE/ACM Seventh International Conference on Internet-of-Things Design and Implementation (IoTDI) 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[12] arXiv:2210.02731 [pdf, other]

Title: PSVRF: Learning to restore Pitch-Shifted Voice without reference

Yangfu Li, Xiaodan Lin, Jiaxin Yang

Comments: Have some errors

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[13] arXiv:2210.02746 [pdf, other]

Title: The Sound of Silence: Efficiency of First Digit Features in Synthetic Audio Detection

Daniele Mari, Federica Latora, Simone Milani

Comments: Accepted at WIFS 2022

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[14] arXiv:2210.02829 [pdf, other]

Title: Melody Infilling with User-Provided Structural Context

Chih-Pin Tan, Alvin W.Y. Su, Yi-Hsuan Yang

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[15] arXiv:2210.02904 [pdf, other]

Title: WakeUpNet: A Mobile-Transformer based Framework for End-to-End Streaming Voice Trigger

Zixing Zhang, Thorin Farnsworth, Senling Lin, Salah Karout

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[16] arXiv:2210.03027 [pdf, other]

Title: AnimeTAB: A new guitar tablature dataset of anime and game music

Yuecheng Zhou, Yaolong Ju, Lingyun Xie

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[17] arXiv:2210.03255 [pdf, other]

Title: Damage Control During Domain Adaptation for Transducer Based Automatic Speech Recognition

Somshubra Majumdar, Shantanu Acharya, Vitaly Lavrukhin, Boris Ginsburg

Comments: To appear in Proc. SLT 2022, Jan 09-12, 2023, Doha, Qatar

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[18] arXiv:2210.03360 [pdf, other]

Title: The PerspectiveLiberator -- an upmixing 6DoF rendering plugin for single-perspective Ambisonic room impulse responses

Kaspar Müller, Franz Zotter

Comments: 4 pages, submitted to conference: DAGA 2021, Vienna, Austria, 2021

Journal-ref: Fortschritte der Akustik - DAGA 2021, Vienna, Austria, 2021, vol. 47, pp. 306-309

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[19] arXiv:2210.03363 [pdf, other]

Title: Model-based estimation of in-car-communication feedback applied to speech zone detection

Kaspar Müller, Simon Doclo, Jan Østergaard, Tobias Wolff

Comments: 5 pages, submitted to International Workshop on Acoustic Signal Enhancement (IWAENC), Bamberg, Germany, 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[20] arXiv:2210.03538 [pdf, other]

Title: An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Era

Andreas Triantafyllopoulos, Björn W. Schuller, Gökçe İymen, Metin Sezgin, Xiangheng He, Zijiang Yang, Panagiotis Tzirakis, Shuo Liu, Silvan Mertes, Elisabeth André, Ruibo Fu, Jianhua Tao

Comments: Submitted to the Proceedings of IEEE

Subjects: Sound (cs.SD); Machine Learning (cs.LG)

[21] arXiv:2210.03799 [pdf, other]

Title: Supervised and Unsupervised Learning of Audio Representations for Music Understanding

Matthew C. McCallum, Filip Korzeniowski, Sergio Oramas, Fabien Gouyon, Andreas F. Ehmann

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[22] arXiv:2210.04062 [pdf, other]

Title: CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning

Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li

Comments: Accepted by Interspeech 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[23] arXiv:2210.05037 [pdf, other]

Title: Automated Audio Captioning via Fusion of Low- and High- Dimensional Features

Jianyuan Sun, Xubo Liu, Xinhao Mei, Mark D. Plumbley, Volkan Kilic, Wenwu Wang

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[24] arXiv:2210.05076 [pdf, other]

Title: ConchShell: A Generative Adversarial Networks that Turns Pictures into Piano Music

Wanpeng Fan, Yuanzhi Su, Yuxin Huang

Comments: 5 pages

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

[25] arXiv:2210.05092 [pdf, other]

Title: The DKU-Tencent System for the VoxCeleb Speaker Recognition Challenge 2022

Xiaoyi Qin, Na Li, Yuke Lin, Yiwei Ding, Chao Weng, Dan Su, Ming Li

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[26] arXiv:2210.05148 [pdf, other]

Title: DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability

Kin Wai Cheuk, Ryosuke Sawata, Toshimitsu Uesaka, Naoki Murata, Naoya Takahashi, Shusuke Takahashi, Dorien Herremans, Yuki Mitsufuji

Journal-ref: Proceedings of ICASSP - IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. IEEE, 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[27] arXiv:2210.05254 [pdf, other]

Title: Deep Spectro-temporal Artifacts for Detecting Synthesized Speech

Xiaohui Liu, Meng Liu, Lin Zhang, Linjuan Zhang, Chang Zeng, Kai Li, Nan Li, Kong Aik Lee, Longbiao Wang, Jianwu Dang

Comments: 7 pages, 1 figures, Accecpted by Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[28] arXiv:2210.05265 [pdf, other]

Title: MFCCA:Multi-Frame Cross-Channel attention for multi-speaker ASR in Multi-party meeting scenario

Fan Yu, Shiliang Zhang, Pengcheng Guo, Yuhao Liang, Zhihao Du, Yuxiao Lin, Lei Xie

Comments: Accepted by SLT 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[29] arXiv:2210.05271 [pdf, other]

Title: GAN You Hear Me? Reclaiming Unconditional Speech Synthesis from Diffusion Models

Matthew Baas, Herman Kamper

Comments: 6 pages, 2 figures, 2 tables. Accepted at IEEE SLT 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[30] arXiv:2210.05614 [pdf, other]

Title: An Experimental Study on Private Aggregation of Teacher Ensemble Learning for End-to-End Speech Recognition

Chao-Han Huck Yang, I-Fan Chen, Andreas Stolcke, Sabato Marco Siniscalchi, Chin-Hui Lee

Comments: 5 pages. Accepted to IEEE SLT 2022. A first version draft was finished in Aug 2021

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[31] arXiv:2210.05917 [pdf, other]

Title: Enemy Spotted: in-game gun sound dataset for gunshot classification and localization

Junwoo Park, Youngwoo Cho, Gyuhyeon Sim, Hojoon Lee, Jaegul Choo

Comments: Accepted at IEEE Conference on Games (GoG) 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[32] arXiv:2210.06007 [pdf, other]

Title: JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAE

Yueh-Kao Wu, Ching-Yu Chiu, Yi-Hsuan Yang

Comments: Accepted at ISMIR 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[33] arXiv:2210.06105 [pdf, other]

Title: SpecRNet: Towards Faster and More Accessible Audio DeepFake Detection

Piotr Kawa, Marcin Plata, Piotr Syga

Comments: Accepted by TrustCom 2022: The 21st IEEE International Conference on Trust, Security and Privacy in Computing and Communications

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[34] arXiv:2210.06111 [pdf, other]

Title: THUEE system description for NIST 2020 SRE CTS challenge

Yu Zheng, Jinghan Peng, Miao Zhao, Yufeng Ma, Min Liu, Xinyue Ma, Tianyu Liang, Tianlong Kong, Liang He, Minqiang Xu

Comments: 3 pages, 1 table; System desciption of NIST 2020 SRE CTS challenge

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[35] arXiv:2210.06368 [pdf, other]

Title: Individualized Conditioning and Negative Distances for Speaker Separation

Tao Sun, Nidal Abuhajar, Shuyu Gong, Zhewei Wang, Charles D. Smith, Xianhui Wang, Li Xu, Jundong Liu

Comments: Accepted to ICMLA 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[36] arXiv:2210.07002 [pdf, other]

Title: Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy

Sarina Meyer, Pascal Tilli, Pavel Denisov, Florian Lux, Julia Koch, Ngoc Thang Vu

Comments: IEEE Spoken Language Technology Workshop 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[37] arXiv:2210.07508 [pdf, other]

Title: Hierarchical Diffusion Models for Singing Voice Neural Vocoder

Naoya Takahashi, Mayank Kumar, Singh, Yuki Mitsufuji

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[38] arXiv:2210.07546 [pdf, other]

Title: Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario

Emily R. Bartusiak, Edward J. Delp

Comments: Accepted to the 2022 IEEE International Conference on Machine Learning and Applications

Journal-ref: IEEE International Conference on Machine Learning and Applications, pp. 1-8, December 2022, Nassau, The Bahamas

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[39] arXiv:2210.07559 [pdf, other]

Title: Empirical Study Incorporating Linguistic Knowledge on Filled Pauses for Personalized Spontaneous Speech Synthesis

Yuta Matsunaga, Takaaki Saeki, Shinnosuke Takamichi, Hiroshi Saruwatari

Comments: Accepted to APSIPA ASC 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[40] arXiv:2210.07642 [pdf, other]

Title: Training speech emotion classifier without categorical annotations

Meysam Shamsi, Marie Tahon

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[41] arXiv:2210.07685 [pdf, other]

Title: Full-Stack Bioacoustics: Field Kit to AI to Action (Workshop report)

Dan Stowell, Caitlin Black, Florencia Noriega, Sarab S. Sethi

Comments: Workshop report: Lorentz Center, Leiden, the Netherlands, 1-5 August 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[42] arXiv:2210.07692 [pdf, other]

Title: Accelerating RNN-based Speech Enhancement on a Multi-Core MCU with Mixed FP16-INT8 Post-Training Quantization

Manuele Rusci, Marco Fariselli, Martin Croome, Francesco Paci, Eric Flamand

Comments: Accepted at the ITEM Workshop 2022 (located at ECML-PKDD2022)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Systems and Control (eess.SY)

[43] arXiv:2210.07978 [pdf, other]

Title: Improving generalizability of distilled self-supervised speech processing models under distorted settings

Kuan-Po Huang, Yu-Kuan Fu, Tsu-Yuan Hsu, Fabian Ritter Gutierrez, Fan-Lin Wang, Liang-Hsuan Tseng, Yu Zhang, Hung-yi Lee

Comments: Accepted by IEEE SLT2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[44] arXiv:2210.08182 [pdf, other]

Title: Learning Invariant Representation and Risk Minimized for Unsupervised Accent Domain Adaptation

Chendong Zhao, Jianzong Wang, Xiaoyang Qu, Haoqian Wang, Jing Xiao

Comments: Accepted to 2022 IEEE Spoken Language Technology Workshop (SLT 2022)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[45] arXiv:2210.08520 [pdf, other]

Title: A Policy-based Approach to the SpecAugment Method for Low Resource E2E ASR

Rui Li, Guodong Ma, Dexin Zhao, Ranran Zeng, Xiaoyu Li, Hao Huang

Comments: Accepted to APSIPA ASC 2022

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[46] arXiv:2210.08610 [pdf, other]

Title: Robust, General, and Low Complexity Acoustic Scene Classification Systems and An Effective Visualization for Presenting a Sound Scene Context

Lam Pham, Dusan Salovic, Anahid Jalali, Alexander Schindler, Khoa Tran, Canh Vu, Phu X. Nguyen

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

[47] arXiv:2210.08834 [pdf, other]

Title: How to Leverage DNN-based speech enhancement for multi-channel speaker verification?

Sandipana Dowerah (MULTISPEECH), Romain Serizel (MULTISPEECH), Denis Jouvet (MULTISPEECH), Mohammad Mohammadamini (LIA), Driss Matrouf (LIA)

Journal-ref: 4th International Conference on Advances in Signal Processing and Artificial Intelligence (ASPAI' 2022), Oct 2022, Corfu, Greece

Subjects: Sound (cs.SD); Human-Computer Interaction (cs.HC); Audio and Speech Processing (eess.AS)

[48] arXiv:2210.09173 [pdf, other]

Title: Visual onoma-to-wave: environmental sound synthesis from visual onomatopoeias and sound-source images

Hien Ohnaka, Shinnosuke Takamichi, Keisuke Imoto, Yuki Okamoto, Kazuki Fujii, Hiroshi Saruwatari

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Audio and Speech Processing (eess.AS)

[49] arXiv:2210.09188 [pdf, other]

Title: Sub-8-bit quantization for on-device speech recognition: a regularization-free approach

Kai Zhen, Martin Radfar, Hieu Duy Nguyen, Grant P. Strimel, Nathan Susanj, Athanasios Mouchtaris

Comments: Accepted for publication at IEEE SLT'22

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[50] arXiv:2210.09524 [pdf, other]

Title: SVLDL: Improved Speaker Age Estimation Using Selective Variance Label Distribution Learning

Zuheng Kang, Jianzong Wang, Junqing Peng, Jing Xiao

Comments: Accepted by SLT 2022. The 2022 IEEE Spoken Language Technology Workshop (SLT 2022)

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)