Computation and Language

Authors and titles for October 2022

[1376] arXiv:2210.15876 (cross-list from eess.AS) [pdf, other]

Title: Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition

Yist Y. Lin, Tao Han, Haihua Xu, Van Tung Pham, Yerbolat Khassanov, Tze Yuang Chong, Yi He, Lu Lu, Zejun Ma

Comments: 5 pages, 3 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1377] arXiv:2210.15882 (cross-list from cs.LG) [pdf, other]

Title: Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?

Byung-Hak Kim, Zhongfen Deng, Philip S. Yu, Varun Ganapathi

Comments: To appear in Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (Louhi 2022), Virtual, December 7, 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1378] arXiv:2210.16031 (cross-list from cs.CV) [pdf, other]

Title: UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance

Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu, Hu Yang, Guohao Li, Zhanpeng Wang, Zhifan Feng, Qiaoqiao She, Yajuan Lyu, Hua Wu

Comments: First Version, 16 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1379] arXiv:2210.16045 (cross-list from cs.SD) [pdf, other]

Title: Towards zero-shot Text-based voice editing using acoustic context conditioning, utterance embeddings, and reference encoders

Jason Fong, Yun Wang, Prabhav Agrawal, Vimal Manohar, Jilong Wu, Thilo Köhler, Qing He

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1380] arXiv:2210.16062 (cross-list from q-bio.NC) [pdf, other]

Title: Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Concepts

Paul Stoewer, Achim Schilling, Andreas Maier, Patrick Krauss

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1381] arXiv:2210.16431 (cross-list from cs.CV) [pdf, other]

Title: DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention

Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou

Comments: Published in ACM TKDD2022 (ACM Transactions on Knowledge Discovery from Data)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1382] arXiv:2210.16481 (cross-list from eess.AS) [pdf, other]

Title: Accelerating RNN-T Training and Inference Using CTC guidance

Yongqiang Wang, Zhehuai Chen, Chengjian Zheng, Yu Zhang, Wei Han, Parisa Haghani

Comments: submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1383] arXiv:2210.16611 (cross-list from eess.AS) [pdf, other]

Title: Application of Knowledge Distillation to Multi-task Speech Representation Learning

Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser

Comments: Speech representation learning, multi-task training, wav2vec, HuBERT, knowledge distillation

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1384] arXiv:2210.16642 (cross-list from cs.SD) [pdf, other]

Title: Unifying the Discrete and Continuous Emotion labels for Speech Emotion Recognition

Roshan Sharma, Hira Dhamyal, Bhiksha Raj, Rita Singh

Comments: Under Review at ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1385] arXiv:2210.16663 (cross-list from eess.AS) [pdf, other]

Title: BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe

Comments: v1: Accepted to Findings of EMNLP2022, v2: Minor corrections and clearer derivation of Eq. (21)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1386] arXiv:2210.16739 (cross-list from eess.AS) [pdf, other]

Title: DuDe: Dual-Decoder Multilingual ASR for Indian Languages using Common Label Set

Arunkumar A, Mudit Batra, Umesh S

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1387] arXiv:2210.16850 (cross-list from cs.LG) [pdf, other]

Title: Medical Codes Prediction from Clinical Notes: From Human Coders to Machines

Byung-Hak Kim

Comments: The 11th Bay Area Machine Learning Symposium (BayLearn 2022), San Francisco, CA, October 20, 2022. arXiv admin note: substantial text overlap with arXiv:2210.15882. substantial text overlap with arXiv:2107.10650

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1388] arXiv:2210.17027 (cross-list from cs.SD) [pdf, other]

Title: Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1389] arXiv:2210.17079 (cross-list from cs.SD) [pdf, other]

Title: FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition

Xingchen Song, Di Wu, Binbin Zhang, Zhiyong Wu, Wenpeng Li, Dongfang Li, Pengshen Zhang, Zhendong Peng, Fuping Pan, Changbao Zhu, Zhongqin Wu

Comments: 8 pages, plus 3 appendix

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1390] arXiv:2210.17143 (cross-list from cs.SD) [pdf, other]

Title: Exploring Train and Test-Time Augmentations for Audio-Language Learning

Eungbeom Kim, Jinhee Kim, Yoori Oh, Kyungsu Kim, Minju Park, Jaeheon Sim, Jinwoo Lee, Kyogu Lee

Comments: 5 pages, 4 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1391] arXiv:2210.17209 (cross-list from cs.HC) [pdf, other]

Title: The Effect of Multiple Replies for Natural Language Generation Chatbots

Eason Chen

Comments: 5 pages

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1392] arXiv:2210.17236 (cross-list from cs.PL) [pdf, other]

Title: When Language Model Meets Private Library

Daoguang Zan, Bei Chen, Zeqi Lin, Bei Guan, Yongji Wang, Jian-Guang Lou

Comments: EMNLP 2022 Findings

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1393] arXiv:2210.17264 (cross-list from cs.SD) [pdf, html, other]

Title: Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation

Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, Georgia Maniati, Panos Kakoulidis, June Sig Sung, Inchul Hwang, Spyros Raptis, Aimilios Chalamandaris, Pirros Tsiakoulis

Comments: Fundamental changes to the model described and experimental procedure

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1394] arXiv:2210.17316 (cross-list from eess.AS) [pdf, other]

Title: There is more than one kind of robustness: Fooling Whisper with adversarial examples

Raphael Olivier, Bhiksha Raj

Comments: Accepted at InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1395] arXiv:2210.17406 (cross-list from cs.LG) [pdf, other]

Title: Emergent Linguistic Structures in Neural Networks are Fragile

Emanuele La Malfa, Matthew Wicker, Marta Kwiatkowska

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1396] arXiv:2210.17437 (cross-list from cs.LG) [pdf, html, other]

Title: Learning New Tasks from a Few Examples with Soft-Label Prototypes

Avyav Kumar Singh, Ekaterina Shutova, Helen Yannakoudakis

Comments: Proceedings of the 9th Workshop on Representation Learning for NLP (2024), Pages 215 to 236

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1397] arXiv:2210.17546 (cross-list from cs.LG) [pdf, other]

Title: Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy

Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)