Computation and Language

Authors and titles for October 2022

[1351] arXiv:2210.14691 (cross-list from cs.SD) [pdf, other]

Title: Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

Wei Wang, Chao Zhang, Xiaopei Wu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1352] arXiv:2210.14699 (cross-list from cs.SE) [pdf, other]

Title: Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic?

Jean-Baptiste Döderlein, Mathieu Acher, Djamel Eddine Khelladi, Benoit Combemale

Comments: 14 pages, 3 Figures (not counted the subfigures), 10 Tables

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1353] arXiv:2210.14760 (cross-list from astro-ph.IM) [pdf, other]

Title: A New Task: Deriving Semantic Class Targets for the Physical Sciences

Micah Bowles, Hongming Tang, Eleni Vardoulaki, Emma L. Alexander, Yan Luo, Lawrence Rudnick, Mike Walmsley, Fiona Porter, Anna M. M. Scaife, Inigo Val Slijepcevic, Gary Segal

Comments: 6 pages, 1 figure, Accepted at Fifth Workshop on Machine Learning and the Physical Sciences (NeurIPS 2022), Neural Information Processing Systems 2022

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Computation and Language (cs.CL)

[1354] arXiv:2210.14862 (cross-list from cs.CV) [pdf, other]

Title: Visual Semantic Parsing: From Images to Abstract Meaning Representation

Mohamed Ashraf Abdelsalam, Zhan Shi, Federico Fancellu, Kalliopi Basioti, Dhaivat J. Bhatt, Vladimir Pavlovic, Afsaneh Fazly

Comments: published in CoNLL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1355] arXiv:2210.14868 (cross-list from cs.LG) [pdf, other]

Title: Multi-lingual Evaluation of Code Generation Models

Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Uddin Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta, Dan Roth, Bing Xiang

Comments: Code and data release: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1356] arXiv:2210.15016 (cross-list from cs.PL) [pdf, other]

Title: TPU-MLIR: A Compiler For TPU Using MLIR

Pengchao Hu, Man Lu, Lei Wang, Guoyue Jiang

Comments: A way to design AI Compiler for ASIC chips by MLIR

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1357] arXiv:2210.15042 (cross-list from cs.CR) [pdf, other]

Title: Privately Fine-Tuning Large Language Models with Differential Privacy

Rouzbeh Behnia, Mohamamdreza Ebrahimi, Jason Pacheco, Balaji Padmanabhan

Comments: Publised at IEEE ICDM Workshop on Machine Learning for Cybersecurity (MLC) 2022

Journal-ref: 2022 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 560-566

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1358] arXiv:2210.15110 (cross-list from cs.CV) [pdf, other]

Title: Masked Vision-Language Transformer in Fashion

Ge-Peng Ji, Mingcheng Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool

Comments: Accepted by Machine Intelligence Research (2023)

Journal-ref: Machine Intelligence Research. 20, 421-434 (2023)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1359] arXiv:2210.15131 (cross-list from cs.SD) [pdf, other]

Title: Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representations

Haohan Guo, Fenglong Xie, Xixin Wu, Hui Lu, Helen Meng

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1360] arXiv:2210.15173 (cross-list from cs.SD) [pdf, other]

Title: Articulation GAN: Unsupervised modeling of articulatory learning

Gašper Beguš, Alan Zhou, Peter Wu, Gopala K Anumanchipalli

Comments: ICASSP 2023

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1361] arXiv:2210.15237 (cross-list from eess.SP) [pdf, other]

Title: Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model

Ju-Hyung Lee, Dong-Ho Lee, Eunsoo Sheen, Thomas Choi, Jay Pujara

Comments: Accepted to IEEE ASILOMAR 2023 conference, 4 pages, 2 figures, 3 tables

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL)

[1362] arXiv:2210.15282 (cross-list from eess.AS) [pdf, other]

Title: Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition

Steven Vander Eeckt, Hugo Van hamme

Comments: Accepted at ICASSP 2023. 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1363] arXiv:2210.15285 (cross-list from cs.SD) [pdf, other]

Title: SAN: a robust end-to-end ASR model architecture

Zeping Min, Qian Ge, Guanhua Huang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1364] arXiv:2210.15368 (cross-list from cs.SD) [pdf, other]

Title: A Training and Inference Strategy Using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech

Li-Wei Chen, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Accepted by Interspeech 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1365] arXiv:2210.15370 (cross-list from cs.SD) [pdf, other]

Title: CasNet: Investigating Channel Robustness for Speech Separation

Fan-Lin Wang, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1366] arXiv:2210.15377 (cross-list from cs.IR) [pdf, other]

Title: Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

Miriam Anschütz, Tobias Eder, Georg Groh

Comments: 8 pages, 5 figures, published at 2023 IEEE 17th International Conference on Semantic Computing (ICSC)

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1367] arXiv:2210.15386 (cross-list from cs.SD) [pdf, other]

Title: Opening the Black Box of wav2vec Feature Encoder

Kwanghee Choi, Eun Jung Yeo

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1368] arXiv:2210.15445 (cross-list from eess.AS) [pdf, other]

Title: Efficient Utilization of Large Pre-Trained Models for Low Resource ASR

Peter Vieting, Christoph Lüscher, Julian Dierkes, Ralf Schlüter, Hermann Ney

Comments: Accepted at ICASSP SASB 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1369] arXiv:2210.15447 (cross-list from cs.SD) [pdf, other]

Title: Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech

Takaaki Saeki, Heiga Zen, Zhehuai Chen, Nobuyuki Morioka, Gary Wang, Yu Zhang, Ankur Bapna, Andrew Rosenberg, Bhuvana Ramabhadran

Comments: To appear in ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1370] arXiv:2210.15629 (cross-list from cs.LG) [pdf, html, other]

Title: Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks

Edwin Zhang, Yujie Lu, William Wang, Amy Zhang

Comments: ICLR 2024, Project and code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1371] arXiv:2210.15631 (cross-list from eess.AS) [pdf, other]

Title: Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition

Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang

Comments: Accepted by ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1372] arXiv:2210.15638 (cross-list from cs.SD) [pdf, other]

Title: LyricJam Sonic: A Generative System for Real-Time Composition and Musical Improvisation

Olga Vechtomova, Gaurav Sahu

Comments: 15 pages, 9 figures, 2 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1373] arXiv:2210.15715 (cross-list from eess.AS) [pdf, other]

Title: Simulating realistic speech overlaps improves multi-talker ASR

Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Comments: v2: fix minor typo

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1374] arXiv:2210.15781 (cross-list from eess.AS) [pdf, other]

Title: A Compact End-to-End Model with Local and Global Context for Spoken Language Identification

Fei Jia, Nithin Rao Koluguri, Jagadeesh Balam, Boris Ginsburg

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1375] arXiv:2210.15868 (cross-list from cs.SD) [pdf, other]

Title: Residual Adapters for Few-Shot Text-to-Speech Speaker Adaptation

Nobuyuki Morioka, Heiga Zen, Nanxin Chen, Yu Zhang, Yifan Ding

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1376] arXiv:2210.15876 (cross-list from eess.AS) [pdf, other]

Title: Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition

Yist Y. Lin, Tao Han, Haihua Xu, Van Tung Pham, Yerbolat Khassanov, Tze Yuang Chong, Yi He, Lu Lu, Zejun Ma

Comments: 5 pages, 3 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1377] arXiv:2210.15882 (cross-list from cs.LG) [pdf, other]

Title: Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?

Byung-Hak Kim, Zhongfen Deng, Philip S. Yu, Varun Ganapathi

Comments: To appear in Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (Louhi 2022), Virtual, December 7, 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1378] arXiv:2210.16031 (cross-list from cs.CV) [pdf, other]

Title: UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance

Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu, Hu Yang, Guohao Li, Zhanpeng Wang, Zhifan Feng, Qiaoqiao She, Yajuan Lyu, Hua Wu

Comments: First Version, 16 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1379] arXiv:2210.16045 (cross-list from cs.SD) [pdf, other]

Title: Towards zero-shot Text-based voice editing using acoustic context conditioning, utterance embeddings, and reference encoders

Jason Fong, Yun Wang, Prabhav Agrawal, Vimal Manohar, Jilong Wu, Thilo Köhler, Qing He

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1380] arXiv:2210.16062 (cross-list from q-bio.NC) [pdf, other]

Title: Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Concepts

Paul Stoewer, Achim Schilling, Andreas Maier, Patrick Krauss

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1381] arXiv:2210.16431 (cross-list from cs.CV) [pdf, other]

Title: DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention

Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou

Comments: Published in ACM TKDD2022 (ACM Transactions on Knowledge Discovery from Data)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1382] arXiv:2210.16481 (cross-list from eess.AS) [pdf, other]

Title: Accelerating RNN-T Training and Inference Using CTC guidance

Yongqiang Wang, Zhehuai Chen, Chengjian Zheng, Yu Zhang, Wei Han, Parisa Haghani

Comments: submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1383] arXiv:2210.16611 (cross-list from eess.AS) [pdf, other]

Title: Application of Knowledge Distillation to Multi-task Speech Representation Learning

Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser

Comments: Speech representation learning, multi-task training, wav2vec, HuBERT, knowledge distillation

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1384] arXiv:2210.16642 (cross-list from cs.SD) [pdf, other]

Title: Unifying the Discrete and Continuous Emotion labels for Speech Emotion Recognition

Roshan Sharma, Hira Dhamyal, Bhiksha Raj, Rita Singh

Comments: Under Review at ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1385] arXiv:2210.16663 (cross-list from eess.AS) [pdf, other]

Title: BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe

Comments: v1: Accepted to Findings of EMNLP2022, v2: Minor corrections and clearer derivation of Eq. (21)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1386] arXiv:2210.16739 (cross-list from eess.AS) [pdf, other]

Title: DuDe: Dual-Decoder Multilingual ASR for Indian Languages using Common Label Set

Arunkumar A, Mudit Batra, Umesh S

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1387] arXiv:2210.16850 (cross-list from cs.LG) [pdf, other]

Title: Medical Codes Prediction from Clinical Notes: From Human Coders to Machines

Byung-Hak Kim

Comments: The 11th Bay Area Machine Learning Symposium (BayLearn 2022), San Francisco, CA, October 20, 2022. arXiv admin note: substantial text overlap with arXiv:2210.15882. substantial text overlap with arXiv:2107.10650

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1388] arXiv:2210.17027 (cross-list from cs.SD) [pdf, other]

Title: Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1389] arXiv:2210.17079 (cross-list from cs.SD) [pdf, other]

Title: FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition

Xingchen Song, Di Wu, Binbin Zhang, Zhiyong Wu, Wenpeng Li, Dongfang Li, Pengshen Zhang, Zhendong Peng, Fuping Pan, Changbao Zhu, Zhongqin Wu

Comments: 8 pages, plus 3 appendix

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1390] arXiv:2210.17143 (cross-list from cs.SD) [pdf, other]

Title: Exploring Train and Test-Time Augmentations for Audio-Language Learning

Eungbeom Kim, Jinhee Kim, Yoori Oh, Kyungsu Kim, Minju Park, Jaeheon Sim, Jinwoo Lee, Kyogu Lee

Comments: 5 pages, 4 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1391] arXiv:2210.17209 (cross-list from cs.HC) [pdf, other]

Title: The Effect of Multiple Replies for Natural Language Generation Chatbots

Eason Chen

Comments: 5 pages

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1392] arXiv:2210.17236 (cross-list from cs.PL) [pdf, other]

Title: When Language Model Meets Private Library

Daoguang Zan, Bei Chen, Zeqi Lin, Bei Guan, Yongji Wang, Jian-Guang Lou

Comments: EMNLP 2022 Findings

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1393] arXiv:2210.17264 (cross-list from cs.SD) [pdf, html, other]

Title: Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation

Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, Georgia Maniati, Panos Kakoulidis, June Sig Sung, Inchul Hwang, Spyros Raptis, Aimilios Chalamandaris, Pirros Tsiakoulis

Comments: Fundamental changes to the model described and experimental procedure

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1394] arXiv:2210.17316 (cross-list from eess.AS) [pdf, other]

Title: There is more than one kind of robustness: Fooling Whisper with adversarial examples

Raphael Olivier, Bhiksha Raj

Comments: Accepted at InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1395] arXiv:2210.17406 (cross-list from cs.LG) [pdf, other]

Title: Emergent Linguistic Structures in Neural Networks are Fragile

Emanuele La Malfa, Matthew Wicker, Marta Kwiatkowska

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1396] arXiv:2210.17437 (cross-list from cs.LG) [pdf, html, other]

Title: Learning New Tasks from a Few Examples with Soft-Label Prototypes

Avyav Kumar Singh, Ekaterina Shutova, Helen Yannakoudakis

Comments: Proceedings of the 9th Workshop on Representation Learning for NLP (2024), Pages 215 to 236

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1397] arXiv:2210.17546 (cross-list from cs.LG) [pdf, other]

Title: Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy

Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)