Computation and Language

Authors and titles for October 2022

[1301] arXiv:2210.10436 (cross-list from cs.AI) [pdf, other]

Title: LightEA: A Scalable, Robust, and Interpretable Entity Alignment Framework via Three-view Label Propagation

Xin Mao, Wenting Wang, Yuanbin Wu, Man Lan

Comments: 15 pages; Accepted by EMNLP2022 (Main Conf)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1302] arXiv:2210.10584 (cross-list from cs.IR) [pdf, other]

Title: Enhanced vectors for top-k document retrieval in Question Answering

Mohammed Hammad

Comments: Year-2019

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1303] arXiv:2210.10634 (cross-list from cs.IR) [pdf, other]

Title: RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Honglei Zhuang, Zhen Qin, Rolf Jagerman, Kai Hui, Ji Ma, Jing Lu, Jianmo Ni, Xuanhui Wang, Michael Bendersky

Comments: 13 pages

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1304] arXiv:2210.10695 (cross-list from cs.IR) [pdf, other]

Title: Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking

Tim Baumgärtner, Leonardo F. R. Ribeiro, Nils Reimers, Iryna Gurevych

Comments: Accepted at EMNLP 2022

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1305] arXiv:2210.10820 (cross-list from cs.CV) [pdf, other]

Title: VTC: Improving Video-Text Retrieval with User Comments

Laura Hanu, James Thewlis, Yuki M. Asano, Christian Rupprecht

Comments: Accepted paper at the European Conference on Computer Vision (ECCV) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1306] arXiv:2210.10879 (cross-list from cs.LG) [pdf, other]

Title: G-Augment: Searching for the Meta-Structure of Data Augmentation Policies for ASR

Gary Wang, Ekin D.Cubuk, Andrew Rosenberg, Shuyang Cheng, Ron J. Weiss, Bhuvana Ramabhadran, Pedro J. Moreno, Quoc V. Le, Daniel S. Park

Comments: 6 pages, accepted at SLT 2022. Updated with copyright

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1307] arXiv:2210.10914 (cross-list from cs.CV) [pdf, other]

Title: Prophet Attention: Predicting Attention with Future Attention for Image Captioning

Fenglin Liu, Xuancheng Ren, Xian Wu, Wei Fan, Yuexian Zou, Xu Sun

Comments: Accepted by NeurIPS 2020

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1308] arXiv:2210.10994 (cross-list from cs.AI) [pdf, other]

Title: MBTI Personality Prediction for Fictional Characters Using Movie Scripts

Yisi Sang, Xiangyang Mou, Mo Yu, Dakuo Wang, Jing Li, Jeffrey Stanton

Comments: paper accepted to EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1309] arXiv:2210.11065 (cross-list from cs.CV) [pdf, other]

Title: MovieCLIP: Visual Scene Recognition in Movies

Digbalay Bose, Rajat Hebbar, Krishna Somandepalli, Haoyang Zhang, Yin Cui, Kree Cole-McLaughlin, Huisheng Wang, Shrikanth Narayanan

Comments: Accepted to 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023). Project website with supplemental material: this https URL. Revised version with updated author affiliations

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[1310] arXiv:2210.11109 (cross-list from cs.CV) [pdf, other]

Title: Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation

Yu Zhao, Jianguo Wei, Zhichao Lin, Yueheng Sun, Meishan Zhang, Min Zhang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1311] arXiv:2210.11233 (cross-list from cs.AI) [pdf, other]

Title: Context-driven Visual Object Recognition based on Knowledge Graphs

Sebastian Monka, Lavdim Halilaj, Achim Rettinger

Comments: ISWC 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Symbolic Computation (cs.SC)

[1312] arXiv:2210.11253 (cross-list from cs.CV) [pdf, other]

Title: Image Semantic Relation Generation

Mingzhe Du

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1313] arXiv:2210.11416 (cross-list from cs.LG) [pdf, other]

Title: Scaling Instruction-Finetuned Language Models

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Zhao, Yanping Huang, Andrew Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

Comments: Public checkpoints: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1314] arXiv:2210.11612 (cross-list from stat.AP) [pdf, other]

Title: Searching for a higher power in the human evaluation of MT

Johnny Tian-Zheng Wei, Tom Kocmi, Christian Federmann

Comments: WMT 2022

Subjects: Applications (stat.AP); Computation and Language (cs.CL)

[1315] arXiv:2210.11618 (cross-list from cs.LG) [pdf, other]

Title: Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve

Giannis Daras, Negin Raoof, Zoi Gkalitsiou, Alexandros G. Dimakis

Comments: Accepted at NeurIPS 2022. 22 pages, 11 Figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1316] arXiv:2210.11630 (cross-list from cs.HC) [pdf, other]

Title: Using Large Language Models to Enhance Programming Error Messages

Juho Leinonen, Arto Hellas, Sami Sarsa, Brent Reeves, Paul Denny, James Prather, Brett A. Becker

Comments: 7 pages, accepted for publication at SIGCSE TS 2023

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1317] arXiv:2210.11794 (cross-list from cs.LG) [pdf, other]

Title: Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences

Aosong Feng, Irene Li, Yuang Jiang, Rex Ying

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1318] arXiv:2210.11929 (cross-list from cs.CV) [pdf, other]

Title: LiteVL: Efficient Video-Language Learning with Enhanced Spatial-Temporal Modeling

Dongsheng Chen, Chaofan Tao, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu

Comments: 13 pages, 6 figures, accepted by EMNLP 2022 main conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1319] arXiv:2210.12040 (cross-list from cs.LG) [pdf, other]

Title: Neuro-Symbolic Causal Reasoning Meets Signaling Game for Emergent Semantic Communications

Christo Kurisummoottil Thomas, Walid Saad

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT)

[1320] arXiv:2210.12112 (cross-list from cs.CV) [pdf, other]

Title: Describing Sets of Images with Textual-PCA

Oded Hupert, Idan Schwartz, Lior Wolf

Comments: Accepted to Findings of EMNLP'22

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1321] arXiv:2210.12214 (cross-list from cs.SD) [pdf, other]

Title: Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation

Thien Nguyen, Nathalie Tran, Liuhui Deng, Thiago Fraga da Silva, Matthew Radzihovsky, Roger Hsiao, Henry Mason, Stefan Braun, Erik McDermott, Dogan Can, Pawel Swietojanski, Lyan Verwimp, Sibel Oyman, Tresi Arvizo, Honza Silovsky, Arnab Ghoshal, Mathieu Martel, Bharat Ram Ambati, Mohamed Ali

Comments: 5 pages, 1 figure, submitted to ICASSP 2023, *: equal contributions

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1322] arXiv:2210.12217 (cross-list from cs.AI) [pdf, other]

Title: Entailer: Answering Questions with Faithful and Truthful Chains of Reasoning

Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark

Comments: accepted at EMNLP 2022. arXiv admin note: substantial text overlap with arXiv:2204.13074

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1323] arXiv:2210.12444 (cross-list from cs.CV) [pdf, other]

Title: Weakly-Supervised Temporal Article Grounding

Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad Ayyubi, Heng Ji, Shih-Fu Chang

Comments: EMNLP 2022, this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[1324] arXiv:2210.12485 (cross-list from cs.AI) [pdf, other]

Title: DANLI: Deliberative Agent for Following Natural Language Instructions

Yichi Zhang, Jianing Yang, Jiayi Pan, Shane Storks, Nikhil Devraj, Ziqiao Ma, Keunwoo Peter Yu, Yuwei Bao, Joyce Chai

Comments: Accepted in EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)

[1325] arXiv:2210.12487 (cross-list from cs.AI) [pdf, other]

Title: MetaLogic: Logical Reasoning Explanations with Fine-Grained Structure

Yinya Huang, Hongming Zhang, Ruixin Hong, Xiaodan Liang, Changshui Zhang, Dong Yu

Comments: To appear at the main conference of EMNLP 2022

Journal-ref: EMNLP 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)

[1326] arXiv:2210.12511 (cross-list from cs.AI) [pdf, other]

Title: DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents

Ziqiao Ma, Ben VanDerPloeg, Cristian-Paul Bara, Huang Yidong, Eui-In Kim, Felix Gervits, Matthew Marge, Joyce Chai

Comments: Findings of EMNLP, 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1327] arXiv:2210.12530 (cross-list from cs.LG) [pdf, other]

Title: LMPriors: Pre-Trained Language Models as Task-Specific Priors

Kristy Choi, Chris Cundy, Sanjari Srivastava, Stefano Ermon

Comments: First two authors contributed equally

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1328] arXiv:2210.12874 (cross-list from cs.LG) [pdf, other]

Title: Global Contrastive Batch Sampling via Optimization on Sample Permutations

Vin Sachidananda, Ziyi Yang, Chenguang Zhu

Comments: ICML 2023; 21 pages, 7 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1329] arXiv:2210.13016 (cross-list from cs.LG) [pdf, other]

Title: Cards Against AI: Predicting Humor in a Fill-in-the-blank Party Game

Dan Ofer, Dafna Shahaf

Comments: Conditionally accepted in EMNLP 2022 short findings. 5 pages

Journal-ref: https://aclanthology.org/2022.findings-emnlp.394

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); General Literature (cs.GL)

[1330] arXiv:2210.13076 (cross-list from cs.CV) [pdf, other]

Title: Towards Unifying Reference Expression Generation and Comprehension

Duo Zheng, Tao Kong, Ya Jing, Jiaan Wang, Xiaojie Wang

Comments: Accepted to EMNLP 2022 (main conference)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1331] arXiv:2210.13189 (cross-list from eess.AS) [pdf, other]

Title: Can Visual Context Improve Automatic Speech Recognition for an Embodied Agent?

Pradip Pramanick, Chayan Sarkar

Comments: Accepted in EMNLP '22

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)

[1332] arXiv:2210.13238 (cross-list from q-bio.QM) [pdf, other]

Title: Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification

Andrey Sakhovskiy, Elena Tutubalina

Comments: This paper is accepted to Journal of Biomedical Informatics

Journal-ref: Journal of Biomedical Informatics, Volume 135, 2022, 104182, ISSN 1532-0464

Subjects: Quantitative Methods (q-bio.QM); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1333] arXiv:2210.13382 (cross-list from cs.LG) [pdf, html, other]

Title: Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task

Kenneth Li, Aspen K. Hopkins, David Bau, Fernanda Viégas, Hanspeter Pfister, Martin Wattenberg

Comments: ICLR 2023 oral (notable-top-5%): this https URL ; code: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1334] arXiv:2210.13459 (cross-list from cs.LG) [pdf, other]

Title: Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation

Dongkyu Lee, Ka Chun Cheung, Nevin L. Zhang

Comments: EMNLP 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1335] arXiv:2210.13526 (cross-list from q-bio.NC) [pdf, other]

Title: Computational Inference in Cognitive Science: Operational, Societal and Ethical Considerations

Baihan Lin

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1336] arXiv:2210.13623 (cross-list from cs.AI) [pdf, other]

Title: Reinforcement Learning and Bandits for Speech and Language Processing: Tutorial, Review and Outlook

Baihan Lin

Comments: To appear in Expert Systems with Applications. Accompanying INTERSPEECH 2022 Tutorial on the same topic. Including latest advancements in large language models (LLMs)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1337] arXiv:2210.13626 (cross-list from cs.CV) [pdf, other]

Title: VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz

Comments: Accepted at WACV 2023. For code and supplementary material, see this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1338] arXiv:2210.13700 (cross-list from eess.AS) [pdf, other]

Title: Does Joint Training Really Help Cascaded Speech Translation?

Viet Anh Khoa Tran, David Thulke, Yingbo Gao, Christian Herold, Hermann Ney

Comments: Accepted to EMNLP 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1339] arXiv:2210.13729 (cross-list from cs.AI) [pdf, other]

Title: Hybrid Reinforced Medical Report Generation with M-Linear Attention and Repetition Penalty

Wenting Xu, Zhenghua Xu, Junyang Chen, Chang Qi, Thomas Lukasiewicz

Comments: This paper is current under peer-review in IEEE TNNLS

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1340] arXiv:2210.13803 (cross-list from cs.SD) [pdf, other]

Title: Adapitch: Adaption Multi-Speaker Text-to-Speech Conditioned on Pitch Disentangling with Untranscribed Data

Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1341] arXiv:2210.13805 (cross-list from cs.SD) [pdf, other]

Title: Improving Speech Representation Learning via Speech-level and Phoneme-level Masking Approach

Xulong Zhang, Jianzong Wang, Ning Cheng, Kexin Zhu, Jing Xiao

Comments: Accepted by MSN2022, The 18th International Conference on Mobility, Sensing and Networking

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1342] arXiv:2210.13811 (cross-list from cs.SD) [pdf, other]

Title: MetaSpeech: Speech Effects Switch Along with Environment for Metaverse

Xulong Zhang, Jianzong Wang, Ning Cheng, Jing Xiao

Comments: Accepted by AI2OT2022, The Third International Workshop on Artificial Intelligence Applications in Internet of Things

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1343] arXiv:2210.13918 (cross-list from cs.LG) [pdf, other]

Title: Differentially Private Language Models for Secure Data Sharing

Justus Mattern, Zhijing Jin, Benjamin Weggenmann, Bernhard Schoelkopf, Mrinmaya Sachan

Comments: Accepted at EMNLP 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1344] arXiv:2210.13942 (cross-list from cs.LG) [pdf, other]

Title: Entity Divider with Language Grounding in Multi-Agent Reinforcement Learning

Ziluo Ding, Wanpeng Zhang, Junpeng Yue, Xiangjun Wang, Tiejun Huang, Zongqing Lu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[1345] arXiv:2210.13979 (cross-list from cs.LG) [pdf, other]

Title: Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks

Arijit Sehanobish, Kawshik Kannan, Nabila Abraham, Anasuya Das, Benjamin Odry

Comments: EMNLP'22 Industry Track. Extended Abstract presented at Machine Learning for Health (ML4H) symposium 2022, November 28th, 2022, New Orleans, United States & Virtual, this http URL, 16 pages

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1346] arXiv:2210.14037 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Softmax for Uncertainty Approximation in Text Classification

Andreas Nugaard Holm, Dustin Wright, Isabelle Augenstein

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1347] arXiv:2210.14395 (cross-list from cs.CV) [pdf, other]

Title: IMU2CLIP: Multimodal Contrastive Learning for IMU Motion Sensors from Egocentric Videos and Text

Seungwhan Moon, Andrea Madotto, Zhaojiang Lin, Alireza Dirafzoon, Aparajita Saraf, Amy Bearman, Babak Damavandi

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1348] arXiv:2210.14406 (cross-list from eess.AS) [pdf, other]

Title: RedPen: Region- and Reason-Annotated Dataset of Unnatural Speech

Kyumin Park, Keon Lee, Daeyoung Kim, Dongyeop Kang

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[1349] arXiv:2210.14593 (cross-list from cs.LG) [pdf, other]

Title: Scaling Laws Beyond Backpropagation

Matthew J. Filipovich, Alessandro Cappelli, Daniel Hesslow, Julien Launay

Comments: I Can't Believe It's Not Better Workshop, NeurIPS 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE); Machine Learning (stat.ML)

[1350] arXiv:2210.14596 (cross-list from cs.AI) [pdf, other]

Title: Scaling Knowledge Graphs for Automating AI of Digital Twins

Joern Ploennigs, Konstantinos Semertzidis, Fabio Lorenzi, Nandana Mihindukulasooriya

Comments: Accepted at ISWC 2022

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[1351] arXiv:2210.14691 (cross-list from cs.SD) [pdf, other]

Title: Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

Wei Wang, Chao Zhang, Xiaopei Wu

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1352] arXiv:2210.14699 (cross-list from cs.SE) [pdf, other]

Title: Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic?

Jean-Baptiste Döderlein, Mathieu Acher, Djamel Eddine Khelladi, Benoit Combemale

Comments: 14 pages, 3 Figures (not counted the subfigures), 10 Tables

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL); Programming Languages (cs.PL)

[1353] arXiv:2210.14760 (cross-list from astro-ph.IM) [pdf, other]

Title: A New Task: Deriving Semantic Class Targets for the Physical Sciences

Micah Bowles, Hongming Tang, Eleni Vardoulaki, Emma L. Alexander, Yan Luo, Lawrence Rudnick, Mike Walmsley, Fiona Porter, Anna M. M. Scaife, Inigo Val Slijepcevic, Gary Segal

Comments: 6 pages, 1 figure, Accepted at Fifth Workshop on Machine Learning and the Physical Sciences (NeurIPS 2022), Neural Information Processing Systems 2022

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Computation and Language (cs.CL)

[1354] arXiv:2210.14862 (cross-list from cs.CV) [pdf, other]

Title: Visual Semantic Parsing: From Images to Abstract Meaning Representation

Mohamed Ashraf Abdelsalam, Zhan Shi, Federico Fancellu, Kalliopi Basioti, Dhaivat J. Bhatt, Vladimir Pavlovic, Afsaneh Fazly

Comments: published in CoNLL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1355] arXiv:2210.14868 (cross-list from cs.LG) [pdf, other]

Title: Multi-lingual Evaluation of Code Generation Models

Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Uddin Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta, Dan Roth, Bing Xiang

Comments: Code and data release: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1356] arXiv:2210.15016 (cross-list from cs.PL) [pdf, other]

Title: TPU-MLIR: A Compiler For TPU Using MLIR

Pengchao Hu, Man Lu, Lei Wang, Guoyue Jiang

Comments: A way to design AI Compiler for ASIC chips by MLIR

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1357] arXiv:2210.15042 (cross-list from cs.CR) [pdf, other]

Title: Privately Fine-Tuning Large Language Models with Differential Privacy

Rouzbeh Behnia, Mohamamdreza Ebrahimi, Jason Pacheco, Balaji Padmanabhan

Comments: Publised at IEEE ICDM Workshop on Machine Learning for Cybersecurity (MLC) 2022

Journal-ref: 2022 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 560-566

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL)

[1358] arXiv:2210.15110 (cross-list from cs.CV) [pdf, other]

Title: Masked Vision-Language Transformer in Fashion

Ge-Peng Ji, Mingcheng Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool

Comments: Accepted by Machine Intelligence Research (2023)

Journal-ref: Machine Intelligence Research. 20, 421-434 (2023)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1359] arXiv:2210.15131 (cross-list from cs.SD) [pdf, other]

Title: Towards High-Quality Neural TTS for Low-Resource Languages by Learning Compact Speech Representations

Haohan Guo, Fenglong Xie, Xixin Wu, Hui Lu, Helen Meng

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1360] arXiv:2210.15173 (cross-list from cs.SD) [pdf, other]

Title: Articulation GAN: Unsupervised modeling of articulatory learning

Gašper Beguš, Alan Zhou, Peter Wu, Gopala K Anumanchipalli

Comments: ICASSP 2023

Journal-ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1361] arXiv:2210.15237 (cross-list from eess.SP) [pdf, other]

Title: Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model

Ju-Hyung Lee, Dong-Ho Lee, Eunsoo Sheen, Thomas Choi, Jay Pujara

Comments: Accepted to IEEE ASILOMAR 2023 conference, 4 pages, 2 figures, 3 tables

Subjects: Signal Processing (eess.SP); Computation and Language (cs.CL)

[1362] arXiv:2210.15282 (cross-list from eess.AS) [pdf, other]

Title: Weight Averaging: A Simple Yet Effective Method to Overcome Catastrophic Forgetting in Automatic Speech Recognition

Steven Vander Eeckt, Hugo Van hamme

Comments: Accepted at ICASSP 2023. 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1363] arXiv:2210.15285 (cross-list from cs.SD) [pdf, other]

Title: SAN: a robust end-to-end ASR model architecture

Zeping Min, Qian Ge, Guanhua Huang

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1364] arXiv:2210.15368 (cross-list from cs.SD) [pdf, other]

Title: A Training and Inference Strategy Using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech

Li-Wei Chen, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Accepted by Interspeech 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1365] arXiv:2210.15370 (cross-list from cs.SD) [pdf, other]

Title: CasNet: Investigating Channel Robustness for Speech Separation

Fan-Lin Wang, Yao-Fei Cheng, Hung-Shin Lee, Yu Tsao, Hsin-Min Wang

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1366] arXiv:2210.15377 (cross-list from cs.IR) [pdf, other]

Title: Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

Miriam Anschütz, Tobias Eder, Georg Groh

Comments: 8 pages, 5 figures, published at 2023 IEEE 17th International Conference on Semantic Computing (ICSC)

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1367] arXiv:2210.15386 (cross-list from cs.SD) [pdf, other]

Title: Opening the Black Box of wav2vec Feature Encoder

Kwanghee Choi, Eun Jung Yeo

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1368] arXiv:2210.15445 (cross-list from eess.AS) [pdf, other]

Title: Efficient Utilization of Large Pre-Trained Models for Low Resource ASR

Peter Vieting, Christoph Lüscher, Julian Dierkes, Ralf Schlüter, Hermann Ney

Comments: Accepted at ICASSP SASB 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1369] arXiv:2210.15447 (cross-list from cs.SD) [pdf, other]

Title: Virtuoso: Massive Multilingual Speech-Text Joint Semi-Supervised Learning for Text-To-Speech

Takaaki Saeki, Heiga Zen, Zhehuai Chen, Nobuyuki Morioka, Gary Wang, Yu Zhang, Ankur Bapna, Andrew Rosenberg, Bhuvana Ramabhadran

Comments: To appear in ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1370] arXiv:2210.15629 (cross-list from cs.LG) [pdf, html, other]

Title: Language Control Diffusion: Efficiently Scaling through Space, Time, and Tasks

Edwin Zhang, Yujie Lu, Shinda Huang, William Wang, Amy Zhang

Comments: ICLR 2024, Project and code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1371] arXiv:2210.15631 (cross-list from eess.AS) [pdf, other]

Title: Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition

Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang

Comments: Accepted by ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1372] arXiv:2210.15638 (cross-list from cs.SD) [pdf, other]

Title: LyricJam Sonic: A Generative System for Real-Time Composition and Musical Improvisation

Olga Vechtomova, Gaurav Sahu

Comments: 15 pages, 9 figures, 2 tables

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1373] arXiv:2210.15715 (cross-list from eess.AS) [pdf, other]

Title: Simulating realistic speech overlaps improves multi-talker ASR

Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Comments: v2: fix minor typo

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1374] arXiv:2210.15781 (cross-list from eess.AS) [pdf, other]

Title: A Compact End-to-End Model with Local and Global Context for Spoken Language Identification

Fei Jia, Nithin Rao Koluguri, Jagadeesh Balam, Boris Ginsburg

Comments: Accepted to INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1375] arXiv:2210.15868 (cross-list from cs.SD) [pdf, other]

Title: Residual Adapters for Few-Shot Text-to-Speech Speaker Adaptation

Nobuyuki Morioka, Heiga Zen, Nanxin Chen, Yu Zhang, Yifan Ding

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1376] arXiv:2210.15876 (cross-list from eess.AS) [pdf, other]

Title: Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition

Yist Y. Lin, Tao Han, Haihua Xu, Van Tung Pham, Yerbolat Khassanov, Tze Yuang Chong, Yi He, Lu Lu, Zejun Ma

Comments: 5 pages, 3 figures, 4 tables

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1377] arXiv:2210.15882 (cross-list from cs.LG) [pdf, other]

Title: Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?

Byung-Hak Kim, Zhongfen Deng, Philip S. Yu, Varun Ganapathi

Comments: To appear in Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (Louhi 2022), Virtual, December 7, 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1378] arXiv:2210.16031 (cross-list from cs.CV) [pdf, other]

Title: UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance

Wei Li, Xue Xu, Xinyan Xiao, Jiachen Liu, Hu Yang, Guohao Li, Zhanpeng Wang, Zhifan Feng, Qiaoqiao She, Yajuan Lyu, Hua Wu

Comments: First Version, 16 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1379] arXiv:2210.16045 (cross-list from cs.SD) [pdf, other]

Title: Towards zero-shot Text-based voice editing using acoustic context conditioning, utterance embeddings, and reference encoders

Jason Fong, Yun Wang, Prabhav Agrawal, Vimal Manohar, Jilong Wu, Thilo Köhler, Qing He

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1380] arXiv:2210.16062 (cross-list from q-bio.NC) [pdf, other]

Title: Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Concepts

Paul Stoewer, Achim Schilling, Andreas Maier, Patrick Krauss

Subjects: Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1381] arXiv:2210.16431 (cross-list from cs.CV) [pdf, other]

Title: DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention

Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou

Comments: Published in ACM TKDD2022 (ACM Transactions on Knowledge Discovery from Data)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1382] arXiv:2210.16481 (cross-list from eess.AS) [pdf, other]

Title: Accelerating RNN-T Training and Inference Using CTC guidance

Yongqiang Wang, Zhehuai Chen, Chengjian Zheng, Yu Zhang, Wei Han, Parisa Haghani

Comments: submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1383] arXiv:2210.16611 (cross-list from eess.AS) [pdf, other]

Title: Application of Knowledge Distillation to Multi-task Speech Representation Learning

Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser

Comments: Speech representation learning, multi-task training, wav2vec, HuBERT, knowledge distillation

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1384] arXiv:2210.16642 (cross-list from cs.SD) [pdf, other]

Title: Unifying the Discrete and Continuous Emotion labels for Speech Emotion Recognition

Roshan Sharma, Hira Dhamyal, Bhiksha Raj, Rita Singh

Comments: Under Review at ICASSP 2023

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1385] arXiv:2210.16663 (cross-list from eess.AS) [pdf, other]

Title: BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe

Comments: v1: Accepted to Findings of EMNLP2022, v2: Minor corrections and clearer derivation of Eq. (21)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[1386] arXiv:2210.16739 (cross-list from eess.AS) [pdf, other]

Title: DuDe: Dual-Decoder Multilingual ASR for Indian Languages using Common Label Set

Arunkumar A, Mudit Batra, Umesh S

Comments: Submitted to ICASSP 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1387] arXiv:2210.16850 (cross-list from cs.LG) [pdf, other]

Title: Medical Codes Prediction from Clinical Notes: From Human Coders to Machines

Byung-Hak Kim

Comments: The 11th Bay Area Machine Learning Symposium (BayLearn 2022), San Francisco, CA, October 20, 2022. arXiv admin note: substantial text overlap with arXiv:2210.15882. substantial text overlap with arXiv:2107.10650

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1388] arXiv:2210.17027 (cross-list from cs.SD) [pdf, other]

Title: Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei

Comments: Submitted to ICASSP 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1389] arXiv:2210.17079 (cross-list from cs.SD) [pdf, other]

Title: FusionFormer: Fusing Operations in Transformer for Efficient Streaming Speech Recognition

Xingchen Song, Di Wu, Binbin Zhang, Zhiyong Wu, Wenpeng Li, Dongfang Li, Pengshen Zhang, Zhendong Peng, Fuping Pan, Changbao Zhu, Zhongqin Wu

Comments: 8 pages, plus 3 appendix

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1390] arXiv:2210.17143 (cross-list from cs.SD) [pdf, other]

Title: Exploring Train and Test-Time Augmentations for Audio-Language Learning

Eungbeom Kim, Jinhee Kim, Yoori Oh, Kyungsu Kim, Minju Park, Jaeheon Sim, Jinwoo Lee, Kyogu Lee

Comments: 5 pages, 4 figures

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1391] arXiv:2210.17209 (cross-list from cs.HC) [pdf, other]

Title: The Effect of Multiple Replies for Natural Language Generation Chatbots

Eason Chen

Comments: 5 pages

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1392] arXiv:2210.17236 (cross-list from cs.PL) [pdf, other]

Title: When Language Model Meets Private Library

Daoguang Zan, Bei Chen, Zeqi Lin, Bei Guan, Yongji Wang, Jian-Guang Lou

Comments: EMNLP 2022 Findings

Subjects: Programming Languages (cs.PL); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1393] arXiv:2210.17264 (cross-list from cs.SD) [pdf, html, other]

Title: Cross-lingual Text-To-Speech with Flow-based Voice Conversion for Improved Pronunciation

Nikolaos Ellinas, Georgios Vamvoukakis, Konstantinos Markopoulos, Georgia Maniati, Panos Kakoulidis, June Sig Sung, Inchul Hwang, Spyros Raptis, Aimilios Chalamandaris, Pirros Tsiakoulis

Comments: Fundamental changes to the model described and experimental procedure

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1394] arXiv:2210.17316 (cross-list from eess.AS) [pdf, other]

Title: There is more than one kind of robustness: Fooling Whisper with adversarial examples

Raphael Olivier, Bhiksha Raj

Comments: Accepted at InterSpeech 2023

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)

[1395] arXiv:2210.17406 (cross-list from cs.LG) [pdf, other]

Title: Emergent Linguistic Structures in Neural Networks are Fragile

Emanuele La Malfa, Matthew Wicker, Marta Kwiatkowska

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1396] arXiv:2210.17437 (cross-list from cs.LG) [pdf, html, other]

Title: Learning New Tasks from a Few Examples with Soft-Label Prototypes

Avyav Kumar Singh, Ekaterina Shutova, Helen Yannakoudakis

Comments: Proceedings of the 9th Workshop on Representation Learning for NLP (2024), Pages 215 to 236

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1397] arXiv:2210.17546 (cross-list from cs.LG) [pdf, other]

Title: Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy

Daphne Ippolito, Florian Tramèr, Milad Nasr, Chiyuan Zhang, Matthew Jagielski, Katherine Lee, Christopher A. Choquette-Choo, Nicholas Carlini

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)