Computation and Language

Authors and titles for May 2023

[2301] arXiv:2305.18373 (cross-list from cs.CV) [pdf, other]

Title: KAFA: Rethinking Image Ad Understanding with Knowledge-Augmented Feature Adaptation of Vision-Language Models

Zhiwei Jia, Pradyumna Narayana, Arjun R. Akula, Garima Pruthi, Hao Su, Sugato Basu, Varun Jampani

Comments: ACL 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2302] arXiv:2305.18391 (cross-list from cs.LG) [pdf, other]

Title: MemeGraphs: Linking Memes to Knowledge Graphs

Vasiliki Kougia, Simon Fetzel, Thomas Kirchmair, Erion Çano, Sina Moayed Baharlou, Sahand Sharifzadeh, Benjamin Roth

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2303] arXiv:2305.18396 (cross-list from cs.LG) [pdf, html, other]

Title: LLMs Can Understand Encrypted Prompt: Towards Privacy-Computing Friendly Transformers

Xuanqi Liu, Zhuotao Liu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[2304] arXiv:2305.18410 (cross-list from cs.LG) [pdf, other]

Title: Understanding Breast Cancer Survival: Using Causality and Language Models on Multi-omics Data

Mugariya Farooq, Shahad Hardan, Aigerim Zhumbhayeva, Yujia Zheng, Preslav Nakov, Kun Zhang

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Genomics (q-bio.GN); Methodology (stat.ME)

[2305] arXiv:2305.18449 (cross-list from cs.AI) [pdf, other]

Title: Taming AI Bots: Controllability of Neural States in Large Language Models

Stefano Soatto, Paulo Tabuada, Pratik Chaudhari, Tian Yu Liu

Comments: TLDR: AI Bots are stochastic dynamical systems whose mental state can be controlled by both the user and the designer. The space of meanings, defined as equivalence classes of sentences, is learned during fine-tuning with human supervision, and safeguarding can be designed into the bot by establishing controls both at its input and output

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Systems and Control (eess.SY)

[2306] arXiv:2305.18498 (cross-list from cs.PL) [pdf, other]

Title: ANPL: Towards Natural Programming with Interactive Decomposition

Di Huang, Ziyuan Nan, Xing Hu, Pengwei Jin, Shaohui Peng, Yuanbo Wen, Rui Zhang, Zidong Du, Qi Guo, Yewen Pu, Yunji Chen

Subjects: Programming Languages (cs.PL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2307] arXiv:2305.18500 (cross-list from cs.CV) [pdf, other]

Title: VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset

Sihan Chen, Handong Li, Qunbo Wang, Zijia Zhao, Mingzhen Sun, Xinxin Zhu, Jing Liu

Comments: Accepted by NeurIPS 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2308] arXiv:2305.18565 (cross-list from cs.CV) [pdf, other]

Title: PaLI-X: On Scaling up a Multilingual Vision and Language Model

Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, Siamak Shakeri, Mostafa Dehghani, Daniel Salz, Mario Lucic, Michael Tschannen, Arsha Nagrani, Hexiang Hu, Mandar Joshi, Bo Pang, Ceslee Montgomery, Paulina Pietrzyk, Marvin Ritter, AJ Piergiovanni, Matthias Minderer, Filip Pavetic, Austin Waters, Gang Li, Ibrahim Alabdulmohsin, Lucas Beyer, Julien Amelot, Kenton Lee, Andreas Peter Steiner, Yang Li, Daniel Keysers, Anurag Arnab, Yuanzhong Xu, Keran Rong, Alexander Kolesnikov, Mojtaba Seyedhosseini, Anelia Angelova, Xiaohua Zhai, Neil Houlsby, Radu Soricut

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2309] arXiv:2305.18569 (cross-list from cs.LG) [pdf, html, other]

Title: Fairness of ChatGPT

Yunqi Li, Lanjing Zhang, Yongfeng Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[2310] arXiv:2305.18596 (cross-list from cs.SD) [pdf, other]

Title: Building Accurate Low Latency ASR for Streaming Voice Search

Abhinav Goyal, Nikesh Garera

Comments: Accepted at ACL 2023 Industry Track

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2311] arXiv:2305.18623 (cross-list from cs.LG) [pdf, other]

Title: Alfred: A System for Prompted Weak Supervision

Peilin Yu, Stephen H. Bach

Comments: ACL 2023 System Demonstration Track

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2312] arXiv:2305.18675 (cross-list from cs.LG) [pdf, other]

Title: History Repeats: Overcoming Catastrophic Forgetting For Event-Centric Temporal Knowledge Graph Completion

Mehrnoosh Mirtaheri, Mohammad Rostami, Aram Galstyan

Comments: 14 pages, 6 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2313] arXiv:2305.18747 (cross-list from eess.AS) [pdf, other]

Title: Adapting Multi-Lingual ASR Models for Handling Multiple Talkers

Chenda Li, Yao Qian, Zhuo Chen, Naoyuki Kanda, Dongmei Wang, Takuya Yoshioka, Yanmin Qian, Michael Zeng

Comments: Accepted by Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2314] arXiv:2305.18752 (cross-list from cs.CV) [pdf, other]

Title: GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction

Rui Yang, Lin Song, Yanwei Li, Sijie Zhao, Yixiao Ge, Xiu Li, Ying Shan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2315] arXiv:2305.18756 (cross-list from cs.CV) [pdf, other]

Title: VSTAR: A Video-grounded Dialogue Dataset for Situated Semantic Understanding with Scene and Topic Transitions

Yuxuan Wang, Zilong Zheng, Xueliang Zhao, Jinpeng Li, Yueqian Wang, Dongyan Zhao

Comments: To appear at ACL 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2316] arXiv:2305.18786 (cross-list from cs.CV) [pdf, other]

Title: Scalable Performance Analysis for Vision-Language Models

Santiago Castro, Oana Ignat, Rada Mihalcea

Comments: Camera-ready version for *SEM 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2317] arXiv:2305.18787 (cross-list from cs.LG) [pdf, other]

Title: Universality and Limitations of Prompt Tuning

Yihan Wang, Jatin Chauhan, Wei Wang, Cho-Jui Hsieh

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2318] arXiv:2305.18869 (cross-list from cs.LG) [pdf, other]

Title: Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning

Yingcong Li, Kartik Sreenivasan, Angeliki Giannou, Dimitris Papailiopoulos, Samet Oymak

Comments: Accepted for NeurIPS 2023. Changes in this version: refined title, restructured content, included new out-of-distribution experiments, and code now available

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2319] arXiv:2305.18887 (cross-list from cs.LG) [pdf, other]

Title: How Does Information Bottleneck Help Deep Learning?

Kenji Kawaguchi, Zhun Deng, Xu Ji, Jiaoyang Huang

Comments: Accepted at ICML 2023. Code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

[2320] arXiv:2305.18925 (cross-list from eess.AS) [pdf, other]

Title: Investigating model performance in language identification: beyond simple error statistics

Suzy J. Styles, Victoria Y. H. Chua, Fei Ting Woon, Hexin Liu, Leibny Paola Garcia Perera, Sanjeev Khudanpur, Andy W. H. Khong, Justin Dauwels

Comments: Accepted to Interspeech 2023, 5 pages, 5 figures

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2321] arXiv:2305.18975 (cross-list from eess.AS) [pdf, other]

Title: Voice Conversion With Just Nearest Neighbors

Matthew Baas, Benjamin van Niekerk, Herman Kamper

Comments: 5 page, 1 table, 2 figures. Accepted at Interspeech 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2322] arXiv:2305.18997 (cross-list from cs.HC) [pdf, other]

Title: GPT Models in Construction Industry: Opportunities, Limitations, and a Use Case Validation

Abdullahi Saka, Ridwan Taiwo, Nurudeen Saka, Babatunde Salami, Saheed Ajayi, Kabiru Akande, Hadi Kazemi

Comments: 58 pages, 20 figures

Journal-ref: Developments in the Built Environment Volume 17 , March 2024, 100300

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2323] arXiv:2305.19011 (cross-list from eess.AS) [pdf, other]

Title: MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Models

Yu-Hsiang Wang, Huang-Yu Chen, Kai-Wei Chang, Winston Hsu, Hung-yi Lee

Comments: Accepted to IEEE ASRU 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2324] arXiv:2305.19019 (cross-list from cs.IR) [pdf, other]

Title: Event-Centric Query Expansion in Web Search

Yanan Zhang, Weijie Cui, Yangfan Zhang, Xiaoling Bai, Zhe Zhang, Jin Ma, Xiang Chen, Tianhua Zhou

Comments: ACL 2023 Industry Track

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2325] arXiv:2305.19164 (cross-list from cs.CV) [pdf, other]

Title: LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images

Viraj Prabhu, Sriram Yenamandra, Prithvijit Chattopadhyay, Judy Hoffman

Comments: NeurIPS 2023 camera ready. Project webpage: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2326] arXiv:2305.19165 (cross-list from cs.AI) [pdf, other]

Title: Strategic Reasoning with Language Models

Kanishk Gandhi, Dorsa Sadigh, Noah D. Goodman

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT); Human-Computer Interaction (cs.HC)

[2327] arXiv:2305.19195 (cross-list from cs.CV) [pdf, other]

Title: PanoGen: Text-Conditioned Panoramic Environment Generation for Vision-and-Language Navigation

Jialu Li, Mohit Bansal

Comments: Project Webpage: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2328] arXiv:2305.19255 (cross-list from eess.AS) [pdf, other]

Title: A Stutter Seldom Comes Alone -- Cross-Corpus Stuttering Detection as a Multi-label Problem

Sebastian P. Bayerl, Dominik Wagner, Ilja Baumann, Florian Hönig, Tobias Bocklet, Elmar Nöth, Korbinian Riedhammer

Comments: Accepted for presentation at Interspeech 2023. arXiv admin note: substantial text overlap with arXiv:2210.15982

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[2329] arXiv:2305.19269 (cross-list from eess.AS) [pdf, other]

Title: Make-A-Voice: Unified Voice Synthesis With Discrete Representation

Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Luping Liu, Zhenhui Ye, Ziyue Jiang, Chao Weng, Zhou Zhao, Dong Yu

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD)

[2330] arXiv:2305.19280 (cross-list from cs.LG) [pdf, other]

Title: Large language models improve Alzheimer's disease diagnosis using multi-modality data

Yingjie Feng, Jun Wang, Xianfeng Gu, Xiaoyin Xu, Min Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2331] arXiv:2305.19308 (cross-list from cs.SE) [pdf, other]

Title: SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Models

Hongxin Li, Jingran Su, Yuntao Chen, Qing Li, Zhaoxiang Zhang

Comments: Accepted to NeurIPS 2023

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2332] arXiv:2305.19373 (cross-list from cs.LG) [pdf, other]

Title: Mining Themes in Clinical Notes to Identify Phenotypes and to Predict Length of Stay in Patients admitted with Heart Failure

Ankita Agarwal, Tanvi Banerjee, William L. Romine, Krishnaprasad Thirunarayan, Lingwei Chen, Mia Cajita

Comments: 9 pages, 3 figures, 3 tables, Accepted as a regular full paper at IEEE INTERNATIONAL CONFERENCE ON DIGITAL HEALTH, 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2333] arXiv:2305.19383 (cross-list from quant-ph) [pdf, other]

Title: Quantum Natural Language Processing based Sentiment Analysis using lambeq Toolkit

Srinjoy Ganguly, Sai Nandan Morapakula, Luis Miguel Pozo Coronado

Comments: 6 pages, 9 figures

Journal-ref: 10.1109/ICPC2T53885.2022.9776836

Subjects: Quantum Physics (quant-ph); Computation and Language (cs.CL)

[2334] arXiv:2305.19396 (cross-list from eess.AS) [pdf, other]

Title: Resource-Efficient Fine-Tuning Strategies for Automatic MOS Prediction in Text-to-Speech for Low-Resource Languages

Phat Do, Matt Coler, Jelske Dijkstra, Esther Klabbers

Comments: Accepted at INTERSPEECH 2023

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2335] arXiv:2305.19402 (cross-list from cs.CV) [pdf, other]

Title: Contextual Vision Transformers for Robust Representation Learning

Yujia Bao, Theofanis Karaletsos

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2336] arXiv:2305.19563 (cross-list from cs.SD) [pdf, other]

Title: Zero-Shot Automatic Pronunciation Assessment

Hongfu Liu, Mingqian Shi, Ye Wang

Comments: Accepted to Interspeech 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2337] arXiv:2305.19567 (cross-list from cs.SD) [pdf, other]

Title: DC CoMix TTS: An End-to-End Expressive TTS with Discrete Code Collaborated with Mixer

Yerin Choi, Myoung-Wan Koo

Comments: Accepted in Interspeech 2023

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[2338] arXiv:2305.19664 (cross-list from cs.CV) [pdf, other]

Title: Unveiling Cross Modality Bias in Visual Question Answering: A Causal View with Possible Worlds VQA

Ali Vosoughi, Shijian Deng, Songyang Zhang, Yapeng Tian, Chenliang Xu, Jiebo Luo

Comments: 22 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[2339] arXiv:2305.19734 (cross-list from cs.AI) [pdf, other]

Title: Knowledge Base Question Answering for Space Debris Queries

Paul Darm, Antonio Valerio Miceli-Barone, Shay B. Cohen, Annalisa Riccardi

Comments: 7 pages, ACL 2023 industry track

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[2340] arXiv:2305.19840 (cross-list from cs.IR) [pdf, html, other]

Title: BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language

Konrad Wojtasik, Vadim Shishkin, Kacper Wołowiec, Arkadiusz Janz, Maciej Piasecki

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2341] arXiv:2305.19911 (cross-list from cs.LG) [pdf, other]

Title: Neuron to Graph: Interpreting Language Model Neurons at Scale

Alex Foote, Neel Nanda, Esben Kran, Ioannis Konstas, Shay Cohen, Fazl Barez

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2342] arXiv:2305.19972 (cross-list from eess.AS) [pdf, html, other]

Title: VILAS: Exploring the Effects of Vision and Language Context in Automatic Speech Recognition

Ziyi Ni, Minglun Han, Feilong Chen, Linghui Meng, Jing Shi, Pin Lv, Bo Xu

Comments: Accepted to ICASSP 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2343] arXiv:2305.19999 (cross-list from cs.LG) [pdf, other]

Title: Beam Tree Recursive Cells

Jishnu Ray Chowdhury, Cornelia Caragea

Comments: Accepted in ICML 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2344] arXiv:2305.20010 (cross-list from cs.AI) [pdf, other]

Title: Human or Not? A Gamified Approach to the Turing Test

Daniel Jannai, Amos Meron, Barak Lenz, Yoav Levine, Yoav Shoham

Comments: 11 pages, 6 figures

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2345] arXiv:2305.20019 (cross-list from cs.LG) [pdf, other]

Title: Monotonic Location Attention for Length Generalization

Jishnu Ray Chowdhury, Cornelia Caragea

Comments: Accepted in ICML 2023

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2346] arXiv:2305.20050 (cross-list from cs.LG) [pdf, other]

Title: Let's Verify Step by Step

Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, Karl Cobbe

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2347] arXiv:2305.20088 (cross-list from cs.CV) [pdf, other]

Title: Improving CLIP Training with Language Rewrites

Lijie Fan, Dilip Krishnan, Phillip Isola, Dina Katabi, Yonglong Tian

Comments: NeurIPS 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)