Computation and Language

Authors and titles for October 2022

[1201] arXiv:2210.01911 (cross-list from cs.RO) [pdf, other]

Title: Grounding Language with Visual Affordances over Unstructured Data

Oier Mees, Jessica Borja-Diaz, Wolfram Burgard

Comments: Accepted at the 2023 IEEE International Conference on Robotics and Automation (ICRA). Project website: this http URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1202] arXiv:2210.01936 (cross-list from cs.CV) [pdf, other]

Title: When and why vision-language models behave like bags-of-words, and what to do about it?

Mert Yuksekgonul, Federico Bianchi, Pratyusha Kalluri, Dan Jurafsky, James Zou

Comments: ICLR 2023 Oral (notable-top-5%)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1203] arXiv:2210.01946 (cross-list from cs.CV) [pdf, other]

Title: Affection: Learning Affective Explanations for Real-World Visual Data

Panos Achlioptas, Maks Ovsjanikov, Leonidas Guibas, Sergey Tulyakov

Comments: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1204] arXiv:2210.02570 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Structured Dropout

Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1205] arXiv:2210.02595 (cross-list from eess.AS) [pdf, other]

Title: Exploration of A Self-Supervised Speech Model: A Study on Emotional Corpora

Yuanchao Li, Yumnah Mohamied, Peter Bell, Catherine Lai

Comments: Accepted to SLT 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1206] arXiv:2210.02615 (cross-list from cs.LG) [pdf, other]

Title: Learning to Reason With Relational Abstractions

Andrew J. Nam, Mengye Ren, Chelsea Finn, James L. McClelland

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1207] arXiv:2210.02663 (cross-list from cs.HC) [pdf, other]

Title: Towards Better Semantic Understanding of Mobile Interfaces

Srinivas Sunkara, Maria Wang, Lijuan Liu, Gilles Baechler, Yu-Chung Hsiao, Jindong (JD)Chen, Abhanshu Sharma, James Stout

Comments: This paper is to be published at COLING 2022

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1208] arXiv:2210.02762 (cross-list from cs.CV) [pdf, other]

Title: Vision Transformer Based Model for Describing a Set of Images as a Story

Zainy M. Malakan, Ghulam Mubashar Hassan, Ajmal Mian

Comments: This paper has been accepted at the 35th Australasian Joint Conference on Artificial Intelligence 2022 (Camera-ready version is attached)

Journal-ref: 13728, 2022, 15 to 28

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1209] arXiv:2210.02833 (cross-list from cs.IR) [pdf, other]

Title: Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval

Benno Weck, Miguel Pérez Fernández, Holger Kirchhoff, Xavier Serra

Comments: 5 pages, 2 figures. Accepted at Detection and Classification of Acoustic Scenes and Events 2022 (DCASE2022)

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1210] arXiv:2210.02862 (cross-list from cs.AI) [pdf, other]

Title: Causal Inference for Chatting Handoff

Shanshan Zhong, Jinghui Qin, Zhongzhan Huang, Daifeng Li

Comments: Work in progress

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1211] arXiv:2210.03005 (cross-list from cs.LG) [pdf, other]

Title: To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Models

Julius Gonsior, Christian Falkenberg, Silvio Magino, Anja Reusch, Maik Thiele, Wolfgang Lehner

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[1212] arXiv:2210.03087 (cross-list from cs.CV) [pdf, html, other]

Title: Iterative Vision-and-Language Navigation

Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason Corso, Peter Anderson, Stefan Lee, Jesse Thomason

Comments: Accepted by CVPR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)

[1213] arXiv:2210.03112 (cross-list from cs.LG) [pdf, other]

Title: A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning

Aishwarya Kamath, Peter Anderson, Su Wang, Jing Yu Koh, Alexander Ku, Austin Waters, Yinfei Yang, Jason Baldridge, Zarana Parekh

Comments: CVPR 2023

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[1214] arXiv:2210.03221 (cross-list from cs.LG) [pdf, other]

Title: PQLM -- Multilingual Decentralized Portable Quantum Language Model for Privacy Protection

Shuyue Stella Li, Xiangyu Zhang, Shu Zhou, Hongchao Shu, Ruixing Liang, Hexin Liu, Leibny Paola Garcia

Comments: 5 pages, 3 figures, 3 tables

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Quantum Physics (quant-ph)

[1215] arXiv:2210.03255 (cross-list from cs.SD) [pdf, other]

Title: Damage Control During Domain Adaptation for Transducer Based Automatic Speech Recognition

Somshubra Majumdar, Shantanu Acharya, Vitaly Lavrukhin, Boris Ginsburg

Comments: To appear in Proc. SLT 2022, Jan 09-12, 2023, Doha, Qatar

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1216] arXiv:2210.03459 (cross-list from eess.AS) [pdf, other]

Title: Mutual Learning of Single- and Multi-Channel End-to-End Neural Diarization

Shota Horiguchi, Yuki Takashima, Shinji Watanabe, Paola Garcia

Comments: Accepted to IEEE SLT 2022

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)

[1217] arXiv:2210.03581 (cross-list from eess.AS) [pdf, other]

Title: Synthetic Voice Detection and Audio Splicing Detection using SE-Res2Net-Conformer Architecture

Lei Wang, Benedict Yeoh, Jun Wah Ng

Comments: Accepted by the 13th International Symposium on Chinese Spoken Language Processing (ISCSLP 2022)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1218] arXiv:2210.03768 (cross-list from cs.DB) [pdf, other]

Title: xDBTagger: Explainable Natural Language Interface to Databases Using Keyword Mappings and Schema Graph

Arif Usta, Akifhan Karakayali, Özgür Ulusoy

Comments: 20 pages, 6 figures. This work is the extended version of arXiv:2101.04226 that appeared in PVLDB'21

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1219] arXiv:2210.03858 (cross-list from cs.LG) [pdf, other]

Title: AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models

Se Jung Kwon, Jeonghoon Kim, Jeongin Bae, Kang Min Yoo, Jin-Hwa Kim, Baeseong Park, Byeongwook Kim, Jung-Woo Ha, Nako Sung, Dongsoo Lee

Comments: Findings of EMNLP 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1220] arXiv:2210.03929 (cross-list from cs.CV) [pdf, other]

Title: EgoTaskQA: Understanding Human Tasks in Egocentric Videos

Baoxiong Jia, Ting Lei, Song-Chun Zhu, Siyuan Huang

Comments: Published at NeurIPS Track on Datasets and Benchmarks 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1221] arXiv:2210.03941 (cross-list from cs.CV) [pdf, other]

Title: Learning Fine-Grained Visual Understanding for Video Question Answering via Decoupling Spatial-Temporal Modeling

Hsin-Ying Lee, Hung-Ting Su, Bing-Chen Tsai, Tsung-Han Wu, Jia-Fong Yeh, Winston H. Hsu

Comments: BMVC 2022. Code is available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1222] arXiv:2210.04133 (cross-list from cs.CV) [pdf, other]

Title: Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains

Pierre Chambon, Christian Bluethgen, Curtis P. Langlotz, Akshay Chaudhari

Comments: 17 pages, 8 figures

Journal-ref: Foundation Models for Decision Making Workshop at Neural Information Processing Systems, 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1223] arXiv:2210.04183 (cross-list from cs.CV) [pdf, other]

Title: MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning

Zijia Zhao, Longteng Guo, Xingjian He, Shuai Shao, Zehuan Yuan, Jing Liu

Comments: SIGIR 2023, 10 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[1224] arXiv:2210.04443 (cross-list from cs.LG) [pdf, other]

Title: Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue

So Yeon Min, Hao Zhu, Ruslan Salakhutdinov, Yonatan Bisk

Comments: To Appear in the Proceedings of EMNLP 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1225] arXiv:2210.04476 (cross-list from cs.RO) [pdf, other]

Title: Using Both Demonstrations and Language Instructions to Efficiently Learn Robotic Tasks

Albert Yu, Raymond J. Mooney

Comments: 24 pages, 10 figures. Project website at this https URL

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Machine Learning (cs.LG)