Computation and Language

Authors and titles for October 2022

[1226] arXiv:2210.04802 (cross-list from cs.SE) [pdf, other]

Title: SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models

Hossein Hajipour, Ning Yu, Cristian-Alexandru Staicu, Mario Fritz

Comments: 19 pages, 6 figures

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)

[1227] arXiv:2210.04864 (cross-list from cs.CV) [pdf, other]

Title: Transformer-based Localization from Embodied Dialog with Large-scale Pre-training

Meera Hahn, James M. Rehg

Journal-ref: International Joint Conference on Natural Language Processing (2022)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1228] arXiv:2210.04885 (cross-list from cs.CV) [pdf, other]

Title: What the DAAM: Interpreting Stable Diffusion Using Cross Attention

Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, Ferhan Ture

Comments: First two authors contributed equally. 13 pages, 15 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1229] arXiv:2210.04964 (cross-list from cs.RO) [pdf, other]

Title: Generating Executable Action Plans with Environmentally-Aware Language Models

Maitrey Gramopadhye, Daniel Szafir

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1230] arXiv:2210.05145 (cross-list from cs.IR) [pdf, other]

Title: Retrieval Augmentation for T5 Re-ranker using External Sources

Kai Hui, Tao Chen, Zhen Qin, Honglei Zhuang, Fernando Diaz, Mike Bendersky, Don Metzler

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[1231] arXiv:2210.05147 (cross-list from cs.LG) [pdf, other]

Title: Markup-to-Image Diffusion Models with Scheduled Sampling

Yuntian Deng, Noriyuki Kojima, Alexander M. Rush

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1232] arXiv:2210.05335 (cross-list from cs.CV) [pdf, other]

Title: MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, Yujiu Yang

Comments: CVPR 2023 Main Track Long Paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[1233] arXiv:2210.05370 (cross-list from cs.LG) [pdf, other]

Title: DeepPerform: An Efficient Approach for Performance Testing of Resource-Constrained Neural Networks

Simin Chen, Mirazul Haque, Cong Liu, Wei Yang

Comments: This paper is accepted to IEEE/ACM International Conference on Automated Software Engineering 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Software Engineering (cs.SE)

[1234] arXiv:2210.05401 (cross-list from cs.SI) [pdf, html, other]

Title: MiDe22: An Annotated Multi-Event Tweet Dataset for Misinformation Detection

Cagri Toraman, Oguzhan Ozcelik, Furkan Şahinuç, Fazli Can

Comments: Published at LREC-COLING 2024

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1235] arXiv:2210.05423 (cross-list from cs.CV) [pdf, other]

Title: Learning to Locate Visual Answer in Video Corpus Using Question

Bin Li, Yixuan Weng, Bin Sun, Shutao Li

Comments: Accepted by ICASSP 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1236] arXiv:2210.05556 (cross-list from cs.CV) [pdf, other]

Title: ViLPAct: A Benchmark for Compositional Generalization on Multimodal Human Activities

Terry Yue Zhuo, Yaqing Liao, Yuecheng Lei, Lizhen Qu, Gerard de Melo, Xiaojun Chang, Yazhou Ren, Zenglin Xu

Comments: Accepted at EACL2023 (Findings)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1237] arXiv:2210.05643 (cross-list from cs.LG) [pdf, other]

Title: A Kernel-Based View of Language Model Fine-Tuning

Sadhika Malladi, Alexander Wettig, Dingli Yu, Danqi Chen, Sanjeev Arora

Comments: Accepted at ICML 2023. Code and pre-computed kernels are publicly available at this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1238] arXiv:2210.05714 (cross-list from cs.RO) [pdf, other]

Title: Visual Language Maps for Robot Navigation

Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard

Comments: Accepted at the 2023 IEEE International Conference on Robotics and Automation (ICRA). Project page: this https URL

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1239] arXiv:2210.05760 (cross-list from cs.SI) [pdf, other]

Title: Detecting Propagators of Disinformation on Twitter Using Quantitative Discursive Analysis

Mark M. Bailey

Comments: 12 pages

Journal-ref: Journal of Intelligence Community Research and Development, 2021

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL)

[1240] arXiv:2210.05769 (cross-list from cs.LG) [pdf, other]

Title: Vote'n'Rank: Revision of Benchmarking with Social Choice Theory

Mark Rofin, Vladislav Mikhailov, Mikhail Florinskiy, Andrey Kravchenko, Elena Tutubalina, Tatiana Shavrina, Daniel Karabekyan, Ekaterina Artemova

Comments: To appear in EACL 2023 (main)

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1241] arXiv:2210.05790 (cross-list from cs.LG) [pdf, other]

Title: Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis

Guilherme Lourenço de Toledo, Ricardo Marcondes Marcacini

Comments: Talk: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1242] arXiv:2210.05793 (cross-list from cs.LG) [pdf, other]

Title: Comparison of Soft and Hard Target RNN-T Distillation for Large-scale ASR

Dongseong Hwang, Khe Chai Sim, Yu Zhang, Trevor Strohman

Comments: 8 pages, 2 figures

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1243] arXiv:2210.05794 (cross-list from cs.LG) [pdf, other]

Title: Designing Robust Transformers using Robust Kernel Density Estimation

Xing Han, Tongzheng Ren, Tan Minh Nguyen, Khai Nguyen, Joydeep Ghosh, Nhat Ho

Comments: Accepted by NeurIPS 2023 as a poster; 23 pages, 5 figures, 11 tables

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1244] arXiv:2210.05815 (cross-list from cs.CV) [pdf, other]

Title: Underspecification in Scene Description-to-Depiction Tasks

Ben Hutchinson, Jason Baldridge, Vinodkumar Prabhakaran

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1245] arXiv:2210.05991 (cross-list from cs.CV) [pdf, other]

Title: Text-Derived Knowledge Helps Vision: A Simple Cross-modal Distillation for Video-based Action Anticipation

Sayontan Ghosh, Tanvi Aggarwal, Minh Hoai, Niranjan Balasubramanian

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1246] arXiv:2210.06044 (cross-list from cs.CV) [pdf, other]

Title: Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learning

Fuying Wang, Yuyin Zhou, Shujun Wang, Varut Vardhanabhuti, Lequan Yu

Comments: NeurIPS 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1247] arXiv:2210.06177 (cross-list from cs.CV) [pdf, other]

Title: VCSE: Time-Domain Visual-Contextual Speaker Extraction Network

Junjie Li, Meng Ge, Zexu Pan, Longbiao Wang, Jianwu Dang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1248] arXiv:2210.06313 (cross-list from cs.LG) [pdf, other]

Title: The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers

Zonglin Li, Chong You, Srinadh Bhojanapalli, Daliang Li, Ankit Singh Rawat, Sashank J. Reddi, Ke Ye, Felix Chern, Felix Yu, Ruiqi Guo, Sanjiv Kumar

Comments: A short version was presented at ICLR 2023. Previous title: Large Models are Parsimonious Learners: Activation Sparsity in Trained Transformers

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[1249] arXiv:2210.06379 (cross-list from cs.CV) [pdf, other]

Title: One does not fit all! On the Complementarity of Vision Encoders for Vision and Language Tasks

Gregor Geigle, Chen Cecilia Liu, Jonas Pfeiffer, Iryna Gurevych

Comments: Repl4NLP 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1250] arXiv:2210.06423 (cross-list from cs.LG) [pdf, other]

Title: Foundation Transformers

Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei

Comments: Work in progress

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)