Computation and Language

Authors and titles for March 2022

[701] arXiv:2203.03853 (cross-list from cs.IR) [pdf, other]

Title: Where Does the Performance Improvement Come From? -- A Reproducibility Concern about Image-Text Retrieval

Jun Rao, Fei Wang, Liang Ding, Shuhan Qi, Yibing Zhan, Weifeng Liu, Dacheng Tao

Comments: SIGIR 2022

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[702] arXiv:2203.03897 (cross-list from cs.CV) [pdf, other]

Title: Geodesic Multi-Modal Mixup for Robust Fine-Tuning

Changdae Oh, Junhyuk So, Hoyoon Byun, YongTaek Lim, Minchul Shin, Jong-June Jeon, Kyungwoo Song

Comments: To appear at NeurIPS 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[703] arXiv:2203.04006 (cross-list from cs.CV) [pdf, other]

Title: Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration

Xiwen Liang, Fengda Zhu, Lingling Li, Hang Xu, Xiaodan Liang

Comments: Accepted by ACL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[704] arXiv:2203.04076 (cross-list from cs.CV) [pdf, other]

Title: Semantic Distillation Guided Salient Object Detection

Bo Xu, Guanze Liu, Han Huang, Cheng Lu, Yandong Guo

Comments: 14 pages, 10 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[705] arXiv:2203.04218 (cross-list from cs.RO) [pdf, other]

Title: Learning Bidirectional Translation between Descriptions and Actions with Small Paired Data

Minori Toyoda, Kanata Suzuki, Yoshihiko Hayashi, Tetsuya Ogata

Comments: 8 pages, 7 figures. To appear in IEEE Robotics and Automation Letters (RA-L) and the 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022). An accompanying video is available at this https URL

Journal-ref: IEEE Robotics and Automation Letters ( Volume: 7, Issue: 4, October 2022)

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[706] arXiv:2203.04366 (cross-list from cs.DB) [pdf, other]

Title: It's AI Match: A Two-Step Approach for Schema Matching Using Embeddings

Benjamin Hättasch, Michael Truong-Ngoc, Andreas Schmidt, Carsten Binnig

Comments: Accepted to the 2nd International Workshop on Applied AI for Database Systems and Applications (AIDB'20), August 31, 2020, Tokyo, Japan

Subjects: Databases (cs.DB); Computation and Language (cs.CL)

[707] arXiv:2203.04408 (cross-list from cs.HC) [pdf, other]

Title: iSEA: An Interactive Pipeline for Semantic Error Analysis of NLP Models

Jun Yuan, Jesse Vig, Nazneen Rajani

Comments: Accepted at IUI 2022, 11 pages, 6 figures

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[708] arXiv:2203.04592 (cross-list from cs.AI) [pdf, other]

Title: Mapping global dynamics of benchmark creation and saturation in artificial intelligence

Simon Ott, Adriano Barbosa-Silva, Kathrin Blagec, Jan Brauner, Matthias Samwald

Comments: This version includes more recent data and additional analyses

Journal-ref: Nature Communications volume 13, Article number: 6793 (2022)

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[709] arXiv:2203.04637 (cross-list from cs.AI) [pdf, other]

Title: LEBP -- Language Expectation & Binding Policy: A Two-Stream Framework for Embodied Vision-and-Language Interaction Task Learning Agents

Haoyu Liu, Yang Liu, Hongkai He, Hangfang Yang

Comments: 6 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[710] arXiv:2203.04786 (cross-list from cs.IR) [pdf, other]

Title: Enhance Topics Analysis based on Keywords Properties

Antonio Penta

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[711] arXiv:2203.04825 (cross-list from cs.LG) [pdf, other]

Title: Efficient Sub-structured Knowledge Distillation

Wenye Lin, Yangming Li, Lemao Liu, Shuming Shi, Hai-tao Zheng

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[712] arXiv:2203.04837 (cross-list from eess.AS) [pdf, other]

Title: 'Beach' to 'Bitch': Inadvertent Unsafe Transcription of Kids' Content on YouTube

Krithika Ramesh, Ashiqur R. KhudaBukhsh, Sumeet Kumar

Comments: This paper got accepted at AAAI 2022, AI for Social Impact track

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Computers and Society (cs.CY)

[713] arXiv:2203.04904 (cross-list from cs.MM) [pdf, other]

Title: Rethinking Task Sampling for Few-shot Vision-Language Transfer Learning

Zhenhailong Wang, Hang Yu, Manling Li, Han Zhao, Heng Ji

Comments: 4 pages, 4 figures, under review

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[714] arXiv:2203.04907 (cross-list from cs.CV) [pdf, other]

Title: KPE: Keypoint Pose Encoding for Transformer-based Image Generation

Soon Yau Cheong, Armin Mustafa, Andrew Gilbert

Journal-ref: British Machine Vision Conference (BMVC) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[715] arXiv:2203.05081 (cross-list from cs.CV) [pdf, other]

Title: NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks

Fawaz Sammani, Tanmoy Mukherjee, Nikos Deligiannis

Comments: Accepted to CVPR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[716] arXiv:2203.05112 (cross-list from cs.DL) [pdf, other]

Title: Librarian-in-the-Loop: A Natural Language Processing Paradigm for Detecting Informal Mentions of Research Data in Academic Literature

Lizhou Fan, Sara Lafia, David Bleckley, Elizabeth Moss, Andrea Thomer, Libby Hemphill

Subjects: Digital Libraries (cs.DL); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[717] arXiv:2203.05203 (cross-list from cs.CV) [pdf, other]

Title: MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes

Yang Jiao, Shaoxiang Chen, Zequn Jie, Jingjing Chen, Lin Ma, Yu-Gang Jiang

Comments: Accepted by ECCV 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[718] arXiv:2203.05243 (cross-list from cs.CV) [pdf, other]

Title: A Closer Look at Debiased Temporal Sentence Grounding in Videos: Dataset, Metric, and Approach

Xiaohan Lan, Yitian Yuan, Xin Wang, Long Chen, Zhi Wang, Lin Ma, Wenwu Zhu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[719] arXiv:2203.05297 (cross-list from cs.CV) [pdf, other]

Title: BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis

Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng

Comments: 28 pages, 15 figures, Accepted by ECCV2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM)

[720] arXiv:2203.05321 (cross-list from cs.CV) [pdf, other]

Title: StyleBabel: Artistic Style Tagging and Captioning

Dan Ruta, Andrew Gilbert, Pranav Aggarwal, Naveen Marri, Ajinkya Kale, Jo Briggs, Chris Speed, Hailin Jin, Baldo Faieta, Alex Filipkowski, Zhe Lin, John Collomosse

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[721] arXiv:2203.05346 (cross-list from cs.CV) [pdf, other]

Title: Knowledge-enriched Attention Network with Group-wise Semantic for Visual Storytelling

Tengpeng Li, Hanli Wang, Bin He, Chang Wen Chen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[722] arXiv:2203.05383 (cross-list from eess.AS) [pdf, other]

Title: KSoF: The Kassel State of Fluency Dataset -- A Therapy Centered Dataset of Stuttering

Sebastian P. Bayerl, Alexander Wolff von Gudenberg, Florian Hönig, Elmar Nöth, Korbinian Riedhammer

Comments: Accepted at LREC 2022 Conference on Language Resources and Evaluation

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[723] arXiv:2203.05465 (cross-list from cs.CV) [pdf, other]

Title: LoopITR: Combining Dual and Cross Encoder Architectures for Image-Text Retrieval

Jie Lei, Xinlei Chen, Ning Zhang, Mengjiao Wang, Mohit Bansal, Tamara L. Berg, Licheng Yu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[724] arXiv:2203.05482 (cross-list from cs.LG) [pdf, other]

Title: Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt

Comments: ICML 2022. The last three authors contributed equally

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[725] arXiv:2203.05557 (cross-list from cs.CV) [pdf, other]

Title: Conditional Prompt Learning for Vision-Language Models

Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu

Comments: CVPR 2022. Update: Adds results on the DOSCO (DOmain Shift in COntext) benchmark

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[726] arXiv:2203.05642 (cross-list from cs.SD) [pdf, other]

Title: Parameter-Free Attentive Scoring for Speaker Verification

Jason Pelecanos, Quan Wang, Yiling Huang, Ignacio Lopez Moreno

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[727] arXiv:2203.05711 (cross-list from cs.CV) [pdf, other]

Title: Synopses of Movie Narratives: a Video-Language Dataset for Story Understanding

Yidan Sun, Qin Chao, Yangfeng Ji, Boyang Li

Comments: 25 pages, 17 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[728] arXiv:2203.05765 (cross-list from cs.IR) [pdf, other]

Title: Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval

Luyu Gao, Xueguang Ma, Jimmy Lin, Jamie Callan

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[729] arXiv:2203.05967 (cross-list from cs.SI) [pdf, other]

Title: A Weibo Dataset for the 2022 Russo-Ukrainian Crisis

Yi R. Fung, Heng Ji

Comments: Russia-Ukraine Crisis, Weibo Dataset

Subjects: Social and Information Networks (cs.SI); Computation and Language (cs.CL)

[730] arXiv:2203.06244 (cross-list from cs.CY) [pdf, other]

Title: AI agents for facilitating social interactions and wellbeing

Hiro Taiyo Hamada, Ryota Kanai

Comments: 10 pages, 1 figure, 1 table

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[731] arXiv:2203.06308 (cross-list from cs.AI) [pdf, other]

Title: Ensemble Semi-supervised Entity Alignment via Cycle-teaching

Kexuan Xin, Zequn Sun, Wen Hua, Bing Liu, Wei Hu, Jianfeng Qu, Xiaofang Zhou

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[732] arXiv:2203.06404 (cross-list from cs.LG) [pdf, other]

Title: A Proposal to Study "Is High Quality Data All We Need?"

Swaroop Mishra, Anjana Arunkumar

Comments: NeurIPS 2020 Pre-registration workshop

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[733] arXiv:2203.06462 (cross-list from cs.LG) [pdf, other]

Title: Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice

Andreas Grivas, Nikolay Bogoychev, Adam Lopez

Comments: Preprint of conference paper accepted at ACL 2022

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[734] arXiv:2203.06667 (cross-list from cs.CV) [pdf, other]

Title: Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Video

Bin Li, Yixuan Weng, Bin Sun, Shutao Li

Comments: 8 pages, 6 figures, 3 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[735] arXiv:2203.06822 (cross-list from cs.CV) [pdf, other]

Title: Grounding Commands for Autonomous Vehicles via Layer Fusion with Region-specific Dynamic Layer Attention

Hou Pong Chan, Mingxi Guo, Cheng-Zhong Xu

Comments: Submitted to IROS 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Robotics (cs.RO)

[736] arXiv:2203.06947 (cross-list from cs.CV) [pdf, other]

Title: XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding

Zhangxuan Gu, Changhua Meng, Ke Wang, Jun Lan, Weiqiang Wang, Ming Gu, Liqing Zhang

Comments: Accepted by CVPR2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[737] arXiv:2203.07026 (cross-list from cs.CV) [pdf, other]

Title: Extracting associations and meanings of objects depicted in artworks through bi-modal deep networks

Gregory Kell, Ryan-Rhys Griffiths, Anthony Bourached, David G. Stork

Comments: Accepted at Computer Vision and Image Analysis of Art (CVAA) conference 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[738] arXiv:2203.07190 (cross-list from cs.CV) [pdf, other]

Title: CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment

Haoyu Song, Li Dong, Wei-Nan Zhang, Ting Liu, Furu Wei

Comments: ACL 2022 main conference

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[739] arXiv:2203.07376 (cross-list from cs.DB) [pdf, other]

Title: HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing

Yanzhao Zheng, Haibin Wang, Baohua Dong, Xingjun Wang, Changshan Li

Comments: Accepted at ACL 2022 Findings

Subjects: Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[740] arXiv:2203.07722 (cross-list from cs.SE) [pdf, other]

Title: ReACC: A Retrieval-Augmented Code Completion Framework

Shuai Lu, Nan Duan, Hojae Han, Daya Guo, Seung-won Hwang, Alexey Svyatkovskiy

Comments: Published in ACL 2022

Subjects: Software Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[741] arXiv:2203.07890 (cross-list from cs.CV) [pdf, other]

Title: K-VQG: Knowledge-aware Visual Question Generation for Common-sense Acquisition

Kohei Uehara, Tatsuya Harada

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[742] arXiv:2203.07990 (cross-list from cs.MM) [pdf, other]

Title: UofA-Truth at Factify 2022 : Transformer And Transfer Learning Based Multi-Modal Fact-Checking

Abhishek Dhankar, Osmar R. Zaïane, Francois Bolduc

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[743] arXiv:2203.07996 (cross-list from cs.SD) [pdf, other]

Title: Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition

Xichen Pan, Peiyu Chen, Yichen Gong, Helong Zhou, Xinbing Wang, Zhouhan Lin

Comments: ACL2022 Main Conference

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)

[744] arXiv:2203.08144 (cross-list from q-fin.ST) [pdf, other]

Title: DeepTrust: A Reliable Financial Knowledge Retrieval Framework For Explaining Extreme Pricing Anomalies

Pok Wah Chan

Comments: 72 pages

Subjects: Statistical Finance (q-fin.ST); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[745] arXiv:2203.08362 (cross-list from cs.CV) [pdf, other]

Title: Spot the Difference: A Cooperative Object-Referring Game in Non-Perfectly Co-Observable Scene

Duo Zheng, Fandong Meng, Qingyi Si, Hairun Fan, Zipeng Xu, Jie Zhou, Fangxiang Feng, Xiaojie Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[746] arXiv:2203.08481 (cross-list from cs.CV) [pdf, other]

Title: Pseudo-Q: Generating Pseudo Language Queries for Visual Grounding

Haojun Jiang, Yuanze Lin, Dongchen Han, Shiji Song, Gao Huang

Comments: Accepted by CVPR2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[747] arXiv:2203.08578 (cross-list from cs.RO) [pdf, other]

Title: Whither the Priors for (Vocal) Interactivity?

Roger K. Moore

Comments: Accepted for the THEORIA Workshop "Towards a Common Understanding and Vision for Theory-Grounded Human-Robot Interaction" at HRI-2022, 7 March 2022

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[748] arXiv:2203.08893 (cross-list from cs.LG) [pdf, other]

Title: Multimodal Learning on Graphs for Disease Relation Extraction

Yucong Lin, Keming Lu, Sheng Yu, Tianxi Cai, Marinka Zitnik

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[749] arXiv:2203.08913 (cross-list from cs.LG) [pdf, other]

Title: Memorizing Transformers

Yuhuai Wu, Markus N. Rabe, DeLesley Hutchins, Christian Szegedy

Comments: Published as a conference paper at ICLR 2022 (spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[750] arXiv:2203.08994 (cross-list from cs.AI) [pdf, other]

Title: AI Autonomy : Self-Initiated Open-World Continual Learning and Adaptation

Bing Liu, Sahisnu Mazumder, Eric Robertson, Scott Grigsby

Comments: To appear in AI Magazine (AAAI), 2023. This draft is an extended and revised version of the previous work - "Self-initiated Open World Learning for Autonomous AI Agents" arXiv preprint arXiv:2110.11385 (2021), which was published in AAAI 2022 Spring Symposium Series

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)