Computation and Language

Authors and titles for June 2024

[1701] arXiv:2406.19065 [pdf, html, other]

Title: STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysis

Wenbin Li, Di Yao, Ruibo Zhao, Wenjie Chen, Zijie Xu, Chengxue Luo, Chang Gong, Quanliang Jing, Haining Tan, Jingping Bi

Subjects: Computation and Language (cs.CL)

[1702] arXiv:2406.19071 [pdf, html, other]

Title: EmPO: Emotion Grounding for Empathetic Response Generation through Preference Optimization

Ondrej Sotolar, Vojtech Formanek, Alok Debnath, Allison Lahnala, Charles Welch, Lucie FLek

Comments: v02, 8 pages long paper, EMNLP ACL style

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1703] arXiv:2406.19073 [pdf, other]

Title: AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queries

Irina Saparina, Mirella Lapata

Comments: NeurIPS 2024 D&B Track Spotlight

Subjects: Computation and Language (cs.CL)

[1704] arXiv:2406.19097 [pdf, html, other]

Title: Fairness and Bias in Multimodal AI: A Survey

Tosin Adewumi, Lama Alkhaled, Namrata Gurung, Goya van Boven, Irene Pagliai

Comments: 12 pages

Subjects: Computation and Language (cs.CL)

[1705] arXiv:2406.19102 [pdf, html, other]

Title: Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs

Lokesh Mishra, Sohayl Dhibi, Yusik Kim, Cesar Berrospi Ramis, Shubham Gupta, Michele Dolfi, Peter Staar

Comments: Accepted at the NLP4Climate workshop in the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024)

Journal-ref: Proceedings of the 1st Workshop on Natural Language Processing Meets Climate Change (ClimateNLP 2024), pages 193-214, Bangkok, Thailand. Association for Computational Linguistics

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1706] arXiv:2406.19116 [pdf, html, other]

Title: CHEW: A Dataset of CHanging Events in Wikipedia

Hsuvas Borkakoty, Luis Espinosa-Anke

Comments: Short Paper

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1707] arXiv:2406.19170 [pdf, html, other]

Title: The Illusion of Competence: Evaluating the Effect of Explanations on Users' Mental Models of Visual Question Answering Systems

Judith Sieker, Simeon Junker, Ronja Utescher, Nazia Attari, Heiko Wersing, Hendrik Buschmeier, Sina Zarrieß

Comments: 17 pages (including Appendix). Accepted at EMNLP 2024 main

Subjects: Computation and Language (cs.CL)

[1708] arXiv:2406.19172 [pdf, html, other]

Title: Annotation Errors and NER: A Study with OntoNotes 5.0

Gabriel Bernier-Colborne, Sowmya Vajjala

Comments: Unpublished report. Originally submitted to LREC 2022

Subjects: Computation and Language (cs.CL)

[1709] arXiv:2406.19215 [pdf, html, other]

Title: SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation

Zijun Yao, Weijian Qi, Liangming Pan, Shulin Cao, Linmei Hu, Weichuan Liu, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL)

[1710] arXiv:2406.19223 [pdf, html, other]

Title: T-FREE: Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings

Björn Deiseroth, Manuel Brack, Patrick Schramowski, Kristian Kersting, Samuel Weinbach

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1711] arXiv:2406.19226 [pdf, html, other]

Title: Simulating Classroom Education with LLM-Empowered Agents

Zheyuan Zhang, Daniel Zhang-Li, Jifan Yu, Linlu Gong, Jinchang Zhou, Zhanxin Hao, Jianxiao Jiang, Jie Cao, Huiqin Liu, Zhiyuan Liu, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1712] arXiv:2406.19227 [pdf, html, other]

Title: Aligning Teacher with Student Preferences for Tailored Training Data Generation

Yantao Liu, Zhao Zhang, Zijun Yao, Shulin Cao, Lei Hou, Juanzi Li

Subjects: Computation and Language (cs.CL)

[1713] arXiv:2406.19228 [pdf, html, other]

Title: Tools Fail: Detecting Silent Errors in Faulty Tools

Jimin Sun, So Yeon Min, Yingshan Chang, Yonatan Bisk

Comments: 18 pages, 12 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1714] arXiv:2406.19232 [pdf, html, other]

Title: RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs

Ekaterina Taktasheva, Maxim Bazhukov, Kirill Koncha, Alena Fenogenova, Ekaterina Artemova, Vladislav Mikhailov

Comments: to appear in EMNLP 2024 (main)

Subjects: Computation and Language (cs.CL)

[1715] arXiv:2406.19237 [pdf, html, other]

Title: FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowcharts

Shubhankar Singh, Purvi Chaurasia, Yerram Varun, Pranshu Pandya, Vatsal Gupta, Vivek Gupta, Dan Roth

Comments: Accepted in ACL 2024 (Findings), 21 pages, 7 figures, 9 Tables

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1716] arXiv:2406.19238 [pdf, html, other]

Title: Revealing Fine-Grained Values and Opinions in Large Language Models

Dustin Wright, Arnav Arora, Nadav Borenstein, Srishti Yadav, Serge Belongie, Isabelle Augenstein

Comments: Findings of EMNLP 2024; 28 pages, 20 figures, 7 tables

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1717] arXiv:2406.19251 [pdf, html, other]

Title: AutoRAG-HP: Automatic Online Hyper-Parameter Tuning for Retrieval-Augmented Generation

Jia Fu, Xiaoting Qin, Fangkai Yang, Lu Wang, Jue Zhang, Qingwei Lin, Yubo Chen, Dongmei Zhang, Saravan Rajmohan, Qi Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1718] arXiv:2406.19263 [pdf, html, other]

Title: Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

Yue Fan, Lei Ding, Ching-Chen Kuo, Shan Jiang, Yang Zhao, Xinze Guan, Jie Yang, Yi Zhang, Xin Eric Wang

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1719] arXiv:2406.19271 [pdf, html, other]

Title: AutoPureData: Automated Filtering of Web Data for LLM Fine-tuning

Praneeth Vadlapati

Comments: Initial version

Journal-ref: Journal of Mathematical & Computer Applications, 3 (2024) E121

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

[1720] arXiv:2406.19276 [pdf, html, other]

Title: VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation

Yixiao Song, Yekyung Kim, Mohit Iyyer

Subjects: Computation and Language (cs.CL)

[1721] arXiv:2406.19307 [pdf, other]

Title: The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning

Shaobo Cui, Zhijing Jin, Bernhard Schölkopf, Boi Faltings

Comments: 42 pages

Subjects: Computation and Language (cs.CL)

[1722] arXiv:2406.19314 [pdf, other]

Title: LiveBench: A Challenging, Contamination-Free LLM Benchmark

Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Ben Feuer, Siddhartha Jain, Ravid Shwartz-Ziv, Neel Jain, Khalid Saifullah, Siddartha Naidu, Chinmay Hegde, Yann LeCun, Tom Goldstein, Willie Neiswanger, Micah Goldblum

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1723] arXiv:2406.19349 [pdf, html, other]

Title: IndoToxic2024: A Demographically-Enriched Dataset of Hate Speech and Toxicity Types for Indonesian Language

Lucky Susanto, Musa Izzanardi Wijanarko, Prasetia Anugrah Pratama, Traci Hong, Ika Idris, Alham Fikri Aji, Derry Wijaya

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1724] arXiv:2406.19354 [pdf, html, other]

Title: Fundamental Problems With Model Editing: How Should Rational Belief Revision Work in LLMs?

Peter Hase, Thomas Hofweber, Xiang Zhou, Elias Stengel-Eskin, Mohit Bansal

Comments: 23 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1725] arXiv:2406.19356 [pdf, html, other]

Title: DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions

Nigel Fernandez, Alexander Scarlatos, Wanyong Feng, Simon Woodhead, Andrew Lan

Comments: EMNLP 2024: The 2024 Conference on Empirical Methods in Natural Language Processing

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)

[1726] arXiv:2406.19358 [pdf, html, other]

Title: The Model Arena for Cross-lingual Sentiment Analysis: A Comparative Study in the Era of Large Language Models

Xiliang Zhu, Shayna Gardiner, Tere Roldán, David Rossouw

Comments: Accepted to WASSA workshop at ACL2024

Subjects: Computation and Language (cs.CL)

[1727] arXiv:2406.19371 [pdf, html, other]

Title: Suri: Multi-constraint Instruction Following for Long-form Text Generation

Chau Minh Pham, Simeng Sun, Mohit Iyyer

Comments: Accepted to EMNLP'24 (Findings)

Subjects: Computation and Language (cs.CL)

[1728] arXiv:2406.19415 [pdf, html, other]

Title: An Analysis of Multilingual FActScore

Kim Trong Vu, Michael Krumdick, Varshini Reddy, Franck Dernoncourt, Viet Dac Lai

Subjects: Computation and Language (cs.CL)

[1729] arXiv:2406.19465 [pdf, html, other]

Title: Can Large Language Models Generate High-quality Patent Claims?

Lekang Jiang, Caiqi Zhang, Pascal A Scherz, Stephan Goetz

Comments: 16 pages, 2 figures, 12 tables

Subjects: Computation and Language (cs.CL)

[1730] arXiv:2406.19470 [pdf, html, other]

Title: Changing Answer Order Can Decrease MMLU Accuracy

Vipul Gupta, David Pantoja, Candace Ross, Adina Williams, Megan Ung

Comments: Short paper, 9 pages

Subjects: Computation and Language (cs.CL)

[1731] arXiv:2406.19478 [pdf, html, other]

Title: Sparse Regression for Machine Translation

Ergun Biçici

Comments: 8 pages, 4 figures, 4 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1732] arXiv:2406.19482 [pdf, html, other]

Title: xTower: A Multilingual LLM for Explaining and Correcting Translation Errors

Marcos Treviso, Nuno M. Guerreiro, Sweta Agrawal, Ricardo Rei, José Pombal, Tania Vaz, Helena Wu, Beatriz Silva, Daan van Stigt, André F. T. Martins

Subjects: Computation and Language (cs.CL)

[1733] arXiv:2406.19486 [pdf, html, other]

Title: LoPT: Low-Rank Prompt Tuning for Parameter Efficient Language Models

Shouchang Guo, Sonam Damani, Keng-hao Chang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Signal Processing (eess.SP)

[1734] arXiv:2406.19493 [pdf, other]

Title: Development and Evaluation of a Retrieval-Augmented Generation Tool for Creating SAPPhIRE Models of Artificial Systems

Anubhab Majumder, Kausik Bhattacharya, Amaresh Chakrabarti

Comments: This paper has been accepted for presentation at the 10th International Conference on Research Into Design, 2025

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1735] arXiv:2406.19497 [pdf, html, other]

Title: Inclusivity in Large Language Models: Personality Traits and Gender Bias in Scientific Abstracts

Naseela Pervez, Alexander J. Titus

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1736] arXiv:2406.19501 [pdf, html, other]

Title: Monitoring Latent World States in Language Models with Propositional Probes

Jiahai Feng, Stuart Russell, Jacob Steinhardt

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1737] arXiv:2406.19502 [pdf, other]

Title: Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Utilization

Miyoung Ko, Sue Hyun Park, Joonsuk Park, Minjoon Seo

Comments: published at EMNLP 2024; code is available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1738] arXiv:2406.19504 [pdf, html, other]

Title: Are Generative Language Models Multicultural? A Study on Hausa Culture and Emotions using ChatGPT

Ibrahim Said Ahmad, Shiran Dudy, Resmi Ramachandranpillai, Kenneth Church

Subjects: Computation and Language (cs.CL)

[1739] arXiv:2406.19512 [pdf, html, other]

Title: Captioning Visualizations with Large Language Models (CVLLM): A Tutorial

Giuseppe Carenini, Jordon Johnson, Ali Salamatian

Comments: 6 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

[1740] arXiv:2406.19526 [pdf, html, other]

Title: TocBERT: Medical Document Structure Extraction Using Bidirectional Transformers

Majd Saleh, Sarra Baghdadi, Stéphane Paquelet

Comments: 6 pages, 6 figures

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

[1741] arXiv:2406.19537 [pdf, html, other]

Title: Handling Ontology Gaps in Semantic Parsing

Andrea Bacciu, Marco Damonte, Marco Basaldella, Emilio Monti

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1742] arXiv:2406.19538 [pdf, html, other]

Title: Context Matters: An Empirical Study of the Impact of Contextual Information in Temporal Question Answering Systems

Dan Schumacher, Fatemeh Haji, Tara Grey, Niharika Bandlamudi, Nupoor Karnik, Gagana Uday Kumar, Jason Cho-Yu Chiang, Paul Rad, Nishant Vishwamitra, Anthony Rios

Subjects: Computation and Language (cs.CL)

[1743] arXiv:2406.19543 [pdf, html, other]

Title: Demarked: A Strategy for Enhanced Abusive Speech Moderation through Counterspeech, Detoxification, and Message Management

Seid Muhie Yimam, Daryna Dementieva, Tim Fischer, Daniil Moskovskiy, Naquee Rizwan, Punyajoy Saha, Sarthak Roy, Martin Semmann, Alexander Panchenko, Chris Biemann, Animesh Mukherjee

Subjects: Computation and Language (cs.CL); Social and Information Networks (cs.SI)

[1744] arXiv:2406.19545 [pdf, html, other]

Title: Leveraging Machine-Generated Rationales to Facilitate Social Meaning Detection in Conversations

Ritam Dutt, Zhen Wu, Kelly Shi, Divyanshu Sheth, Prakhar Gupta, Carolyn Penstein Rose

Comments: To appear at The Proceedings of the Association for Computational Linguistics, 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1745] arXiv:2406.19552 [pdf, other]

Title: Rethinking harmless refusals when fine-tuning foundation models

Florin Pop, Judd Rosenblatt, Diogo Schwerz de Lucena, Michael Vaiana

Comments: ICLR 2024 AGI Workshop Poster

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1746] arXiv:2406.19564 [pdf, html, other]

Title: Voices Unheard: NLP Resources and Models for Yor\`ub\'a Regional Dialects

Orevaoghene Ahia, Anuoluwapo Aremu, Diana Abagyan, Hila Gonen, David Ifeoluwa Adelani, Daud Abolade, Noah A. Smith, Yulia Tsvetkov

Subjects: Computation and Language (cs.CL)

[1747] arXiv:2406.19593 [pdf, other]

Title: SK-VQA: Synthetic Knowledge Generation at Scale for Training Context-Augmented Multimodal LLMs

Xin Su, Man Luo, Kris W Pan, Tien Pei Chou, Vasudev Lal, Phillip Howard

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1748] arXiv:2406.19598 [pdf, html, other]

Title: Mixture of In-Context Experts Enhance LLMs' Long Context Awareness

Hongzhan Lin, Ang Lv, Yuhan Chen, Chen Zhu, Yang Song, Hengshu Zhu, Rui Yan

Comments: Accepted by Neurips2024

Subjects: Computation and Language (cs.CL)

[1749] arXiv:2406.19642 [pdf, html, other]

Title: IDT: Dual-Task Adversarial Attacks for Privacy Protection

Pedro Faustini, Shakila Mahjabin Tonni, Annabelle McIver, Qiongkai Xu, Mark Dras

Comments: 28 pages, 1 figure

Subjects: Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[1750] arXiv:2406.19643 [pdf, html, other]

Title: Debate-to-Write: A Persona-Driven Multi-Agent Framework for Diverse Argument Generation

Zhe Hu, Hou Pong Chan, Jing Li, Yu Yin

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)