Computation and Language

Authors and titles for June 2024

[226] arXiv:2406.03075 [pdf, html, other]

Title: Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework

Xiaoxi Sun, Jinpeng Li, Yan Zhong, Dongyan Zhao, Rui Yan

Comments: 18 pages, 3 figures

Subjects: Computation and Language (cs.CL)

[227] arXiv:2406.03079 [pdf, html, other]

Title: Cryptocurrency Frauds for Dummies: How ChatGPT introduces us to fraud?

Wail Zellagui, Abdessamad Imine, Yamina Tadjeddine

Comments: To be published in ACM journal "Digital Government: Research and Practice"

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[228] arXiv:2406.03092 [pdf, html, other]

Title: FragRel: Exploiting Fragment-level Relations in the External Memory of Large Language Models

Xihang Yue, Linchao Zhu, Yi Yang

Subjects: Computation and Language (cs.CL)

[229] arXiv:2406.03125 [pdf, html, other]

Title: Space Decomposition for Sentence Embedding

Wuttikorn Ponwitayarat, Peerat Limkonchotiwat, Ekapol Chuangsuwanich, Sarana Nutanong

Comments: ACL Finding 2024. The code and pre-trained models are available at this https URL

Subjects: Computation and Language (cs.CL)

[230] arXiv:2406.03127 [pdf, html, other]

Title: Towards Real-world Scenario: Imbalanced New Intent Discovery

Shun Zhang, Chaoran Yan, Jian Yang, Jiaheng Liu, Ying Mo, Jiaqi Bai, Tongliang Li, Zhoujun Li

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[231] arXiv:2406.03151 [pdf, html, other]

Title: Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

Hao Li, Yuping Wu, Viktor Schlegel, Riza Batista-Navarro, Tharindu Madusanka, Iqra Zahid, Jiayan Zeng, Xiaochi Wang, Xinran He, Yizhi Li, Goran Nenadic

Comments: Published on ACL 2024 Findings

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[232] arXiv:2406.03158 [pdf, html, other]

Title: CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs

Shuang Ao, Stefan Rueger, Advaith Siddharthan

Comments: The paper is accepted by The Conference on Uncertainty in Artificial Intelligence (UAI), 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[233] arXiv:2406.03170 [pdf, html, other]

Title: StatBot.Swiss: Bilingual Open Data Exploration in Natural Language

Farhad Nooralahzadeh, Yi Zhang, Ellery Smith, Sabine Maennel, Cyril Matthey-Doret, Raphaël de Fondville, Kurt Stockinger

Comments: This work is accepted at ACL Findings 2024

Subjects: Computation and Language (cs.CL)

[234] arXiv:2406.03181 [pdf, html, other]

Title: Missci: Reconstructing Fallacies in Misrepresented Science

Max Glockner, Yufang Hou, Preslav Nakov, Iryna Gurevych

Comments: ACL 2024 (main)

Subjects: Computation and Language (cs.CL)

[235] arXiv:2406.03198 [pdf, html, other]

Title: The Impossibility of Fair LLMs

Jacy Anthis, Kristian Lum, Michael Ekstrand, Avi Feller, Alexander D'Amour, Chenhao Tan

Comments: Presented at the 1st Human-Centered Evaluation and Auditing of Language Models (HEAL) workshop at CHI 2024

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Applications (stat.AP); Machine Learning (stat.ML)

[236] arXiv:2406.03199 [pdf, html, other]

Title: Bayesian WeakS-to-Strong from Text Classification to Generation

Ziyun Cui, Ziyang Zhang, Wen Wu, Guangzhi Sun, Chao Zhang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[237] arXiv:2406.03202 [pdf, html, other]

Title: ChatLang-8: An LLM-Based Synthetic Data Generation Framework for Grammatical Error Correction

Jeiyoon Park, Chanjun Park, Heuiseok Lim

Comments: preprint

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[238] arXiv:2406.03221 [pdf, html, other]

Title: Linking Named Entities in Diderot's \textit{Encyclop\'edie} to Wikidata

Pierre Nugues

Comments: 6 pages, 3 figures

Journal-ref: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pp. 10610--10615

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[239] arXiv:2406.03235 [pdf, html, other]

Title: Error-preserving Automatic Speech Recognition of Young English Learners' Language

Janick Michot, Manuela Hürlimann, Jan Deriu, Luzia Sauer, Katsiaryna Mlynchyk, Mark Cieliebak

Comments: Accepted at ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[240] arXiv:2406.03239 [pdf, html, other]

Title: Document-level Claim Extraction and Decontextualisation for Fact-Checking

Zhenyun Deng, Michael Schlichtkrull, Andreas Vlachos

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL)

[241] arXiv:2406.03339 [pdf, html, other]

Title: The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches

Bhashithe Abeysinghe, Ruhan Circi

Comments: Accepted in The First Workshop on Large Language Models for Evaluation in Information Retrieval

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[242] arXiv:2406.03363 [pdf, html, other]

Title: LLM-based Rewriting of Inappropriate Argumentation using Reinforcement Learning from Machine Feedback

Timon Ziegenbein, Gabriella Skitalinskaya, Alireza Bayat Makou, Henning Wachsmuth

Subjects: Computation and Language (cs.CL)

[243] arXiv:2406.03368 [pdf, html, other]

Title: IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

David Ifeoluwa Adelani, Jessica Ojo, Israel Abebe Azime, Jian Yun Zhuang, Jesujoba O. Alabi, Xuanli He, Millicent Ochieng, Sara Hooker, Andiswa Bukula, En-Shiun Annie Lee, Chiamaka Chukwuneke, Happy Buzaaba, Blessing Sibanda, Godson Kalipe, Jonathan Mukiibi, Salomon Kabongo, Foutse Yuehgoh, Mmasibidi Setaka, Lolwethu Ndolela, Nkiruka Odu, Rooweither Mabuya, Shamsuddeen Hassan Muhammad, Salomey Osei, Sokhar Samb, Tadesse Kebede Guge, Pontus Stenetorp

Comments: Under review

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[244] arXiv:2406.03397 [pdf, html, other]

Title: Automating Turkish Educational Quiz Generation Using Large Language Models

Kamyar Zeinalipour, Yusuf Gökberk Keptiğ, Marco Maggini, Marco Gori

Comments: Accepted Paper for ISPR 2024

Subjects: Computation and Language (cs.CL)

[245] arXiv:2406.03441 [pdf, html, other]

Title: Cycles of Thought: Measuring LLM Confidence through Stable Explanations

Evan Becker, Stefano Soatto

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[246] arXiv:2406.03442 [pdf, html, other]

Title: Are language models rational? The case of coherence norms and belief revision

Thomas Hofweber, Peter Hase, Elias Stengel-Eskin, Mohit Bansal

Comments: added discussion and cross reference of new empirical work by the authors, updated references, fixed typos

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[247] arXiv:2406.03450 [pdf, html, other]

Title: What is the Best Way for ChatGPT to Translate Poetry?

Shanshan Wang, Derek F. Wong, Jingming Yao, Lidia S. Chao

Comments: 19 pages, 1 figure. The paper has been accepted by ACL 2024(Main Conference)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[248] arXiv:2406.03452 [pdf, html, other]

Title: Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types

Pierluigi Cassotti, Stefano De Pascale, Nina Tahmasebi

Subjects: Computation and Language (cs.CL)

[249] arXiv:2406.03479 [pdf, html, other]

Title: MODABS: Multi-Objective Learning for Dynamic Aspect-Based Summarization

Xiaobo Guo, Soroush Vosoughi

Subjects: Computation and Language (cs.CL)

[250] arXiv:2406.03486 [pdf, html, other]

Title: BIPED: Pedagogically Informed Tutoring System for ESL Education

Soonwoo Kwon, Sojung Kim, Minju Park, Seunghyun Lee, Kyuseok Kim

Comments: ACL 2024

Subjects: Computation and Language (cs.CL)

[251] arXiv:2406.03487 [pdf, html, other]

Title: Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends

Sanjana Ramprasad, Elisa Ferracane, Zachary C. Lipton

Comments: Accepted at ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[252] arXiv:2406.03496 [pdf, html, other]

Title: Wings: Learning Multimodal LLMs without Text-only Forgetting

Yi-Kai Zhang, Shiyin Lu, Yang Li, Yanqing Ma, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, De-Chuan Zhan, Han-Jia Ye

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[253] arXiv:2406.03589 [pdf, html, other]

Title: Ranking Manipulation for Conversational Search Engines

Samuel Pfrommer, Yatong Bai, Tanmay Gautam, Somayeh Sojoudi

Comments: 2024 Conference on Empirical Methods in Natural Language Processing (Main)

Subjects: Computation and Language (cs.CL)

[254] arXiv:2406.03592 [pdf, html, other]

Title: Measuring Retrieval Complexity in Question Answering Systems

Matteo Gabburo, Nicolaas Paul Jedema, Siddhant Garg, Leonardo F. R. Ribeiro, Alessandro Moschitti

Comments: Accepted to ACL 2024 (findings)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[255] arXiv:2406.03600 [pdf, html, other]

Title: Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning

Yang Wu, Chenghao Wang, Ece Gumusel, Xiaozhong Liu

Comments: Accepted by ACL Findings 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[256] arXiv:2406.03618 [pdf, html, other]

Title: TACT: Advancing Complex Aggregative Reasoning with Information Extraction Tools

Avi Caciularu, Alon Jacovi, Eyal Ben-David, Sasha Goldshtein, Tal Schuster, Jonathan Herzig, Gal Elidan, Amir Globerson

Comments: Accepted to NeurIPS 2024. Website (this https URL), Huggingface (this https URL)

Subjects: Computation and Language (cs.CL)

[257] arXiv:2406.03642 [pdf, html, other]

Title: Is Free Self-Alignment Possible?

Dyah Adila, Changho Shin, Yijing Zhang, Frederic Sala

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[258] arXiv:2406.03666 [pdf, html, other]

Title: What Makes Language Models Good-enough?

Daiki Asami, Saku Sugawara

Comments: To appear in Findings of ACL2024

Subjects: Computation and Language (cs.CL)

[259] arXiv:2406.03673 [pdf, html, other]

Title: Linguistically Conditioned Semantic Textual Similarity

Jingxuan Tu, Keer Xu, Liulu Yue, Bingyang Ye, Kyeongmin Rim, James Pustejovsky

Comments: To appear in the ACL 2024 main proceedings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[260] arXiv:2406.03689 [pdf, html, other]

Title: Evaluating the World Model Implicit in a Generative Model

Keyon Vafa, Justin Y. Chen, Jon Kleinberg, Sendhil Mullainathan, Ashesh Rambachan

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[261] arXiv:2406.03699 [pdf, other]

Title: M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question Answering

Anand Subramanian, Viktor Schlegel, Abhinav Ramesh Kashyap, Thanh-Tung Nguyen, Vijay Prakash Dwivedi, Stefan Winkler

Comments: Accepted at ACL 2024 (Findings)

Subjects: Computation and Language (cs.CL)

[262] arXiv:2406.03703 [pdf, html, other]

Title: Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation

Fanyou Wu, Weijie Xu, Chandan K. Reddy, Srinivasan H. Sengamedu

Comments: findings of ACL 2024

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[263] arXiv:2406.03712 [pdf, html, other]

Title: A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directions

Lei Liu, Xiaoyan Yang, Junchi Lei, Xiaoyang Liu, Yue Shen, Zhiqiang Zhang, Peng Wei, Jinjie Gu, Zhixuan Chu, Zhan Qin, Kui Ren

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[264] arXiv:2406.03725 [pdf, html, other]

Title: LLMEmbed: Rethinking Lightweight LLM's Genuine Function in Text Classification

Chun Liu, Hongguang Zhang, Kainan Zhao, Xinghai Ju, Lin Yang

Comments: ACL 2024 main conference

Subjects: Computation and Language (cs.CL)

[265] arXiv:2406.03746 [pdf, html, other]

Title: Efficient Knowledge Infusion via KG-LLM Alignment

Zhouyu Jiang, Ling Zhong, Mengshu Sun, Jun Xu, Rui Sun, Hui Cai, Shuhan Luo, Zhiqiang Zhang

Comments: ACL2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[266] arXiv:2406.03749 [pdf, html, other]

Title: NAP^2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Human

Shuo Huang, William MacLean, Xiaoxi Kang, Anqi Wu, Lizhen Qu, Qiongkai Xu, Zhuang Li, Xingliang Yuan, Gholamreza Haffari

Subjects: Computation and Language (cs.CL)

[267] arXiv:2406.03772 [pdf, other]

Title: Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure

Yang Hou, Zhenghua Li

Comments: Findings of ACL 2024

Subjects: Computation and Language (cs.CL)

[268] arXiv:2406.03776 [pdf, other]

Title: XL-HeadTags: Leveraging Multimodal Retrieval Augmentation for the Multilingual Generation of News Headlines and Tags

Faisal Tareque Shohan, Mir Tafseer Nayeem, Samsul Islam, Abu Ubaida Akash, Shafiq Joty

Comments: ACL 2024 camera ready. The first two authors contributed equally

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[269] arXiv:2406.03790 [pdf, html, other]

Title: End-to-End Trainable Retrieval-Augmented Generation for Relation Extraction

Kohei Makino, Makoto Miwa, Yutaka Sasaki

Comments: preprint

Subjects: Computation and Language (cs.CL)

[270] arXiv:2406.03792 [pdf, html, other]

Title: Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning

Naibin Gu, Peng Fu, Xiyu Liu, Bowen Shen, Zheng Lin, Weiping Wang

Comments: Findings of ACL 2024

Subjects: Computation and Language (cs.CL)

[271] arXiv:2406.03814 [pdf, html, other]

Title: Improving Zero-Shot Chinese-English Code-Switching ASR with kNN-CTC and Gated Monolingual Datastores

Jiaming Zhou, Shiwan Zhao, Hui Wang, Tian-Hao Zhang, Haoqin Sun, Xuechen Wang, Yong Qin

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[272] arXiv:2406.03816 [pdf, html, other]

Title: ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search

Dan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue, Yuxiao Dong, Jie Tang

Comments: 30 pages

Subjects: Computation and Language (cs.CL)

[273] arXiv:2406.03827 [pdf, html, other]

Title: Chaos with Keywords: Exposing Large Language Models Sycophantic Hallucination to Misleading Keywords and Evaluating Defense Strategies

Aswin RRV, Nemika Tyagi, Md Nayem Uddin, Neeraj Varshney, Chitta Baral

Comments: Findings of ACL 2024

Subjects: Computation and Language (cs.CL)

[274] arXiv:2406.03847 [pdf, html, other]

Title: Lean Workbook: A large-scale Lean problem set formalized from natural language math problems

Huaiyuan Ying, Zijian Wu, Yihan Geng, Jiayu Wang, Dahua Lin, Kai Chen

Subjects: Computation and Language (cs.CL)

[275] arXiv:2406.03853 [pdf, html, other]

Title: Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism

Jiahao Liu, Qifan Wang, Jingang Wang, Xunliang Cai

Comments: Accepted by ACL 2024 (Findings)

Subjects: Computation and Language (cs.CL)