Computation and Language

Authors and titles for April 2024

[61] arXiv:2404.00614 [pdf, html, other]

Title: Learning to Plan for Language Modeling from Unlabeled Data

Nathan Cornille, Marie-Francine Moens, Florian Mai

Comments: Published at COLM 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[62] arXiv:2404.00620 [pdf, html, other]

Title: Reporting Eye-Tracking Data Quality: Towards a New Standard

Deborah N. Jakobi, Daniel G. Krakowczyk, Lena A. Jäger

Journal-ref: Proceedings of the 2024 Symposium on Eye Tracking Research and Applications (ETRA '24) Article 47 1-3

Subjects: Computation and Language (cs.CL)

[63] arXiv:2404.00629 [pdf, html, other]

Title: Against The Achilles' Heel: A Survey on Red Teaming for Generative Models

Lizhi Lin, Honglin Mu, Zenan Zhai, Minghan Wang, Yuxia Wang, Renxi Wang, Junjie Gao, Yixuan Zhang, Wanxiang Che, Timothy Baldwin, Xudong Han, Haonan Li

Subjects: Computation and Language (cs.CL)

[64] arXiv:2404.00656 [pdf, html, other]

Title: WavLLM: Towards Robust and Adaptive Speech Large Language Model

Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei

Comments: accepted by EMNLP2024 findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[65] arXiv:2404.00681 [pdf, html, other]

Title: CoUDA: Coherence Evaluation via Unified Data Augmentation

Dawei Zhu, Wenhao Wu, Yifan Song, Fangwei Zhu, Ziqiang Cao, Sujian Li

Comments: NAACL 2024

Subjects: Computation and Language (cs.CL)

[66] arXiv:2404.00699 [pdf, html, other]

Title: How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize Library

Mathieu Ravaut, Bosheng Ding, Fangkai Jiao, Hailin Chen, Xingxuan Li, Ruochen Zhao, Chengwei Qin, Caiming Xiong, Shafiq Joty

Comments: 8 pages, 1 figure, 1 table

Subjects: Computation and Language (cs.CL)

[67] arXiv:2404.00727 [pdf, html, other]

Title: A Controlled Reevaluation of Coreference Resolution Models

Ian Porada, Xiyuan Zou, Jackie Chi Kit Cheung

Comments: LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[68] arXiv:2404.00739 [pdf, html, other]

Title: Opera Graeca Adnotata: Building a 34M+ Token Multilayer Corpus for Ancient Greek

Giuseppe G. A. Celano

Subjects: Computation and Language (cs.CL)

[69] arXiv:2404.00748 [pdf, html, other]

Title: Benchmark Transparency: Measuring the Impact of Data on Evaluation

Venelin Kovatchev, Matthew Lease

Comments: Accepted at NAACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[70] arXiv:2404.00750 [pdf, html, other]

Title: Can Language Models Recognize Convincing Arguments?

Paula Rescala, Manoel Horta Ribeiro, Tiancheng Hu, Robert West

Comments: Accepted to EMNLP Findings, please cite accordingly

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[71] arXiv:2404.00752 [pdf, html, other]

Title: On the True Distribution Approximation of Minimum Bayes-Risk Decoding

Atsumoto Ohashi, Ukyo Honda, Tetsuro Morimura, Yuu Jinnai

Comments: NAACL 2024 (main conference)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[72] arXiv:2404.00758 [pdf, html, other]

Title: From Robustness to Improved Generalization and Calibration in Pre-trained Language Models

Josip Jukić, Jan Šnajder

Subjects: Computation and Language (cs.CL)

[73] arXiv:2404.00826 [pdf, html, other]

Title: Extracting Social Determinants of Health from Pediatric Patient Notes Using Large Language Models: Novel Corpus and Methods

Yujuan Fu, Giridhar Kaushik Ramachandran, Nicholas J Dobbins, Namu Park, Michael Leu, Abby R. Rosenberg, Kevin Lybarger, Fei Xia, Ozlem Uzuner, Meliha Yetisgen

Comments: 12 pages, 2 figures and 3 tables. Accepted by LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[74] arXiv:2404.00828 [pdf, html, other]

Title: PID Control-Based Self-Healing to Improve the Robustness of Large Language Models

Zhuotong Chen, Zihu Wang, Yifan Yang, Qianxiao Li, Zheng Zhang

Comments: Transactions on Machine Learning Research

Subjects: Computation and Language (cs.CL)

[75] arXiv:2404.00829 [pdf, html, other]

Title: Returning to the Start: Generating Narratives with Related Endpoints

Anneliese Brei, Chao Zhao, Snigdha Chaturvedi

Subjects: Computation and Language (cs.CL)

[76] arXiv:2404.00862 [pdf, html, other]

Title: Bailong: Bilingual Transfer Learning based on QLoRA and Zip-tie Embedding

Lung-Chuan Chen, Zong-Ru Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[77] arXiv:2404.00884 [pdf, html, other]

Title: Self-Demos: Eliciting Out-of-Demonstration Generalizability in Large Language Models

Wei He, Shichun Liu, Jun Zhao, Yiwen Ding, Yi Lu, Zhiheng Xi, Tao Gui, Qi Zhang, Xuanjing Huang

Comments: Accepted to NAACL 2024 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[78] arXiv:2404.00899 [pdf, html, other]

Title: TM-TREK at SemEval-2024 Task 8: Towards LLM-Based Automatic Boundary Detection for Human-Machine Mixed Text

Xiaoyan Qu, Xiangfeng Meng

Comments: 1st place at SemEval-2024 Task 8, Subtask C, to appear in SemEval-2024 proceedings

Subjects: Computation and Language (cs.CL)

[79] arXiv:2404.00914 [pdf, html, other]

Title: Token-Efficient Leverage Learning in Large Language Models

Yuanhao Zeng, Min Wang, Yihang Wang, Yingxia Shao

Comments: 15 pages, 16 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[80] arXiv:2404.00929 [pdf, html, other]

Title: A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias

Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Yuqi Ye, Hanwen Gu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[81] arXiv:2404.00930 [pdf, html, other]

Title: PSYDIAL: Personality-based Synthetic Dialogue Generation using Large Language Models

Ji-Eun Han, Jun-Seok Koh, Hyeon-Tae Seo, Du-Seong Chang, Kyung-Ah Sohn

Comments: LREC-COLING 2024 Main

Subjects: Computation and Language (cs.CL)

[82] arXiv:2404.00934 [pdf, html, other]

Title: ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback

Zhenyu Hou, Yilin Niu, Zhengxiao Du, Xiaohan Zhang, Xiao Liu, Aohan Zeng, Qinkai Zheng, Minlie Huang, Hongning Wang, Jie Tang, Yuxiao Dong

Subjects: Computation and Language (cs.CL)

[83] arXiv:2404.00942 [pdf, html, other]

Title: Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs

Xiaoze Liu, Feijie Wu, Tianyang Xu, Zhuo Chen, Yichi Zhang, Xiaoqian Wang, Jing Gao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[84] arXiv:2404.00943 [pdf, html, other]

Title: Evalverse: Unified and Accessible Library for Large Language Model Evaluation

Jihoo Kim, Wonho Song, Dahyun Kim, Yunsu Kim, Yungi Kim, Chanjun Park

Comments: Accepted to EMNLP 2024 Demo Track

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[85] arXiv:2404.00950 [pdf, html, other]

Title: AISPACE at SemEval-2024 task 8: A Class-balanced Soft-voting System for Detecting Multi-generator Machine-generated Text

Renhua Gu, Xiangfeng Meng

Comments: 1st place at SemEval-2024 Task 8, Subtask B, to appear in SemEval-2024 proceedings

Subjects: Computation and Language (cs.CL)

[86] arXiv:2404.00978 [pdf, other]

Title: Prior Constraints-based Reward Model Training for Aligning Large Language Models

Hang Zhou, Chenglong Wang, Yimin Hu, Tong Xiao, Chunliang Zhang, Jingbo Zhu

Comments: Accepted by CCL 2024

Subjects: Computation and Language (cs.CL)

[87] arXiv:2404.00990 [pdf, html, other]

Title: Exploring the Nexus of Large Language Models and Legal Systems: A Short Survey

Weicong Qin, Zhongxiang Sun

Subjects: Computation and Language (cs.CL)

[88] arXiv:2404.00998 [pdf, html, other]

Title: LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generation

Zilong Wang, Xufang Luo, Xinyang Jiang, Dongsheng Li, Lili Qiu

Comments: 11 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[89] arXiv:2404.00999 [pdf, html, other]

Title: What Causes the Failure of Explicit to Implicit Discourse Relation Recognition?

Wei Liu, Stephen Wan, Michael Strube

Comments: Accepted by NAACL2024 (Long Paper)

Subjects: Computation and Language (cs.CL)

[90] arXiv:2404.01009 [pdf, html, other]

Title: Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languages

Joanito Agili Lopo, Radius Tanone

Comments: Submitted for consideration at the EAMT, 2024. Results pending

Subjects: Computation and Language (cs.CL)

[91] arXiv:2404.01015 [pdf, html, other]

Title: PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison

ChaeHun Park, Minseok Choi, Dohyun Lee, Jaegul Choo

Comments: COLM2024 (accepted)

Subjects: Computation and Language (cs.CL)

[92] arXiv:2404.01019 [pdf, html, other]

Title: Source-Aware Training Enables Knowledge Attribution in Language Models

Muhammad Khalifa, David Wadden, Emma Strubell, Honglak Lee, Lu Wang, Iz Beltagy, Hao Peng

Comments: COLM '24

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[93] arXiv:2404.01029 [pdf, html, other]

Title: Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identification

Kotaro Aono, Ryohei Sasano, Koichi Takeda

Comments: 9 pages, 0 figures, accepted in NAACL2024

Subjects: Computation and Language (cs.CL)

[94] arXiv:2404.01037 [pdf, html, other]

Title: ARAGOG: Advanced RAG Output Grading

Matouš Eibich, Shivay Nagpal, Alexander Fred-Ojala

Comments: 14 pages, 8 figures, associated Github repo: this https URL

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[95] arXiv:2404.01054 [pdf, html, other]

Title: Regularized Best-of-N Sampling to Mitigate Reward Hacking for Language Model Alignment

Yuu Jinnai, Tetsuro Morimura, Kaito Ariu, Kenshi Abe

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[96] arXiv:2404.01067 [pdf, html, other]

Title: Exploring the Mystery of Influential Data for Mathematical Reasoning

Xinzhe Ni, Yeyun Gong, Zhibin Gou, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen

Comments: Accepted by COLM 2024

Subjects: Computation and Language (cs.CL)

[97] arXiv:2404.01070 [pdf, html, other]

Title: Advancing AI with Integrity: Ethical Challenges and Solutions in Neural Machine Translation

Richard Kimera, Yun-Seon Kim, Heeyoul Choi

Comments: 11 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[98] arXiv:2404.01077 [pdf, html, other]

Title: Efficient Prompting Methods for Large Language Models: A Survey

Kaiyan Chang, Songcheng Xu, Chenglong Wang, Yingfeng Luo, Tong Xiao, Jingbo Zhu

Subjects: Computation and Language (cs.CL)

[99] arXiv:2404.01084 [pdf, html, other]

Title: AILS-NTUA at SemEval-2024 Task 9: Cracking Brain Teasers: Transformer Models for Lateral Thinking Puzzles

Ioannis Panagiotopoulos, Giorgos Filandrianos, Maria Lymperaiou, Giorgos Stamou

Comments: SemEval-2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[100] arXiv:2404.01104 [pdf, html, other]

Title: SentiCSE: A Sentiment-aware Contrastive Sentence Embedding Framework with Sentiment-guided Textual Similarity

Jaemin Kim, Yohan Na, Kangmin Kim, Sang Rak Lee, Dong-Kyu Chae

Comments: 14 pages, 8 figures

Journal-ref: LREC-COLING2024

Subjects: Computation and Language (cs.CL)

[101] arXiv:2404.01129 [pdf, html, other]

Title: Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation

Bohao Yang, Kun Zhao, Chen Tang, Dong Liu, Liang Zhan, Chenghua Lin

Subjects: Computation and Language (cs.CL)

[102] arXiv:2404.01140 [pdf, html, other]

Title: KoCoNovel: Annotated Dataset of Character Coreference in Korean Novels

Kyuhee Kim, Surin Lee, Sangah Lee

Comments: 12 pages

Subjects: Computation and Language (cs.CL)

[103] arXiv:2404.01147 [pdf, html, other]

Title: Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit

Parker Seegmiller, Joseph Gatto, Omar Sharif, Madhusudan Basak, Sarah Masud Preum

Comments: 4 pages, 2 figures

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[104] arXiv:2404.01157 [pdf, html, other]

Title: Green AI: Exploring Carbon Footprints, Mitigation Strategies, and Trade Offs in Large Language Model Training

Vivian Liu, Yiqiao Yin

Subjects: Computation and Language (cs.CL); Performance (cs.PF)

[105] arXiv:2404.01158 [pdf, html, other]

Title: Dialogue with Robots: Proposals for Broadening Participation and Research in the SLIVAR Community

Casey Kennington, Malihe Alikhani, Heather Pon-Barry, Katherine Atwell, Yonatan Bisk, Daniel Fried, Felix Gervits, Zhao Han, Mert Inan, Michael Johnston, Raj Korpan, Diane Litman, Matthew Marge, Cynthia Matuszek, Ross Mead, Shiwali Mohan, Raymond Mooney, Natalie Parde, Jivko Sinapov, Angela Stewart, Matthew Stone, Stefanie Tellex, Tom Williams

Comments: NSF Report on the "Dialogue with Robots" Workshop held in Pittsburg, PA, April 2023

Subjects: Computation and Language (cs.CL); Robotics (cs.RO)

[106] arXiv:2404.01165 [pdf, html, other]

Title: LITE: Modeling Environmental Ecosystems with Multimodal Large Language Models

Haoran Li, Junqi Liu, Zexian Wang, Shiyuan Luo, Xiaowei Jia, Huaxiu Yao

Comments: COLM camera-ready version. Code is released at this https URL

Subjects: Computation and Language (cs.CL)

[107] arXiv:2404.01182 [pdf, html, other]

Title: A Neuro-Symbolic Approach to Monitoring Salt Content in Food

Anuja Tayal, Barbara Di Eugenio, Devika Salunke, Andrew D. Boyd, Carolyn A Dickens, Eulalia P Abril, Olga Garcia-Bedoya, Paula G Allen-Meares

Comments: Accepted in CL4Health workshop in LREC-COLING'24

Subjects: Computation and Language (cs.CL); Symbolic Computation (cs.SC)

[108] arXiv:2404.01189 [pdf, html, other]

Title: Generating Faithful and Complete Hospital-Course Summaries from the Electronic Health Record

Griffin Adams

Comments: PhD thesis

Subjects: Computation and Language (cs.CL)

[109] arXiv:2404.01196 [pdf, html, other]

Title: Estimating Lexical Complexity from Document-Level Distributions

Sondre Wold, Petter Mæhlum, Oddbjørn Hove

Comments: LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[110] arXiv:2404.01204 [pdf, html, other]

Title: The Fine Line: Navigating Large Language Model Pretraining with Down-streaming Capability Analysis

Chen Yang, Junzhuo Li, Xinyao Niu, Xinrun Du, Songyang Gao, Haoran Zhang, Zhaoliang Chen, Xingwei Qu, Ruibin Yuan, Yizhi Li, Jiaheng Liu, Stephen W. Huang, Shawn Yue, Ge Zhang

Subjects: Computation and Language (cs.CL)