Computation and Language

Authors and titles for March 2024

[1101] arXiv:2403.18697 [pdf, html, other]

Title: The Invalsi Benchmarks: measuring Linguistic and Mathematical understanding of Large Language Models in Italian

Giovanni Puccetti, Maria Cassese, Andrea Esuli

Subjects: Computation and Language (cs.CL)

[1102] arXiv:2403.18769 [pdf, other]

Title: Improved Neural Protoform Reconstruction via Reflex Prediction

Liang Lu, Jingzhi Wang, David R. Mortensen

Comments: Accepted to LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1103] arXiv:2403.18771 [pdf, html, other]

Title: CheckEval: Robust Evaluation Framework using Large Language Model via Checklist

Yukyung Lee, Joonghoon Kim, Jaehee Kim, Hyowon Cho, Pilsung Kang

Comments: HEAL at CHI 2024

Subjects: Computation and Language (cs.CL)

[1104] arXiv:2403.18783 [pdf, html, other]

Title: Towards a World-English Language Model for On-Device Virtual Assistants

Rricha Jalota, Lyan Verwimp, Markus Nussbaum-Thom, Amr Mousa, Arturo Argueta, Youssef Oualil

Comments: Accepted in ICASSP 2024

Subjects: Computation and Language (cs.CL)

[1105] arXiv:2403.18802 [pdf, other]

Title: Long-form factuality in large language models

Jerry Wei, Chengrun Yang, Xinying Song, Yifeng Lu, Nathan Hu, Jie Huang, Dustin Tran, Daiyi Peng, Ruibo Liu, Da Huang, Cosmo Du, Quoc V. Le

Comments: NeurIPS 2024; 72 pages, 18 figures, 30 tables. Code at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1106] arXiv:2403.18803 [pdf, html, other]

Title: Projective Methods for Mitigating Gender Bias in Pre-trained Language Models

Hillary Dawkins, Isar Nejadgholi, Daniel Gillis, Judi McCuaig

Journal-ref: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

Subjects: Computation and Language (cs.CL)

[1107] arXiv:2403.18804 [pdf, html, other]

Title: Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation

Mateusz Klimaszewski, Piotr Andruszkiewicz, Alexandra Birch

Comments: Accepted at LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1108] arXiv:2403.18932 [pdf, html, other]

Title: Measuring Political Bias in Large Language Models: What Is Said and How It Is Said

Yejin Bang, Delong Chen, Nayeon Lee, Pascale Fung

Comments: 16 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1109] arXiv:2403.18933 [pdf, html, other]

Title: SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages

Nedjma Ousidhoum, Shamsuddeen Hassan Muhammad, Mohamed Abdalla, Idris Abdulmumin, Ibrahim Said Ahmad, Sanchit Ahuja, Alham Fikri Aji, Vladimir Araujo, Meriem Beloucif, Christine De Kock, Oumaima Hourrane, Manish Shrivastava, Thamar Solorio, Nirmal Surange, Krishnapriya Vishnubhotla, Seid Muhie Yimam, Saif M. Mohammad

Comments: SemEval 2024 Task Description Paper. arXiv admin note: text overlap with arXiv:2402.08638

Subjects: Computation and Language (cs.CL)

[1110] arXiv:2403.18938 [pdf, other]

Title: Reshaping Free-Text Radiology Notes Into Structured Reports With Generative Transformers

Laura Bergomi, Tommaso M. Buonocore, Paolo Antonazzo, Lorenzo Alberghi, Riccardo Bellazzi, Lorenzo Preda, Chandra Bortolotto, Enea Parimbelli

Journal-ref: Artificial Intelligence in Medicine, Volume 154, 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1111] arXiv:2403.18969 [pdf, other]

Title: A Survey on Large Language Models from Concept to Implementation

Chen Wang, Jin Zhao, Jiaqi Gong

Comments: Section 3 lacks to clarity and accuracy in defining the applications and capabilities of LLMs. More rework needs to be done on illustrate how LLMs being used in cross-domains

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT); Machine Learning (cs.LG)

[1112] arXiv:2403.18973 [pdf, html, other]

Title: Conformal Intent Classification and Clarification for Fast and Accurate Intent Recognition

Floris den Hengst, Ralf Wolter, Patrick Altmeyer, Arda Kaygan

Comments: 9 pages,2 figures,3 tables,6 appendices,to be published in ACL's NAACL Findings 2024

Subjects: Computation and Language (cs.CL)

[1113] arXiv:2403.18975 [pdf, html, other]

Title: A Novel Corpus of Annotated Medical Imaging Reports and Information Extraction Results Using BERT-based Language Models

Namu Park, Kevin Lybarger, Giridhar Kaushik Ramachandran, Spencer Lewis, Aashka Damani, Ozlem Uzuner, Martin Gunn, Meliha Yetisgen

Comments: Accepted at LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1114] arXiv:2403.18976 [pdf, html, other]

Title: "Sorry, Come Again?" Prompting -- Enhancing Comprehension and Diminishing Hallucination with [PAUSE]-injected Optimal Paraphrasing

Vipula Rawte, S.M Towhidul Islam Tonmoy, S M Mehedi Zaman, Prachi Priya, Aman Chadha, Amit P. Sheth, Amitava Das

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1115] arXiv:2403.19012 [pdf, html, other]

Title: ReflectSumm: A Benchmark for Course Reflection Summarization

Yang Zhong, Mohamed Elaraby, Diane Litman, Ahmed Ashraf Butt, Muhsin Menekse

Comments: LREC-COLING 2024 camera ready; code and dataset are available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1116] arXiv:2403.19031 [pdf, other]

Title: Evaluating Large Language Models for Health-Related Text Classification Tasks with Public Social Media Data

Yuting Guo, Anthony Ovadje, Mohammed Ali Al-Garadi, Abeed Sarker

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1117] arXiv:2403.19056 [pdf, html, other]

Title: CAUSE: Counterfactual Assessment of User Satisfaction Estimation in Task-Oriented Dialogue Systems

Amin Abolghasemi, Zhaochun Ren, Arian Askari, Mohammad Aliannejadi, Maarten de Rijke, Suzan Verberne

Subjects: Computation and Language (cs.CL)

[1118] arXiv:2403.19094 [pdf, html, other]

Title: Learning From Correctness Without Prompting Makes LLM Efficient Reasoner

Yuxuan Yao, Han Wu, Zhijiang Guo, Biyan Zhou, Jiahui Gao, Sichun Luo, Hanxu Hou, Xiaojin Fu, Linqi Song

Comments: Accepted to COLM 2024

Subjects: Computation and Language (cs.CL)

[1119] arXiv:2403.19113 [pdf, html, other]

Title: FACTOID: FACtual enTailment fOr hallucInation Detection

Vipula Rawte, S.M Towhidul Islam Tonmoy, Krishnav Rajbangshi, Shravani Nag, Aman Chadha, Amit P. Sheth, Amitava Das

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1120] arXiv:2403.19116 [pdf, other]

Title: MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering

Che Guan, Mengyu Huang, Peng Zhang

Comments: 8 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1121] arXiv:2403.19121 [pdf, html, other]

Title: Code Comparison Tuning for Code Large Language Models

Yufan Jiang, Qiaozhi He, Xiaomin Zhuang, Zhihua Wu

Comments: Preprint

Subjects: Computation and Language (cs.CL)

[1122] arXiv:2403.19135 [pdf, html, other]

Title: Streamlining Redundant Layers to Compress Large Language Models

Xiaodong Chen, Yuxuan Hu, Jing Zhang, Yanling Wang, Cuiping Li, Hong Chen

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1123] arXiv:2403.19142 [pdf, html, other]

Title: A Tulu Resource for Machine Translation

Manu Narayanan, Noëmi Aepli

Comments: Accepted at LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1124] arXiv:2403.19154 [pdf, html, other]

Title: STaR-GATE: Teaching Language Models to Ask Clarifying Questions

Chinmaya Andukuri, Jan-Philipp Fränken, Tobias Gerstenberg, Noah D. Goodman

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1125] arXiv:2403.19159 [pdf, html, other]

Title: Disentangling Length from Quality in Direct Preference Optimization

Ryan Park, Rafael Rafailov, Stefano Ermon, Chelsea Finn

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1126] arXiv:2403.19161 [pdf, html, other]

Title: Improving Vietnamese-English Medical Machine Translation

Nhu Vo, Dat Quoc Nguyen, Dung D. Le, Massimo Piccardi, Wray Buntine

Comments: To appear in Proceedings of LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1127] arXiv:2403.19167 [pdf, html, other]

Title: Mitigating Misleading Chain-of-Thought Reasoning with Selective Filtering

Yexin Wu, Zhuosheng Zhang, Hai Zhao

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1128] arXiv:2403.19183 [pdf, html, other]

Title: Empirical Analysis for Unsupervised Universal Dependency Parse Tree Aggregation

Adithya Kulkarni, Oliver Eulenstein, Qi Li

Subjects: Computation and Language (cs.CL)

[1129] arXiv:2403.19219 [pdf, html, other]

Title: Collaborative Knowledge Infusion for Low-resource Stance Detection

Ming Yan, Joey Tianyi Zhou, Ivor W. Tsang

Comments: 13 pages, 3 figures, Big Data Mining and Analysis

Subjects: Computation and Language (cs.CL)

[1130] arXiv:2403.19259 [pdf, html, other]

Title: J-CRe3: A Japanese Conversation Dataset for Real-world Reference Resolution

Nobuhiro Ueda, Hideko Habe, Yoko Matsui, Akishige Yuguchi, Seiya Kawano, Yasutomo Kawanishi, Sadao Kurohashi, Koichiro Yoshino

Comments: LREC-COLING 2024

Subjects: Computation and Language (cs.CL)

[1131] arXiv:2403.19260 [pdf, other]

Title: NaijaHate: Evaluating Hate Speech Detection on Nigerian Twitter Using Representative Data

Manuel Tonneau, Pedro Vitor Quinta de Castro, Karim Lasri, Ibrahim Farouq, Lakshminarayanan Subramanian, Victor Orozco-Olvera, Samuel P. Fraiberger

Comments: ACL 2024 main conference. Data and models available at this https URL

Subjects: Computation and Language (cs.CL)

[1132] arXiv:2403.19267 [pdf, html, other]

Title: MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs

Xianhao Yu, Jiaqi Fu, Renjia Deng, Wenjuan Han

Comments: Project website: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1133] arXiv:2403.19270 [pdf, html, other]

Title: sDPO: Don't Use Your Data All at Once

Dahyun Kim, Yungi Kim, Wonho Song, Hyeonwoo Kim, Yunsu Kim, Sanghoon Kim, Chanjun Park

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1134] arXiv:2403.19275 [pdf, html, other]

Title: Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agent

Junkai Zhou, Liang Pang, Ya Jing, Jia Gu, Huawei Shen, Xueqi Cheng

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1135] arXiv:2403.19279 [pdf, html, other]

Title: Fine-Tuning Language Models with Reward Learning on Policy

Hao Lang, Fei Huang, Yongbin Li

Comments: NAACL2024 Main Track Long Paper

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1136] arXiv:2403.19283 [pdf, html, other]

Title: Ungrammatical-syntax-based In-context Example Selection for Grammatical Error Correction

Chenming Tang, Fanyi Qu, Yunfang Wu

Comments: Accepted to NAACL 2024 Main Conference

Subjects: Computation and Language (cs.CL)

[1137] arXiv:2403.19285 [pdf, other]

Title: Going Beyond Word Matching: Syntax Improves In-context Example Selection for Machine Translation

Chenming Tang, Zhixiang Wang, Yunfang Wu

Comments: Some reported baselines are not comparable in Section 5 and could be misleading and confusing

Subjects: Computation and Language (cs.CL)

[1138] arXiv:2403.19305 [pdf, html, other]

Title: MATEval: A Multi-Agent Discussion Framework for Advancing Open-Ended Text Evaluation

Yu Li, Shenyu Zhang, Rui Wu, Xiutian Huang, Yongrui Chen, Wenhao Xu, Guilin Qi, Dehai Min

Comments: This paper has been accepted as a long paper presentation by DASFAA 2024 Industrial Track

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1139] arXiv:2403.19317 [pdf, html, other]

Title: Beyond Borders: Investigating Cross-Jurisdiction Transfer in Legal Case Summarization

T.Y.S.S Santosh, Vatsal Venkatkrishna, Saptarshi Ghosh, Matthias Grabmair

Comments: Accepted to NAACL 2024

Subjects: Computation and Language (cs.CL)

[1140] arXiv:2403.19318 [pdf, html, other]

Title: TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios

Xiaokang Zhang, Jing Zhang, Zeyao Ma, Yang Li, Bohan Zhang, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-Li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang

Comments: this https URL

Subjects: Computation and Language (cs.CL)

[1141] arXiv:2403.19335 [pdf, html, other]

Title: KazSAnDRA: Kazakh Sentiment Analysis Dataset of Reviews and Attitudes

Rustem Yeshpanov, Huseyin Atakan Varol

Comments: To appear in Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

Subjects: Computation and Language (cs.CL)

[1142] arXiv:2403.19340 [pdf, html, other]

Title: Dataverse: Open-Source ETL (Extract, Transform, Load) Pipeline for Large Language Models

Hyunbyung Park, Sukyung Lee, Gyoungjin Gim, Yungi Kim, Dahyun Kim, Chanjun Park

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1143] arXiv:2403.19346 [pdf, html, other]

Title: Large Language Models Are Unconscious of Unreasonability in Math Problems

Jingyuan Ma, Damai Dai, Lei Sha, Zhifang Sui

Comments: 11 pages, 3 figures

Subjects: Computation and Language (cs.CL)

[1144] arXiv:2403.19352 [pdf, html, other]

Title: A diverse Multilingual News Headlines Dataset from around the World

Felix Leeb, Bernhard Schölkopf

Comments: Published in NAACL 2024 Proceedings (Short Paper track)

Subjects: Computation and Language (cs.CL)

[1145] arXiv:2403.19354 [pdf, html, other]

Title: AIpom at SemEval-2024 Task 8: Detecting AI-produced Outputs in M4

Alexander Shirnin, Nikita Andreev, Vladislav Mikhailov, Ekaterina Artemova

Comments: 2nd place at SemEval-2024 Task 8, Subtask C, to appear in SemEval-2024 proceedings

Subjects: Computation and Language (cs.CL)

[1146] arXiv:2403.19358 [pdf, html, other]

Title: Risk prediction of pathological gambling on social media

Angelina Parfenova, Marianne Clausel

Subjects: Computation and Language (cs.CL)

[1147] arXiv:2403.19365 [pdf, html, other]

Title: EthioMT: Parallel Corpus for Low-resource Ethiopian Languages

Atnafu Lambebo Tonja, Olga Kolesnikova, Alexander Gelbukh, Jugal Kalita

Comments: Accepted at The Fifth workshop on Resources for African Indigenous Languages (RAIL) 2024 ( LREC-COLING 2024)

Subjects: Computation and Language (cs.CL)

[1148] arXiv:2403.19390 [pdf, html, other]

Title: Checkpoint Merging via Bayesian Optimization in LLM Pretraining

Deyuan Liu, Zecheng Wang, Bingning Wang, Weipeng Chen, Chunshan Li, Zhiying Tu, Dianhui Chu, Bo Li, Dianbo Sui

Subjects: Computation and Language (cs.CL)

[1149] arXiv:2403.19399 [pdf, html, other]

Title: KazParC: Kazakh Parallel Corpus for Machine Translation

Rustem Yeshpanov, Alina Polonskaya, Huseyin Atakan Varol

Comments: To appear in Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

Subjects: Computation and Language (cs.CL)

[1150] arXiv:2403.19414 [pdf, html, other]

Title: BP4ER: Bootstrap Prompting for Explicit Reasoning in Medical Dialogue Generation

Yuhong He, Yongqi Zhang, Shizhu He, Jun Wan

Comments: Accepted at LREC-COLING 2024

Subjects: Computation and Language (cs.CL)