Computation and Language

Authors and titles for June 2024

[926] arXiv:2406.11328 [pdf, html, other]

Title: Are Large Language Models True Healthcare Jacks-of-All-Trades? Benchmarking Across Health Professions Beyond Physician Exams

Zheheng Luo, Chenhan Yuan, Qianqian Xie, Sophia Ananiadou

Comments: 15 pages, 4 figures

Subjects: Computation and Language (cs.CL)

[927] arXiv:2406.11338 [pdf, html, other]

Title: Fine-grained Controllable Text Generation through In-context Learning with Feedback

Sarubi Thillainathan, Alexander Koller

Subjects: Computation and Language (cs.CL)

[928] arXiv:2406.11341 [pdf, html, other]

Title: A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences

Leonardo Bertolazzi, Albert Gatt, Raffaella Bernardi

Comments: Accepted to EMNLP 2024 (main conference)

Subjects: Computation and Language (cs.CL)

[929] arXiv:2406.11345 [pdf, html, other]

Title: Full-ECE: A Metric For Token-level Calibration on Large Language Models

Han Liu, Yupeng Zhang, Bingning Wang, Weipeng Chen, Xiaolin Hu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[930] arXiv:2406.11354 [pdf, html, other]

Title: Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression

Zilun Zhang, Yutao Sun, Tiancheng Zhao, Leigang Sha, Ruochen Xu, Kyusong Lee, Jianwei Yin

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[931] arXiv:2406.11357 [pdf, html, other]

Title: Refiner: Restructure Retrieval Content Efficiently to Advance Question-Answering Capabilities

Zhonghao Li, Xuming Hu, Aiwei Liu, Kening Zheng, Sirui Huang, Hui Xiong

Comments: 8 pages

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[932] arXiv:2406.11368 [pdf, html, other]

Title: Improving Quotation Attribution with Fictional Character Embeddings

Gaspard Michel, Elena V. Epure, Romain Hennequin, Christophe Cerisara

Comments: EMNLP 2024 (Findings)

Subjects: Computation and Language (cs.CL)

[933] arXiv:2406.11370 [pdf, html, other]

Title: Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments

Han Zhou, Xingchen Wan, Yinhong Liu, Nigel Collier, Ivan Vulić, Anna Korhonen

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG)

[934] arXiv:2406.11375 [pdf, html, other]

Title: Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models?

Siyu Yuan, Cheng Jiayang, Lin Qiu, Deqing Yang

Comments: Accepted to EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[935] arXiv:2406.11380 [pdf, html, other]

Title: A Realistic Evaluation of LLMs for Quotation Attribution in Literary Texts: A Case Study of LLaMa3

Gaspard Michel, Elena V. Epure, Romain Hennequin, Christophe Cerisara

Comments: Paper under review

Subjects: Computation and Language (cs.CL)

[936] arXiv:2406.11385 [pdf, html, other]

Title: MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic

Yuyan Zhou, Liang Song, Bingning Wang, Weipeng Chen

Comments: 19 pages

Subjects: Computation and Language (cs.CL)

[937] arXiv:2406.11400 [pdf, other]

Title: Large Language Models and Knowledge Graphs for Astronomical Entity Disambiguation

Golnaz Shapurian

Subjects: Computation and Language (cs.CL); Instrumentation and Methods for Astrophysics (astro-ph.IM)

[938] arXiv:2406.11402 [pdf, html, other]

Title: Are Small Language Models Ready to Compete with Large Language Models for Practical Applications?

Neelabh Sinha, Vinija Jain, Aman Chadha

Comments: Submitted to ARR

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[939] arXiv:2406.11409 [pdf, html, other]

Title: CodeGemma: Open Code Models Based on Gemma

CodeGemma Team: Heri Zhao, Jeffrey Hui, Joshua Howland, Nam Nguyen, Siqi Zuo, Andrea Hu, Christopher A. Choquette-Choo, Jingyue Shen, Joe Kelley, Kshitij Bansal, Luke Vilnis, Mateo Wirth, Paul Michel, Peter Choy, Pratik Joshi, Ravin Kumar, Sarmad Hashmi, Shubham Agrawal, Zhitao Gong, Jane Fine, Tris Warkentin, Ale Jakse Hartman, Bin Ni, Kathy Korevec, Kelly Schaefer, Scott Huffman

Comments: v1: 11 pages, 4 figures, 5 tables. v2: Update metadata

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[940] arXiv:2406.11410 [pdf, html, other]

Title: HARE: HumAn pRiors, a key to small language model Efficiency

Lingyun Zhang, Bin jin, Gaojian Ge, Lunhui Liu, Xuewen Shen, Mingyong Wu, Houqian Zhang, Yongneng Jiang, Shiqi Chen, Shi Pu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[941] arXiv:2406.11418 [pdf, html, other]

Title: BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM

Zhewen Shen, Aditya Joshi, Ruey-Cheng Chen

Comments: 5 pages + references; Selected at CMCL Workshop@ACL 2024

Subjects: Computation and Language (cs.CL)

[942] arXiv:2406.11429 [pdf, html, other]

Title: Fusion Makes Perfection: An Efficient Multi-Grained Matching Approach for Zero-Shot Relation Extraction

Shilong Li, Ge Bai, Zhang Zhang, Ying Liu, Chenji Lu, Daichi Guo, Ruifang Liu, Yong Sun

Comments: Accepted to the main conference of NAACL2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[943] arXiv:2406.11430 [pdf, html, other]

Title: A Simple and Effective $L_2$ Norm-Based Strategy for KV Cache Compression

Alessio Devoto, Yu Zhao, Simone Scardapane, Pasquale Minervini

Comments: This is an extended version of a paper published in the proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP 2024); this version was presented at the 4th NeurIPS Workshop on Efficient Natural Language and Speech Processing (ENLSP-IV)

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[944] arXiv:2406.11431 [pdf, html, other]

Title: Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization

Wenkai Yang, Shiqi Shen, Guangyao Shen, Wei Yao, Yong Liu, Zhi Gong, Yankai Lin, Ji-Rong Wen

Comments: Code is available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[945] arXiv:2406.11455 [pdf, html, other]

Title: Adaptive Reinforcement Learning Planning: Harnessing Large Language Models for Complex Information Extraction

Zepeng Ding, Ruiyang Ke, Wenhao Huang, Guochao Jiang, Yanda Li, Deqing Yang, Jiaqing Liang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[946] arXiv:2406.11460 [pdf, html, other]

Title: TRACE the Evidence: Constructing Knowledge-Grounded Reasoning Chains for Retrieval-Augmented Generation

Jinyuan Fang, Zaiqiao Meng, Craig Macdonald

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[947] arXiv:2406.11464 [pdf, html, other]

Title: Automating Easy Read Text Segmentation

Jesús Calleja, Thierry Etchegoyhen, David Ponce

Subjects: Computation and Language (cs.CL)

[948] arXiv:2406.11473 [pdf, html, other]

Title: Promises, Outlooks and Challenges of Diffusion Language Modeling

Justin Deschenaux, Caglar Gulcehre

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[949] arXiv:2406.11474 [pdf, html, other]

Title: How Far Can In-Context Alignment Go? Exploring the State of In-Context Alignment

Heyan Huang, Yinghao Li, Huashan Sun, Yu Bai, Yang Gao

Comments: 22 pages, 6 figures, work in progress

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[950] arXiv:2406.11477 [pdf, html, other]

Title: How Can We Effectively Expand the Vocabulary of LLMs with 0.01GB of Target Language Text?

Atsuki Yamaguchi, Aline Villavicencio, Nikolaos Aletras

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)