Computation and Language

Authors and titles for June 2024

[1311] arXiv:2406.14868 [pdf, other]

Title: Direct Multi-Turn Preference Optimization for Language Agents

Wentao Shi, Mengqi Yuan, Junkang Wu, Qifan Wang, Fuli Feng

Comments: Accepted by EMNLP 2024 Main

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1312] arXiv:2406.14877 [pdf, html, other]

Title: Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Video

Zhengbang Yang, Haotian Xia, Jingxi Li, Zezhi Chen, Zhuangdi Zhu, Weining Shen

Subjects: Computation and Language (cs.CL)

[1313] arXiv:2406.14882 [pdf, html, other]

Title: 70B-parameter large language models in Japanese medical question-answering

Issey Sukeda, Risa Kishikawa, Satoshi Kodera

Comments: 7 pages, 2 figures, 4 Tables

Subjects: Computation and Language (cs.CL)

[1314] arXiv:2406.14883 [pdf, html, other]

Title: OATH-Frames: Characterizing Online Attitudes Towards Homelessness with LLM Assistants

Jaspreet Ranjit, Brihi Joshi, Rebecca Dorn, Laura Petry, Olga Koumoundouros, Jayne Bottarini, Peichen Liu, Eric Rice, Swabha Swayamdipta

Comments: Project website: this https URL, EMNLP Main 2024

Subjects: Computation and Language (cs.CL); Computers and Society (cs.CY)

[1315] arXiv:2406.14884 [pdf, html, other]

Title: FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agents

Ruixuan Xiao, Wentao Ma, Ke Wang, Yuchuan Wu, Junbo Zhao, Haobo Wang, Fei Huang, Yongbin Li

Subjects: Computation and Language (cs.CL)

[1316] arXiv:2406.14887 [pdf, html, other]

Title: InternLM-Law: An Open Source Chinese Legal Large Language Model

Zhiwei Fei, Songyang Zhang, Xiaoyu Shen, Dawei Zhu, Xiao Wang, Maosong Cao, Fengzhe Zhou, Yining Li, Wenwei Zhang, Dahua Lin, Kai Chen, Jidong Ge

Comments: Our dataset, code and models will be released at this https URL

Subjects: Computation and Language (cs.CL)

[1317] arXiv:2406.14890 [pdf, html, other]

Title: InterBiasing: Boost Unseen Word Recognition through Biasing Intermediate Predictions

Yu Nakagome, Michael Hentschel

Comments: Accepted to Interspeech 2024

Subjects: Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1318] arXiv:2406.14891 [pdf, html, other]

Title: Generate-then-Ground in Retrieval-Augmented Generation for Multi-hop Question Answering

Zhengliang Shi, Weiwei Sun, Shen Gao, Pengjie Ren, Zhumin Chen, Zhaochun Ren

Comments: ACL 2024 (main conference)

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1319] arXiv:2406.14894 [pdf, other]

Title: Talking the Talk Does Not Entail Walking the Walk: On the Limits of Large Language Models in Lexical Entailment Recognition

Candida M. Greco, Lucio La Cava, Andrea Tagarelli

Comments: Accepted for publication at The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP-2024) - Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Information Retrieval (cs.IR); Physics and Society (physics.soc-ph)

[1320] arXiv:2406.14938 [pdf, other]

Title: Towards Retrieval Augmented Generation over Large Video Libraries

Yannis Tevissen, Khalil Guetari, Frédéric Petitpont

Comments: Accepted in IEEE HSI 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1321] arXiv:2406.14952 [pdf, html, other]

Title: ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models

Haiquan Zhao, Lingyu Li, Shisong Chen, Shuqi Kong, Jiaan Wang, Kexin Huang, Tianle Gu, Yixu Wang, Wang Jian, Dandan Liang, Zhixu Li, Yan Teng, Yanghua Xiao, Yingchun Wang

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1322] arXiv:2406.14955 [pdf, html, other]

Title: ICLEval: Evaluating In-Context Learning Ability of Large Language Models

Wentong Chen, Yankai Lin, ZhenHao Zhou, HongYun Huang, Yantao Jia, Zhao Cao, Ji-Rong Wen

Subjects: Computation and Language (cs.CL)

[1323] arXiv:2406.14971 [pdf, html, other]

Title: Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation

Shamane Siriwardhana, Mark McQuade, Thomas Gauthier, Lucas Atkins, Fernando Fernandes Neto, Luke Meyers, Anneketh Vij, Tyler Odenthal, Charles Goddard, Mary MacCarthy, Jacob Solawetz

Comments: 8 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[1324] arXiv:2406.14972 [pdf, html, other]

Title: A Tale of Trust and Accuracy: Base vs. Instruct LLMs in RAG Systems

Florin Cuconasu, Giovanni Trappolini, Nicola Tonellotto, Fabrizio Silvestri

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1325] arXiv:2406.14979 [pdf, other]

Title: Retrieve-Plan-Generation: An Iterative Planning and Answering Framework for Knowledge-Intensive LLM Generation

Yuanjie Lyu, Zihan Niu, Zheyong Xie, Chao Zhang, Tong Xu, Yang Wang, Enhong Chen

Subjects: Computation and Language (cs.CL)

[1326] arXiv:2406.14991 [pdf, html, other]

Title: SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation

Zeyao Ma, Bohan Zhang, Jing Zhang, Jifan Yu, Xiaokang Zhang, Xiaohan Zhang, Sijia Luo, Xi Wang, Jie Tang

Comments: Neurips 2024 (Spotlight); Homepage: this https URL

Subjects: Computation and Language (cs.CL); Software Engineering (cs.SE)

[1327] arXiv:2406.15000 [pdf, html, other]

Title: Unveiling the Impact of Multi-Modal Interactions on User Engagement: A Comprehensive Evaluation in AI-driven Conversations

Lichao Zhang, Jia Yu, Shuai Zhang, Long Li, Yangyang Zhong, Guanbao Liang, Yuming Yan, Qing Ma, Fangsheng Weng, Fayu Pan, Jing Li, Renjun Xu, Zhenzhong Lan

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1328] arXiv:2406.15019 [pdf, html, other]

Title: MedOdyssey: A Medical Domain Benchmark for Long Context Evaluation Up to 200K Tokens

Yongqi Fan, Hongli Sun, Kui Xue, Xiaofan Zhang, Shaoting Zhang, Tong Ruan

Subjects: Computation and Language (cs.CL)

[1329] arXiv:2406.15032 [pdf, html, other]

Title: GiusBERTo: A Legal Language Model for Personal Data De-identification in Italian Court of Auditors Decisions

Giulio Salierno, Rosamaria Bertè, Luca Attias, Carla Morrone, Dario Pettazzoni, Daniela Battisti

Comments: 14 pages, 4 figures, 6 Tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[1330] arXiv:2406.15045 [pdf, html, other]

Title: Integrating Knowledge Retrieval and Large Language Models for Clinical Report Correction

Jinge Wu, Zhaolong Wu, Ruizhe Li, Abul Hasan, Yunsoo Kim, Jason P.Y. Cheung, Teng Zhang, Honghan Wu

Comments: v2

Subjects: Computation and Language (cs.CL)

[1331] arXiv:2406.15053 [pdf, html, other]

Title: PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data

Ishaan Watts, Varun Gumma, Aditya Yadavalli, Vivek Seshadri, Manohar Swaminathan, Sunayana Sitaram

Comments: Accepted to EMNLP 2024

Subjects: Computation and Language (cs.CL)

[1332] arXiv:2406.15066 [pdf, html, other]

Title: Cross-lingual paraphrase identification

Inessa Fedorova, Aleksei Musatow

Subjects: Computation and Language (cs.CL)

[1333] arXiv:2406.15085 [pdf, html, other]

Title: A Unified Framework for Input Feature Attribution Analysis

Jingyi Sun, Pepa Atanasova, Isabelle Augenstein

Subjects: Computation and Language (cs.CL)

[1334] arXiv:2406.15109 [pdf, html, other]

Title: Brain-Like Language Processing via a Shallow Untrained Multihead Attention Network

Badr AlKhamissi, Greta Tuckute, Antoine Bosselut, Martin Schrimpf

Comments: Preprint

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[1335] arXiv:2406.15126 [pdf, html, other]

Title: On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey

Lin Long, Rui Wang, Ruixuan Xiao, Junbo Zhao, Xiao Ding, Gang Chen, Haobo Wang

Comments: A survey on LLMs-driven synthetic data generation, curation and evaluation

Subjects: Computation and Language (cs.CL)