Computation and Language

Authors and titles for June 2024

[976] arXiv:2406.11681 [pdf, other]

Title: R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models

Shangqing Tu, Yuanchun Wang, Jifan Yu, Yuyang Xie, Yaran Shi, Xiaozhi Wang, Jing Zhang, Lei Hou, Juanzi Li

Comments: 12 pages, 9 figures, Accepted by KDD2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[977] arXiv:2406.11682 [pdf, html, other]

Title: Knowledge-to-Jailbreak: One Knowledge Point Worth One Attack

Shangqing Tu, Zhuoran Pan, Wenxuan Wang, Zhexin Zhang, Yuliang Sun, Jifan Yu, Hongning Wang, Lei Hou, Juanzi Li

Comments: 18 pages, 14 figures, 11 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[978] arXiv:2406.11683 [pdf, html, other]

Title: HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing

Jing Chen, Xinyu Zhu, Cheng Yang, Chufan Shi, Yadong Xi, Yuxiang Zhang, Junjie Wang, Jiashu Pu, Rongsheng Zhang, Yujiu Yang, Tian Feng

Subjects: Computation and Language (cs.CL)

[979] arXiv:2406.11687 [pdf, html, other]

Title: Tokenization Falling Short: On Subword Robustness in Large Language Models

Yekun Chai, Yewei Fang, Qiwei Peng, Xuhong Li

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[980] arXiv:2406.11695 [pdf, html, other]

Title: Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs

Krista Opsahl-Ong, Michael J Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, Omar Khattab

Comments: EMNLP 2024. Krista and Michael contributed equally to this work

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[981] arXiv:2406.11698 [pdf, html, other]

Title: Meta Reasoning for Large Language Models

Peizhong Gao, Ao Xie, Shaoguang Mao, Wenshan Wu, Yan Xia, Haipeng Mi, Furu Wei

Subjects: Computation and Language (cs.CL)

[982] arXiv:2406.11704 [pdf, html, other]

Title: Nemotron-4 340B Technical Report

Nvidia: Bo Adler, Niket Agarwal, Ashwath Aithal, Dong H. Anh, Pallab Bhattacharya, Annika Brundyn, Jared Casper, Bryan Catanzaro, Sharon Clay, Jonathan Cohen, Sirshak Das, Ayush Dattagupta, Olivier Delalleau, Leon Derczynski, Yi Dong, Daniel Egert, Ellie Evans, Aleksander Ficek, Denys Fridman, Shaona Ghosh, Boris Ginsburg, Igor Gitman, Tomasz Grzegorzek, Robert Hero, Jining Huang, Vibhu Jawa, Joseph Jennings, Aastha Jhunjhunwala, John Kamalu, Sadaf Khan, Oleksii Kuchaiev, Patrick LeGresley, Hui Li, Jiwei Liu, Zihan Liu, Eileen Long, Ameya Sunil Mahabaleshwarkar, Somshubra Majumdar, James Maki, Miguel Martinez, Maer Rodrigues de Melo, Ivan Moshkov, Deepak Narayanan, Sean Narenthiran, Jesus Navarro, Phong Nguyen, Osvald Nitski, Vahid Noroozi, Guruprasad Nutheti, Christopher Parisien, Jupinder Parmar, Mostofa Patwary, Krzysztof Pawelec, Wei Ping, Shrimai Prabhumoye, Rajarshi Roy, Trisha Saar, Vasanth Rao Naik Sabavat, Sanjeev Satheesh, Jane Polak Scowcroft, Jason Sewall, Pavel Shamis, Gerald Shen, Mohammad Shoeybi, Dave Sizer, Misha Smelyanskiy, Felipe Soares, Makesh Narsimhan Sreedhar, Dan Su, Sandeep Subramanian, Shengyang Sun, Shubham Toshniwal, Hao Wang, Zhilin Wang, Jiaxuan You, Jiaqi Zeng, Jimmy Zhang, Jing Zhang, Vivienne Zhang, Yian Zhang, Chen Zhu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[983] arXiv:2406.11709 [pdf, html, other]

Title: Instruct, Not Assist: LLM-based Multi-Turn Planning and Hierarchical Questioning for Socratic Code Debugging

Priyanka Kargupta, Ishika Agarwal, Dilek Hakkani-Tur, Jiawei Han

Comments: Code available at: this https URL Accepted at EMNLP'24 Findings

Subjects: Computation and Language (cs.CL); Multiagent Systems (cs.MA)

[984] arXiv:2406.11721 [pdf, html, other]

Title: Zero-Shot Generalization during Instruction Tuning: Insights from Similarity and Granularity

Bingxiang He, Ning Ding, Cheng Qian, Jia Deng, Ganqu Cui, Lifan Yuan, Huan-ang Gao, Huimin Chen, Zhiyuan Liu, Maosong Sun

Comments: 33 pages, 14 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[985] arXiv:2406.11736 [pdf, html, other]

Title: Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models

Fangzhi Xu, Qiushi Sun, Kanzhi Cheng, Jun Liu, Yu Qiao, Zhiyong Wu

Comments: 18 pages, 6 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[986] arXiv:2406.11753 [pdf, other]

Title: A Semantic-based Layer Freezing Approach to Efficient Fine-Tuning of Language Models

Jian Gu, Aldeida Aleti, Chunyang Chen, Hongyu Zhang

Comments: 13 pages, 5 figures, under peer-review

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[987] arXiv:2406.11776 [pdf, html, other]

Title: Improving Multi-Agent Debate with Sparse Communication Topology

Yunxuan Li, Yibing Du, Jiageng Zhang, Le Hou, Peter Grabowski, Yeqing Li, Eugene Ie

Comments: 13 pages, 9 figures

Subjects: Computation and Language (cs.CL)

[988] arXiv:2406.11784 [pdf, html, other]

Title: MDCR: A Dataset for Multi-Document Conditional Reasoning

Peter Baile Chen, Yi Zhang, Chunwei Liu, Sejal Gupta, Yoon Kim, Michael Cafarella

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[989] arXiv:2406.11785 [pdf, html, other]

Title: CELL your Model: Contrastive Explanations for Large Language Models

Ronny Luss, Erik Miehling, Amit Dhurandhar

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[990] arXiv:2406.11801 [pdf, html, other]

Title: Safety Arithmetic: A Framework for Test-time Safety Alignment of Language Models by Steering Parameters and Activations

Rima Hazra, Sayan Layek, Somnath Banerjee, Soujanya Poria

Comments: EMNLP 2024 Main. Codes are available at: this https URL

Subjects: Computation and Language (cs.CL)

[991] arXiv:2406.11811 [pdf, html, other]

Title: RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content

Joao Monteiro, Pierre-Andre Noel, Etienne Marcotte, Sai Rajeswar, Valentina Zantedeschi, David Vazquez, Nicolas Chapados, Christopher Pal, Perouz Taslakian

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[992] arXiv:2406.11813 [pdf, html, other]

Title: How Do Large Language Models Acquire Factual Knowledge During Pretraining?

Hoyeon Chang, Jinho Park, Seonghyeon Ye, Sohee Yang, Youngkyung Seo, Du-Seong Chang, Minjoon Seo

Comments: Accepted at NeurIPS 2024

Subjects: Computation and Language (cs.CL)

[993] arXiv:2406.11817 [pdf, html, other]

Title: Iterative Length-Regularized Direct Preference Optimization: A Case Study on Improving 7B Language Models to GPT-4 Level

Jie Liu, Zhanhui Zhou, Jiaheng Liu, Xingyuan Bu, Chao Yang, Han-Sen Zhong, Wanli Ouyang

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[994] arXiv:2406.11827 [pdf, html, other]

Title: WPO: Enhancing RLHF with Weighted Preference Optimization

Wenxuan Zhou, Ravi Agrawal, Shujian Zhang, Sathish Reddy Indurthi, Sanqiang Zhao, Kaiqiang Song, Silei Xu, Chenguang Zhu

Comments: EMNLP 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[995] arXiv:2406.11830 [pdf, html, other]

Title: Language Modeling with Editable External Knowledge

Belinda Z. Li, Emmy Liu, Alexis Ross, Abbas Zeitoun, Graham Neubig, Jacob Andreas

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[996] arXiv:2406.11977 [pdf, html, other]

Title: Reframing linguistic bootstrapping as joint inference using visually-grounded grammar induction models

Eva Portelance, Siva Reddy, Timothy J. O'Donnell

Subjects: Computation and Language (cs.CL)

[997] arXiv:2406.11978 [pdf, html, other]

Title: Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner

Kenneth Li, Yiming Wang, Fernanda Viégas, Martin Wattenberg

Comments: Code: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[998] arXiv:2406.12009 [pdf, html, other]

Title: FinTruthQA: A Benchmark Dataset for Evaluating the Quality of Financial Information Disclosure

Ziyue Xu, Peilin Zhou, Xinyu Shi, Jiageng Wu, Yikang Jiang, Dading Chong, Bin Ke, Jie Yang

Subjects: Computation and Language (cs.CL)

[999] arXiv:2406.12018 [pdf, html, other]

Title: CItruS: Chunked Instruction-aware State Eviction for Long Sequence Modeling

Yu Bai, Xiyuan Zou, Heyan Huang, Sanxing Chen, Marc-Antoine Rondeau, Yang Gao, Jackie Chi Kit Cheung

Comments: EMNLP 2024 Main Conference

Subjects: Computation and Language (cs.CL)

[1000] arXiv:2406.12023 [pdf, html, other]

Title: LiLiuM: eBay's Large Language Models for e-commerce

Christian Herold, Michael Kozielski, Leonid Ekimov, Pavel Petrushkov, Pierre-Yves Vandenbussche, Shahram Khadivi

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)