Computation and Language

Authors and titles for June 2024

[101] arXiv:2406.01276 [pdf, html, other]

Title: EduNLP: Towards a Unified and Modularized Library for Educational Resources

Zhenya Huang, Yuting Ning, Longhu Qin, Shiwei Tong, Shangzi Xue, Tong Xiao, Xin Lin, Jiayu Liu, Qi Liu, Enhong Chen, Shijing Wang

Subjects: Computation and Language (cs.CL)

[102] arXiv:2406.01283 [pdf, html, other]

Title: Focus on the Core: Efficient Attention via Pruned Token Compression for Document Classification

Jungmin Yun, Mihyeon Kim, Youngbin Kim

Comments: Accepted to EMNLP 2023 Findings

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[103] arXiv:2406.01288 [pdf, html, other]

Title: Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses

Xiaosen Zheng, Tianyu Pang, Chao Du, Qian Liu, Jing Jiang, Min Lin

Comments: NeurIPS 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

[104] arXiv:2406.01297 [pdf, html, other]

Title: When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMs

Ryo Kamoi, Yusen Zhang, Nan Zhang, Jiawei Han, Rui Zhang

Comments: Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2024. Author's final version

Subjects: Computation and Language (cs.CL)

[105] arXiv:2406.01304 [pdf, html, other]

Title: CodeR: Issue Resolving with Multi-Agent and Task Graphs

Dong Chen, Shaoxin Lin, Muhan Zeng, Daoguang Zan, Jian-Gang Wang, Anton Cheshkov, Jun Sun, Hao Yu, Guoliang Dong, Artem Aliev, Jie Wang, Xiao Cheng, Guangtai Liang, Yuchi Ma, Pan Bian, Tao Xie, Qianxiang Wang

Comments: this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)

[106] arXiv:2406.01306 [pdf, html, other]

Title: Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding

Fanyi Qu, Hao Sun, Yunfang Wu

Comments: Accepted as a long paper in ACL 2024 findings

Subjects: Computation and Language (cs.CL)

[107] arXiv:2406.01311 [pdf, html, other]

Title: FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

Sushant Gautam

Comments: accepted and presented at the 6th IN5550 Workshop on Neural Natural Language Processing (WNNLP 2024) at the University of Oslo, Norway

Subjects: Computation and Language (cs.CL)

[108] arXiv:2406.01333 [pdf, html, other]

Title: Probing Language Models for Pre-training Data Detection

Zhenhua Liu, Tong Zhu, Chuanyuan Tan, Haonan Lu, Bing Liu, Wenliang Chen

Comments: Accepted by ACL-2024 main conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[109] arXiv:2406.01359 [pdf, html, other]

Title: R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Models

Ken Deng, Jiaheng Liu, He Zhu, Congnan Liu, Jingxin Li, Jiakai Wang, Peng Zhao, Chenchen Zhang, Yanan Wu, Xueqiao Yin, Yuanxing Zhang, Wenbo Su, Bangyu Xiang, Tiezheng Ge, Bo Zheng

Subjects: Computation and Language (cs.CL); Software Engineering (cs.SE)

[110] arXiv:2406.01363 [pdf, html, other]

Title: Privacy in LLM-based Recommendation: Recent Advances and Future Directions

Sichun Luo, Wei Shao, Yuxuan Yao, Jian Xu, Mingyang Liu, Qintong Li, Bowei He, Maolin Wang, Guanzhi Deng, Hanxu Hou, Xinyi Zhang, Linqi Song

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[111] arXiv:2406.01372 [pdf, html, other]

Title: Linguistic Analysis, Description, and Typological Exploration with Categorial Grammar (TheBench Guide)

Cem Bozsahin

Subjects: Computation and Language (cs.CL)

[112] arXiv:2406.01375 [pdf, html, other]

Title: D-CPT Law: Domain-specific Continual Pre-Training Scaling Law for Large Language Models

Haoran Que, Jiaheng Liu, Ge Zhang, Chenchen Zhang, Xingwei Qu, Yinghao Ma, Feiyu Duan, Zhiqi Bai, Jiakai Wang, Yuanxing Zhang, Xu Tan, Jie Fu, Wenbo Su, Jiamang Wang, Lin Qu, Bo Zheng

Subjects: Computation and Language (cs.CL)

[113] arXiv:2406.01382 [pdf, html, other]

Title: Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

Keyon Vafa, Ashesh Rambachan, Sendhil Mullainathan

Comments: To appear in ICML 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[114] arXiv:2406.01392 [pdf, html, other]

Title: Sparsity-Accelerated Training for Large Language Models

Da Ma, Lu Chen, Pengyu Wang, Hongshen Xu, Hanqi Li, Liangtai Sun, Su Zhu, Shuai Fan, Kai Yu

Comments: Accepted to ACL 2024 Findings

Subjects: Computation and Language (cs.CL)

[115] arXiv:2406.01428 [pdf, other]

Title: Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study

Martin J. Hetz, Nicolas Carl, Sarah Haggenmüller, Christoph Wies, Maurice Stephan Michel, Frederik Wessels, Titus J. Brinker

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[116] arXiv:2406.01436 [pdf, html, other]

Title: Editing the Mind of Giants: An In-Depth Exploration of Pitfalls of Knowledge Editing in Large Language Models

Cheng-Hsun Hsueh, Paul Kuo-Ming Huang, Tzu-Han Lin, Che-Wei Liao, Hung-Chieh Fang, Chao-Wei Huang, Yun-Nung Chen

Comments: EMNLP 2024 Findings

Subjects: Computation and Language (cs.CL)

[117] arXiv:2406.01441 [pdf, html, other]

Title: LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

Yongjing Yin, Jiali Zeng, Yafu Li, Fandong Meng, Yue Zhang

Journal-ref: EMNLP2024 Findings

Subjects: Computation and Language (cs.CL)

[118] arXiv:2406.01446 [pdf, other]

Title: Enabling ASR for Low-Resource Languages: A Comprehensive Dataset Creation Approach

Ara Yeroyan (Data Science Department, American University of Armenia), Nikolay Karpov (Nvidia, NeMo Conversational AI team)

Comments: 13 pages, 10 figures (including ablation studies), to be published in 2024 IEEE Spoken Language Technology Workshop. Additionally, the associated software package can be accessed at (this https URL) for practical applications and further development

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[119] arXiv:2406.01468 [pdf, html, other]

Title: Understanding Token Probability Encoding in Output Embeddings

Hakaze Cho, Yoshihiro Sakai, Kenshiro Tanaka, Mariko Kato, Naoya Inoue

Comments: 15 pages, 17 figures, 3 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[120] arXiv:2406.01495 [pdf, html, other]

Title: Re-ReST: Reflection-Reinforced Self-Training for Language Agents

Zi-Yi Dou, Cheng-Fu Yang, Xueqing Wu, Kai-Wei Chang, Nanyun Peng

Subjects: Computation and Language (cs.CL)

[121] arXiv:2406.01506 [pdf, html, other]

Title: The Geometry of Categorical and Hierarchical Concepts in Large Language Models

Kiho Park, Yo Joong Choe, Yibo Jiang, Victor Veitch

Comments: Best Paper Award at the ICML 2024 Workshop on Mechanistic Interpretability. Code is available at this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

[122] arXiv:2406.01512 [pdf, html, other]

Title: MAD: Multi-Alignment MEG-to-Text Decoding

Yiqian Yang, Hyejeong Jo, Yiqun Duan, Qiang Zhang, Jinni Zhou, Won Hee Lee, Renjing Xu, Hui Xiong

Subjects: Computation and Language (cs.CL)

[123] arXiv:2406.01514 [pdf, html, other]

Title: Decoupled Alignment for Robust Plug-and-Play Adaptation

Haozheng Luo, Jiahao Yu, Wenxin Zhang, Jialong Li, Jerry Yao-Chieh Hu, Xinyu Xing, Han Liu

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

[124] arXiv:2406.01538 [pdf, html, other]

Title: What Are Large Language Models Mapping to in the Brain? A Case Against Over-Reliance on Brain Scores

Ebrahim Feghhi, Nima Hadidi, Bryan Song, Idan A. Blank, Jonathan C. Kao

Comments: 10 pages, 4 figures in the main paper

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[125] arXiv:2406.01549 [pdf, html, other]

Title: An Information Bottleneck Perspective for Effective Noise Filtering on Retrieval-Augmented Generation

Kun Zhu, Xiaocheng Feng, Xiyuan Du, Yuxuan Gu, Weijiang Yu, Haotian Wang, Qianglong Chen, Zheng Chu, Jingchang Chen, Bing Qin

Comments: Accepted to ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)