Computation and Language

Authors and titles for January 2024

[76] arXiv:2401.01854 [pdf, html, other]

Title: Multilingual Instruction Tuning With Just a Pinch of Multilinguality

Uri Shaham, Jonathan Herzig, Roee Aharoni, Idan Szpektor, Reut Tsarfaty, Matan Eyal

Comments: Findings of ACL 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[77] arXiv:2401.01943 [pdf, html, other]

Title: Generalist embedding models are better at short-context clinical semantic search than specialized embedding models

Jean-Baptiste Excoffier, Tom Roehr, Alexei Figueroa, Jens-Michalis Papaioannou, Keno Bressem, Matthieu Ortala

Comments: 11 pages, 1 figure, 5 tables

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[78] arXiv:2401.01967 [pdf, html, other]

Title: A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity

Andrew Lee, Xiaoyan Bai, Itamar Pres, Martin Wattenberg, Jonathan K. Kummerfeld, Rada Mihalcea

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[79] arXiv:2401.01989 [pdf, html, other]

Title: Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias

Anshuman Chhabra, Hadi Askari, Prasant Mohapatra

Comments: Accepted to NAACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[80] arXiv:2401.02009 [pdf, html, other]

Title: Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives

Wenqi Zhang, Yongliang Shen, Linjuan Wu, Qiuying Peng, Jun Wang, Yueting Zhuang, Weiming Lu

Comments: Accepted by ACL 2024 Main

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[81] arXiv:2401.02034 [pdf, html, other]

Title: Text2MDT: Extracting Medical Decision Trees from Medical Texts

Wei Zhu, Wenfeng Li, Xing Tian, Pengfei Wang, Xiaoling Wang, Jin Chen, Yuanbin Wu, Yuan Ni, Guotong Xie

Subjects: Computation and Language (cs.CL)

[82] arXiv:2401.02038 [pdf, html, other]

Title: Understanding LLMs: A Comprehensive Overview from Training to Inference

Yiheng Liu, Hao He, Tianle Han, Xu Zhang, Mengyuan Liu, Jiaming Tian, Yutong Zhang, Jiaqi Wang, Xiaohui Gao, Tianyang Zhong, Yi Pan, Shaochen Xu, Zihao Wu, Zhengliang Liu, Xin Zhang, Shu Zhang, Xintao Hu, Tuo Zhang, Ning Qiang, Tianming Liu, Bao Ge

Comments: 30 pages,6 figures

Subjects: Computation and Language (cs.CL)

[83] arXiv:2401.02072 [pdf, html, other]

Title: ICE-GRT: Instruction Context Enhancement by Generative Reinforcement based Transformers

Chen Zheng, Ke Sun, Da Tang, Yukun Ma, Yuyu Zhang, Chenguang Xi, Xun Zhou

Subjects: Computation and Language (cs.CL)

[84] arXiv:2401.02115 [pdf, html, other]

Title: Using LLM to select the right SQL Query from candidates

Zhenwen Li, Tao Xie

Comments: 8 pages

Subjects: Computation and Language (cs.CL)

[85] arXiv:2401.02122 [pdf, other]

Title: PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques

Tzu-Han Lin, How-Shing Wang, Hao-Yung Weng, Kuang-Chen Peng, Zih-Ching Chen, Hung-yi Lee

Comments: Accepted to ICASSP 2024 Self-supervision in Audio, Speech and Beyond (SASB) workshop

Subjects: Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[86] arXiv:2401.02132 [pdf, html, other]

Title: DCR-Consistency: Divide-Conquer-Reasoning for Consistency Evaluation and Improvement of Large Language Models

Wendi Cui, Jiaxin Zhang, Zhuohang Li, Lopez Damien, Kamalika Das, Bradley Malin, Sricharan Kumar

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[87] arXiv:2401.02147 [pdf, html, other]

Title: Exploring Boundary of GPT-4V on Marine Analysis: A Preliminary Case Study

Ziqiang Zheng, Yiwei Chen, Jipeng Zhang, Tuan-Anh Vu, Huimin Zeng, Yue Him Wong Tim, Sai-Kit Yeung

Comments: 51 pages, 36 figures, Repository: this https URL

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[88] arXiv:2401.02158 [pdf, html, other]

Title: Shayona@SMM4H23: COVID-19 Self diagnosis classification using BERT and LightGBM models

Rushi Chavda, Darshan Makwana, Vraj Patel, Anupam Shukla

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[89] arXiv:2401.02187 [pdf, html, other]

Title: Location Aware Modular Biencoder for Tourism Question Answering

Haonan Li, Martin Tomko, Timothy Baldwin

Comments: Accepted at AACL 2023

Subjects: Computation and Language (cs.CL)

[90] arXiv:2401.02208 [pdf, html, other]

Title: DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models

Songbo Hu, Xiaobin Wang, Zhangdie Yuan, Anna Korhonen, Ivan Vulić

Comments: 17 pages, 7 tables, 9 figures

Subjects: Computation and Language (cs.CL)

[91] arXiv:2401.02212 [pdf, html, other]

Title: Joint Multi-Facts Reasoning Network For Complex Temporal Question Answering Over Knowledge Graph

Rikui Huang, Wei Wei, Xiaoye Qu, Wenfeng Xie, Xianling Mao, Dangyang Chen

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[92] arXiv:2401.02254 [pdf, html, other]

Title: L3Cube-IndicNews: News-based Short Text and Long Document Classification Datasets in Indic Languages

Aishwarya Mirashi, Srushti Sonavane, Purva Lingayat, Tejas Padhiyar, Raviraj Joshi

Comments: Accepted at the International Conference on Natural Language Processing (ICON 2023)

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[93] arXiv:2401.02256 [pdf, html, other]

Title: Rethinking Response Evaluation from Interlocutor's Eye for Open-Domain Dialogue Systems

Yuma Tsuta, Naoki Yoshinaga, Shoetsu Sato, Masashi Toyoda

Comments: 9 pages, 3 figures, 5 tables, Accepted by IJCNLP-AACL 2023 SRW

Subjects: Computation and Language (cs.CL)

[94] arXiv:2401.02297 [pdf, html, other]

Title: Are LLMs Robust for Spoken Dialogues?

Seyed Mahed Mousavi, Gabriel Roccabruna, Simone Alghisi, Massimo Rizzoli, Mirco Ravanelli, Giuseppe Riccardi

Subjects: Computation and Language (cs.CL)

[95] arXiv:2401.02369 [pdf, other]

Title: SPEER: Sentence-Level Planning of Long Clinical Summaries via Embedded Entity Retrieval

Griffin Adams, Jason Zucker, Noémie Elhadad

Comments: COLM 2024

Subjects: Computation and Language (cs.CL)

[96] arXiv:2401.02385 [pdf, html, other]

Title: TinyLlama: An Open-Source Small Language Model

Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, Wei Lu

Comments: Technical Report

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[97] arXiv:2401.02415 [pdf, html, other]

Title: LLaMA Pro: Progressive LLaMA with Block Expansion

Chengyue Wu, Yukang Gan, Yixiao Ge, Zeyu Lu, Jiahao Wang, Ye Feng, Ying Shan, Ping Luo

Comments: Accepted by ACL 2024, Main Conference

Subjects: Computation and Language (cs.CL)

[98] arXiv:2401.02594 [pdf, html, other]

Title: Unsupervised hard Negative Augmentation for contrastive learning

Yuxuan Shu, Vasileios Lampos

Comments: The code and pre-trained models are available at this https URL

Subjects: Computation and Language (cs.CL)

[99] arXiv:2401.02709 [pdf, html, other]

Title: German Text Embedding Clustering Benchmark

Silvan Wehrli, Bert Arnrich, Christopher Irrgang

Comments: 15 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[100] arXiv:2401.02777 [pdf, other]

Title: From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Models

Na Liu, Liangyu Chen, Xiaoyu Tian, Wei Zou, Kaijiang Chen, Ming Cui

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)