Computation and Language

Authors and titles for April 2024

[1601] arXiv:2404.17525 (cross-list from cs.LG) [pdf, other]

Title: Large Language Model Agent as a Mechanical Designer

Yayati Jadhav, Amir Barati Farimani

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1602] arXiv:2404.17546 (cross-list from cs.LG) [pdf, html, other]

Title: Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo

Stephen Zhao, Rob Brekelmans, Alireza Makhzani, Roger Grosse

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1603] arXiv:2404.17552 (cross-list from eess.AS) [pdf, html, other]

Title: A Semi-Automatic Approach to Create Large Gender- and Age-Balanced Speaker Corpora: Usefulness of Speaker Diarization & Identification

Rémi Uro, David Doukhan, Albert Rilliard, Laëtitia Larcher, Anissa-Claire Adgharouamane, Marie Tahon, Antoine Laurent

Comments: Keywords:, semi-automatic processing, corpus creation, diarization, speaker identification, gender-balanced, age-balanced, speaker corpus, diachrony

Journal-ref: Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 3271-3280, Marseille, 20-25 June 2022. European Language Resources Association (ELRA)

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Digital Libraries (cs.DL); Machine Learning (cs.LG); Sound (cs.SD)

[1604] arXiv:2404.17606 (cross-list from cs.IR) [pdf, html, other]

Title: SetCSE: Set Operations using Contrastive Learning of Sentence Embeddings

Kang Liu

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1605] arXiv:2404.17607 (cross-list from cs.IR) [pdf, html, other]

Title: Utilizing Large Language Models to Identify Reddit Users Considering Vaping Cessation for Digital Interventions

Sai Krishna Revanth Vuruma, Dezhi Wu, Saborny Sen Gupta, Lucas Aust, Valerie Lookingbill, Caleb Henry, Yang Ren, Erin Kasson, Li-Shiun Chen, Patricia Cavazos-Rehg, Dian Hu, Ming Huang

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)

[1606] arXiv:2404.17609 (cross-list from cs.LG) [pdf, html, other]

Title: CoSD: Collaborative Stance Detection with Contrastive Heterogeneous Topic Graph Learning

Yinghan Cheng, Qi Zhang, Chongyang Shi, Liang Xiao, Shufeng Hao, Liang Hu

Comments: 13 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1607] arXiv:2404.17723 (cross-list from cs.IR) [pdf, html, other]

Title: Retrieval-Augmented Generation with Knowledge Graphs for Customer Service Question Answering

Zhentao Xu, Mark Jerome Cruz, Matthew Guevara, Tie Wang, Manasi Deshpande, Xiaofeng Wang, Zheng Li

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1608] arXiv:2404.17730 (cross-list from cs.HC) [pdf, other]

Title: Bridging the Social & Technical Divide in Augmentative and Alternative Communication (AAC) Applications for Autistic Adults

Lara J. Martin, Malathy Nagalakshmi

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1609] arXiv:2404.17749 (cross-list from cs.AI) [pdf, html, other]

Title: UMass-BioNLP at MEDIQA-M3G 2024: DermPrompt -- A Systematic Exploration of Prompt Engineering with GPT-4V for Dermatological Diagnosis

Parth Vashisht, Abhilasha Lodha, Mukta Maddipatla, Zonghai Yao, Avijit Mitra, Zhichao Yang, Junda Wang, Sunjae Kwon, Hong Yu

Comments: Accepted at NAACL-ClinicalNLP workshop 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1610] arXiv:2404.17806 (cross-list from cs.SD) [pdf, html, other]

Title: T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretraining

Yi Yuan, Zhuo Chen, Xubo Liu, Haohe Liu, Xuenan Xu, Dongya Jia, Yuanzhe Chen, Mark D. Plumbley, Wenwu Wang

Comments: Preprint submitted to IEEE MLSP 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1611] arXiv:2404.17929 (cross-list from cs.CV) [pdf, html, other]

Title: Spatio-Temporal Side Tuning Pre-trained Foundation Models for Video-based Pedestrian Attribute Recognition

Xiao Wang, Qian Zhu, Jiandong Jin, Jun Zhu, Futian Wang, Bo Jiang, Yaowei Wang, Yonghong Tian

Comments: Parameter Efficient Fine-Tuning Strategy for Video-based Pedestrian Attribute Recognition

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1612] arXiv:2404.17983 (cross-list from cs.SD) [pdf, html, other]

Title: TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality

Tiantian Feng, Xuan Shi, Rahul Gupta, Shrikanth S. Narayanan

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1613] arXiv:2404.18021 (cross-list from cs.AI) [pdf, html, other]

Title: CRISPR-GPT: An LLM Agent for Automated Design of Gene-Editing Experiments

Kaixuan Huang, Yuanhao Qu, Henry Cousins, William A. Johnson, Di Yin, Mihir Shah, Denny Zhou, Russ Altman, Mengdi Wang, Le Cong

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Quantitative Methods (q-bio.QM)

[1614] arXiv:2404.18081 (cross-list from cs.SD) [pdf, other]

Title: ComposerX: Multi-Agent Symbolic Music Composition with LLMs

Qixin Deng, Qikai Yang, Ruibin Yuan, Yipeng Huang, Yi Wang, Xubo Liu, Zeyue Tian, Jiahao Pan, Ge Zhang, Hanfeng Lin, Yizhi Li, Yinghao Ma, Jie Fu, Chenghua Lin, Emmanouil Benetos, Wenwu Wang, Guangyu Xia, Wei Xue, Yike Guo

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[1615] arXiv:2404.18094 (cross-list from cs.SD) [pdf, html, other]

Title: USAT: A Universal Speaker-Adaptive Text-to-Speech Approach

Wenbin Wang, Yang Song, Sanjay Jha

Comments: 15 pages, 13 figures. Copyright has been transferred to IEEE

Journal-ref: IEEE/ACM Transactions on Audio, Speech and Language Processing, 2024

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1616] arXiv:2404.18130 (cross-list from cs.AI) [pdf, html, other]

Title: Logic Agent: Enhancing Validity with Logic Rule Invocation

Hanmeng Liu, Zhiyang Teng, Chaoli Zhang, Yue Zhang

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1617] arXiv:2404.18185 (cross-list from cs.IR) [pdf, html, other]

Title: Ranked List Truncation for Large Language Model-based Re-Ranking

Chuan Meng, Negar Arabzadeh, Arian Askari, Mohammad Aliannejadi, Maarten de Rijke

Comments: Accepted for publication as a long paper at SIGIR 2024

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1618] arXiv:2404.18239 (cross-list from cs.LG) [pdf, html, other]

Title: SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning

Jinghan Jia, Yihua Zhang, Yimeng Zhang, Jiancheng Liu, Bharat Runwal, James Diffenderfer, Bhavya Kailkhura, Sijia Liu

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1619] arXiv:2404.18311 (cross-list from cs.LG) [pdf, other]

Title: Towards Incremental Learning in Large Language Models: A Critical Review

Mladjan Jovanovic, Peter Voss

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1620] arXiv:2404.18400 (cross-list from cs.LG) [pdf, html, other]

Title: LLM-SR: Scientific Equation Discovery via Programming with Large Language Models

Parshin Shojaee, Kazem Meidani, Shashank Gupta, Amir Barati Farimani, Chandan K Reddy

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

[1621] arXiv:2404.18416 (cross-list from cs.AI) [pdf, html, other]

Title: Capabilities of Gemini Models in Medicine

Khaled Saab, Tao Tu, Wei-Hung Weng, Ryutaro Tanno, David Stutz, Ellery Wulczyn, Fan Zhang, Tim Strother, Chunjong Park, Elahe Vedadi, Juanma Zambrano Chaves, Szu-Yeu Hu, Mike Schaekermann, Aishwarya Kamath, Yong Cheng, David G.T. Barrett, Cathy Cheung, Basil Mustafa, Anil Palepu, Daniel McDuff, Le Hou, Tomer Golany, Luyang Liu, Jean-baptiste Alayrac, Neil Houlsby, Nenad Tomasev, Jan Freyberg, Charles Lau, Jonas Kemp, Jeremy Lai, Shekoofeh Azizi, Kimberly Kanada, SiWai Man, Kavita Kulkarni, Ruoxi Sun, Siamak Shakeri, Luheng He, Ben Caine, Albert Webson, Natasha Latysheva, Melvin Johnson, Philip Mansfield, Jian Lu, Ehud Rivlin, Jesper Anderson, Bradley Green, Renee Wong, Jonathan Krause, Jonathon Shlens, Ewa Dominowska, S. M. Ali Eslami, Katherine Chou, Claire Cui, Oriol Vinyals, Koray Kavukcuoglu, James Manyika, Jeff Dean, Demis Hassabis, Yossi Matias, Dale Webster, Joelle Barral, Greg Corrado, Christopher Semturs, S. Sara Mahdavi, Juraj Gottweis, Alan Karthikesalingam, Vivek Natarajan

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1622] arXiv:2404.18470 (cross-list from cs.CE) [pdf, html, other]

Title: ECC Analyzer: Extract Trading Signal from Earnings Conference Calls using Large Language Model for Stock Performance Prediction

Yupeng Cao, Zhi Chen, Qingyun Pei, Nathan Jinseok Lee, K.P. Subbalakshmi, Papa Momar Ndiaye

Comments: 9 pages, 1 figures, 2 tables

Subjects: Computational Engineering, Finance, and Science (cs.CE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Risk Management (q-fin.RM); Trading and Market Microstructure (q-fin.TR)

[1623] arXiv:2404.18518 (cross-list from cs.DL) [pdf, other]

Title: From ChatGPT, DALL-E 3 to Sora: How has Generative AI Changed Digital Humanities Research and Services?

Jiangfeng Liu, Ziyi Wang, Jing Xie, Lei Pei

Comments: 21 pages, 3 figures

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

[1624] arXiv:2404.18638 (cross-list from cs.AI) [pdf, html, other]

Title: Reinforcement Learning Problem Solving with Large Language Models

Sina Gholamian, Domingo Huh

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1625] arXiv:2404.18722 (cross-list from cs.CV) [pdf, html, other]

Title: Improving Automatic Text Recognition with Language Models in the PyLaia Open-Source Library

Solène Tarride, Yoann Schneider, Marie Generali-Lince, Mélodie Boillet, Bastien Abadie, Christopher Kermorvant

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1626] arXiv:2404.18848 (cross-list from cs.LG) [pdf, html, other]

Title: FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition

Yuxuan Yan, Qianqian Yang, Shunpu Tang, Zhiguo Shi

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1627] arXiv:2404.18922 (cross-list from cs.LG) [pdf, html, other]

Title: DPO Meets PPO: Reinforced Token Optimization for RLHF

Han Zhong, Guhao Feng, Wei Xiong, Xinle Cheng, Li Zhao, Di He, Jiang Bian, Liwei Wang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (stat.ML)

[1628] arXiv:2404.18928 (cross-list from cs.CV) [pdf, html, other]

Title: Stylus: Automatic Adapter Selection for Diffusion Models

Michael Luo, Justin Wong, Brandon Trabucco, Yanping Huang, Joseph E. Gonzalez, Zhifeng Chen, Ruslan Salakhutdinov, Ion Stoica

Comments: Project Website: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR); Machine Learning (cs.LG)

[1629] arXiv:2404.18963 (cross-list from cs.LG) [pdf, other]

Title: RE-GrievanceAssist: Enhancing Customer Experience through ML-Powered Complaint Management

Venkatesh C, Harshit Oberoi, Anurag Kumar Pandey, Anil Goyal, Nikhil Sikka

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1630] arXiv:2404.18976 (cross-list from cs.LG) [pdf, html, other]

Title: Foundations of Multisensory Artificial Intelligence

Paul Pu Liang

Comments: CMU Machine Learning Department PhD Thesis

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1631] arXiv:2404.19065 (cross-list from cs.AI) [pdf, other]

Title: HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models

Gabriel Sarch, Sahil Somani, Raghav Kapoor, Michael J. Tarr, Katerina Fragkiadaki

Comments: Videos and code this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1632] arXiv:2404.19071 (cross-list from cs.HC) [pdf, html, other]

Title: Blind Spots and Biases: Exploring the Role of Annotator Cognitive Biases in NLP

Sanjana Gautam, Mukund Srinath

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[1633] arXiv:2404.19128 (cross-list from cs.CV) [pdf, html, other]

Title: Q-GroundCAM: Quantifying Grounding in Vision Language Models via GradCAM

Navid Rajabi, Jana Kosecka

Comments: Accepted to CVPR 2024, Second Workshop on Foundation Models (WFM)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1634] arXiv:2404.19221 (cross-list from cs.CV) [pdf, html, other]

Title: Transcrib3D: 3D Referring Expression Resolution through Large Language Models

Jiading Fang, Xiangshan Tan, Shengjie Lin, Igor Vasiljevic, Vitor Guizilini, Hongyuan Mei, Rares Ambrus, Gregory Shakhnarovich, Matthew R Walter

Comments: CORLW 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1635] arXiv:2404.19234 (cross-list from cs.AI) [pdf, other]

Title: Multi-hop Question Answering over Knowledge Graphs using Large Language Models

Abir Chakraborty

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)

[1636] arXiv:2404.19317 (cross-list from cs.CV) [pdf, other]

Title: Revisiting N-Gram Models: Their Impact in Modern Neural Networks for Handwritten Text Recognition

Solène Tarride, Christopher Kermorvant

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1637] arXiv:2404.19318 (cross-list from cs.SE) [pdf, other]

Title: Enhancing Trust in LLM-Generated Code Summaries with Calibrated Confidence Scores

Yuvraj Virk, Premkumar Devanbu, Toufique Ahmed

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[1638] arXiv:2404.19360 (cross-list from cs.CV) [pdf, html, other]

Title: Large Language Model Informed Patent Image Retrieval

Hao-Cheng Lo, Jung-Mei Chu, Jieh Hsiang, Chun-Chieh Cho

Comments: 8 pages. Under review

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

[1639] arXiv:2404.19484 (cross-list from cs.LG) [pdf, html, other]

Title: More Compute Is What You Need

Zhen Guo

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1640] arXiv:2404.19696 (cross-list from cs.CV) [pdf, html, other]

Title: Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners

Chun Feng, Joy Hsu, Weiyu Liu, Jiajun Wu

Comments: CVPR 2024. The first two authors contributed equally

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1641] arXiv:2404.19708 (cross-list from cs.LG) [pdf, html, other]

Title: Harmonic LLMs are Trustworthy

Nicholas S. Kersting, Mohammad Rahman, Suchismitha Vedala, Yang Wang

Comments: 15 pages, 2 figures, 16 tables; added Claude-3.0, GPT-4o, Mistral-7B, Mixtral-8x7B, and more annotation for other models

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1642] arXiv:2404.19721 (cross-list from cs.AI) [pdf, other]

Title: PANGeA: Procedural Artificial Narrative using Generative AI for Turn-Based Video Games

Steph Buongiorno, Lawrence Jake Klinkert, Tanishq Chawla, Zixin Zhuang, Corey Clark

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1643] arXiv:2404.19753 (cross-list from cs.CV) [pdf, other]

Title: DOCCI: Descriptions of Connected and Contrasting Images

Yasumasa Onoe, Sunayana Rane, Zachary Berger, Yonatan Bitton, Jaemin Cho, Roopal Garg, Alexander Ku, Zarana Parekh, Jordi Pont-Tuset, Garrett Tanzer, Su Wang, Jason Baldridge

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)