Computation and Language

Authors and titles for May 2024

[1506] arXiv:2405.18639 (cross-list from q-bio.NC) [pdf, other]

Title: Improving Speech Decoding from ECoG with Self-Supervised Pretraining

Brian A. Yuan, Joseph G. Makin

Subjects: Neurons and Cognition (q-bio.NC); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[1507] arXiv:2405.18642 (cross-list from cs.AI) [pdf, html, other]

Title: JADS: A Framework for Self-supervised Joint Aspect Discovery and Summarization

Xiaobo Guo, Jay Desai, Srinivasan H. Sengamedu

Comments: preprint

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1508] arXiv:2405.18669 (cross-list from cs.LG) [pdf, html, other]

Title: Zipper: A Multi-Tower Decoder Architecture for Fusing Modalities

Vicky Zayats, Peter Chen, Melissa Ferrari, Dirk Padfield

Comments: Under review at NeurIPS

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1509] arXiv:2405.18672 (cross-list from cs.CV) [pdf, html, other]

Title: LLM-based Hierarchical Concept Decomposition for Interpretable Fine-Grained Image Classification

Renyi Qu, Mark Yatskar

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1510] arXiv:2405.18688 (cross-list from cs.LG) [pdf, html, other]

Title: Efficient Preference-based Reinforcement Learning via Aligned Experience Estimation

Fengshuo Bai, Rui Zhao, Hongming Zhang, Sijia Cui, Ying Wen, Yaodong Yang, Bo Xu, Lei Han

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1511] arXiv:2405.18711 (cross-list from cs.AI) [pdf, html, other]

Title: Calibrating Reasoning in Language Models with Internal Consistency

Zhihui Xie, Jizhou Guo, Tong Yu, Shuai Li

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1512] arXiv:2405.18721 (cross-list from cs.CV) [pdf, html, other]

Title: Correctable Landmark Discovery via Large Models for Vision-Language Navigation

Bingqian Lin, Yunshuang Nie, Ziming Wei, Yi Zhu, Hang Xu, Shikui Ma, Jianzhuang Liu, Xiaodan Liang

Comments: Accepted by TPAMI 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1513] arXiv:2405.18742 (cross-list from cs.AI) [pdf, html, other]

Title: Musical Phrase Segmentation via Grammatical Induction

Reed Perkins, Dan Ventura

Comments: Extended version of a paper appearing in the proceedings of IJCAI 2024 that includes additional material in an appendix. Please cite the IJCAI version

Journal-ref: Proceedings of the International Joint Conference on Artificial Intelligence, 2024

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1514] arXiv:2405.18776 (cross-list from cs.CR) [pdf, html, other]

Title: LMO-DP: Optimizing the Randomization Mechanism for Differentially Private Fine-Tuning (Large) Language Models

Qin Yang, Meisam Mohammad, Han Wang, Ali Payani, Ashish Kundu, Kai Shu, Yan Yan, Yuan Hong

Comments: 18 pages, 15 figures

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1515] arXiv:2405.18870 (cross-list from cs.AI) [pdf, html, other]

Title: LLMs achieve adult human performance on higher-order theory of mind tasks

Winnie Street, John Oliver Siy, Geoff Keeling, Adrien Baranes, Benjamin Barnett, Michael McKibben, Tatenda Kanyere, Alison Lentz, Blaise Aguera y Arcas, Robin I. M. Dunbar

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

[1516] arXiv:2405.18874 (cross-list from cond-mat.dis-nn) [pdf, html, other]

Title: Are queries and keys always relevant? A case study on Transformer wave functions

Riccardo Rende, Luciano Loris Viteritti

Comments: 9 pages, 4 figures

Subjects: Disordered Systems and Neural Networks (cond-mat.dis-nn); Computation and Language (cs.CL); Computational Physics (physics.comp-ph)

[1517] arXiv:2405.18937 (cross-list from cs.CV) [pdf, html, other]

Title: Kestrel: Point Grounding Multimodal LLM for Part-Aware 3D Vision-Language Understanding

Junjie Fei, Mahmoud Ahmed, Jian Ding, Eslam Mohamed Bakr, Mohamed Elhoseiny

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[1518] arXiv:2405.18991 (cross-list from cs.CV) [pdf, html, other]

Title: EasyAnimate: A High-Performance Long Video Generation Method based on Transformer Architecture

Jiaqi Xu, Xinyi Zou, Kunzhe Huang, Yunkuo Chen, Bo Liu, MengLi Cheng, Xing Shi, Jun Huang

Comments: 8 pages, 6 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[1519] arXiv:2405.19026 (cross-list from cs.LG) [pdf, html, other]

Title: DiveR-CT: Diversity-enhanced Red Teaming with Relaxing Constraints

Andrew Zhao, Quentin Xu, Matthieu Lin, Shenzhi Wang, Yong-jin Liu, Zilong Zheng, Gao Huang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[1520] arXiv:2405.19076 (cross-list from cs.CV) [pdf, other]

Title: Cephalo: Multi-Modal Vision-Language Models for Bio-Inspired Materials Analysis and Design

Markus J. Buehler

Subjects: Computer Vision and Pattern Recognition (cs.CV); Mesoscale and Nanoscale Physics (cond-mat.mes-hall); Materials Science (cond-mat.mtrl-sci); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1521] arXiv:2405.19186 (cross-list from cs.CV) [pdf, html, other]

Title: MetaToken: Detecting Hallucination in Image Descriptions by Meta Classification

Laura Fieback (1,2), Jakob Spiegelberg (1), Hanno Gottschalk (2) ((1) Volkswagen AG, (2) TU Berlin)

Comments: 18 pages, 8 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1522] arXiv:2405.19209 (cross-list from cs.CV) [pdf, other]

Title: VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos

Ziyang Wang, Shoubin Yu, Elias Stengel-Eskin, Jaehong Yoon, Feng Cheng, Gedas Bertasius, Mohit Bansal

Comments: 23 pages, first three authors contributed equally; Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[1523] arXiv:2405.19313 (cross-list from cs.AI) [pdf, html, other]

Title: Language Models Trained to do Arithmetic Predict Human Risky and Intertemporal Choice

Jian-Qiao Zhu, Haijiang Yan, Thomas L. Griffiths

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); General Economics (econ.GN)

[1524] arXiv:2405.19315 (cross-list from cs.CV) [pdf, html, other]

Title: Matryoshka Query Transformer for Large Vision-Language Models

Wenbo Hu, Zi-Yi Dou, Liunian Harold Li, Amita Kamath, Nanyun Peng, Kai-Wei Chang

Comments: Preprint. Our code and model are publicly available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1525] arXiv:2405.19316 (cross-list from cs.LG) [pdf, html, other]

Title: Robust Preference Optimization through Reward Model Distillation

Adam Fisch, Jacob Eisenstein, Vicky Zayats, Alekh Agarwal, Ahmad Beirami, Chirag Nagpal, Pete Shaw, Jonathan Berant

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[1526] arXiv:2405.19334 (cross-list from cs.AI) [pdf, html, other]

Title: LLMs Meet Multimodal Generation and Editing: A Survey

Yingqing He, Zhaoyang Liu, Jingye Chen, Zeyue Tian, Hongyu Liu, Xiaowei Chi, Runtao Liu, Ruibin Yuan, Yazhou Xing, Wenhai Wang, Jifeng Dai, Yong Zhang, Wei Xue, Qifeng Liu, Yike Guo, Qifeng Chen

Comments: 52 Pages with 16 Figures, 12 Tables, and 545 References. GitHub Repository at: this https URL

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)

[1527] arXiv:2405.19335 (cross-list from cs.CV) [pdf, html, other]

Title: X-VILA: Cross-Modality Alignment for Large Language Model

Hanrong Ye, De-An Huang, Yao Lu, Zhiding Yu, Wei Ping, Andrew Tao, Jan Kautz, Song Han, Dan Xu, Pavlo Molchanov, Hongxu Yin

Comments: Technical Report

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

[1528] arXiv:2405.19342 (cross-list from cs.SD) [pdf, html, other]

Title: Sonos Voice Control Bias Assessment Dataset: A Methodology for Demographic Bias Assessment in Voice Assistants

Chloé Sekkat, Fanny Leroy, Salima Mdhaffar, Blake Perry Smith, Yannick Estève, Joseph Dureau, Alice Coucke

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[1529] arXiv:2405.19343 (cross-list from cs.SD) [pdf, html, other]

Title: Luganda Speech Intent Recognition for IoT Applications

Andrew Katumba, Sudi Murindanyi, John Trevor Kasule, Elvis Mugume

Comments: Presented as a conference paper at ICLR 2024/AfricaNLP

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)

[1530] arXiv:2405.19534 (cross-list from cs.LG) [pdf, html, other]

Title: Preference Learning Algorithms Do Not Learn Preference Rankings

Angelica Chen, Sadhika Malladi, Lily H. Zhang, Xinyi Chen, Qiuyi Zhang, Rajesh Ranganath, Kyunghyun Cho

Comments: NeurIPS 2024 camera-ready

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)