Computer Vision and Pattern Recognition

Authors and titles for February 2024

[1601] arXiv:2402.09801 (cross-list from cs.CL) [pdf, html, other]

Title: EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

Shangyu Xing, Fei Zhao, Zhen Wu, Tuo An, Weihao Chen, Chunhui Li, Jianbing Zhang, Xinyu Dai

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1602] arXiv:2402.09841 (cross-list from cs.CL) [pdf, other]

Title: LAPDoc: Layout-Aware Prompting for Documents

Marcel Lamott, Yves-Noel Weweler, Adrian Ulges, Faisal Shafait, Dirk Krechel, Darko Obradovic

Comments: Under review at ICDAR2024

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1603] arXiv:2402.09867 (cross-list from eess.SP) [pdf, other]

Title: Characterizing Accuracy Trade-offs of EEG Applications on Embedded HMPs

Zain Taufique, Muhammad Awais Bin Altaf, Antonio Miele, Pasi Liljeberg, Anil Kanduri

Comments: 7 pages, 10 figures

Subjects: Signal Processing (eess.SP); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Performance (cs.PF)

[1604] arXiv:2402.09975 (cross-list from eess.IV) [pdf, other]

Title: Current and future roles of artificial intelligence in retinopathy of prematurity

Ali Jafarizadeh, Shadi Farabi Maleki, Parnia Pouya, Navid Sobhi, Mirsaeed Abdollahi, Siamak Pedrammehr, Chee Peng Lim, Houshyar Asadi, Roohallah Alizadehsani, Ru-San Tan, Sheikh Mohammad Shariful Islam, U. Rajendra Acharya

Comments: 28 pages, 8 figures, 2 tables, 235 references, 1 supplementary table

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1605] arXiv:2402.09990 (cross-list from eess.IV) [pdf, other]

Title: TIAViz: A Browser-based Visualization Tool for Computational Pathology Models

Mark Eastwood, John Pocock, Mostafa Jahanifar, Adam Shephard, Skiros Habib, Ethar Alzaid, Abdullah Alsalemi, Jan Lukas Robertus, Nasir Rajpoot, Shan Raza, Fayyaz Minhas

Comments: Application note to be submitted to bioinformatics

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1606] arXiv:2402.10010 (cross-list from physics.med-ph) [pdf, other]

Title: Enhancing signal detectability in learning-based CT reconstruction with a model observer inspired loss function

Megan Lantz, Emil Y. Sidky, Ingrid S. Reiser, Xiaochuan Pan, Gregory Ongie

Subjects: Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

[1607] arXiv:2402.10026 (cross-list from eess.IV) [pdf, html, other]

Title: Hybrid CNN Bi-LSTM neural network for Hyperspectral image classification

Alok Ranjan Sahoo, Pavan Chakraborty

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1608] arXiv:2402.10038 (cross-list from cs.CL) [pdf, html, other]

Title: RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Models

Saeed Khaki, JinJin Li, Lan Ma, Liu Yang, Prathap Ramachandra

Comments: 16 pages, 4 figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1609] arXiv:2402.10055 (cross-list from eess.IV) [pdf, html, other]

Title: Robust semi-automatic vessel tracing in the human retinal image by an instance segmentation neural network

Siyi Chen, Amir H. Kashani, Ji Yi

Subjects: Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1610] arXiv:2402.10086 (cross-list from cs.RO) [pdf, html, other]

Title: Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review

Anton Kuznietsov, Balint Gyevnar, Cheng Wang, Steven Peters, Stefano V. Albrecht

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

[1611] arXiv:2402.10130 (cross-list from cs.LG) [pdf, other]

Title: Is Continual Learning Ready for Real-world Challenges?

Theodora Kontogianni, Yuanwen Yue, Siyu Tang, Konrad Schindler

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1612] arXiv:2402.10204 (cross-list from astro-ph.IM) [pdf, html, other]

Title: Radio-astronomical Image Reconstruction with Conditional Denoising Diffusion Model

Mariia Drozdova, Vitaliy Kinakh, Omkar Bait, Olga Taran, Erica Lastufka, Miroslava Dessauges-Zavadsky, Taras Holotyak, Daniel Schaerer, Slava Voloshynovskiy

Comments: In production in Astronomy&Astrophyics

Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1613] arXiv:2402.10208 (cross-list from cs.LG) [pdf, html, other]

Title: Recovering the Pre-Fine-Tuning Weights of Generative Models

Eliahu Horwitz, Jonathan Kahana, Yedid Hoshen

Comments: ICML 2024. Project page: this https URL

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[1614] arXiv:2402.10210 (cross-list from cs.LG) [pdf, other]

Title: Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generation

Huizhuo Yuan, Zixiang Chen, Kaixuan Ji, Quanquan Gu

Comments: 28 pages, 8 figures, 10 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[1615] arXiv:2402.10223 (cross-list from cs.RO) [pdf, html, other]

Title: Integer Optimization of CT Trajectories using a Discrete Data Completeness Formulation

Linda-Sophie Schneider, Gabriel Herl, Andreas Maier

Comments: Preprint

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)

[1616] arXiv:2402.10376 (cross-list from cs.LG) [pdf, html, other]

Title: Interpreting CLIP with Sparse Linear Concept Embeddings (SpLiCE)

Usha Bhalla, Alex Oesterling, Suraj Srinivas, Flavio P. Calmon, Himabindu Lakkaraju

Comments: 25 pages, 15 figures, NeurIPS 2024. Code is provided at this https URL

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1617] arXiv:2402.10401 (cross-list from cs.LG) [pdf, html, other]

Title: ManiFPT: Defining and Analyzing Fingerprints of Generative Models

Hae Jin Song, Mahyar Khayatkhoei, Wael AbdAlmageed

Comments: Accepted to CVPR 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1618] arXiv:2402.10403 (cross-list from cs.LG) [pdf, html, other]

Title: Polyhedral Complex Derivation from Piecewise Trilinear Networks

Jin-Hwa Kim

Comments: Accepted at NeurIPS 2024. Updated with the camera-ready version

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

[1619] arXiv:2402.10425 (cross-list from eess.IV) [pdf, other]

Title: DABS-LS: Deep Atlas-Based Segmentation Using Regional Level Set Self-Supervision

Hannah G. Mason, Jack H. Noble

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1620] arXiv:2402.10470 (cross-list from cs.LG) [pdf, other]

Title: Theoretical Understanding of Learning from Adversarial Perturbations

Soichiro Kumano, Hiroshi Kera, Toshihiko Yamasaki

Comments: ICLR24

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[1621] arXiv:2402.10483 (cross-list from cs.GR) [pdf, html, other]

Title: GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians

Haimin Luo, Min Ouyang, Zijun Zhao, Suyi Jiang, Longwen Zhang, Qixuan Zhang, Wei Yang, Lan Xu, Jingyi Yu

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

[1622] arXiv:2402.10553 (cross-list from cs.RO) [pdf, other]

Title: A novel integrated industrial approach with cobots in the age of industry 4.0 through conversational interaction and computer vision

Andrea Pazienza, Nicola Macchiarulo, Felice Vitulano, Antonio Fiorentini, Marco Cammisa, Leonardo Rigutini, Ernesto Di Iorio, Achille Globo, Antonio Trevisi

Journal-ref: Proceedings of the 6th Italian Conference on Computational Linguistics (CLiC-it 2019)

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1623] arXiv:2402.10609 (cross-list from eess.IV) [pdf, html, other]

Title: MRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model

Ziqi Gao, S. Kevin Zhou

Comments: 10 pages, 5 figures, 7 tables, 1 pseudocode

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1624] arXiv:2402.10665 (cross-list from cs.LG) [pdf, html, other]

Title: Selective Prediction for Semantic Segmentation using Post-Hoc Confidence Estimation and Its Performance under Distribution Shift

Bruno Laboissiere Camargos Borges, Bruno Machado Pacheco, Danilo Silva

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1625] arXiv:2402.10728 (cross-list from eess.IV) [pdf, html, other]

Title: Semi-weakly-supervised neural network training for medical image registration

Yiwen Li, Yunguan Fu, Iani J.M.B. Gayo, Qianye Yang, Zhe Min, Shaheer U. Saeed, Wen Yan, Yipei Wang, J. Alison Noble, Mark Emberton, Matthew J. Clarkson, Dean C. Barratt, Victor A. Prisacariu, Yipeng Hu

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1626] arXiv:2402.10747 (cross-list from cs.LG) [pdf, other]

Title: Fully Differentiable Lagrangian Convolutional Neural Network for Continuity-Consistent Physics-Informed Precipitation Nowcasting

Peter Pavlík, Martin Výboh, Anna Bou Ezzeddine, Viera Rozinajová

Comments: Submitted to ICML 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1627] arXiv:2402.10776 (cross-list from eess.IV) [pdf, other]

Title: In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection

H. Fabelo, S. Ortega, A. Szolna, D. Bulters, J.F. Pineiro, S. Kabwama, A. Shanahan, H. Bulstrode, S. Bisshopp, B.R. Kiran, D. Ravi, R. Lazcano, D. Madronal, C. Sosa, C. Espino, M. Marquez, M. De la Luz Plaza, R. Camacho, D. Carrera, M. Hernandez, G.M. Callico, J. Morera, B. Stanciulescu, G.Z. Yang, R. Salvador, E. Juarez, C. Sanz, R. Sarmiento

Comments: 19 pages, 12 figures

Journal-ref: IEEE Access, 2019, 7, pp. 39098 39116

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1628] arXiv:2402.10805 (cross-list from cs.MM) [pdf, other]

Title: Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyond

Yongqi Li, Wenjie Wang, Leigang Qu, Liqiang Nie, Wenjie Li, Tat-Seng Chua

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[1629] arXiv:2402.10814 (cross-list from cs.LG) [pdf, other]

Title: Associative Memories in the Feature Space

Tommaso Salvatori, Beren Millidge, Yuhang Song, Rafal Bogacz, Thomas Lukasiewicz

Comments: 8 Pages, 4 Figures, accepted for publication at ECAI 2023

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1630] arXiv:2402.10851 (cross-list from eess.IV) [pdf, html, other]

Title: HistoSegCap: Capsules for Weakly-Supervised Semantic Segmentation of Histological Tissue Type in Whole Slide Images

Mobina Mansoori, Sajjad Shahabodini, Jamshid Abouei, Arash Mohammadi, Konstantinos N. Plataniotis

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1631] arXiv:2402.10865 (cross-list from cs.RO) [pdf, html, other]

Title: Multi-Model 3D Registration: Finding Multiple Moving Objects in Cluttered Point Clouds

David Jin, Sushrut Karmalkar, Harry Zhang, Luca Carlone

Comments: 8 pages, Accepted by ICRA 2024

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

[1632] arXiv:2402.10884 (cross-list from cs.CL) [pdf, html, other]

Title: Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models

Shengzhi Li, Rongyu Lin, Shichao Pei

Comments: Project code, model and data: this https URL

Journal-ref: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14188-14200, 2024

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1633] arXiv:2402.10885 (cross-list from cs.RO) [pdf, html, other]

Title: 3D Diffuser Actor: Policy Diffusion with 3D Scene Representations

Tsung-Wei Ke, Nikolaos Gkanatsios, Katerina Fragkiadaki

Comments: First two authors contributed equally

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1634] arXiv:2402.10887 (cross-list from eess.IV) [pdf, other]

Title: Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation

Ziyang Wang, Chao Ma

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1635] arXiv:2402.10921 (cross-list from cs.AI) [pdf, html, other]

Title: AM^2-EmoJE: Adaptive Missing-Modality Emotion Recognition in Conversation via Joint Embedding Learning

Naresh Kumar Devulapally, Sidharth Anand, Sreyasee Das Bhattacharjee, Junsong Yuan

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1636] arXiv:2402.10943 (cross-list from cs.CL) [pdf, other]

Title: Advances and Limitations in Open Source Arabic-Script OCR: A Case Study

Benjamin Kiessling (PSL), Gennady Kurin, Matthew Thomas Miller, Kader Smail

Journal-ref: Digital Studies / Le champ num{\'e}rique, 2021, 11 (1)

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1637] arXiv:2402.11120 (cross-list from cs.LG) [pdf, html, other]

Title: DART: A Principled Approach to Adversarially Robust Unsupervised Domain Adaptation

Yunjuan Wang, Hussein Hazimeh, Natalia Ponomareva, Alexey Kurakin, Ibrahim Hammoud, Raman Arora

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[1638] arXiv:2402.11145 (cross-list from cs.HC) [pdf, html, other]

Title: Supporting Experts with a Multimodal Machine-Learning-Based Tool for Human Behavior Analysis of Conversational Videos

Riku Arakawa, Kiyosu Maeda, Hiromu Yakura

Subjects: Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1639] arXiv:2402.11148 (cross-list from cs.LG) [pdf, html, other]

Title: Knowledge Distillation Based on Transformed Teacher Matching

Kaixiang Zheng, En-Hui Yang

Comments: Published as a conference paper at ICLR 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1640] arXiv:2402.11159 (cross-list from cs.CL) [pdf, html, other]

Title: Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability

Yejun Yoon, Seunghyun Yoon, Kunwoo Park

Comments: ACL 2024 (findings), 16 pages

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1641] arXiv:2402.11211 (cross-list from eess.IV) [pdf, html, other]

Title: Training-free image style alignment for self-adapting domain shift on handheld ultrasound devices

Hongye Zeng, Ke Zou, Zhihao Chen, Yuchong Gao, Hongbo Chen, Haibin Zhang, Kang Zhou, Meng Wang, Rick Siow Mong Goh, Yong Liu, Chang Jiang, Rui Zheng, Huazhu Fu

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1642] arXiv:2402.11217 (cross-list from cs.CL) [pdf, html, other]

Title: Asclepius: A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models

Wenxuan Wang, Yihang Su, Jingyuan Huan, Jie Liu, Wenting Chen, Yudi Zhang, Cheng-Yi Li, Kao-Jung Chang, Xiaohan Xin, Linlin Shen, Michael R. Lyu

Comments: 20 pages, 15 figures

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1643] arXiv:2402.11237 (cross-list from cs.LG) [pdf, other]

Title: Be Persistent: Towards a Unified Solution for Mitigating Shortcuts in Deep Learning

Hadi M. Dolatabadi, Sarah M. Erfani, Christopher Leckie

Comments: Accepted to the 2024 European Conference on Artificial Intelligence (ECAI)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1644] arXiv:2402.11250 (cross-list from eess.IV) [pdf, other]

Title: Hierarchical Prior-based Super Resolution for Point Cloud Geometry Compression

Dingquan Li, Kede Ma, Jing Wang, Ge Li

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1645] arXiv:2402.11274 (cross-list from eess.IV) [pdf, other]

Title: TC-DiffRecon: Texture coordination MRI reconstruction method based on diffusion model and modified MF-UNet method

Chenyan Zhang, Yifei Chen, Zhenxiong Fan, Yiyu Huang, Wenchao Weng, Ruiquan Ge, Dong Zeng, Changmiao Wang

Comments: 5 pages, 2 figures, accept ISBI2024

Journal-ref: ISBI 2024

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1646] arXiv:2402.11354 (cross-list from cs.LG) [pdf, html, other]

Title: Probabilistic Routing for Graph-Based Approximate Nearest Neighbor Search

Kejing Lu, Chuan Xiao, Yoshiharu Ishikawa

Comments: Source code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB); Data Structures and Algorithms (cs.DS)

[1647] arXiv:2402.11362 (cross-list from cs.LG) [pdf, other]

Title: Exploiting T-norms for Deep Learning in Autonomous Driving

Mihaela Cătălina Stoian, Eleonora Giunchiglia, Thomas Lukasiewicz

Comments: Published in Proceedings of the 17th International Workshop on Neural-Symbolic Learning and Reasoning, 2023 (NeSy 2023)

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1648] arXiv:2402.11411 (cross-list from cs.LG) [pdf, other]

Title: Aligning Modalities in Vision Large Language Models via Preference Fine-tuning

Yiyang Zhou, Chenhang Cui, Rafael Rafailov, Chelsea Finn, Huaxiu Yao

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1649] arXiv:2402.11510 (cross-list from eess.IV) [pdf, other]

Title: Underestimation of lung regions on chest X-ray segmentation masks assessed by comparison with total lung volume evaluated on computed tomography

Przemysław Bombiński, Patryk Szatkowski, Bartłomiej Sobieski, Tymoteusz Kwieciński, Szymon Płotka, Mariusz Adamek, Marcin Banasiuk, Mariusz I. Furmanek, Przemysław Biecek

Comments: Preprint to Elsevier

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1650] arXiv:2402.11557 (cross-list from eess.IV) [pdf, other]

Title: Evaluating Adversarial Robustness of Low dose CT Recovery

Kanchana Vaishnavi Gandikota, Paramanand Chandramouli, Hannah Droege, Michael Moeller

Comments: MIDL 2023

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1651] arXiv:2402.11682 (cross-list from cs.LG) [pdf, other]

Title: Learning Conditional Invariances through Non-Commutativity

Abhra Chaudhuri, Serban Georgescu, Anjan Dutta

Comments: International Conference on Learning Representations (ICLR) 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1652] arXiv:2402.11690 (cross-list from cs.CL) [pdf, other]

Title: Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning

Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang

Comments: 8 Pages, visual instruction tuning

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1653] arXiv:2402.11733 (cross-list from cs.LG) [pdf, other]

Title: The Effectiveness of Random Forgetting for Robust Generalization

Vijaya Raghavan T Ramkumar, Bahram Zonooz, Elahe Arani

Comments: Published as a conference paper at ICLR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1654] arXiv:2402.11735 (cross-list from cs.RO) [pdf, other]

Title: LiRaFusion: Deep Adaptive LiDAR-Radar Fusion for 3D Object Detection

Jingyu Song, Lingjun Zhao, Katherine A. Skinner

Comments: Accepted to ICRA 2024

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

[1655] arXiv:2402.11760 (cross-list from cs.LG) [pdf, other]

Title: Reinforcement Learning as a Parsimonious Alternative to Prediction Cascades: A Case Study on Image Segmentation

Bharat Srikishan, Anika Tabassum, Srikanth Allu, Ramakrishnan Kannan, Nikhil Muralidhar

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1656] arXiv:2402.11775 (cross-list from eess.IV) [pdf, other]

Title: FOD-Swin-Net: angular super resolution of fiber orientation distribution using a transformer-based deep model

Mateus Oliveira da Silva, Caio Pinheiro Santana, Diedre Santos do Carmo, Letícia Rittner

Comments: Accepted for publication at ISBI 2024

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neurons and Cognition (q-bio.NC)

[1657] arXiv:2402.11789 (cross-list from stat.ML) [pdf, html, other]

Title: Statistical Test on Diffusion Model-based Anomaly Detection by Selective Inference

Teruyuki Katsuoka, Tomohiro Shiraishi, Daiki Miwa, Vo Nguyen Le Duy, Ichiro Takeuchi

Comments: 30 pages, 7 figures

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1658] arXiv:2402.11836 (cross-list from cs.RO) [pdf, other]

Title: DIO: Dataset of 3D Mesh Models of Indoor Objects for Robotics and Computer Vision Applications

Nillan Nimal, Wenbin Li, Ronald Clark, Sajad Saeedi

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

[1659] arXiv:2402.11845 (cross-list from cs.CL) [pdf, other]

Title: Modularized Networks for Few-shot Hateful Meme Detection

Rui Cao, Roy Ka-Wei Lee, Jing Jiang

Comments: camera-ready for WWW, 2024, Web4Good

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1660] arXiv:2402.11866 (cross-list from cs.CG) [pdf, html, other]

Title: Two Online Map Matching Algorithms Based on Analytic Hierarchy Process and Fuzzy Logic

Jeremy J. Lin, Tomoro Mochida, Riley C. W. O'Neill, Atsuro Yoshida, Masashi Yamazaki, Akinobu Sasada

Comments: 25 pages, 27 figures

Subjects: Computational Geometry (cs.CG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1661] arXiv:2402.11908 (cross-list from cs.CL) [pdf, other]

Title: Semantic Textual Similarity Assessment in Chest X-ray Reports Using a Domain-Specific Cosine-Based Metric

Sayeh Gholipour Picha, Dawood Al Chanti, Alice Caplier

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1662] arXiv:2402.11989 (cross-list from cs.LG) [pdf, html, other]

Title: Privacy-Preserving Low-Rank Adaptation for Latent Diffusion Models

Zihao Luo, Xilie Xu, Feng Liu, Yun Sing Koh, Di Wang, Jingfeng Zhang

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

[1663] arXiv:2402.12072 (cross-list from eess.IV) [pdf, html, other]

Title: Robustness and Exploration of Variational and Machine Learning Approaches to Inverse Problems: An Overview

Alexander Auras, Kanchana Vaishnavi Gandikota, Hannah Droege, Michael Moeller

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Numerical Analysis (math.NA)

[1664] arXiv:2402.12114 (cross-list from eess.IV) [pdf, other]

Title: A Spatiotemporal Illumination Model for 3D Image Fusion in Optical Coherence Tomography

Stefan Ploner, Jungeun Won, Julia Schottenhamml, Jessica Girgis, Kenneth Lam, Nadia Waheed, James Fujimoto, Andreas Maier

Comments: Presented orally & as poster on 20th April 2023 at the IEEE International Symposium on Biomedical Imaging (ISBI) in Cartagena, Colombia. 6 pages, 3 figures. You can find the official version with broken equations and bad contrast figures under this https URL

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1665] arXiv:2402.12121 (cross-list from cs.CL) [pdf, other]

Title: Evaluating Image Review Ability of Vision Language Models

Shigeki Saito, Kazuki Hayashi, Yusuke Ide, Yusuke Sakai, Kazuma Onishi, Toma Suzuki, Seiji Gobara, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe

Comments: 9pages, under reviewing

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[1666] arXiv:2402.12181 (cross-list from cs.LG) [pdf, other]

Title: Revisiting Data Augmentation in Deep Reinforcement Learning

Jianshu Hu, Yunpeng Jiang, Paul Weng

Comments: Accepted in ICLR 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1667] arXiv:2402.12198 (cross-list from cs.CL) [pdf, html, other]

Title: Zero shot VLMs for hate meme detection: Are we there yet?

Naquee Rizwan, Paramananda Bhaskar, Mithun Das, Swadhin Satyaprakash Majhi, Punyajoy Saha, Animesh Mukherjee

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1668] arXiv:2402.12226 (cross-list from cs.CL) [pdf, html, other]

Title: AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling

Jun Zhan, Junqi Dai, Jiasheng Ye, Yunhua Zhou, Dong Zhang, Zhigeng Liu, Xin Zhang, Ruibin Yuan, Ge Zhang, Linyang Li, Hang Yan, Jie Fu, Tao Gui, Tianxiang Sun, Yugang Jiang, Xipeng Qiu

Comments: 28 pages, 16 figures, under review, work in progress

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1669] arXiv:2402.12292 (cross-list from stat.ML) [pdf, html, other]

Title: Regularization by denoising: Bayesian model and Langevin-within-split Gibbs sampling

Elhadji C. Faye, Mame Diarra Fall, Nicolas Dobigeon

Subjects: Machine Learning (stat.ML); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1670] arXiv:2402.12336 (cross-list from cs.LG) [pdf, html, other]

Title: Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models

Christian Schlarmann, Naman Deep Singh, Francesco Croce, Matthias Hein

Comments: ICML 2024 Oral

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[1671] arXiv:2402.12406 (cross-list from cs.LG) [pdf, html, other]

Title: Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation

Hyunjune Shin, Dong-Wan Choi

Comments: Accepted in AAAI-2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1672] arXiv:2402.12407 (cross-list from eess.IV) [pdf, html, other]

Title: Accelerating local laplacian filters on FPGAs

Shashwat Khandelwal, Ziaul Choudhury, Shashwat Shrivastava, Suresh Purini

Comments: 6 pages, 5 figures, 2 tables

Journal-ref: 10.1109/FPL50879.2020.00028

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Signal Processing (eess.SP)

[1673] arXiv:2402.12424 (cross-list from cs.LG) [pdf, html, other]

Title: Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs

Naihao Deng, Zhenjie Sun, Ruiqi He, Aman Sikka, Yulong Chen, Lin Ma, Yue Zhang, Rada Mihalcea

Comments: Accepted to ACL 2024 Findings; Naihao and Zhenjie contributed equally to the project; Data available at: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1674] arXiv:2402.12490 (cross-list from cs.LG) [pdf, html, other]

Title: Towards Cross-Domain Continual Learning

Marcus de Carvalho, Mahardhika Pratama, Jie Zhang, Chua Haoyan, Edward Yapp

Comments: 12 pages, 2 Figures, 4 Tables. To be published at the IEEE International Conference on Data Engineering (ICDE) 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1675] arXiv:2402.12627 (cross-list from cs.LG) [pdf, html, other]

Title: A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective

Jeng-Lin Li, Chih-Fan Hsu, Ming-Ching Chang, Wei-Chao Chen

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1676] arXiv:2402.12683 (cross-list from cs.LG) [pdf, other]

Title: TorchCP: A Library for Conformal Prediction based on PyTorch

Hongxin Wei, Jianguo Huang

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Statistics Theory (math.ST)

[1677] arXiv:2402.12701 (cross-list from eess.IV) [pdf, html, other]

Title: wmh_seg: Transformer based U-Net for Robust and Automatic White Matter Hyperintensity Segmentation across 1.5T, 3T and 7T

Jinghang Li, Tales Santini, Yuanzhe Huang, Joseph M. Mettenburg, Tamer S. Ibrahim, Howard J. Aizenstein, Minjie Wu

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1678] arXiv:2402.12735 (cross-list from eess.IV) [pdf, html, other]

Title: Denoising OCT Images Using Steered Mixture of Experts with Multi-Model Inference

Aytaç Özkan, Elena Stoykova, Thomas Sikora, Violeta Madjarova

Comments: This submission contains 10 pages and 4 figures. It was presented at the 2024 SPIE Photonics West, held in San Francisco. The paper details advancements in photonics applications related to healthcare and includes supplementary material with additional datasets for review

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1679] arXiv:2402.12760 (cross-list from cs.MM) [pdf, html, other]

Title: A User-Friendly Framework for Generating Model-Preferred Prompts in Text-to-Image Synthesis

Nailei Hei, Qianyu Guo, Zihao Wang, Yan Wang, Haofen Wang, Wenqiang Zhang

Comments: Accepted by The 38th Annual AAAI Conference on Artificial Intelligence (AAAI 2024)

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1680] arXiv:2402.12928 (cross-list from cs.DL) [pdf, html, other]

Title: A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence

Penghai Zhao, Xin Zhang, Ming-Ming Cheng, Jian Yang, Xiang Li

Comments: IEEE version v1. [February 19, 2024] IEEE version v2 with typos fixed. [February 23, 2024] IEEE version v3 with errors fixed. [February 29, 2024] IEEE version v4 with improved quaility. [February 29, 2024]

Subjects: Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1681] arXiv:2402.13007 (cross-list from cs.LG) [pdf, html, other]

Title: Improve Cross-Architecture Generalization on Dataset Distillation

Binglin Zhou, Linhao Zhong, Wentao Chen

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1682] arXiv:2402.13126 (cross-list from cs.CR) [pdf, other]

Title: VGMShield: Mitigating Misuse of Video Generative Models

Yan Pang, Yang Zhang, Tianhao Wang

Comments: 17 pages, 10 figures

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

[1683] arXiv:2402.13144 (cross-list from cs.LG) [pdf, html, other]

Title: Neural Network Parameter Diffusion

Kai Wang, Zhaopan Xu, Yukun Zhou, Zelin Zang, Trevor Darrell, Zhuang Liu, Yang You

Comments: We introduce a novel approach for parameter generation, named neural network parameter diffusion (\textbf{p-diff}), which employs a standard latent diffusion model to synthesize a new set of parameters

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1684] arXiv:2402.13195 (cross-list from cs.RO) [pdf, html, other]

Title: Design and Flight Demonstration of a Quadrotor for Urban Mapping and Target Tracking Research

Collin Hague, Nick Kakavitsas, Jincheng Zhang, Chris Beam, Andrew Willis, Artur Wolek

Comments: 7 pages, 10 figures, To be presented at IEEE SoutheastCon 2024

Journal-ref: SoutheastCon 2024, 559-564

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)

[1685] arXiv:2402.13251 (cross-list from cs.GR) [pdf, html, other]

Title: FlashTex: Fast Relightable Mesh Texturing with LightControlNet

Kangle Deng, Timothy Omernick, Alexander Weiss, Deva Ramanan, Jun-Yan Zhu, Tinghui Zhou, Maneesh Agrawala

Comments: Project page: this https URL

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1686] arXiv:2402.13368 (cross-list from cs.LG) [pdf, html, other]

Title: Unsupervised Concept Discovery Mitigates Spurious Correlations

Md Rifat Arefin, Yan Zhang, Aristide Baratin, Francesco Locatello, Irina Rish, Dianbo Liu, Kenji Kawaguchi

Journal-ref: ICLM 2024

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1687] arXiv:2402.13369 (cross-list from cs.LG) [pdf, html, other]

Title: The Uncanny Valley: A Comprehensive Analysis of Diffusion Models

Karam Ghanem, Danilo Bzdok

Comments: 28 pages, 21 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1688] arXiv:2402.13505 (cross-list from cs.LG) [pdf, html, other]

Title: SimPro: A Simple Probabilistic Framework Towards Realistic Long-Tailed Semi-Supervised Learning

Chaoqun Du, Yizeng Han, Gao Huang

Comments: ICML2024 camera-ready version

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1689] arXiv:2402.13546 (cross-list from cs.CL) [pdf, html, other]

Title: LLMs Meet Long Video: Advancing Long Video Question Answering with An Interactive Visual Adapter in LLMs

Yunxin Li, Xinyu Chen, Baotain Hu, Min Zhang

Comments: 12 pages; working in progress

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1690] arXiv:2402.13561 (cross-list from cs.CL) [pdf, html, other]

Title: Cognitive Visual-Language Mapper: Advancing Multimodal Comprehension with Enhanced Visual Knowledge Alignment

Yunxin Li, Xinyu Chen, Baotian Hu, Haoyuan Shi, Min Zhang

Comments: 12 pages,4 figures; Accepted by ACL 2024 Main Conference

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1691] arXiv:2402.13587 (cross-list from cs.CL) [pdf, html, other]

Title: A Multimodal In-Context Tuning Approach for E-Commerce Product Description Generation

Yunxin Li, Baotian Hu, Wenhan Luo, Lin Ma, Yuxin Ding, Min Zhang

Comments: Accepted by LREC-COLING 2024

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1692] arXiv:2402.13609 (cross-list from cs.RO) [pdf, html, other]

Title: VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarks

Yutong Wang, Chaoyang Jiang, Xieyuanli Chen

Comments: 7 pages, 5 figures, 4 tables, conference icra 2024 accepted

Subjects: Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

[1693] arXiv:2402.13629 (cross-list from eess.IV) [pdf, other]

Title: Adversarial Purification and Fine-tuning for Robust UDC Image Restoration

Zhenbo Song, Zhenyuan Zhang, Kaihao Zhang, Zhaoxin Fan, Jianfeng Lu

Comments: Failure to meet expectations

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

[1694] arXiv:2402.13724 (cross-list from cs.HC) [pdf, html, other]

Title: Bring Your Own Character: A Holistic Solution for Automatic Facial Animation Generation of Customized Characters

Zechen Bai, Peng Chen, Xiaolan Peng, Lu Liu, Hui Chen, Mike Zheng Shou, Feng Tian

Comments: 9 pages. To appear in IEEE-VR

Subjects: Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)

[1695] arXiv:2402.13776 (cross-list from eess.IV) [pdf, html, other]

Title: Cas-DiffCom: Cascaded diffusion model for infant longitudinal super-resolution 3D medical image completion

Lianghu Guo, Tianli Tao, Xinyi Cai, Zihao Zhu, Jiawei Huang, Lixuan Zhu, Zhuoyang Gu, Haifeng Tang, Rui Zhou, Siyan Han, Yan Liang, Qing Yang, Dinggang Shen, Han Zhang

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[1696] arXiv:2402.13809 (cross-list from cs.NE) [pdf, html, other]

Title: NeuralDiffuser: Controllable fMRI Reconstruction with Primary Visual Feature Guided Diffusion

Haoyu Li, Hao Wu, Badong Chen

Comments: The implementation error lead to incorrect results in experiment

Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1697] arXiv:2402.13853 (cross-list from cs.RO) [pdf, html, other]

Title: RealDex: Towards Human-like Grasping for Robotic Dexterous Hand

Yumeng Liu, Yaxun Yang, Youzhuo Wang, Xiaofei Wu, Jiamin Wang, Yichen Yao, Sören Schwertfeger, Sibei Yang, Wenping Wang, Jingyi Yu, Xuming He, Yuexin Ma

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[1698] arXiv:2402.13936 (cross-list from cs.CL) [pdf, html, other]

Title: Distinctive Image Captioning: Leveraging Ground Truth Captions in CLIP Guided Reinforcement Learning

Antoine Chaffin, Ewa Kijak, Vincent Claveau

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[1699] arXiv:2402.14009 (cross-list from cs.LG) [pdf, html, other]

Title: Geometry-Informed Neural Networks

Arturs Berzins, Andreas Radler, Eric Volkmann, Sebastian Sanokowski, Sepp Hochreiter, Johannes Brandstetter

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[1700] arXiv:2402.14015 (cross-list from cs.LG) [pdf, html, other]

Title: Corrective Machine Unlearning

Shashwat Goel, Ameya Prabhu, Philip Torr, Ponnurangam Kumaraguru, Amartya Sanyal

Comments: Published in Transactions of Machine Learning Research (TMLR), 17 pages, 7 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)