Multimedia

Authors and titles for March 2025

[1] arXiv:2503.00625 [pdf, html, other]

Title: Perceptual Visual Quality Assessment: Principles, Methods, and Future Directions

Wei Zhou, Hadi Amirpour, Christian Timmerer, Guangtao Zhai, Patrick Le Callet, Alan C. Bovik

Comments: A tutorial and review

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

[2] arXiv:2503.01404 [pdf, html, other]

Title: Multi-resolution Encoding for HTTP Adaptive Streaming using VVenC

Kamran Qureshi, Hadi Amirpour, Christian Timmerer

Subjects: Multimedia (cs.MM)

[3] arXiv:2503.01415 [pdf, html, other]

Title: Improving the Efficiency of VVC using Partitioning of Reference Frames

Kamran Qureshi, Hadi Amirpour, Christian Timmerer

Subjects: Multimedia (cs.MM)

[4] arXiv:2503.01879 [pdf, html, other]

Title: Nexus-O: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision

Che Liu, Yingji Zhang, Dong Zhang, Weijie Zhang, Chenggong Gong, Haohan Li, Yu Lu, Shilin Zhou, Yue Lu, Ziliang Gan, Ziao Wang, Junwei Liao, Haipang Wu, Ji Liu, André Freitas, Qifan Wang, Zenglin Xu, Rongjuncheng Zhang, Yong Dai

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[5] arXiv:2503.05008 [pdf, html, other]

Title: Enhancing Video Music Recommendation with Transformer-Driven Audio-Visual Embeddings

Shimiao Liu, Alexander Lerch

Comments: 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2), Erlangen, Germany, 2024, pp. 1-6

Subjects: Multimedia (cs.MM)

[6] arXiv:2503.07911 [pdf, html, other]

Title: Visual and Text Prompt Segmentation: A Novel Multi-Model Framework for Remote Sensing

Xing Zi, Kairui Jin, Xian Tao, Jun Li, Ali Braytee, Rajiv Ratn Shah, Mukesh Prasad

Comments: Under Review - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

[7] arXiv:2503.08461 [pdf, html, other]

Title: FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework

Jianian Zhu, Hang Wu, Haojie Wang, Yinghui Li, Biao Hou, Ruixuan Li, Jidong Zhai

Comments: 14 pages, 14 figures

Subjects: Multimedia (cs.MM); Distributed, Parallel, and Cluster Computing (cs.DC)

[8] arXiv:2503.09205 [pdf, other]

Title: Quality Over Quantity? LLM-Based Curation for a Data-Efficient Audio-Video Foundation Model

Ali Vosoughi, Dimitra Emmanouilidou, Hannes Gamper

Comments: We are withdrawing this version due to the need for substantial updates in scope and organization, which affect the clarity and completeness of the manuscript. We plan to submit a revised version that incorporates these changes

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Information Retrieval (cs.IR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[9] arXiv:2503.09448 [pdf, other]

Title: Optimizing QoE-Privacy Tradeoff for Proactive VR Streaming

Xing Wei, Shengqian Han, Chenyang Yang, Chengjian Sun

Subjects: Multimedia (cs.MM); Multiagent Systems (cs.MA)

[10] arXiv:2503.09852 [pdf, html, other]

Title: StyleSpeaker: Audio-Enhanced Fine-Grained Style Modeling for Speech-Driven 3D Facial Animation

An Yang, Chenyu Liu, Pengcheng Xia, Jun Du

Subjects: Multimedia (cs.MM)

[11] arXiv:2503.10522 [pdf, html, other]

Title: AudioX: Diffusion Transformer for Anything-to-Audio Generation

Zeyue Tian, Yizhu Jin, Zhaoyang Liu, Ruibin Yuan, Xu Tan, Qifeng Chen, Wei Xue, Yike Guo

Comments: The code and datasets will be available at this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[12] arXiv:2503.11324 [pdf, html, other]

Title: Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarking

Ziyi Wang, Songbai Tan, Gang Xu, Xuerui Qiu, Hongbin Xu, Xin Meng, Ming Li, Fei Richard Yu

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

[13] arXiv:2503.12806 [pdf, html, other]

Title: AV-Surf: Surface-Enhanced Geometry-Aware Novel-View Acoustic Synthesis

Hadam Baek, Hannie Shin, Jiyoung Seo, Chanwoo Kim, Saerom Kim, Hyeongbok Kim, Sangpil Kim

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[14] arXiv:2503.15237 [pdf, html, other]

Title: QuMATL: Query-based Multi-annotator Tendency Learning

Liyun Zhang, Zheng Lian, Hong Liu, Takanori Takebe, Yuta Nakashima

Comments: 12 pages

Subjects: Multimedia (cs.MM)

[15] arXiv:2503.17116 [pdf, html, other]

Title: The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understanding

Luca Rossetto, Werner Bailer, Duc-Tien Dang-Nguyen, Graham Healy, Björn Þór Jónsson, Onanong Kongmeesub, Hoang-Bao Le, Stevan Rudinac, Klaus Schöffmann, Florian Spiess, Allie Tran, Minh-Triet Tran, Quang-Linh Tran, Cathal Gurrin

Comments: 7 pages, 6 figures, dataset available via this https URL

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

[16] arXiv:2503.17340 [pdf, html, other]

Title: Align Your Rhythm: Generating Highly Aligned Dance Poses with Gating-Enhanced Rhythm-Aware Feature Representation

Congyi Fan, Jian Guan, Xuanjia Zhao, Dongli Xu, Youtian Lin, Tong Ye, Pengming Feng, Haiwei Pan

Comments: 10 pages, 6 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[17] arXiv:2503.17551 [pdf, html, other]

Title: Audio-Enhanced Vision-Language Modeling with Latent Space Broadening for High Quality Data Expansion

Yu Sun, Yin Li, Ruixiao Sun, Chunhui Liu, Fangming Zhou, Ze Jin, Linjie Wang, Xiang Shen, Zhuolin Hao, Hongyu Xiong

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[18] arXiv:2503.17735 [pdf, html, other]

Title: RDTF: Resource-efficient Dual-mask Training Framework for Multi-frame Animated Sticker Generation

Zhiqiang Yuan, Ting Zhang, Ying Deng, Jiapei Zhang, Yeshuang Zhu, Zexi Jia, Jie Zhou, Jinchao Zhang

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[19] arXiv:2503.17914 [pdf, html, other]

Title: Semi-supervised Semantic Segmentation with Multi-Constraint Consistency Learning

Jianjian Yin, Tao Chen, Gensheng Pei, Yazhou Yao, Liqiang Nie, Xiansheng Hua

Comments: accepted by IEEE Transactions on Multimedia

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[20] arXiv:2503.18104 [pdf, html, other]

Title: Challenging Dataset and Multi-modal Gated Mixture of Experts Model for Remote Sensing Copy-Move Forgery Understanding

Ze Zhang, Enyuan Zhao, Yi Jiang, Jie Nie, Xinyue Liang

Comments: 6 pages, 6 figures

Subjects: Multimedia (cs.MM)

[21] arXiv:2503.18679 [pdf, html, other]

Title: Merge Mode for Template-based Intra Mode Derivation (TIMD) in ECM

Mohsen Abdoli, Ramin G. Youvalari, Frank Plowman, Alexandre Tissier

Subjects: Multimedia (cs.MM)

[22] arXiv:2503.21197 [pdf, html, other]

Title: WVSC: Wireless Video Semantic Communication with Multi-frame Compensation

Bingyan Xie, Yongpeng Wu, Yuxuan Shi, Biqian Feng, Wenjun Zhang, Jihong Park, Tony Q.S. Quek

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[23] arXiv:2503.21699 [pdf, html, other]

Title: MAVERIX: Multimodal Audio-Visual Evaluation Reasoning IndeX

Liuyue Xie, George Z. Wei, Avik Kuthiala, Ce Zheng, Ananya Bal, Mosam Dabhi, Liting Wen, Taru Rustagi, Ethan Lai, Sushil Khyalia, Rohan Choudhury, Morteza Ziyadi, Xu Zhang, Hao Yang, László A. Jeni

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[24] arXiv:2503.22589 [pdf, html, other]

Title: Using AI to Summarize US Presidential Campaign TV Advertisement Videos, 1952-2012

Adam Breuer, Bryce J. Dietrich, Michael H. Crespin, Matthew Butler, J.A. Pyrse, Kosuke Imai

Comments: 17 pages, 7 tables, 4 figures, and linked datasets

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[25] arXiv:2503.23655 [pdf, other]

Title: Construction of Hyperchaotic Maps Based on 3D-CCC and its Applications in Image Encryption

Jilei Sun

Subjects: Multimedia (cs.MM)

[26] arXiv:2503.24127 [pdf, html, other]

Title: Compression Metadata-assisted RoI Extraction and Adaptive Inference for Efficient Video Analytics

Chengzhi Wang, Peng Yang

Comments: Accepted by the IEEE ICME 2025

Subjects: Multimedia (cs.MM)

[27] arXiv:2503.24164 [pdf, html, other]

Title: SVLA: A Unified Speech-Vision-Language Assistant with Multimodal Reasoning and Speech Generation

Ngoc Dung Huynh, Mohamed Reda Bouadjenek, Imran Razzak, Hakim Hacid, Sunil Aryal

Comments: 21 pages

Subjects: Multimedia (cs.MM)

[28] arXiv:2503.00071 (cross-list from cs.CV) [pdf, html, other]

Title: I see what you mean: Co-Speech Gestures for Reference Resolution in Multimodal Dialogue

Esam Ghaleb, Bulat Khaertdinov, Aslı Özyürek, Raquel Fernández

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[29] arXiv:2503.00374 (cross-list from cs.CV) [pdf, html, other]

Title: MIRROR: Multi-Modal Pathological Self-Supervised Representation Learning via Modality Alignment and Retention

Tianyi Wang, Jianan Fan, Dingxin Zhang, Dongnan Liu, Yong Xia, Heng Huang, Weidong Cai

Comments: 10 pages, 5 figures, 4 tables. Code available at this https URL. Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[30] arXiv:2503.00455 (cross-list from cs.SD) [pdf, html, other]

Title: PodAgent: A Comprehensive Framework for Podcast Generation

Yujia Xiao, Lei He, Haohan Guo, Fenglong Xie, Tan Lee

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[31] arXiv:2503.00548 (cross-list from cs.CV) [pdf, html, other]

Title: Unbiased Video Scene Graph Generation via Visual and Semantic Dual Debiasing

Yanjun Li, Zhaoyang Li, Honghui Chen, Lizhi Xu

Comments: 17 pages, 8 figures, CVPR 2025 (poster)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[32] arXiv:2503.01175 (cross-list from cs.CV) [pdf, html, other]

Title: HOP: Heterogeneous Topology-based Multimodal Entanglement for Co-Speech Gesture Generation

Hongye Cheng, Tianyu Wang, Guangsi Shi, Zexing Zhao, Yanwei Fu

Comments: Accepted by CVPR 2025. See this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[33] arXiv:2503.01362 (cross-list from cs.SD) [pdf, html, other]

Title: Streaming Piano Transcription Based on Consistent Onset and Offset Decoding with Sustain Pedal Detection

Weixing Wei, Jiahao Zhao, Yulun Wu, Kazuyoshi Yoshii

Comments: Accepted to ISMIR 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[34] arXiv:2503.01370 (cross-list from cs.GR) [pdf, html, other]

Title: Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation

Jiantao Lin, Xin Yang, Meixi Chen, Yingjie Xu, Dongyu Yan, Leyi Wu, Xinli Xu, Lie XU, Shunsi Zhang, Ying-Cong Chen

Comments: The first three authors contributed equally to this work

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[35] arXiv:2503.01396 (cross-list from cs.CR) [pdf, html, other]

Title: CorrNetDroid: Android Malware Detector leveraging a Correlation-based Feature Selection for Network Traffic features

Yash Sharma, Anshul Arora

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM)

[36] arXiv:2503.01980 (cross-list from cs.CV) [pdf, html, other]

Title: Recurrence-Enhanced Vision-and-Language Transformers for Robust Multimodal Document Retrieval

Davide Caffagni, Sara Sarto, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[37] arXiv:2503.02199 (cross-list from cs.CV) [pdf, html, other]

Title: Words or Vision: Do Vision-Language Models Have Blind Faith in Text?

Ailin Deng, Tri Cao, Zhirui Chen, Bryan Hooi

Comments: Accepted to CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[38] arXiv:2503.02318 (cross-list from cs.SD) [pdf, html, other]

Title: Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models

Zhifei Xie, Mingbao Lin, Zihang Liu, Pengcheng Wu, Shuicheng Yan, Chunyan Miao

Comments: Technical report, in process

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[39] arXiv:2503.02452 (cross-list from cs.CV) [pdf, html, other]

Title: 2DGS-Avatar: Animatable High-fidelity Clothed Avatar via 2D Gaussian Splatting

Qipeng Yan, Mingyang Sun, Lihua Zhang

Comments: ICVRV 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[40] arXiv:2503.02823 (cross-list from cs.SD) [pdf, html, other]

Title: A Multimodal Symphony: Integrating Taste and Sound through Generative AI

Matteo Spanio, Massimiliano Zampini, Antonio Rodà, Franco Pierucci

Comments: 17 pages, 6 figures (2 + 2 figures with 2 subfigures each)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[41] arXiv:2503.04446 (cross-list from cs.SI) [pdf, html, other]

Title: SMTPD: A New Benchmark for Temporal Prediction of Social Media Popularity

Yijie Xu, Bolun Zheng, Wei Zhu, Hangjia Pan, Yuchen Yao, Ning Xu, Anan Liu, Quan Zhang, Chenggang Yan

Comments: accept by CVPR 2025

Subjects: Social and Information Networks (cs.SI); Multimedia (cs.MM)

[42] arXiv:2503.04817 (cross-list from cs.CL) [pdf, html, other]

Title: Multi-Agent System for AI-Assisted Extraction of Narrative Arcs in TV Series

Roberto Balestri, Guglielmo Pescatore

Comments: 17th International Conference on Agents and Artificial Intelligence, Porto (Portugal). 23/02/2025 - 25/02/2025

Journal-ref: 2025. Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1, ISBN 978-989-758-737-5, ISSN 2184-433X, pages 663-670

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Multimedia (cs.MM)

[43] arXiv:2503.05185 (cross-list from q-fin.CP) [pdf, other]

Title: FinTMMBench: Benchmarking Temporal-Aware Multi-Modal RAG in Finance

Fengbin Zhu, Junfeng Li, Liangming Pan, Wenjie Wang, Fuli Feng, Chao Wang, Huanbo Luan, Tat-Seng Chua

Comments: Under review

Subjects: Computational Finance (q-fin.CP); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[44] arXiv:2503.05223 (cross-list from cs.SD) [pdf, html, other]

Title: DiVISe: Direct Visual-Input Speech Synthesis Preserving Speaker Characteristics And Intelligibility

Yifan Liu, Yu Fang, Zhouhan Lin

Comments: to be published in NAACL 25

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[45] arXiv:2503.05639 (cross-list from cs.CV) [pdf, html, other]

Title: VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control

Yuxuan Bian, Zhaoyang Zhang, Xuan Ju, Mingdeng Cao, Liangbin Xie, Ying Shan, Qiang Xu

Comments: Project page available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[46] arXiv:2503.05858 (cross-list from cs.SD) [pdf, html, other]

Title: Bimodal Connection Attention Fusion for Speech Emotion Recognition

Jiachen Luo, Huy Phan, Lin Wang, Joshua D. Reiss

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[47] arXiv:2503.06122 (cross-list from cs.HC) [pdf, html, other]

Title: Facilitating Daily Practice in Intangible Cultural Heritage through Virtual Reality: A Case Study of Traditional Chinese Flower Arrangement

Yingna Wang, Qingqin Liu, Xiaoying Wei, Mingming Fan

Comments: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 - May 1, 2025, Yokohama, Japan

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[48] arXiv:2503.06273 (cross-list from cs.CV) [pdf, html, other]

Title: Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations

Jeong Hun Yeo, Minsu Kim, Chae Won Kim, Stavros Petridis, Yong Man Ro

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[49] arXiv:2503.06362 (cross-list from cs.CV) [pdf, html, other]

Title: Adaptive Audio-Visual Speech Recognition via Matryoshka-Based Multimodal LLMs

Umberto Cappellazzo, Minsu Kim, Stavros Petridis

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[50] arXiv:2503.06442 (cross-list from cs.CV) [pdf, html, other]

Title: OT-DETECTOR: Delving into Optimal Transport for Zero-shot Out-of-Distribution Detection

Yu Liu, Hao Tang, Haiqi Zhang, Jing Qin, Zechao Li

Comments: The first two authors contributed equally to this work

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[51] arXiv:2503.06472 (cross-list from cs.CV) [pdf, html, other]

Title: CalliReader: Contextualizing Chinese Calligraphy via an Embedding-Aligned Vision-Language Model

Yuxuan Luo, Jiaqi Tang, Chenyi Huang, Feiyang Hao, Zhouhui Lian

Comments: 11 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[52] arXiv:2503.06520 (cross-list from cs.CV) [pdf, html, other]

Title: Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement

Yuqi Liu, Bohao Peng, Zhisheng Zhong, Zihao Yue, Fanbin Lu, Bei Yu, Jiaya Jia

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[53] arXiv:2503.06526 (cross-list from cs.CV) [pdf, html, other]

Title: TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long Videos

Chen-Lin Zhang, Lin Sui, Shuming Liu, Fangzhou Mu, Zhangcheng Wang, Bernard Ghanem

Comments: Code & models will be released at this https URL. The first 4 authors contributes equally

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[54] arXiv:2503.06608 (cross-list from cs.CV) [pdf, html, other]

Title: GroMo: Plant Growth Modeling with Multiview Images

Ruchi Bhatt, Shreya Bansal, Amanpreet Chander, Rupinder Kaur, Malya Singh, Mohan Kankanhalli, Abdulmotaleb El Saddik, Mukesh Kumar Saini

Comments: 7 pages, 5 Figures, 3 Tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[55] arXiv:2503.06677 (cross-list from cs.CV) [pdf, html, other]

Title: REArtGS: Reconstructing and Generating Articulated Objects via 3D Gaussian Splatting with Geometric and Motion Constraints

Di Wu, Liu Liu, Zhou Linli, Anran Huang, Liangtu Song, Qiaojun Yu, Qi Wu, Cewu Lu

Comments: 11pages, 6 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[56] arXiv:2503.07050 (cross-list from cs.CV) [pdf, html, other]

Title: TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation

Victor Shea-Jay Huang, Le Zhuo, Yi Xin, Zhaokai Wang, Peng Gao, Hongsheng Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[57] arXiv:2503.07259 (cross-list from cs.CV) [pdf, html, other]

Title: COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition

Baiyu Chen, Wilson Wongso, Zechen Li, Yonchanok Khaokaew, Hao Xue, Flora Salim

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[58] arXiv:2503.08120 (cross-list from cs.CV) [pdf, html, other]

Title: Uni$\textbf{F}^2$ace: Fine-grained Face Understanding and Generation with Unified Multimodal Models

Junzhe Li, Xuerui Qiu, Linrui Xu, Liya Guo, Delin Qu, Tingting Long, Chun Fan, Ming Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[59] arXiv:2503.08147 (cross-list from cs.CV) [pdf, html, other]

Title: FilmComposer: LLM-Driven Music Production for Silent Film Clips

Zhifeng Xie, Qile He, Youjia Zhu, Qiwei He, Mengtian Li

Comments: Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2503.08221 (cross-list from cs.CV) [pdf, html, other]

Title: EgoBlind: Towards Egocentric Visual Assistance for the Blind People

Junbin Xiao, Nanxin Huang, Hao Qiu, Zhulin Tao, Xun Yang, Richang Hong, Meng Wang, Angela Yao

Comments: Preprint. Under Review

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[61] arXiv:2503.08417 (cross-list from cs.GR) [pdf, html, other]

Title: AnyMoLe: Any Character Motion In-betweening Leveraging Video Diffusion Models

Kwan Yun, Seokhyeon Hong, Chaelin Kim, Junyong Noh

Comments: 11 pages, 10 figures, CVPR 2025

Subjects: Graphics (cs.GR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[62] arXiv:2503.08638 (cross-list from eess.AS) [pdf, html, other]

Title: YuE: Scaling Open Foundation Models for Long-Form Music Generation

Ruibin Yuan, Hanfeng Lin, Shuyue Guo, Ge Zhang, Jiahao Pan, Yongyi Zang, Haohe Liu, Yiming Liang, Wenye Ma, Xingjian Du, Xinrun Du, Zhen Ye, Tianyu Zheng, Yinghao Ma, Minghao Liu, Zeyue Tian, Ziya Zhou, Liumeng Xue, Xingwei Qu, Yizhi Li, Shangda Wu, Tianhao Shen, Ziyang Ma, Jun Zhan, Chunhui Wang, Yatian Wang, Xiaowei Chi, Xinyue Zhang, Zhenzhu Yang, Xiangzhou Wang, Shansong Liu, Lingrui Mei, Peng Li, Junjie Wang, Jianwei Yu, Guojian Pang, Xu Li, Zihao Wang, Xiaohuan Zhou, Lijun Yu, Emmanouil Benetos, Yong Chen, Chenghua Lin, Xie Chen, Gus Xia, Zhaoxiang Zhang, Chao Zhang, Wenhu Chen, Xinyu Zhou, Xipeng Qiu, Roger Dannenberg, Jiaheng Liu, Jian Yang, Wenhao Huang, Wei Xue, Xu Tan, Yike Guo

Comments: this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)

[63] arXiv:2503.08906 (cross-list from cs.CV) [pdf, html, other]

Title: Prompt-OT: An Optimal Transport Regularization Paradigm for Knowledge Preservation in Vision-Language Model Adaptation

Xiwen Chen, Wenhui Zhu, Peijie Qiu, Hao Wang, Huayu Li, Haiyu Wu, Aristeidis Sotiras, Yalin Wang, Abolfazl Razi

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[64] arXiv:2503.09130 (cross-list from cs.GR) [pdf, html, other]

Title: InteractEdit: Zero-Shot Editing of Human-Object Interactions in Images

Jiun Tian Hoe, Weipeng Hu, Wei Zhou, Chao Xie, Ziwei Wang, Chee Seng Chan, Xudong Jiang, Yap-Peng Tan

Comments: Website: this https URL

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[65] arXiv:2503.09146 (cross-list from cs.CV) [pdf, html, other]

Title: Generative Frame Sampler for Long Video Understanding

Linli Yao, Haoning Wu, Kun Ouyang, Yuanxing Zhang, Caiming Xiong, Bei Chen, Xu Sun, Junnan Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[66] arXiv:2503.09149 (cross-list from cs.CV) [pdf, html, other]

Title: Memory-enhanced Retrieval Augmentation for Long Video Understanding

Huaying Yuan, Zheng Liu, Minhao Qin, Hongjin Qian, Y Shu, Zhicheng Dou, Ji-Rong Wen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[67] arXiv:2503.09537 (cross-list from cs.CV) [pdf, html, other]

Title: GenHPE: Generative Counterfactuals for 3D Human Pose Estimation with Radio Frequency Signals

Shuokang Huang, Julie A. McCann

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Signal Processing (eess.SP)

[68] arXiv:2503.09832 (cross-list from cs.CY) [pdf, html, other]

Title: Honey Trap or Romantic Utopia: A Case Study of Final Fantasy XIV Players PII Disclosure in Intimate Partner-Seeking Posts

Yihao Zhou, Tanusree Sharma

Subjects: Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[69] arXiv:2503.09938 (cross-list from cs.CV) [pdf, html, other]

Title: PanoGen++: Domain-Adapted Text-Guided Panoramic Environment Generation for Vision-and-Language Navigation

Sen Wang, Dongliang Zhou, Liang Xie, Chao Xu, Ye Yan, Erwei Yin

Comments: This paper was accepted by Neural Networks

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Robotics (cs.RO)

[70] arXiv:2503.10078 (cross-list from cs.CV) [pdf, html, other]

Title: Image Quality Assessment: From Human to Machine Preference

Chunyi Li, Yuan Tian, Xiaoyue Ling, Zicheng Zhang, Haodong Duan, Haoning Wu, Ziheng Jia, Xiaohong Liu, Xiongkuo Min, Guo Lu, Weisi Lin, Guangtao Zhai

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[71] arXiv:2503.10086 (cross-list from cs.SD) [pdf, html, other]

Title: Efficient Adapter Tuning for Joint Singing Voice Beat and Downbeat Tracking with Self-supervised Learning Features

Jiajun Deng, Yaolong Ju, Jing Yang, Simon Lui, Xunying Liu

Comments: Accepted by ISMIR2024

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[72] arXiv:2503.10125 (cross-list from cs.CV) [pdf, html, other]

Title: Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generation

Yi Wu, Lingting Zhu, Lei Liu, Wandi Qiao, Ziqiang Li, Lequan Yu, Bin Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[73] arXiv:2503.10166 (cross-list from cs.IR) [pdf, html, other]

Title: ImageScope: Unifying Language-Guided Image Retrieval via Large Multimodal Model Collective Reasoning

Pengfei Luo, Jingbo Zhou, Tong Xu, Yuan Xia, Linli Xu, Enhong Chen

Comments: WWW 2025

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[74] arXiv:2503.10324 (cross-list from cs.CV) [pdf, other]

Title: IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identification

Yuhao Wang, Yongfeng Lv, Pingping Zhang, Huchuan Lu

Comments: This work is accepted by CVPR2025. More modifications may be performed

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[75] arXiv:2503.10700 (cross-list from cs.CV) [pdf, html, other]

Title: TA-V2A: Textually Assisted Video-to-Audio Generation

Yuhuan You, Xihong Wu, Tianshu Qu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[76] arXiv:2503.10704 (cross-list from cs.CV) [pdf, html, other]

Title: Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework

Jing Wang, Fengzhuo Zhang, Xiaoli Li, Vincent Y. F. Tan, Tianyu Pang, Chao Du, Aixin Sun, Zhuoran Yang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[77] arXiv:2503.11026 (cross-list from eess.AS) [pdf, html, other]

Title: MAVFlow: Preserving Paralinguistic Elements with Conditional Flow Matching for Zero-Shot AV2AV Multilingual Translation

Sungwoo Cho, Jeongsoo Choi, Sungnyun Kim, Se-Young Yun

Comments: Preliminary work

Subjects: Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[78] arXiv:2503.11190 (cross-list from cs.SD) [pdf, html, other]

Title: Cross-Modal Learning for Music-to-Music-Video Description Generation

Zhuoyuan Mao, Mengjie Zhao, Qiyu Wu, Zhi Zhong, Wei-Hsiang Liao, Hiromi Wakaki, Yuki Mitsufuji

Comments: Accepted by RepL4NLP 2025 @ NAACL 2025

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[79] arXiv:2503.11315 (cross-list from cs.CV) [pdf, html, other]

Title: MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens

Jeong Hun Yeo, Hyeongseop Rha, Se Jin Park, Yong Man Ro

Comments: The code and models are available this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[80] arXiv:2503.11609 (cross-list from cs.CV) [pdf, html, other]

Title: Rethinking Few-Shot Adaptation of Vision-Language Models in Two Stages

Matteo Farina, Massimiliano Mancini, Giovanni Iacca, Elisa Ricci

Comments: Camera-ready version for CVPR 2025 (w/ SuppMat, 23 pages)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[81] arXiv:2503.11629 (cross-list from cs.GR) [pdf, html, other]

Title: TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree Sequencing

Stefan Lionar, Jiabin Liang, Gim Hee Lee

Comments: CVPR 2025. Code: this https URL

Subjects: Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[82] arXiv:2503.12127 (cross-list from cs.CV) [pdf, html, other]

Title: Hyperbolic Safety-Aware Vision-Language Models

Tobia Poppi, Tejaswi Kasarla, Pascal Mettes, Lorenzo Baraldi, Rita Cucchiara

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[83] arXiv:2503.12149 (cross-list from cs.CL) [pdf, html, other]

Title: Seeing Sarcasm Through Different Eyes: Analyzing Multimodal Sarcasm Perception in Large Vision-Language Models

Junjie Chen, Xuyang Liu, Subin Huang, Linfeng Zhang, Hang Yu

Subjects: Computation and Language (cs.CL); Multimedia (cs.MM); Social and Information Networks (cs.SI)

[84] arXiv:2503.12173 (cross-list from cs.CV) [pdf, html, other]

Title: LAPIG: Language Guided Projector Image Generation with Surface Adaptation and Stylization

Yuchen Deng, Haibin Ling, Bingyao Huang

Comments: 12 pages, 9 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[85] arXiv:2503.12381 (cross-list from cs.CV) [pdf, html, other]

Title: Deepfake Detection with Optimized Hybrid Model: EAR Biometric Descriptor via Improved RCNN

Ruchika Sharma, Rudresh Dwivedi

Comments: Submiited to journal

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[86] arXiv:2503.12559 (cross-list from cs.CV) [pdf, html, other]

Title: AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding

Xiao Wang, Qingyi Si, Jianlong Wu, Shiyu Zhu, Li Cao, Liqiang Nie

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[87] arXiv:2503.12623 (cross-list from cs.LG) [pdf, html, other]

Title: MAVEN: Multi-modal Attention for Valence-Arousal Emotion Network

Vrushank Ahire, Kunal Shah, Mudasir Nazir Khan, Nikhil Pakhale, Lownish Rai Sookha, M. A. Ganaie, Abhinav Dhall

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[88] arXiv:2503.12799 (cross-list from cs.CV) [pdf, html, other]

Title: Grounded Chain-of-Thought for Multimodal Large Language Models

Qiong Wu, Xiangcong Yang, Yiyi Zhou, Chenxin Fang, Baiyang Song, Xiaoshuai Sun, Rongrong Ji

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[89] arXiv:2503.12852 (cross-list from cs.CV) [pdf, html, other]

Title: ACT360: An Efficient 360-Degree Action Detection and Summarization Framework for Mission-Critical Training and Debriefing

Aditi Tiwari, Klara Nahrstedt

Comments: 9 pages, 8 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[90] arXiv:2503.13434 (cross-list from cs.CV) [pdf, html, other]

Title: BlobCtrl: A Unified and Flexible Framework for Element-level Image Generation and Editing

Yaowei Li, Lingen Li, Zhaoyang Zhang, Xiaoyu Li, Guangzhi Wang, Hongxiang Li, Xiaodong Cun, Ying Shan, Yuexian Zou

Comments: Project Webpage: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[91] arXiv:2503.13443 (cross-list from cs.CV) [pdf, html, other]

Title: DPC: Dual-Prompt Collaboration for Tuning Vision-Language Models

Haoyang Li, Liang Wang, Chao Wang, Jing Jiang, Yan Peng, Guodong Long

Comments: Accepted by the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2025 (CVPR 2025)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[92] arXiv:2503.13805 (cross-list from cs.CV) [pdf, html, other]

Title: Text-Guided Image Invariant Feature Learning for Robust Image Watermarking

Muhammad Ahtesham, Xin Zhong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[93] arXiv:2503.13809 (cross-list from cs.ET) [pdf, html, other]

Title: The Immersive Archive: Archival Strategies for the Sensorama & Sutherland HMD

Zeynep Abes, Nathan Fairchild, Spencer Lin, Michael Wahba, Katrina Xiao, Scott S. Fisher

Journal-ref: Proc. IEEE Conf. AI & XR, 2025, pp. 307-312

Subjects: Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[94] arXiv:2503.14154 (cross-list from cs.CV) [pdf, html, other]

Title: RBFIM: Perceptual Quality Assessment for Compressed Point Clouds Using Radial Basis Function Interpolation

Zhang Chen, Shuai Wan, Siyu Ren, Fuzheng Yang, Mengting Yu, Junhui Hou

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[95] arXiv:2503.14220 (cross-list from cs.HC) [pdf, html, other]

Title: musicolors: Bridging Sound and Visuals For Synesthetic Creative Musical Experience

ChungHa Lee, Jin-Hyuk Hong

Comments: 16 pages, 2 figures, 1 table

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[96] arXiv:2503.14271 (cross-list from cs.NI) [pdf, html, other]

Title: Video Streaming with Kairos: An MPC-Based ABR with Streaming-Aware Throughput Prediction

Ziyu Zhong, Mufan Liu, Le Yang, Yifan Wang, Yiling Xu, Jenq-Neng Hwang

Subjects: Networking and Internet Architecture (cs.NI); Multimedia (cs.MM)

[97] arXiv:2503.14421 (cross-list from cs.CV) [pdf, html, other]

Title: ExDDV: A New Dataset for Explainable Deepfake Detection in Video

Vlad Hondru, Eduard Hogea, Darian Onchis, Radu Tudor Ionescu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[98] arXiv:2503.15001 (cross-list from cs.CV) [pdf, html, other]

Title: Low-Complexity Patch-based No-Reference Point Cloud Quality Metric exploiting Weighted Structure and Texture Features

Michael Neri, Federica Battisti

Comments: Accepted for publication in IEEE Transactions on Broadcasting. Code at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[99] arXiv:2503.15166 (cross-list from cs.CV) [pdf, html, other]

Title: Machine Unlearning in Hyperbolic vs. Euclidean Multimodal Contrastive Learning: Adapting Alignment Calibration to MERU

Àlex Pujol Vidal, Sergio Escalera, Kamal Nasrollahi, Thomas B. Moeslund

Comments: Preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[100] arXiv:2503.15498 (cross-list from cs.HC) [pdf, html, other]

Title: Revival: Collaborative Artistic Creation through Human-AI Interactions in Musical Creativity

Keon Ju M. Lee, Philippe Pasquier, Jun Yuri

Comments: Keon Ju M. Lee, Philippe Pasquier and Jun Yuri. 2024. In Proceedings of the Creativity and Generative AI NIPS (Neural Information Processing Systems) Workshop

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)