Multimedia

Authors and titles for November 2024

[76] arXiv:2411.12072 (cross-list from cs.CV) [pdf, html, other]

Title: Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution

Brian B. Moser, Stanislav Frolov, Tobias C. Nauen, Federico Raue, Andreas Dengel

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[77] arXiv:2411.12197 (cross-list from cs.CV) [pdf, html, other]

Title: MTFusion: Reconstructing Any 3D Object from Single Image Using Multi-word Textual Inversion

Yu Liu, Ruowei Wang, Jiaqi Li, Zixiang Xu, Qijun Zhao

Comments: PRCV 2024

Journal-ref: Pattern Recognition and Computer Vision (2025), Springer Nature Singapore, pages 166-180, ISBN 978-981-97-8508-7

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[78] arXiv:2411.12293 (cross-list from cs.CV) [pdf, html, other]

Title: Generative Timelines for Instructed Visual Assembly

Alejandro Pardo, Jui-Hsien Wang, Bernard Ghanem, Josef Sivic, Bryan Russell, Fabian Caba Heilbron

Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[79] arXiv:2411.12776 (cross-list from eess.IV) [pdf, html, other]

Title: Cross-Layer Encrypted Semantic Communication Framework for Panoramic Video Transmission

Haixiao Gao, Mengying Sun, Xiaodong Xu, Bingxuan Xu, Shujun Han, Bizhu Wang, Sheng Jiang, Chen Dong, Ping Zhang

Subjects: Image and Video Processing (eess.IV); Cryptography and Security (cs.CR); Multimedia (cs.MM)

[80] arXiv:2411.13281 (cross-list from cs.CV) [pdf, html, other]

Title: VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation

Ziyang Luo, Haoning Wu, Dongxu Li, Jing Ma, Mohan Kankanhalli, Junnan Li

Comments: CVPR 2025, Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[81] arXiv:2411.13536 (cross-list from cs.CV) [pdf, html, other]

Title: Identity Preserving 3D Head Stylization with Multiview Score Distillation

Bahri Batuhan Bilecen, Ahmet Berke Gokmen, Furkan Guzelant, Aysegul Dundar

Comments: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM)

[82] arXiv:2411.13577 (cross-list from eess.AS) [pdf, html, other]

Title: WavChat: A Survey of Spoken Dialogue Models

Shengpeng Ji, Yifu Chen, Minghui Fang, Jialong Zuo, Jingyu Lu, Hanting Wang, Ziyue Jiang, Long Zhou, Shujie Liu, Xize Cheng, Xiaoda Yang, Zehan Wang, Qian Yang, Jian Li, Yidi Jiang, Jingzhen He, Yunfei Chu, Jin Xu, Zhou Zhao

Comments: 60 papes, working in progress

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)

[83] arXiv:2411.13811 (cross-list from cs.SD) [pdf, html, other]

Title: X-CrossNet: A complex spectral mapping approach to target speaker extraction with cross attention speaker embedding fusion

Chang Sun, Bo Qin

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[84] arXiv:2411.13819 (cross-list from cs.CR) [pdf, html, other]

Title: Robust Steganography with Boundary-Preserving Overflow Alleviation and Adaptive Error Correction

Yu Cheng, Zhenlin Luo, Zhaoxia Yin

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM)

[85] arXiv:2411.14135 (cross-list from eess.IV) [pdf, html, other]

Title: Compact Visual Data Representation for Green Multimedia -- A Human Visual System Perspective

Peilin Chen, Xiaohan Fang, Meng Wang, Shiqi Wang, Siwei Ma

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[86] arXiv:2411.14207 (cross-list from cs.SD) [pdf, html, other]

Title: HARP: A Large-Scale Higher-Order Ambisonic Room Impulse Response Dataset

Shivam Saini, Jürgen Peissig

Comments: Accepted at ICASSP 2025 Workshop. Code to generate uploaded at: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[87] arXiv:2411.14627 (cross-list from cs.SD) [pdf, html, other]

Title: Generative AI for Music and Audio

Hao-Wen Dong

Comments: PhD Dissertation

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[88] arXiv:2411.15128 (cross-list from cs.LG) [pdf, html, other]

Title: Health AI Developer Foundations

Atilla P. Kiraly, Sebastien Baur, Kenneth Philbrick, Fereshteh Mahvar, Liron Yatziv, Tiffany Chen, Bram Sterling, Nick George, Fayaz Jamil, Jing Tang, Kai Bailey, Faruk Ahmed, Akshay Goel, Abbi Ward, Lin Yang, Andrew Sellergren, Yossi Matias, Avinatan Hassidim, Shravya Shetty, Daniel Golden, Shekoofeh Azizi, David F. Steiner, Yun Liu, Tim Thelin, Rory Pilgrim, Can Kirmizibayrak

Comments: 16 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[89] arXiv:2411.15457 (cross-list from cs.SD) [pdf, html, other]

Title: Hindi audio-video-Deepfake (HAV-DF): A Hindi language-based Audio-video Deepfake Dataset

Sukhandeep Kaur, Mubashir Buhari, Naman Khandelwal, Priyansh Tyagi, Kiran Sharma

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[90] arXiv:2411.16096 (cross-list from cs.CV) [pdf, html, other]

Title: ENCLIP: Ensembling and Clustering-Based Contrastive Language-Image Pretraining for Fashion Multimodal Search with Limited Data and Low-Quality Images

Prithviraj Purushottam Naik, Rohit Agarwal

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[91] arXiv:2411.16729 (cross-list from cs.SD) [pdf, html, other]

Title: DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2

Fan Zhang, Siyuan Zhao, Naye Ji, Zhaohan Wang, Jingmei Wu, Fuxing Gao, Zhenqing Ye, Leyao Yan, Lanxin Dai, Weidong Geng, Xin Lyu, Bozuo Zhao, Dingguo Yu, Hui Du, Bin Hu

Comments: 13 pages, 11 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Graphics (cs.GR); Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[92] arXiv:2411.16750 (cross-list from cs.CV) [pdf, html, other]

Title: PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation

Ziyao Zeng, Jingcheng Ni, Daniel Wang, Patrick Rim, Younjoon Chung, Fengyu Yang, Byung-Woo Hong, Alex Wong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[93] arXiv:2411.16863 (cross-list from cs.CV) [pdf, html, other]

Title: Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering

Federico Cocchi, Nicholas Moratelli, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[94] arXiv:2411.16946 (cross-list from cs.CV) [pdf, html, other]

Title: Lens Distortion Encoding System Version 1.0

Jakub Maksymilian Fober

Comments: 8 pages, 1 figure, 2 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)

[95] arXiv:2411.17440 (cross-list from cs.CV) [pdf, html, other]

Title: Identity-Preserving Text-to-Video Generation by Frequency Decomposition

Shenghai Yuan, Jinfa Huang, Xianyi He, Yunyuan Ge, Yujun Shi, Liuhan Chen, Jiebo Luo, Li Yuan

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[96] arXiv:2411.17698 (cross-list from cs.CV) [pdf, html, other]

Title: Video-Guided Foley Sound Generation with Multimodal Controls

Ziyang Chen, Prem Seetharaman, Bryan Russell, Oriol Nieto, David Bourgin, Andrew Owens, Justin Salamon

Comments: Accepted at CVPR 2025. Project site: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2411.17776 (cross-list from cs.CV) [pdf, html, other]

Title: Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Search

Shuyu Yang, Yaxiong Wang, Li Zhu, Zhedong Zheng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[98] arXiv:2411.18855 (cross-list from cs.CV) [pdf, html, other]

Title: Improving Accuracy and Generalization for Efficient Visual Tracking

Ram Zaveri, Shivang Patel, Yu Gu, Gianfranco Doretto

Comments: WACV 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[99] arXiv:2411.18966 (cross-list from cs.CV) [pdf, html, other]

Title: SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors

Rui Xu, Wenyue Chen, Jiepeng Wang, Yuan Liu, Peng Wang, Lin Gao, Shiqing Xin, Taku Komura, Xin Li, Wenping Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)

[100] arXiv:2411.19220 (cross-list from cs.CV) [pdf, html, other]

Title: Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection

Tsun-Hin Cheung, Ka-Chun Fung, Songjiang Lai, Kwan-Ho Lin, Vincent Ng, Kin-Man Lam

Comments: Accepted to APSIPA ASC 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[101] arXiv:2411.19537 (cross-list from cs.CV) [pdf, html, other]

Title: Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook

Florinel-Alin Croitoru, Andrei-Iulian Hiji, Vlad Hondru, Nicolae Catalin Ristea, Paul Irofti, Marius Popescu, Cristian Rusu, Radu Tudor Ionescu, Fahad Shahbaz Khan, Mubarak Shah

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[102] arXiv:2411.19628 (cross-list from cs.CV) [pdf, html, other]

Title: Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings

Qiong Wu, Wenhao Lin, Weihao Ye, Yiyi Zhou, Xiaoshuai Sun, Rongrong Ji

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[103] arXiv:2411.19730 (cross-list from cs.PF) [pdf, html, other]

Title: Ten Ways in which Virtual Reality Differs from Video Streaming

Gustavo de Veciana, Sonia Fahmy, George Kesidis, Voicu Popescu

Subjects: Performance (cs.PF); Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[104] arXiv:2411.19772 (cross-list from cs.CV) [pdf, html, other]

Title: LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos

Tiantian Geng, Jinrui Zhang, Qingni Wang, Teng Wang, Jinming Duan, Feng Zheng

Comments: Accepted by CVPR2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)