Multimedia

Authors and titles for November 2024

[51] arXiv:2411.06742 (cross-list from cs.NI) [pdf, other]

Title: Loss-tolerant neural video codec aware congestion control for real time video communication

Zhengxu Xia, Hanchen Li, Junchen Jiang

Subjects: Networking and Internet Architecture (cs.NI); Multimedia (cs.MM)

[52] arXiv:2411.06810 (cross-list from cs.AI) [pdf, html, other]

Title: JPEG AI Image Compression Visual Artifacts: Detection Methods and Dataset

Daria Tsereh, Mark Mirgaleev, Ivan Molodetskikh, Roman Kazantsev, Dmitriy Vatolin

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[53] arXiv:2411.06976 (cross-list from cs.CV) [pdf, html, other]

Title: A Hierarchical Compression Technique for 3D Gaussian Splatting Compression

He Huang, Wenjie Huang, Qi Yang, Yiling Xu, Zhu li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[54] arXiv:2411.07335 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Fusion Balancing Through Game-Theoretic Regularization

Konstantinos Kontras, Thomas Strypsteen, Christos Chatzichristos, Paul Pu Liang, Matthew Blaschko, Maarten De Vos

Comments: 21 pages, 6 figures, 4 tables, 1 algorithm

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computer Science and Game Theory (cs.GT); Multimedia (cs.MM)

[55] arXiv:2411.07428 (cross-list from cs.SD) [pdf, html, other]

Title: Just Label the Repeats for In-The-Wild Audio-to-Score Alignment

Irmak Bukey, Michael Feffer, Chris Donahue

Comments: 25th International Society for Music Information Retrieval Conference, San Francisco, 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[56] arXiv:2411.07650 (cross-list from cs.CV) [pdf, html, other]

Title: Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights

Ammarah Hashmi, Sahibzada Adil Shahzad, Chia-Wen Lin, Yu Tsao, Hsin-Min Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Image and Video Processing (eess.IV)

[57] arXiv:2411.07751 (cross-list from cs.SD) [pdf, html, other]

Title: SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model

Xinyuan Qian, Jiaran Gao, Yaodan Zhang, Qiquan Zhang, Hexin Liu, Leibny Paola Garcia, Haizhou Li

Comments: accepted by IEEE Journal of Selected Topics in Signal Processing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[58] arXiv:2411.07772 (cross-list from cs.LG) [pdf, html, other]

Title: Automatic Album Sequencing

Vincent Herrmann, Dylan R. Ashley, Jürgen Schmidhuber

Comments: presented as a late breaking demo in the 25th International Society for Music Information Retrieval Conference; 3 pages in main text + 1 page of references, 3 figures in main text; source code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[59] arXiv:2411.08307 (cross-list from cs.AI) [pdf, html, other]

Title: PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation

Yungang Yi, Weihua Li, Matthew Kuo, Quan Bai

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2411.08334 (cross-list from cs.CV) [pdf, html, other]

Title: MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrieval

Yeong-Joon Ju, Ho-Joong Kim, Seong-Whan Lee

Comments: preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Multimedia (cs.MM)

[61] arXiv:2411.08409 (cross-list from cs.AI) [pdf, other]

Title: DiVR: incorporating context from diverse VR scenes for human trajectory prediction

Franz Franco Gallo (BIOVISION), Hui-Yin Wu (BIOVISION), Lucile Sassatelli (UniCA, IUF)

Journal-ref: European Conf. on Computer Vision (ECCV) CV4Metaverse workshop, Sep 2024, Milano, Italy

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[62] arXiv:2411.09053 (cross-list from cs.IR) [pdf, html, other]

Title: Information Need in Metaverse Recordings -- A Field Study

Patrick Steinert, Jan Mischkies, Stefan Wagenpfeil, Ingo Frommholz, Matthias L. Hemmje

Comments: 12 pages, 3 Figures, 8 Tables

Subjects: Information Retrieval (cs.IR); Multimedia (cs.MM)

[63] arXiv:2411.09266 (cross-list from cs.CV) [pdf, html, other]

Title: How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception

Sahibzada Adil Shahzad, Ammarah Hashmi, Yan-Tsung Peng, Yu Tsao, Hsin-Min Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

[64] arXiv:2411.09952 (cross-list from cs.CV) [pdf, html, other]

Title: GGAvatar: Reconstructing Garment-Separated 3D Gaussian Splatting Avatars from Monocular Video

Jingxuan Chen

Comments: MMAsia'24 Accepted

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[65] arXiv:2411.09955 (cross-list from cs.CV) [pdf, html, other]

Title: Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era

Thanh Tam Nguyen, Zhao Ren, Trinh Pham, Thanh Trung Huynh, Phi Le Nguyen, Hongzhi Yin, Quoc Viet Hung Nguyen

Comments: Fixed a serious error in author information

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

[66] arXiv:2411.10034 (cross-list from cs.CR) [pdf, html, other]

Title: EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations

Jung-Woo Chang, Ke Sun, David Xia, Xinyu Zhang, Farinaz Koushanfar

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2411.10231 (cross-list from cs.CV) [pdf, html, other]

Title: A Low-Resolution Image is Worth 1x1 Words: Enabling Fine Image Super-Resolution with Transformers and TaylorShift

Sanath Budakegowdanadoddi Nagaraju, Brian Bernhard Moser, Tobias Christian Nauen, Stanislav Frolov, Federico Raue, Andreas Dengel

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[68] arXiv:2411.10436 (cross-list from cs.CL) [pdf, html, other]

Title: Mitigating Hallucination in Multimodal Large Language Model via Hallucination-targeted Direct Preference Optimization

Yuhan Fu, Ruobing Xie, Xingwu Sun, Zhanhui Kang, Xirong Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[69] arXiv:2411.10480 (cross-list from cs.CV) [pdf, html, other]

Title: Hateful Meme Detection through Context-Sensitive Prompting and Fine-Grained Labeling

Rongxin Ouyang, Kokil Jaidka, Subhayan Mukerjee, Guangyu Cui

Comments: AAAI-25 Student Abstract, Oral Presentation

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[70] arXiv:2411.10513 (cross-list from cs.CV) [pdf, html, other]

Title: Any2Any: Incomplete Multimodal Retrieval with Conformal Prediction

Po-han Li, Yunhao Yang, Mohammad Omama, Sandeep Chinchali, Ufuk Topcu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM)

[71] arXiv:2411.10775 (cross-list from eess.IV) [pdf, html, other]

Title: Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

Kepeng Xu, Li Xu, Gang He, Zhiqiang Zhang, Wenxin Yu, Shihao Wang, Dajiang Zhou, Yunsong Li

Comments: 8 pages,4 figures

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[72] arXiv:2411.11222 (cross-list from cs.CV) [pdf, other]

Title: The Sound of Water: Inferring Physical Properties from Pouring Liquids

Piyush Bagad, Makarand Tapaswi, Cees G. M. Snoek, Andrew Zisserman

Comments: Project page at this https URL. Short version accepted to ICASSP 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2411.11278 (cross-list from cs.CV) [pdf, html, other]

Title: Towards Open-Vocabulary Audio-Visual Event Localization

Jinxing Zhou, Dan Guo, Ruohao Guo, Yuxin Mao, Jingjing Hu, Yiran Zhong, Xiaojun Chang, Meng Wang

Comments: accepted by CVPR 2025; Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[74] arXiv:2411.11688 (cross-list from cs.CR) [pdf, html, other]

Title: Conceptwm: A Diffusion Model Watermark for Concept Protection

Liangqi Lei, Keke Gai, Jing Yu, Liehuang Zhu, Qi Wu

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[75] arXiv:2411.12008 (cross-list from cs.SD) [pdf, html, other]

Title: Compression of Higher Order Ambisonics with Multichannel RVQGAN

Toni Hirvonen, Mahmoud Namazi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)