Multimedia

Authors and titles for November 2024

[1] arXiv:2411.00813 [pdf, html, other]

Title: Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

Sixu An, Xiangguo Sun, Yicong Li, Yu Yang, Guandong Xu

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Audio and Speech Processing (eess.AS)

[2] arXiv:2411.01561 [pdf, html, other]

Title: Multimodal Graph Neural Network for Recommendation with Dynamic De-redundancy and Modality-Guided Feature De-noisy

Feng Mo, Lin Xiao, Qiya Song, Xieping Gao, Eryao Liang

Subjects: Multimedia (cs.MM); Information Retrieval (cs.IR)

[3] arXiv:2411.02851 [pdf, html, other]

Title: Learning to Unify Audio, Visual and Text for Audio-Enhanced Multilingual Visual Answer Localization

Zhibin Wen, Bin Li

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

[4] arXiv:2411.03010 [pdf, html, other]

Title: Learning-based Lossless Event Data Compression

Ahmadreza Sezavar, Catarina Brites, Joao Ascenso

Subjects: Multimedia (cs.MM)

[5] arXiv:2411.03595 [pdf, html, other]

Title: Investigating Conceptual Blending of a Diffusion Model for Improving Nonword-to-Image Generation

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide

Comments: Paper accepted at ACM MM 2024 (doi: https://doi.org/10.1145/3664647.3681202) with supplementary materials concatenated

Subjects: Multimedia (cs.MM)

[6] arXiv:2411.03921 [pdf, html, other]

Title: Inter-Frame Coding for Dynamic Meshes via Coarse-to-Fine Anchor Mesh Generation

He Huang, Lizhi Hou, Qi Yang, Yiling Xu

Subjects: Multimedia (cs.MM)

[7] arXiv:2411.05295 [pdf, html, other]

Title: Content-Adaptive Rate-Quality Curve Prediction Model in Media Processing System

Shibo Yin, Zhiyu Zhang, Peirong Ning, Qiubo Chen, Jing Chen, Quan Zhou, Li Song

Comments: Accepted by IEEE VCIP 2024 (Oral)

Subjects: Multimedia (cs.MM)

[8] arXiv:2411.05322 [pdf, html, other]

Title: Rate-aware Compression for NeRF-based Volumetric Video

Zhiyu Zhang, Guo Lu, Huanxiong Liang, Zhengxue Cheng, Anni Tang, Li Song

Comments: Accepted by ACM MM 2024 (Oral)

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[9] arXiv:2411.05374 [pdf, html, other]

Title: Interdisciplinary Translations: Sensory Perception as a Universal Language

Xindi Kang, Xuanyang Huang, Mingdong Song, Varvara Guljajeva, JoAnn Kuchera-Morin

Comments: This paper has been accepted to the International Symposium of Electronic Arts 2024, and the proceedings version will be available at this https URL with DOI to be added once published

Subjects: Multimedia (cs.MM)

[10] arXiv:2411.05794 [pdf, html, other]

Title: Beyond Correlation: Evaluating Multimedia Quality Models with the Constrained Concordance Index

Alessandro Ragano, Helard Becerra Martinez, Andrew Hines

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[11] arXiv:2411.05854 [pdf, other]

Title: Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators

Claire Wonjeong Jo, Miki Wesołowska, Magdalena Wojcieszak

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[12] arXiv:2411.07155 [pdf, html, other]

Title: Low Complexity Learning-based Lossless Event-based Compression

Ahmadreza Sezavar, Catarina Brites, Joao Ascenso

Subjects: Multimedia (cs.MM)

[13] arXiv:2411.07539 [pdf, html, other]

Title: Harmonizing Pixels and Melodies: Maestro-Guided Film Score Generation and Composition Style Transfer

F. Qi, L. Ni, C. Xu

Subjects: Multimedia (cs.MM)

[14] arXiv:2411.07899 [pdf, html, other]

Title: Rendering-Oriented 3D Point Cloud Attribute Compression using Sparse Tensor-based Transformer

Xiao Huo, Junhui Hou, Shuai Wan, Fuzheng Yang

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[15] arXiv:2411.08730 [pdf, other]

Title: 3D Modelling to Address Pandemic Challenges: A Project-Based Learning Methodology

Tânia Rocha, Ana Ribeiro, Joana Oliveira, Ricardo Nunes, Diana Carvalho, Hugo Paredes, Paulo Martins

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[16] arXiv:2411.08882 [pdf, html, other]

Title: A Novel Multimodal System to Predict Agitation in People with Dementia Within Clinical Settings: A Proof of Concept

Abeer Badawi, Somayya Elmoghazy, Samira Choudhury, Sara Elgazzar, Khalid Elgazzar, Amer Burhan

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[17] arXiv:2411.08885 [pdf, html, other]

Title: Enhancing Lie Detection Accuracy: A Comparative Study of Classic ML, CNN, and GCN Models using Audio-Visual Features

Abdelrahman Abdelwahab, Akshaj Vishnubhatla, Ayaan Vaswani, Advait Bharathulwar, Arnav Kommaraju

Comments: 11 pages, 18 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[18] arXiv:2411.10060 [pdf, html, other]

Title: CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversation

Xiaofei Zhu, Jiawei Cheng, Zhou Yang, Zhuo Chen, Qingyang Wang, Jianfeng Yao

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL)

[19] arXiv:2411.12825 [pdf, html, other]

Title: TopoCode: Topologically Informed Error Detection and Correction in Communication Systems

Hongzhi Guo

Subjects: Multimedia (cs.MM)

[20] arXiv:2411.12907 [pdf, html, other]

Title: Narrative Information Theory

Lion Schulz, Miguel Patrício, Daan Odijk

Comments: To be published in NeurIPS 2024 Workshop on Creativity & Generative AI. 7 pages, 3 figures

Subjects: Multimedia (cs.MM); Information Theory (cs.IT)

[21] arXiv:2411.13917 [pdf, html, other]

Title: SpikEmo: Enhancing Emotion Recognition With Spiking Temporal Dynamics in Conversations

Xiaomin Yu, Feiyang Wang, Ziyue Qiao

Subjects: Multimedia (cs.MM)

[22] arXiv:2411.14613 [pdf, other]

Title: Optimal Transcoding Preset Selection for Live Video Streaming

Zahra Nabizadeh, Maedeh Jamali, Nader Karimi, Shadrokh Samavi, Shahram Shirani

Comments: 23 pages, 10 figures

Subjects: Multimedia (cs.MM)

[23] arXiv:2411.15447 [pdf, html, other]

Title: Gotta Hear Them All: Sound Source Aware Vision to Audio Generation

Wei Guo, Heng Wang, Jianbo Ma, Weidong Cai

Comments: 18 pages, 13 figures, source code available at this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[24] arXiv:2411.15455 [pdf, html, other]

Title: MUFM: A Mamba-Enhanced Feedback Model for Micro Video Popularity Prediction

Jiacheng Lu, Mingyuan Xiao, Weijian Wang, Yuxin Du, Yi Cui, Jingnan Zhao, Cheng Hua

Comments: 14 pages,9 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[25] arXiv:2411.15759 [pdf, html, other]

Title: Advanced Learning-Based Inter Prediction for Future Video Coding

Yanchen Zhao, Wenhong Duan, Chuanmin Jia, Shanshe Wang, Siwei Ma

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[26] arXiv:2411.15801 [pdf, html, other]

Title: A review on Machine Learning based User-Centric Multimedia Streaming Techniques

Monalisa Ghosh, Chetna Singhal

Comments: Computer Communications

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[27] arXiv:2411.16331 [pdf, html, other]

Title: Sonic: Shifting Focus to Global Audio Perception in Portrait Animation

Xiaozhong Ji, Xiaobin Hu, Zhihong Xu, Junwei Zhu, Chuming Lin, Qingdong He, Jiangning Zhang, Donghao Luo, Yi Chen, Qin Lin, Qinglin Lu, Chengjie Wang

Comments: refer to our main-page \url{this https URL}

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[28] arXiv:2411.16885 [pdf, other]

Title: Fully Automatic Content-Aware Tiling Pipeline for Pathology Whole Slide Images

Falah Jabar, Lill-Tove Rasmussen Busund, Biagio Ricciuti, Masoud Tafavvoghi, Mette Pøhl, Sigve Andersen, Tom Donnem, David J. Kwiatkowski, Mehrdad Rakaee

Comments: Submitted to Medical Image Analysis journal, February 2025

Subjects: Multimedia (cs.MM)

[29] arXiv:2411.17690 [pdf, html, other]

Title: Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis

Akshita Gupta, Tatiana Likhomanenko, Karren Dai Yang, Richard He Bai, Zakaria Aldeneh, Navdeep Jaitly

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[30] arXiv:2411.17704 [pdf, other]

Title: Racism in the Machine: Visualization Ethics in Digital Humanities Projects

K.J. Hepworth, Christopher Church

Subjects: Multimedia (cs.MM)

[31] arXiv:2411.18372 [pdf, html, other]

Title: Uncertainty-driven Sampling for Efficient Pairwise Comparison Subjective Assessment

Shima Mohammadi, João Ascenso

Comments: 10 Pages, 7 Figures, Accepted at IEEE Transactions on Multimedia

Subjects: Multimedia (cs.MM)

[32] arXiv:2411.19522 [pdf, html, other]

Title: Subjective and Objective Quality Assessment Methods of Stereoscopic Videos with Visibility Affecting Distortions

Sria Biswas, Balasubramanyam Appina, Priyanka Kokil, Sumohana S Channappayya

Comments: 13 pages

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[33] arXiv:2411.00304 (cross-list from cs.CV) [pdf, html, other]

Title: Unified Generative and Discriminative Training for Multi-modal Large Language Models

Wei Chow, Juncheng Li, Qifan Yu, Kaihang Pan, Hao Fei, Zhiqi Ge, Shuai Yang, Siliang Tang, Hanwang Zhang, Qianru Sun

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[34] arXiv:2411.00831 (cross-list from cs.CV) [pdf, html, other]

Title: Saliency-Based diversity and fairness Metric and FaceKeepOriginalAugment: A Novel Approach for Enhancing Fairness and Diversity

Teerath Kumar, Alessandra Mileo, Malika Bendechache

Comments: Paper is underReview in Image and Vision Computing Journal special issue: Advancing Transparency and Privacy: Explainable AI and Synthetic Data in Biometrics and Computer Vision

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[35] arXiv:2411.01805 (cross-list from cs.SD) [pdf, html, other]

Title: MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence

Fuming You, Minghui Fang, Li Tang, Rongjie Huang, Yongqi Wang, Zhou Zhao

Comments: NeurIPS 2024

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[36] arXiv:2411.02236 (cross-list from cs.CV) [pdf, html, other]

Title: 3D Audio-Visual Segmentation

Artem Sokolov, Swapnil Bhosale, Xiatian Zhu

Comments: Accepted at the NeurIPS 2024 Workshop on Audio Imagination

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[37] arXiv:2411.02334 (cross-list from cs.IT) [pdf, html, other]

Title: Diffusion-based Generative Multicasting with Intent-aware Semantic Decomposition

Xinkai Liu, Mahdi Boloursaz Mashhadi, Li Qiao, Yi Ma, Rahim Tafazolli, Mehdi Bennis

Subjects: Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Signal Processing (eess.SP)

[38] arXiv:2411.02551 (cross-list from cs.SD) [pdf, html, other]

Title: PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text

Hayeon Bang, Eunjin Choi, Megan Finch, Seungheon Doh, Seolhee Lee, Gyeong-Hoon Lee, Juhan Nam

Comments: Accepted for publication at the 3rd Workshop on NLP for Music and Audio (NLP4MusA 2024)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[39] arXiv:2411.02607 (cross-list from cs.HC) [pdf, html, other]

Title: Towards Context-Aware Adaptation in Extended Reality: A Design Space for XR Interfaces and an Adaptive Placement Strategy

Shakiba Davari, Doug A. Bowman

Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY); Graphics (cs.GR); Information Retrieval (cs.IR); Multimedia (cs.MM)

[40] arXiv:2411.02860 (cross-list from cs.CV) [pdf, html, other]

Title: Continual Audio-Visual Sound Separation

Weiguo Pian, Yiyang Nan, Shijian Deng, Shentong Mo, Yunhui Guo, Yapeng Tian

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[41] arXiv:2411.03034 (cross-list from cs.AI) [pdf, html, other]

Title: HumanVLM: Foundation for Human-Scene Vision-Language Model

Dawei Dai, Xu Long, Li Yutang, Zhang Yuanhui, Shuyin Xia

Comments: 34 pages,11 figures

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[42] arXiv:2411.03085 (cross-list from cs.SD) [pdf, html, other]

Title: Speech Separation with Pretrained Frontend to Minimize Domain Mismatch

Wupeng Wang, Zexu Pan, Xinke Li, Shuai Wang, Haizhou Li

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Journal-ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing.32(2024)4184-4198

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[43] arXiv:2411.03109 (cross-list from cs.SD) [pdf, html, other]

Title: pTSE-T: Presentation Target Speaker Extraction using Unaligned Text Cues

Ziyang Jiang, Xinyuan Qian, Jiahe Lei, Zexu Pan, Wei Xue, Xu-cheng Yin

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[44] arXiv:2411.03823 (cross-list from cs.CV) [pdf, html, other]

Title: Both Text and Images Leaked! A Systematic Analysis of Multimodal LLM Data Contamination

Dingjie Song, Sicheng Lai, Shunian Chen, Lichao Sun, Benyou Wang

Comments: Code Available: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[45] arXiv:2411.03948 (cross-list from cs.SD) [pdf, html, other]

Title: Long-Form Text-to-Music Generation with Adaptive Prompts: A Case of Study in Tabletop Role-Playing Games Soundtracks

Felipe Marra, Lucas N. Ferreira

Comments: Paper accepted at the LAMIR 2024 workshop

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[46] arXiv:2411.04366 (cross-list from cs.SD) [pdf, html, other]

Title: The Concatenator: A Bayesian Approach To Real Time Concatenative Musaicing

Christopher Tralie, Ben Cantil

Comments: 12 pages, 6 figures, Accepted for Publication in The International Society for Music Information Retrieval Proceedings, 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[47] arXiv:2411.04517 (cross-list from cs.LG) [pdf, other]

Title: Continuous Sign Language Recognition System using Deep Learning with MediaPipe Holistic

Sharvani Srivastava, Sudhakar Singh, Pooja, Shiv Prakash

Comments: 14 pages, 4 figures, Wireless Pers Commun

Journal-ref: Wireless Personal Communication, 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[48] arXiv:2411.04859 (cross-list from cs.CV) [pdf, html, other]

Title: A multi-purpose automatic editing system based on lecture semantics for remote education

Panwen Hu, Rui Huang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[49] arXiv:2411.05715 (cross-list from cs.SD) [pdf, html, other]

Title: On the Role of Noise in AudioVisual Integration: Evidence from Artificial Neural Networks that Exhibit the McGurk Effect

Lukas Grasse, Matthew S. Tata

Subjects: Sound (cs.SD); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[50] arXiv:2411.05832 (cross-list from cs.CV) [pdf, html, other]

Title: Diversify, Contextualize, and Adapt: Efficient Entropy Modeling for Neural Image Codec

Jun-Hyuk Kim, Seungeon Kim, Won-Hee Lee, Dokwan Oh

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[51] arXiv:2411.06742 (cross-list from cs.NI) [pdf, other]

Title: Loss-tolerant neural video codec aware congestion control for real time video communication

Zhengxu Xia, Hanchen Li, Junchen Jiang

Subjects: Networking and Internet Architecture (cs.NI); Multimedia (cs.MM)

[52] arXiv:2411.06810 (cross-list from cs.AI) [pdf, html, other]

Title: JPEG AI Image Compression Visual Artifacts: Detection Methods and Dataset

Daria Tsereh, Mark Mirgaleev, Ivan Molodetskikh, Roman Kazantsev, Dmitriy Vatolin

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[53] arXiv:2411.06976 (cross-list from cs.CV) [pdf, html, other]

Title: A Hierarchical Compression Technique for 3D Gaussian Splatting Compression

He Huang, Wenjie Huang, Qi Yang, Yiling Xu, Zhu li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[54] arXiv:2411.07335 (cross-list from cs.LG) [pdf, html, other]

Title: Multimodal Fusion Balancing Through Game-Theoretic Regularization

Konstantinos Kontras, Thomas Strypsteen, Christos Chatzichristos, Paul Pu Liang, Matthew Blaschko, Maarten De Vos

Comments: 21 pages, 6 figures, 4 tables, 1 algorithm

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computer Science and Game Theory (cs.GT); Multimedia (cs.MM)

[55] arXiv:2411.07428 (cross-list from cs.SD) [pdf, html, other]

Title: Just Label the Repeats for In-The-Wild Audio-to-Score Alignment

Irmak Bukey, Michael Feffer, Chris Donahue

Comments: 25th International Society for Music Information Retrieval Conference, San Francisco, 2024

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[56] arXiv:2411.07650 (cross-list from cs.CV) [pdf, html, other]

Title: Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights

Ammarah Hashmi, Sahibzada Adil Shahzad, Chia-Wen Lin, Yu Tsao, Hsin-Min Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Image and Video Processing (eess.IV)

[57] arXiv:2411.07751 (cross-list from cs.SD) [pdf, html, other]

Title: SAV-SE: Scene-aware Audio-Visual Speech Enhancement with Selective State Space Model

Xinyuan Qian, Jiaran Gao, Yaodan Zhang, Qiquan Zhang, Hexin Liu, Leibny Paola Garcia, Haizhou Li

Comments: accepted by IEEE Journal of Selected Topics in Signal Processing

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[58] arXiv:2411.07772 (cross-list from cs.LG) [pdf, html, other]

Title: Automatic Album Sequencing

Vincent Herrmann, Dylan R. Ashley, Jürgen Schmidhuber

Comments: presented as a late breaking demo in the 25th International Society for Music Information Retrieval Conference; 3 pages in main text + 1 page of references, 3 figures in main text; source code available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[59] arXiv:2411.08307 (cross-list from cs.AI) [pdf, html, other]

Title: PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation

Yungang Yi, Weihua Li, Matthew Kuo, Quan Bai

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[60] arXiv:2411.08334 (cross-list from cs.CV) [pdf, html, other]

Title: MIRe: Enhancing Multimodal Queries Representation via Fusion-Free Modality Interaction for Multimodal Retrieval

Yeong-Joon Ju, Ho-Joong Kim, Seong-Whan Lee

Comments: preprint

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Multimedia (cs.MM)

[61] arXiv:2411.08409 (cross-list from cs.AI) [pdf, other]

Title: DiVR: incorporating context from diverse VR scenes for human trajectory prediction

Franz Franco Gallo (BIOVISION), Hui-Yin Wu (BIOVISION), Lucile Sassatelli (UniCA, IUF)

Journal-ref: European Conf. on Computer Vision (ECCV) CV4Metaverse workshop, Sep 2024, Milano, Italy

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[62] arXiv:2411.09053 (cross-list from cs.IR) [pdf, html, other]

Title: Information Need in Metaverse Recordings -- A Field Study

Patrick Steinert, Jan Mischkies, Stefan Wagenpfeil, Ingo Frommholz, Matthias L. Hemmje

Comments: 12 pages, 3 Figures, 8 Tables

Subjects: Information Retrieval (cs.IR); Multimedia (cs.MM)

[63] arXiv:2411.09266 (cross-list from cs.CV) [pdf, html, other]

Title: How Good is ChatGPT at Audiovisual Deepfake Detection: A Comparative Study of ChatGPT, AI Models and Human Perception

Sahibzada Adil Shahzad, Ammarah Hashmi, Yan-Tsung Peng, Yu Tsao, Hsin-Min Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

[64] arXiv:2411.09952 (cross-list from cs.CV) [pdf, html, other]

Title: GGAvatar: Reconstructing Garment-Separated 3D Gaussian Splatting Avatars from Monocular Video

Jingxuan Chen

Comments: MMAsia'24 Accepted

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[65] arXiv:2411.09955 (cross-list from cs.CV) [pdf, html, other]

Title: Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era

Thanh Tam Nguyen, Zhao Ren, Trinh Pham, Thanh Trung Huynh, Phi Le Nguyen, Hongzhi Yin, Quoc Viet Hung Nguyen

Comments: Fixed a serious error in author information

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

[66] arXiv:2411.10034 (cross-list from cs.CR) [pdf, html, other]

Title: EveGuard: Defeating Vibration-based Side-Channel Eavesdropping with Audio Adversarial Perturbations

Jung-Woo Chang, Ke Sun, David Xia, Xinyu Zhang, Farinaz Koushanfar

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[67] arXiv:2411.10231 (cross-list from cs.CV) [pdf, html, other]

Title: A Low-Resolution Image is Worth 1x1 Words: Enabling Fine Image Super-Resolution with Transformers and TaylorShift

Sanath Budakegowdanadoddi Nagaraju, Brian Bernhard Moser, Tobias Christian Nauen, Stanislav Frolov, Federico Raue, Andreas Dengel

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[68] arXiv:2411.10436 (cross-list from cs.CL) [pdf, html, other]

Title: Mitigating Hallucination in Multimodal Large Language Model via Hallucination-targeted Direct Preference Optimization

Yuhan Fu, Ruobing Xie, Xingwu Sun, Zhanhui Kang, Xirong Li

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[69] arXiv:2411.10480 (cross-list from cs.CV) [pdf, html, other]

Title: Hateful Meme Detection through Context-Sensitive Prompting and Fine-Grained Labeling

Rongxin Ouyang, Kokil Jaidka, Subhayan Mukerjee, Guangyu Cui

Comments: AAAI-25 Student Abstract, Oral Presentation

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[70] arXiv:2411.10513 (cross-list from cs.CV) [pdf, html, other]

Title: Any2Any: Incomplete Multimodal Retrieval with Conformal Prediction

Po-han Li, Yunhao Yang, Mohammad Omama, Sandeep Chinchali, Ufuk Topcu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM)

[71] arXiv:2411.10775 (cross-list from eess.IV) [pdf, html, other]

Title: Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

Kepeng Xu, Li Xu, Gang He, Zhiqiang Zhang, Wenxin Yu, Shihao Wang, Dajiang Zhou, Yunsong Li

Comments: 8 pages,4 figures

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[72] arXiv:2411.11222 (cross-list from cs.CV) [pdf, other]

Title: The Sound of Water: Inferring Physical Properties from Pouring Liquids

Piyush Bagad, Makarand Tapaswi, Cees G. M. Snoek, Andrew Zisserman

Comments: Project page at this https URL. Short version accepted to ICASSP 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[73] arXiv:2411.11278 (cross-list from cs.CV) [pdf, html, other]

Title: Towards Open-Vocabulary Audio-Visual Event Localization

Jinxing Zhou, Dan Guo, Ruohao Guo, Yuxin Mao, Jingjing Hu, Yiran Zhong, Xiaojun Chang, Meng Wang

Comments: accepted by CVPR 2025; Project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[74] arXiv:2411.11688 (cross-list from cs.CR) [pdf, html, other]

Title: Conceptwm: A Diffusion Model Watermark for Concept Protection

Liangqi Lei, Keke Gai, Jing Yu, Liehuang Zhu, Qi Wu

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[75] arXiv:2411.12008 (cross-list from cs.SD) [pdf, html, other]

Title: Compression of Higher Order Ambisonics with Multichannel RVQGAN

Toni Hirvonen, Mahmoud Namazi

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[76] arXiv:2411.12072 (cross-list from cs.CV) [pdf, html, other]

Title: Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution

Brian B. Moser, Stanislav Frolov, Tobias C. Nauen, Federico Raue, Andreas Dengel

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[77] arXiv:2411.12197 (cross-list from cs.CV) [pdf, html, other]

Title: MTFusion: Reconstructing Any 3D Object from Single Image Using Multi-word Textual Inversion

Yu Liu, Ruowei Wang, Jiaqi Li, Zixiang Xu, Qijun Zhao

Comments: PRCV 2024

Journal-ref: Pattern Recognition and Computer Vision (2025), Springer Nature Singapore, pages 166-180, ISBN 978-981-97-8508-7

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[78] arXiv:2411.12293 (cross-list from cs.CV) [pdf, html, other]

Title: Generative Timelines for Instructed Visual Assembly

Alejandro Pardo, Jui-Hsien Wang, Bernard Ghanem, Josef Sivic, Bryan Russell, Fabian Caba Heilbron

Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[79] arXiv:2411.12776 (cross-list from eess.IV) [pdf, html, other]

Title: Cross-Layer Encrypted Semantic Communication Framework for Panoramic Video Transmission

Haixiao Gao, Mengying Sun, Xiaodong Xu, Bingxuan Xu, Shujun Han, Bizhu Wang, Sheng Jiang, Chen Dong, Ping Zhang

Subjects: Image and Video Processing (eess.IV); Cryptography and Security (cs.CR); Multimedia (cs.MM)

[80] arXiv:2411.13281 (cross-list from cs.CV) [pdf, html, other]

Title: VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation

Ziyang Luo, Haoning Wu, Dongxu Li, Jing Ma, Mohan Kankanhalli, Junnan Li

Comments: CVPR 2025, Project Page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[81] arXiv:2411.13536 (cross-list from cs.CV) [pdf, html, other]

Title: Identity Preserving 3D Head Stylization with Multiview Score Distillation

Bahri Batuhan Bilecen, Ahmet Berke Gokmen, Furkan Guzelant, Aysegul Dundar

Comments: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM)

[82] arXiv:2411.13577 (cross-list from eess.AS) [pdf, html, other]

Title: WavChat: A Survey of Spoken Dialogue Models

Shengpeng Ji, Yifu Chen, Minghui Fang, Jialong Zuo, Jingyu Lu, Hanting Wang, Ziyue Jiang, Long Zhou, Shujie Liu, Xize Cheng, Xiaoda Yang, Zehan Wang, Qian Yang, Jian Li, Yidi Jiang, Jingzhen He, Yunfei Chu, Jin Xu, Zhou Zhao

Comments: 60 papes, working in progress

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)

[83] arXiv:2411.13811 (cross-list from cs.SD) [pdf, html, other]

Title: X-CrossNet: A complex spectral mapping approach to target speaker extraction with cross attention speaker embedding fusion

Chang Sun, Bo Qin

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[84] arXiv:2411.13819 (cross-list from cs.CR) [pdf, html, other]

Title: Robust Steganography with Boundary-Preserving Overflow Alleviation and Adaptive Error Correction

Yu Cheng, Zhenlin Luo, Zhaoxia Yin

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM)

[85] arXiv:2411.14135 (cross-list from eess.IV) [pdf, html, other]

Title: Compact Visual Data Representation for Green Multimedia -- A Human Visual System Perspective

Peilin Chen, Xiaohan Fang, Meng Wang, Shiqi Wang, Siwei Ma

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[86] arXiv:2411.14207 (cross-list from cs.SD) [pdf, html, other]

Title: HARP: A Large-Scale Higher-Order Ambisonic Room Impulse Response Dataset

Shivam Saini, Jürgen Peissig

Comments: Accepted at ICASSP 2025 Workshop. Code to generate uploaded at: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[87] arXiv:2411.14627 (cross-list from cs.SD) [pdf, html, other]

Title: Generative AI for Music and Audio

Hao-Wen Dong

Comments: PhD Dissertation

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[88] arXiv:2411.15128 (cross-list from cs.LG) [pdf, html, other]

Title: Health AI Developer Foundations

Atilla P. Kiraly, Sebastien Baur, Kenneth Philbrick, Fereshteh Mahvar, Liron Yatziv, Tiffany Chen, Bram Sterling, Nick George, Fayaz Jamil, Jing Tang, Kai Bailey, Faruk Ahmed, Akshay Goel, Abbi Ward, Lin Yang, Andrew Sellergren, Yossi Matias, Avinatan Hassidim, Shravya Shetty, Daniel Golden, Shekoofeh Azizi, David F. Steiner, Yun Liu, Tim Thelin, Rory Pilgrim, Can Kirmizibayrak

Comments: 16 pages, 8 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[89] arXiv:2411.15457 (cross-list from cs.SD) [pdf, html, other]

Title: Hindi audio-video-Deepfake (HAV-DF): A Hindi language-based Audio-video Deepfake Dataset

Sukhandeep Kaur, Mubashir Buhari, Naman Khandelwal, Priyansh Tyagi, Kiran Sharma

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[90] arXiv:2411.16096 (cross-list from cs.CV) [pdf, html, other]

Title: ENCLIP: Ensembling and Clustering-Based Contrastive Language-Image Pretraining for Fashion Multimodal Search with Limited Data and Low-Quality Images

Prithviraj Purushottam Naik, Rohit Agarwal

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[91] arXiv:2411.16729 (cross-list from cs.SD) [pdf, html, other]

Title: DiM-Gestor: Co-Speech Gesture Generation with Adaptive Layer Normalization Mamba-2

Fan Zhang, Siyuan Zhao, Naye Ji, Zhaohan Wang, Jingmei Wu, Fuxing Gao, Zhenqing Ye, Leyao Yan, Lanxin Dai, Weidong Geng, Xin Lyu, Bozuo Zhao, Dingguo Yu, Hui Du, Bin Hu

Comments: 13 pages, 11 figures

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Graphics (cs.GR); Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[92] arXiv:2411.16750 (cross-list from cs.CV) [pdf, html, other]

Title: PriorDiffusion: Leverage Language Prior in Diffusion Models for Monocular Depth Estimation

Ziyao Zeng, Jingcheng Ni, Daniel Wang, Patrick Rim, Younjoon Chung, Fengyu Yang, Byung-Woo Hong, Alex Wong

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[93] arXiv:2411.16863 (cross-list from cs.CV) [pdf, html, other]

Title: Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering

Federico Cocchi, Nicholas Moratelli, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[94] arXiv:2411.16946 (cross-list from cs.CV) [pdf, html, other]

Title: Lens Distortion Encoding System Version 1.0

Jakub Maksymilian Fober

Comments: 8 pages, 1 figure, 2 tables

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)

[95] arXiv:2411.17440 (cross-list from cs.CV) [pdf, html, other]

Title: Identity-Preserving Text-to-Video Generation by Frequency Decomposition

Shenghai Yuan, Jinfa Huang, Xianyi He, Yunyuan Ge, Yujun Shi, Liuhan Chen, Jiebo Luo, Li Yuan

Comments: CVPR 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[96] arXiv:2411.17698 (cross-list from cs.CV) [pdf, html, other]

Title: Video-Guided Foley Sound Generation with Multimodal Controls

Ziyang Chen, Prem Seetharaman, Bryan Russell, Oriol Nieto, David Bourgin, Andrew Owens, Justin Salamon

Comments: Accepted at CVPR 2025. Project site: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[97] arXiv:2411.17776 (cross-list from cs.CV) [pdf, html, other]

Title: Beyond Walking: A Large-Scale Image-Text Benchmark for Text-based Person Anomaly Search

Shuyu Yang, Yaxiong Wang, Li Zhu, Zhedong Zheng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[98] arXiv:2411.18855 (cross-list from cs.CV) [pdf, html, other]

Title: Improving Accuracy and Generalization for Efficient Visual Tracking

Ram Zaveri, Shivang Patel, Yu Gu, Gianfranco Doretto

Comments: WACV 2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[99] arXiv:2411.18966 (cross-list from cs.CV) [pdf, html, other]

Title: SuperGaussians: Enhancing Gaussian Splatting Using Primitives with Spatially Varying Colors

Rui Xu, Wenyue Chen, Jiepeng Wang, Yuan Liu, Peng Wang, Lin Gao, Shiqing Xin, Taku Komura, Xin Li, Wenping Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)

[100] arXiv:2411.19220 (cross-list from cs.CV) [pdf, html, other]

Title: Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection

Tsun-Hin Cheung, Ka-Chun Fung, Songjiang Lai, Kwan-Ho Lin, Vincent Ng, Kin-Man Lam

Comments: Accepted to APSIPA ASC 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[101] arXiv:2411.19537 (cross-list from cs.CV) [pdf, html, other]

Title: Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlook

Florinel-Alin Croitoru, Andrei-Iulian Hiji, Vlad Hondru, Nicolae Catalin Ristea, Paul Irofti, Marius Popescu, Cristian Rusu, Radu Tudor Ionescu, Fahad Shahbaz Khan, Mubarak Shah

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[102] arXiv:2411.19628 (cross-list from cs.CV) [pdf, html, other]

Title: Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings

Qiong Wu, Wenhao Lin, Weihao Ye, Yiyi Zhou, Xiaoshuai Sun, Rongrong Ji

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[103] arXiv:2411.19730 (cross-list from cs.PF) [pdf, html, other]

Title: Ten Ways in which Virtual Reality Differs from Video Streaming

Gustavo de Veciana, Sonia Fahmy, George Kesidis, Voicu Popescu

Subjects: Performance (cs.PF); Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[104] arXiv:2411.19772 (cross-list from cs.CV) [pdf, html, other]

Title: LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos

Tiantian Geng, Jinrui Zhang, Qingni Wang, Teng Wang, Jinming Duan, Feng Zheng

Comments: Accepted by CVPR2025

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)