Multimedia

Authors and titles for November 2024

[1] arXiv:2411.00813 [pdf, html, other]

Title: Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

Sixu An, Xiangguo Sun, Yicong Li, Yu Yang, Guandong Xu

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG); Social and Information Networks (cs.SI); Audio and Speech Processing (eess.AS)

[2] arXiv:2411.01561 [pdf, html, other]

Title: Multimodal Graph Neural Network for Recommendation with Dynamic De-redundancy and Modality-Guided Feature De-noisy

Feng Mo, Lin Xiao, Qiya Song, Xieping Gao, Eryao Liang

Subjects: Multimedia (cs.MM); Information Retrieval (cs.IR)

[3] arXiv:2411.02851 [pdf, html, other]

Title: Learning to Unify Audio, Visual and Text for Audio-Enhanced Multilingual Visual Answer Localization

Zhibin Wen, Bin Li

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

[4] arXiv:2411.03010 [pdf, html, other]

Title: Learning-based Lossless Event Data Compression

Ahmadreza Sezavar, Catarina Brites, Joao Ascenso

Subjects: Multimedia (cs.MM)

[5] arXiv:2411.03595 [pdf, html, other]

Title: Investigating Conceptual Blending of a Diffusion Model for Improving Nonword-to-Image Generation

Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide

Comments: Paper accepted at ACM MM 2024 (doi: https://doi.org/10.1145/3664647.3681202) with supplementary materials concatenated

Subjects: Multimedia (cs.MM)

[6] arXiv:2411.03921 [pdf, html, other]

Title: Inter-Frame Coding for Dynamic Meshes via Coarse-to-Fine Anchor Mesh Generation

He Huang, Lizhi Hou, Qi Yang, Yiling Xu

Subjects: Multimedia (cs.MM)

[7] arXiv:2411.05295 [pdf, html, other]

Title: Content-Adaptive Rate-Quality Curve Prediction Model in Media Processing System

Shibo Yin, Zhiyu Zhang, Peirong Ning, Qiubo Chen, Jing Chen, Quan Zhou, Li Song

Comments: Accepted by IEEE VCIP 2024 (Oral)

Subjects: Multimedia (cs.MM)

[8] arXiv:2411.05322 [pdf, html, other]

Title: Rate-aware Compression for NeRF-based Volumetric Video

Zhiyu Zhang, Guo Lu, Huanxiong Liang, Zhengxue Cheng, Anni Tang, Li Song

Comments: Accepted by ACM MM 2024 (Oral)

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[9] arXiv:2411.05374 [pdf, html, other]

Title: Interdisciplinary Translations: Sensory Perception as a Universal Language

Xindi Kang, Xuanyang Huang, Mingdong Song, Varvara Guljajeva, JoAnn Kuchera-Morin

Comments: This paper has been accepted to the International Symposium of Electronic Arts 2024, and the proceedings version will be available at this https URL with DOI to be added once published

Subjects: Multimedia (cs.MM)

[10] arXiv:2411.05794 [pdf, html, other]

Title: Beyond Correlation: Evaluating Multimedia Quality Models with the Constrained Concordance Index

Alessandro Ragano, Helard Becerra Martinez, Andrew Hines

Subjects: Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[11] arXiv:2411.05854 [pdf, other]

Title: Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators

Claire Wonjeong Jo, Miki Wesołowska, Magdalena Wojcieszak

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

[12] arXiv:2411.07155 [pdf, html, other]

Title: Low Complexity Learning-based Lossless Event-based Compression

Ahmadreza Sezavar, Catarina Brites, Joao Ascenso

Subjects: Multimedia (cs.MM)

[13] arXiv:2411.07539 [pdf, html, other]

Title: Harmonizing Pixels and Melodies: Maestro-Guided Film Score Generation and Composition Style Transfer

F. Qi, L. Ni, C. Xu

Subjects: Multimedia (cs.MM)

[14] arXiv:2411.07899 [pdf, html, other]

Title: Rendering-Oriented 3D Point Cloud Attribute Compression using Sparse Tensor-based Transformer

Xiao Huo, Junhui Hou, Shuai Wan, Fuzheng Yang

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[15] arXiv:2411.08730 [pdf, other]

Title: 3D Modelling to Address Pandemic Challenges: A Project-Based Learning Methodology

Tânia Rocha, Ana Ribeiro, Joana Oliveira, Ricardo Nunes, Diana Carvalho, Hugo Paredes, Paulo Martins

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[16] arXiv:2411.08882 [pdf, html, other]

Title: A Novel Multimodal System to Predict Agitation in People with Dementia Within Clinical Settings: A Proof of Concept

Abeer Badawi, Somayya Elmoghazy, Samira Choudhury, Sara Elgazzar, Khalid Elgazzar, Amer Burhan

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[17] arXiv:2411.08885 [pdf, html, other]

Title: Enhancing Lie Detection Accuracy: A Comparative Study of Classic ML, CNN, and GCN Models using Audio-Visual Features

Abdelrahman Abdelwahab, Akshaj Vishnubhatla, Ayaan Vaswani, Advait Bharathulwar, Arnav Kommaraju

Comments: 11 pages, 18 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[18] arXiv:2411.10060 [pdf, html, other]

Title: CMATH: Cross-Modality Augmented Transformer with Hierarchical Variational Distillation for Multimodal Emotion Recognition in Conversation

Xiaofei Zhu, Jiawei Cheng, Zhou Yang, Zhuo Chen, Qingyang Wang, Jianfeng Yao

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL)

[19] arXiv:2411.12825 [pdf, html, other]

Title: TopoCode: Topologically Informed Error Detection and Correction in Communication Systems

Hongzhi Guo

Subjects: Multimedia (cs.MM)

[20] arXiv:2411.12907 [pdf, html, other]

Title: Narrative Information Theory

Lion Schulz, Miguel Patrício, Daan Odijk

Comments: To be published in NeurIPS 2024 Workshop on Creativity & Generative AI. 7 pages, 3 figures

Subjects: Multimedia (cs.MM); Information Theory (cs.IT)

[21] arXiv:2411.13917 [pdf, html, other]

Title: SpikEmo: Enhancing Emotion Recognition With Spiking Temporal Dynamics in Conversations

Xiaomin Yu, Feiyang Wang, Ziyue Qiao

Subjects: Multimedia (cs.MM)

[22] arXiv:2411.14613 [pdf, other]

Title: Optimal Transcoding Preset Selection for Live Video Streaming

Zahra Nabizadeh, Maedeh Jamali, Nader Karimi, Shadrokh Samavi, Shahram Shirani

Comments: 23 pages, 10 figures

Subjects: Multimedia (cs.MM)

[23] arXiv:2411.15447 [pdf, html, other]

Title: Gotta Hear Them All: Sound Source Aware Vision to Audio Generation

Wei Guo, Heng Wang, Jianbo Ma, Weidong Cai

Comments: 18 pages, 13 figures, source code available at this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[24] arXiv:2411.15455 [pdf, html, other]

Title: MUFM: A Mamba-Enhanced Feedback Model for Micro Video Popularity Prediction

Jiacheng Lu, Mingyuan Xiao, Weijian Wang, Yuxin Du, Yi Cui, Jingnan Zhao, Cheng Hua

Comments: 14 pages,9 figures

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[25] arXiv:2411.15759 [pdf, html, other]

Title: Advanced Learning-Based Inter Prediction for Future Video Coding

Yanchen Zhao, Wenhong Duan, Chuanmin Jia, Shanshe Wang, Siwei Ma

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[26] arXiv:2411.15801 [pdf, html, other]

Title: A review on Machine Learning based User-Centric Multimedia Streaming Techniques

Monalisa Ghosh, Chetna Singhal

Comments: Computer Communications

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[27] arXiv:2411.16331 [pdf, html, other]

Title: Sonic: Shifting Focus to Global Audio Perception in Portrait Animation

Xiaozhong Ji, Xiaobin Hu, Zhihong Xu, Junwei Zhu, Chuming Lin, Qingdong He, Jiangning Zhang, Donghao Luo, Yi Chen, Qin Lin, Qinglin Lu, Chengjie Wang

Comments: refer to our main-page \url{this https URL}

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[28] arXiv:2411.16885 [pdf, other]

Title: Fully Automatic Content-Aware Tiling Pipeline for Pathology Whole Slide Images

Falah Jabar, Lill-Tove Rasmussen Busund, Biagio Ricciuti, Masoud Tafavvoghi, Mette Pøhl, Sigve Andersen, Tom Donnem, David J. Kwiatkowski, Mehrdad Rakaee

Comments: Submitted to Medical Image Analysis journal, February 2025

Subjects: Multimedia (cs.MM)

[29] arXiv:2411.17690 [pdf, html, other]

Title: Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis

Akshita Gupta, Tatiana Likhomanenko, Karren Dai Yang, Richard He Bai, Zakaria Aldeneh, Navdeep Jaitly

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[30] arXiv:2411.17704 [pdf, other]

Title: Racism in the Machine: Visualization Ethics in Digital Humanities Projects

K.J. Hepworth, Christopher Church

Subjects: Multimedia (cs.MM)

[31] arXiv:2411.18372 [pdf, html, other]

Title: Uncertainty-driven Sampling for Efficient Pairwise Comparison Subjective Assessment

Shima Mohammadi, João Ascenso

Comments: 10 Pages, 7 Figures, Accepted at IEEE Transactions on Multimedia

Subjects: Multimedia (cs.MM)

[32] arXiv:2411.19522 [pdf, html, other]

Title: Subjective and Objective Quality Assessment Methods of Stereoscopic Videos with Visibility Affecting Distortions

Sria Biswas, Balasubramanyam Appina, Priyanka Kokil, Sumohana S Channappayya

Comments: 13 pages

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[33] arXiv:2411.00304 (cross-list from cs.CV) [pdf, html, other]

Title: Unified Generative and Discriminative Training for Multi-modal Large Language Models

Wei Chow, Juncheng Li, Qifan Yu, Kaihang Pan, Hao Fei, Zhiqi Ge, Shuai Yang, Siliang Tang, Hanwang Zhang, Qianru Sun

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[34] arXiv:2411.00831 (cross-list from cs.CV) [pdf, html, other]

Title: Saliency-Based diversity and fairness Metric and FaceKeepOriginalAugment: A Novel Approach for Enhancing Fairness and Diversity

Teerath Kumar, Alessandra Mileo, Malika Bendechache

Comments: Paper is underReview in Image and Vision Computing Journal special issue: Advancing Transparency and Privacy: Explainable AI and Synthetic Data in Biometrics and Computer Vision

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[35] arXiv:2411.01805 (cross-list from cs.SD) [pdf, html, other]

Title: MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence

Fuming You, Minghui Fang, Li Tang, Rongjie Huang, Yongqi Wang, Zhou Zhao

Comments: NeurIPS 2024

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[36] arXiv:2411.02236 (cross-list from cs.CV) [pdf, html, other]

Title: 3D Audio-Visual Segmentation

Artem Sokolov, Swapnil Bhosale, Xiatian Zhu

Comments: Accepted at the NeurIPS 2024 Workshop on Audio Imagination

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[37] arXiv:2411.02334 (cross-list from cs.IT) [pdf, html, other]

Title: Diffusion-based Generative Multicasting with Intent-aware Semantic Decomposition

Xinkai Liu, Mahdi Boloursaz Mashhadi, Li Qiao, Yi Ma, Rahim Tafazolli, Mehdi Bennis

Subjects: Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Signal Processing (eess.SP)

[38] arXiv:2411.02551 (cross-list from cs.SD) [pdf, html, other]

Title: PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text

Hayeon Bang, Eunjin Choi, Megan Finch, Seungheon Doh, Seolhee Lee, Gyeong-Hoon Lee, Juhan Nam

Comments: Accepted for publication at the 3rd Workshop on NLP for Music and Audio (NLP4MusA 2024)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[39] arXiv:2411.02607 (cross-list from cs.HC) [pdf, html, other]

Title: Towards Context-Aware Adaptation in Extended Reality: A Design Space for XR Interfaces and an Adaptive Placement Strategy

Shakiba Davari, Doug A. Bowman

Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY); Graphics (cs.GR); Information Retrieval (cs.IR); Multimedia (cs.MM)

[40] arXiv:2411.02860 (cross-list from cs.CV) [pdf, html, other]

Title: Continual Audio-Visual Sound Separation

Weiguo Pian, Yiyang Nan, Shijian Deng, Shentong Mo, Yunhui Guo, Yapeng Tian

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[41] arXiv:2411.03034 (cross-list from cs.AI) [pdf, html, other]

Title: HumanVLM: Foundation for Human-Scene Vision-Language Model

Dawei Dai, Xu Long, Li Yutang, Zhang Yuanhui, Shuyin Xia

Comments: 34 pages,11 figures

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[42] arXiv:2411.03085 (cross-list from cs.SD) [pdf, html, other]

Title: Speech Separation with Pretrained Frontend to Minimize Domain Mismatch

Wupeng Wang, Zexu Pan, Xinke Li, Shuai Wang, Haizhou Li

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Journal-ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing.32(2024)4184-4198

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[43] arXiv:2411.03109 (cross-list from cs.SD) [pdf, html, other]

Title: pTSE-T: Presentation Target Speaker Extraction using Unaligned Text Cues

Ziyang Jiang, Xinyuan Qian, Jiahe Lei, Zexu Pan, Wei Xue, Xu-cheng Yin

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[44] arXiv:2411.03823 (cross-list from cs.CV) [pdf, html, other]

Title: Both Text and Images Leaked! A Systematic Analysis of Multimodal LLM Data Contamination

Dingjie Song, Sicheng Lai, Shunian Chen, Lichao Sun, Benyou Wang

Comments: Code Available: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[45] arXiv:2411.03948 (cross-list from cs.SD) [pdf, html, other]

Title: Long-Form Text-to-Music Generation with Adaptive Prompts: A Case of Study in Tabletop Role-Playing Games Soundtracks

Felipe Marra, Lucas N. Ferreira

Comments: Paper accepted at the LAMIR 2024 workshop

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[46] arXiv:2411.04366 (cross-list from cs.SD) [pdf, html, other]

Title: The Concatenator: A Bayesian Approach To Real Time Concatenative Musaicing

Christopher Tralie, Ben Cantil

Comments: 12 pages, 6 figures, Accepted for Publication in The International Society for Music Information Retrieval Proceedings, 2024

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[47] arXiv:2411.04517 (cross-list from cs.LG) [pdf, other]

Title: Continuous Sign Language Recognition System using Deep Learning with MediaPipe Holistic

Sharvani Srivastava, Sudhakar Singh, Pooja, Shiv Prakash

Comments: 14 pages, 4 figures, Wireless Pers Commun

Journal-ref: Wireless Personal Communication, 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[48] arXiv:2411.04859 (cross-list from cs.CV) [pdf, html, other]

Title: A multi-purpose automatic editing system based on lecture semantics for remote education

Panwen Hu, Rui Huang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[49] arXiv:2411.05715 (cross-list from cs.SD) [pdf, html, other]

Title: On the Role of Noise in AudioVisual Integration: Evidence from Artificial Neural Networks that Exhibit the McGurk Effect

Lukas Grasse, Matthew S. Tata

Subjects: Sound (cs.SD); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[50] arXiv:2411.05832 (cross-list from cs.CV) [pdf, html, other]

Title: Diversify, Contextualize, and Adapt: Efficient Entropy Modeling for Neural Image Codec

Jun-Hyuk Kim, Seungeon Kim, Won-Hee Lee, Dokwan Oh

Comments: NeurIPS 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)