Multimedia

Authors and titles for October 2022

[1] arXiv:2210.00330 [pdf, other]

Title: Social VR and multi-party holographic communications: Opportunities, Challenges and Impact in the Education and Training Sectors

Mario Montagud, Gianluca Cernigliaro, Miguel Arevalillo-Herráez, Miguel García-Pineda, Jaume Segura-Garcia, Sergi Fernández

Subjects: Multimedia (cs.MM)

[2] arXiv:2210.00821 [pdf, other]

Title: A high accuracy and low complexity quality control method for image compression

Xiao Yan, Zhangxin Gong, Wenqiang Wang, Xiaoyang Zeng, Yibo Fan

Subjects: Multimedia (cs.MM)

[3] arXiv:2210.01652 [pdf, other]

Title: A Conditional-Probability-Distribution Model for Bandwidth Estimation with Application in Live Video Streaming

Weijia Zheng

Comments: 5 pages, 6 figures

Subjects: Multimedia (cs.MM)

[4] arXiv:2210.02206 [pdf, other]

Title: Improving Visual-Semantic Embedding with Adaptive Pooling and Optimization Objective

Zijian Zhang, Chang Shu, Ya Xiao, Yuan Shen, Di Zhu, Jing Xiao, Youxin Chen, Jey Han Lau, Qian Zhang, Zheng Lu

Subjects: Multimedia (cs.MM)

[5] arXiv:2210.04677 [pdf, other]

Title: UAV Placement for Real-time Video Acquisition: A Tradeoff between Resolution and Delay

Tang Xiao-Wei, Huang Xin-Lin Huang

Comments: submitted to ieee for possible publication. arXiv admin note: text overlap with arXiv:2006.14438 by other authors

Subjects: Multimedia (cs.MM)

[6] arXiv:2210.06697 [pdf, other]

Title: Size Does Matter: An Experimental Study of Anxiety in Virtual Reality

Junyi Shen, Itaru Kitahara, Shinichi Koyama, Qiaoge Li

Comments: to appear in VRST 2022

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[7] arXiv:2210.06794 [pdf, other]

Title: Towards Holographic Video Communications: A Promising AI-driven Solution

Yakun Huang, Yuanwei Zhu, Xiuquan Qiao, Xiang Su, Schahram Dustdar, Ping Zhang

Subjects: Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[8] arXiv:2210.06802 [pdf, other]

Title: Multi-Player Immersive Communications and Interactions in Metaverse: Challenges, Architecture, and Future Directions

Yakun Huang, Xiuquan Qiao, Haowen Wang, Xiang Su, Schahram Dustdar, Ping Zhang

Subjects: Multimedia (cs.MM)

[9] arXiv:2210.06808 [pdf, other]

Title: ISCom: Interest-aware Semantic Communication Scheme for Point Cloud Video Streaming

Yakun Huang, Boyuan Bai, Yuanwei Zhu, Xiuquan Qiao, Xiang Su, Ping Zhang

Subjects: Multimedia (cs.MM)

[10] arXiv:2210.07839 [pdf, other]

Title: Contrastive Audio-Visual Masked Autoencoder

Yuan Gong, Andrew Rouditchenko, Alexander H. Liu, David Harwath, Leonid Karlinsky, Hilde Kuehne, James Glass

Comments: Accepted at ICLR 2023 as a notable top 25% paper. Code and pretrained models are at this https URL

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[11] arXiv:2210.09651 [pdf, other]

Title: Comparison of Popular Video Conferencing Apps Using Client-side Measurements on Different Backhaul Networks

Rohan Kumar, Dhruv Nagpal, Vinayak Naik, Dipanjan Chakraborty

Journal-ref: Proceedings of the Twenty-Third International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing 2022

Subjects: Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[12] arXiv:2210.09946 [pdf, other]

Title: MMGA: Multimodal Learning with Graph Alignment

Xuan Yang, Quanjin Tao, Xiao Feng, Donghong Cai, Xiang Ren, Yang Yang

Comments: Please contact xuany@zju.this http URL for the dataset

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[13] arXiv:2210.10330 [pdf, other]

Title: Content-adaptive Encoder Preset Prediction for Adaptive Live Streaming

Vignesh V Menon, Hadi Amirpour, Prajit T Rajendran, Mohammad Ghanbari, Christian Timmerer

Comments: Accepted in PCS2022

Subjects: Multimedia (cs.MM)

[14] arXiv:2210.10972 [pdf, other]

Title: A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognition

Vijay John, Yasutomo Kawanishi

Comments: Accepted for ACM Multimedia Asia, 2022

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[15] arXiv:2210.12201 [pdf, other]

Title: A computational analysis on the relationship between melodic originality and thematic fame in classical music from the Romantic period

Hudson Griffith

Subjects: Multimedia (cs.MM)

[16] arXiv:2210.13827 [pdf, other]

Title: End-to-end Transformer for Compressed Video Quality Enhancement

Li Yu, Wenshuai Chang, Shiyu Wu, Moncef Gabbouj

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[17] arXiv:2210.13890 [pdf, other]

Title: Fast multi-encoding to reduce the cost of video streaming

Hadi Amirpour, Vignesh V Menon, Ekrem Çetinkaya, Adithyan Ilangovan, Christian Feldmann, Martin Smole, Christian Timmerer

Comments: Accepted in IBC2022

Subjects: Multimedia (cs.MM)

[18] arXiv:2210.14349 [pdf, other]

Title: A DirectX-Based DICOM Viewer for Multi-User Surgical Planning in Augmented Reality

Menghe Zhang, Weichen Liu, Nadir Weibel, Jurgen Schulze

Journal-ref: ISVC 2022 symposium proceeding, will be on Lecture Notes in Computer Science (LNCS) series

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[19] arXiv:2210.15300 [pdf, other]

Title: Leveraging Computer Vision Application in Visual Arts: A Case Study on the Use of Residual Neural Network to Classify and Analyze Baroque Paintings

Daniel Kvak

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[20] arXiv:2210.15824 [pdf, other]

Title: Improving the Modality Representation with Multi-View Contrastive Learning for Multimodal Sentiment Analysis

Peipei Liu, Xin Zheng, Hong Li, Jie Liu, Yimo Ren, Hongsong Zhu, Limin Sun

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI)

[21] arXiv:2210.16470 [pdf, other]

Title: Improving Audio Captioning Using Semantic Similarity Metrics

Rehana Mahfuz, Yinyi Guo, Erik Visser

Comments: Accepted at ICASSP 2023

Subjects: Multimedia (cs.MM)

[22] arXiv:2210.16639 [pdf, other]

Title: GRACE: Loss-Resilient Real-Time Video Communication Using Data-Scalable Autoencoder

Yihua Cheng, Anton Arapin, Ziyi Zhang, Qizheng Zhang, Hanchen Li, Nick Feamster, Junchen Jiang

Subjects: Multimedia (cs.MM); Networking and Internet Architecture (cs.NI)

[23] arXiv:2210.00312 (cross-list from cs.CL) [pdf, other]

Title: Multimodal Analogical Reasoning over Knowledge Graphs

Ningyu Zhang, Lei Li, Xiang Chen, Xiaozhuan Liang, Shumin Deng, Huajun Chen

Comments: Accepted by ICLR 2023. The project website is this https URL

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[24] arXiv:2210.00378 (cross-list from eess.AS) [pdf, other]

Title: Optimized Decoders for Mixed-Order Ambisonics

Aaron Heller (1), Eric Benjamin (2), Fernando Lopez-Lezcano (3) ((1) Artificial Intelligence Center, SRI International, (2) Surround Research, (3) Center for Computer Research in Music and Acoustics (CCRMA), Stanford University)

Comments: 9 pages, 10 figures,

Journal-ref: Paper 10507, 150th Audio Engineering Society Convention, May 2021

Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM); Sound (cs.SD)

[25] arXiv:2210.00434 (cross-list from eess.AS) [pdf, other]

Title: Music-to-Text Synaesthesia: Generating Descriptive Text from Music Recordings

Zhihuan Kuang, Shi Zong, Jianbing Zhang, Jiajun Chen, Hongfu Liu

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD)

[26] arXiv:2210.00753 (cross-list from cs.SD) [pdf, other]

Title: Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection

Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang

Comments: Accepted by SLT 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[27] arXiv:2210.00757 (cross-list from cs.CV) [pdf, other]

Title: Fully Transformer Network for Change Detection of Remote Sensing Images

Tianyu Yan, Zifu Wan, Pingping Zhang

Comments: 18 pages, 6 figures and 5 tables. This work will appear in ACCV2022 as a poster paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[28] arXiv:2210.01402 (cross-list from cs.CV) [pdf, other]

Title: Streaming Video Analytics On The Edge With Asynchronous Cloud Support

Anurag Ghosh, Srinivasan Iyengar, Stephen Lee, Anuj Rathore, Venkat N Padmanabhan

Comments: 12 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Multimedia (cs.MM)

[29] arXiv:2210.01719 (cross-list from cs.SD) [pdf, html, other]

Title: Learning Temporal Resolution in Spectrogram for Audio Classification

Haohe Liu, Xubo Liu, Qiuqiang Kong, Wenwu Wang, Mark D. Plumbley

Comments: Accepted by the 38th Annual AAAI Conference on Artificial Intelligence

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[30] arXiv:2210.02227 (cross-list from cs.CV) [pdf, other]

Title: Comprint: Image Forgery Detection and Localization using Compression Fingerprints

Hannes Mareen, Dante Vanden Bussche, Fabrizio Guillaro, Davide Cozzolino, Glenn Van Wallendael, Peter Lambert, Luisa Verdoliva

Comments: Presented at the Workshop on MultiMedia FORensics in the WILD 2022, held in conjunction with the International Conference on Pattern Recognition (ICPR) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[31] arXiv:2210.02257 (cross-list from cs.CR) [pdf, other]

Title: Hiding Images in Deep Probabilistic Models

Haoyu Chen, Linqi Song, Zhenxing Qian, Xinpeng Zhang, Kede Ma

Subjects: Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[32] arXiv:2210.02324 (cross-list from cs.CV) [pdf, other]

Title: Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Images

Yafei Yang, Bo Yang

Comments: NeurIPS 2022. Code and data are available at project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Robotics (cs.RO)

[33] arXiv:2210.02391 (cross-list from cs.CV) [pdf, other]

Title: Geometry Driven Progressive Warping for One-Shot Face Animation

Yatao Zhong, Faezeh Amjadi, Ilya Zharkov

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[34] arXiv:2210.02437 (cross-list from cs.SD) [pdf, other]

Title: ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild

Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, Kong Aik Lee

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[35] arXiv:2210.02946 (cross-list from cs.IR) [pdf, other]

Title: VLSNR:Vision-Linguistics Coordination Time Sequence-aware News Recommendation

Songhao Han (1), Wei Huang (1), Xiaotian Luan (2) ((1) Beihang University, (2) Peking University)

Comments: 10 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[36] arXiv:2210.03382 (cross-list from cs.CV) [pdf, other]

Title: Temporal Feature Alignment in Contrastive Self-Supervised Learning for Human Activity Recognition

Bulat Khaertdinov, Stylianos Asteriadis

Comments: Accepted to IJCB 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[37] arXiv:2210.03625 (cross-list from cs.CL) [pdf, other]

Title: C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval

Andrew Rouditchenko, Yung-Sung Chuang, Nina Shvetsova, Samuel Thomas, Rogerio Feris, Brian Kingsbury, Leonid Karlinsky, David Harwath, Hilde Kuehne, James Glass

Comments: Accepted at ICASSP 2023. The code, models, and dataset are available at this https URL

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[38] arXiv:2210.03799 (cross-list from cs.SD) [pdf, other]

Title: Supervised and Unsupervised Learning of Audio Representations for Music Understanding

Matthew C. McCallum, Filip Korzeniowski, Sergio Oramas, Fabien Gouyon, Andreas F. Ehmann

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[39] arXiv:2210.04112 (cross-list from cs.CV) [pdf, other]

Title: Leveraging progressive model and overfitting for efficient learned image compression

Honglei Zhang, Francesco Cricri, Hamed Rezazadegan Tavakoli, Emre Aksu, Miska M. Hannuksela

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[40] arXiv:2210.04135 (cross-list from cs.CV) [pdf, other]

Title: VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment

Shraman Pramanick, Li Jing, Sayan Nag, Jiachen Zhu, Hardik Shah, Yann LeCun, Rama Chellappa

Comments: Published in TMLR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[41] arXiv:2210.04183 (cross-list from cs.CV) [pdf, other]

Title: MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning

Zijia Zhao, Longteng Guo, Xingjian He, Shuai Shao, Zehuan Yuan, Jing Liu

Comments: SIGIR 2023, 10 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[42] arXiv:2210.04216 (cross-list from cs.CV) [pdf, other]

Title: AMPose: Alternately Mixed Global-Local Attention Model for 3D Human Pose Estimation

Hongxin Lin, Yunwei Chiu, Peiyuan Wu

Comments: ICASSP 2023 Accepted Paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[43] arXiv:2210.04671 (cross-list from cs.CV) [pdf, other]

Title: TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment

Yujie Zhang, Qi Yang, Yifei Zhou, Xiaozhong Xu, Le Yang, Yiling Xu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[44] arXiv:2210.05335 (cross-list from cs.CV) [pdf, other]

Title: MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, Yujiu Yang

Comments: CVPR 2023 Main Track Long Paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[45] arXiv:2210.05357 (cross-list from cs.CV) [pdf, other]

Title: Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessment

Haoning Wu, Chaofeng Chen, Liang Liao, Jingwen Hou, Wenxiu Sun, Qiong Yan, Jinwei Gu, Weisi Lin

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[46] arXiv:2210.05766 (cross-list from cs.CV) [pdf, other]

Title: Match Cutting: Finding Cuts with Smooth Visual Transitions

Boris Chen, Amir Ziai, Rebecca Tucker, Yuchen Xie

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[47] arXiv:2210.05916 (cross-list from cs.CL) [pdf, other]

Title: Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features

Gokul Karthik Kumar, Karthik Nandakumar

Comments: Accepted at EMNLP 2022 Workshop on NLP for Positive Impact

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[48] arXiv:2210.06366 (cross-list from cs.CV) [pdf, other]

Title: A Generalist Framework for Panoptic Segmentation of Images and Videos

Ting Chen, Lala Li, Saurabh Saxena, Geoffrey Hinton, David J. Fleet

Comments: ICCV'23. Code at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[49] arXiv:2210.06756 (cross-list from cs.CV) [pdf, other]

Title: Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features

Changde Du, Kaicheng Fu, Jinpeng Li, Huiguang He

Comments: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE)

[50] arXiv:2210.06790 (cross-list from cs.RO) [pdf, other]

Title: Deep Gesture Generation for Social Robots Using Type-Specific Libraries

Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi

Subjects: Robotics (cs.RO); Multimedia (cs.MM)