Multimedia

Authors and titles for October 2022

[26] arXiv:2210.00753 (cross-list from cs.SD) [pdf, other]

Title: Push-Pull: Characterizing the Adversarial Robustness for Audio-Visual Active Speaker Detection

Xuanjun Chen, Haibin Wu, Helen Meng, Hung-yi Lee, Jyh-Shing Roger Jang

Comments: Accepted by SLT 2022

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[27] arXiv:2210.00757 (cross-list from cs.CV) [pdf, other]

Title: Fully Transformer Network for Change Detection of Remote Sensing Images

Tianyu Yan, Zifu Wan, Pingping Zhang

Comments: 18 pages, 6 figures and 5 tables. This work will appear in ACCV2022 as a poster paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[28] arXiv:2210.01402 (cross-list from cs.CV) [pdf, other]

Title: Streaming Video Analytics On The Edge With Asynchronous Cloud Support

Anurag Ghosh, Srinivasan Iyengar, Stephen Lee, Anuj Rathore, Venkat N Padmanabhan

Comments: 12 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Multimedia (cs.MM)

[29] arXiv:2210.01719 (cross-list from cs.SD) [pdf, html, other]

Title: Learning Temporal Resolution in Spectrogram for Audio Classification

Haohe Liu, Xubo Liu, Qiuqiang Kong, Wenwu Wang, Mark D. Plumbley

Comments: Accepted by the 38th Annual AAAI Conference on Artificial Intelligence

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[30] arXiv:2210.02227 (cross-list from cs.CV) [pdf, other]

Title: Comprint: Image Forgery Detection and Localization using Compression Fingerprints

Hannes Mareen, Dante Vanden Bussche, Fabrizio Guillaro, Davide Cozzolino, Glenn Van Wallendael, Peter Lambert, Luisa Verdoliva

Comments: Presented at the Workshop on MultiMedia FORensics in the WILD 2022, held in conjunction with the International Conference on Pattern Recognition (ICPR) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[31] arXiv:2210.02257 (cross-list from cs.CR) [pdf, other]

Title: Hiding Images in Deep Probabilistic Models

Haoyu Chen, Linqi Song, Zhenxing Qian, Xinpeng Zhang, Kede Ma

Subjects: Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[32] arXiv:2210.02324 (cross-list from cs.CV) [pdf, other]

Title: Promising or Elusive? Unsupervised Object Segmentation from Real-world Single Images

Yafei Yang, Bo Yang

Comments: NeurIPS 2022. Code and data are available at project page: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Robotics (cs.RO)

[33] arXiv:2210.02391 (cross-list from cs.CV) [pdf, other]

Title: Geometry Driven Progressive Warping for One-Shot Face Animation

Yatao Zhong, Faezeh Amjadi, Ilya Zharkov

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[34] arXiv:2210.02437 (cross-list from cs.SD) [pdf, other]

Title: ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild

Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, Kong Aik Lee

Comments: IEEE/ACM Transactions on Audio, Speech, and Language Processing

Subjects: Sound (cs.SD); Cryptography and Security (cs.CR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[35] arXiv:2210.02946 (cross-list from cs.IR) [pdf, other]

Title: VLSNR:Vision-Linguistics Coordination Time Sequence-aware News Recommendation

Songhao Han (1), Wei Huang (1), Xiaotian Luan (2) ((1) Beihang University, (2) Peking University)

Comments: 10 pages, 5 figures

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[36] arXiv:2210.03382 (cross-list from cs.CV) [pdf, other]

Title: Temporal Feature Alignment in Contrastive Self-Supervised Learning for Human Activity Recognition

Bulat Khaertdinov, Stylianos Asteriadis

Comments: Accepted to IJCB 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[37] arXiv:2210.03625 (cross-list from cs.CL) [pdf, other]

Title: C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval

Andrew Rouditchenko, Yung-Sung Chuang, Nina Shvetsova, Samuel Thomas, Rogerio Feris, Brian Kingsbury, Leonid Karlinsky, David Harwath, Hilde Kuehne, James Glass

Comments: Accepted at ICASSP 2023. The code, models, and dataset are available at this https URL

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[38] arXiv:2210.03799 (cross-list from cs.SD) [pdf, other]

Title: Supervised and Unsupervised Learning of Audio Representations for Music Understanding

Matthew C. McCallum, Filip Korzeniowski, Sergio Oramas, Fabien Gouyon, Andreas F. Ehmann

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[39] arXiv:2210.04112 (cross-list from cs.CV) [pdf, other]

Title: Leveraging progressive model and overfitting for efficient learned image compression

Honglei Zhang, Francesco Cricri, Hamed Rezazadegan Tavakoli, Emre Aksu, Miska M. Hannuksela

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[40] arXiv:2210.04135 (cross-list from cs.CV) [pdf, other]

Title: VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment

Shraman Pramanick, Li Jing, Sayan Nag, Jiachen Zhu, Hardik Shah, Yann LeCun, Rama Chellappa

Comments: Published in TMLR 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[41] arXiv:2210.04183 (cross-list from cs.CV) [pdf, other]

Title: MAMO: Masked Multimodal Modeling for Fine-Grained Vision-Language Representation Learning

Zijia Zhao, Longteng Guo, Xingjian He, Shuai Shao, Zehuan Yuan, Jing Liu

Comments: SIGIR 2023, 10 pages

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[42] arXiv:2210.04216 (cross-list from cs.CV) [pdf, other]

Title: AMPose: Alternately Mixed Global-Local Attention Model for 3D Human Pose Estimation

Hongxin Lin, Yunwei Chiu, Peiyuan Wu

Comments: ICASSP 2023 Accepted Paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[43] arXiv:2210.04671 (cross-list from cs.CV) [pdf, other]

Title: TCDM: Transformational Complexity Based Distortion Metric for Perceptual Point Cloud Quality Assessment

Yujie Zhang, Qi Yang, Yifei Zhou, Xiaozhong Xu, Le Yang, Yiling Xu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[44] arXiv:2210.05335 (cross-list from cs.CV) [pdf, other]

Title: MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

Yatai Ji, Junjie Wang, Yuan Gong, Lin Zhang, Yanru Zhu, Hongfa Wang, Jiaxing Zhang, Tetsuya Sakai, Yujiu Yang

Comments: CVPR 2023 Main Track Long Paper

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[45] arXiv:2210.05357 (cross-list from cs.CV) [pdf, other]

Title: Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessment

Haoning Wu, Chaofeng Chen, Liang Liao, Jingwen Hou, Wenxiu Sun, Qiong Yan, Jinwei Gu, Weisi Lin

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[46] arXiv:2210.05766 (cross-list from cs.CV) [pdf, other]

Title: Match Cutting: Finding Cuts with Smooth Visual Transitions

Boris Chen, Amir Ziai, Rebecca Tucker, Yuchen Xie

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[47] arXiv:2210.05916 (cross-list from cs.CL) [pdf, other]

Title: Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features

Gokul Karthik Kumar, Karthik Nandakumar

Comments: Accepted at EMNLP 2022 Workshop on NLP for Positive Impact

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[48] arXiv:2210.06366 (cross-list from cs.CV) [pdf, other]

Title: A Generalist Framework for Panoptic Segmentation of Images and Videos

Ting Chen, Lala Li, Saurabh Saxena, Geoffrey Hinton, David J. Fleet

Comments: ICCV'23. Code at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[49] arXiv:2210.06756 (cross-list from cs.CV) [pdf, other]

Title: Decoding Visual Neural Representations by Multimodal Learning of Brain-Visual-Linguistic Features

Changde Du, Kaicheng Fu, Jinpeng Li, Huiguang He

Comments: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE)

[50] arXiv:2210.06790 (cross-list from cs.RO) [pdf, other]

Title: Deep Gesture Generation for Social Robots Using Type-Specific Libraries

Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi

Subjects: Robotics (cs.RO); Multimedia (cs.MM)