Multimedia

Authors and titles for July 2022

[1] arXiv:2207.00319 [pdf, other]

Title: SDRTV-to-HDRTV via Hierarchical Dynamic Context Feature Mapping

Gang He, Kepeng Xu, Li Xu, Chang Wu, Ming Sun, Xing Wen, Yu-Wing Tai

Comments: 9 pages

Subjects: Multimedia (cs.MM)

[2] arXiv:2207.00755 [pdf, other]

Title: Unsupervised Recurrent Federated Learning for Edge Popularity Prediction in Privacy-Preserving Mobile Edge Computing Networks

Chong Zheng, Shengheng Liu, Yongming Huang, Wei Zhang, Luxi Yang

Comments: 17 pages, 15 figures, accepted for publication in IEEE INTERNET OF THINGS JOURNAL

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG)

[3] arXiv:2207.01426 [pdf, other]

Title: Dynamic Contrastive Distillation for Image-Text Retrieval

Jun Rao, Liang Ding, Shuhan Qi, Meng Fang, Yang Liu, Li Shen, Dacheng Tao

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[4] arXiv:2207.03056 [pdf, other]

Title: Privacy-preserving Reflection Rendering for Augmented Reality

Yiqin Zhao, Sheng Wei, Tian Guo

Comments: Accepted to ACM Multimedia 2022

Subjects: Multimedia (cs.MM)

[5] arXiv:2207.04201 [pdf, other]

Title: Human-centric Spatio-Temporal Video Grounding via the Combination of Mutual Matching Network and TubeDETR

Fan Yu, Zhixiang Zhao, Yuchen Wang, Yi Xu, Tongwei Ren, Gangshan Wu

Subjects: Multimedia (cs.MM)

[6] arXiv:2207.04213 [pdf, other]

Title: Dual-Path Cross-Modal Attention for better Audio-Visual Speech Extraction

Zhongweiyang Xu, Xulin Fan, Mark Hasegawa-Johnson

Comments: Paper Accepted by ICASSP2023

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[7] arXiv:2207.04521 [pdf, other]

Title: Information-Theoretic Bounds for Steganography in Multimedia

Hassan Y. El Arsh, Amr Abdelaziz, Ahmed Elliethy, Hussein A. Aly, T. Aaron Gulliver

Comments: arXiv admin note: substantial text overlap with arXiv:2111.04960

Subjects: Multimedia (cs.MM); Cryptography and Security (cs.CR)

[8] arXiv:2207.05680 [pdf, other]

Title: The Contribution of Lyrics and Acoustics to Collaborative Understanding of Mood

Shahrzad Naseri, Sravana Reddy, Joana Correia, Jussi Karlgren, Rosie Jones

Subjects: Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[9] arXiv:2207.05692 [pdf, other]

Title: Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models

Hadeel Mabrouk, Omar Abugabal, Nourhan Sakr, Hesham M. Eraqi

Comments: arXiv admin note: text overlap with arXiv:2108.03543

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[10] arXiv:2207.06177 [pdf, other]

Title: RTN: Reinforced Transformer Network for Coronary CT Angiography Vessel-level Image Quality Assessment

Yiting Lu, Jun Fu, Xin Li, Wei Zhou, Sen Liu, Xinxin Zhang, Congfu Jia, Ying Liu, Zhibo Chen

Comments: To appear in MICCAI2022

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[11] arXiv:2207.06909 [pdf, other]

Title: A Comprehensive Review on Digital Image Watermarking

Shweta Wadhera, Deepa Kamra, Ankit Rajpal, Aruna Jain, Vishal Jain

Subjects: Multimedia (cs.MM); Signal Processing (eess.SP)

[12] arXiv:2207.07386 [pdf, other]

Title: ChoreoGraph: Music-conditioned Automatic Dance Choreography over a Style and Tempo Consistent Dynamic Graph

Ho Yin Au, Jie Chen, Junkun Jiang, Yike Guo

Subjects: Multimedia (cs.MM)

[13] arXiv:2207.07394 [pdf, other]

Title: FRAS: Federated Reinforcement Learning empowered Adaptive Point Cloud Video Streaming

Yu Gao, Pengyuan Zhou, Zhi Liu, Bo Han, Pan Hui

Subjects: Multimedia (cs.MM)

[14] arXiv:2207.11880 [pdf, other]

Title: Adaptive Marginalized Semantic Hashing for Unpaired Cross-Modal Retrieval

Kaiyi Luo, Chao Zhang, Huaxiong Li, Xiuyi Jia, Chunlin Chen

Subjects: Multimedia (cs.MM)

[15] arXiv:2207.11900 [pdf, other]

Title: GA2MIF: Graph and Attention Based Two-Stage Multi-Source Information Fusion for Conversational Emotion Detection

Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng

Comments: Accepted by IEEE Transactions on Affective Computing

Subjects: Multimedia (cs.MM)

[16] arXiv:2207.12903 [pdf, other]

Title: Playback-centric visualisations of video usage using weighted interactions to guide where to watch in an educational context

Hyowon Lee, Mingming Liu, Michael Scriney, Alan F. Smeaton

Journal-ref: Front. Educ. 7:733646 (2022)

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[17] arXiv:2207.13530 [pdf, other]

Title: A Hybrid Deep Animation Codec for Low-bitrate Video Conferencing

Goluck Konuko, Stéphane Lathuilière, Giuseppe Valenzise

Comments: Preprint paper. Accepted for publication at ICIP 2022

Subjects: Multimedia (cs.MM); Image and Video Processing (eess.IV)

[18] arXiv:2207.14087 [pdf, other]

Title: CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation

Hao Sun, Hongyi Wang, Jiaqing Liu, Yen-Wei Chen, Lanfen Lin

Comments: Accepted by ACM MM 2022

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[19] arXiv:2207.14534 [pdf, other]

Title: ACM Multimedia Grand Challenge on Detecting Cheapfakes

Shivangi Aneja, Cise Midoglu, Duc-Tien Dang-Nguyen, Sohail Ahmed Khan, Michael Riegler, Pål Halvorsen, Chris Bregler, Balu Adsumilli

Comments: arXiv admin note: substantial text overlap with arXiv:2107.05297

Subjects: Multimedia (cs.MM)

[20] arXiv:2207.00056 (cross-list from cs.LG) [pdf, other]

Title: MultiViz: Towards Visualizing and Understanding Multimodal Models

Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe Morency, Ruslan Salakhutdinov

Comments: ICLR 2023. Code available at: this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[21] arXiv:2207.00231 (cross-list from eess.IV) [pdf, other]

Title: Motion Compensated Frequency Selective Extrapolation for Error Concealment in Video Coding

Jürgen Seiler, André Kaup

Journal-ref: 16th European Signal Processing Conference, 2008

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[22] arXiv:2207.00282 (cross-list from cs.CV) [pdf, other]

Title: (Un)likelihood Training for Interpretable Embedding

Jiaxin Wu, Chong-Wah Ngo, Wing-Kwong Chan, Zhijian Hou

Comments: accepted in ACM Transactions on Information Systems

Subjects: Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Multimedia (cs.MM)

[23] arXiv:2207.00419 (cross-list from cs.CV) [pdf, other]

Title: Self-Supervised Learning for Videos: A Survey

Madeline C. Schiappa, Yogesh S. Rawat, Mubarak Shah

Comments: ACM CSUR (December 2022). Project Link: this https URL

Journal-ref: ACM Comput. Surv. (December 2022)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[24] arXiv:2207.00522 (cross-list from eess.IV) [pdf, other]

Title: Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

Thuc Nguyen Huu, Vinh Van Duong, Jonghoon Yim, Byeungwoo Jeon

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[25] arXiv:2207.00993 (cross-list from cs.SD) [pdf, other]

Title: Towards Error-Resilient Neural Speech Coding

Huaying Xue, Xiulian Peng, Xue Jiang, Yan Lu

Comments: 5 pages, Interspeech 2022(Accepted)

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[26] arXiv:2207.01058 (cross-list from cs.AI) [pdf, other]

Title: Chat-to-Design: AI Assisted Personalized Fashion Design

Weiming Zhuang, Chongjie Ye, Ying Xu, Pengzhi Mao, Shuai Zhang

Subjects: Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[27] arXiv:2207.01077 (cross-list from cs.CV) [pdf, other]

Title: Can Language Understand Depth?

Renrui Zhang, Ziyao Zeng, Ziyu Guo, Yafeng Li

Journal-ref: ACM Multimedia 2022 (Brave New Idea)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[28] arXiv:2207.01113 (cross-list from cs.CV) [pdf, other]

Title: Are 3D Face Shapes Expressive Enough for Recognising Continuous Emotions and Action Unit Intensities?

Mani Kumar Tellamekala, Ömer Sümer, Björn W. Schuller, Elisabeth André, Timo Giesbrecht, Michel Valstar

Comments: Accepted to IEEE Transactions on Affective Computing

Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[29] arXiv:2207.01197 (cross-list from cs.SD) [pdf, other]

Title: Multi-Modal Multi-Correlation Learning for Audio-Visual Speech Separation

Xiaoyu Wang, Xiangyu Kong, Xiulian Peng, Yan Lu

Comments: 5 pages, accepted by interspeech2022

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[30] arXiv:2207.01210 (cross-list from eess.IV) [pdf, other]

Title: Reusing the H.264/AVC deblocking filter for efficient spatio-temporal prediction in video coding

Jürgen Seiler, André Kaup

Journal-ref: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 1049-1052

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[31] arXiv:2207.01508 (cross-list from cs.CY) [pdf, other]

Title: Understanding misinformation in India: The case for a meaningful regulatory approach for social media platforms

Gandharv Dhruv Madan

Comments: 10 pages

Subjects: Computers and Society (cs.CY); Multimedia (cs.MM)

[32] arXiv:2207.01698 (cross-list from cs.SD) [pdf, other]

Title: An adaptive music generation architecture for games based on the deep learning Transformer mode

Gustavo Amaral Costa dos Santos, Augusto Baffa, Jean-Pierre Briot, Bruno Feijó, Antonio Luz Furtado

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[33] arXiv:2207.01708 (cross-list from cs.CV) [pdf, other]

Title: Disentangled Action Recognition with Knowledge Bases

Zhekun Luo, Shalini Ghosh, Devin Guillory, Keizo Kato, Trevor Darrell, Huijuan Xu

Comments: NAACL 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[34] arXiv:2207.01869 (cross-list from cs.CV) [pdf, other]

Title: Distance Matters in Human-Object Interaction Detection

Guangzhi Wang, Yangyang Guo, Yongkang Wong, Mohan Kankanhalli

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[35] arXiv:2207.02159 (cross-list from cs.CV) [pdf, other]

Title: Robustness Analysis of Video-Language Models Against Visual and Language Perturbations

Madeline C. Schiappa, Shruti Vyas, Hamid Palangi, Yogesh S. Rawat, Vibhav Vineet

Comments: NeurIPS 2022 Datasets and Benchmarks Track. This projects webpage is located at this https URL

Journal-ref: Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (2022)

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[36] arXiv:2207.02400 (cross-list from cs.CV) [pdf, other]

Title: Chairs Can be Stood on: Overcoming Object Bias in Human-Object Interaction Detection

Guangzhi Wang, Yangyang Guo, Yongkang Wong, Mohan Kankanhalli

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[37] arXiv:2207.02595 (cross-list from cs.CV) [pdf, other]

Title: FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Sampling

Haoning Wu, Chaofeng Chen, Jingwen Hou, Liang Liao, Annan Wang, Wenxiu Sun, Qiong Yan, Weisi Lin

Comments: Will appear on ECCV 2022. 14 Pages

Journal-ref: Proceedings of the European Conference on Computer Vision (ECCV) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[38] arXiv:2207.02639 (cross-list from cs.CV) [pdf, other]

Title: Adversarial Robustness of Visual Dialog

Lu Yu, Verena Rieser

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[39] arXiv:2207.03190 (cross-list from cs.SD) [pdf, other]

Title: Learning Music-Dance Representations through Explicit-Implicit Rhythm Synchronization

Jiashuo Yu, Junfu Pu, Ying Cheng, Rui Feng, Ying Shan

Comments: Accepted for publication in IEEE Transactions on Multimedia

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[40] arXiv:2207.03682 (cross-list from cs.CV) [pdf, other]

Title: Music-driven Dance Regeneration with Controllable Key Pose Constraints

Junfu Pu, Ying Shan

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[41] arXiv:2207.03723 (cross-list from cs.CV) [pdf, other]

Title: Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessment

Liang Liao, Kangmin Xu, Haoning Wu, Chaofeng Chen, Wenxiu Sun, Qiong Yan, Weisi Lin

Comments: Will appear on ACM MM 2022

Journal-ref: 2022 ACM International Conference on Multimedia

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[42] arXiv:2207.03800 (cross-list from cs.SD) [pdf, other]

Title: FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech Synthesis

Yongqi Wang, Zhou Zhao

Comments: 10 pages, 5 figures, accepted by ACMMM 2022

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[43] arXiv:2207.03827 (cross-list from cs.HC) [pdf, other]

Title: One Pixel, One Interaction, One Game: An Experiment in Minimalist Game Design

Pier Luca Lanzi, Daniele Loiacono, Alberto Arosio, Dorian Bucur, Davide Caio, Luca Capecchi, Maria Giulietta Cappelletti, Lorenzo Carnaghi, Marco Giuseppe Caruso, Valerio Ceraudo, Luca Contato, Luca Cornaggia, Christian Costanza, Tommaso Grilli, Sumero Lira, Luca Marchetti, Giulia Olivares, Barbara Pagano, Davide Pons, Michele Pirovano, Valentina Tosto

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[44] arXiv:2207.04200 (cross-list from cs.CV) [pdf, other]

Title: Learning Structured Representations of Visual Scenes

Meng-Jiun Chiou

Comments: Ph.D. thesis at the National University of Singapore

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[45] arXiv:2207.04203 (cross-list from cs.SD) [pdf, other]

Title: Learning to Separate Voices by Spatial Regions

Zhongweiyang Xu, Romit Roy Choudhury

Comments: Accepted to ICML 2022. For associated audio samples, see this https URL

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[46] arXiv:2207.04471 (cross-list from cs.SD) [pdf, other]

Title: Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio Representation

Jeong Choi, Seongwon Jang, Hyunsouk Cho, Sehee Chung

Comments: 2022 IEEE International Conference on Multimedia and Expo (ICME)

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[47] arXiv:2207.04589 (cross-list from eess.IV) [pdf, other]

Title: Learned Video Compression via Heterogeneous Deformable Compensation Network

Huairui Wang, Zhenzhong Chen, Chang Wen Chen

Journal-ref: IEEE Transactions on Multimedia, 2023

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[48] arXiv:2207.04858 (cross-list from cs.CV) [pdf, other]

Title: LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval

Jinbin Bai, Chunhui Liu, Feiyue Ni, Haofan Wang, Mengying Hu, Xiaofeng Guo, Lele Cheng

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[49] arXiv:2207.04945 (cross-list from cs.CV) [pdf, other]

Title: SHREC'22 Track: Sketch-Based 3D Shape Retrieval in the Wild

Jie Qin, Shuaihang Yuan, Jiaxin Chen, Boulbaba Ben Amor, Yi Fang, Nhat Hoang-Xuan, Chi-Bien Chu, Khoi-Nguyen Nguyen-Ngoc, Thien-Tri Cao, Nhat-Khang Ngo, Tuan-Luc Huynh, Hai-Dang Nguyen, Minh-Triet Tran, Haoyang Luo, Jianning Wang, Zheng Zhang, Zihao Xin, Yang Wang, Feng Wang, Ying Tang, Haiqin Chen, Yan Wang, Qunying Zhou, Ji Zhang, Hongyuan Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)

[50] arXiv:2207.05024 (cross-list from cs.CV) [pdf, other]

Title: Intra-Modal Constraint Loss For Image-Text Retrieval

Jianan Chen, Lu Zhang, Qiong Wang, Cong Bai, Kidiyo Kpalma

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[51] arXiv:2207.05042 (cross-list from cs.CV) [pdf, other]

Title: Audio-Visual Segmentation

Jinxing Zhou, Jianyuan Wang, Jiayi Zhang, Weixuan Sun, Jing Zhang, Stan Birchfield, Dan Guo, Lingpeng Kong, Meng Wang, Yiran Zhong

Comments: ECCV 2022; Code is available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[52] arXiv:2207.05192 (cross-list from cs.CV) [pdf, other]

Title: Patch-level instance-group discrimination with pretext-invariant learning for colitis scoring

Ziang Xu, Sharib Ali, Soumya Gupta, Simon Leedham, James E East, Jens Rittscher

Comments: 11

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[53] arXiv:2207.05483 (cross-list from cs.CV) [pdf, other]

Title: CorrI2P: Deep Image-to-Point Cloud Registration via Dense Correspondence

Siyu Ren, Yiming Zeng, Junhui Hou, Xiaodong Chen

Comments: Accepted by IEEE TCSVT

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[54] arXiv:2207.05500 (cross-list from cs.CV) [pdf, other]

Title: Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detection

Jiashuo Yu, Jinyu Liu, Ying Cheng, Rui Feng, Yuejie Zhang

Comments: ACM MM 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[55] arXiv:2207.05526 (cross-list from cs.CV) [pdf, other]

Title: Long-term Leap Attention, Short-term Periodic Shift for Video Classification

Hao Zhang, Lechao Cheng, Yanbin Hao, Chong-Wah Ngo

Comments: Accepted by ACM Multimedia 2022, 10 pages, 4 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[56] arXiv:2207.05577 (cross-list from cs.CV) [pdf, other]

Title: Learning from Label Relationships in Human Affect

Niki Maria Foteinopoulou, Ioannis Patras

Comments: Accepted at ACM Multimedia (ACMMM) 2022, 10 pages, 4 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[57] arXiv:2207.05688 (cross-list from cs.SD) [pdf, other]

Title: ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships

Chen Zhang, Luchin Chang, Songruoyao Wu, Xu Tan, Tao Qin, Tie-Yan Liu, Kejun Zhang

Comments: Accepted by ACMMM 2022, oral

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[58] arXiv:2207.05691 (cross-list from cs.LG) [pdf, other]

Title: The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress

Lukas Christ, Shahin Amiriparian, Alice Baird, Panagiotis Tzirakis, Alexander Kathan, Niklas Müller, Lukas Stappen, Eva-Maria Meßner, Andreas König, Alan Cowen, Erik Cambria, Björn W. Schuller

Comments: Baseline paper for the 3rd Multimodal Sentiment Analysis Challenge (MuSe) 2022, a full-day workshop at ACM Multimedia 2022

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[59] arXiv:2207.05791 (cross-list from cs.HC) [pdf, other]

Title: Perceived Conversation Quality in Spontaneous Interactions

Chirag Raman, Navin Raj Prabhu, Hayley Hung

Comments: First two authors contributed equally

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[60] arXiv:2207.05894 (cross-list from eess.IV) [pdf, other]

Title: Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compression

Jiahao Li, Bin Li, Yan Lu

Comments: Accepted by ACM MM 2022. Codes are at this https URL

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[61] arXiv:2207.06020 (cross-list from cs.SD) [pdf, other]

Title: Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition

Joanna Hong, Minsu Kim, Daehun Yoo, Yong Man Ro

Comments: Accepted at Interspeech 2022

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)

[62] arXiv:2207.06057 (cross-list from cs.SD) [pdf, other]

Title: Subband-based Generative Adversarial Network for Non-parallel Many-to-many Voice Conversion

Jian Ma, Zhedong Zheng, Hao Fei, Feng Zheng, Tat-seng Chua, Yi Yang

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[63] arXiv:2207.06078 (cross-list from cs.CV) [pdf, other]

Title: MultiStream: A Simple and Fast Multiple Cameras Visual Monitor and Directly Streaming

Jinwei Lin

Comments: 6 pages, 9 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[64] arXiv:2207.06580 (cross-list from cs.CV) [pdf, other]

Title: Proposal-Free Temporal Action Detection via Global Segmentation Mask Learning

Sauradip Nag, Xiatian Zhu, Yi-Zhe Song, Tao Xiang

Comments: ECCV 2022; Code available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[65] arXiv:2207.06717 (cross-list from cs.CL) [pdf, other]

Title: Layout-Aware Information Extraction for Document-Grounded Dialogue: Dataset, Method and Demonstration

Zhenyu Zhang, Bowen Yu, Haiyang Yu, Tingwen Liu, Cheng Fu, Jingyang Li, Chengguang Tang, Jian Sun, Yongbin Li

Comments: Accepted to ACM Multimedia (MM) Industry Track 2022

Subjects: Computation and Language (cs.CL); Multimedia (cs.MM)

[66] arXiv:2207.06983 (cross-list from cs.SD) [pdf, other]

Title: Multitrack Music Transformer

Hao-Wen Dong, Ke Chen, Shlomo Dubnov, Julian McAuley, Taylor Berg-Kirkpatrick

Comments: Accepted by ICASSP 2023. Demo: this https URL . Code: this https URL

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[67] arXiv:2207.07059 (cross-list from cs.CV) [pdf, other]

Title: Semi-Supervised Temporal Action Detection with Proposal-Free Masking

Sauradip Nag, Xiatian Zhu, Yi-Zhe Song, Tao Xiang

Comments: ECCV 2022; Code available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[68] arXiv:2207.07092 (cross-list from cs.CV) [pdf, other]

Title: Explaining Image Enhancement Black-Box Methods through a Path Planning Based Algorithm

Marco Cotogni, Claudio Cusano

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[69] arXiv:2207.07162 (cross-list from cs.SD) [pdf, other]

Title: Audio-guided Album Cover Art Generation with Genetic Algorithms

James Marien, Sam Leroux, Bart Dhoedt, Cedric De Boom

Comments: 8 pages, 6 figures, 4 tables

Subjects: Sound (cs.SD); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Audio and Speech Processing (eess.AS)

[70] arXiv:2207.07165 (cross-list from cs.SI) [pdf, other]

Title: Estimating Emotion Contagion on Social Media via Localized Diffusion in Dynamic Graphs

Trisha Mittal, Puneet Mathur, Rohan Chandra, Apurva Bhatt, Vikram Gupta, Debdoot Mukherjee, Aniket Bera, Dinesh Manocha

Subjects: Social and Information Networks (cs.SI); Multimedia (cs.MM)

[71] arXiv:2207.07278 (cross-list from cs.CV) [pdf, other]

Title: Boosting Multi-Modal E-commerce Attribute Value Extraction via Unified Learning Scheme and Dynamic Range Minimization

Mengyin Liu, Chao Zhu, Hongyu Gao, Weibo Gu, Hongfa Wang, Wei Liu, Xu-cheng Yin

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Multimedia (cs.MM)

[72] arXiv:2207.07520 (cross-list from cs.NI) [pdf, other]

Title: Short-Term Trajectory Prediction for Full-Immersive Multiuser Virtual Reality with Redirected Walking

Filip Lemic, Jakob Struye, Jeroen Famaey

Comments: 7 pages, 9 figures, 2 tables

Subjects: Networking and Internet Architecture (cs.NI); Machine Learning (cs.LG); Multimedia (cs.MM)

[73] arXiv:2207.07934 (cross-list from cs.CL) [pdf, html, other]

Title: Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model

Xiaolin Chen, Xuemeng Song, Liqiang Jing, Shuo Li, Linmei Hu, Liqiang Nie

Subjects: Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[74] arXiv:2207.07935 (cross-list from cs.SD) [pdf, other]

Title: Visually-aware Acoustic Event Detection using Heterogeneous Graphs

Amir Shirian, Krishna Somandepalli, Victor Sanchez, Tanaya Guha

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[75] arXiv:2207.08164 (cross-list from cs.CV) [pdf, other]

Title: Action-conditioned On-demand Motion Generation

Qiujing Lu, Yipeng Zhang, Mingjian Lu, Vwani Roychowdhury

Comments: Accepted by ACMMM 2022, 13 pages, 5 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[76] arXiv:2207.08184 (cross-list from cs.CV) [pdf, other]

Title: Zero-Shot Temporal Action Detection via Vision-Language Prompting

Sauradip Nag, Xiatian Zhu, Yi-Zhe Song, Tao Xiang

Comments: ECCV 2022; Code available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[77] arXiv:2207.08338 (cross-list from cs.CV) [pdf, other]

Title: MobileCodec: Neural Inter-frame Video Compression on Mobile Devices

Hoang Le, Liang Zhang, Amir Said, Guillaume Sautiere, Yang Yang, Pranav Shrestha, Fei Yin, Reza Pourreza, Auke Wiggers

Comments: ACM MMSys 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[78] arXiv:2207.08346 (cross-list from cs.GR) [pdf, other]

Title: Display of 3D Illuminations using Flying Light Specks

Shahram Ghandeharizadeh

Comments: A shorter version in the Proceedings of the 30th ACM International Conference on Multimedia (MM '22), October 10--14, 2022, Lisboa, Portugal, DOI this https URL, ISBN 978-1-4503-9203-7/22/10. See this https URL for experimental software

Subjects: Graphics (cs.GR); Multimedia (cs.MM); Robotics (cs.RO)

[79] arXiv:2207.08461 (cross-list from cs.CV) [pdf, other]

Title: Multi-dimension Geospatial feature learning for urban region function recognition

Wenjia Xu, Jiuniu Wang, Yirong Wu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[80] arXiv:2207.08689 (cross-list from cs.CV) [pdf, other]

Title: Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity

Wei Zhou, Zhou Wang

Comments: Accepted by ACMMM2022 this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[81] arXiv:2207.08739 (cross-list from cs.CV) [pdf, other]

Title: Rethinking Data Augmentation for Robust Visual Question Answering

Long Chen, Yuhang Zheng, Jun Xiao

Comments: Accepted to ECCV 2022; Codes: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[82] arXiv:2207.09192 (cross-list from cs.ET) [pdf, other]

Title: A self-contained and self-explanatory DNA storage system

Min Li, Jiashu Wu, Junbiao Dai, Qingshan Jiang, Qiang Qu, Xiaoluo Huang, Yang Wang

Comments: Accepted by Nature Scientific Reports

Subjects: Emerging Technologies (cs.ET); Databases (cs.DB); Multimedia (cs.MM)

[83] arXiv:2207.09927 (cross-list from cs.CV) [pdf, other]

Title: ViGAT: Bottom-up event recognition and explanation in video using factorized graph attention network

Nikolaos Gkalelis, Dimitrios Daskalakis, Vasileios Mezaris

Journal-ref: IEEE Access, vol. 10, pp. 108797-108816, 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[84] arXiv:2207.10355 (cross-list from cs.IR) [pdf, other]

Title: Unimodal vs. Multimodal Siamese Networks for Outfit Completion

Mariya Hendriksen, Viggo Overes

Comments: 3 pages, 2 figures

Subjects: Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[85] arXiv:2207.10574 (cross-list from cs.HC) [pdf, other]

Title: Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A Survey

Cigdem Beyan, Alessandro Vinciarelli, Alessio Del Bue

Comments: This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive version was published in ACM Computing Surveys, this https URL

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

[86] arXiv:2207.10760 (cross-list from cs.SD) [pdf, other]

Title: A Proposal for Foley Sound Synthesis Challenge

Keunwoo Choi, Sangshin Oh, Minsung Kang, Brian McFee

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[87] arXiv:2207.11247 (cross-list from cs.CV) [pdf, other]

Title: Panoptic Scene Graph Generation

Jingkang Yang, Yi Zhe Ang, Zujin Guo, Kaiyang Zhou, Wayne Zhang, Ziwei Liu

Comments: Accepted to ECCV'22 (Paper ID #222, Final Score 2222). Project Page: this https URL. OpenPSG Codebase: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[88] arXiv:2207.11401 (cross-list from cs.CL) [pdf, other]

Title: Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanations

Qian Yang, Yunxin Li, Baotian Hu, Lin Ma, Yuxing Ding, Min Zhang

Comments: 11 pages (including Supplementary Materials); Accepted to ACM MM 2022

Journal-ref: ACM International Conference on Multimedia. 2022. 3587-3597

Subjects: Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[89] arXiv:2207.11482 (cross-list from cs.CV) [pdf, other]

Title: Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Loss

Riccardo Franceschini, Enrico Fini, Cigdem Beyan, Alessandro Conti, Federica Arrigoni, Elisa Ricci

Comments: Accepted to 26th International Conference on Pattern Recognition (ICPR) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM)

[90] arXiv:2207.11638 (cross-list from eess.SP) [pdf, other]

Title: DCT Approximations Based on Chen's Factorization

C. J. Tablada, T. L. T. da Silveira, R. J. Cintra, F. M. Bayer

Comments: 19 pages, 8 figures, 5 tables

Journal-ref: Signal Processing: Image Communication, Volume 58, October 2017, Pages 14-23

Subjects: Signal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV); Methodology (stat.ME)

[91] arXiv:2207.11677 (cross-list from cs.CV) [pdf, other]

Title: Learnable Privacy-Preserving Anonymization for Pedestrian Images

Junwu Zhang, Mang Ye, Yao Yang

Comments: Accepted by ACMMM2022 \url{this https URL}

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[92] arXiv:2207.11718 (cross-list from cs.CV) [pdf, html, other]

Title: TIPS: Text-Induced Pose Synthesis

Prasun Roy, Subhankar Ghosh, Saumik Bhattacharya, Umapada Pal, Michael Blumenstein

Comments: Accepted in The European Conference on Computer Vision (ECCV) 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[93] arXiv:2207.11857 (cross-list from cs.NI) [pdf, other]

Title: SQP: Congestion Control for Low-Latency Interactive Video Streaming

Devdeep Ray (1 and 2), Connor Smith (1), Teng Wei (1), David Chu (1), Srinivasan Seshan (2) ((1) Google, (2) Carnegie Mellon University)

Comments: 14 pages, 2 page appendix

Subjects: Networking and Internet Architecture (cs.NI); Multimedia (cs.MM)

[94] arXiv:2207.11964 (cross-list from eess.AS) [pdf, other]

Title: ConceptBeam: Concept Driven Target Speech Extraction

Yasunori Ohishi, Marc Delcroix, Tsubasa Ochiai, Shoko Araki, Daiki Takeuchi, Daisuke Niizumi, Akisato Kimura, Noboru Harada, Kunio Kashino

Comments: Accepted to ACM Multimedia 2022

Subjects: Audio and Speech Processing (eess.AS); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)

[95] arXiv:2207.12261 (cross-list from cs.CL) [pdf, other]

Title: GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition

Jiang Li, Xiaoping Wang, Guoqing Lv, Zhigang Zeng

Comments: Accepted by IEEE Transactions on Multimedia (TMM)

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)

[96] arXiv:2207.12554 (cross-list from cs.CV) [pdf, html, other]

Title: Inter-Frame Compression for Dynamic Point Cloud Geometry Coding

Anique Akhtar, Zhu Li, Geert Van der Auwera

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[97] arXiv:2207.12625 (cross-list from cs.IR) [pdf, other]

Title: Adaptive Asymmetric Label-guided Hashing for Multimedia Search

Yitian Long

Comments: Submitted to APPLIED SCIENCES

Subjects: Information Retrieval (cs.IR); Multimedia (cs.MM)

[98] arXiv:2207.13064 (cross-list from cs.CV) [pdf, other]

Title: Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis

Trisha Mittal, Ritwik Sinha, Viswanathan Swaminathan, John Collomosse, Dinesh Manocha

Comments: Accepted to WACV2023 - Workshop on Manipulation, Adversarial, and Presentation Attacks in Biometrics

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[99] arXiv:2207.13162 (cross-list from cs.CV) [pdf, other]

Title: Retrieval-Augmented Transformer for Image Captioning

Sara Sarto, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara

Comments: CBMI 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[100] arXiv:2207.13361 (cross-list from cs.CV) [pdf, other]

Title: Learning Appearance-motion Normality for Video Anomaly Detection

Yang Liu, Jing Liu, Mengyang Zhao, Dingkang Yang, Xiaoguang Zhu, Liang Song

Comments: Accepted by ICME 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[101] arXiv:2207.13434 (cross-list from cs.SD) [pdf, other]

Title: End-To-End Audiovisual Feature Fusion for Active Speaker Detection

Fiseha B. Tesema, Zheyuan Lin, Shiqiang Zhu, Wei Song, Jason Gu, Hong Wu

Comments: To appear on the proceeding of the Fourteenth International Conference on Digital Image Processing (ICDIP 2022), May 20-23, Wuhan, China, 8 pages, 3 figures

Journal-ref: Proceedings Volume 12342, Fourteenth International Conference on Digital Image Processing (ICDIP 2022); 123422A (2022)

Subjects: Sound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[102] arXiv:2207.13458 (cross-list from cs.CV) [pdf, other]

Title: VICTOR: Visual Incompatibility Detection with Transformers and Fashion-specific contrastive pre-training

Stefanos-Iordanis Papadopoulos, Christos Koutlis, Symeon Papadopoulos, Ioannis Kompatsiaris

Comments: 14 pages, 6 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[103] arXiv:2207.13479 (cross-list from cs.CV) [pdf, other]

Title: AutoTransition: Learning to Recommend Video Transition Effects

Yaojie Shen, Libo Zhang, Kai Xu, Xiaojie Jin

Comments: To appear at ECCV 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[104] arXiv:2207.13867 (cross-list from cs.CV) [pdf, other]

Title: Generative Steganography Network

Ping Wei, Sheng Li, Xinpeng Zhang, Ge Luo, Zhenxing Qian, Qing Zhou

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[105] arXiv:2207.14168 (cross-list from cs.CV) [pdf, other]

Title: Content-oriented learned image compression

Meng Li, Shangyin Gao, Yihui Feng, Yibo Shi, Jing Wang

Comments: ECCV2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[106] arXiv:2207.14462 (cross-list from cs.HC) [pdf, other]

Title: Towards Reproducible Evaluations for Flying Drone Controllers in Virtual Environments

Zheng Li, Yiming Huang, Yui-Pan Yau, Pan Hui, Lik-Hang Lee

Comments: Accepted in IROS 2022

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Robotics (cs.RO)

[107] arXiv:2207.14463 (cross-list from eess.IV) [pdf, other]

Title: Low-Complexity Loeffler DCT Approximations for Image and Video Coding

D. F. G. Coelho, R. J. Cintra, F. M. Bayer, S. Kulasekera, A. Madanayake, P. A. C. Martinez, T. L. T. Silveira, R. S. Oliveira, V. S. Dimitrov

Comments: 25 pages, 11 figures, 7 tables

Journal-ref: J. Low Power Electron. Appl. 2018, 8(4), 46

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Signal Processing (eess.SP); Methodology (stat.ME)

[108] arXiv:2207.14507 (cross-list from cs.CV) [pdf, other]

Title: GPU-accelerated SIFT-aided source identification of stabilized videos

Andrea Montibeller, Cecilia Pasquini, Giulia Boato, Stefano Dell'Anna, Fernando Pérez-González

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[109] arXiv:2207.14757 (cross-list from cs.CV) [pdf, other]

Title: ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval

Nicola Messina, Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Fabrizio Falchi, Giuseppe Amato, Rita Cucchiara

Comments: CBMI 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)