Multimedia

Authors and titles for February 2022

[1] arXiv:2202.02177 [pdf, other]

Title: Generalised Score Distribution: A Two-Parameter Discrete Distribution Accurately Describing Responses from Quality of Experience Subjective Experiments

Jakub Nawała (1), Lucjan Janowski (1), Bogdan Ćmiel (2), Krzysztof Rusek (1), Pablo Pérez (3) ((1) AGH University of Science and Technology, Institute of Telecommunications, (2) AGH University of Science and Technology, Department of Mathematical Analysis, Computational Mathematics and Probability Methods, (3) Applications & Platforms Software Systems, Nokia Bell Labs, Madrid, Spain)

Comments: 15 pages, 6 figures. Under review in IEEE Transactions on Multimedia

Journal-ref: IEEE Transactions on Multimedia, 2022

Subjects: Multimedia (cs.MM)

[2] arXiv:2202.03861 [pdf, other]

Title: Towards Making a Trojan-horse Attack on Text-to-Image Retrieval

Fan Hu, Aozhu Chen, Xirong Li

Comments: Accepted by ICASSP 2023

Subjects: Multimedia (cs.MM)

[3] arXiv:2202.04298 [pdf, other]

Title: Image Difference Captioning with Pre-training and Contrastive Learning

Linli Yao, Weiying Wang, Qin Jin

Comments: Accepted to AAAI2022

Subjects: Multimedia (cs.MM); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[4] arXiv:2202.09772 [pdf, other]

Title: Context-aware adaptation of mobile video decoding resolution

Octavian Machidon, Jani Asprov, Tine Fajfar, Veljko Pejovic

Subjects: Multimedia (cs.MM); Human-Computer Interaction (cs.HC)

[5] arXiv:2202.11038 [pdf, other]

Title: Banding vs. Quality: Perceptual Impact and Objective Assessment

Lukáš Krasula, Zhi Li, Christos G. Bampis, Mariana Afonso, Nil Fons Miret, Joel Sole

Comments: Submitted to IEEE International Conference on Image Processing (ICIP) 2022

Subjects: Multimedia (cs.MM); Image and Video Processing (eess.IV)

[6] arXiv:2202.12478 [pdf, html, other]

Title: GAME-ON: Graph Attention Network based Multimodal Fusion for Fake News Detection

Mudit Dhawan, Shakshi Sharma, Aditya Kadam, Rajesh Sharma, Ponnurangam Kumaraguru

Comments: Accepted at SNAM 2024

Subjects: Multimedia (cs.MM); Machine Learning (cs.LG)

[7] arXiv:2202.12987 [pdf, other]

Title: A Brief Survey on Adaptive Video Streaming Quality Assessment

Wei Zhou, Xiongkuo Min, Hong Li, Qiuping Jiang

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

[8] arXiv:2202.13673 [pdf, other]

Title: Recent Advances and Challenges in Deep Audio-Visual Correlation Learning

Luís Vilaça, Yi Yu, Paula Viana

Comments: 8 pages, 1 figure

Subjects: Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[9] arXiv:2202.00253 (cross-list from cs.CR) [pdf, other]

Title: A Novel Pair and Matching Algorithm for Embedding Secret Messages in Images

P N Priya, R Ranjitha, Yashaswini Naik, Shrilekha, Rama Moorthy H

Comments: Accepted and Published in the International Journal of Emerging Trends & Technology in Computer Science (IJETTCS). Volume 6, Issue 3, May- June 2017

Subjects: Cryptography and Security (cs.CR); Multimedia (cs.MM)

[10] arXiv:2202.00382 (cross-list from eess.IV) [pdf, other]

Title: A Privacy-Preserving Image Retrieval Scheme with a Mixture of Plain and EtC Images

Kenta Iida, Hitoshi Kiya

Comments: This paper will be presented at IEEE LifeTech 2022. arXiv admin note: text overlap with arXiv:2011.00270

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[11] arXiv:2202.00900 (cross-list from cs.HC) [pdf, other]

Title: Augmenting Immersive Telepresence Experience with a Virtual Body

Nikunj Arora, Markku Suomalainen, Matti Pouke, Evan G. Center, Katherine J. Mimnaugh, Alexis P. Chambers, Sakaria Pouke, Steven M. LaValle

Comments: Accepted for publication in Transactions in Visualization and Computer Graphics (TVCG), to be presented in IEEE VR 2022

Journal-ref: IEEE Transactions on Visualization and Computer Graphics (2022)

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM); Robotics (cs.RO)

[12] arXiv:2202.00951 (cross-list from eess.AS) [pdf, other]

Title: TONet: Tone-Octave Network for Singing Melody Extraction from Polyphonic Music

Ke Chen, Shuai Yu, Cheng-i Wang, Wei Li, Taylor Berg-Kirkpatrick, Shlomo Dubnov

Comments: Preprint Version for ICASSP 2022, Singapore

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)

[13] arXiv:2202.01031 (cross-list from cs.CV) [pdf, other]

Title: MMSys'22 Grand Challenge on AI-based Video Production for Soccer

Cise Midoglu, Steven A. Hicks, Vajira Thambawita, Tomas Kupka, Pål Halvorsen

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[14] arXiv:2202.01740 (cross-list from cs.HC) [pdf, other]

Title: Technological Factors Influencing Videoconferencing and Zoom Fatigue

Alexander Raake, Markus Fiedler, Katrin Schoenenberg, Katrien De Moor, Nicola Döring

Comments: 15 pages

Subjects: Human-Computer Interaction (cs.HC); Computers and Society (cs.CY); Multimedia (cs.MM)

[15] arXiv:2202.02112 (cross-list from cs.SD) [pdf, other]

Title: Musical Audio Similarity with Self-supervised Convolutional Neural Networks

Carl Thomé, Sebastian Piwell, Oscar Utterbäck

Comments: ISMIR LBD 2021

Subjects: Sound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[16] arXiv:2202.02115 (cross-list from cs.SD) [pdf, other]

Title: Polyphonic pitch detection with convolutional recurrent neural networks

Carl Thomé, Sven Ahlbäck

Comments: MIREX 2017

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[17] arXiv:2202.02277 (cross-list from eess.IV) [pdf, other]

Title: Quality Assessment of Low Light Restored Images: A Subjective Study and an Unsupervised Model

Vignesh Kannan, Sameer Malik, Rajiv Soundararajan

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Machine Learning (stat.ML)

[18] arXiv:2202.02454 (cross-list from cs.NI) [pdf, other]

Title: Supervised Learning based QoE Prediction of Video Streaming in Future Networks: A Tutorial with Comparative Study

Arslan Ahmad, Atif Bin Mansoor, Alcardo Alex Barakabitze, Andrew Hines, Luigi Atzori, Ray Walshe

Journal-ref: IEEE Communications Magazine, vol. 59, no. 11, pp. 88-94, November 2021

Subjects: Networking and Internet Architecture (cs.NI); Machine Learning (cs.LG); Multimedia (cs.MM)

[19] arXiv:2202.02518 (cross-list from cs.CV) [pdf, other]

Title: On the predictability in reversible steganography

Ching-Chun Chang, Xu Wang, Sisheng Chen, Hitoshi Kiya, Isao Echizen

Journal-ref: Telecommunication Systems (2023), vol. 82, no. 2, pp. 301-313

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Image and Video Processing (eess.IV)

[20] arXiv:2202.03384 (cross-list from cs.IR) [pdf, other]

Title: Hybrid Contrastive Quantization for Efficient Cross-View Video Retrieval

Jinpeng Wang, Bin Chen, Dongliang Liao, Ziyun Zeng, Gongfu Li, Shu-Tao Xia, Jin Xu

Comments: Accepted to The Web Conference 2022 (WWW'22). 11 pages, 5 tables, 6 figures

Subjects: Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Social and Information Networks (cs.SI)

[21] arXiv:2202.03427 (cross-list from eess.IV) [pdf, other]

Title: Performance Evaluation of Infrared Image Enhancement Techniques

Rania Gaber, AbdElmgied Ali, Kareem Ahmed

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[22] arXiv:2202.04015 (cross-list from cs.CV) [pdf, other]

Title: NEWSKVQA: Knowledge-Aware News Video Question Answering

Pranay Gupta, Manish Gupta

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[23] arXiv:2202.04703 (cross-list from cs.NI) [pdf, other]

Title: Improving Content-Aware Video Streaming in Congested Networks with In-Network Computing

Leonardo Gobatto, Mateus Saquetti, Claudio Diniz, Bruno Zatt, Weverton Cordeiro, Jose Rodrigo Azambuja

Subjects: Networking and Internet Architecture (cs.NI); Hardware Architecture (cs.AR); Multimedia (cs.MM)

[24] arXiv:2202.05514 (cross-list from eess.IV) [pdf, other]

Title: Dilated convolutional neural network-based deep reference picture generation for video compression

Haoyue Tian, Pan Gao, Ran Wei, Manoranjan Paul

Subjects: Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[25] arXiv:2202.05528 (cross-list from cs.AI) [pdf, other]

Title: MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

Rui Guo, Ivor Simpson, Chris Kiefer, Thor Magnusson, Dorien Herremans

Comments: preprint for The 11th International Conference on Artificial Intelligence in Music, Sound, Art and Design (EvoMUSART) 2022

Subjects: Artificial Intelligence (cs.AI); Multimedia (cs.MM)

[26] arXiv:2202.05677 (cross-list from eess.IV) [pdf, other]

Title: Cross-Block Difference Guided Fast CU Partition for VVC Intra Coding

Hewei Liu, Shuyuan Zhu, Ruiqin Xiong, Guanghui Liu, Bing Zeng

Comments: Accepted by 2021 VCIP

Subjects: Image and Video Processing (eess.IV); Multimedia (cs.MM)

[27] arXiv:2202.05817 (cross-list from cs.SD) [pdf, other]

Title: The HaMSE Ontology: Using Semantic Technologies to support Music Representation Interoperability and Musicological Analysis

Andrea Poltronieri, Aldo Gangemi

Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[28] arXiv:2202.06034 (cross-list from cs.SD) [pdf, other]

Title: Deep Performer: Score-to-Audio Music Performance Synthesis

Hao-Wen Dong, Cong Zhou, Taylor Berg-Kirkpatrick, Julian McAuley

Comments: ICASSP 2022 final version with appendix

Subjects: Sound (cs.SD); Machine Learning (cs.LG); Multimedia (cs.MM); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)

[29] arXiv:2202.06338 (cross-list from eess.AS) [pdf, other]

Title: DEEPCHORUS: A Hybrid Model of Multi-scale Convolution and Self-attention for Chorus Detection

Qiqi He, Xiaoheng Sun, Yi Yu, Wei Li

Comments: Accepted by ICASSP 2022

Subjects: Audio and Speech Processing (eess.AS); Multimedia (cs.MM)

[30] arXiv:2202.06358 (cross-list from cs.CV) [pdf, other]

Title: Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplars

Wanglong Lu, Hanli Zhao, Xianta Jiang, Xiaogang Jin, Yongliang Yang, Min Wang, Jiankai Lyu, Kaijie Shi

Comments: There are 16 pages, 18 figures in this paper. Homepage: this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Multimedia (cs.MM)

[31] arXiv:2202.06777 (cross-list from cs.CV) [pdf, html, other]

Title: Multi-scale Attention Guided Pose Transfer

Prasun Roy, Saumik Bhattacharya, Subhankar Ghosh, Umapada Pal

Comments: Accepted in Pattern Recognition (PR) 2023

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[32] arXiv:2202.06875 (cross-list from cs.CV) [pdf, other]

Title: Visual Acoustic Matching

Changan Chen, Ruohan Gao, Paul Calamia, Kristen Grauman

Comments: Project page: this https URL. Accepted at CVPR 2022

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[33] arXiv:2202.07247 (cross-list from cs.CV) [pdf, other]

Title: CommerceMM: Large-Scale Commerce MultiModal Representation Learning with Omni Retrieval

Licheng Yu, Jun Chen, Animesh Sinha, Mengjiao MJ Wang, Hugo Chen, Tamara L. Berg, Ning Zhang

Comments: 10 pages, 7 figures. Commerce Multimodal Model towards Real Applications at Facebook

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM); Social and Information Networks (cs.SI)

[34] arXiv:2202.08100 (cross-list from cs.CV) [pdf, other]

Title: Reversible data hiding with dual pixel-value-ordering and1minimum prediction error expansion

Md. Abdul Wahed, Hussain Nyeem

Comments: Submitted to Plos One [PONE-D-21-21353R1]

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[35] arXiv:2202.09081 (cross-list from eess.AS) [pdf, other]

Title: VCVTS: Multi-speaker Video-to-Speech synthesis via cross-modal knowledge transfer from voice conversion

Disong Wang, Shan Yang, Dan Su, Xunying Liu, Dong Yu, Helen Meng

Comments: Accepted to ICASSP 2022. Demo page is available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Image and Video Processing (eess.IV)

[36] arXiv:2202.09082 (cross-list from eess.AS) [pdf, other]

Title: Speaker Identity Preservation in Dysarthric Speech Reconstruction by Adversarial Speaker Adaptation

Disong Wang, Songxiang Liu, Xixin Wu, Hui Lu, Lifa Sun, Xunying Liu, Helen Meng

Comments: Accepted to ICASSP 2022. Demo page is available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Multimedia (cs.MM); Sound (cs.SD); Signal Processing (eess.SP)

[37] arXiv:2202.09102 (cross-list from cs.SD) [pdf, other]

Title: Predicting Sex and Stroke Success -- Computer-aided Player Grunt Analysis in Tennis Matches

Lukas Stappen, Manuel Milling, Valentin Munst, Korakot Hoffmann, Bjorn W. Schuller

Subjects: Sound (cs.SD); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[38] arXiv:2202.09195 (cross-list from cs.LG) [pdf, other]

Title: A Review on Methods and Applications in Multimodal Deep Learning

Jabeen Summaira, Xi Li, Amin Muhammad Shoib, Jabbar Abdul

Comments: 29 pages. arXiv admin note: substantial text overlap with arXiv:2105.11087

Journal-ref: ACM Transactions on Multimedia Computing, Communications, and Applications 2022

Subjects: Machine Learning (cs.LG); Multimedia (cs.MM)

[39] arXiv:2202.09263 (cross-list from cs.LG) [pdf, other]

Title: Is Cross-Attention Preferable to Self-Attention for Multi-Modal Emotion Recognition?

Vandana Rajan, Alessio Brutti, Andrea Cavallaro

Comments: Accepted at ICASSP 2022

Subjects: Machine Learning (cs.LG); Multimedia (cs.MM)

[40] arXiv:2202.10453 (cross-list from cs.CV) [pdf, other]

Title: Predicting emotion from music videos: exploring the relative contribution of visual and auditory information to affective responses

Phoebe Chua (1), Dimos Makris (2), Dorien Herremans (2), Gemma Roig (3), Kat Agres (4) ((1) Department of Information Systems and Analytics, National University of Singapore, (2) Singapore University of Technology and Design, (3) Goethe University Frankfurt, (4) Yong Siew Toh Conservatory of Music, National University of Singapore)

Comments: 16 pages with 9 figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

[41] arXiv:2202.10492 (cross-list from cs.CV) [pdf, other]

Title: CaMEL: Mean Teacher Learning for Image Captioning

Manuele Barraco, Matteo Stefanini, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)

[42] arXiv:2202.10881 (cross-list from cs.CV) [pdf, other]

Title: Coordinate-Aligned Multi-Camera Collaboration for Active Multi-Object Tracking

Zeyu Fang, Jian Zhao, Mingyu Yang, Wengang Zhou, Zhenbo Lu, Houqiang Li

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[43] arXiv:2202.12799 (cross-list from cs.HC) [pdf, other]

Title: Subjective Functionality and Comfort Prediction for Apartment Floor Plans and Its Application to Intuitive Searches

Taro Narahara, Toshihiko Yamasaki

Subjects: Human-Computer Interaction (cs.HC); Multimedia (cs.MM)

[44] arXiv:2202.12823 (cross-list from cs.LG) [pdf, other]

Title: GenéLive! Generating Rhythm Actions in Love Live!

Atsushi Takada, Daichi Yamazaki, Likun Liu, Yudai Yoshida, Nyamkhuu Ganbat, Takayuki Shimotomai, Taiga Yamamoto, Daisuke Sakurai, Naoki Hamada

Comments: 15 pages, 13 figures, to appear at AAAI-23

Subjects: Machine Learning (cs.LG); Multimedia (cs.MM); Neural and Evolutionary Computing (cs.NE); Sound (cs.SD); Machine Learning (stat.ML)

[45] arXiv:2202.12951 (cross-list from cs.CV) [pdf, other]

Title: Model Attribution of Face-swap Deepfake Videos

Shan Jia, Xin Li, Siwei Lyu

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[46] arXiv:2202.13133 (cross-list from cs.CV) [pdf, other]

Title: Automation of reversible steganographic coding with nonlinear discrete optimisation

Ching-Chun Chang

Journal-ref: Connection Science (2022), vol. 34, no. 1, 1719-1735

Subjects: Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

[47] arXiv:2202.13277 (cross-list from eess.AS) [pdf, other]

Title: Learning the Beauty in Songs: Neural Singing Voice Beautifier

Jinglin Liu, Chengxi Li, Yi Ren, Zhiying Zhu, Zhou Zhao

Comments: Accepted by ACL 2022 Main conference; Code: this https URL

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM); Sound (cs.SD)