Computer Science > Computer Vision and Pattern Recognition
[Submitted on 8 Nov 2020 (v1), revised 10 Feb 2021 (this version, v5), latest version 25 Aug 2022 (v13)]
Title:An HVS-Oriented Saliency Map Prediction Model
View PDFAbstract:Visual attention is one of the most significant characteristics for selecting and understanding the outside redundancy world. The nature complex scenes, including larger redundancy and human vision, cannot be processing all information simultaneously because of the information bottleneck. The human visual system mainly focuses on dominant parts of the scenes to reduce the input visual redundancy information. It is commonly known as visual attention prediction or visual saliency map. This paper proposes a new saliency prediction architecture WECSF which inspired by human low-level visual cortex function. The model consists of opponent color channels, wavelet transform, wavelet energy map, and contrast sensitivity function for extracting low-level image features and maximum approximation to the human visual system. The proposed model is evaluated several datasets, including MIT1003, MIT300, TORONTO, SID4VAM and UCF Sports dataset to explain its efficiency. The proposed model results are quantitatively and qualitatively compared to other state-of-the-art salience prediction models. Compared with the baseline model, our model achieved very good performance. Secondly, we also confirmed Fourier/Spectral inspired saliency prediction models has the best prediction scores compared to other start-of-the-art non-neural network and even deep neural network models on the simple image features saliency prediction. Finally, the model also can be applied to spatial-temporal saliency prediction and got better performance.
Submission history
From: Qiang Li [view email][v1] Sun, 8 Nov 2020 20:58:05 UTC (18,832 KB)
[v2] Wed, 11 Nov 2020 11:59:43 UTC (18,832 KB)
[v3] Mon, 16 Nov 2020 13:21:22 UTC (18,889 KB)
[v4] Tue, 9 Feb 2021 14:58:19 UTC (27,965 KB)
[v5] Wed, 10 Feb 2021 11:07:16 UTC (27,965 KB)
[v6] Sun, 14 Feb 2021 13:58:03 UTC (27,965 KB)
[v7] Tue, 13 Apr 2021 19:53:53 UTC (27,965 KB)
[v8] Thu, 20 May 2021 20:17:41 UTC (27,970 KB)
[v9] Mon, 14 Jun 2021 20:45:46 UTC (27,970 KB)
[v10] Fri, 9 Jul 2021 11:29:57 UTC (25,686 KB)
[v11] Fri, 1 Oct 2021 19:34:33 UTC (25,832 KB)
[v12] Wed, 17 Nov 2021 21:25:26 UTC (9,974 KB)
[v13] Thu, 25 Aug 2022 20:29:20 UTC (10,175 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.