Computer Science > Computer Vision and Pattern Recognition
[Submitted on 8 Nov 2020 (v1), revised 20 May 2021 (this version, v8), latest version 25 Aug 2022 (v13)]
Title:An Psychophysical Oriented Saliency Map Prediction Model
View PDFAbstract:Visual attention is one of the most significant characteristics for selecting and understanding the outside redundancy world. The nature of complex scenes includes enormous redundancy. The human vision system can not process all information simultaneously because of visual information bottleneck. The human visual system mainly focuses on dominant parts of the scenes to reduce the input visual redundancy information. It is commonly known as visual attention prediction or visual saliency map. This paper proposes a new psychophysical saliency prediction architecture, WECSF, inspired by human low-level visual cortex function. The model consists of opponent color channels, wavelet transform, wavelet energy map, and contrast sensitivity function for extracting low-level image features and maximum approximation to the human visual system. The proposed model is evaluated several datasets, including MIT1003, MIT300, TORONTO, SID4VAM and UCF Sports dataset to explain its efficiency. We also quantitatively and qualitatively compared the performance of saliency prediction with other state-of-the-art models. Our model achieved very stable and good performance. Second, we also confirmed that Fourier and spectral-inspired saliency prediction models achieved outperformance compared to other start-of-the-art non-neural networks and even deep neural network models on psychophysical synthesis images. Finally, the proposed model also can be applied to spatial-temporal saliency prediction and got better performance.
Submission history
From: Qiang Li [view email][v1] Sun, 8 Nov 2020 20:58:05 UTC (18,832 KB)
[v2] Wed, 11 Nov 2020 11:59:43 UTC (18,832 KB)
[v3] Mon, 16 Nov 2020 13:21:22 UTC (18,889 KB)
[v4] Tue, 9 Feb 2021 14:58:19 UTC (27,965 KB)
[v5] Wed, 10 Feb 2021 11:07:16 UTC (27,965 KB)
[v6] Sun, 14 Feb 2021 13:58:03 UTC (27,965 KB)
[v7] Tue, 13 Apr 2021 19:53:53 UTC (27,965 KB)
[v8] Thu, 20 May 2021 20:17:41 UTC (27,970 KB)
[v9] Mon, 14 Jun 2021 20:45:46 UTC (27,970 KB)
[v10] Fri, 9 Jul 2021 11:29:57 UTC (25,686 KB)
[v11] Fri, 1 Oct 2021 19:34:33 UTC (25,832 KB)
[v12] Wed, 17 Nov 2021 21:25:26 UTC (9,974 KB)
[v13] Thu, 25 Aug 2022 20:29:20 UTC (10,175 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.