Computer Science > Computer Vision and Pattern Recognition
[Submitted on 18 Jun 2020 (v1), revised 24 Nov 2020 (this version, v3), latest version 30 Mar 2021 (v4)]
Title:Task-agnostic Unsupervised Out-of-Distribution Detection Using Kernel Density Estimation
View PDFAbstract:In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to classification tasks. Attempts for generally applicable methods beyond classification did not attain similar performance. In this paper, we propose a task-agnostic unsupervised OOD detection method using kernel density estimation (KDE) that addresses this limitation. We estimate the probability density functions (pdfs) of intermediate features of an already trained network, by performing KDE on the training dataset. As direct application of KDE to feature maps is hindered by their high dimensionality, we use a set of channel-wise marginalized KDE models instead of a single high-dimensional one. At test time, we evaluate the pdfs on a test sample and combine the resulting channel-wise scores with a logistic regression into a final confidence score that indicates the sample is OOD. Crucially, the proposed method is task agnostic as we only use intermediate features without requiring information on class labels nor the structure of the output, and attains high accuracy thanks to the flexibility of KDE. We performed experiments on DNNs trained for segmentation, detection and classification tasks, using benchmark datasets for OOD detection. The proposed method substantially outperformed existing works for non-classification networks while achieving on-par accuracy with the state-of-the-art for classification networks. The results demonstrate that the proposed method attains high OOD detection accuracy across different tasks, offering a larger scope of applications than existing task-specific methods and improving state-of-the-art for task-agnostic methods. The code will be made available.
Submission history
From: Ertunc Erdil [view email][v1] Thu, 18 Jun 2020 17:46:06 UTC (140 KB)
[v2] Tue, 6 Oct 2020 20:39:03 UTC (433 KB)
[v3] Tue, 24 Nov 2020 11:29:14 UTC (369 KB)
[v4] Tue, 30 Mar 2021 21:55:47 UTC (1,014 KB)
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.