Electrical Engineering and Systems Science > Image and Video Processing
[Submitted on 24 May 2019 (v1), revised 26 Sep 2019 (this version, v2), latest version 19 May 2021 (v5)]
Title:Segmentation of lesioned brain anatomy with deep volumetric neural networks and multiple spatial priors achieves human-level performance
View PDFAbstract:Conventional automated segmentation of MRI of the brain and head distinguishes different tissues based on image intensities and prior tissue probability maps (TPM). This works well for normal head anatomies, but fails in the presence of unexpected lesions. Deep convolutional neural networks leverage instead spatial patterns and can learn to segment lesions, but have thus far not leveraged prior probabilities. Here we add to a three-dimensional convolutional network spatial priors with a TPM, morphological priors with conditional random fields, and context with a wider field-of-view at lower resolution. We train and test these networks on images of 43 stroke patients and 4 healthy individuals which have been manually segmented. The analysis demonstrates the benefits of leveraging the three sources of prior information. We also provide an out-of-sample validation and clinical application of the approach on an additional 47 patients with disorders of consciousness. Importantly, we demonstrate that the new architecture, which we call MultiPrior network, surpaces the performance of expert human segmenters. We make the code and trained networks freely available.
Submission history
From: Lukas Hirsch [view email][v1] Fri, 24 May 2019 02:54:04 UTC (1,167 KB)
[v2] Thu, 26 Sep 2019 14:29:22 UTC (1,360 KB)
[v3] Mon, 25 Nov 2019 19:22:16 UTC (6,681 KB)
[v4] Mon, 11 May 2020 16:18:57 UTC (6,866 KB)
[v5] Wed, 19 May 2021 14:32:28 UTC (16,732 KB)
Current browse context:
eess.IV
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.