Mathematics > Statistics Theory
[Submitted on 27 Dec 2017 (this version), latest version 19 Aug 2019 (v3)]
Title:Minimax Estimation of Large Precision Matrices with Bandable Cholesky Factor
View PDFAbstract:This paper considers the estimation of large precision matrices. We focus on two commonly used types of parameter spaces with a bandable structure on the Cholesky factor of precision matrices. Last decade witnesses significant methodological advances and wide scientific applications in meteorology and spectroscopy. However, the minimax theory has still been largely unknown, as opposed to the well established minimax results over the corresponding two types of bandable covariance matrices. In this paper, we develop the optimal rates of convergence under both the operator norm and the Frobenius norm. A striking phenomenon is found: two types of parameter spaces are fundamentally different under the operator norm but enjoy the same rate optimality under the Frobenius norm, which is in sharp contrast to the equivalence of two types of bandable covariance matrices under both norms. This fundamental difference is largely established by carefully constructing the corresponding minimax lower bounds using the Le Cam and Assouad methods. Two new estimation procedures are developed: for the operator norm, our optimal procedure is based on a novel local cropping estimator targeting on all principle submatrices of the precision matrix while for the Frobenius norm, our optimal procedure relies on a delicate regression-based block-thresholding rule. We further establish rate optimality in the nonparanormal model by applying our local cropping procedure to the rank-based estimators. In the end, we carry out numerical studies to demonstrate the performance of our approach as well as illustrate the fundamental difference between two types of parameter spaces.
Submission history
From: Zhao Ren [view email][v1] Wed, 27 Dec 2017 03:26:25 UTC (350 KB)
[v2] Tue, 20 Feb 2018 06:35:21 UTC (353 KB)
[v3] Mon, 19 Aug 2019 03:47:33 UTC (425 KB)
Current browse context:
math.ST
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.