Statistics > Methodology
[Submitted on 4 Jan 2010 (this version), latest version 21 Jan 2011 (v2)]
Title:Graphically dependent and spatially varying Dirichlet process mixtures
View PDFAbstract: We consider the problem of clustering grouped and functional data, which are indexed by a covariate, and assessing the dependency of the clustered groups on the covariate. We assume that each observation within a group is a draw from a mixture model. The mixture components and the number of such components can change with the covariate, and are assumed to be unknown a priori. In addition to learning the "local" clusters within each group we also assume the existence of "global clusters" indexed over the covariate domain when the observations across the groups are jointly analyzed. The number of global clusters is also unknown and to be inferred from the data. We propose a nonparametric Bayesian solution to this problem, reposing on the theory of dependent Dirichlet processes, where the dependency among the Dirichlet processes is regulated by a spatial or a graphical model distribution indexed by the covariate. In our proposed model, the global clusters are supported by a Dirichlet process, while the local clusters are randomly selected using another hierarchy of Dirichlet processes. We provide an analysis of the model properties, including a stick-breaking and a Pólya-urn scheme characterization. The graphical and spatial dependency are investigated, along with a discussion of the model identifiability. We present MCMC sampling methods, and discuss the computational implications of using a spatial or a graphical model distribution as the base measure in our model. Finally, the model behavior and inference algorithm are demonstrated by several data examples, including a clustering analysis of the progesterone hormone data.
Submission history
From: XuanLong Nguyen [view email][v1] Mon, 4 Jan 2010 22:47:31 UTC (144 KB)
[v2] Fri, 21 Jan 2011 15:42:15 UTC (165 KB)
Current browse context:
stat.ME
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.