Computer Science > Information Theory
[Submitted on 21 Jun 2012 (v1), revised 6 Apr 2013 (this version, v5), latest version 3 Jul 2014 (v6)]
Title:Smoothed Functional Algorithms for Stochastic Optimization using q-Gaussian Distributions
View PDFAbstract:The importance of the q-Gaussian family of distributions lies in its power-law nature, and its close association with Gaussian, Cauchy and uniform distributions. This class of distributions arises from maximization of a generalized information measure. We use the power-law nature of the q-Gaussian distribution to improve upon the smoothing properties of Gaussian and Cauchy distributions. Based on this, we propose a Smoothed Functional (SF) scheme for gradient estimation using q-Gaussian distribution. Our work extends the class of distributions that can be used in SF algorithms by including the q-Gaussian distributions, which encompass the above three distributions as special cases. Using the derived gradient estimates, we propose two-timescale algorithms for optimization of a stochastic objective function with gradient descent method. We prove that the proposed algorithms converge to a local optimum. Performance of the algorithms is shown by simulation results on a queuing model.
Submission history
From: Debarghya Ghoshdastidar [view email][v1] Thu, 21 Jun 2012 11:03:50 UTC (251 KB)
[v2] Tue, 18 Sep 2012 14:35:25 UTC (188 KB)
[v3] Thu, 20 Sep 2012 04:39:45 UTC (465 KB)
[v4] Fri, 21 Sep 2012 05:48:05 UTC (465 KB)
[v5] Sat, 6 Apr 2013 09:20:52 UTC (204 KB)
[v6] Thu, 3 Jul 2014 04:56:30 UTC (756 KB)
Current browse context:
cs.IT
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.