Computer Science > Machine Learning
[Submitted on 19 Feb 2015 (this version), latest version 1 Jul 2015 (v2)]
Title:Scale-Free Algorithms for Online Linear Optimization
View PDFAbstract:Online linear optimization problem models a situation where an algorithm repeatedly has to make a decision before it sees the loss function, which is a linear function of the decision. The performance of an algorithm is measured by the so-called regret, which is the difference between the cumulative loss of the algorithm and the cumulative loss of the best fixed decision in hindsight.
We present algorithms for online linear optimization that are oblivious to the scaling of the losses. That is, the algorithms make the exactly the same sequence of decisions if the loss functions are scaled by an arbitrary positive constant. Consequence of the scale invariance is that the algorithms do not need to know an upper bound on the norm of the loss vectors as an input. The bound on algorithms' regret is within constant factor of the previously known optimal bound for the situation where the scaling is known.
Coincidentally, the algorithms do not need to know the number of rounds and do not have any other tuning parameters.
Submission history
From: Francesco Orabona [view email][v1] Thu, 19 Feb 2015 23:05:04 UTC (39 KB)
[v2] Wed, 1 Jul 2015 20:56:34 UTC (34 KB)
Current browse context:
cs.LG
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
Connected Papers (What is Connected Papers?)
CORE Recommender (What is CORE?)
IArxiv Recommender
(What is IArxiv?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.