Skip to main content
We gratefully acknowledge support from the Simons Foundation, member institutions, and all contributors. Donate
arXiv logo
Cornell University Logo

Mathematics > Optimization and Control

arXiv:2502.12957 (math)
[Submitted on 18 Feb 2025]

Title:A measure-valued HJB perspective on Bayesian optimal adaptive control

Authors:Alexander M.G. Cox, Sigrid Källblad, Chaorui Wang
View PDF HTML (experimental)
Abstract:We consider a Bayesian adaptive optimal stochastic control problem where a hidden static signal has a non-separable influence on the drift of a noisy observation. Being allowed to control the specific form of this dependence, we aim at optimising a cost functional depending on the posterior distribution of the hidden signal. Expressing the dynamics of this posterior distribution in the observation filtration, we embed our problem into a genuinely infinite-dimensional stochastic control problem featuring so-called measure-valued martingales. We address this problem by use of viscosity theory and approximation arguments. Specifically, we show equivalence to a corresponding weak formulation, characterise the optimal value of the problem in terms of the unique continuous viscosity solution of an associated HJB equation, and construct a piecewise constant and arbitrarily-close-to-optimal control to our main problem of study.
Subjects: Optimization and Control (math.OC); Probability (math.PR); Mathematical Finance (q-fin.MF)
MSC classes: 49L25, 60G35, 60H10, 62M20, 93E35, 93E10
Cite as: arXiv:2502.12957 [math.OC]
  (or arXiv:2502.12957v1 [math.OC] for this version)
  https://doi.org/10.48550/arXiv.2502.12957

Submission history

From: Sigrid Källblad [view email]
[v1] Tue, 18 Feb 2025 15:42:05 UTC (35 KB)
Full-text links:

Access Paper:

view license
Current browse context:
math.OC
< prev   |   next >
new | recent | 2025-02
Change to browse by:
math
math.PR
q-fin
q-fin.MF

References & Citations

export BibTeX citation

Bookmark

BibSonomy logo Reddit logo

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)