In this paper we consider the optimal control of Hilbert space-valued infinite-dimensional Piecewise Deterministic Markov Processes (PDMP) and we prove that the corresponding value function can be represented via a Feynman–Kac type formula through the solution of a constrained Backward Stochastic Differential Equation. A fundamental step consists in showing that the corresponding integro-differential Hamilton–Jacobi–Bellman equation has a unique viscosity solution, by proving a suitable comparison theorem. We apply our results to the control of a PDMP Hodgkin-Huxley model with spatial component.

Bandini, E., Thieullen, M. (2021). Optimal Control of Infinite-Dimensional Piecewise Deterministic Markov Processes: A BSDE Approach. Application to the Control of an Excitable Cell Membrane. APPLIED MATHEMATICS AND OPTIMIZATION, 84(2), 1549-1603 [10.1007/s00245-020-09687-y].

Optimal Control of Infinite-Dimensional Piecewise Deterministic Markov Processes: A BSDE Approach. Application to the Control of an Excitable Cell Membrane

Bandini, E
;
2021

Abstract

In this paper we consider the optimal control of Hilbert space-valued infinite-dimensional Piecewise Deterministic Markov Processes (PDMP) and we prove that the corresponding value function can be represented via a Feynman–Kac type formula through the solution of a constrained Backward Stochastic Differential Equation. A fundamental step consists in showing that the corresponding integro-differential Hamilton–Jacobi–Bellman equation has a unique viscosity solution, by proving a suitable comparison theorem. We apply our results to the control of a PDMP Hodgkin-Huxley model with spatial component.
Articolo in rivista - Articolo scientifico
Constrained backward stochastic differential equations; Infinite-dimensional PDMPs; Integro-differential Hamilton–Jacobi–Bellman equation; Spatio-temporal Hodgkin–Huxley models; Viscosity solutions in infinite dimensions;
English
30-mag-2020
2021
84
2
1549
1603
reserved
Bandini, E., Thieullen, M. (2021). Optimal Control of Infinite-Dimensional Piecewise Deterministic Markov Processes: A BSDE Approach. Application to the Control of an Excitable Cell Membrane. APPLIED MATHEMATICS AND OPTIMIZATION, 84(2), 1549-1603 [10.1007/s00245-020-09687-y].
File in questo prodotto:
File Dimensione Formato  
245_2020_9687_OnlinePDF.pdf

Solo gestori archivio

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Dimensione 701.3 kB
Formato Adobe PDF
701.3 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/276995
Citazioni
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
Social impact