ON THE CONVERGENCE OF THE DISCRETE TIME DYNAMIC PROGRAMMINGEQUATION FOR GENERAL SEMIGROUPS.

Research output: Journal Publications and ReviewsRGC 21 - Publication in refereed journalpeer-review

9 Scopus Citations
View graph of relations

Author(s)

Detail(s)

Original languageEnglish
Pages (from-to)722-746
Journal / PublicationSIAM J CONTROL OPTIM
VolumeV 20
Issue numberN 5
Publication statusPublished - Sept 1982
Externally publishedYes

Abstract

SEVERAL CLASSES OF CONTROL PROBLEMS FOR MARKOV PROCESSES (CONTINUOUS CONTROL, OPTIMAL STOPPING, IMPULSE CONTROL ARE CONSIDERED. THE FORMULATION USED IS VALID FOR GENERAL MARKOV SEMIGROUPS. THE DISCRETE TIME APPROXIMATION OF THE DYNAMIC PROGRAMMING EQUATION IS STUDIED USING MAINLY AN ANALYTICAL APPROACH. PROBABLISTIC INTERPRETATION IS GIVEN FOR SOME OF THE RESULTS.