On the Markovian randomized strategy of controller for Markov decision processes

Chen, Taolue and Han, Tingting and Lu, J. (2006) On the Markovian randomized strategy of controller for Markov decision processes. In: Wang, L. and Jiao, L. and Shi, G. and Li, X. and Liu, J. (eds.) FSKD 2006: Fuzzy Systems and Knowledge Discovery, Third International Conference. Lecture Notes in Computer Science 4223. Springer, pp. 149-158. ISBN 9783540459163.

Full text not available from this repository.

Official URL: https://doi.org/10.1007/11881599\_17

Abstract

This paper focuses on the so called controller synthesis problem, which addresses the question of how to limit the internal behavior of a given system implementation to meet its specification, regardless of the behavior enforced by the environment. We consider this problem in the probabilistic setting, where the underlying model has both probabilism and nondeterminism and the nondeterministic choices in some states are assumed to be controllable while the others are under the control of an unpredictable environment. As for the specification, it is defined by probabilistic computation tree logic. We show that under the restriction that the controller exploits only Markovian randomized strategy, the existence of such a controller is decidable, which is done by a reduction to the decidability of first-order theory for reals. This also gives rise to an algorithm which can synthesize the controller if it does exist.

Metadata

Item Type:	Book Section
School:	Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
Depositing User:	Sarah Hall
Date Deposited:	09 Feb 2021 19:14
Last Modified:	09 Aug 2023 12:50
URI:	https://eprints.bbk.ac.uk/id/eprint/42957

Statistics

Archive Staff Only (login required)

Edit/View Item