Chen, Taolue and Han, Tingting and Lu, J. (2006) On the Markovian randomized strategy of controller for Markov decision processes. In: Wang, L. and Jiao, L. and Shi, G. and Li, X. and Liu, J. (eds.) FSKD 2006: Fuzzy Systems and Knowledge Discovery, Third International Conference. Lecture Notes in Computer Science 4223. Springer, pp. 149-158. ISBN 9783540459163.
Abstract
This paper focuses on the so called controller synthesis problem, which addresses the question of how to limit the internal behavior of a given system implementation to meet its specification, regardless of the behavior enforced by the environment. We consider this problem in the probabilistic setting, where the underlying model has both probabilism and nondeterminism and the nondeterministic choices in some states are assumed to be controllable while the others are under the control of an unpredictable environment. As for the specification, it is defined by probabilistic computation tree logic. We show that under the restriction that the controller exploits only Markovian randomized strategy, the existence of such a controller is decidable, which is done by a reduction to the decidability of first-order theory for reals. This also gives rise to an algorithm which can synthesize the controller if it does exist.
Metadata
| Item Type: | Book Section |
|---|---|
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
| Depositing User: | Sarah Hall |
| Date Deposited: | 09 Feb 2021 19:14 |
| Last Modified: | 09 Aug 2023 12:50 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/42957 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
