A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2015; you can also visit the original URL.
The file type is `application/pdf`

.

##
###
Pseudo-MDPs and factored linear action models

2014
*
2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL)
*

In this paper we introduce the concept of pseudo-MDPs to develop abstractions. Pseudo-MDPs relax the requirement that the transition kernel has to be a probability kernel. We show that the new framework captures many existing abstractions. We also introduce the concept of factored linear action models; a special case. Again, the relation of factored linear action models and existing works are discussed. We use the general framework to develop a theory for bounding the suboptimality of policies

doi:10.1109/adprl.2014.7010633
dblp:conf/adprl/YaoSPZ14
fatcat:4l7aaf5bsrczzdlpdptb3o7xqm