Mathematics of Operations Research, Vol. 42, No. 4 (November 2017), pp. 945-978 (34 pages) Calculating optimal policies is known to be computationally difficult for Markov decision processes (MDPs) ...
This paper describes sufficient conditions for the existence of optimal policies for partially observable Markov decision processes (POMDPs) with Borel state, observation, and action sets, when the ...