Stochastic games have a value.
Undiscounted nonterminating stochastic games in which the state and action spaces are finite have a value.
Mertens
J F
JF
Center for Operations Research and Econometrics and Department of Mathematics, Université Catholique de Louvain, Louvain-la Neuve, Belgium.
Neyman
A
A