DENUMERABLE STATE STOCHASTIC GAMES WITH LIMITING AVERAGE PAYOFF

We study stochastic games with countable state space, compact action spaces, and limiting average payoff. For N-person games, the existence of an equilibrium in stationary strategies is established under a certain Liapunov stability condition. For two-person zero-sum games, the existence of a value and optimal strategies for both players are established under the same stability condition.