Limiting Dynamics for Q-Learning with Memory One in Symmetric Two-Player, Two-Action Games

Figure 1

Game state transitions of the symmetric TFT pure strategy pair. Here, the states the game can be in are labelled with 1 corresponding to the DD state, 2 corresponding to the DC state, 3 corresponding to the CD state and 4 corresponding to the CC state.