A Caching-Enabled Permissioned Blockchain Scheme for Industrial Internet of Things Based on Deep Reinforcement Learning

Figure 3

Caching agent overview. The caching agent can observe states from the environment, where a state contains statistical features of keys, smart contracts, and blocks. To minimize the average execution delay of smart contracts, each action performed by the agent might replace a cached block body with another one to maximize the reward.