A Framework and Algorithm for Human-Robot Collaboration Based on Multimodal Reinforcement Learning

<div>User’s body gesture. (a) Cross arms; (b) point to the unplaced pile of blocks; (c) point to the built Jenga tower; (d) raise your hand in a small increment.</div>

Computational Intelligence and Neuroscience

fig3

Figure 3

Figure 3: A Framework and Algorithm for Human-Robot Collaboration Based on Multimodal Reinforcement Learning 