MES: A Helping Elderly Escort Interactive System Based on Reverse Active Integration of Multimodal Intentions

Table 5

Interaction task 3 (task no. 78).

Interaction experiment (place: bedroom; time: 10:00 am; user no: 7)
Interaction no.	Integrated intention	Start
1:	Taking medicine	User:	I feel a little uncomfortable (posture: sitting on the bed; gesture: acting like grasping a medicine bottle)
		Pepper:	(Reversely and actively ask) it’s not the time to take medicine. Are you sure you want to take medicine now?
2:	Watching TV	User:	(Posture: sitting on bed) no, I want to watch TV (gesture: swinging the thumb up and down)
		Pepper:	As extracted by the system, you want to watch TV. (Reversely and actively say) there is no TV in the bedroom, please go to the living room to watch TV
		End