MES: A Helping Elderly Escort Interactive System Based on Reverse Active Integration of Multimodal Intentions
Table 3
Interaction task 1 (task no. 31).
Interaction experiment (place: living room; time: 4:00 pm; user no: 3)
Interaction no.
Integrated intention
Start
1:
Drinking tea
User:
I want to drink tea (posture: sitting on the chair; gesture: making a fist and shaking it)
Pepper:
(Reversely and actively ask) I am not sure about your intention because the gesture information is substandard. Please re-enter the gesture information
2:
Drinking tea
User:
(Gesture: acting like grasping tea)
Pepper:
(Extract the intention of drinking tea and reversely and actively ask) the evening sleeping quality may be affected if you drink tea in the afternoon. Are you sure you want to drink tea now?
3:
Drinking tea
User:
Yes, now
Pepper:
(Execute the task of “taking a cup, tea box, and thermos” as no articles relevant to drinking tea were found in front of the elderly in previous target detection)
