MES: A Helping Elderly Escort Interactive System Based on Reverse Active Integration of Multimodal Intentions
Table 2
Multimodal intention integration algorithm.
The algorithm for reverse active integration of multimodal intentions
While(1):
While(1):
Modal information
//extract speech and gesture intentions from the speech and gesture information as per the posture information and then integrate the two-modal intentions based on the environment information
IF: ! = :; break; //if the integrated intention set is not empty, obtain the most possible intention based on the time difference-intention probability
ELSE: analyze the cause of empty set, actively obtain enhanced information to cover the original , and continue; //the system obtains the enhanced information as per the cause of empty set of the integrated intention
, (check the corresponding table); //calculate the entropy of single-modal information by using the improved method for calculation of information entropy
∗
S = () //obtain the system’s feedback action S on the basis of the integrated intention, the time difference, and the trust degree threshold if():; break;
