MFA: A Smart Glove with Multimodal Intent Sensing Capability

Table 1

Experiment library under voice channel, visual channel, and sensor channel.

Intent	System speech library task slot	Corresponding recognition object	Corresponding recognition action
I1	[Pick up, distilled water]	Beaker with water	Pick up
I2	[Pour, distilled water]	Beaker with water	Pour
I3	[Check, air tightness]	Hot towel	Grasp
I4	[Pick up, clarified lime aqueous]	Wide mouth bottle with clarified lime water	Pick up
I5	[Pour, clarified lime aqueous]	Wide mouth bottle with clarified lime water	Pour
I6	[Pick up, spoon]	Medicine spoon	Pinch
I7	[Take out, charcoal powder]	Fine mouth bottle with charcoal powder	Pinch
I8	[Add, charcoal powder]	Fine mouth bottle with charcoal powder	Pinch
I9	[Take out, iron oxide powder]	Fine mouth bottle with iron oxide powder	Pinch
I10	[Add, iron oxide powder]	Fine mouth bottle with iron oxide powder	Pinch
I11	[Turn on, alcohol burner]	—	Poke