Research Article
EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text
Table 5
Comparison of accuracy of Affect Analysis Model employing different parsers (Connexor Machinese Syntax versus Stanford Parser).
| | Measure | Gold standard | | 2-3 annotators agreed | 3 annotators agreed | | Fine-grained emotions | Merged labels | Fine-grained emotions | Merged labels | | 656 sentences, Kappa 0.51 | 692 sentences, Kappa 0.60 | 249 sentences, Kappa 1.0 | 447 sentences, Kappa 1.0 |
| | Accuracy of AAM with Connexor Machinese Syntax | 0.726 | 0.816 | 0.815 | 0.890 |
| | Accuracy of AAM with Stanford Parser | 0.649 | 0.747 | 0.751 | 0.814 |
| | Difference in % | 7.7 | 6.9 | 6.4 | 7.6 |
|
|