Research Article
Do Deepfakes Adequately Display Emotions? A Study on Deepfake Facial Emotion Expression
Table 2
Percentages of fake recordings with emotional photograms, displayed by performer and emotion.
| ID | Dynamic model | Static model | %Sa | %Fe | %Ha | %An | %Su | %Di | %Ne | %Sa | %Fe | %Ha | %An | %Su | %Di | %Ne |
| id0 | 14.04 | 0 | 10.53 | 0 | 38.6 | 22.81 | 36.84 | 53.51 | 5.26 | 10.53 | 0 | 57.89 | 42.11 | 0 | id1 | 19.61 | 0 | 49.67 | 0 | 9.8 | 0.65 | 60.78 | 51.63 | 0.65 | 49.67 | 0 | 8.5 | 52.29 | 5.88 | id2 | 4.23 | 0 | 12.68 | 7.75 | 19.72 | 9.15 | 21.13 | 47.18 | 0.7 | 12.68 | 7.75 | 42.25 | 0 | 0 | id3 | 27.46 | 0 | 31.69 | 0 | 7.75 | 30.28 | 54.93 | 89.44 | 0 | 31.69 | 0 | 21.83 | 10.56 | 2.11 | id4 | 38.89 | 0 | 23.02 | 0 | 44.44 | 24.6 | 19.84 | 92.06 | 5.56 | 23.02 | 0 | 39.68 | 53.17 | 0 | id5 | 16.67 | 0 | 33.33 | 0 | 77.78 | 50 | 44.44 | 44.44 | 0 | 33.33 | 0 | 94.44 | 55.56 | 5.56 | id6 | 18.49 | 0 | 17.65 | 0 | 17.65 | 23.53 | 59.66 | 90.76 | 0 | 17.65 | 0 | 21.01 | 62.18 | 0 | id7 | 17.24 | 0 | 41.38 | 0 | 3.45 | 37.93 | 79.31 | 55.17 | 0 | 41.38 | 0 | 48.28 | 65.52 | 6.9 | id8 | 0 | 0 | 60 | 0 | 56 | 0 | 0 | 80 | 0 | 60 | 0 | 60 | 24 | 0 | id9 | 4.21 | 0 | 47.37 | 0 | 0 | 21.05 | 55.79 | 74.74 | 0 | 47.37 | 0 | 0 | 28.42 | 0 | id10 | 0 | 0 | 40.63 | 0 | 59.38 | 56.25 | 56.25 | 25 | 0 | 40.63 | 0 | 68.75 | 18.75 | 0 | id11 | 45.45 | 0 | 63.64 | 0 | 36.36 | 36.36 | 45.45 | 63.64 | 0 | 63.64 | 0 | 45.45 | 81.82 | 0 | id12 | 36.36 | 0 | 81.82 | 0 | 54.55 | 9.09 | 18.18 | 45.45 | 0 | 81.82 | 0 | 63.64 | 63.64 | 0 | id13 | 13.04 | 0 | 39.13 | 0 | 17.39 | 4.35 | 30.43 | 30.43 | 0 | 39.13 | 0 | 82.61 | 56.52 | 0 | id16 | 12.32 | 0 | 36.45 | 0 | 4.93 | 15.76 | 32.02 | 73.4 | 0 | 36.45 | 0 | 15.76 | 62.07 | 3.45 | id17 | 5.47 | 0 | 25.78 | 0 | 0 | 9.38 | 26.56 | 28.13 | 0 | 25.78 | 0 | 10.16 | 44.53 | 13.28 | id19 | 6.94 | 0 | 20.83 | 0 | 6.94 | 5.56 | 38.89 | 20.83 | 0 | 20.83 | 0 | 13.89 | 63.89 | 0 | id20 | 19.89 | 0 | 30.11 | 0.54 | 10.22 | 0 | 22.04 | 61.83 | 9.14 | 30.11 | 0.54 | 27.42 | 55.38 | 0 | id21 | 10 | 0 | 13.89 | 0 | 0 | 13.33 | 38.89 | 77.22 | 0 | 13.89 | 0 | 0 | 45 | 0 | id22 | 0 | 0 | 0 | 0 | 8.7 | 2.17 | 6.52 | 34.78 | 0 | 0 | 0 | 21.74 | 36.96 | 0 | id23 | 27.08 | 0 | 47.92 | 14.06 | 12.5 | 8.85 | 9.9 | 77.08 | 0 | 47.92 | 14.06 | 10.42 | 73.96 | 0 | id24 | 15.19 | 0 | 68.35 | 0 | 41.77 | 21.52 | 20.25 | 39.24 | 0 | 68.35 | 0 | 30.38 | 54.43 | 0 | id25 | 32.2 | 0 | 27.12 | 0 | 15.25 | 20.34 | 22.03 | 76.27 | 0 | 27.12 | 0 | 61.02 | 20.34 | 0 | id26 | 14.96 | 0 | 30.71 | 0 | 5.51 | 13.39 | 59.84 | 59.06 | 14.96 | 30.71 | 0 | 62.2 | 14.17 | 0 | id27 | 1.45 | 0 | 20.29 | 0 | 18.84 | 7.25 | 69.57 | 26.09 | 0 | 20.29 | 0 | 13.04 | 43.48 | 8.7 | id28 | 14.46 | 0 | 8.43 | 0 | 28.92 | 10.84 | 30.12 | 54.62 | 0 | 8.43 | 0 | 38.96 | 35.34 | 0 | id29 | 13.25 | 8.43 | 38.55 | 0 | 61.45 | 56.63 | 21.69 | 42.17 | 19.28 | 38.55 | 0 | 89.16 | 65.06 | 0 | id30 | 23.63 | 0 | 56.04 | 2.75 | 0.55 | 4.95 | 35.16 | 58.24 | 7.14 | 56.04 | 2.75 | 23.63 | 43.96 | 0 | id31 | 17.77 | 0 | 12.69 | 0 | 1.52 | 24.87 | 19.8 | 82.23 | 0 | 12.69 | 0 | 24.37 | 56.85 | 0 | id32 | 10.17 | 0 | 61.02 | 0 | 13.56 | 52.54 | 16.95 | 94.92 | 0 | 61.02 | 0 | 16.95 | 91.53 | 0 | id33 | 29.36 | 0 | 68.81 | 0 | 15.6 | 35.78 | 33.03 | 90.83 | 0.92 | 68.81 | 0 | 43.12 | 77.06 | 0 | id34 | 21.67 | 0 | 68.33 | 18.33 | 45 | 38.33 | 6.67 | 91.67 | 0 | 68.33 | 18.33 | 55 | 78.33 | 1.67 | id35 | 0.55 | 0 | 29.12 | 7.69 | 36.26 | 9.89 | 43.96 | 58.24 | 0 | 29.12 | 7.69 | 43.41 | 48.9 | 2.2 | id37 | 23.9 | 0 | 22.64 | 0 | 0 | 5.66 | 19.5 | 81.76 | 0 | 22.64 | 0 | 1.26 | 61.64 | 0 | id38 | 10.94 | 0 | 39.06 | 6.25 | 4.69 | 7.81 | 0 | 53.13 | 0 | 39.06 | 6.25 | 42.19 | 31.25 | 0 | id39 | 13.64 | 0 | 18.18 | 3.03 | 48.48 | 10.61 | 48.48 | 50 | 0 | 18.18 | 3.03 | 53.03 | 56.06 | 0 | id40 | 1.2 | 0 | 57.83 | 0 | 18.07 | 7.23 | 46.99 | 27.71 | 1.2 | 57.83 | 0 | 78.31 | 55.42 | 0 | id41 | 7.81 | 0 | 67.19 | 0 | 21.88 | 17.19 | 56.25 | 34.38 | 0 | 67.19 | 0 | 42.19 | 90.63 | 0 | id42 | 13.89 | 0 | 25 | 0 | 22.22 | 8.33 | 47.22 | 50 | 0 | 25 | 0 | 41.67 | 22.22 | 0 | id43 | 0 | 0 | 60.76 | 0 | 20.25 | 18.99 | 36.71 | 8.86 | 0 | 60.76 | 0 | 50.63 | 31.65 | 0 | id44 | 0 | 0 | 73.08 | 0 | 0 | 26.92 | 26.92 | 61.54 | 0 | 73.08 | 0 | 15.38 | 65.38 | 15.38 | id45 | 26.58 | 0 | 29.11 | 0 | 8.86 | 17.72 | 84.81 | 31.65 | 0 | 29.11 | 0 | 37.97 | 70.89 | 0 | id46 | 0 | 0 | 16.67 | 1.67 | 15 | 11.67 | 85 | 13.33 | 0 | 16.67 | 1.67 | 80 | 65 | 10 | id47 | 1.12 | 0 | 30.34 | 0 | 15.73 | 5.62 | 71.91 | 60.67 | 0 | 30.34 | 0 | 37.08 | 58.43 | 0 | id48 | 19.05 | 0 | 55.95 | 0 | 33.33 | 21.43 | 63.1 | 40.48 | 0 | 55.95 | 0 | 36.9 | 69.05 | 0 | id49 | 32.47 | 0 | 66.23 | 0 | 28.57 | 5.19 | 54.55 | 55.84 | 1.3 | 66.23 | 0 | 80.52 | 72.73 | 0 | id50 | 18.31 | 0 | 63.38 | 0 | 25.35 | 19.72 | 76.06 | 59.15 | 0 | 63.38 | 0 | 46.48 | 59.15 | 7.04 | id51 | 21.88 | 0 | 50 | 0 | 51.56 | 43.75 | 18.75 | 51.56 | 0 | 50 | 0 | 70.31 | 82.81 | 0 | id52 | 31.65 | 0 | 48.1 | 5.06 | 35.44 | 16.46 | 41.77 | 77.22 | 5.06 | 48.1 | 5.06 | 51.9 | 87.34 | 0 | id53 | 15.38 | 0 | 57.69 | 0 | 35.9 | 26.92 | 47.44 | 43.59 | 0 | 57.69 | 0 | 33.33 | 75.64 | 5.13 | id54 | 21.25 | 0 | 50 | 0 | 33.75 | 28.75 | 61.25 | 50 | 0 | 50 | 0 | 38.75 | 62.5 | 7.5 | id55 | 0 | 0 | 84.38 | 0 | 40.63 | 46.88 | 76.56 | 46.88 | 4.69 | 84.38 | 0 | 70.31 | 68.75 | 6.25 | id56 | 6.33 | 0 | 88.61 | 0 | 56.96 | 35.44 | 39.24 | 31.65 | 0 | 88.61 | 0 | 75.95 | 94.94 | 0 | id57 | 0 | 0 | 42.86 | 0 | 32.14 | 23.21 | 62.5 | 21.43 | 0 | 42.86 | 0 | 57.14 | 26.79 | 0 | id58 | 6 | 0 | 56 | 0 | 42 | 26 | 64 | 32 | 0 | 56 | 0 | 70 | 56 | 0 | id59 | 34.78 | 0 | 30.43 | 0 | 69.57 | 47.83 | 30.43 | 56.52 | 0 | 30.43 | 0 | 69.57 | 78.26 | 4.35 | id60 | 30 | 0 | 76.67 | 26.67 | 53.33 | 53.33 | 70 | 96.67 | 16.67 | 76.67 | 26.67 | 76.67 | 93.33 | 26.67 | id61 | 6.67 | 0 | 20 | 0 | 60 | 46.67 | 80 | 40 | 0 | 20 | 0 | 86.67 | 33.33 | 0 |
|
|
Happiness (Ha), Sadness (Sa), Surprise (Su), Fear (Fe), Anger (An), and Disgust (Di) are used for dynamic and static models.
|