Do Deepfakes Adequately Display Emotions? A Study on Deepfake Facial Emotion Expression

Table 4

Sample data and detected overall emotions.

ID	OR	PF	FRP	Dynamic model						Static model
				CO	OR	FA	%CO	%OR	%FA	CO	OR	FA	%CO	%OR	%FA
id0	10	13	114	2608	2406	3026	52.01	47.99	60.35	5029	8427	7012	37.37	62.63	52.11
id1	10	17	153	8943	8529	6405	51.18	48.82	36.66	12674	11117	12469	53.27	46.73	52.41
id2	10	17	158	1652	1871	3866	46.89	53.11	109.74	5515	10780	8253	33.84	66.16	50.65
id3	10	17	157	3868	6988	2691	35.63	64.37	24.79	4409	4280	16585	50.74	49.26	190.87
id4	10	15	140	3939	4129	3001	48.82	51.18	37.2	11665	7909	11677	59.59	40.41	59.66
id5	10	3	18	508	452	453	52.92	47.08	47.19	2323	1568	959	59.70	40.30	24.65
id6	10	17	134	3718	3055	3386	54.89	45.11	49.99	15487	8694	7760	64.05	35.95	32.09
id7	10	4	29	1167	779	1170	59.97	40.03	60.12	3419	1811	2479	65.37	34.63	47.40
id8	10	9	33	2990	2980	661	50.08	49.92	11.07	3486	4096	2626	45.98	54.02	34.63
id9	10	17	124	5582	4460	2652	55.59	44.41	26.41	8850	9186	3892	49.07	50.93	21.58
id10	10	4	33	3155	1101	1089	74.13	25.87	25.59	3376	2428	785	58.17	41.83	13.53
id11	11	1	11	877	356	238	71.13	28.87	19.3	1686	926	719	64.55	35.45	27.53
id12	7	2	11	941	229	543	80.43	19.57	46.41	1559	576	928	73.02	26.98	43.47
id13	16	2	23	2169	1263	465	63.2	36.8	13.55	3422	2904	974	54.09	45.91	15.40
id16	14	16	203	5853	8438	3792	40.96	59.04	26.53	23137	19710	14574	54.00	46.00	34.01
id17	10	16	143	8448	4272	1773	66.42	33.58	13.94	10427	6117	5311	63.03	36.97	32.10
id19	10	9	72	2342	951	1667	71.12	28.88	50.62	3234	3449	2858	48.39	51.61	42.77
id20	10	27	212	7194	6925	3443	50.95	49.05	24.39	33724	30693	8398	52.35	47.65	13.04
id21	10	27	205	1486	3504	2508	29.78	70.22	50.26	12585	10429	10840	54.68	45.32	47.10
id22	10	9	52	96	139	615	40.85	59.15	261.7	4371	3393	1415	56.30	43.70	18.23
id23	10	27	218	5353	5838	4246	47.83	52.17	37.94	24505	16198	13878	60.20	39.80	34.10
id24	10	9	79	4402	2536	2280	63.45	36.55	32.86	6526	3265	5013	66.65	33.35	51.20
id25	11	9	59	1584	1279	1067	55.33	44.67	37.27	3596	5512	2352	39.48	60.52	25.82
id26	10	27	170	5075	5278	2501	49.02	50.98	24.16	6988	4953	11561	58.52	41.48	96.82
id27	10	9	77	2147	2517	878	46.03	53.97	18.83	2951	1430	3247	67.36	32.64	74.12
id28	10	27	249	3236	3125	5438	50.87	49.13	85.49	15921	10156	13149	61.05	38.95	50.42
id29	10	13	103	2901	3679	1722	44.09	55.91	26.17	10211	10678	6299	48.88	51.12	30.15
id30	10	21	201	2731	3096	7776	46.87	53.13	133.45	40638	39511	9427	50.70	49.30	11.76
id31	10	21	197	1372	4774	3566	22.32	77.68	58.02	39716	30033	16023	56.94	43.06	22.97
id32	10	13	88	1435	1081	2163	57.03	42.97	85.97	16032	6920	5593	69.85	30.15	24.37
id33	10	13	109	4217	3536	4852	54.39	45.61	62.58	18643	15752	11702	54.20	45.80	34.02
id34	10	13	87	4654	2113	3162	68.77	31.23	46.73	7265	5690	5222	56.08	43.92	40.31
id35	10	21	182	4653	5571	5360	45.51	54.49	52.43	15156	14880	12323	50.46	49.54	41.03
id37	10	21	172	3197	3374	5264	48.65	51.35	80.11	32742	21484	16629	60.38	39.62	30.67
id38	10	13	104	3032	2957	790	50.63	49.37	13.19	8002	5657	7295	58.58	41.42	53.41
id39	10	8	72	3694	1242	1620	74.84	25.16	32.82	10710	5169	5005	67.45	32.55	31.52
id40	10	9	83	7527	2201	1783	77.37	22.63	18.33	12327	4566	4189	72.97	27.03	24.80
id41	10	8	71	3497	2381	1616	59.49	40.51	27.49	9380	5408	4002	63.43	36.57	27.06
id42	5	9	36	3505	968	1184	78.36	21.64	26.47	3994	1109	1095	78.27	21.73	21.46
id43	10	9	79	5443	1088	3761	83.34	16.66	57.59	9751	8985	4371	52.04	47.96	23.33
id44	6	9	46	1861	1435	1013	56.46	43.54	30.73	2820	2540	1139	52.61	47.39	21.25
id45	10	9	87	3411	3814	2408	47.21	52.79	33.33	4296	4011	3640	51.72	48.28	43.82
id46	10	9	76	1945	1702	1573	53.33	46.67	43.13	3233	3416	2993	48.62	51.38	45.01
id47	10	9	89	3884	1660	2426	70.06	29.94	43.76	14475	4996	6221	74.34	25.66	31.95
id48	10	9	84	5035	2619	2322	65.78	34.22	30.34	10434	5901	4678	63.88	36.12	28.64
id49	10	9	84	2406	1865	3894	56.33	43.67	91.17	9071	8312	5011	52.18	47.82	28.83
id50	10	8	71	3302	3216	4478	50.66	49.34	68.7	4821	2292	8265	67.78	32.22	116.20
id51	10	8	67	11224	4040	1850	73.53	26.47	12.12	17190	7082	4431	70.82	29.18	18.26
id52	10	8	79	8931	6069	2812	59.54	40.46	18.75	21332	14171	6285	60.09	39.91	17.70
id53	10	9	86	9810	6115	2557	61.6	38.4	16.06	17295	10690	3707	61.80	38.20	13.25
id54	10	9	80	11734	5870	3106	66.66	33.34	17.64	13703	6736	6694	67.04	32.96	32.75
id55	10	9	64	7576	2783	4395	73.13	26.87	42.43	10837	4537	5743	70.49	29.51	37.36
id56	10	9	79	9131	3168	3366	74.24	25.76	27.37	14968	7330	5804	67.13	32.87	26.03
id57	10	9	63	4874	2652	3366	64.76	35.24	44.72	6896	5005	3735	57.94	42.06	31.38
id58	10	8	55	4436	2726	3208	61.94	38.06	44.79	6122	4539	4179	57.42	42.58	39.20
id59	10	3	23	1036	840	955	55.22	44.78	50.91	3038	1975	2735	60.60	39.40	54.56
id60	10	3	30	1862	2647	1682	41.3	58.7	37.3	3853	4919	3415	43.92	56.08	38.93
id61	10	3	15	360	483	907	42.7	57.3	107.59	1796	1459	1285	55.18	44.82	39.48

Columns display the number of original recordings by the performer (OR), the number of performers of deepfakes on the original recordings of the current performer (PF), and number of fake recordings made on recordings by the performer (FRP). Then, the number of photograms with emotions in common with the original recording and the corresponding photogram of a fake recording (CO), the number of photograms that showed emotion in the original recording but not in the corresponding fakes (OR), and the number of emotional photograms that appear in fakes but not in corresponding photograms on original recordings alone (FA) are displayed followed by their corresponding percentages, for dynamic and static models.