Identifying IoT Devices Based on Spatial and Temporal Features from Network Traffic

Table 7

Results of the ablation study on the UNSW dataset.

Method	CBBI w/o FGAN			CBBI
FGAN	✗			✓
Conv-BiLSTM	✓			✓
Device name	Precision	Recall	F-score	Precision	Recall	F-score
Amazon_Echo	0.9878	0.9932	0.9905	0.9983	0.9988	0.9985
Belkin_Wemo_Switch	0.9932	0.9929	0.9931	0.9982	0.9988	0.9985
HP_Printer	0.9056	0.9646	0.9342	0.9908	0.9981	0.9944
Insteon_Camera	0.9931	0.9981	0.9956	0.9994	0.9994	0.9994
Light_Bulbs_LiFX_Smart_Bulb	0.9825	0.9825	0.9825	0.9979	0.9965	0.9972
Netatmo_Weather_Station	0.9865	0.9963	0.9914	0.9988	1.0000	0.9994
Netatmo_Welcome	0.9181	0.9533	0.9354	0.9937	0.9956	0.9947
PIX_STAR_Photo_Frame	0.9926	0.9887	0.9907	0.9990	0.9951	0.9971
Samsung_SmartCam	0.9978	0.9922	0.9950	0.9992	0.9989	0.9991
Smart_Things	0.9956	0.9888	0.9922	0.9985	0.9980	0.9983
TP_Link_Day_Night_Cloud_Camera	0.9898	0.9563	0.9728	0.9892	0.9989	0.9940
TP_Link_Smart_Plug	0.8638	0.8675	0.8657	0.9804	0.9615	0.9709
Withings_Aura_Smart_Sleep_Sensor	0.9929	0.9793	0.9861	0.9989	0.9985	0.9987
Withings_Smart_Baby_Monitor	0.9823	0.9961	0.9891	0.9997	0.9997	0.9997
iHome	1.0000	0.6833	0.8119	1.0000	1.0000	1.0000
Nest_Dropcam	0.3193	0.4371	0.3980	1.0000	0.9600	0.9796
NEST_Procet_Smoke_Alarm	1.0000	0.7317	0.8451	1.0000	1.0000	1.0000
Triby_Speaker	0.8841	0.4552	0.6010	0.9817	0.9469	0.9640
Macro average performance	0.9325	0.8865	0.9039	0.9958	0.9914	0.9935
Total accuracy	0.9865			0.9983