A Conformance Testing Methodology and System for Cognitive Radios

Table 1

Approaches for CR testing.

Paper	Description	Environment type	Purpose	Tested CR functionalities	Software	Analyzed metrics
[16]	Relationships among metrics, utility functions, CE performance, and a system for CR performance evaluation	Simulation	Performance evaluation	Spectrum sensing, power control, and adaptive modulation	Radio environment generator and XML	Adaptation time and average total utility
[17]	A platform for measuring different CR characteristics	Experimentation	Performance evaluation	Spectrum sensing	GNU radio and MATLAB	Channel closing transmission time
[18]	A testbed to evaluate the device in multidimensional scenarios	Emulation and experimentation	Performance evaluation	None	Not defined	None
[22]	Testing and evaluation methodologies for CR	Experimentation	Performance evaluation	Adaptive modulation	C++	Error vector magnitude (EVM)
[25]	A visual programming tool for designing CR prototypes	Simulation and emulation	CR prototype development	None	EZPro, CORE, and EMANE	None
[26]	A methodology to define the device cognition based on the performance evaluation	Experimentation	Device cognition level	Spectrum sensing and adaptive modulation	MATLAB and WARPLab	Bit error rate and throughput
[14]	The item response model is adopted to measure the CR device intelligence	Simulation	Device cognition level	Spectrum sensing, parameters selection, and reconfiguration	MATLAB	Difference between the CR solution and the optimal one
[15]	Cattell-Horn-Carroll intelligence model and performance results are used to quantify and qualify the CR device	Simulation	Device cognition level	Spectrum sensing and parameter reconfiguration	MATLAB	Throughput, delay, and violation (interference) ratio
[24]	A seven-step methodology to evaluate signal detection methods	Experimentation	Performance evaluation	Spectrum sensing	GNU radio, Python, and VESNA libraries	Noise level sensitivity, computational complexity, and minimal detectable signal
[19]	A CR-based testbed for smart grids and communication system	Simulation and experimentation	Performance evaluation	Spectrum sensing	Real-time digital simulator and GNU radio	Voltage stability control and communication latency
[20]	A low-cost CR-based testbed for LTE and LTE-A networks	Experimentation	Performance evaluation	Spectrum sensing and spectrum handoff	WaveGuru SDR	Throughput
[21]	A SDR-based testbed for multimedia communications	Experimentation	Performance evaluation	None	GNU radio	None
Our proposal	A methodology and system for CR conformance testing	Experimentation	Conformance testing	Spectrum sensing and spectrum handoff	GNU radio, R and Python languages, ZeroMQ middleware	Percentage of matching (PoM) and its variant