Research Article

IRePf: An Instruction Reorganization Virtual Platform for Kernel Stack Overflow Detection

Algorithm 3

Comparing backup stack data with real stack data.
Input: The address of the return address of real stack backadd_add_real; the return address of real stack backadd_real; the address of the return address of backup stack backadd_add_backup; the return address of backup stack backadd_backup
Output: Stack overflow {true, false}
(1)If backadd_add_real > backadd_add_backup then
(2)return true
(3)If backadd_add_real < backadd_add_backup then
(4)return false
(5)If backadd_add_real = backadd_add_backup then
(6)If backadd_real = backadd_backup then
(7)  return false
(8)else
(9)  return true