Kernel Recursive Least-Squares Temporal Difference Algorithms with Sparsification and Regularization

Algorithm 2

Fixed-point subiteration and online pruning.

)  Input: , , , , , , ,

()  Initialize:

()  for    to    do

()   Update by (35)

()    if    then

()    Break out of the loop

()    end if

()  end for

() 

() Determine the index set by (37)

() Perform , , and