Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Figure 3

Pipelined backpropagation algorithm.