Pipelined Training with Stale Weights in Deep Convolutional Neural Networks

Figure 4

Illustration of pipelined computations of each cycle.