Parallel Cleaning Algorithm for Similar Duplicate Chinese Data Based on BERT

Figure 6

MapReduce process of BERT.