[Retracted] Research on the Key Issues of Big Data Quality Management, Evaluation, and Testing for Automotive Application Scenarios

Table 1

Data processing functions.

Function category	Effect	Function name
Data conversion function	Select a specific column in the data and project it into new data	Select
Data conversion function	Group data according to specific columns	Grouby
Data conversion function	Join multiple data sets through a public column	Join
Data conversion function	Add new columns or update existing columns in the data set	withColumn
Data conversion function	Sort the data set based on a specific column	Sort
Data conversion function	Filter the data set according to specific rules	Filter