Research Article
Flink-ER: An Elastic Resource-Scheduling Strategy for Processing Fluctuating Mobile Stream Data on Flink
Algorithm 3
Data redistribution algorithm.
| | Input: | | | Operator to be rescaled: operator[] | | | Resource pool: pool | | | Output: | | | Rescaled flow network: G′ | | | Begin | | | foreach O ∈ operator[] do | | | foreach ∈ O do | | | Send the stateful data of vertex to the HDFS and the data handler to Zookeeper. | | | end foreach | | | ← pool.getNode() | | | O.add()/∗Enlarge the parallelism of the Operator∗/ | | | bucket[]←JobManager.remapping(bucket[],|O|) | | | /∗Remapping stateful data as shown in Figure 5∗/ | | | foreach ∈ O do | | | Require stateful data from Zookeeper and restore the corresponding stateful data from the HDFS | | | end foreach | | | end foreach | | | flowNetwork_selfLearning(G′) | | | return G′ | | | End |
|