Composition of Web Services Using Markov Decision Processes and Dynamic Programming

Figure 8

Learning times required for a simulated scenario with 3 layers of 20 Web services. Curves plotted in logarithmic scale show that reinforcement learning methods required ten times more time than dynamic programming algorithms to handle the same kind of problem.