Dynamic Request Routing for Online Video-on-Demand Service: A Markov Decision Process Approach

<table class="table-group" width="800px"><tr class="fig-image" id="a"><td><img alt="920829.fig.004a" src="https://static-preview.hindawi.com/articles/mpe/volume-2014/920829/figures/920829.fig.004a.jpg"/></td></tr><tr class="fig-caption"><td align="center"><table><tr><td><b>(a) </b>State size versus number of request types, with server capacity = 5</td></tr></table></td></tr><tr class="fig-image" id="b"><td><img alt="920829.fig.004b" src="https://static-preview.hindawi.com/articles/mpe/volume-2014/920829/figures/920829.fig.004b.jpg"/></td></tr><tr class="fig-caption"><td align="center"><table><tr><td><b>(b) </b>State size versus server capacity, with number of request types = 2</td></tr></table></td></tr></table>

<table>Problem state space size of MDP and BMDP formulations.</table>

Mathematical Problems in Engineering

fig4

Figure 4

Figure 4: Dynamic Request Routing for Online Video-on-Demand Service: A Markov Decision Process Approach 