HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces

<table class="table-group" id="tab5"><tr><td><table class="table"><tr><td class="thead-hr" colspan="4"><hr/></td></tr><tr class="thead"><td class="align_left" rowspan="2">Season</td><td class="align_center" colspan="3">Computational time (second)</td></tr><tr class="thead"><td class="align_center">EXM</td><td class="align_center">DQN-L</td><td class="align_center">625-MAC-1000</td></tr><tr><td class="thead-hr" colspan="4"><hr/></td></tr><tr><td class="align_left">Spring</td><td class="align_center">5.83</td><td class="align_center">0.11</td><td class="align_center">0.15</td></tr><tr><td class="align_left">Summer</td><td class="align_center">5.92</td><td class="align_center">0.13</td><td class="align_center">0.20</td></tr><tr><td class="align_left">Autumn</td><td class="align_center">5.75</td><td class="align_center">0.10</td><td class="align_center">0.15</td></tr><tr class="table-tr"><td colspan="4"><hr class="tbody-hr"/></td></tr></table></td></tr></table>

Mathematical Problems in Engineering

tab5

Table 5

Table 5: HVAC Optimal Control with the Multistep-Actor Critic Algorithm in Large Action Spaces 