Budget-Constrained MAB for Trajectory Planning in Aerial-Aided Emergency Networks

Algorithm 1

UCB-BC1/BC2 algorithms.

Output: ,

Input: , .

Initialization: At t =1

During the first grids, pull each arm/grid once

Calculate the index for each arm using the formula below.

whiledo

 UCB-BC1

 UCB-BC2

 Pull the grid that achieves: .

 Obtain and update of the selected grid.

 End while