Abstract

Traffic network design problems (NDPs) play an important role in urban planning. Since there exist uncertainties in the real urban traffic network, neglecting the uncertainty factors may lead to unreasonable decisions. This paper considers the transportation network signal design problem under stochastic origin-destination (OD) demand. In general, solving this stochastic problem requires a large amount of computational budget to calculate the equilibrium flow corresponding to a certain demand distribution, which limits its real applications. To reduce the computational time in calculating the equilibrium flow under stochastic demand, this paper proposes a metamodel-based optimization method. First, a combined metamodel that integrates a physical modeling part and a model bias generic part is developed. The metamodel is used to approximate the time-consuming average equilibrium flow solution process, hence to improve the computational efficiency. To further improve the convergence and the solution optimality performance of the metamodel-based optimization, the gradient information of traffic flow with respect to the signal plan is incorporated in the optimization model. A gradient-based metamodel algorithm is then proposed. In the numerical example, a six-node test network is used to examine the proposed metamodel-based optimization method. The proposed combined metamodel is compared with the benchmark method to investigate the importance of incorporating a model bias generic part and the traffic flow gradient information in the combined metamodel. Although there is a reduction in solution optimality since the metamodel is an approximation of the original model, the metamodel methods greatly improve the computational efficiency (the computational time is reduced by 4.84 to 13.47 times in the cases of different initial points). By incorporating the model bias, the combined metamodel can better approximate the original optimal solution. Moreover, incorporating the gradient information of the traffic flow in the optimization search algorithm can further improve the solution performance. Numerical results show that the gradient-based metamodel method can effectively improve the computation efficiency while slightly reducing the solution optimality (with an increase of 0.09% in the expected total travel cost).

1. Introduction

Traffic network design is a basic means to improve traffic flow distribution and alleviate traffic congestion in urban traffic networks. The network design problem (NDP) is usually to determine optimal network supply decisions, such as adding new links or improving the capacity of existing ones, with certain objectives (e.g., maximizes social benefits or minimizes total travel cost), while considering users’ route choice behavior [16]. There exist different network supply decisions for the traffic network design problems, including road network expansion design, signal control optimization design, and road tolling design. For network traffic signal control, it focuses on determining optimal signal timing plans that can trigger better equilibrium flow patterns with optimal network performance. It is also called the combined traffic assignment and signal control problem [712] or anticipatory network traffic control [1316] because the signal control anticipates the effect of route choice response.

The traffic network signal design problem has been extensively explored in the literature. Allsop [17] first proposed the concept of combined signal control and traffic assignment and developed an iterative optimization method to achieve the equilibrium solution by alternately modifying the signal timings and the equilibrium flows. However, it is reported that the solution of the iterative optimization method highly depends on the initial point (initial assignment), and the equilibrium solution is generally not necessarily the optimal solution [1820]. In view of the drawbacks of the iterative approach, Yang and Yagar [21] established the network signal control model from the perspective of global optimization and proposed a global optimization approach, which is usually formulated as a bilevel programming optimization model. The upper level problem is the signal control optimization problem, which optimizes the network performance with flow constraints. The lower level problem solves the user equilibrium (UE) problem [2225] under the given signal timing plan. The global optimization approach needs to simultaneously consider the traffic flow equilibrium and signal control optimization, which makes it time-consuming and difficult to solve. The computational budget increases especially for large-scale road network problems.

Traditional traffic network design problems usually assume fixed or deterministic traffic conditions, such as fixed traffic demand. However, the transportation system is generally affected by many uncertain factors on demand and supply, for instance, OD demand fluctuations, link capacity variations, special events, and random route choice behavior. Ignoring the uncertainty effects in the decision-making process may result in inaccurate evaluations and suboptimal control plans [2628]. Li et al. [29] dealt with NDP under stochastic demand and reported that demand stochasticity affects the reliability of the optimal solution and its real application. Lv and Liu [30] also showed that the stochastic features of traffic demand will significantly affect the optimal signal control settings as well as the associated equilibrium flow pattern of the transportation network, leading to suboptimal network performance. This paper focuses on network traffic control under stochastic demand. To account for the impact of demand stochasticity and ensure the reliability of the solution, it is required to calculate the equilibrium flows under a large number of random demand scenarios, which substantially adds to the computation complexity of the control optimization problem. The high computational budget of the control method that addresses the demand uncertainty limits its real-time and large-scale network applications.

Metamodel (or surrogate model) is a common method to solve nonlinear problems with high computational budget. It typically makes use of simple analytical models, which are called metamodels to approximate the original time-expensive analysis or models, so as to improve the overall computation efficiency [31]. In general, metamodels can be classified in two types: physical metamodels and functional metamodels. The physical metamodel usually develops problem-specific model to approximate the original problem from first principle. Their functional form and parameters have a physical or structural interpretation. Osorio and Bierlaire [32] considered simulation-based optimization approach for traffic signal control and developed a simplified analytical queueing network model to approximate the complex queue network in the simulation. To improve the accuracy of the physical metamodel, it is necessary to conduct a model parameter fitting. A conventional two-step approach was usually applied to reduce the errors between the physical model and the real system [33]. However, for complex transportation system, it is difficult to calibrate model parameters and establish an accurate physical model.

Another is the functional metamodel, which is composed of generic functions with general purposes. The functional metamodel is usually developed based on analytical tractability, following a data-driven regression analysis approach. Hence, it does not include physical information regarding the underlying problem. A common way is to apply low-order polynomials for constructing the functional metamodel. In recent years, the functional metamodel has been gradually applied to the domain of traffic network design. Chen et al. [34] introduced Kriging surrogates to solve the network design problem under dynamic traffic assignment. Li et al. [35] proved the convergence of solving the continuous network design problem with the surrogate model and showed the advantages of the surrogate model in computation efficiency. However, the functional metamodel relies highly on data, and the approximation performance outside the range of sample data is often unsatisfactory. It is typically that the data-driven method has a rigid requirement on the sample data and parameter fitting in order to achieve a good approximation performance.

To overcome the shortcomings of the physical and functional metamodels, Osorio and Bierlaire [32] proposed a metamodel that combines a functional component with a physical component to approximate the traffic queueing process. The purpose of the functional component is to provide a more accurate local approximation, and the physical component is to provide a good global approximation. It has been shown that the combined metamodel method has a faster convergence speed and better fitting performance [36, 37]. The above-mentioned studies focus on local intersection signal control, which does not consider the travelers’ route choice behavior. Moreover, the demand uncertainty is not explicitly addressed.

Following the combined metamodeling approach, this paper proposes a metamodel-based optimization method for traffic network signal design under stochastic demand. Taking account of the stochastic features of traffic demand, a global optimization model is established with the goal of minimizing the expected total travel cost of the road network. Therefore, it needs to calculate the equilibrium flows under random demand scenarios and derive the expected performance. In order to improve the computational efficiency of solving the average equilibrium traffic state, a metamodel that consists of a traffic assignment model (physical modeling) and a model bias (generic function) is constructed to approximate the expected equilibrium traffic flow. This paper further proposes to incorporate the gradient information of traffic flow with respect to the decision variable (the signal timing plan in our case) in the combined metamodel. By incorporating the gradient information, it is able to improve the parameter fitting performance and hence the solution optimality. A gradient-based metamodel algorithm is then developed to solve the network signal control optimization problem. The main contributions of this paper are summarized as follows:(1)A metamodel-based optimization method is developed for traffic network signal design under stochastic demand. To explicitly address the stochasticity in traffic demand and improve the computation efficiency, a combined metamodel that consists of a physical modeling part and a model bias generic part is proposed to approximate the time-consuming average equilibrium flow solution process.(2)A gradient metamodel scheme is further developed to make use of the gradient information of traffic flow to improve solution performance.(3)A gradient-based metamodel algorithm is proposed to solve the network signal control optimization problem.

The rest of the paper is organized as follows. Section 2 elaborates the problem formulation and methodology of the metamodel-based optimization for traffic network signal design. Section 3 presents the numerical example on a test network. Insights into the properties of the proposed metamodel method and the solution performance of the method are demonstrated. Concluding remarks are discussed in Section 4.

2. Metamodel-Based Optimization Method for Traffic Network Signal Design

2.1. Traffic Network Design Problems under Stochastic Demand

In view of the inherent variations in traffic demand, in the traffic network design problem, the stochastic features of traffic demand need to be explicitly addressed in the optimization model to ensure reliable decisions. For the traffic network signal design problem under stochastic demand, it can be expressed as the problem of minimizing the expected total travel cost of the road network as follows:where represents the travel cost of link , which is a function of signal settings (such as green splits) and link flow . represents the total number of links in the road network. Equation (1) is the objective function, i.e., minimizing the average of the total travel cost of all links. Constraint condition (2) represents the equilibrium flow constraint. The equilibrium link flow pattern is related to the signal settings and the stochastic traffic demand , , represents the sample size of stochastic demand. The equilibrium flow is derived by the traffic assignment model . Equation (3) is the signal timing constraint. Equation (4) sets the upper and lower limits of the signal control variables. According to the discussion above, in the presence of demand uncertainty, it is necessary to calculate the equilibrium link flow under a certain demand distribution. In other words, calculations of the traffic assignment model and the total travel cost function are repeated a large number of times, leading to a computational-intensive optimization problem. Therefore, the computational budget restricts the application of the stochastic network design in real-time or large-scale problems.

2.2. Metamodel-Based Optimization Method for Network Signal Control

In order to improve the efficiency of calculation, this paper proposes a metamodeling approach. As shown in equation (1), the objective is to minimize the expected total travel cost, which requires calculating the equilibrium flow under different demand scenarios. It usually involves a large number of scenarios (sample size) in order to achieve a comparable accuracy level, leading to a time-expensive calculation process. Therefore, the metamodel is developed as a surrogate of the expensive calculation process to improve computational efficiency. First, we assume that the expected total travel cost is associated with the expected equilibrium link flow under stochastic demand. In general, calculating the expected equilibrium flow takes most of the computation time.

To reduce the computation time, we introduce a metamodel as a surrogate of , to approximate the expensive calculation of the expected equilibrium flow with different demand scenarios. is the average traffic demand. and are parameters of the metamodel, whose feasible regions are and , respectively.

Based on the metamodel, traffic network signal design problem under stochastic demand can be written as follows:where in equation (6) we calculate the expected equilibrium flow with the metamodel. Other constraints are the same of the original problem. In order to improve the approximation accuracy and make the approximate result of the metamodel closer to the actual average equilibrium flow, a suitable parameter set should be determined. The parameter fitting can be formulated as a general least square error problem:where is the iteration indicator and is signal settings at iteration .

As discussed, the metamodel is an analytical approximation of the expensive calculation process of the original optimization, i.e., the calculation of average equilibrium flow under stochastic demand. The metamodel-based optimization method then iterates over two main steps, including a metamodel fitting step and a signal control optimization step (i.e., the traffic network signal design). Figure 1 shows the interaction between different modules in the metamodel-based optimization framework. The metamodel is constructed based on a sample of calculation results of the average equilibrium flow. Given the signal settings and stochastic demand, we can calculate the average equilibrium flow which involves solving the equilibrium flow for each demand and taking the average value. In the metamodel fitting step, based on the current sample of average equilibrium flow, the metamodel is fitted by solving the optimization problem (9). Then, the signal control optimization step uses the fitted metamodel as constraint (6) to solve the signal control design problem and derive the optimal signal settings . Further, the updated signal settings are implemented in the expensive calculation process, which leads to a new calculation result of the average equilibrium flow . As the new sample becomes available, the metamodel is fitted again, leading to a more accurate metamodel. The two steps iterate until convergence. At convergence, an accurate metamodel that approximates the original model can be obtained, and ultimately the optimal control scheme derived based on the metamodel should be close to the solution of the original traffic network design problem under stochastic demand.

2.3. Equilibrium Flow and Metamodel Fitting

The traffic network signal design considers the equilibrium flow constraint. From a network planning perspective, the signal control involves the interaction between the controller and travelers. The controller anticipates travelers’ route choice response when determining the signal settings, while travelers make route choice based on traffic conditions depending on the signal settings [1315]. Hence, the route choice response and the resulting equilibrium flow pattern, which is derived by solving a traffic assignment problem, are taken as constraints in the network signal design process. In general, finding the solution of traffic assignment problem can be represented as a fixed-point problem. The link flow determines the link travel cost, and the route travel cost calculated from the link travel cost will affect the route selection and hence the traffic flow assignment. This can be formulated as the following equations:where is the link cost vector, which is calculated as a function of link flows and signal settings , represents the route flow, and is incidence matrix of link-route flow, which can transform the route flow function into the link flow function . Finding the solution of equations (10) represents a fixed-point problem, for which there exist different solution algorithms [38]. Assuming that the link cost function is continuous and strictly increasing with and the link flow function is continuous and monotonically decreasing with , the existence and uniqueness of the fixed-point solution is guaranteed [39]. The solution of the fixed-point problem is the equilibrium flow. The signal settings will affect the equilibrium state because the travel cost highly depends on the signal settings. Given a set of signal settings , the equilibrium flow can be expressed as follows:

The solution of this fixed-point problem depends on the link travel cost function and link flow function. Equation (11) shows that the equilibrium flow is related to the signal settings.

In this paper, the metamodel is used to approximate the average value of equilibrium flow under stochastic demand. As mentioned above, the metamodel that combines a functional component with a physical component is considered. The purpose of the functional component is to provide a detailed local approximation and that of the physical component is to provide a good global approximation. This study develops a combined metamodel to approximate the average equilibrium flow. We formulate the traffic assignment model as the physical modeling part. is the set of signal settings, and is the set of model parameters to be calibrated. The generic function is expressed as . Then the metamodel can be written as follows:where is the parameter of the generic function. In this paper, we consider the low-order polynomials function and define as follows:where N is the number of signal control variables. Therefore, the objective function of the metamodel fitting problem (9) can be written as follows:

The first term is the error between the approximate result of the metamodel and the actual average equilibrium flow , and the second term is the ridge penalty term.

Next, we elaborate on the development of the metamodel. First, the physical metamodel that only considers the simplified problem-specific model (the traffic assignment model in our case) is established. Then, the concept of model bias is introduced, and a combined metamodel with the model bias as the generic part is proposed. To improve the solution performance, this paper further integrates the traffic flow gradient information into the combined metamodel.

2.3.1. Physical Metamodel

The physical metamodel only considers the simplified physical model, that is, the traffic assignment model , as shown in equation (11). Generally, a two-step scheme is used to iteratively update model parameters and determine the optimal signal settings as follows:where is the iteration indicator, and constraints of the optimization problem are not included for simplicity. Equation (15) represents the problem of model parameter estimation, which minimizes the distance between the approximate metamodel and the average equilibrium flow by updating the model parameters. Equation (16) represents the signal optimization problem. Based on the fitted metamodel, the optimal signal setting is calculated by minimizing the total travel cost, and these two steps iterate until convergence.

2.3.2. Combined Metamodel with Model Bias

In view of the physical modeling error, this paper introduces a concept of model bias, which is defined as the error between the traffic assignment model and the average equilibrium link flow of the system as follows:

At iteration step t, the model bias is calculated by the average equilibrium flow and the traffic assignment model with the corresponding signal settings as follows:

With the help of model bias, a combined metamodel is developed as follows:

The combined metamodel consists of two terms. The first term is the traffic assignment model, which is the physical modeling part. The second term of model bias corresponds to the generic function part, which is updated by using the data during the iteration process. The signal optimization design problem is formulated as follows:

The model bias is updated with the data obtained during the iteration process.

2.3.3. Gradient-Based Metamodel

In this paper, a combined metamodel considering gradient information of traffic flow is proposed. In general, gradient is an important information for finding the descending direction of the optimization problem. In the traffic assignment model, the gradient reflects the variations of the traffic flow when the signal settings change. Incorporating gradient information generally improves solution performance in terms of convergence and solution optimality, i.e., faster convergence and better solution point [14]. Patwary et al. [40] proposed a metamodel method with traffic flow gradient for an efficient calibration of large-scale traffic simulation models. For calculating the gradient of the equilibrium flow, this paper makes use of a finite difference (FD) approach, which requires perturbing each signal control variable and calculates the corresponding derivative component.where is the equilibrium flow function (i.e., the traffic assignment model) and is a small perturbation on signal control variable . Calculating the gradient of the traffic assignment model, i.e., , is trivial. However, it is computationally intensive to estimate the gradient of the actual average equilibrium flow, i.e., . This is because for each changed signal control variable, derivatives of equilibrium flows under different demand scenarios are required, which involve repeatedly solving the traffic assignment model. Regarding the computational budget on calculating the gradient information, this paper applies a finite difference approximation method [41], which uses the results recorded in previous iterations to estimate the Jacobian matrix of the average equilibrium flow. In each iteration, the Jacobian matrix is updated by the average equilibrium flow obtained in the historical iterations. Assuming that the number of control variables is , then control parameters and corresponding values of the average equilibrium flow are required, i.e., and . The Jacobian matrix of iteration t can be calculated by the following formula:where .

Therefore, the Jacobian matrix estimation based on the average equilibrium flow recorded in the historical iterations can be implemented as follows:Step 1: set a set of initial signal settings and the corresponding values of the average equilibrium flow under stochastic demand, i.e., and ; calculate the initial Jacobian matrix from equation (21), i.e., ;then solve the metamodel-based optimization; and derive .Step 2: apply , calculate the average equilibrium flow, update the set of signal control settings and flows, i.e., and , and calculate Step 3: input to solve the metamodel-based optimization and update Step 2 and Step 3 are iterated until the convergence condition is satisfied. During the process, the gradient of the traffic assignment model and the gradient of the average equilibrium flow should be calculated for each iteration step. Considering the gradient information of traffic flow, the following combined metamodel is constructed:

The gradient information is added to the calculation of model bias. As shown in equation (24), the model bias part is updated with , corresponding to the generic function in equation (12).

Now at iteration step , the combined metamodel can be determined by the average equilibrium flow , the equilibrium flow calculated by traffic assignment model , the gradient of the average equilibrium flow , and the gradient of traffic assignment model . Compared with the metamodel with model bias in equation (19), the gradient-based metamodel (24) not only considers the value of model bias but also takes account of the gradient information, i.e., the first-order derivative information. This gradient-based metamodel method, which incorporates the gradient information of the metamodel at each local point , can ensure the first-order optimality at convergence.

Applying the gradient-based metamodel, the optimal signal setting at th iteration is determined by solving the following optimization problem:

Choose a control step size and update the signal settings bywhere represents the control step size with a range of [0, 1].

Algorithm 1 summarizes the solution process of the traffic network signal design problem under stochastic demand by using the combined metamodel method considering gradient information.

Step 1: initialization. Set the parameters of traffic assignment model . Set a set of initial signal settings .
Step 2: apply the initial signal setting. Based on the initial signal settings , calculate the average equilibrium flow , and get the corresponding ; calculate the gradient of the traffic assignment model and the gradient of the initial average equilibrium flow, construct the combined metamodel as equation (24), and apply it into equations (25)–(28) to solve the signal control optimization problem, obtain the control , and update the iteration step .
Step 3: calculate the average equilibrium flow. Implement to derive and update the set of signal settings and the corresponding average equilibrium flow, i.e., and .
Step 4: update the gradient-based metamodel. Calculate the gradient of the metamodel according to equation (22); calculate the Jacobian matrix based on equation (23) to obtain ; update the combined metamodel at the current iteration, i.e., .
Step 5: update the signal setting. Calculate by solving the control optimization (25)–(28) with the updated metamodel and update the signal setting .
Step 6: check termination. Stop if the termination condition is satisfied; otherwise, set and go to Step 3.

3. Numerical Examples

3.1. Simulation Setup

In this paper, a combined metamodel considering gradient information of traffic flow is proposed. This section establishes a simulation network to test the performance of the proposed method. Figure 2 is the test network, which consists of one OD pair (from node 1 to node 6), 8 links, and 5 routes. Link travel cost is calculated using a linearized Bureau of Public Roads (BPR) function. The signal control plans of intersection node 3 and node 4 are decision variables. Assuming that the intersections operate in a two-phase timing plan, the green split is to be optimized. The signal loss time is not considered in this case, i.e., at intersection 3 and at intersection 4.

Assuming that the travelers follow a nested logit (NL) structure for making route choice decisions, the probability of choosing route can be expressed as follows:where the route travel cost is denoted by . The route choice set is divided into subsets . is the ratio of dispersion parameters of the two-layer structure of NL, associated with the first and second choice levels, respectively.

The link travel cost is derived by a linearized BPR function [42]. Defining the free-flow travel time , saturation flow , and a coefficient , the link travel cost is expressed as a function of the link flow and signal settings as follows:

For nonsignalized links, signal settings are equal to 1.

The equilibrium link flow that can be obtained by solving the fixed-point problem depends on the link travel cost and link flow under a given traffic demand. The above calculations need to be carried out many times under the stochastic traffic demand to obtain the average equilibrium flow and then calculate the average total travel cost of the network.

In this paper, the metamodel method is introduced to simplify the traffic assignment calculation process and approximate the average equilibrium flow. In general, we cannot derive an accurate model of route choice behavior. In this case study, we assume that a multinomial logit (MNL) model with the dispersion parameter is used to describe the route choice and construct the metamodel of average equilibrium flow. The probability is calculated by the model as follows:

The link travel cost is also represented by the BPR function (31). The equilibrium flow is derived by solving the fixed-point problem with MNL and BPR function, which is used as the physical modeling part in the combined metamodel to approximate the average equilibrium flow. The total travel time is formulated as a function of the equilibrium flow and signal setting:

Signal control decisions are to be made based on the metamodel, and the objective is to minimize the expected total travel cost on this network. All optimization problems in this numerical example are solved using the Python optimization toolbox. Characteristics of the network and model parameters are listed in Table 1.

3.2. Sensitivity Analysis of the Model Parameter

As discussed, the traffic assignment model is used as the physical modeling part in the metamodel. In order to evaluate the role of model parameters and examine whether the model performance is sensitive to the parameters, we first conduct a sensitivity analysis on the traffic assignment model with respect to different model parameters.

In general, the parameter in the BPR function is an important factor; we take it as the parameter to be calibrated. Next, we analyze the impact of the route choice parameter and the saturated flow . Fixing and saturated flow , we adjust the parameter with a step size of 0.01 in the range of and calculate the corresponding link flow and total travel cost based on the physical metamodel. The solution of optimal signal control plan is also derived with the corresponding parameters. Similarly, fixing parameter and parameter , we adjust the saturated flow with a step size of 10 in the range of and calculate the corresponding change rates. Figures 3 and 4 show the variation and the change rate of link flow, total travel time, and optimal signal scheme with the route selection parameters and saturated flow , respectively. The results show that both parameters can affect the calculation results of the physical metamodel. In particular, the parameter has a more significant effect on the results when it is greater than 1.2. In view of the magnitude of the parameters, both have a fair impact on the network flow and control scheme. Therefore, the BPR parameter , route choice parameter , and saturation flow are taken as the fitting parameters of the physical metamodel.

3.3. Result Analysis and Comparison

In this section, we test the performance of the proposed gradient-based metamodel method and compare it with the general physical metamodel and the combined metamodel method with model bias. We set the stochastic OD demand with a mean value of 2,000 and a variance of 10 and select a sample size of 500. Under stochastic demand, the equilibrium flows under 500 demand samples are solved, and the corresponding average total travel cost is calculated.

3.3.1. The Benchmark Optimal Solution

We first calculate the optimal solution of the computation intensive network signal design problem under stochastic demand. Note that this is just used as a benchmark to examine the proposed method. The goal of our proposed metamodel-based method is to reduce the computation time while retaining the solution optimality. The optimal signal control scheme, link flow, and total travel cost are calculated by solving the signal control design problem with the NL model under stochastic demand, and the results are listed in Table 2. Figure 5 shows the expected total travel cost surface. Deviation of these results involves a computation-intensive process to calculate the average equilibrium flow and expected total travel cost. The main purpose of listing the optimal control scheme here is to provide a benchmark for the subsequent method validation. In this paper, we propose a metamodel to approximate the time-consuming process to reduce the computation time of the optimization problem and make the optimization result as close as possible to the optimal signal control scheme.

3.3.2. Solution Performance of the Metamodel Method

To illustrate the performance of the proposed method, we compare three metamodel schemes, i.e., the proposed gradient-based metamodel method (GD), the combined metamodel with model bias (bias), and a traditional physical metamodel method (two-step). By comparing with the physical metamodel method, we test the value of adding a model bias generic part in the combined metamodel. Furthermore, by comparing the GD method and the bias method, we validate the role of gradient information in improving solution optimality. Select different initial control points and analyze the convergence performance of the three methods. The initial points are () = (0.3, 0.7, 0.73, 0.27), (0.8, 0.2, 0.8, 0.2), and (0.2, 0.8, 0.2, 0.8), respectively, and the control step size . Figures 6 and 7 illustrate the convergence performance and the optimal solutions of three methods under different initial points. The selection of initial points typically affects the convergence process of the algorithm. The results show that, compared with the physical metamodel, the combined metamodel greatly improves the optimal solution (in terms of reducing the expected total travel cost) with the help of the model bias. Moreover, by explicitly incorporating the gradient information of traffic flow, the gradient-based metamodel method further improves the solution performance and converges to a smaller total travel cost (i.e., convergence to a lower contour in Figure 7), which is closer to the original optimal solution.

3.3.3. Analysis of the Computation Time and Solution Optimality

Solving the network signal control problem under stochastic demand requires carrying out the fixed-point problems multiple times to obtain the corresponding equilibrium flow and the expected total travel cost, leading to a computationally expensive process. Therefore, this paper proposes a gradient-based metamodel method to approximate the average equilibrium flow function, replacing the time-consuming part of the signal control design problem. In this regard, the metamodel method can be evaluated from two aspects, namely, computational efficiency and solution optimality (i.e., whether the optimal solution derived from the metamodel method is close to the optimal solution of the original problem).

Tables 35 list the results of three metamodel methods with different initial points, including the computation time and the optimal solution performance (the expected total travel cost). In this example, different initial points have little influence on the optimal solutions. The entire process of metamodel-based optimization includes metamodel fitting, solving the optimal control, and calculating the sample average equilibrium traffic flow. The time for metamodel fitting and solving the optimal control problem with the metamodel methods is in total approximately 0.04 s. The time to obtain the average equilibrium traffic is about 0.28 s. Therefore, in terms of computation efficiency, the time to solve the average equilibrium flow problem accounts for approximately 85% of the total calculation time in the metamodel optimization method. This shows that the time-consuming process in the iteration is the multiple runs of the traffic assignment model under stochastic demand, which in turn validates the need of a more efficient surrogate for the calculation of the average equilibrium flow. An improvement factor (defined as the ratio of the computation time of the benchmark optimal control scheme to the computation time of the metamodel method) is introduced to capture the improvement of the computation time. The results show that although there is a small reduction in solution optimality, the metamodel methods can significantly reduce the computation time (the computation time is reduced by 4.84 to 13.47 times under different initial points). With the help of the model bias, the combined metamodel can better approximate the original optimal solution. As indicated in Tables 35, compared with the traditional physical metamodel method, the combined metamodel method with model bias improves the total travel cost. Moreover, by incorporating the gradient information, the gradient-based method further improves the optimal solution. The numerical results show that the proposed gradient-based metamodel method can effectively improve the computation efficiency while slightly increasing the total travel cost (i.e., 0.09%, 0.09%, and 0.06% under the three initial points).

The influence of control step size on the gradient-based metamodel method is further analyzed. The step size adjustment methods with different optimization descent directions are considered. The commonly used step size update methods include Adam, Momentum, and RMSprop algorithms. We select the initial point (0.45, 0.55, 0.5, and 0.5) and compare these step size update methods, as shown in Figure 8. Adam and RMSprop converge slowly at the beginning because they limit the update within a certain range, which however makes the convergence process more stable. Therefore, different control steps will also affect the convergence process of the gradient-based metamodel method. In the solution process, we should carefully select the initial point and the control step under a specific problem setting.

4. Conclusion

This paper developed a metamodel-based optimization method for traffic network signal design under stochastic OD demand. Solving the network design problem considering uncertainty typically involves an expensive calculation process to derive the equilibrium flows with a certain demand distribution. This paper applied a metamodeling approach and used a metamodel as a surrogate of the expensive calculation process of the average equilibrium flow, so as to enhance the overall computational efficiency. More specifically, based on the concept of model bias, a combined metamodel was developed, which integrates a physical modeling part (i.e., the traffic assignment model) and a model bias generic function. In order to further improve the solution performance, i.e., convergence and solution optimality, of the metamodel-based optimization method, the gradient information of traffic flow was incorporated in the metamodel, which provides a better descent direction of searching for the optimal solution. We tested the proposed gradient-based metamodel method on an example network. Three methods were compared, including our proposed gradient-based metamodel, the combined metamodel with model bias, and the physical metamodel. The comparison was conducted to investigate the importance of incorporating a model bias generic part and the traffic flow gradient information in the combined metamodel. Numerical results showed that there is a trade-off between computation time and solution optimality. Although there is a reduction in solution optimality, the metamodel methods significantly reduce the computation time (by 4.84 to 13.47 times under different initial points). By incorporating the model bias, the combined metamodel is able to better approximate the original optimal solution. Moreover, incorporating the traffic flow gradient information in the search algorithm further improves the solution performance. Comparison results indicated that the proposed gradient-based metamodel method can effectively improve the computation time with a small increase of 0.09% in the expected total travel cost.

In this paper, we apply the linear model to construct the generic function part of the combined metamodel. In future study, more functional forms including higher-order functions can be explored to improve the fitting performance of the method. Moreover, methods that can handle a larger amount of data should be explored. In addition, this paper focuses on developing the methodology and we test the effectiveness of the proposed metamodel method on a small example network. Our further research work will consider applications on larger road networks, probably based on certain traffic simulation models.

Data Availability

The numerical example data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

The study was supported by the National Natural Science Foundation of China (No. 52102401), the Guangdong Basic and Applied Basic Research Foundation (No. 2023A1515012886), and the Shenzhen Science and Technology Program (Grant No. 202206193000001, 20220817201129001).