Scheduling unmanned aerial vehicle and automated guided vehicle operations in an indoor manufacturing environment using differential evolution-fused particle swarm optimization

Intelligent manufacturing technologies have been pursued by the industries to establish an autonomous indoor manufacturing environment. It means that tasks, which are comprised in the desired manufacturing activities, shall be performed with exceptional human interventions. This entails the employment of automated resources (i.e. machines) and agents (i.e. robots) on the shop floor. Such an implementation requires a planning system which controls the actions of the agents and their interactions with the resources to accomplish a given set of tasks. A scheduling system which plans the task executions by scheduling the available unmanned aerial vehicles and automated guided vehicles is investigated in this study. The primary objective of the study is to optimize the schedule in a cost-efficient manner. This includes the minimization of makespan and total battery consumption; the priority is given to the schedule with the better makespan. A metaheuristic-based methodology called differential evolution-fused particle swarm optimization is proposed, whose performance is benchmarked with several data sets. Each data set possesses different weights upon characteristics such as geographical scale, number of predecessors, and number of tasks. Differential evolution-fused particle swarm optimization is compared against differential evolution and particle swarm optimization throughout the conducted numerical simulations. It is shown that differential evolution-fused particle swarm optimization is effective to tackle the addressed problem, in terms of objective values and computation time.


Introduction
2][3] It creates a smart factory, where automation of the manufacturing operations is the key factor.This automation enables the minimization of human-labor interventions on tedious, time-consuming, and sometimes hazardous jobs.Machines (resources) and robots (agents) can autonomously perform the given tasks in an efficient manner.This could mean the optimization in terms of time, energy consumption, or other objectives.
A pilot study by Khosiawan et al. 4 on the task scheduling system for unmanned aerial vehicle (UAV) operations in indoor environment has opened the gate toward the executions of material handling and visual inspection by UAVs.Task automation by employing UAVs gives a remarkable value in terms of time efficiency and capability.A UAV has more freedom in gathering images from various angles for an inspection task.On the other hand, a heavy material handling task is suitable for an automated guided vehicle (AGV) to perform.This becomes the motivation of the collaborative operations among UAVs and AGVs to perform multiple tasks in an indoor manufacturing environment, which is addressed in this article.
In the past, gradient-based optimization methods were used, and they only guarantee convergence toward local optima. 5Furthermore, non-convex problems cannot be solved easily by those methods.In contrast, metaheuristic algorithms can explore regions in the search space at an affordable computation time, and does not tend to get trapped at a local optimum due to inbuilt escape mechanisms.
Particle swarm optimization (PSO) and differential evolution (DE) are two prominent metaheuristic algorithms which are popularly used by researchers in various optimization fields.Nilakantan et al. 6 implemented both approaches and found that DE could improve the energy efficiency of the robotic assembly lines in the manufacturing environment.A comprehensive study by Price et al. 7 shows that DE usually gives the best result with a longer computation time compared to PSO.Supported with a priori studies by Khosiawan et al. 4,8 there is a room of improvement for the explorative characteristic in the body of PSO framework.This is aligned with the reported works in the existing literatures.In this study, an approach of fusing DE's explorative characteristic into PSO is proposed, and this gives birth to DEfused PSO (DEFPSO).
In regard to the addressed problem, DEFPSO is compared against DE and PSO in three aspects: makespan of the produced schedule, total battery consumption of the produced schedule, and the computation time.Correspondingly, the benchmark is done by using task data sets (which comprise tasks for UAVs and AGVs) with different weights on the following characteristics: geographical scale, number of predecessors, and number of tasks.These data sets are generated by the authors based on test flights at the laboratory and a field study of an indoor industry site.The investigation is remarked with a satisfactory performance of DE in terms of the pursued objectives: makespan and total battery consumption (of the optimized schedule), and the respective computational time.
The main contributions of this study are described as follows: (i) This study developed a mathematical formulation of the addressed problem of collaborative UAV-AGV operations in an indoor manufacturing environment.(ii) This study developed a DEFPSO which is measured as a methodology which generally outperforms DE and PSO.The measured characteristics are the solution's makespan and total battery consumption, together with its computation time.
The content of the article is organized as follows.The "Literature review" section describes the literature on metaheuristic-based approaches toward optimization problems, focusing on scheduling.The "Problem definition" section outlines the formal description of the problem, accompanied with the representative mathematical formulation.In The "Methodology" section, the proposed approach with heuristic and metaheuristic algorithms are described in detail.The "Numerical simulations" section presents the results and analysis of the benchmark of DE, PSO, and DEFPSO upon different data sets.A summary of the conducted study is then provided in the "Conclusion" section.

Literature review
][11] The desired autonomous operations demand a planning system to generate a schedule of task executions in a cost-efficient manner. 12In such a system, numerous constraints according to the operational environment need to be taken into account-in connection with the respective objective function.As the scale of the problem increasesin terms of the number of agents, tasks, and constraintsthe computation time grows exponentially.This entails the employment of a scheduling methodology which is able to search the optimum solution in the solution space whilst balancing time efficiency.
The paradigm of such an effort is known as optimization, and heuristic & metaheuristic algorithms have come to researchers' and practitioners' rescue to tackle various forms of optimization problem in the last two decades. 5mong others, PSO and DE are the prominent metaheuristic algorithms in the optimization field.

Particle swarm optimization
PSO 13 is a metaheuristic-based optimization method which emphasizes the collaborative learning through the individual experience and social interactions among the particles during the search.The algorithm allows particles to go through different directions in the search space, while enabling them to adjust the direction to some extent toward the (global) best one so far.This behavior is enabled by the role of local and global best particles, respectively.Two major updates in the PSO procedure are velocity and position updates, as depicted in equations ( 1) and (2).Velocity updates utilize parameters learning coefficients c 1 and c 2 , together with velocity coefficients u 1 and u 2 .They will determine the degree of learning toward the local and global best particles ( lo P t i and G t ).Correspondingly, the updated velocity will be used to modify the position.This process is done in every generation t and every particle i.
The initial swarm plays a significant role in giving good starting points. 14The comprised initial particles are generated through intuitive heuristics, which are inspired by the characteristics of the problem.The more distinct the initial particles produced, the more explorative the search will be-right from the beginning of the search.
Zhu et al. 15 and Mahmoudzadeh et al. 16 have investigated that the incorporation of PSO is efficient for the problem of task assignment toward multiple robots.In connection with this article, such a problem is NP-hard natured.Deciding whether there exists a schedule where all tasks are executed is an NP-complete problem.However, when one looks for an optimum schedule (e.g. with the minimum makespan), it becomes an NP-hard problem-NP-hard problem is at least as hard as NPcomplete problem.

Differential evolution
Along with PSO, DE belongs to the family of swarm intelligence algorithms.With the same principle of initial swarm, the performance characteristics can be different.While DE's computation time may not be the fastest one, it usually produces the best result among several other algorithms. 6,7ro ¨mer et al. 17 has applied DE to the independent tasks scheduling problem on heterogeneous distributed environments, which is an NP-complete problem.Without any tuning, it managed to optimize schedules to a certain degree.The authors found that using scheduling heuristics for generating initial population for DE delivers good results.Moreover, Nearchou and Omirou 18 employed DE for solving NP-hard scheduling problems.The authors concluded that with a slight modification of encoding scheme within DE, the performance was found substantially superior than the original form's.
The existing works mentioned above suggested the insights of approaching scheduling problems with metaheuristic algorithms, and they can be effective to tackle different combinatorial optimization problems.Furthermore, some reported studies 19,20 have performed a comparative evaluation of several metaheuristic algorithms (e.g.genetic algorithm, ant colony optimization, artificial bee colony, and PSO) on tackling different optimization problems, which once again exhibits metaheuristics as the major player in the game.
Metaheuristic algorithms are well known for their adaptability, in connection with the type of the problem, and its simplicity during implementation.Metaheuristics are general purpose, they are not problem specific.Their role is to guide a lower level heuristic, encompassing both intensification (to concentrate on high quality areas of solution space) and diversification (to allow the freedom to explore unvisited areas of search space) characteristics.

Problem definition
Automation in the manufacturing environment has been a consistently growing interest in both research and implementation.One of the technological advancements is the usage of robot agents such as UAV and AGV on the shop floor.In this study, the problem focuses on scheduling the task executions by multiple UAVs and AGVs in an indoor manufacturing environment.The types of task during the operations are listed in Table 1.
An instance of a task data set is depicted in Table 2.It comprises attributes such as task identifier, start position, end position, task type, payload, and predecessor(s).
The given tasks in the data set shall be performed by the agents (i.e.UAVs and AGVs) in an efficient way (according to the defined objective, e.g.makespan).The execution manner in regards to the available agents, time, and other resources (e.g. machine at a particular position) is planned in a schedule.The example of a schedule representation is depicted in Figure 1.
The objective of the optimization problem in this study is to generate a schedule of the given tasks which optimizes the makespan and the battery consumption, whilst balancing time efficiency.The optimization process is driven by this objective, while being bounded to the defined constraints (e.g.agent's battery capacity, precedence relationship between tasks, and geographical space limitation).
The integer programming formulation of the problem in this article is described as follows.

Mathematical formulation
In this section, the mathematical formulation of the novel problem of collaboratively scheduling UAV and AGV operations is described.We begin with a set of UAVs U ¼ f1; :::ug and AGVs A ¼ f1; :::ag.The UAVs and AGVs will be scheduled to complete a set of tasks N ¼ f1; :::ng.Each UAV u and AGV a has a level of energy which can be replenished by a recharge station denoted as the set R ¼ f1; :::rg.Each recharge station r has a number of slots/maximum capacity given by r i .
The objective function is to minimize the makespan of the schedule whilst serving all jobs as described in equation ( 3) Subject to the following constraints Equation ( 4) illustrates that each task is executed only once, by either a UAV or AGV.Here, x u;n equals one if task n is allocated to UAV u, and x a;n equals one if task n is allocated to AGV a.
Equation ( 5) guarantees that a recharge station comprises at least one recharge slot or more, where r i equals the number of recharge slots available at r Equation (6) states that a recharge slot can only be occupied by a UAV or AGV at any time.Here, r t;u and r t;a are equal to one if recharge slot r is occupied by either u or a at time t Equation (7) ensures that a UAV or AGV may wait on ground if the recharge slot r is occupied.We use w t;u;r and w t;a;r equal to one if at time t a UAV u or AGV a is waiting for recharge slot r w t;u;r þ w t;a;r r t;u þ r t;a 8u 2 U ; a 2 A; t 2 T ð7Þ Equation (8) shows that each task n has a begin time a n and a duration w n which when summed equals the end time of the task Equation (9) shows that each UAV or AGV can only execute one task at a time.Let x 0 n;n 0 ;u or x 0 n;n 0 ;a equals one if both task n and n 0 are allocated to either UAV u or AGV a Equations ( 10) and ( 11) state that if two tasks are both scheduled, x 0 n;n 0 ;u ¼ 1 or x 0 n;n 0 ;a ¼ 1 to be completed by UAV u or by AGV a, then both tasks are individually allocated to u and a also Equations ( 12) and (13) show that if two tasks are scheduled to the same UAV or AGV, then each task belonging to this pairing is also scheduled Equation (14) shows that if two tasks are allocated to the same resource; that is, q n;n 0 ¼ 1, then both tasks are allocated either to UAV u or to AGV a Equation ( 15) illustrates that a recharge can only happen to UAV u before executing task n if task n is allocated to u Equation ( 16) states that a recharge can only happen to AGV a before executing task n if task n is allocated to a Constraints ( 17) and (18) ensure that the start time a n and the finish time z n lie within the boundaries of the time window in which the job must be completed ½n min ; n max Constraint (19) guarantees that a task n may only begin once all of its predecessors have been completed.
Constraint (24) ensures that no tasks are executed at the same time in the same place Constraints ( 25) and ( 26) show what recharge does to the battery level and how the battery is consumed.
Here, the battery level is equal to a minus the travel time from the end position of task n, s n to recharge station r.
Constraints ( 27) and (28) illustrate that the battery level before executing n is equal to the battery level before executing n 0 minus the difference between the start times of n and n 0 .This is subject to the condition that either V n;n 0 ;u ¼ 1 or V n;n 0 ;a ¼ 1, which states that no recharge occurs between the execution of these tasks Conversely, constraints (29) and (30) describe the condition where a recharge does occur between the execution of two tasks.If a recharge occurs then either U n;n 0 ;u ¼ 1 or U n;n 0 ;a ¼ 1.Here the variable O n;n 0 ¼ 1 only if task n 0 precedes task n, where y n;u and y n;a specifies a recharge before n is executed Constraints (31) and (32) ensure that either a recharge happens or it does not before task n is executed Constraints (33) and (34) ensure that if no recharge happens before the execution of task n, then the value that either V n;n 0 ;u or V n;n 0 ;a takes is equal to one.This value is greater than or equal to the sum of O n,n 0 ¼ 1 (if task n is executed after another task), plus x n,u ¼ 1 or x n,a ¼ 1 (if n is allocated to u or a respectively), minus y n,u ¼ 0 (if a recharge has occurred), minus 1 Constraints (35) and ( 36) set the battery level of the UAVs and AGVs at the beginning of the planning horizon to be fully charged.Here a is the maximum level of charge, and t s o ;s n is the travel time from position s o to the start position of task n, s n b n;u ¼ a À t s o ;s n 8n 2 N ; p n ¼ 0; Constraints (37) and (38) determine the start time of the first task to be executed, which is equal to the travel time from the starting position s o to the start position of task n, s n t s o ;s n a n 8n 2 N ; p n ¼ 0; Operational precedence constraints are stated in equations (39) and (40).Here f n denotes the start time of a task that is operationally preceded by task n and f 00 n;n 0 is equal to one if the start time of task n is less than the end time of task n 0 and M is a large constant value Constraint (41) illustrates that two tasks may only happen sequentially if they are scheduled to the same UAV or AGV O n;n 0 q n;n 0 8n; n 0 2 N ð41Þ Constraints (42) and (43) state that the start time of a task preceded by n is equal to the minimum value of f 0 n;n 0 ;u which is equal to a n 0 unless a n 0 z n f n ¼ min Constraints (44)-( 46) state that if two tasks are assigned to the same UAV u or AGV a, then the start time of task n will be equal to the end time of task n 0 , this allows for time continuity to ensure a task n cannot begin until the task that operationally precedes it, n 0 , has been completed.
Constraints (47)-( 49) state that a task can be operationally preceded by at most one task, where p i Equation ( 50) and (51) illustrate that there can be no self operational precedence and no cyclic operational precedence Equation (52) states that no task is completed after the total makespan of the solution The UAV-AGV operations are conducted in the indoor environment, where the map is provided as an input for the scheduling process.A tractable yet realistic position mapping is used, where waypoints are connected with (oneway) directed paths and the whole graph is fully connected.The waypoints in the air are for the UAV operations, while the ones on the ground are mainly for the AGV operations (except the UAV recharge station).In this study, the transmission of the command to the agent is done through a component which verifies that the command does not yield a geographical conflict (path collision) with the currently being executed ones.Otherwise, the transmission is delayed until this constraint is satisfied.
To briefly summarize equations ( 5)-( 52), there are a set of tasks which must be completed, some of which require an AGV (visual inspection) and others a UAV (ground material delivery) to satisfy each task's demand.The objective of the problem is to service all tasks (just once) whilst minimizing the scheduling horizon makespan.
The UAVs and AGVs have levels of charge which can be replenished at a recharge station.At the beginning of the planning horizon, it is assumed that each UAV and AGV has maximum charge.The level of charge that a UAV or AGV has is reduced when travelling to perform tasks.Each recharge station has a maximum number of ports, and therefore, sometimes a UAV or AGV may have to wait until a port becomes available in order to recharge.A recharge must happen if the UAV or AGV does not have enough power to serve the next task.
Each UAV or AGV may only serve a single task at a time, and the end time of a task is equal to the beginning time plus the task duration.In addition, a task has a time window in which the service of a task must begin, and a set of predecessor tasks which must be completed before the service of a task begins.Travel time between locations of successive tasks is also accounted for to ensure time continuity, so the beginning time of a task, is equal to the end time of the previous task, plus the travel time between the locations (if a recharge is not needed).There are also geographical constraints associated with the UAVs and AGVs, such that at no time during the schedule execution are two UAVs or AGVs situated at the same location.

Methodology
Constructive heuristic to create a schedule from a task sequence A constructive heuristic has been introduced in a study by Khosiawan et al. 4 for creating a schedule of UAV operations from a task sequence.Given a task sequence, each comprised task is put into the schedule sequentially in the earliest available time manner.This constructive heuristic has been modified in this study to be able to schedule the tasks in cooperative UAV-AGV operations.As depicted in Table 1, a task needs to be executed by either a UAV or an AGV.The heuristic is modified to construct a schedule with the awareness of the type of the available agents (i.e.UAV or AGV) and the corresponding type of task (i.e.visual inspection by UAV, light material handling by UAV, and heavy handling by AGV).In principle, the available agents for a particular task are filtered based on the type of the task; for example, only UAVs will be checked as the prospective performing agents for the air material delivery.Furthermore, the recharge station selection is also conducted in a similar manner; for example, only recharge stations on the ground will be considered for recharging AGVs.Due to the implementation-wise nature of the modification toward the a priori algorithm, the constructive heuristic to create a schedule from a task sequence is not elaborated further in this article.

DE-fused PSO
The heuristic-based approach is viable for solving the problem of scheduling collaborative UAV-AGV operations, whose nature is NP-hard.There are heuristics for constructing a solution and for exploring the solution space (searching).Constructive heuristics can be used for producing initial solutions prior to the search.Since heuristics are designed based on intuitive rules according to the constraints at hand, the produced solutions are good starting points for the search.These rules are well known as the priority rules.In this study, 10 priority rules have been utilized, which are addressed in the study by Khosiawan and Nielsen. 8The priority rules are depicted in Table 3.A solution is represented as a sequence of tasks, which correspond to a schedule.For instance, a task sequence [1, 5, 10, 9, 7, 6, 4, 8, 3, 2]  corresponds to the schedule depicted in Figure 1.
In the study by Khosiawan et al., 4,8 PSO shows that the algorithm exposes a room for improvements on the explorative side.The position update during the search is guided by the local and global best particles.The global best particle is formed through the efforts of all particles in the swarm, but it is postulated to be marginal.Through an investigation in this study, DE is able to explore the search space, where more optimum solutions lie-where PSO generally does not reach.On the other hand, there is a trade-off between the optimality of the solution and the computation time which is quite significant in DE.
This trade-off is the challenging gap which this study tries to bridge.The proposed DEFPSO is aimed to produce a high quality near optimum solution whilst balancing time efficiency.In the place of the local and global best particles, a random particle from the current swarm is used for the position update.This treatment is realistic because the initial swarm is generated based on the priority rules.These rules employ heuristics which are believed to be sensible to produce a good quality schedule.Furthermore, a crossover operation with the global best particle is performed after the position update.This allows both rapid (position) information absorption from the global best solution and search space exploration (i.e. through the recombinant 7 particle) simultaneously.The detailed procedure of DEFPSO is depicted in Figure 2 and described as follows.
Step 1. Initialize DEFPSO parameters.They include F (degree of velocity update), CR (possibility of crossover), N (size of population), maximum number of iterations, and maximum number of iterations without improvement.
Step 2. Generate initial swarm based on the given priority rules.If the size of population exceeds the number of unique task sequences, random mutations will be performed to the existing particles and the newly formed ones are added into the swarm.If the number of all possible combinations of the sequence x is less than the required size of population, then the size of population is set to x.
Step 3. If the maximum number of generations is reached, select the global best particle as the final solution.Otherwise, go to step 4.
Step 4. If the maximum number of generations without any improvement is reached, select the global best particle as the final solution.Otherwise, go to step 5.
Step 5.If every individual in the population has been evolved in the current generation, go to step 3. Otherwise, get the next unevolved particle, evaluate its fitness value, and update the global best particle if a better solution is found.
Step 6. Update the position based on the current velocity.
Step 7. Crossover with the global best particle is conducted based on the value of CR.This action is performed to promote the generation of high quality offspring.This allows a great step of search, while inducing a good drive (direction) throughout the search.On the other hand, it evens out the absence of the local best particle influence (see step 8 for more elaboration).Step 8. Update the velocity based on a random particle (other than itself) from the swarm.The degree of velocity update is affected by F. It acts similar to the role of social learning coefficient c 2 in the traditional PSO.In contrast with the traditional PSO (and as briefly mentioned in step 7), DEFPSO does not take the distance of the local best particle with the current one.This treatment is performed to allow more explorative behavior during the search.Afterwards, go to step 5.In this study, the optimization with DEFPSO is aimed to minimize the makespan and total battery consumption.The fitness evaluation will be done with makespan as the top priority.When the makespan of two schedules are the same, the total battery consumption will be used as a tie breaker.The schedule with less makespan and total battery consumption is preferred.The results of the numerical simulations are shown in the following section.

Numerical simulations
The proposed methodology has been benchmarked with 12 data sets, each with different weighted characteristics, that is, geographical scale (laboratory scale and industrial scale), number of predecessors, and number of tasks.The simulations are run on an Intel Core i7-4910MQ processor (2.9 GHz) with 32 GB of RAM.They involve numerous scheduling attempts in the following manner.
There are two geographical scales: laboratory and industrial scale.For each scale, there are three different data set classifications based on the mean number of predecessors: 0, 1, and 2. The exact number of predecessors of a task will be normally distributed with x ¼ 0 _ 1 _ 2 and s ¼ min ð1; xÞ.
For each mean number of predecessor, there are two data set classifications based on the number of tasks: 50 and 100.
In the end, there are 2 Â 3 Â 2 ¼ 12 data sets with different weights of the aforementioned characteristics (i.e.geographical scale, number of predecessors, and number of tasks).For each task data set, 20 scheduling runs are performed.
With numerous runs on the same data set, the analysis results are based on reproducible behavior of the tested algorithms.In total, there are 12 Â 20 ¼ 240 runs for each algorithm.Since there are three benchmarked algorithms: DE, PSO, and DEFPSO; 240 Â 3 ¼ 720 runs are performed.

Parameter values
The selected set of parameters through the simulations, in respect to the investigated three methodologies (i.e.DE, PSO, DEFPSO), are listed as follows.

PSO
The values of c 1 ¼ 1 (cognitive learning coefficient) and c 2 ¼ 2 (social learning coefficient), while u 1 and u 2 are randomly (following a uniform distribution) set in the range of [0, 0.5].

DEFPSO
The values of F ¼ 0:5 (F acts similar to c 2 in the traditional PSO) and CR ¼ 0:5.

DE, PSO, and DEFPSO
The values of N ¼ 40 (size of population), I ¼ 40 (maximum number of iterations), and g ¼ 10 (maximum number of iterations without improvement).
In this section, the simulations are done upon the operations of five agents (3 UAVs and 2 AGVs), while the ones with six agents (3 UAVs and 3 AGVs) are depicted in Appendix 1 for further reading.This study is a pilot investigation on UAV-AGV operations which is originated from a work on UAV operations in indoor environment. 21As a minimum working instance for multi-agent operations (multiple UAVs and AGVs) which is dominated by UAV, three UAVs and two AGVs are used.Furthermore, simulations on three UAVs and three AGVs are also performed to see more results.
Figure 3 depicts the makespans of the schedules generated by DE, PSO, and DEFPSO.The makespans yielded by DEFPSO clearly outperform those from PSO and are on par with the ones from DE. Furthermore, the proposed DEFPSO consistently maintains its position relative to DE and PSO regardless of the target data set.From the perspective of the total battery consumption, as the lower-priority objective (compared to makespan), DEFPSO generally outperforms PSO and is on par with DE.The results show DEFPSO to be even better than DE in many runs.One can see this situation as finding a diamond among other minerals and rocks.This indicates that DEFPSO explores various areas (getting stuck in the same area less), and allow it to find better solutions in the promising area.
With the obtained objective values depicted in Figures 3  and 4, the computation time of the three methods plays an important role to make a remark.In Figure 5, the computation time of DEFPSO is slightly higher than PSO and significantly lower than DE.DEFPSO's appeal is then formed by the high quality objective value (better than PSO and on par with DE) that it can achieve within less time than what DE needs.On a further discussion, the computation time graph of DEFPSO is oscillating due to its convergence in various high quality local optima.With the trade-off of a significantly higher computation time, DE offers the tendency to search further and get better objective values than DEFPSO.

Analysis
To pull out a tractable numerical analysis, the quartiles of the makespan, battery consumption, and computation time data are shown in Figures 6 to 8.
The mean numbers of the characteristics being observed are put into Figure 9. DE and DEFPSO are compared toward PSO to show the better results they gained.It is followed by calculating the gain ratio to quantify the excellence of the proposed DEFPSO.The ratios show that in terms of objective values (makespan and total battery consumption), DEFPSO gains as much as 83-140% of improvement from what DE gets against PSO.This means that DEFPSO's performance is nearly as good as DE's or even better.From the perspective of the computation time,  DEFPSO needs at most 21% of DE's computation time, which is on par with PSO's (refer Figure 8).Hence, DEFPSO is shown as an effective methodology to solve the problem of task executions by multiple UAVs and AGVs in indoor manufacturing environment.
In the calculated gained ratio, it is depicted that the superiority of makespan yielded by DE and DEFPSO are on par, it is almost as good (with a ratio a bit less than 1.0) or even better (with a ratio of > 1:0) in regard to the various task data sets.In addition, the gain ratio in respect to the computation time is low (< 0:21), which signifies the additional time (against PSO's computation time) required by DEFPSO is not as long as DE's.This additional time represents the trade-off of having a longer computation time to get a higher quality near optimum solution.
Additionally, a paired t-test analysis of the proposed method is presented in Table 4.It depicts the certainty of superiority or inferiority of DEFPSO over each of its parents: DE and PSO.With 95% confidence interval, a p value less than 0.05 indicates that the results from DEFPSO has statistically significantly lower makespan, battery consumption or computation time than the ones from DE or PSO.Each paired t test has the same one-sided alternative hypothesis (H a ¼ o À n > 0, where o is another algorithm's observation and n is DEFPSO's observation) and degrees of freedom (df ¼ 239).Table 5 lists the cases in the t test analysis in Table 4.More variations of DEFPSO parameters are used to conduct more simulations to be used in the statistical test.When not mentioned, the parameters conform to the values described in the "Parameter values" subsection.
In cases C1-C4, DE is statistically tested against DEFPSO variants (with different configurations).The makespans of schedules from DEFPSO are definitely not less than the ones from DE.The p values are quite greater than 0.05, even though C1 has a slightly lower value than the others.For the secondary objective, all DEFPSO variants have statistically significantly lower battery   In cases C5-C8, PSO is statistically tested against DEFPSO variants (with different configurations).All four cases show that DEFPSO variants have statistically significantly lower makespan and battery consumption than PSO.In terms of computation time, all four cases statistically not lower than PSO (with the p:value being 0.999).On a thorough observation, C5 and C8 are on par, which indicates the essence of the proportion of F and CR (mutation and crossover rate) and the balance between them to have a good search experience.
Based on the aforementioned statistical significance analysis, the superiority of DEFPSO with F ¼ 0:5 and CR ¼ 0:5 among others can be postulated.Furthermore, DEFPSO has statistically significantly lower makespan and objective compared to PSO, and statistically significantly lower computation time compared to DE.

On the robustness of the system
In the UAV operations, there are uncertain events that may happen during the flight or the task execution.It can expose a delay to the originally scheduled completion time of a task.To some extent, the exposed delay will still yield the same schedule to achieve well optimized operations.When the delay occurs frequently with a significant amount of time, an efficient method of producing a fault-tolerant schedule is required.A straightforward rescheduling is what is within the capability of the current study.Hence, a fault-tolerant scheduling system which focuses on the  robustness of the scheduling system is the next goal to pursue.

Conclusion
The

Figure 1 .
Figure 1.An instance of a schedule.

Figure 4 .
Figure 4. Total battery consumption of schedules for laboratory scale (a) and industrial scale (b) data sets with DE, PSO, and DEFPSO.DE: differential evolution; PSO: particle swarm optimization; DEFPSO: DE-fused PSO.

Figure 5 .
Figure 5. Computation time of schedules for laboratory scale (a) and industrial scale (b) data sets with DE, PSO, and DEFPSO.DE: differential evolution; PSO: particle swarm optimization; DEFPSO: DE-fused PSO.

Figure 6 .
Figure 6.Boxplot of makespan of schedules for laboratory scale (a) and industrial scale (b) data sets in connection with the results in Figure 3.

Figure 7 .
Figure 7. Boxplot of battery consumption of schedules for laboratory scale (a) and industrial scale (b) data sets in connection with the results in Figure 4.

Figure 8 .
Figure 8. Boxplot of computation time of schedules for laboratory scale (a) and industrial scale (b) data sets in connection with the results in Figure 5.

Figure 1B .
Figure 1B.Battery consumption of schedules for laboratory scale (a) and industrial scale (b) data sets with DE, PSO, and DEFPSO.DE: differential evolution; PSO: particle swarm optimization; DEFPSO: DE-fused PSO.

Figure 1C .
Figure 1C.Computation time of schedules for laboratory scale (a) and industrial scale (b) data sets with DE, PSO, and DEFPSO.DE: differential evolution; PSO: particle swarm optimization; DEFPSO: DE-fused PSO.

Table 2 .
Example of task data set with 10 tasks.

Table 4 .
Result summary of the proposed DEFPSO in connection with DE and PSO.DE: differential evolution; PSO: particle swarm optimization; DEFPSO: DE-fused PSO.p Values of one-sided paired t tests of DE or PSO against DEFPSO with different configurations.

Table 5 .
Cases for statistical significance analysis in Table4.
problem of scheduling task executions by multiple robots is NP-hard natured, which demands the involvement of heuristic and metaheuristic algorithms to get a high quality feasible solutions whilst balancing time efficiency.Researchers have been investigating prominent metaheuristic algorithms such as DE and PSO to tackle problems with such a nature.The quality of the solution produced by DE is found to be usually better, while the computation time is generally longer compared to PSO.In this article, a mathematical formulation of the addressed problem is developed.A metaheuristic algorithm called DEFPSO is proposed to solve it, where the explorative property of DE is fused into PSO, and the performance is then benchmarked through several data sets.They have different weighted characteristics including geographical scale, number of predecessors, and number of tasks.DEFPSO obtains at least 83% of improvement in terms of objective values, and needs at most only 21% of the computation time compared to what DE gains against PSO.The results are also analyzed through paired t test, and DEFPSO statistically significantly outperforms DE and PSO in terms of computation time and objective values, respectively.Future researchers in the optimization area may conduct further studies for different optimization fields, not only scheduling, and perform different utilization ways of the parameters, operators, and the overall optimization framework.The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.combinatorial optimization problems.Int J Adv Rob Syst 2017; 14(3): 1-11.DOI: 10.1177/1729881417705969. 20.Li Z, Janardhanan MN, Tang Q, et al.Co-evolutionary particle swarm optimization algorithm for two-sided robotic assembly line balancing problem.Adv Mechanic Eng 2016; 8(9): 1-14.DOI: 10.1177/1687814016667907. 21.Khosiawan Y and Nielsen I.A system of UAV application in indoor environment.Prod Manuf Res 2016; 4(1): 2-22.Simulation results for the operations of six agents generated by DE, PSO, and DEFPSO Figures 1A to 1C depict the makespan, battery consumption, and computation time of the schedules from simulations with six agents (i.e. 3 UAVs and 3 AGVs).