Abstract
While scheduling problems in deterministic models are quite well investigated, the same problems in an uncertain environment require very often further exploration and examination. In the paper we consider a single machine tabu search method with block approach in an uncertain environment modeled by random variables with the normal distribution. We propose a modification to the tabu search method which improves the robustness of the obtained solutions. The conducted computational experiments show that the proposed improvement results in a much more robust solutions than the ones obtained in the classic block approach.
Keywords: Single machine scheduling, Uncertain parameters, Normal distribution, Tabu search, Block approach
Introduction
Uncertainty occurs in many production processes and has a direct impact on their smooth execution. For instance it is important in construction domain to deliver goods with no delays, but it is not easy to meet this requirement as the transportation time depends on many external factors like weather conditions, traffic jams, driver’s condition and many others. Moreover, effective solving practical problems and taking the best approach requires also thorough knowledge of the process or production system and values of all parameters. For example an uncertain data of the duration of activities (operations) can be measured and in result: approximated as deterministic ones in case the variance is small enough, modeled by an appropriate probabilistic distribution or determined the membership function for the fuzzy representation. So, as in practice it is difficult to clearly determine the process parameters, quite often safe ones are taken (e.g. assume longer transportation time) what is an opportunity for further improvements.
Research on scheduling problems carried out for many years is related primarily to deterministic models where the key assumption is that parameters are well defined. For those, mostly belonging to the class of strongly NP-hard problems, a number of very effective approximate algorithms have been developed. Solutions determined by these algorithms are very often only slightly worse from the optimal ones. In practice, however, as already mentioned, some parameters (e.g. operation times) may differ during the process execution from the initially assumed values. This can cause that the actual cost of execution is much bigger than expected what leads to either losing optimality or even acceptability (feasibility) of solutions.
In order to close that gap in recent years more and more research has been conducted on developing methods which find more robust solution resistant to data disturbance. Uncertain parameters are usually represented by random variables or fuzzy numbers and extensive review of methods and algorithms for solving optimization problems with random parameters is presented by Vondrák in monograph [12] and newer of Shang et al. [9], Soroush [10], Xiaoqiang et al. [14], Urgo and Vancza [11], Zhang et al. [15] and Bożejko et al. [2, 4] and [6].
In this paper we consider a single machine scheduling problem with due dates in two variants where either job execution times or due dates are represented by independent variables with normal distribution. We also present some properties of the problem (so-called block elimination properties) accelerating the review of neighborhoods in local search algorithms. The main goal is to compare the robustness of the block-based tabu search algorithm in the classic and the proposed random model and show the superiority of the latter one.
Deterministic Scheduling Problem
Let
be a set of jobs to be executed on a single machine. At any given moment a machine can execute exactly one job and all jobs must be executed without preemption. For each task
let
be a processing time,
be a due date and
be a cost for tardy jobs.
Every sequence of jobs execution can be presented as a permutation
of items from the set
.
Let
be the set of all permutations of the set
. For every permutation
we define
![]() |
as a completion time of a job
.
The cost of jobs’ execution determined by the permutation
is as follows
![]() |
1 |
where
![]() |
We consider the optimization problem where the goal is to find a permutation
which minimizes the cost of jobs’ execution:
![]() |
Probabilistic Jobs Times
In order to simplify the further considerations we assume w.l.o.g. that at any moment the considered solution is the natural permutation, i.e.
. Moreover, if X is a random variable, then
denotes its cumulative distribution function.
In this section we consider a TWT problem with uncertain parameters. We investigate two variants: (a) uncertain processing times and (b) uncertain due dates.
Random Processing Times
Random processing times are represented by random variables with the normal distribution
),
. Other parameters, i.e. due dates
and costs
are deterministic. Then completion times
are random variables:
![]() |
2 |
and delays are random variables
![]() |
3 |
For each permutation
the cost in the deterministic model is defined as
(see (1)). A corresponding cost in the random model is defined as the following random variable:
![]() |
4 |
In order to compare the costs of permutations from the set
we introduce the following comparison function to calculate the value:
![]() |
5 |
where
is the expected value of the random variable
.
Random Due Dates
Random due dates are represented by random variables with the normal distribution
),
Other parameters, i.e. processing times
and costs
are deterministic. Delay indication is a random variable
![]() |
6 |
In this variant of the problem we apply the comparison function (5) defined in the previous section.
The TWT problem in both variants (i.e. with random processing times and random due dates) is to find a permutation for which the comparison function (5) is minimal in the set
. We denote the probabilistic version of the problem as TWTP. As the deterministic version, the problem belongs to the class of NP-hard problems.
Blocks in Random Model
Random Processing Times and Due Dates
Each permutation
is decomposed into m (
) subpermutations
, called random blocks for
, which satisfy the following criteria:
,
,
,
,
.- All jobs
satisfy either the condition
or the condition
7 
8
is maximal subsequence of
where all the jobs satisfy either (7) or (8).
We distinguish two types of blocks:
E-Random Blocks, denoted as
, the ones satisfying condition (7),T-Random Blocks, denoted as
, the ones satisfying condition (8).
Theorem 1
Let
be a permutation with a distinguished random block
, i.e.
where
,
and
. Estimated value of comparison function can be calculated as follows:
![]() |
Now let
be a set of all permutations of
and for each
we define
in the same way as
.
Then we have the following
if B is a random E-block, then for each
,if B is a random T-block, then for each

what in result gives as that for each
there is a fixed upper bound for
.
Proof
Let’s consider the following 2 cases.
- A. B is random E-block. Then we have:
Applying our assumption that B fulfills (7) (i.e. B is a random E-block) as well as by definition of
and the problem formulation where every realization of
will be less or equal than realization of
we obtain that
for all
. Having that we can proceed as follows:
what leads us to the conclusion that for each permutation
we have 
- B. B is random T-block. Then we have:
By definition of
and
(
) we can easily observe the following:
Having that and applying our assumption that B fulfills (8) (i.e. B is a random T-block) we obtain that
what implies that
for all
. Having that we can proceed as follows:
what leads us to the conclusion that for each permutation
we have
That concludes the proof.
The above theorem also holds in case where we consider only random processing times or only random due dates and each case the proof is analogous.
Improving Robustness by Applying the Derived Theorem
It is easy to show the following. For the variant with random processing times
we have:
![]() |
and for the variant with random due dates
we have:
![]() |
Combining the above with assumptions expressed in (7) and (8) and adapted to respective variants, we apply the following rules to modify the base tabu search method. For the variant with random processing times
:
if B is a random E-block, then
,if B is a random T-block, then
.
For the variant with random due dates
:
if B is a random E-block, then
,if B is a random T-block, then
.
Computational Experiments
In this section we present the results of the robustness property comparison between the tabu search method with blocks and the tabu search method with blocks and theorem applied in a way described in Sect. 4. All tests are executed with a modified version of tabu search method described in [1]. The algorithm has been configured with the following parameters:
is an initial permutation, n is the length of tabu list and n is the number of algorithm iterations where n is the tasks number.
Both methods have been tested on instances from OR-Library ([8]) where there are 125 examples for
, 50 and 100 (in total 375 examples). For each example and each parameter
, 0.04, 0.06 and 0.08 (expressing 4 levels of data disturbance) 100 randomly disturbed instances were generated according to the normal distribution defined in Sect. 3.1 (in total 400 disturbed instances per example). The full description of the method for disturbed data generation can be found in [5].
All the presented results in this section are calculated as the relative coefficient according to the following formula:
![]() |
9 |
which expresses by what percentage the investigated solution W is worse than the reference (best known) solution
. Details of calculating robustness of the investigated methods can also be found in [5].
An algorithm without applied theorem we denote by
and the one with applied theorem by
.
Results
In Tables 1 and 2 we present a complete summary of the computational experiments results. Values from columns
and
in both tables represent a relative distance between solutions established by a respective algorithm and the best known solution. The distance is based on (9) and it is an average of all solutions calculated for the disturbed data on a respective disturbance level expressed by the parameter c. Value from column IF (what stands for improvement factor) expresses the relative distance (also based on (9)) between the results obtained by
and the results obtained by
.
Table 1.
Relative distance between robustness coefficient of algorithm
(or respectively
) and the reference value for random
on different disturbance levels (0.02–0.08)
| N | 40 | 50 | 100 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| c | ![]() |
![]() |
IF | ![]() |
![]() |
IF(%) | ![]() |
![]() |
IF |
| 0.02 | 757.9 | 25.6 | 2863% | 820.6 | 24.3 | 3275% | 3625.5 | 11.5 | 31558% |
| 0.04 | 1776.3 | 24.6 | 7112% | 2132.2 | 25.8 | 8177% | 5146.6 | 12.2 | 41952% |
| 0.06 | 2442.4 | 26.8 | 9022% | 3013.2 | 25.4 | 11762% | 6488 | 13.5 | 47831% |
| 0.08 | 2821.2 | 29.4 | 9509% | 5656.3 | 28.7 | 19627% | 7957.5 | 14.8 | 53661% |
| Avg | 1949.5 | 26.6 | 7233% | 2905.6 | 26.0 | 11060% | 5804.4 | 13.0 | 44525% |
Table 2.
Relative distance between robustness coefficient of algorithm
(or respectively
) and the reference value for random
on different disturbance levels (0.02–0.08)
| N | 40 | 50 | 100 | ||||||
|---|---|---|---|---|---|---|---|---|---|
| c | ![]() |
![]() |
IF | ![]() |
![]() |
IF(%) | ![]() |
![]() |
IF |
| 0.02 | 3000.2 | 70.8 | 4136% | 4661.6 | 31.8 | 14547% | 11812.1 | 20.1 | 58795% |
| 0.04 | 4719.2 | 124.9 | 3678% | 7948.9 | 181.8 | 4273% | 17830.2 | 141.3 | 12517% |
| 0.06 | 6303.4 | 271.6 | 2220% | 8191.3 | 284.6 | 2777% | 15180.5 | 264 | 5649% |
| 0.08 | 5654.6 | 341.6 | 1555% | 8109.1 | 511.8 | 1484% | 7235.6 | 322.2 | 2145% |
| Avg | 4919.3 | 202.2 | 2332% | 7227.7 | 252.5 | 2762% | 13026.2 | 186.6 | 6880% |
We can easily observe that applying the theorem into the method improves results very significantly for all the investigated cases. We can also observe that robustness coefficients for random
are generally worse than ones for random
what can be explained by the fact that for random
there are more fluctuations in disturbed data than for random
what is implied by the disturbed data generation method. The other observation is related to the results on different disturbance levels (parameter c). With the bigger value of c we might expect the worse robustness coefficient. Surprisingly, we can observe a difference between results for random
and random
. For random
the rule generally works both for
and
, only for
there is a swap between
and
for
and a swap between
and
for
, nevertheless those values are all very close to each other, so those swaps are actually meaningless. For
the situation is different. The rule still works for
, but for
we are not able to observe any trend. That can be considered as an advantage of
as it behaves in a more predictive and stable way than
does.
It is also worth noting the difference of trends for random
and random
of the comparison between
and
(column IF) on different disturbance levels which are visualized on Figs. 1 and 2. While for random
we can see that with the increase of the parameter c the gap between
and
is also increasing, for random
we can observe exactly the opposite. On the other hand the order of magnitude of improvement factor (IF) is the same for both random
and random
what shows that the level of improvement introduced by the presented Theorem works similarly in both considered scenarios.
Fig. 1.

Comparison of the robustness level with reference to the main methods for random 
Fig. 2.

Comparison of the robustness level with reference to the main methods for random 
Parallelization Consideration
The tabu search method is well paralleling. According to the classification proposed by Voß [13], four models of the parallel tabu search method can be considered: SSSS (Single Starting point Single Strategy), SSMS (Single Starting point Multiple Strategies), MSSS (Multiple Starting point Single Strategy), MSMS (Multiple Starting point Multiple Strategies). They refer to the classic classification of Flynn’s parallel architectures [7]. In the version proposed in this paper where block approach is applied it is natural to use MSSS or MSMS diversification strategies, because the block mechanism is quite easily parallelized (each block can be considered separately [3]). The use of ‘tree’ strategies using the same start solution is also possible provided the fact that the process of searching the solution space at a later stage is diversified (e.g. by using different tabu length for individual threads or through a mechanism of dynamic tabu list length change [1]).
Conclusions
In the paper we considered a single machine tabu search method with block approach in an uncertain environment modeled by random variables with the normal distribution. We proposed a theorem which allows to modify the base tabu search method in a way which improves the robustness of calculated solutions. Computational experiments conducted on disturbed data confirmed substantial predominant of the method after applying the proposed theorem.
Acknowledgments
This work was partially funded by the National Science Centre of Poland, grant OPUS no. 2017/25/B/ST7/02181 and a statutory subsidy 049U/0032/19.
Contributor Information
Valeria V. Krzhizhanovskaya, Email: V.Krzhizhanovskaya@uva.nl
Gábor Závodszky, Email: G.Zavodszky@uva.nl.
Michael H. Lees, Email: m.h.lees@uva.nl
Jack J. Dongarra, Email: dongarra@icl.utk.edu
Peter M. A. Sloot, Email: p.m.a.sloot@uva.nl
Sérgio Brissos, Email: sergio.brissos@intellegibilis.com.
João Teixeira, Email: joao.teixeira@intellegibilis.com.
Wojciech Bożejko, Email: wojciech.bozejko@pwr.wroc.pl.
Paweł Rajba, Email: pawel@cs.uni.wroc.pl.
Mieczysław Wodecki, Email: mieczyslaw.wodecki@pwr.wroc.pl.
References
- 1.Bożejko W, Grabowski J, Wodecki M. Block approach-tabu search algorithm for single machine total weighted tardiness problem. Comput. Ind. Eng. 2006;50(1–2):1–14. doi: 10.1016/j.cie.2005.12.001. [DOI] [Google Scholar]
- 2.Bożejko W, Rajba P, Wodecki M. Stable scheduling with random processing times. In: Klempous R, Nikodem J, Jacak W, Chaczko Z, editors. Advanced Methods and Applications in Computational Intelligence. 6. Heidelberg: Springer; 2014. pp. 61–77. [Google Scholar]
- 3.Bożejko W, Uchroński M, Wodecki M. Parallel metaheuristics for the cyclic flow shop scheduling problem. Comput. Ind. Eng. 2016;95:156–163. doi: 10.1016/j.cie.2016.03.008. [DOI] [Google Scholar]
- 4.Bożejko W, Rajba P, Wodecki M. Stable scheduling of single machine with probabilistic parameters. Bull. Polish Acad. Sci. Tech. Sci. 2017;65(2):219–231. [Google Scholar]
- 5.Bożejko W, Rajba P, Wodecki M. Robustness of the uncertain single machine total weighted tardiness problem with elimination criteria applied. In: Zamojski W, Mazurkiewicz J, Sugier J, Walkowiak T, Kacprzyk J, editors. Contemporary Complex Systems and Their Dependability; Cham: Springer; 2019. pp. 94–103. [Google Scholar]
- 6.Bożejko W, Hejducki Z, Wodecki M. Flowshop scheduling of construction processes with uncertain parameters. Arch. Civil Mech. Eng. 2019;19(1):194–204. doi: 10.1016/j.acme.2018.09.010. [DOI] [Google Scholar]
- 7.Flynn, M.J.: Computer architecture: Pipelined and parallel processor design. Jones & Bartlett Learning, Burlington (1995)
- 8.OR-Library. http://www.brunel.ac.uk/~mastjjb/jeb/info.html. Accessed 13 April 2020
- 9.Shang C, You F. Distributionally robust optimization for planning and scheduling under uncertainty. Comput. Chem. Eng. 2018;110:53–68. doi: 10.1016/j.compchemeng.2017.12.002. [DOI] [Google Scholar]
- 10.Soroush HM. Scheduling stochastic jobs on a single machine to minimize weighted number of tardy jobs. Kuwait J. Sci. 2013;40(1):123–147. [Google Scholar]
- 11.Urgo M, Váncza J. A branch-and-bound approach for the single machine maximum lateness stochastic scheduling problem to minimize the value-at-risk. Flexible Serv. Manuf. J. 2019;31:472–496. doi: 10.1007/s10696-018-9316-z. [DOI] [Google Scholar]
- 12.Vondrák, J.: Probabilistic methods in combinatorial and stochastic optimization (Doctoral dissertation, Massachusetts Institute of Technology) (2005)
- 13.Voß, S.: Tabu search: Applications and prospects. In: Network Optimization Problems: Algorithms, Applications and Complexity, pp. 333–353 (1993)
- 14.Cai X, Wu X, Zhou X. Optimal Stochastic Scheduling. Boston: Springer; 2014. [Google Scholar]
- 15.Zhang L, Lin Y, Xiao Y, Zhang X. Stochastic single-machine scheduling with random resource arrival times. Int. J. Mach. Learn. Cybernet. 2018;9(7):1101–1107. doi: 10.1007/s13042-016-0631-y. [DOI] [Google Scholar]

























