 Original Paper
 Open Access
 Published:
DEA Malmquist productivity index based on a doublefrontier slacksbased model: Iranian road safety assessment
European Transport Research Review volume 11, Article number: 4 (2019)
Abstract
Many governments in the developing world face the social and economic consequences of road accidents and mortalities. Hence, more precise evaluation of regional programs to reduce road fatalities has been a concern for many safety professionals.
Road safety performance is often measured using various extensions of Data Envelopment Analysis (DEA), in particular the model proposed by Charnes, Cooper and Rhodes (CCR), which deals only with the radial efficiency as the objective function neither taking into account input excesses nor output shortfalls. The SlacksBased Measure (SBM) of efficiency overcomes this shortcoming by taking both measurements mentioned above simultaneously. In this regard, the current study aims to employ the SBM in analyzing road safety performance. It is noteworthy that the efficiency of each Decision Making Unit (DMU) can be pessimistically measured using the slacksbased measure of inefficiency such that the antiefficient DMUs provide the antiefficient frontier. The results obtained from the optimistic and pessimistic frontiers are nonlinearly aggregated by means of the Evidential Reasoning (ER) algorithm.
Furthermore, a DoubleFrontier SBMbased Malmquist Productivity Index (DFSBM MPI) is provided to analyze the efficiency and technological changes in safety performance from 2014 to 2016. For this purpose, the standard SBM and SuperSBM models are used to compute the optimistic Malmquist Productivity Index (MPI); similarly, the pessimistic MPI is determined by means of the inverted SBM and SuperSBM models. Finally, the obtained MPIs from the two different points of view are geometrically combined to obtain the overall MPI.
Introduction
The World Health Organization (WHO) reported that about 1.25 million people annually perish due to road accidents. More often than not, accident victims are from low and middle income countries [1]. In other words, the global contribution of under developed countries to road fatalities is on the rise. Subsequently, road fatalities have recently become a social dilemma in under developed countries. According to the WHO, nearly 18,000 out of 77,447,168 Iranians passed away due to road accidents from 21 March 2013 to 20 March 2014. This means that around 23.2 out of 100,000 people died as a result of road accidents from 2013 to 2014, which is significantly higher than the global average of 17.4 per 100,000 people [1]. As a result of road accidents, Iran lost about six per cent of its gross domestic product [1].
Road safety performance is usually defined as an indicator for assessing countries, states, or provinces in terms of reducing road safety risks with regard to the existing resources. The number of crashes, fatalities, and injuries are usually considered as the three most common road safety risk indicators. In this regard, data availability is crucial in selecting the input data as well as road safety risk indicators. In addition, the definition of road safety performance will be different depending on the main purpose of road safety programs provided by governments or local authorities. In the current study, the most successful province in terms of road safety performance is a province that experiences a lower number of fatalities due to the less amount of investment.
Data Envelopment Analysis (DEA) method, originally proposed by Charnes, Cooper and Rhodes (CCR) in 1978 [2], has recently been widely used to assess road safety performance [3,4,5,6,7,8,9,10,11,12,13,14,15]. Based on the standard DEA, a Decision Making Unit (DMU) is recognized as an efficient DMU which generates either the maximum output levels with the given input levels or the minimum input levels with the given output levels. The CCRbased DEA model [2] uses a scalar measure to compute the efficiency of DMUs.
The main disadvantage of the CCR model is that it does not directly take into account the input excesses or output shortfalls (input/output slacks). Accordingly, an additive model was proposed by Charnes et al. (1985) to contend with this shortcoming; however it also lacks a scalar measure in the range of [0,1] [16]. Subsequently, Tone (2001) developed a SlacksBased Measure (SBM) of efficiency in order to take into account both scalar measure and inputs/outputs slacks simultaneously [17]. To the best of our knowledge, no studies have assessed road safety efficiency using SBMbased DEA model. Existing studies have optimistically assessed road safety performance using the traditional CCR model. In other words, each DMU is assessed based only on the distance from the efficient frontier, which is composed of all efficient DMUs. In this situation, a DMU closer to the efficient frontier is more efficient than those that are farther away. On the other hand, the antiefficiency value of each DMU can be pessimistically measured as the distance from the antiefficient frontier. Consequently, a DMU farther away from the antiefficient frontier is more efficient than those that are closer. Obviously, the efficiency results obtained using the optimistic and pessimistic perspectives are not the same, more often than not. In this respect, the present study aims to investigate a doublefrontier SBM model to achieve a more realistic evaluation of road safety performance. In this regard, a nonlinear method of integration, namely the ER approach, is employed to integrate the two points of view [18, 19].
In addition, this study is meant to further analyze Iranian road safety performance over a period of time. For this purpose, Malmquist Productivity Index (MPI) is used. Traditionally, MPI values are computed using the optimistic DEA model, but this indicator can be equivalently obtained by utilizing the pessimistic DEA model. In this regard, a novel doublefrontier MPI is proposed for a comprehensive evaluation of road safety performance over a threeyear period of time.
The rest of the study is organized as follows:
Section 2 reviews the existing studies on road safety evaluation. Section 3 discusses the optimistic and pessimistic SBM models, followed by section 4 that briefly describes the ER approach. Afterwards, the optimistic, pessimistic and integrated MPIs are explained in section 5. Section 6 evaluates Iranian road safety performance not only in each year but also over a period of time by respectively implementing the proposed methods, DoubleFrontier SBM aggregated by ER algorithm (DFSBMER) and DoubleFrontier SBMbased Malmquist Productivity Index (DFSBMMPI). Section 6 respectively implements the proposed methods, DFSBMER and DFSBMMPI, in order to practically assess Iranian road safety performance not only during each year but also over a period of time. Conclusions and remarks are finally presented in section 7.
Literature review
This section surveys the studies previously carried out on road safety assessment using DEA models. In 2000, Odeck analyzed the productivity of 67 vehicle inspection stations over a twoyear period of time (19891991), by utilizing an optimistic CCRbased MPI on the basis of an inputoriented model (Appendix 1) with one input (effective days of work) and four outputs including technical controls, usage controls, licensing and administration [3]. Afterwards, Odeck (2006) evaluated the safety performance of the 19 regional road agencies with the assumption of variable return to scale instead of constant return to scales [4]. Additionally, Odeck (2006) analyzed the productivity change of regional road agencies over a threeyear period of time by means of an optimistic MPI based on the model proposed by Banker, Charnes and Cooper (BCC) [20] with only three outputs (technical, usage and safety belt controls), while no inputs were taken into account [4].
Hermans et al. (2008) examined the road safety performance of 27 European countries with respect to road accident fatalities using the CCRbased DEA model along with other four weighting methods. They calculated the road safety index for 21 European countries based on seven outputs (i.e., alcohol and drugs, protective systems, speed, vehicle, infrastructure daytime running lights and trauma care), but without input data. It is also found that the DEA model and road safety rank are highly correlated [5]. Hermans et al. [6] further evaluated the European countries in terms of road safety performance, taking into account the abovementioned seven inputs and two undesirable outputs (number of crashes and fatalities). They came to the obvious conclusion that the inverted DEA model is more suitable for the available data set than economic issues [6].
In 2011, Shen et al. assessed the road safety performance of 19 European countries by developing both multiplelayer CCR and BCC models. They hierarchically categorized all inputs, consisting of 13 road user behaviors, into three layers. Similarly, they classified four defined outputs into two layers, namely injuries and crashes [7]. Also, Shen et al. (2012) assessed the road safety performance of 27 European countries with respect to three desirable inputs, inhabitants, passengerkilometers and passenger cars, and only one undesirable output, fatalities, by developing a maximization programming model, called DEAbased Road Safety model (DEARS). The presented DEARS is simply obtained by inverting the traditional CCR model to make it more suitable for the defined data set. Although the DEARS was formulated as an outputoriented model (Appendix 1.2), it can also be converted to an inputoriented model, by minimizing the weighted sum of the outputs rather than maximizing the weighted sum of the inputs [8]. In 2013, Shen et al. further evaluated the road safety performance of European countries over a tenyear period of time. For this purpose, they developed a DEARS based MPI [9].
In 2013, Egilmez et al. analyzed 50 U.S. states in terms of road safety performance, using an MPI based on the standard inputoriented CCR model with seven inputs (highway safety expenditures, registered vehicles, licenced drivers, vehiclemiles traveled, total road length, overall road condition and safety belt usage) and one output (fatal crashes). They normalized the data set to fit the CCR model. Accordingly, the input data was reduced to five inputs. In addition, the ratio of the total annual time to the fatality rate was introduced as the model’s output [10]. Also, in 2015, Shen et al. developed the DEARS models with weight restrictions based on either shadow price or a priori knowledge. Then, they employed the proposed models to assess 10 European countries in terms of road safety performance with respect to two outputs, serious injuries and fatalities [11]. All input variables were also defined in the same way as those previously introduced by Shen et al. [8, 9].
Bastos et al. (2015) analyzed the 27 Brazilian states by utilizing a multiple layer DEA method, taking into account two main indicators, namely mortality and fatality rates. They pointed out the obvious fact that the number of fatalities should be used as undesirable output in road safety studies [12]. In this regard, their model was presented based on the inverse of the DEA model provided by Cherchye et al. [21].
Rosic et al. (2017) assessed the 27 Serbian police departments on road safety performance using the DEA and TOPSIS (Technique for Order Preference by Similarity to an Ideal Solution) methods. It is worth noting that they applied the DEA models previously presented by Hermans et al. [5] and Shen et al. [8] as well as the corresponding crossefficiency methods. The number of fatalities and seriously injured people were also defined as two undesirable outputs [13].
Behnood et al. evaluated the Iranian road safety performance using a CCR model that is, in fact, an inverted inputoriented CCR model (Appendix 1), which mathematically defines an efficient DMU as a DMU with less output and more input. However, the input variables seem not to be appropriate for the presented model, since all authorities actually prefer to reduce the fatality rate with the least number of defined inputs, i.e. police operation, emergency medical services, etc. They also measured the efficiency of road safety performance based on a data set of 60 DMUs, including 30 DMUs in 2008, and 30 DMUs in 2009. They did not analyze the road safety performance over a period of time, although they utilized twoyear data sets [14].
The literature review reveals that no study has assessed road safety performance using SBM model. In contrast to standard DEA model, SBM assesses road safety performance by considering both input excess and output shortfall. In addition, all previous studies analyzed road safety performance based on the efficient frontier while ignoring the antiefficient frontier. However, research on doublefrontier DEA models has recently been of interest to many researchers [22,23,24]. Therefore, the main goal of this study is to bridge this gap by analyzing road safety performance based on a double frontier SBM.
Methods
Slacksbased measure (SBM) approach
This section briefly describes the optimistic and pessimistic SBM model. The optimistic SBM model was proposed by Tone in 2001 [17]. Suppose that there is an evaluation problem consisting of n DMUs with m inputs and s outputs respectively defined by \( X={x}_{ij}\in {\mathcal{R}}^{m\times n} \), and \( Y={y}_{rj}\in {\mathcal{R}}^{s\times n} \). The production possibility set can be defined as follows:
where all data sets are assumed to be positive. The optimistic SBM is mathematically expressed as the following fractional programming model:
where the input excess and output shortfall are respectively represented by slacks \( {s}_i^{}\in {\mathcal{R}}^m \) and \( {s}_r^{+}\in {\mathcal{R}}^s \). The SBM model (2) minimizes both input and output inefficiencies, which are respectively defined by the mean rate of input reductions, \( \left(1/m\right){\sum}_{i=1}^m\left({x}_{i0}{s}_i^{}\right)/{x}_{i0} \), as well as the inverted mean rate of output expansions, \( {\left[\left(1/s\right){\sum}_{r=1}^s\left({y}_{r0}+{s}_r^{+}\right)/{y}_{r0}\right]}^{1} \) (Tone, 2001).
By multiplying a positive scalar variable q > 0 by the denominator and the numerator of the objective function of the fractional program (2) and making some adjustments, the linear program (3) can be achieved as follows:
where Λ_{j} = qλ_{j}, \( {S}_i^{}=q{s}_i^{} \) and \( {S}_r^{+}=q{s}_r^{+}. \)The optimal solution of model (3) is \( \left({\tau}^{\ast }={\rho}^{\ast },{q}^{\ast },{\varLambda}_j^{\ast },{S}_i^{\ast },{S}_r^{+\ast}\right) \). Consequently, the optimal solution of (2) is as follow: \( \left({\rho}^{\ast }={\tau}^{\ast },{\lambda}_j^{\ast }={\varLambda}_j^{\ast }/{q}^{\ast },{s}_i^{\ast }={S}_i^{\ast }/{q}^{\ast },{s}_r^{+\ast }={S}_r^{+\ast }/{q}^{\ast}\right). \) A DMU is efficient if and only if \( {\rho}_{optimistic}^{\ast }={\tau}_{optimistic}^{\ast }=1 \). Such a condition can be obtained when there is no input excess, s^{−∗} = 0 , and output shortfall, s^{+∗} = 0 ; otherwise, the DMU is defined as inefficient.
Taking the pessimistic SBM into account, the following production possibility set can be introduced:
The antiefficiency of each DMU can be mathematically formulated as follows:
The pessimistic SBM model (5) maximizes both the mean expansion rate of inputs, \( \left(1/m\right){\sum}_{i=1}^m\left({x}_{i0}+{s}_i^{+}\right)/{x}_{i0} \) , and the inverted mean reduction rate of outputs, \( {\left[\left(1/s\right){\sum}_{r=1}^s\left({y}_{r0}{s}_r^{}\right)/{y}_{r0}\right]}^{1} \). The fractional program (5) can also be converted to the following linear program (6) in the same way as the optimistic SBM.
All parameters and variables are the same as those of the optimistic SBM. A DMU is antiefficient if and only if \( {\rho}_{pessimistic}^{\ast }={\tau}_{pessimistic}^{\ast }=1 \). Such a condition indicates that the relative DMU is located on the antiefficient frontier; hence both slack values are zero.
Evidential Reasoning (ER) algorithm
The ER algorithm was originally introduced by Yang and Singh in 1994 [25], based on the theory of evidence proposed by Dempster in 1967 [26] and improved by Shafer in 1976 [27]. Suppose that there is a frame of discernment, Θ= { H_{1}, . . ., H_{N}}, that contains a set of collectively exhaustive and mutually exclusive propositions. Mass functions (or basic probability assignments) are defined as follows:
where m(A) represents a belief degree in the interval [0,1], assigned to subset A, and Ф is the empty set. The power set of Θ is expressed by 2^{Θ}. The ER algorithm aggregates the independent evidence, m_{1} and m_{2}, based on the Dumpster's rule of combination, as follows:
where k is a normalization factor. Note that the Dumpster's rule is not compatible in such a situation with thorough conflict between evidence, \( {\sum}_{A\cap B=\varPhi }{m}_1(A){m}_2(B)=1 \). In addition, many studies also pointed out that the Dumpster's rule of combination may be inappropriate to deal with the problems with conflicting evidence. In other word, in such a situation, the results might be counterintuitive, irrational and complex [28,29,30].
In this regard, the ER algorithm has been proposed to effectively deal with the aforementioned shortcomings. Many studies were carried out based on the ER algorithm as an appropriate method of aggregation in dealing with certain and uncertain decision making problems [15, 25, 31,32,33,34,35,36,37,38,39,40].
Suppose that we intend to evaluate a decision making problem with n DMUs using G assessment grades as the frame of discernment, Θ = {H_{1}, …, H_{g}, …, H_{G}}. It is also assumed that each DMU is assessed according to L pieces of evidence, E = {e_{1}, …, e_{l}, …, e_{L}}, and L relative weights, w = (ω_{1}, …, ω_{l}, …, ω_{L}). The mathematical expression of each DMU evaluation based on a certain evidence, e_{l}, is as follows:
where β_{g,l} is a belief degree assigned to H_{g }with respect to evidence e_{l}. Note that the sum of all beliefs is equal to unity, \( {\sum}_{g=1}^G{\beta}_{g,l}=1 \), in the certain environment and is less than unity in the uncertain conditions, \( {\sum}_{g=1}^G{\beta}_{g,l}<1 \). In brief, \( {\sum}_{g=1}^G{\beta}_{g,l}\le 1 \). Accordingly, the mass functions, including the assigned and unassigned probabilities respectively denoted by m_{g,l} and m_{Θ,l}, are calculated by multiplying the belief degree, β_{g,l}, by the relative importance degree, ω_{l} , as follows :
In addition, the unassigned probability mass, m_{Θ,i}, can be derived using Eqs. (12) and (13):
where \( {\overline{m}}_{\varTheta, l} \) and \( {\overline{m}}_{\varTheta, l} \) represent the relative importance of evidence e_{l }and the ignorance respectively.
The ER algorithm aggregates probability masses using Eqs. (14) –(16) as follows:
and the normalization factor, k, is calculated using Eq. (17):
In addition, Yang and Xu proposed the recursive ER algorithm as a novel aggregation process as follows [32]:
The normalization factor, K_{I(l + 1)}, is computed as follows:
The ultimate assessment distribution can be achieved using Eqs. (22) and (23):
where \( \sum \limits_{g=1}^G{\beta}_g+{\beta}_{\varTheta }=1 \).
Malmquist Productivity Index (MPI)
Sten Malmquist proposed a quantity index to analyze input consumptions [41]. Fare et al. (1992) suggested a DEAbased MPI to measure the efficiency and technical changes on the basis of two measurements, namely efficiency and the productivity, that were previously proposed by Farrell (1957) and Cave et al. (1982) [42,43,44]. Subsequently, the DEAbased MPI was successfully applied in many studies to examine the productivity change regarding each DMU over time [3, 10, 45, 46]. Wang and Lan recently proposed the integrated MPI as a geometric mean of both optimistic and pessimistic MPIs [47]. They pointed out that the doublefrontier MPI measures the productivity changes more comprehensively than the traditional MPI, as all information is taken into account.
Although most of the carried out studies used the CCR model to construct the MPI; Liu and Wang employed SBM to compute MPI [48]. Therefore, a novel DFSBMMPI is proposed to thoroughly analyze the productivity changes, taking into accounts both optimistic and pessimistic points of view simultaneously. In this regard, the pessimistic SBMbased MPI (represented by PMPI) is computed along with the optimistic SBMbased MPI (represented by OMPI); thereafter, the MPIs are geometrically combined to generate DFSBMMPI.
The OMPI of each DMU can be achieved as follows:
where \( \left({x}_0^t,{y}_0^t\right) \) and \( \left({x}_0^{t+1},{y}_0^{t+1}\right) \) denote the input and output data sets relative to time periods t and t + 1 respectively. \( {D}_0^t\left({x}_0^t,{y}_0^t\right) \) and \( {D}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \) respectively represent the optimistic efficiency scores obtained in time periods t and t + 1, based on the data set relative to the same time period. \( {D}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \) denotes the optimistic efficiency value in time period t, on the basis of the data set relative to time period t + 1 and similarly \( {D}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \) measures the relative efficiency in time period t + 1, according to the data set relative to time period t.
It is also noteworthy that the OMPI_{0} can be achieved by multiplying the optimistic efficiency change (denoted by OEC) by the optimistic technical change (denoted by OTC), as follows [44]:
OEC_{0} > 1 demonstrates an improvement in the efficiency of DMU_{0} over time period t to t + 1, whereas OEC_{0} < 1 indicates that DMU_{0} experienced a diminution in its efficiency. OEC = 1 denotes no efficiency change over time period t to t + 1. Similarly, OTC_{0} > 1 indicates that DMU_{0} achieved a technical progress over time period t to t + 1, while OTC_{0} < 1 shows that DMU_{0} experienced a technical regression. OTC_{0} = 1 expresses no technical change over time period t to t + 1.
All required efficiency scores are computed using the optimistic and pessimistic SBM models (3) and (6), rather than only the optimistic CCR model. The required programming models for computing two single period measures, \( {D}_0^t\left({x}_0^t,{y}_0^t\right) \) and \( {D}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \), as well as two mixed period measures, \( {D}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right) \) and \( {D}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \), are in detail presented in Appendix 2.1. Obviously, D_{0}(∙) = 1 means that the DMU_{0} is efficient in a given time period, t or t + 1 , with respect to the given data set, \( \left({x}_0^t,{y}_0^t\right) \) or \( \left({x}_0^{t+1},{y}_0^{t+1}\right) \). In such a situation, the optimistic SuperSBM model, as presented in Appendix 3.1, is used for further evaluation of efficient DMUs, with \( {\rho}_{optimistic}^{\ast }={\tau}_{optimistic}^{\ast }=1 \) [49]. For this reason, two single and two mixed period measures, called \( {\overset{\sim }{D}}_0\left(\bullet \right)\ge 1 \), can be driven as illustrated in Appendix 4.1.
The PMPI_{0} regarding DMU_{0} can be similarly computed by substituting the pessimistic period measures, \( \left\{{d}_0^t\left({x}_0^t,{y}_0^t\right),{d}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right),{d}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right),{d}_0^{t+1}\left({x}_0^t,{y}_0^t\right)\right\} \), in Eq. (25) which can be achieved by multiplication of the pessimistic efficiency and technical changes, respectively called PEC_{0} and PTC_{0}, as follows:
All pessimistic period measures are presented in Appendix 2.2. As shown in Appendix 3.2, the pessimistic SuperSBM model can also be applied for further assessment of antiefficient DMUs, with d_{0}(∙) = 1 [50]. In this regard, the pessimistic period measures, \( {\overset{\sim }{d}}_0\left(\bullet \right)\le 1 \), are driven and illustrated in Appendix 4.2. In the situation where d_{0}(∙) = 1, the corresponding \( {\overset{\sim }{d}}_0\left(\bullet \right) \) is used.
Finally, the doublefrontier MPI (represented by DFMPI_{0}) for evaluating the DMU_{0} can be computed by the geometric mean of OMPI_{0} and PMPI_{0} as follows:
where DFEC_{0} and DFTC_{0} indicate the aggregated efficiency and technical changes over a time period.
DFMPI_{0} > 1 and DFMPI_{0}< 1 respectively demonstrate a progress and a regression over time that is more realistic. The productivity of DMU_{0 }will be unchanged if DFMPI_{0} = 1.
Road safety performance
In this section, a threeyear evaluation of Iranian road safety performance is practically carried out by means of a new hybrid approach, DFSBMER. In this regard, the efficiencies obtained from the optimistic and pessimistic SBM models are aggregated by the ER algorithm, as a method of combination. Then, the efficiency and technical changes are examined. This case study includes 31 provinces.
The required data are usually selected based on data availability and safety programs defined by government and authorities. For example, Odeck (2000) considered vehicle technical failures as the main cause of road accidents. They defined these indicators mainly based on the Norwegian safety program [3]. Hermans et al. (2008) also utilized seven risk indicators presented in [51] as the input variables [5]. Shen et al. [8, 9] evaluated the road safety of European countries using a set of three input variables provided by the European Commission [52, 53]. Egilmez and McAvoy [10] assessed 50 U.S. states using an online database of Research and Innovative Technology Administration (RITA) Bureau of Transportation Statistics [54].
The Iran Road Maintenance and Transportation Organization (RMTO) is responsible for the intercity road safety performance. RMTO focuses more on fatality reduction by investing facilities and equipment. All available data are annually published by RMTO [55,56,57]. In this regard, six inputs and an output were derived from the Statistical Yearbook published annually by RMTO. Behnood et al. also applied RMTO Statistical Yearbook in order to define inputs and outputs variables [14].
The computations are based on the available data set for the years 2014–2016 obtained, including six inputs and one output as follows:
Inputs
Police station (PS)
The average number of highway police stations along 100 kilometres of road.
Road maintenance depot (RMD)
The average number of stations along 100 kilometres of road.
Equipment and vehicles (E&V)
The average number of both equipment and vehicles along 100 kilometres of road.
Camera (C)
The average number of both fixed speed and monitoring cameras along 100 kilometres of road.
Emergency medical service (EMS)
The average number of EMS stations along 100 kilometres of road.
Road with lighting system (RLS)
The average length of road equipped with lighting systems along 100 kilometres of road.
Output
Fatality risk (FR ^{−1} )
The inverse of fatality risk, including the number of fatalities per mean rate of hourly traffic.
It is supposed that all police stations are similar in terms of the number of officers and patrols. It is also supposed that all other input variables are the same. The period of 20142016 was selected due to data availability for the inputs and the output considered. The descriptive statistics of data are reported in Table 1. Table 2 reveals that the selected data set for the years 2014–2016 are highly correlated. Tables 3, 4 and 5 depict the efficiency and antiefficiency degrees measured by implementing the optimistic and pessimistic SBM models (3) and (6). According to the results reported in column 2 of Table 3, Fars is optimistically recognized as an efficient province along with Alborz, Ilam, Tehran, Khorasan S, Khuzestan, Qazvin and Hormozgan, and it is ranked 17^{th}, with an efficiency degree of 0.7460 from the pessimistic point of view, as shown in column 6 of Table 3. Obviously, the optimistic SBM model usually overestimates the efficiencies of Iranian provinces, since about 25 per cent of provinces are recognized as efficient according to the data set belonging to 2014. Consequently, the efficiency results might be biased. Furthermore, both efficiency and antiefficiency degrees are important for having a better insight into the situation of each province in terms of road safety performance. For example, although Kermanshah ranks 20^{th} from both optimistic and pessimistic points of view, the measured efficiency scores are respectively 0.3804 and 0.7134, which may lead to different policies. For this reason, the simultaneous evaluations of road safety performance based on the two perspectives seem to be necessary.
A comprehensive and unique indicator of road safety performance can be obtained by employing the ER algorithm as a method of combination. As presented in section 3, a frame of discernment, Θ= {H_{1}, H_{2}}, consisting of two hypotheses, H_{1}: notefficient and H_{2}: efficient, is first defined [18, 19]. There are also two pieces of evidence, including the pessimistic and optimistic efficiencies. Accordingly, E_{j} = {e_{j1}, e_{j2}} can be defined as follows:
where S(e_{j1}) and S(e_{j2}) respectively represent two assessment distributions regarding DMU_{0}, taking into account the optimistic and pessimistic perspectives. (β_{j,1,1}, β_{j,2,1}) and (β_{j,1,2}, β_{j,2,2}) respectively denote the belief degrees assigned to the propositions H_{1} and H_{2} based on the SBM models (3) and (6). Obviously, β_{j,1,1} + β_{j,2,1} = 1 and β_{j,1,2} + β_{j,2,2} = 1. Subsequently, the assessment distributions (28) and (29) are transformed to the following mass functions:
Eventually, the aggregated distributions can be computed using Eqs. (18)–(21). The final efficiency scores (column 11) and associated ranking results (column 12) for the years 2014–2016 are respectively reported in Tables 3, 4 and 5. Obviously, the discrimination power of DFSBMER is higher than both the optimistic and pessimistic SBM models.
Results and discussion
As graphically shown in Figs. 1, 2 and 3, Alborz, Hormozgan, and Qazvin rank 1^{st} (0.9622), 2^{nd} (0.9584) and 3^{rd} (0.9570) in 2014 respectively; Alborz, KohgiluyehandBoyerAhmad and Ilam rank 1^{st} (0.9497), 2^{nd} (0.9136) and 3^{rd} (0.9024) in 2015 respectively; Ilam, Alborz and KohgiluyehandBoyerAhmad rank 1^{st} (0.9548), 2^{nd} (0.9509) and 3^{rd} (0.9436) in 2016 respectively.
Similar results can be obtained using the double frontier CCR model aggregated by ER approach (DFCCRER). These results are compared in Table 6 and Fig. 4. For more discussion on DFCCRER, the interested readers are referred to [15, 19]. As proved, the efficiency and antiefficiency degrees obtained by SBM are equal or less than those obtained by the CCR model. Compared with CCR, the SBM based models result in higher optimistic and lower pessimistic degrees of efficiency. As a result, some aggregated results achieved by DFSBMER are greater than those obtained by DFCCRER [15]. In such a situation, the aggregated efficiencies are closer to the pessimistic efficiency compared to the optimistic results.
The efficiency and antiefficiency results obtained by SBM and Super SBM for evaluating 31 Iranian provinces over two periods of time (20142015 and 20152016) are summarized in Tables 7 and 8. In order to further analyzethe road safety performance over a period of time (2014–2016), the super efficiency scores of the efficient provinces, \( {D}_0^t\left({x}_0^t,{y}_0^t\right)=1 \), are computed by implementing the optimistic Super SBM model (43), \( {\overset{\sim }{D}}_0^t\left({x}_0^t,{y}_0^t\right) \). For example, the super efficiency values of the eight efficient provinces in 2014, Alborz, Ilam, Tehran, Khorasan S, Khuzestan, Fars, Qazvin and Hormozgan, were 1.2176, 1.0467, 1.0349, 1.0307, 1.0125, 1.0433, 1.0269 and 1.2585 respectively. Similarly, the super antiefficiency scores of antiefficient provinces, \( {d}_0^t\left({x}_0^t,{y}_0^t\right)=1 \), are computed by employing the pessimistic SuperSBM model (47), \( {\overset{\sim }{d}}_0^t\left({x}_0^t,{y}_0^t\right) \).
As shown in Table 7, twelve provinces optimistically improved their efficiency from 2014 to 2015, as OEC ≥ 1, while only three provinces experienced efficiency progress from the pessimistic point of view, as PEC ≥ 1. Taking into account the optimistic point of view, KohgiluyeandBoyerAhmad showed the highest efficiency progress, with a growth rate of 83.84% from 2014 to 2015, while Fars experienced the highest efficiency regression, with a decline of 72.93%. On average, the Iranian road safety performance declined in terms of efficiency change from both the optimistic and pessimistic perspectives, with a rate of 11.61% and 37.27% decline respectively, from 2014–2015. Furthermore, among the twenty two provinces with optimistic technical progress, Mazandaran experienced the highest change, with an improvement of 5.58%; meanwhile, Qom pessimistically experienced the highest technical change, with a growth rate of 127.83%. It is noted that on average, the technical efficiency of provinces in terms of road safety performance optimistically declined by 2.43% while pessimistically improved 37.79%. Fig. 5 (a) illustrates that the road safety performance of ten provinces optimistically progressed from 2014 to 2015, as OMPI ≥ 1; additionally, nine provinces pessimistically showed improvement in terms of road safety performance, as PMPI ≥ 1. Generally speaking, the Iranian road safety performance, however, declined by an average rate of about 14% from both the optimistic and pessimistic perspectives.
As illustrated in Table 8 and Fig. 5 (b), no province technically showed any progress in road safety performance from 2015 to 2016, as OMPI ≤ 1 and PMPI ≤ 1. This is mainly because of a significant decrease in average technical change over the period of time from 2015–2016, with 42.05% optimistic decline and a 45.81% pessimistic drop. On average, the efficiency of Iranian provinces optimistically progressed by about 7% from 2015 to 2016; meanwhile, Iranian provinces pessimistically showed an increase of nearly 19%.
The rather different results can be addressed by computing the integrated OMPI and PMPI. For this purpose, double frontier MPIs are obtained using a geometric integration of OMPIs and PMPIs through Eq. (27). Table 9 and Fig. 6 provide the achieved double frontier MPIs with associated components, efficiency and technical changes, for all Iranian provinces in terms of road safety performance from 2014–2016. Although technical changes in Iranian provinces optimistically dropped by an average of 2.43% between 2014 and 2015 (Table 7), the double frontier MPI shows an average rise of about 16%.
Fig. 6 graphically displays the double frontier MPIs for twoyear (2014–2015 and 2015–2016) and threeyear (2014–2016) evaluations. As illustrated in Table 9 and Fig. 6, the overall double frontier MPI demonstrates that most Iranian provinces were unproductive in road safety performance from 2014 to 2016. Iranian road safety performance declined by an average of 26.06%, mainly due to technical negative changes (19.39% decrease), over the time period 2014–2016. During the time period 2015–2016, the road safety performance of Iranian provinces dropped by an average rate of 36.68%, mainly due to a significant reduction of about 44% in technical changes, while the average integrated efficiency progressed with a mean rate of around 13%. During the time period 2014–2015, Iranian road safety performance declined by an average of 13.66%, largely owing to a considerable decrease of 25.54% in efficiency changes, while the integrated technical changes improved at a mean rate of about 16%.
As shown in Fig. 6 and Table 9, only three provinces, Ardabil, Zanjan and KohgiluyehandBoyerAhmad, progressed in road safety performance with growth rates of 32.95%, 3.27% and 10.44% respectively. The main reason for their improvement was efficiency enhancement, while they experienced a decline in technology from 2014 to 2016. On the other hand, Tehran experienced the most negative growth in road safety performance during the threeyear evaluation (2014–2016) by taking into account the optimistic and pessimistic points of view, with a mean rate of 66.96% decline in MPI; meanwhile, it achieved a negative growth not only in efficiency but also in technology, with mean rates of 60.67% (decrease) and 16% (decrease) respectively. Therefore, it can be concluded that Tehran's negative growth in road safety performance was mainly influenced by negative changes in efficiency, since it is technically recognized as one of the top six provinces. As clearly shown in Tables 3, 4 and 5, the efficiency of Tehran optimistically declined from 1.00 (super efficiency of 1.0349) (rank 1^{st}) in 2014 to 0.4281 (rank 12^{th}) in 2015 and then to 0.1575 (rank 31^{th}) in 2016. From the pessimistic point of view, the efficiency of Tehran decreased from 0.8168 (rank 8^{th}) in 2014 to 0.6740 (rank 11^{th}) in 2015 and then to 0.00 (rank 27^{th}) in 2016.
More precisely, the MPI values alone are not enough to evaluate a province in terms of road safety performance, and a province should also be productive with respect to both technical and efficiency components. Figures 7, 8 and 9 depict the status of Iranian provinces in terms of road safety performance in Cartesian coordinates, with efficiency changes as the vertical axis and technical changes as the horizontal axis. The coordinates of the origin is also defined as the point (1,1), where the vertical and technical axes intersect.
Although the optimistic MPIs indicate that ten provinces are productive in road safety performance (Table 7), Fig. 7. a displays that six provinces were located in the 1^{st} quadrant, which means that these provinces optimistically increased their efficiency and technology from 2014–2015. Pessimistically, only two provinces, Ardabil and KohgiluyehandBoyerAhmad, were located in the 1^{st} quadrant (Fig. 7.b), and the pessimistic MPI (Table 7) shows that nine provinces are productive. As shown in Fig. 7.c, the doublefrontier assessment also demonstrates that five provinces simultaneously enhanced their productivity on road safety, taking into account both components, from 2014–2015. Briefly, the Iranian provinces were mostly productive in terms of technological advancement, since most provinces were in the 1^{st} and 2^{nd} quadrants from 2014–2015.
As shown in Fig. 8 (a) –(c), unfortunately, no provinces were positioned in the first quadrant, which means that all provinces declined their productivity from 2015–2016. On the other hand, most provinces were in the third quadrant, which means that Iranian provinces were mostly productive in terms of efficiency enhancement in 2015–2016.
Generally speaking, the threeyear assessment from 2014 to 2016, as illustrated in Fig. 9, indicates that most Iranian provinces were located in the 3^{th} and 4^{th} quadrants meaning that they are in general unsuccessful in road safety performance in terms of technology advancement; meanwhile, eleven provinces progressed in road safety performance in terms of efficiency improvement.
For more discussion, the input and output slack variables can be further analyzed. For example, the existing data set, slack values and the deviations of input and output variables for Qom province based on the efficient frontier are shown in Tables 10, 11 and 12 respectively. As illustrated, the maximum deviation for Qom province is related to the input variable RLS with a deviation of about 67%. The results also demonstrate that there is no deviation in the input variable of EMS. Similarly, the relative deviation of input and output variables for all provinces can be achieved for 20142016. The average deviation of input and output variables are demonstrated in Fig. 10. It has to be noted that an efficient province, in this regard, is a province with fewer investments in road safety and, consequently, fewer fatalities. As shown in Fig. 10, Iranian provinces experienced a high deviation in road fatalities; i.e. 75% on average. The results also demonstrate that the deviation of road fatality rate has been reduced to some extent from 2014 (around 91%) to 2016 (about 75%). Regarding the input variables, the highest deviation was related to E&V, which indicates an improper distribution of this variable in provinces, with a deviation of around 58% in 2016, 50% in 2015, and 33% in 2014. The second highest deviation regarding the input variables in 2015 and 2016 was related to the variable PS, with a deviation of more than 30%, compared to a deviation of about 21% in 2014, which ranked 3^{rd}. Furthermore, the lowest deviation in 2016 was related to variable C, with a deviation of about 11%, compared to a deviation of more than 16% in 2014 and 24% in 2015. This result shows the improved distribution of cameras in 2016. Apart from fatality risk and cameras, the deviation of other variables from ideal situation has increased in 2016 compared to the years 2014 and 2015, which requires special attention from the Iranian government in their future planning. Generally speaking, although the average deviation of the fatality rate has been improved by 17.6%, Iranian provinces have not succeeded in reducing the deviation of input variables over the period 20142016.
For more discussion, the deviations of input and output variables for the year 2016 are shown in detail in Fig. 11. As can be noted, there are no deviations for efficient provinces taking into account all input and output variables (Ilam, Alborz, KohgiluyehandBoyerAhmad, and Hormozgan). In addition to the efficient provinces, Fig. 11.a illustrates that Bushehr and SistanandBaluchistan have also experienced a deviation of less than 10% in terms of PS. As shown in Fig. 11.a, about 25% of provinces experienced a deviation of more than 50%. It is worth noting that the highest deviation regarding PS variable is related to Khuzestan followed by Kermanshah and Azerbaijan E.
Figure 11.b shows that there is no deviation in RMD for Ardebil, Tehran, Khuzestan, Semnan, and Mazandaran. Apparently, Khuzestan and Mazandaran have experienced no deviation in RMD in contrast to their high deviation in PS. Fig. 11.c also presents that about 77% of provinces have experienced a deviation of more than 50% in E&V. As illustrated in Fig. 11.d, about half the provinces have effectively invested in C without any deviation and five provinces have marginally deviated from the ideal position with a deviation of less than 10%. Although Qom province has received a deviation of more than 50% in C, it has experienced no deviation in EMS (Fig. 11.e). Tehran, Markazi, and Yazd have also invested in EMS effectively. The deviations of about 22% Iranian provinces from the ideal were more than 50%. Figure 11.e also shows that, similar to PS and E&V, the deviation of Khuzestan province in EMS is critically high and needs to be reconsidered by the authorities. According to Fig. 11.f, any deviation from the ideal is observed for twelve provinces while there is a deviation of more than 50% for about 25% of provinces. Figure 11.g provides some information about road fatality risk. The results confirm that nine provinces have succeeded in reducing road fatalities with no deviation from Ideal; however, fifteen provinces have significantly deviated from ideal with a deviation of more than 50%. So, it can be stated that although Iranian provinces have generally succeeded in fatality reduction in 2016 compared to 2014 and 2015 (Fig. 10), output shortfalls are still considerable.
In summary, the input excesses, as well as the output shortfalls regarding each province, can be highlighted using Figs. 10 and 11, respectively. The findings would also be appropriate for the provincial authorities to address safety issues in their future planning.
Conclusions
The DEA models have been recently employed as an effective tool to measure road safety performance worldwide. The existing studies mostly applied the CCR and BCC models for safety measurement, which are on the basis of efficiency ratio and neither considered input excess nor output shortfall. In this respect, the SBM is employed in the current study, which not only measures the efficiency ratio but also takes account of slacks. It is also noted that the safety performance of each DMU (countries, states or provinces) has been previously assessed using the traditional CCR model based only on the efficient frontier, but it can be equivalently measured by taking into account the antiefficient frontier. To bridge this gap, the present study comprehensively examined Iranian road safety performance using a novel double frontier SBM model taking into account the efficient and antiefficient frontiers simultaneously. The ER approach was then employed as a suitable method to aggregate the obtained results from both optimistic and pessimistic points of view. This is because of the fact that the additive independence condition may not be satisfied, since both the optimistic and pessimistic efficiency results are computed from the same data source.
To evaluate Iranian road safety performance, the input and output variables were selected based on policy relevance and data availability. For this purpose, the RMTO Statistical Yearbook was used as the main source of information. As a result, six input variables, including PS, RMD, E&V, C, EMS, and RLS, and an output variable, FR^{−1}, were selected for assessing the road safety performance. Analysis of Iranian road safety performance using the proposed DFSBMER illustrates that Alborz ranked 2^{nd} in the year 2014; meanwhile, it was the most efficient province in 2015 and 2016.
It is certainly crucial for the authorities to examine the strengths and weaknesses of their managerial decisions regarding each province. For this reason, the MPI has been recognized as an appropriate method for further analysis of each province in terms of road safety performance. Although the previous studies, more or less, utilized the optimistic MPI values for assessing DMUs, the current study carried out an indepth analysis to assess Iranian provinces regarding road safety performance by investigating a novel DFSBMMPI, which simultaneously takes into account both efficiency changes and frontier shifts from the optimistic and pessimistic points of view over a period of time. The significant difference between the results obtained from the optimistic and pessimistic MPIs obviously confirms that taking account of the antiefficient frontier is essential for a more comprehensive analysis of performance changes. The results will also assist the authorities to decide whether the strategic frontier shift is appropriate or not.
On average, the Iranian provinces’ productivity in terms of road safety declined with a rate of 13.66% from 2014 to 2015, although the technology frontier shifted with a positive rate of around 16%. This means that the main reason for productivity reduction from 2014–2015 is the significant decline in provinces’ efficiency, by an average of 25.54%. On the contrary, the Iranian road safety performance technologically regressed, with an average reduction rate of 44 % from 2015–2016; meanwhile, Iranian provinces experienced an improvement in efficiency changes, with an average reduction rate of 13%. Generally speaking, the provinces’ productivity in terms of road safety significantly decreased from 2015 to 2016, with a geometric mean rate of about 37%.
Finally, taking into account the period 2014–2016, Iranian road safety declined with a mean rate of about 26%, due to a reduction in efficiency changes (around 8%) as well as a slight negative shift in technology frontier (about 19%).
In brief, the conducted indepth analysis reveals that Iranian provinces were successful in technical changes from 2014–2015, while from 2015–2016, they effectively improved their efficiencies, which is, of course, admirable. It is also worth mentioning that although the productivity of nine provinces on road safety was generally enhanced from 2014–2015; only five provinces fully progressed in road safety performance regarding both efficiency and technical changes.
It is suggested applying the proposed method in other aspects of transportation management. Using different nonlinear methods of aggregation rather than the ER algorithm would also be an interesting topic for future road safety research. In addition, it is suggested extending the method by using some weight restrictions on input variables. In this regard, some group decisionmaking methods can be applied to investigate the importance of each variable. Furthermore, proposing a double frontier Assurance Region SBM model can be of interest to the safety experts.
As mentioned earlier, Iranian safety experts suffer from lack of data. Road safety experts around the world are encouraged to conduct a research study based on the proposed method by defining some new input and output variables subject to data availability. They can define input variables such as “barriers to accidents”, “traffic calming devices”, “police officers or patrol units”, “financial resources” (i.e. the amount of money spent on police patrols and highway maintenance) and “manpower”; meanwhile, “the number of seriously injured people” and “the number of road accidents” can also be used to define a new output variable.
As discussed in the literature, a number of studies have been carried out to assess the road safety performance of European countries using DEA models based only on the efficient frontier, which could not lead to a comprehensive assessment. The current study is the first attempt to assess road safety performance by considering the bestpractice and the worstpractice frontiers. Since the focus of this study is on the basic characteristics of the proposed method, further applications are suggested as the future direction of the current research. The European countries can apply the proposed approach to assess their road safety performance more comprehensively. The input excesses and the output shortfalls obtained from the slack variables analysis can also provide the European authorities with a deeper insight into the road safety performance. In addition, the DFSBMER can be further used by the European Commission to assess other aspects of transportation such as European rail transport, European air transport, and European maritime transport.
Abbreviations
 DEA :

Data Envelopment Analysis
 CCR :

Charnes, Cooper and Rhodes
 SBM :

SlacksBased Measure
 DMU:

Decision Making Unit
 ER:

Evidential Reasoning
 DFSBM MPI:

DoubleFrontier SBMbased Malmquist Productivity Index
 MPI:

Malmquist Productivity Index
 WHO:

World Health Organization
 DFSBMER:

DoubleFrontier SBM aggregated by ER algorithm
 BCC:

Banker, Charnes and Cooper
 DEARS :

DEAbased Road Safety model
 TOPSIS:

Technique for Order Preference by Similarity to an Ideal Solution
 PMPI :

Pessimistic SBMbased MPI
 OMPI:

Optimistic SBMbased MPI
 RMTO:

Road Maintenance and Transportation Organization
 PS:

Police Station
 RMD :

Road Maintenance Depot
 E&V:

Equipment and vehicles
 C:

Camera
 EMS :

Emergency medical service
 RLS:

Road with lighting system
References
 1.
World Health Organization. 2015. Global status report on road safety. http://apps.who.int/iris/bitstream/10665/44122/1/9789241563840_eng.pdf
 2.
Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429–444.
 3.
Odeck, J. (2000). Assessing the relative efficiency and productivity growth of vehicle inspection services: an application of DEA and Malmquist indices. European Journal of Operational Research, 126, 501–514.
 4.
Odeck, J. (2006). Identifying traffic safety best practice: An application of DEA and Malmquist indices. Omega, 34(1), 28–40.
 5.
Hermans, E., Van den Bossche, F., & Wets, G. (2008). Combining road safety information in a performance index. Accident Analysis and Prevention, 40, 1337–1344.
 6.
Hermans, E., Brijs, T., Wets, G., & Vanhoof, K. (2009). Benchmarking road safety: Lessons to learn from a data envelopment analysis. Accident Analysis and Prevention, 41, 174–182.
 7.
Shen, Y., Hermans, E., Ruan, D., Wets, G., Brijs, T., & Vanhoof, K. (2011). A generalized multiple layer data envelopment analysis model for hierarchical structure assessment: A case study in road safety performance evaluation. Expert Systems with Applications, 38, 15262–15272.
 8.
Shen, Y., Hermans, E., Brijs, T., Wets, G., & Vanhoof, K. (2012). Road safety risk evaluation and target setting using data envelopment analysis and its extensions. Accident Analysis and Prevention, 48, 430–441.
 9.
Shen, Y., Hermans, E., Bao, Q., Brijs, T., & Wets, G. (2013). Road safety development in Europe: A decade of changes (2001–2010). Accident Analysis and Prevention, 60, 85–94.
 10.
Egilmez, G., & McAvoy, D. (2013). Benchmarking road safety of U.S. states: A DEAbased Malmquist productivity index approach. Accident Analysis and Prevention, 53, 55–64.
 11.
Shen, Y., Hermans, E., Bao, Q., Brijs, T., & Wets, G. (2015). Serious Injuries: An Additional Indicator to Fatalities for Road Safety Benchmarking. Traffic Injury Prevention, 16, 246–253.
 12.
Bastos, J. T., Shen, Y., Hermans, E., Brijs, T., Wets, G., & Ferraz, A. C. P. (2015). Traffic fatality indicators in Brazil: State diagnosis based on data envelopment analysis research. Accident Analysis and Prevention, 81, 61–73.
 13.
Rosic, M., Pesic, D., Kukic, D., Antic, B., & Bozovic, M. (2017). Method for selection of optimal road safety composite index with examples from DEA and TOPSIS method. Accident Analysis and Prevention, 98, 277–286.
 14.
Behnood, H. R., Ayati, E., Hermans, E., & Pirayesh Neghab, M. A. (2014). The Road safety performance evaluation and policy making by data envelopment analysis: A case study of provincial data in Iran. Scientia Iranica A, 21(5), 1515–1528.
 15.
Ganji, S. S., & Rassafi, A. A. (2018). Measuring the road traffic safety performance of Iranian provinces: A doublefrontier DEA model and evidential reasoning approach. International Journal of Injury Control and Safety Promotion In press.
 16.
Charnes, A., Cooper, W. W., Golany, B., Seiford, L., & Stutz, J. (1985). Foundations of Data Envelopment Analysis for ParetoKoopmans Efficient Empirical Production Functions. Journal of Econometrics, 30(1/2), 91–107.
 17.
Tone, K. (2001). A slackbased measure of efficiency in data envelopment analysis. European Journal of Operational Research, 130(3), 498–509.
 18.
Yang, G.L., Yang, J.B., Liu, W.B., & Li, X.X. (2013). Crossefficiency aggregation in DEA models using the evidentialreasoning approach. European Journal of Operational Research, 231(2), 393–404.
 19.
Cao, J., Chen, G., Khoveyni, M., Eslami, R., & Yang, G.L. (2016). Specification of a performance indicator using the EvidentialReasoning approach. KnowledgeBased Systems, 92, 138–150.
 20.
Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale efficiencies in data envelopment analysis. Management Science, 30(9), 1078–1092.
 21.
Cherchye, L., Moesen, W., Rogge, N., Van Puyenbroeck, T., Saisana, M., Saltelli, A., Liska, R., & Tarantola, S. (2008). Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index. Journal of the Operational Research Society, 59, 239–251.
 22.
Azizi, H., & Fathi Ajirlu, S. (2010). Measurement of overall performances of decisionmaking units using ideal and antiideal decisionmaking units. Computers and Industrial Engineering, 59, 411–418.
 23.
Azizi, H. (2011). The interval efficiency based on the optimistic and pessimistic points of view. Applied Mathematical Modelling, 35(5), 2384–2393.
 24.
Azizi, H. (2014). DEA efficiency analysis: A DEA approach with double frontiers. International Journal of Systems Science, 45(11), 2289–2230.
 25.
Yang, J. B., & Singh, M. G. (1994). An Evidential Reasoning Approach for multiple attribute decision making with uncertainty. IEEE Transactions on Systems, Man, and Cybernetics, 24(1), 1–18.
 26.
Dempster, A. P. (1967). Upper and lower probabilities induced by a multivalued mapping. Annals of Mathematical Statistics, 38(2), 325–339.
 27.
Shafer, G. (1976). A mathematical theory of evidence. Princeton University Press, Princeton, NJ.
 28.
Zadeh, L. A. (1984). Review of books: A mathematical theory of evidence. AI Magazine, 5(3), 81–83.
 29.
Buchanan, B. G., & Shortliffe, E. H. (1984). Rulebased expert system. Reading: AddisonWesley.
 30.
Murphy, C. K. (2000). Combining belief functions when evidence conflicts. Decision Support System, 29, 1–9.
 31.
Yang, J. B., & Sen, P. (1994). A general multilevel evaluation process for hybrid MADM with uncertainty. IEEE Transactions on Systems, Man, and Cybernetics, 24(10), 1458–1473.
 32.
Yang, J. B., & Xu, D. L. (2002). On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty. IEEE Transactions on Systems, Man, and Cybernetics—Part A, 32(2), 289–304.
 33.
Ganji, S. S., & Rassafi, A. A. (2019). Road Safety Evaluation using a Novel Cross Efficiency Method based on Double Frontiers DEA and Evidential Reasoning Approach. KSCE Journal of Civil Engineering, In press.
 34.
Xu, D. L., & Yang, J. B. (2005). An intelligent decision system based on the evidential reasoning approach and its applications. Journal of Telecommunications and Information Technology, 3, 73–80.
 35.
Xu, D. L. (2009). Assessment of nuclear waste repository options using the ER approach. International Journal of Information Technology and Decision Making, 8(3), 581.
 36.
Xu, D. L. (2012). An introduction and survey of the evidential reasoning approach for multiple criteria decision analysis. Annals of Operations Research, 195, 163–187.
 37.
Yang, J. B., & Xu, D. L. (2013). Evidential reasoning rule for evidence combination. Artificial Intelligence, 205, 1–29.
 38.
Yang, J. B. and Xu, D. L. 2014. A study on generalizing Bayesian inference to evidential reasoning, in Belief Function: Theory and Applications, Lecture Notes in Artificial Intelligence, Fabio Cuzzolin (ed.), Springer, ISBN 9783319111919, 180189.
 39.
Rassafi, A. A., Ganji, S. S., & Purkhani, H. (2018). Road safety assessment under uncertainty using a Multi Attribute Decision Analysis based on Dempster–Shafer theory. KSCE Journal of Civil Engineering, 22(8), 3137–3152.
 40.
Ganji, S. S., Rassafi, A. A., & Kordani, A. A. (2018). Vehicle safety analysis based on a hybrid approach integrating DEMATEL, ANP and ER. KSCE Journal of Civil Engineering, 22(11), 4580–4592.
 41.
Malmquist, S. (1953). Index numbers and indifference surfaces. Trabajos de Estatistica, 4, 209–242.
 42.
Färe, R., Grosskopf, S., Lindgren, B., & Roos, P. (1992). Productivity change in Swedish pharmacies 1980–1989: a nonparametric Malmquist approach. Journal of Productivity Analysis, 3, 85–102.
 43.
Caves, D. W., Christensen, L. R., & Diewert, W. E. (1982). The economic theory of index numbers and the measurement of input, output, and productivity. Econometrica, 50(6), 1393–1414.
 44.
Farrell, M. J. (1957). The measurement of productivity efficiency. Journal of the Royal Statistical Society Series A: General, 120(3), 253–281.
 45.
Chen, Y., & Agha Ighbal, A. (2004). DEA Malmquist productivity measure: New insights with an application to computer industry. European Journal of Operational Research, 159, 239–249.
 46.
AlEraqi, A. S., Khader, A. T., & Mustafa, A. (2009). DEA Mamquist index measurement in Middle East and East African containers terminals. International Journal of Shipping and Transport Logistics, 1(3), 249–259.
 47.
Wang, Y.M., & Lan, Y.X. (2011). Measuring Malmquist productivity index: A new approach based on double frontiers data envelopment analysis. Mathematical and Computer Modelling, 54, 2760–2771.
 48.
Liu, F.H. F., & Wang, P.H. (2008). DEA Malmquist productivity measure: Taiwanese semiconductor companies. International Journal of Production Economics, 112, 367–379.
 49.
Tone, K. (2002). A slackbased measure of superefficiency in data envelopment analysis. European Journal of Operational Research, 143(1), 32–41.
 50.
Liu, F.H. F., & Chen, C.L. (2009). The worstPractice DEA model with slackbased measurement. Computers and Industrial Engineering, 57, 496–505.
 51.
SafetyNet, Work Package 3. (2005). Stateoftheart Report on Road Safety Performance Indicators. In Stichting Wetenschappelijk Onderzoek Verkeersveiligheid.
 52.
European Commission (EC). 2010 b. EU Energy and Transport in Figures 2010. Commission of the European Communities, Brussels.
 53.
European Commission (EC). 2012. EU Energy and Transport in Figures 2012. Commission of the European Communities, Brussels.
 54.
Research and Innovative Technology Administration (RITA). 2010. State Transportation Statistics. State Transportation Statistics.
 55.
Road Maintenance and Transportation Organization (RMTO). (2014). The Statistical Yearbook, Ministry of Road and Urban Development. In Iran.
 56.
Road Maintenance and Transportation Organization (RMTO). (2015). The Statistical Yearbook, Ministry of Road and Urban Development. In Iran.
 57.
Road Maintenance and Transportation Organization (RMTO). (2016). The Statistical Yearbook, Ministry of Road and Urban Development. In Iran.
 58.
Cooper, W. W., Seiford, L. M., & Tone, K. (2007). Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEASolver Software (Second Edition). Publisher: Springer US. https://doi.org/10.1007/9780387452838.
Acknowledgements
Not applicable
Funding
Not applicable
Availability of data and materials
The required data were collected from the following website (in Persian)
Author information
Affiliations
Contributions
Both authors read and approved the final manuscript.
Corresponding author
Correspondence to S. S. Ganji.
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1
Suppose that there is an evaluation problem for assessing n DMUs with m inputs and s outputs.
1.1. The inputoriented CCR
The optimistic inputoriented CCR model is mathematically as follows [2, 58]:
where u_{r} and v_{i} denote the realtive weights of the outputs and the inputs, respectively. x_{ij} and y_{rj} also express the i^{th} input and the r^{th} output of DMU_{j}. θ_{0} denotes the efficiency degree of a given DMU_{0} with the given inputs (x_{i0}) and the given outputs (y_{r0}).
The pessimistic or inverted inputoriented CCR model can be mathematically formulated as follows:
1.2. The outputoriented CCR
The optimistic outputoriented CCR model is mathematically as follows [2, 58]:
where u_{r} and v_{i} denote the realtive weights of the outputs and the inputs, respectively. x_{ij} and y_{rj} also express the i^{th} input and the r^{th} output of DMU_{j}. θ_{0} denotes the efficiency degree of a given DMU_{0} with the given inputs (x_{i0}) and the given outputs (y_{r0}).
The pessimistic or inverted outputoriented CCR model can be mathematically formulated as follows:
Appendix 2
Suppose that there is an evaluation problem for assessing n DMUs with m inputs and s outputs.
2.1. The optimistic SBM
The optimistic SBM in time t, \( {D}_0^t\left({x}_0^t,{y}_0^t\right) \) , can be mathematically represented as follows:
Similarly, the optimistic SBM in time t + 1, \( {D}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be obtained by substituting \( \left({x}_{i0}^{t+1},{x}_{ij}^{t+1},{y}_{r0}^{t+1},{y}_{rj}^{t+1}\right) \) with \( \left({x}_{i0}^t,{x}_{ij}^t,{y}_{r0}^t,{y}_{rj}^t\right) \) in model (36). As a result, \( {D}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be represented as follows:
Likewise, the second mixed period of measure, \( {D}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \), can be computed by substituting \( \left(\ {x}_{i0}^t,{x}_{ij}^{t+1},{y}_{r0}^t,{y}_{rj}^{t+1}\right) \) with \( \left(\ {x}_{i0}^{t+1},{x}_{ij}^t,{y}_{r0}^{t+1},{y}_{rj}^t\right) \) in model (37).
2.2. The pessimistic point of view
The pessimistic SBM in time t, \( {d}_0^t\left({x}_0^t,{y}_0^t\right) \), can be formulated as follows:
By substituting \( \left({x}_{i0}^{t+1},{x}_{ij}^{t+1},{y}_{r0}^{t+1},{y}_{rj}^{t+1}\right) \)with\( \left({x}_{i0}^t,{x}_{ij}^t,{y}_{r0}^t,{y}_{rj}^t\right) \) in model (38), the pessimistic SBM in time t + 1, \( {d}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be computed. Moreover, the first mixed period measure, \( {d}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be formulated as follows:
Likewise, the second mixed period of measure, \( {d}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \), can be computed by substituting \( \left(\ {x}_{i0}^t,{x}_{ij}^{t+1},{y}_{r0}^t,{y}_{rj}^{t+1}\right) \) with \( \left(\ {x}_{i0}^{t+1},{x}_{ij}^t,{y}_{r0}^{t+1},{y}_{rj}^t\right) \) in model (39).
Appendix 3
3.1. The optimistic SuperSBM [49]
Suppose that DMU (x_{0}, y_{0}) is efficient. The production possibility set is defined as follows:
\( \overline{P}\backslash \left({x}_0,{y}_0\right) \)is further defined as a subset of P\(x_{0}, y_{0}):
The optimistic SuperSBM is mathematically represented as follows:
Using CharnesCooper transformation, the fractional programming model (42) is transformed into the following linear programming model:
The optimal solution of model (43) is (\( {\tau}^{\ast },{\overset{\sim }{x}}_i^{\ast },{\overset{\sim }{y}}_r^{\ast },{\varLambda}_j^{\ast },{q}^{\ast } \)). Subsequently, the optimal solution of SuperSBM is (\( {\delta}^{\ast }={\tau}^{\ast },{\lambda}_j^{\ast }={\varLambda}_j^{\ast }/{q}^{\ast },{\overline{x}}_i^{\ast }={\overset{\sim }{x}}_i^{\ast }/{q}^{\ast } \), \( {\overline{y}}_r^{\ast }={\overset{\sim }{y}}_r^{\ast }/{q}^{\ast } \)).
3.2. The pessimistic SuperSBM
The production possibility set can be defined as follows:
Furthermore,\( \overline{P}\backslash \left({x}_0,{y}_0\right) \)can be defined as a subset of (x_{0}, y_{0}):
The pessimistic SuperSBM can be formulated as follows:
Subsequently, the following linear programming model can be pessimistically obtained using the CharnesCooper transformation technique:
The optimal solution of (47) is (\( {\tau}^{\ast },{\overset{\sim }{x}}_i^{\ast },{\overset{\sim }{y}}_r^{\ast },{\varLambda}_j^{\ast },{q}^{\ast } \)). Subsequently, the optimal solution of SuperSBM is (\( {\delta}^{\ast }={\tau}^{\ast },{\lambda}_j^{\ast }={\varLambda}_j^{\ast }/{q}^{\ast },{\overline{x}}_i^{\ast }={\overset{\sim }{x}}_i^{\ast }/{q}^{\ast } \), \( {\overline{y}}_r^{\ast }={\overset{\sim }{y}}_r^{\ast }/{q}^{\ast } \)).
Appendix 4
4.1. The optimistic point of view
In the situation that \( {D}_0^t\left({x}_0^t,{y}_0^t\right)=1 \), DMU_{0} is efficient based on the data set belonging to time period t. Therefore, the super efficiency score, \( {\overset{\sim }{D}}_0^t\left({x}_0^t,{y}_0^t\right) \), is optimistically measured as follows:
By substituting \( \left({x}_{i0}^{t+1},{\overset{\sim }{x}}_i^{t+1},{x}_{ij}^{t+1},{y}_{r0}^{t+1},{\overset{\sim }{y}}_r^{t+1},{y}_{rj}^{t+1}\right) \) with \( \left({x}_{i0}^t,{\overset{\sim }{x}}_i^t,{x}_{ij}^t,{y}_{r0}^t,{\overset{\sim }{y}}_r^t,{y}_{rj}^t\right) \) in model (48), the super efficiency in time period t + 1, \( {\overset{\sim }{D}}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be optimistically computed. Moreover, the first mixed period of measure, \( {\overset{\sim }{D}}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be formulated as follows:
Likewise, the second mixed period of measure, \( {D}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \), can be computed by substituting \( \left({x}_{i0}^t,{\overset{\sim }{x}}_i^t,{x}_{ij}^{t+1},{y}_{r0}^t,{\overset{\sim }{y}}_r^t,{y}_{rj}^{t+1}\right) \) with \( \left({x}_{i0}^{t+1},{\overset{\sim }{x}}_i^{t+1},{x}_{ij}^t,{y}_{r0}^{t+1},{\overset{\sim }{y}}_r^{t+1},{y}_{rj}^t\right) \) in model (49).
4.2. The pessimistic point of view
In the situation that \( {d}_0^t\left({x}_0^t,{y}_0^t\right)=1 \) which means that DMU_{0} is efficient based on the data set belongs to time period t. Therefore, the super efficiency score, \( {\overset{\sim }{d}}_0^t\left({x}_0^t,{y}_0^t\right) \), is measured from the pessimistic point of view as follows:
By substituting \( \left({x}_{i0}^{t+1},{\overset{\sim }{x}}_i^{t+1},{x}_{ij}^{t+1},{y}_{r0}^{t+1},{\overset{\sim }{y}}_r^{t+1},{y}_{rj}^{t+1}\right) \) with \( \left({x}_{i0}^t,{\overset{\sim }{x}}_i^t,{x}_{ij}^t,{y}_{r0}^t,{\overset{\sim }{y}}_r^t,{y}_{rj}^t\right) \) in model (50), the super efficiency in time period t + 1, \( {\overset{\sim }{d}}_0^{t+1}\left({x}_0^{t+1},{y}_0^{t+1}\right) \) can be pessimistically computed. Moreover, the first mixed period of measure, \( {\overset{\sim }{d}}_0^t\left({x}_0^{t+1},{y}_0^{t+1}\right) \), can be formulated as follows:
Likewise, the second mixed period of measure, \( {d}_0^{t+1}\left({x}_0^t,{y}_0^t\right) \), can be computed by substituting \( \left({x}_{i0}^t,{\overset{\sim }{x}}_i^t,{x}_{ij}^{t+1},{y}_{r0}^t,{\overset{\sim }{y}}_r^t,{y}_{rj}^{t+1}\right) \) with \( \left({x}_{i0}^{t+1},{\overset{\sim }{x}}_i^{t+1},{x}_{ij}^t,{y}_{r0}^{t+1},{\overset{\sim }{y}}_r^{t+1},{y}_{rj}^t\right) \) in model (51).
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Received
Accepted
Published
DOI
Keywords
 Doublefrontier slacksbased measurement
 Iranian provinces
 Road safety performance
 ER algorithm
 DFSBMMPI