- Original Paper
- Open Access
Multicriteria versus Cost Benefit Analysis: a comparative perspective in the assessment of sustainable mobility
© The Author(s) 2012
- Received: 1 May 2011
- Accepted: 11 January 2012
- Published: 5 February 2012
Background and aim
The paper focuses on the methodology for assessing Sustainable Mobility (SM) at the neighbourhood scale, and pays attention to two different ex-ante evaluation approaches: the Multicriteria Analysis (MCA) and the Cost-Benefit Analysis (CBA). If MCA is an acknowledged technique for the assessment of sustainability at neighbourhood level, CBA is mainly used for infrastructure and large transformation projects. The aim of the paper is twofold: (i) highlight strengths and weaknesses of the two techniques, especially when assessing SM at the neighbourhoods scale; (ii) investigate the applicability of MCA and CBA to evaluate some relevant SM strategies and policies at the neighbourhood scale. To do so, a detailed description of MCA and CBA is presented and, when it exists, a review of their application to assess SM at neighbourhood level is described. Strengths and weaknesses of the approaches are, therefore, highlighted and their applicability to some specific SM measures are examined.
Results and conclusions
It results that the joint use of the two methodologies could overcome their mutual weaknesses, providing a coherent methodology for assessing both efficiency and effectiveness of SM policies and projects.
- Sustainable mobility
Despite sustainability in transport has become a crucial element in urban planning, it has often received poor attention in developing neighbourhoods [1, 2]. Yet the city is sustainable if its parts meet sustainability criteria, which appear quite feasible to be included in neighbourhood design [3, 4]. Moreover, pertaining sustainable mobility, a well connected and designed district level does appear as the most effective , not only for planning transport and land-use , but even for fixing policies and investments [7, 8], and for enhancing people participation . Moreover, there is some evidence that at the local level, people should mainly concern the common good and have positive attitude towards collective actions .
Evaluation (ex-post and ex-ante) of transportation plans and projects have been carried out in the past, using a variety of methodological frameworks. The methods can be grouped in two major categories: the single criterion method (monetary approach), and the multicrieria methods (non-monetary approach). The Cost Benefit Analysis (hereinafter CBA) belongs to the first category, the Multicriteria Analysis (hereinafter MCA) to the second one.
Within this context, the present paper focuses on some methodological problems in the field of ex-ante assessment of Sustainable Mobility (“SM” in the following) policies at the neighbourhood scale. Also in this field the two different evaluation approaches (MCA and CBA) are considered. If MCA is a well acknowledged technique for the assessment of sustainability at neighbourhood level, CBA is mainly used for infrastructure projects (where public expenses are expected), and policies.
Both methodologies present some prickly points. MCA, for instance, is not considering public expense efficiency at all, but only its effectiveness in achieving the SM goal. On the other hand, critics often consider CBA not appropriate in managing intangible impacts, which are more relevant to policies and strategies at this scale for achieving SM, and urban quality of life.
The joint use of the two methodologies could, thus, overcome the limitations, providing a coherent methodology for assessing both efficiency and effectiveness of SM policies and projects, and taking coherent and shared decisions on policy actions.
Within this context, the aim of the paper is twofold: (i) highlight strenghts and weaknesses of the two techniques - MCA and CBA - especially when assessing SM at the neighbourhood scale; (ii) investigate the applicability of MCA and CBA to evaluate some relevant SM strategies and policies at neghbourhood scale.
The paper is structured as follows. After the Introduction, in section 2 a literature review on the MCA and CBA methodologies is conducted. Section 3 focuses on the application of the two techniques to assess SM policies, trying to identify the specificities associated to the scale and to the peculiar object. A discussion of the strengths and weaknesses of MCA and CBA is provided in Section 4. Section 5 is dedicated to conclusions and future research questions.
2.1 Multicriteria analysis
Usually, a decision-making problem has more than one goal to reach, and there is always a trade-off between the different goals, advocated by different interest groups or stakeholders. Within this context, the MCA is seen by some authors as the most appropriate tool to adopt [11–15]. The MCA is a tool for selecting alternative projects, which have significant social, economic, environmental impact, that allows to take into account several criteria and the stakeholders’ opinions. Therefore, the inclusion of multiple stakeholders in the decision making process is widely acknowledged and it is often a crucial factor for the successful implementation of the measure or project under consideration in the transport sector .
Within the MCA, the objectives to reach must be specified and corresponding attributes or indicators must be identified. The actual measurement of indicators need not to be in monetary terms, but it is often based on scoring, ranking and weighting of a wide range of qualitative impact categories and criteria.
Phase 1. Definition of the projects or actions to be judged.
Phase 2. Definition of judgment criteria.
Phase 3. Analysis of the impacts of the actions.
Phase 4. Judgment of the effects of the actions in terms of each of the selected criteria.
Phase 5. Aggregation of judgments.
Multi-criteria methods can be classified according to the nature of the decision problem restrictions (implicit or explicit), and the nature of the results (deterministic or random) .
There are several methods that might be applied to transport evaluation, the most suitable are: (i) Analytic Hierarchy Process (AHP), (ii) Analytic Network Process (ANP), (iii) REGIME, (iv) ELECTRE family, (v) Multi Attribute Utility approach, (vi) ADAM type (for a detailed review, see [16, 17]). In the present work particular attention is placed on the AHP, ANP and REGIME, being the AHP and the ANP two of the most used and well-known multi-criteria techniques, and the REGIME adopted to assess sustainability at the neighbourhood level.
The AHP, developed by Saaty [18, 19], is a three-stage method: (i) building the hierarchy; (ii) weighting the indicators by a pair-wise comparison, and (iii) calculating the final value for the alternatives. The AHP, indeed, consists of decomposing a complex decision making process into a hierarchical structure, with the ultimate goal at the top of the hierarchy, the primary criteria in the second level, and the subcriteria in the third level. In the following level there might be additional subcriteria, while at the bottom level of this “probability tree”  there are the discrete options under consideration (for a review see, among the others, ). The elements of the hierarchy can relate to any aspect of the decision problem—tangible or intangible, carefully measured or roughly estimated, well- or poorly-understood—anything at all that applies to the decision at hand.
The stakeholders, public and private, might take part to the construction of this hierarchy, and “especial care must be taken when building up the hierarchy such that pernicious double counting of attributes is avoided” . Once the criteria and sub-criteria have been settled, a set of weights is required. These weights represent the relative importance of the criteria, subcriteria and attributes belonging to a specific nest in the hierarchy. According to the original procedure developed by Saaty, these weights are obtained from pairwise comparison matrices, for each nest in the hierarchy. Once weights are available, the hierarchical structure is collapsed, following a folding back procedure. For each option under study, there will be a final weight. These final weights are used to rank the options.
Another procedure that is widely adopted is the ANP. The ANP provides a general framework to deal with decisions without making assumptions about the independence of higher level elements from lower level elements and about the independence of the elements within a level. In fact the ANP uses a network without the need to specify levels as in a hierarchy. Influence is a central concept in the ANP. The ANP is a useful tool for prediction and for representing a variety of competitors with their surmised interactions and their relative strengths to wield influence in making a decision (for a review see, among the others, ).
The ANP is a coupling of two parts. The first consists of a control hierarchy or network of criteria and subcriteria that check the interactions. The second is a network of influences among the elements and clusters. The network varies from criterion to criterion and a different supermatrix of limiting influence is computed for each control criterion. Finally, each of these supermatrices is weighted by the priority of its control criterion and the results are synthesized through addition for all the control criteria.
With the ANP a problem is often studied through a control hierarchy or control system of benefits, a second for costs, a third for opportunities, and a fourth for risks, and each is represented in the controlling system. The synthesized results of the four control systems are combined by taking the quotient of the benefits times the opportunities, to the costs times the risks for each alternative, then normalizing the results over all the alternatives to determine the best outcome.
The REGIME method uses pairwise comparison (for a detailed review see [22, 23]) on the basis of which a synthetic index is calculated. The index defines a ranking among alternative options: the higher is the index, the most preferable is the option. In this case, the synthetic index expresses the level of performance of the different selected indicators as respect to the criterion referring to each analyzed experiences, and make them explicit in the ‘information matrix’. In the REGIME analysis the main focus is the sign of differences between impacts of alternatives. In general terms, an evaluation table is given and composed by scores of a number ‘n’ of alternative options with respect to ‘m’ criteria. In the case of ordinal information, the weight can be represented by means of rank orders in a weight vector: the higher the value of the weight, the better the correspondent criterion. The alternative options will be compared pairwise for all criteria and for two alternative choice options, the difference of the criterion scores is assessed.1
2.2 Cost benefit analysis
Cost Benefit Analysis is the most used evaluation technique for assessing infrastructural investments. In the transport field, it is the basic tool in the majority of countries in Europe (; OECD, ECMT ) and in the rest of the world (; EVA TREN ), and it is also widely adopted by all the international bodies ([28, 29]).
A number of official guidelines exist.2 They, despite some differences in how a CBA must be actually performed, always refer to one single common theoretical framework. It is not the aim of the present paper to go in deep with the well known CBA theory, however, some key aspects can be pointed out.
Firstly, the CBA is based on monetisation and inter-temporal discount. Money is the measure unit used as a common numerary to translate all costs and benefits associated to an investment or a policy. Apart direct monetary costs in perfect markets (e.g. untaxed cost of energy) whose monetisation is trivial, also non-market goods and goods traded in an imperfect market are quantified. The first ones (e.g. time or environmental costs) are translated into the common numerary by means of the willingness to pay or by deriving prices from substitute markets (hedonic prices method). The second ones are translated into their opportunity cost by subtracting taxes (e.g. fuel prices) and by looking at the direct effect only (e.g. shadow price of labour cost).
Once all relevant effects of an investment are quantified, the concept of inter-temporal discount is used to translate future costs and benefits to present day by means of a social discount rate. In this way, the future can be compared with present.
The core of CBA technique is the social surplus, sum of users’ surplus, producers’ surplus, and, if the case, non-users’ and Government surplus. Surplus is the difference between the willingness to pay/sell of users/producers for a good (which is the combined effect of perceived utility and income distribution), and the effort needed to obtain such good (the monetary cost or any other kind of effort). A scheme generates a variation of surplus, between the situation “with” and “without” it. Following this concept, CBA essentially compares among trade-offs: total benefits must exceed the total opportunity cost of consumed resources (labour, time, monetary costs, etc.) to make a project feasible. Otherwise, social cost exceeds social benefits and the scheme should be rejected.
In order to have a significant result, two hypotheses must be fulfilled. The first is represented by the Kaldor-Hicks criterion , which states that a resources allocation change is efficient if the surplus obtained by some actors exceeds the surplus losses paid by other actors, i.e. if the benefit for a person can be compared with the cost of another one. The second hypothesis assumes that a scheme is marginal, i.e. does not change upstream and downstream markets.
From a practical viewpoint, transport CBA usually quantifies the investment plus running cost of a scheme and compare it with direct benefits, that usually are represented by time, running costs and environmental cost savings. Recently, CBA can also include wider benefits, i.e. macroeconomic benefits that are not subsumed in the direct benefits (agglomeration effects, labour pooling, efficiency; see 3.2).
Moving to the topic of SM policies, several quantitative studies do exist. For example, Farrell et al.  and Beria  assess quantitatively the effect of different mobility policies in terms of avoided emissions, but only in terms of policies’ effectiveness. They, however, do not evaluate the costs associated to such policies, at least in strict microeconomic terms, and thus they do not perform a socio-economic assessment.
In contrast with the importance of CBA for infrastructural investments, in fact, the use of such tool for softer measures, typically those associated with sustainable mobility, is less common. The above cited examples of CBA guidelines actually refer to infrastructural investments. Motivations that lay behind to the less common application of CBA to policies assessment are clear and will be discussed in a while. However, some examples of CBA applied to policy analysis exist in scientific literature, together with some applications.
From a general perspective, Farrow and Toman  state that CBA can be used to improve environmental regulation. Its limits must be known, but it is a necessary tool to cope with scarcity of resources. They describe an evaluation process that reflects the same flow used in physical investments: the definition of a base scenario in which the state of the world goes on with already decided actions, the definition of a complete set of policy alternatives, the identification of the changes to the costs and benefits due to the policies, the assessment and finally a sensitivity/risk analysis in order to—to evaluate robustness.
A warm debate is open on the limits the use of CBA in the environmental field policies. Among many, Heinzerling and Ackerman , Hahn , and Turner  analyse, from radically different viewpoint, pros and cons of the approach. While the first heavily criticise the approach, claiming that it is trying to price priceless things, the other two conclude that, despite the well-known limitations of the technique, it still plays a role also in the environmental policy appraisal. In particular, Turner  revises the relevant literature on the topic, underlining that CBA usefulness is particularly true if moving from a prescriptive role to that of information and decision support and when scarcity of resources exists. Only in the policies or actions involving “values” (poverty, cultural aspects, beauty, etc.) the role of CBA must be only partial. In general, CBA is seen as part of a multiple-criteria policy analysis process.
Another specific field of policy assessment in which the debate on CBA is particularly active is that of safety in transport. For example, Elvik  analyses the conditions under which applying CBA in safety policies is justified or not, showing that it is appropriate if used as a tool to find “the most cost-effective measures to reduce the number of accidents and injuries”. Wijnen et al.  go more into the practice and present the method to assess safety effects (by the estimation of the value of a statistical life).
However, apart from specific ethical and theoretical reflexions on the applicability of CBA to policy analysis, fewer contributions exist explaining “how” to perform a CBA of a generic policy instead of an infrastructure. In fact, all manuals and theories usually refer to the “physical” projects, involving an investment cost and some future benefits. Policies, instead, represent a much broader world, where infrastructures are only one of the possible options, aside to technological investments, education, pricing, etc. to obtain a chosen goal.
One of the policies more studied in literature is road user charging. Rich and Nielsen , Transport for London , Eliasson , and Rotaris et al.  perform a CBA to road user charging schemes in Copenhagen, London, Stockholm and Milan, respectively. A similar measure, but applied at a country scale is described in Glaister and Graham . In this kind of policy, however, main benefits and costs are similar to those related to infrastructures: investment and fixed running costs, time savings or costs, revenues, reduction of congestion and possibly of pollution.
Another typical sustainable mobility policy is car sharing. Fellows and Pitfield  use the standard British methodology (the so called “COBA”) to analyse a soft measure like car sharing. Methodologically, however, they perform it “exactly in the same way as new road schemes”, quantifying benefits from reduced vehicle kilometres, increased average speeds and savings in fuel, accidents and emissions.
Moving to measures less and less dominated by an investment cost, Sælensminde  performs a CBA of walking and cycling networks, taking into account all the relevant aspects, some of which are usually not considered: travel time, insecurity, accidents, savings for school buses, health effects, parking costs, environmental external costs. On the same topic - cycling - Börjesson and Eliasson  demonstrate that, in a CBA of cycling support policies, health effects on cyclists, which are usually considered as external benefits, are actually internalized. In fact, the generalized cost of a cyclist seems to include also the health benefit of cycling: he/she accepts a slower mode vs. car or public transport also because perceiving a personal benefit in terms of health. For this reason, considering health benefits as an external benefit to be added in case of an improvement to cycling network, introduces a double counting if consumers’ surplus is correctly accounted.
Finally, a practical application for environmental policies is offered by Massé . The author is calculating the costs and benefits associated to the compulsory introduction of anti-particulate matter filters on cars and trucks in France. He obtains a very good B/C ratio, thanks to the large benefits in terms of saved human lives. On the same topic of pollution, Bollen et al.  perform a CBA to evaluate policies that reduce jointly or separately local and global pollutants.
2.3 MCA and CBA: integrated approaches
The combination of MCA and CBA has been applied in several studies. For instance, CBA has been combined with AHP or ANP in order to cope with the CBA’s weakness in reflecting stakeholders’ knowledge in the evaluation process of projects ; while a financial CBA plus a MCA matrix was created for an economic evaluation of urban transformations .
As concerns specifically transport issues, in the EU member states (for a detailed review see ), different evaluation techniques are adopted with a great prevalence of CBA. In most of the cases (i.e. in Sweden, Netherlands, United Kingdom), CBA is supplemented by a specific appraisal for impacts that are difficult to be monetized; in some others (i.e. Belgium, Austria and Greece), MCA is used, but it includes CBA as one of the criteria. Finally, in France CBA has recently been considered weak in stimulate stakeholders’ interactions, thus, in order to create a larger public debate, MCA tools have also been adopted . Even at the urban scale of transport investment evaluation, as the outcome of CBA did not match with the one selected by MCA, a combination of the two methods was suggested .
As regards sustainable development, for instance, in the ExternE-Pol project  it was possibile to integrate multicriteria methodology into the wider structure of CBA by using a specific framework. By doing so, all the stakeholders’ preferences could be exploited, thus, deriving indirect monetary values for environmental goods and impacts .
Besides, as for the specific environmental impacts assessment from transportation projects, either for small-scale (local) or large-scale (regional/national), a combination of CBA and MCA has been developed in the Evaluation Framework of Environmental impacts and Costs of Transport (EFECT) . EFECT is a methodological framework, which aims to cover all kinds of transport environmental initiatives, namely policies, plans and projects, by using an additive function.
Finally, as concerns the evaluation of SM at neighbourhood level, as it will be described in details in the following sections, a first attempt to use MCA has been done , while no specific evidence has been provided for the application of CBA. This is due to the fact that CBA well fits in the assessment of specific infrastructures or policies where monetary or monetizable costs and benefits prevail (investment, time, environmental benefits, etc.) (see 3.2 for a discussion), therefore when it is applied to assess soft policies at the urban scale, it can be well supplemented by a broader evaluation approach like MCA. The MCA, indeed, effectively evaluates effects like social inclusion, change in behavior of citizens, change in the use of city, quality of life, etc.
3.1 The case of MCA
Within the application fields of the MCA, transportation plays an important role. Specifically, there has been a flourishing literature investigating the assessment of SM, both ex-ante and ex-post at the urban scale3 and the city level, while the literature at the neighbourhood level is still poor.
The literature on the city level presents the indicators to measure SM, and adopts the MCA to obtain the indicators weighting (see, among the others, ). Among the many works focusing on the city level, the PROPOLIS Report , the TRANSPLUS Report  and the PROSPECT Report  present some successful good practices connecting measures in land use and urban transport, and develop specific strategies and indicators to achieve SM. Specifically, the PROPOLIS Report aims at finding policies that could, in an ideal case, simultaneously improve all dimensions of sustainability compared with the reference solution and, if possible, even improve the current level of sustainability. Other applications of MCA are found in the work by Campos Gouvêa et al. , which proposes a set of mobility indicators with the objective to integrate transport and land use planning in order to achieve an efficient sustainable urban development. The case study analyzed by the authors is Belo Horizonte, the third largest city of Brazil. Besides, Tzeng et al.  adopt MCA to evaluate alternative-fuel buses in Taiwan urban areas; Yedla and Shrestha  focus on the selection of alternative options for environmentally sustainable transport system in Delhi.
The Nijkamp Hexagon model
Ecoware: natural capital
• environment and natural resources
• waste management
Hardware: man-made capital
• built environment
• technologies and building system
• land use
Finware: economic and financial capital
• financing, incentives, subsidies
• economic vitality
Orgware: institutional capital
• laws and regulation
• local governance
Software: human capital
• training and knowledge
• education and sensitizing
• innovation and creativity
Civicware: social capital
• equity and social inclusion
• local quality of life
With reference to the conceptual framework suggested by this multidimensional model, it is clear that the level of sustainability achieved by a project, a plan or an intervention, depends on how many dimensions are considered in it and on the degree of their mutual relationships [54, 61, 62, 65].
In particular, Cerreta  and Cerreta and Salzano  adopt the Hexagon model in order to assess the sustainability degree of a sample of eight “best practices” neighbourhoods in Europe. The authors have translated the data for each case study into specific indicators able to express the interventions and strategies’ performances, measured throughout a score of the performance level (from 0 = none to 5 = excellent). It was, thus, possible to develop the evaluation matrix and compare the profiles of the eight neighbourhoods according to an ex post evaluation approach. The methodological approach used the multicriteria method to define the significance of the practices as concerns sustainability. Specifically, the REGIME method was adopted in order to make explicit the satisfaction level of each criterion, and to verify the performance of each neighbourhood, thus obtaining a synthetic index representing the selected indicators.
Starting from the work by Cerreta and Salzano , in recent studies Maltese et al. , and Maltese and Mariotti  have focused on the SM assessment of 20 European neighbourhoods. To do so, they have selected several SM strategies, derived from: (i) a very rich literature review on SM indicators (see among the others, [66–72]4; [73–76])5; (ii) the Nijkamp Hexagon model and the ex-post assessment model for achieving SM by Holden ; (iii) data availability at the neighbourhood level.6
According to a widely accepted sustainability rating systems (see for example, GBTool, SBTool and Itaca Protocol8 for assessing sustainability of buildings, but even the above-mentioned , for sustainability of neighbourhoods), the presence of each SM strategy has then been measured by a quantitative score, which ranges from 0 to +2 (0 = deficient performance: no strategy is adopted; +1 = ordinary practice, which is the minimum acceptable performance, strategy is partially adopted; +2 = good performance, strategy is fully or strongly adopted). For example, as regards the measures for private transport degree the score is 0 if no measure regarding private transport is undertaken; 1 if some traffic calming measures, inside the neighbourhood, have been adopted; 2, if the neighbourhood is a car free area. Of course, no mention is provided about the effectiveness of measure (for instance, if it is respected or not) or its efficiency (assessing costs or benefits deriving from the specific intervention).
The study concludes that SM can only be achieved through the homogeneous involvement of direct (from transport strategies for reducing car use to bicycle and pedestrian paths) and indirect (from mixed use of land, density and urban form to community involvement) SM strategies.9
3.2 The case of CBA
As we already stated, literature and common thinking suggest that CBA can also be used to assess policies. In fact, any action in the transport sector (an investment, a policy measure, a new restrictive norm) potentially involves public or private costs, in change of direct or external benefits. And when a social cost exists, it is appropriate to take public decisions after having verified the opportunity-cost of it: is the effort efficiently spent because giving a higher benefit, at least aggregate, and not only effective? Moreover, the distribution of costs and benefits among groups can be relevant. In other words, for any non-win-win policy it makes sense to verify if the monetary or non-monetary effort is well paid, and CBA is widely recognised as an adapt tool for such task.
“ethical” problems, related to the issue of measurability of some costs/benefits;
practical problems, on how to perform such analysis.
Ethical arguments are the most used to criticise the use of CBA in this field.10 Practical problems, instead, remain unsolved or not sufficiently clarified in CBA for SM policies. This issue is amplified when focusing on the relevant sub-problem of SM at the neighbourhood level.
In fact, it is well known to practitioners that CBA tends to be more complex, the smaller the scale of the problem. While for an infrastructural problem it is “easy” and obvious to identify and quantify the main costs and benefits, and leaving to qualitative decisions other effects, such task is more difficult for policy measures, where non-monetary benefits and costs prevail.
available solutions are much broader (not only infrastructures);
the range of impacts is broader11;
direct public investment is relatively less dominant on other positive and negative effects;
some policies are at zero monetary cost, but determine other kind of efforts for part of the users (e.g. car free zones introduce a cost for car users).
At the neighbourhood level this is even more evident: nearly no policies involve a relevant public cost to be assessed in term of trade-offs, but this does not mean that all policies have no social cost.
Columns divide the type of benefits and costs to be considered according to the degree of adherence of monetisation to reality. For example, expenditures and time costs are naturally expressed in monetary terms. In this case, CBA uses simply the shadow value of market costs. Other costs are not monetary, but can be reasonably translated in monetary terms (e.g. the environmental costs). This “translation” is not accepted by everybody, but it is commonly used in the large majority of guidelines. The third column includes all the effects that can be judged as positive or negative, but for which associating a conventional monetary cost can be too difficult, unclear or simply a nonsense. For example, it is obvious that a nice bridge is better than an ugly one, but how to measure “nice” and “ugly”, even if practically possible, will be too undefined (involving personal judgements) and of scarce economic meaning.
Time is not traded into a market, but its monetisation is rather intuitive.
A general and important issue is that of double counting, i.e. benefits (or costs) that are accounted two times under different forms. The largest attention must be paid to it, because biasing the result and very common in SM policies, and CBA forces to pay such attention. Examples are the accessibility (see below), the way taxes are accounted, the effect on land prices, the way users’ benefits are calculated  and many more.
Accessibility is not listed in the table because already included in two separate terms. On one side, it is the inverse function of generalised cost, implicitly calculated in the users surplus. The other “form” of accessibility is related to the positive externality of getting nearer to markets or workforce. This effect is usually treated in CBAs as a “wider benefit”, listed in the last row. The two effects (the internal, perceived one and the external one) must not be associated also with a further measure of “accessibility” to avoid double counting in favour of projects. Similarly, “accessibility” must not be confused with the network effect, that economics treats as a positive externality .
That of wider benefits is a complex and important issue.13 It is widely recognised that under some conditions the direct transport benefits (e.g. users’ surplus) do not fully represent all the benefits associated to a scheme or a policy. The main external (or wider) benefits are the macroeconomic ones, namely agglomeration economies ([80–83]), increased long term productivity  and labour pooling . For the conditions ruling the existence of such benefits, see the same sources. In general one can say that they are relevant in case of true capacity constraints/bottlenecks/missing links and/or in developing countries. A rule of thumb for European economies says that these effects account for 0% to 30% of direct benefits, according to the type, place and size of project.
Land use associated benefits are among the most difficult to manage. Apparently, to a scheme that increases land prices should be associated a further benefit apart direct ones. Actually, this is often configuring a double counting. For example, an increase in estate prices due to a car free area can be added because representing the willingness to pay of citizens for a quieter area, but in this case noise reduction must not be accounted. To the contrary, all things equal, if the increase of prices is generated by a new metro station, all relevant benefits except externalities are already in the users surplus: the house costs more exactly because more accessible. In other words, one should always recognise when land price increase is a net benefit or is the dual of another benefit already considered. In addition, the analysis is complicated by the time dimension: direct benefits over time transform into land rent .
When analysing policies, the issue of distribution of impacts is more and more relevant. CBA allows to inform the decision-maker on the distribution of quantifiable impacts by means of a distributional matrix, or Kaldor-Hicks matrix (see Table 6 below and [85–87]). Such a matrix excludes non monetary aspects, that must be considered apart.
Costs and benefits to be considered in SM policies
Public sector costs*
Public sector benefits
Users costs and benefits
Introduction of constraints
Attitudinal and behavioural measures (car sharing, car pooling, journey planning, DRTS)
(PT provision, subsidies to the policies)
reduction of peaks, reduction in PT supply
transport cost savings, discomfort of sharing/pooling
possibly less congestion
investment, running costs
(reduction of PT costs)
(land price variations, net of double counting)
travel time, frequency, tolls and fares. In some cases: generated demand
all external costs of demand shifted from private to public transport
sub-case: cycle routes, pedestrian areas
longer travel time, car cost savings, more health
all external costs of demand shifted from private to cycling
Management of the infrastructure
(depends on the policy, but marginal)
variation of travel time for car and PT users, fares.
(modal shift). Different use of space
sub-case: traffic management, ITS
longer/shorter travel time
existing: effect on safety, pollution and congestion. But possible modal shift to private
sub-case: restrictions (segregate lanes, car free areas, …)
reduction in PT cost
longer (for car users)/shorter (for PT users) travel time
modal shift: safety, pollution and congestion
sub case: parking control & pricing
fares, (less parking time)
modal shift & existing: safety, pollution and congestion
(investment, running costs)
time benefits for better routing
(safety and congestion)
(investment, running costs, more PT)
tolls and fares; (more efficient PT provision)
tolls and fares, more/less parking space available, increase in generalised cost for those moved to PT
modal shift: safety, pollution and congestion. (Increase of sprawl). (More city space)
sub case: fare segmentation
(variation of subsidies to cover the PT financial gap)
(variation of subsidies to cover the PT financial gap)
existing and new users surplus: positive if subsidies, zero if perfect price discrimination.
(in case of modal shift only)
Land use measures
(reduction of PT costs)
modify the costs and revenues of land developers
modification of city use in the long run
less congestion and other externalities in the long run
The last column of the table underlines a key concept: the introduction of a constraint by a policy. Some policies are additive: e.g. the introduction of a new technology into the market. Other policies are constraining the existing conditions: e.g. a new technology becomes compulsory. In the first case, the policy must be assessed only by looking at how demand responds to the new situation (more demand, less costs, etc.). The second case also introduces, at least for part of the users, a constraint that translates into a cost. For example, the adoption of a compulsory environmental standard for truck emissions causes enterprises to purchase new vehicles even if the existing ones are not yet amortised.
CBA is then capable not only to assess public expenditure, that is its “traditional” use, but also to explicitly take into consideration the private costs associated with the introduction of new constraints. The same sustainability goal can be obtained through different public decisions and actions (e.g. emissions reduction can be obtained with new technologies, public transport expansion, restrictions to cars or city areas). Some involve a public subsidy, some others are without subsidy, but involve increasing private costs. CBA can clarify losers and winners and the net balance, but can also be used to fine tune the policy. For example, car free areas are more costly in sprawled or public transport deficient areas than in compact areas already infrastructured.
Comparing MCA and CBA
Primarily ex ante and possibly ex-post
Ex post; ex ante
Primarily large scale
Quantifiable and measurable effects (“hard”)
Perception of the effect, including “soft” ones
Single criterion and result
Multi(ple) criteria and indicators
Output (support to decision makers)
Input (indications from decision makers)
Strengths and weaknesses of MCA and CBA
Rigour and rationality
Participation and legitimacy
Allows qualitative measures
It is a “common language”, known and used worldwide
Easy communication of the results
Independent from judgements
Difficult technique, expensive.
Potential ambiguity, subjectivity
Need of many data, sometimes hardly available
Some components of arbitrariness, especially in the perception of public costs vs. private benefits
Practically impossible to assess “soft” effects (beauty, personal beliefs, attitudes)
Risk of double counting
Equity is not a goal directly assessed*, but left to decision maker
Lack of clarity, consistency, accountability
Referring to when the analysis can be conducted, CBA is more used as an ex-ante tool, while MCA is adopted for both ex-ante and ex-post assessments (Table 5).
The application of the two methodologies is then often suggested by the size of the project or of the policy to be evaluated: at a large scale, i.e. when public and private costs are consistent, CBA is necessary; MCA appears instead useful at the micro-scale, where all the stakeholders can be easily individuated and consulted and are able to express informed opinions on their priorities.
If the aim of CBA is social expenditure’s efficiency, the aim of MCA is to find the better way to get the final target, if conducted ex-ante, or the level of performance reached - that is the proper effectiveness- when the evaluation is ex-post.
Furthermore, MCA seems to be better in measuring intangibles and soft impacts than CBA; actually, it uses more than one criterion introducing qualitative aspects in the analysis. CBA, instead, translates all the effects in a common numerary and expresses them into a single aggregate measure. Finally, if the CBA is used to generate a ranking of alternatives that will help the decision maker in choosing (that may obviously differ from the CBA one), the MCA takes the personal ranking of the decision maker as an input and weights it together with other stakeholders’ ones.
It is, therefore, clear that the two approaches are not totally alternative to assess the same object. Rather, especially according to some aspects, the two look completing each other and the joint use can add value to the assessment.
Broadly speaking, CBA appears more rigorous, transparent and formal [33, 89], providing a rational framework for assessing projects and clear results easy to be communicated and, thus, shared and engaged ; nevertheless, the technical procedures for applying is much more complex , and expensive ; the monetization process is questionable for some intangible aspects (among the others, [15, 16, 17, 53, 91]).
On the other hand, MCA, in a more informal process, allows every stakeholder to be heard about the action to be realized , enlarging the “democracy” in terms of public debate ; furthermore, it could be useful to settle possible arguments (,) and to get preferences and priorities revealed (Lee et al. . In this case, a thoughtful question may be posed about the way of weighting different opinions , and the consequent accountability, transparency and coherence of the method .
In the assessment of public policies, the main added value of CBA in this field, not treated in a sufficiently formalised way in other approaches, is the evaluation of the outcome in terms of public expenses. In other words, when a policy is not involving significant public expenditure (e.g. education campaign to promote bicycling and walking) or where public expenditure and costs in general are dominated by less tangible effects (e.g. a reorganisation of public spaces of a neighbourhood to promote bicycling and walking), MCA can already provide consistent answers. On the contrary, when significant public costs exist (e.g. the expansion of public transport network) or when a costless policy actually inflicts extra-costs to citizens in the name of SM (e.g. the introduction of a large car-free area), it is necessary to evaluate the outcomes not in absolute terms, but in terms of costs or efforts. CBA allows, then, to consider the opportunity cost of a policy , i.e. the value of alternatives use of public money spent for a certain policy. To make a simple example, if two policies are both generating a +5% patronage of public transport, but one generates a cost to the public administration or to the car users and the other obtains the same benefit without generating costs, the judgement on the two policies must be different and the second must be chosen (it is, for example, the case of constraints policies or supply-side policies vs. education-based policies).
Applicability of MCA and CBA to assess SM actions
Transport strategies for reducing car use:
- Car sharing
- Car pooling
- Bike sharing
Not completely catching all benefits
Regulations (restrictions, traffic calming, etc.)
Not completely catching all trade offs
Public Transport system strategies:
- Frequency/capacity increase
Not completely catching all trade offs
- Betterment of intermodality
Not completely catching all trade offs
- New infrastructures
Not completely catching all trade offs
Bicycle and pedestrian paths
Not completely catching all benefits
Parking planning: Park&Ride
Funds for reducing car use
Not completely catching all trade offs
Involvement in policies and programs for SM
Accessibility to information and inclusion in decision making processes about SM
Campaigns of communication and information about SM
Innovative approach to project and technology use for SM
A point is however extremely important. The two methods do not provide the same information in terms of decisions. MCA “summarises” the stakeholders’ implicit priorities, possibly weighting stakeholders in terms of importance in the decision, while, CBA is the translation into a number of the social welfare function, measured independently using physical measures, models and literature values. The output is not the decision, but one of the inputs to the public decision maker when taking the decision.
on the micro-scale, MCA is commonly used, ex ante, and ex-post at the urban or suburban scale, while CBA is much more adopted for infrastructure projects at a bigger scale, as an ex ante approach;
on SM many difficulties arose when measuring all relevant impacts of a transport strategy (either policy or project) in monetary terms, concerning intangible aspects, thus leading to the expansion of monetary evaluation (unique criterion) to evaluation methods using more than one criterion, e.g. multi-criteria methods ().
It is clear that a traditional MCA approach has the risk to fail in evaluating the real trade offs generated by the policy. To the contrary, the traditional CBA approach is not catching all the effects involved in SM policies, where intangible aspects are not secondary, but dominating. This is particularly true when the problem is related to the peculiar case of small scale.
It can, therefore, be concluded that as concerns the specific case of SM assessment at the neighbourhood scale, MCA and CBA might be integrated to fully consider all relevant actions available. Specifically, MCA is a good tool for the indirect actions (where soft and indirect effects prevail) and to be applied at a suburban scale. CBA, on the contrary, better works for the direct strategies (where monetizable costs and benefits prevail), besides, it better takes into account the external costs, which are very important at the urban dense areas, and can no longer be neglected.
developing CBA and evaluate the soft effects with MCA;
developing a MCA for a broad screening of options and evaluate public expenditures and consumer surplus with CBA.
The joint use of the two methodologies can guarantee a deeper analysis (and knowledge) of priorities and impacts of an action, always remaining “beyond the market” . However, it is worth observing that the concurrent use of the two techniques may even drive to contrasting results among the alternatives (see, for example, ). On the other hand, the joint use of the techniques, where the focus of each one is clear and well defined, does not lead to distortions in the decision, lowering ambiguity and misleading on the hierarchy/prioritization.
Specifically, at the neighbourhood scale, the joint MCA - CBA can be easily conducted in order to assess the SM level; furthermore, it can create a stronger and aware participation to the decision making process, spreading out knowledge, not only about the goal, but also about the alternative solutions to problems and their costs.
This conjoint assessment procedure allows a neighbourhood to choose among different SM options by referring to its own (revealed) preferences (MCA), while being aware of budget constraints and externalities (CBA). This means that, as an economic subject, the neighbourhood is showing its own “willingness to pay” to reach the SM goal.
Therefore, further research could, from one side, develop more deeply the methodological framework for selecting indicators and for developing a joint evaluation methodology; from the other side, focus on the empirical analysis, that is the implementation of the conjoint methods to scenarios, or real cases.
A problem of the REGIME method is the lack of the relevant condition of independence from irrelevant alternatives: an irrelevant alternative can change the rank of the relevant ones. This limitation is particularly severe when assessing public policies.
Among the most recent and complete official guidelines, it can be mentioned the one used by the European Commission DG Regio ([92, 94]). Important are, also, some national guidelines ([(DfT 95] for the UK; Eijgenraam et al  for the Netherlands; CEDEX  for Spain, etc.) or mode specific guidelines (i.e. the EIB  for rail investment).
It cannot be denied that a methodological framework is needed to choose the indicators (see, among the others, , with their ELASTIC procedure or the distinction between impact/effect performance and outcome as types of indicators, developed by UN ).
Data availability always plays a key role (, UN 2011), and at the suburban scale it is rather poor. That is why, Maltese et al. [54, 65] in their ex-post evaluation chose only few SM actions in order to observe whether they are present and to which extent. Indeed, more in-depth analysis of efficiency and effectiveness of transport and land use policies on SM appears quite hard to afford at the suburban scale.
It is worth mentioning that the direct SM strategies do not fit together neatly with transport policy: the object could be transport issue, but for example parking planning or bike lanes do also involve land use planning policy.
To simplify: not only monetary, time and pollution savings in change of a lump sum investment, but lighter effects such as change in the long term behaviour of citizens, change in the use of the city, etc.
In Table 3 rows represent the type of stakeholder according to how benefits and costs must be calculated and not according to real world divisions (that may be more complex).
The table does not explicit the sign (i.e. which are costs and which are benefits) of those effects. For example, road tolls are both a cost for users and a benefit for infrastructure owner, so they must appear with opposite signs and disappear. Time can be typically a cost or a benefit according to which user and which policy is considered (e.g. in case of a new priority lane it is a benefit for bus users and a cost for car users, which lane becomes narrower).
For example, an action increasing environmental attitude of the citizens should be monetised by estimating, for example, the effect of less polluting car purchased in the long term.
- Codoban N, Kennedy CA (2008) Metabolism of neighbourhood. J Urban Plann Dev 134(1):21–31View ArticleGoogle Scholar
- Geerlings H, Stead D (2003) The integration of land use planning, transport and environment in European policy and research. Transport Pol 10:187–196View ArticleGoogle Scholar
- Choguill CL (2008) Developing sustainable neighbourhoods. Habitat International 32(1):41–48View ArticleGoogle Scholar
- ODPM (2006) The Bristol Accord, LondonGoogle Scholar
- Wheeler R (2009) Regions, megaregions, and sustainability. Reg Stud 43(6):863–876View ArticleGoogle Scholar
- Marshall S (2000) The potential contribution of land use policies towards sustainable mobility through activation of travel reduction mechanisms. Innovation 13(1):63–79Google Scholar
- Hull A (2008) Policy integration: what will it take to achieve more sustainable transport solutions in cities?. Transport Pol (15):94–103Google Scholar
- Zuindeau B (2006) Spatial approach to sustainable development: challenges of equity and efficacy. Reg Stud 40(5):459–470View ArticleGoogle Scholar
- Loukopoulos P, Scholz RW (2004) Sustainable future urban mobility: using ‘area development negotiations’ for scenario assessment and participatory strategic planning. Environ Plann 36:2203–2226View ArticleGoogle Scholar
- Banister D, Berechman J (2000) The economic development effects of transport investments, Paper presented at the TRANS-TALK Workshop, Brussels, November 2000Google Scholar
- Janic M (2003) Multicriteria evaluation of high-speed Rail, Transrapid maglevand air passenger transport in Europe. Transp Plan Technol 26(6):491–512View ArticleGoogle Scholar
- Macharis C (2004) The importance of stakeholder analysis in freight transport: The MAMCA methodology. Transport Eur 25(26):114–120Google Scholar
- Macharis C (2007) Multi-criteria Analysis as a tool to include stakeholders in project evaluation: The MAMCA method. In: Haezendonck E (ed) Transport project evaluation. Extending the social cost-benefit approach. Edward Elgar, Cheltenham, pp 115–131Google Scholar
- Tudela A, Akiki N, Cisternas R (2006) Comparing the output of cost benefit and multi-criteria analysis An application to urban transport investments. Transport Res Pol Pract 40(2006):414–423View ArticleGoogle Scholar
- Walker WE (2000) Policy Analysis: a systematic approach to supporting policymaking in the public sector. Journal of Multi-criteria Decision Analysis 9:11–27View ArticleGoogle Scholar
- Tsamboulas D, Yiotis GS, Panou KD (1999) Use of multicriteria methods for assessment of transport projects. J Transp Eng. September–October, pp.407–414Google Scholar
- Aldian A, Taylor MAP (2005) A consistent method to determine flexible criteria weights for multicriteria transport project evaluation in developing countries. J East Soc Transp Stud 6:3948–3963Google Scholar
- Saaty TL (1977) A scaling method for priorities in Hierarchical Structures. J Math Psychol 15:234–281MathSciNetView ArticleGoogle Scholar
- Saaty TL (1990) Multi-Criteria Decision Making: The Analytic Hierarchy ProcessAHP Series, vol 1. RWS Publications, PittsburghGoogle Scholar
- Roscelli R (2005), (ed) Misurare nell’incertezza, Celid, TorinoGoogle Scholar
- Diappi L, Bolchi P, Concilio G (2010) Assessing sustainability in urban design: the ANP (Analytic Network Process) approach, Fifth Congress of Italian Association of System Research, 14th–16th October, FermoGoogle Scholar
- Hinloopen E, Nijkamp P (1986) Qualitative multiple criteria choice analysis. The dominant regime method, Serie Research Memoranda, n.45. Free University, AmsterdamGoogle Scholar
- Nijkamp P, Blaas E (1993) Impact assessment and evaluation in transportation planning. Kluwier Academic, DordrechtGoogle Scholar
- HEATCO (2005) Developing harmonised European approaches for transport costing and project assessment. Deliverable 1: current practice in project appraisal in EuropeGoogle Scholar
- OECD, ECMT (2005) National systems of transport infrastructures planning. ECMT Round Table 128, Paris, 26–27 February 2004Google Scholar
- PIARC (2004) Economic evaluation methods for road projects in PIARC member countries. PIARCGoogle Scholar
- EVA TREN (2008) Improved decision-aid methods and tools to support evaluation of investment for transport and energy networks in Europe. Deliverable 1. Evaluating the state-of-the-art in investment for transport and energy networks. www.eva-tren.org.
- COM – The European Commission (2007) Greenbook 2007 – Towards a new culture for urban mobility. Commission of the European Communities, BrusselsGoogle Scholar
- World bank (1996) Sustainable transport: priorities for policy reform. World Bank, Washington DCView ArticleGoogle Scholar
- Persky J (2001) Cost-Benefit Analysis and the Classical Creed. J Econ Perspect 15(4):199–208View ArticleGoogle Scholar
- Farrell S, McNamara D, Caulfield B (2010) Estimating the Potential Success of Sustainable Transport Measures for a Small Town. Transport Res Rec (2163):97–102Google Scholar
- Beria P (2005) Effectiveness of mobility limitation policies against long term approaches in reduction of emitted pollutants. The Case of Milan Area, AESOP 2005 conference, Wien (Austria). http://aesop2005.scix.net/cgi-bin/papers/Show?_id=247
- Farrow S, Toman M (1999) Using environmental benefit-cost analysis to improve government performance. Environment 41:12–37View ArticleGoogle Scholar
- Heinzerling L, Ackerman F (2002) Pricing the priceless. Cost-benefit analysis of environmental protection. Georgetown Environmental Law and Policy Institute, WashingtonGoogle Scholar
- Hahn RW (2005) In defense of the economic analysis of regulation. American Enterprise Institute, WashingtonGoogle Scholar
- Turner K (2007) Limits to CBA in UK and European environmental policy: retrospects and future prospects. Environ Resource Econ (37):253–269Google Scholar
- Elvik R (2001) Cost–benefit analysis of road safety measures: applicability and controversies. Accid Anal Prev 33:9–17View ArticleGoogle Scholar
- Wijnen W, Wesemann P, de Blaeij A (2009) Valuation of road safety effects in cost-benefit analysis. Eval Program Plann 32:326–331View ArticleGoogle Scholar
- Rich J, Nielsen OA (2007) A socio-economic assessment of proposed road user charging schemes in Copenhagen. Transport Pol 14(4):330–345View ArticleGoogle Scholar
- Transport for London (2007) Congestion charging. Central London congestion charging scheme: ex-post evaluation of the quantified impacts of the original scheme. Prepared by Reg Evans, for Congestion Charging Modelling and Evaluation Team. <http://www.tfl.gov.uk> (29.06.07).
- Eliasson J (2009) A cost-benefit analysis of the Stockholm congestion charging system. Transport Res Pol Pract 43(4):468–480View ArticleGoogle Scholar
- Rotaris L, Danielis R, Marcucci E, Massiani J (2010) The urban road pricing scheme to curb pollution in Milan, Italy: Description, impacts and preliminary cost–benefit analysis assessment. Transport Res Pol Pract 44(5):359–375View ArticleGoogle Scholar
- Glaister S, Graham DJ (2005) An evaluation of national road user charging in England. Transport Res Pol Pract 39(7–9):632–650View ArticleGoogle Scholar
- Fellows NT, Pitfield DE (2000) An economic and operational evaluation of urban car-sharing. Transport Res Transport Environ 5(2000):1–10View ArticleGoogle Scholar
- Sælensminde K (2004) Cost–benefit analyses of walking and cycling track networks taking into account insecurity, health effects and external costs of motorized traffic. Transport Res Pol Pract 38:593–606View ArticleGoogle Scholar
- Börjesson M, Eliasson J (2010) The value of time and external benefits in bicycle cost-benefit analyses. Selected proceedings of the 12th WCTR, July 11–15, 2010 – Lisbon, PortugalGoogle Scholar
- Massé E (2005) Analyse économique de la rentabilité des filtres à particules sur les véhicules diesels neufs. Économie et Prévision (167) 2005-1:13–25Google Scholar
- Bollen J, van der Zwaan B, Brink C, Eerens H (2009) Local air pollution and global climate change: A combined cost-benefit analysis. Resource Energ Econ 31(2009):161–181View ArticleGoogle Scholar
- Lee J, Kang S, Kim CK (2009) Software architecture evaluation methods based on cost benefit analysis and quantitative decision making. Empir Software Eng (14):453–475Google Scholar
- Pompili T (2005) Valutazione economica di interventi complessi di trasformazione urbana: un metodo operativo, in Valutazione economica di progetti, piani e programmi complessi di trasformazione urbana, IRER, Regione Lombardia, MilanGoogle Scholar
- Damart S, Roy B (2009) The uses of cost- benefit analysis in public transportation decision-making in France. Transport Pol (16):200–212Google Scholar
- Diakoulaki D, Grafakos S (2004) Externalities of energy: extension of accounting framework and policy applications. Final Report on Work Package 4Google Scholar
- Tsamboulas D, Mikroudis G (2000) EFECT—evaluation framework of environmental impacts and costs of transport initiatives. Transport Res Transport Environ 5:283–303View ArticleGoogle Scholar
- Maltese I, Mariotti I, Oppio A (2011) An ex-post assessment of sustainable mobility: the case of European neighbourhoods, Territorio (59):51–58Google Scholar
- Campos Gouvêa VB, Rodrigues Ramos RA, de Miranda D, Correia S (2009) Multi-criteria analysis procedure for sustainable mobility evaluation in urban areas. J Adv Transp 43(4):371–390View ArticleGoogle Scholar
- Lautso K, Spiekemann K, Wegener M, Sheppard I, Steadman P, Martino A, Doming R, Gayda S (2004) PROPOLIS – Final Report, 2nd Edition, FinlandGoogle Scholar
- TRANSPLUS (2002) Analysis of land use and transport indicators, transport planning land-use and sustainability public deliverables D2.2 and D3. http://www.transplus.net
- PROSPECTS – Procedures for Recommending Optimal Sustainable Planning of European City Transport Systems Results (2004) Cities’ Decision-Making Requirements. http://www-ivv.tuwien.ac.at/projects/prospects.html
- Tzeng G, Lin C, Opricovic S (2005) Multi-criteria analysis of alternative-fuel buses for public transportation, Energy Policy, 33, pp. 1373–1383Google Scholar
- Yedla S, Shrestha R (2003) Multi-criteria approach for the selection of alternative options for environmentally sustainable transport system in Delhi. Transport Res Pol Pract 37:717–729View ArticleGoogle Scholar
- Cerreta M (2004) Strategie integrate di sostenibilità: le valutazioni ex-post per la costruzione dell’“alternativa ecologica. In: Fusco Girard L, Nijkamp P (eds) Energia, bellezza partecipazione: la sfida della sostenibilità. Valutazioni integrate tra conservazione e sviluppo. Franco Angeli, Milano, pp 420–459Google Scholar
- Cerreta M, Salzano I (2009) ‘Green urban catalyst’: An ex-post evaluation of sustainability practices, Proceedings REAL CORP 2009 Tagungsband, 22–25 April 2009.Google Scholar
- Fusco GL, Forte B, Cerreta F, De Toro P, Fabiana F (2003) L’uomo e la città. Franco Angeli, MilanoGoogle Scholar
- Nijkamp P, Oirschot G, Oosterman A (1993) Regional development and engeneering creativity: an instrumental comparison of science parks in a knowledge society, Research memoranda. Free University, AmsterdamGoogle Scholar
- Maltese I, Mariotti I (2011) Sustainable mobility in Europe: the role of participation at the neighbourhood scale. TeMA 4(4):35–46Google Scholar
- Gilbert R, Irwin N, Hollingworth B, Blais P (2002) Sustainable Transportation Performance Indicators (STPI) Project, Report for Phase 3. Centre for Sustainable Transportation, WinnipegGoogle Scholar
- Gilbert R, Tanguay H (2000) Sustainable transportation performance indicators project. Brief review of some relevant worldwide activity and development of an initial long list of indicators. The Centre for Sustainable Transportation, TorontoGoogle Scholar
- Gudmundsson H (2003) Sustainable mobility and indicator systems in transport policy. UNESCO, Blackwell Publishing Ltd, MaldenGoogle Scholar
- Litman TA (2003) Measuring transportation. Traffic, mobility and accessibility. ITE Journal 73(10):28–32Google Scholar
- Litman T (2007) Well Measured: Developing Indicators for Comprehensive and Sustainable Transport Planning. Victoria Transport Policy Institute (www.vtpi.org; www.vtpi.org/wellmeas.pdf)
- Litman T (2008) Sustainable Transportation Indicators: A Recommended Research Program For Developing Sustainable Transportation Indicators and Data, By the Sustainable Transportation Indicators Subcommittee of the Transportation Research Board, 10 NovemberGoogle Scholar
- Litman T (2011) Developing indicators for comprehensive and sustainable transport planning. Available at www.vtpi.org/sus_tran_ind.pdf
- Rassafi AA, Vaziri M (2005) Sustainable transport indicators: definition and integation. Int J Environ Sci Tech 2(1):83–96View ArticleGoogle Scholar
- Euromobility (2008) Lo mobilità sostenibile in Italia: indagine sulle principali 50 città, www.euromobility.org
- Joumard R, Gudmundsson H (eds) (2010) Indicators of environmental sustainability in transport: an interdisciplinary approach to methods, INRETS report, Recherches R282, Bron, France, (http://hal.archives-ouvertes.fr/hal-00492823/fr/)
- Yigitcanlar T, Dur F (2010) Developing a Sustainability Assessment Model: The Sustainable Infrastructure, Land-Use, Environment and Transport Model. Sustainability (2):321–340Google Scholar
- Holden E (2007) Achieving sustainable mobility: everyday and leisure-time travel in the EU. Ashgate, AldershotGoogle Scholar
- Mohring H (1993) Maximizing, measuring, and not double counting transport improvement benefits: A primer on closed- and open-economy cost-benefit analysis. Transport Research B 27(6):413–424View ArticleGoogle Scholar
- Mohring H (1972) Optimization and scale economies in urban bus transportation. Am Econ Rev 62(4):591–604Google Scholar
- Graham DJ (2006) Wider economic benefits of transport improvements: link between agglomeration and productivity. Imperial College London, LondonGoogle Scholar
- DfT (2006) Transport, Wider Economic Benefits and Impacts on GDP. Department for Transport, LondonGoogle Scholar
- DfT (2009) The Wider Impacts Sub-Objective. TAG Unit 3.5.14. Department for Transport Transport Analysis Guidance (TAG). Department for Transport, London (UK)Google Scholar
- Venables AJ (2004) Evaluating urban transport improvements: Cost-Benefit Analysis in the presence of agglomeration and income taxation, CEP Discussion Paper No 651. Centre for Economic Performance, LSE, LondonGoogle Scholar
- Ponti M, Scopel E (2010) Land Rent, Transport Policies and Building Constraints. Selected proceedings of the 12th WCTR, July 11–15, 2010 – Lisbon, PortugalGoogle Scholar
- Krutilla K (2005) Using the Kaldor-Hicks Tableau format for the teaching and practice of project appraisal and policy analysis. J Pol Anal Manag 24(4):864–875View ArticleGoogle Scholar
- Morisugi H, Ohno E (1995) Proposal of a benefit incidence matrix for urban development projects. Reg Sci Urban Econ (25):431–481, ElsevierGoogle Scholar
- Campbell HF, Brown RPC (2003) Benefit-cost analysis. Financial and economic appraisal using spreadsheets. Cambridge University Press, CambridgeView ArticleGoogle Scholar
- Kelly C, May A, Jopson A (2008) The development of an option generation tool to identify potential transport policy packages. Transport Pol 15(6):361–371View ArticleGoogle Scholar
- Damart S, Roy B (2002) L’analyse Coûts-Avantages, outil de concertation et de légitimation? Metropolis (108/109):7–16Google Scholar
- Sayers TM, Jessop AT, Hills PJ (2003) Multi-criteria evaluation of transport options—flexible, transparent and user-friendly? Transport Pol 10:95–105View ArticleGoogle Scholar
- Bristow AL, Nellthorp J (2000) Transport project appraisal in the European Union. Transport Pol (7):51–60Google Scholar
- DG REGIO (2008) Guide to Cost-Benefit Analysis of investment projects. Structural Funds, Cohesion Fund and Instrument for Pre-Accession, European Commission, Directorate General Regional PolicyGoogle Scholar
- Macharis C, De Witte A, Turcksin L (2010) The Mutli-Actor Multi-Criteria Analysis (MAMCA) application in the Flemish long-term decision making process on mobility and logistics. Transport Pol 17:303–311View ArticleGoogle Scholar
- Mairate A (2010) The rationale for economic evaluation in Europe: the case of EU Regional Policy, Cuadernos Económicos de ICE, No. 80(2010)Google Scholar
- DfT (2007) The NATA Refresh: Reviewing the New Approach to Appraisal. Department for TransportGoogle Scholar
- Eijgenraam CJJ, Koopmans CC, Tang PJG, Verster ACP (2000) Evaluation of infrastructural projects; Guide for cost-benefit analysis. CPB NEI, RotterdamGoogle Scholar
- CEDEX (2010) Guide on economic evaluation of transport projects, Centro de Estudios y Experimentación de Obras Públicas (CEDEX). Ministerio de Fomento, Gobierno de EspañaGoogle Scholar
- EIB (2005) RAILPAG - Railways Project Appraisal Guidelines, European Commission and European Investment Bank, available at: www.railpag.com
- Voogd H (1983) Multicriteria evaluation for urban and regional planning. Pion Ltd., LondonGoogle Scholar
- Castillo H, Pitfield D (2010) ELASTIC – A methodological framework for identifying and selectingsustainable transport indicators. Transp Res Part D: Transp Environ 15(4):179–188View ArticleGoogle Scholar
- UN (2011) Sustainable Transport Evaluation, Developing Practical Tools for Evaluation in the Context of the CSD Process, UN - Department of economic and social affairs, background paper No.10Google Scholar
- Næss P (2006) Cost-benefit analyses of transportation investments: neither critical nor realistic. Journal of Critical Realism 5(1), London (Great Britain)Google Scholar
- Vickerman R (2007) Recent evolution of research into the wider economic benefits of transport infrastructure investments, Discussion paper 2007-9, OECD and International Transport ForumGoogle Scholar
- OECD and ITF (2008) The wider economic benefits of transport: macro, meso and micro transport planning and investment tools, Discussion paper 2008-06, OECD and International Transport ForumGoogle Scholar
This article is published under license to BioMed Central Ltd. Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution and reproduction in any medium, provided the original author(s) and source are credited.