Review of remote sensing methodologies for pavement management and assessment

Abstract

Introduction

Evaluating the condition of transportation infrastructure is an expensive, labor intensive, and time consuming process. Many traditional road evaluation methods utilize measurements taken in situ along with visual examinations and interpretations. The measurement of damage and deterioration is often qualitative and limited to point observations. Remote sensing techniques offer nondestructive methods for road condition assessment with large spatial coverage. These tools provide an opportunity for frequent, comprehensive, and quantitative surveys of transportation infrastructure.

Methods

The goal of this paper is to provide a bridge between traditional procedures for road evaluation and remote sensing methodologies by creating a comprehensive reference for geotechnical engineers and remote sensing experts alike.

Results

A comprehensive literature review and survey of current techniques and research methods is provided to facilitate this bridge. A special emphasis is given to the challenges associated with transportation assessment in the aftermath of major disasters.

Conclusions

The use of remote sensing techniques offers new potential for pavement managers to assess large areas, often in little time. Although remote sensing techniques can never entirely replace traditional geotechnical methods, they do provide an opportunity to reduce the number or size of areas requiring site visits or manual methods.

1 Introduction

The importance of incorporating remote sensing into geotechnical and geological engineering practices has long been recognized by the United States (US) National Research Council [95]. Recently, many US departments of transportation are integrating more remote sensing techniques into their standard methodologies for pavement management and assessment. Futhermore, the integration of geospatial tools and techniques in transportation management is a growing research agenda [99]. However, many geo-transportation engineers do not have an educational or practical background in remote sensing and many in the remote sensing community are unaware of the specific needs of geo-transportation engineers. Therefore, this paper is provided as a bridge between these two disciplines by serving as a reference tool as well as a way to initiate interdisciplinary research and practice collaborations. We discuss commonly used, traditional geotechnical methods and present an overview of recent remote sensing applications which may augment or be used as alternatives.

We define “remote sensing” as any surveying method which does not require physical contact with the road surface or subsurface. This paper does not intend to imply that remote sensing may be used to replace all traditional in situ methods. However, if used appropriately, remote sensing may provide tools for rapidly surveying broad areas. Once problem areas are identified, specific conditions may then require the use of traditional road assessment methods.

Because remote sensing is capable of rapidly collecting information over wide areas, it has become a valuable method for assessing damage to infrastructure and buildings following major disasters. Using remote sensing for the analysis of road structure or accessibility following disasters is a new research agenda.

1.1 History of roads and the need for assessment

Unlike the stone roads constructed in ancient times, roads today are not designed or constructed to last forever, mainly for economical reasons. In most US states, roads are typically designed to last 15 to 20 years. Though, with frequent and proper maintenance, the design life may be extended considerably [84]. Typically, the cost of reconstruction of a deteriorated road due to lack of maintenance may be more than three times the cost of preserving a frequently maintained road [1]. Road conditions are an important factor in the US economy and leading civil engineering institutions, such as the American Society of Civil Engineers (ASCE), continue to produce articles regarding the need to improve roads and other infrastructures. According to [1], currently half of the major roads in the US are considered in poor condition with almost 25 % of roads in urban areas (and in some areas even up to 60 %) considered poor. Researchers such as [119] have been reviewing the conditions of America’s highways since 1983 to provide awareness to the general public and legislators.

The cost of maintenance and rehabilitation is high. In 2008, an estimated $182 billion were spent in the US on capital improvements and maintenance of federal highways.¹ Although billions are spent annually, many consider this insufficient. For example, the ASCE currently gives the nation’s transportation infrastructure (which includes not only roads and bridges, but dams, rail, levees, etc.) an overall grade of D (on a traditional grading scale ranging from A-F) and estimates $2.2 trillion in improvements are needed.²

The development of road and bridge inspection and maintenance standards were developed in the US following the collapse of the Silver Bridge in 1967. In 1971, the National Bridge Inspection Standards (NBIS) were implemented as a result of the Federal-Aid Highway Act of 1968.³ The development of a rating method for pavement resulted in the US Army Corps of Engineers Pavement Condition Index (PCI) which “measures pavement structural integrity and surface operational conditions” which are “calculated based on measured pavement distress types and severity levels” [113]. More recently, in 1987 the US Department of Transportation’s Strategic Highway Research Program sponsored the Long-Term Pavement Performance Program (LTPP) to identify, collect, and catalog pavement defects and signs of deterioration [87].

A pavement’s condition is assessed from data which measures information such as the rideability, surface distress, structure, and skid resistance of the road [57]. Many of the methods utilized for the NBIS, PCI, and LTPP require point data gathered in situ. For example, a measurement of pavement condition using the PCI requires a manual survey and application of the American Society for Testing and Materials (ASTM) standards (ASTM standards are used to promote health and safety as well as the reliability of products, materials, and systems⁴), while the Distress Identification Manual for the LTPP provides descriptions of all types of distresses such as cracks, potholes, rutting, and spalling in flexible and rigid pavements as well as methods for measuring these distresses [87].

Because road networks in Europe and the US are so extensive, it is not feasible to use traditional approaches to survey all existing roadways for their rideability and integrity of road structure. Remote sensing methods offer tools to replace or complement existing traditional methods and can serve many needs of transportation civil engineers. In addition to the difficulties associated with creating a comprehensive evaluation of the over 6,000,000 km of roads in the US from point data, other factors also restrict frequent, cost effective, and comprehensive road evaluations. Some of these limiting factors include time (roads need to be closed off during inspections causing transportation disruption), site work on highways can be hazardous for inspectors, manual collection methods which often require trained and experienced inspectors, and the use of destructive techniques. Also, many inspections are descriptive in nature making comparative measuring difficult.

Remote sensing techniques provide alternative methods for transportation assessment along with high spatial and temporal resolutions. These techniques can be implemented from various platforms, including moving vehicles, unmanned aerial vehicles (UAVs), airplanes, and satellites. Along with multiple platform options, sensors use different parts of the electromagnetic spectrum and contribute to the identification and the measurement of the surface and subsurface defects. These techniques offer non-destructive evaluation methods as compared to traditional procedures such as coring and field surveys. The use of remote sensing in transportation research is becoming an important and economically advantageous area of exploration.

In addition, the utilization of remote sensing methods is not limited to the identification and analysis of pavement defects and distress from weathering or service loads. There are many applications, such as tasking data collection from air- and space-borne platforms, which allow for regional scale identification of destruction during and after natural or anthropogenic disasters. Currently, the utilization of multi-source and multi-spectral data can provide enhanced identification of infrastructure destruction, as well as timely information regarding the trafficabililty of road networks after a disaster.

2 Road types and profiles

For most people, roads are just a layer of asphalt or concrete that is constructed over dirt (soil) to create a smooth surface to allow vehicular traffic. In reality, roads consist of several layers of material selected, designed, and constructed following specific US Federal and State design and material guidelines or specifications. Roads are generally categorized as unpaved or paved with paved roads typically classified as flexible, rigid, or composite systems. The subsurface layer varies with road type and plays a major role in the performance of the road [60]. In order to assess road conditions, it is important to understand typical road profiles.

2.1 Unpaved roads

Unpaved roads are typically constructed using a mixture of gravel placed and compacted over finer-grained soil such as clay or silt (or mixtures of these soils) (Fig. 1a). The finer-grained soil may be naturally deposited as part of the geological cycle or constructed as a fill as part of an artificially constructed structure such as an embankment or on top of an earth retaining structure. These finer-grained soils form the foundation of the roadway and are referred to as the subgrade [72]. The thickness, gradation, and type of gravel placed over the subgrade will vary based on the availability of the material close to the construction site as well as the subgrade type. If the subgrade consists of very soft soils, then a gravel with a maximum grain size is used to minimize the total deflection (rutting). If the size of the aggregate becomes too coarse, additional finer grained aggregate is mixed in with the coarser aggregate to fill voids and create a smoother surface. The thickness of the gravel layer is usually selected based on the local experience, although there are generally accepted unpaved road design methodologies [43]. It should be noted it is not uncommon to have gravel layers above subgrade in excess of 1m if the subgrade or the gravel are not of high quality.

Fig. 1

Profiles of unpaved, flexible, and rigid pavements

2.2 Paved roads

Paved roads are typically categorized as either a flexible or rigid pavement system. Sometimes, as part of the reclamation, the old road is not completely removed prior to construction of the new road and is referred to as a composite pavement [60]. The major difference between flexible and rigid pavement systems is the application of a bituminous surface layer (e.g., asphalt layer) in a flexible pavement or a Portland cement concrete layer in a rigid pavement system. In general, regardless of the type, pavement systems are constructed with the highest quality materials on the top where traffic stresses are greatest [60]. The thickness of the layers within the pavement system will typically decrease as constructed over subgrade due to the increased cost of the materials.

Following the subgrade layer is the application of a subbase layer. This layer is constructed to provide foundational support for the subsequent, higher layers if the subgrade is insufficient. The subbase is constructed by one of the following methods: (1) physically improving the subgrade with compaction and placing a coarse aggregate over the existing soil; (2) removing a portion of the soft subgrade and replacing it with more suitable soil; (3) adding chemical additives into the ground followed by compaction. The materials used for the subbase layer are similar to the materials used for unpaved roads but it is important to note, for approximately the last 20 years, transportation engineers also commonly use materials other than natural soils. Sometimes the soil will be reinforced with fabric-like materials such as woven or nonwoven geotextiles or materials resembling plastic (e.g., geogrids or geocells) [32, 67, 132]. Additionally, the natural soil can be completely replaced with recycled materials (e.g., industrial by-products such as foundry sand, foundry slag, bottom ash, or fly ash) [122]. The thickness of the subbase layer is usually constructed in the order of 450-600 mm but will vary based on the properties of the subgrade.

The base layer serves as the drainage layer for the pavement system. It is commonly constructed over the subbase but may be placed directly over the subgrade if the subgrade soils are classified as competent for road construction [60]. It is built using a high quality aggregate containing very few or no-fines [72]. It is also possible to use recycled materials in the base layer such as a recycled concrete aggregate [14, 137]. The typical thickness of the base layer may range between 100-300 mm for flexible pavement systems and up to 500 mm for rigid pavement systems.

For flexible pavements, the layers above the base layer consist of (from the bottom up) a binder course and a surface course (Fig. 1b). The binder course consists of a mixture of larger aggregates and asphalt and is typically constructed to be between 50-100 mm thick. The surface course is the top of the pavement and is usually constructed from dense asphalt. As the crown of the pavement system, this layer must be constructed to resist distortion under traffic, be reasonably waterproof, smooth, and provide skid resistance. On rigid pavements, the layer above the base layer typically consists of 150-300 mm thick Portland cement concrete (Fig. 1c). The surface of the rigid pavement is much stiffer than the surface of the asphalt pavement and is customarily constructed directly over the base course (sometimes without having a subbase layer underneath). Although the concrete for rigid pavements is constructed in several different ways, these types of pavement systems will contain some form of reinforcement elements such as dowels, wire mesh, or deformed bars within the concrete.

Composite pavement is typically a combination of both flexible and rigid pavement. Usually, concrete is used at the bottom of the two layers, providing a strong foundation to support heavy traffic with the asphalt on top providing a smooth riding surface. As with other pavement systems, these types of systems may also include a base layer depending on the subgrade conditions. Due to the high cost of constructing these systems, composite pavements are limited to less than 1 % of the paved roads in the US [60].

3 Common road defects

Roads are considered problematic typically when they start to indicate issues related to their (1) structural adequacy, (2) skid resistance, or (3) surface defects. Some of these properties are more suited for remote sensing evaluations than others.

3.1 Structural adequacy

Structural adequacy is associated with the load transfer efficiency of the road and is evaluated using measured deflections inflicted at the surface of the pavement. The deflections are created by applied loads such as static or slowly moving loads (e.g., Benkelman beam, California travelling deflectometer, and LaCroix deflectometer), steady-state vibration (e.g., Dynaflect and road rater), or impulse loads (e.g., falling weight deflectometers). The measured deflections are used to backcalculate elastic moduli or the load-transfer efficiency of the subsurface layers. Predicting this type of behavior via remote sensing, without being able to apply pressure to the surface, is difficult.

3.2 Skid resistance

Skid resistance is a property of the pavement which creates enough surface friction for vehicles to maintain control, especially during wet conditions. Although skid resistance is also a function of the driver and vehicle characteristics, surface conditions such as bleeding or polished asphalt or smooth macro-texture are used as indicators to identify the potential for skid resistance hazards. Skid resistance of a road is typically measured with a locked wheel trailer procedure where the trailer is pulled at a certain constant speed while the braking system of the test tire is actuated to lock the tire on a wet road surface.

Recently, remote sensing has been applied to measure the macro and micro-texture of the surface. [138] used multiple laser scanners to identify surface macro-texture at a 1 mm resolution collected at highway speeds. [21] used spectral and fractal analysis to identify micro-texture changes due to a differential loss of mineral constituents from tire polishing. [83] illustrate how 3D photogrammetry can capture micro-texture changes from polishing.

3.3 Surface defects

Surface defects are visible indicators of road serviceability and are closely related to roughness, which is often utilized for road condition evaluations. There are a variety of available remote sensing applications for the identification, measurement, and classification of surface defects and thus, also to provide estimations of road roughness. The following subsections describe the usual features associated with surface defects that may be identified with remote sensing methods.

3.3.1 Unpaved roads

Below is a summary of the most common visible defects/deformations which typically affect unpaved road performance [8, 41, 44, 60, 96, 104, 125, 133].⁵

• Potholes: Bowl-shaped holes caused by the movement of loose surface material under traffic loads. They become problematic if their depth and diameter becomes greater than 25 mm and 200 mm, respectively.

• Rutting: Longitudinal deflections along the wheel-path caused by permanent deformation or compaction of road material under traffic loading. Unpaved roads constructed over a subgrade with a high clay content or with minimal surface coarse aggregate are prone to rutting in wet conditions.

• Corrugations: Evenly spaced transverse ridges caused by traffic actions in conjunction with lose of aggregate. They often occur in areas with heavy acceleration and deceleration traffic actions.

• Erosion and gravel loss: This occurs from a sweeping action of traffic or free flowing water across road surface. It may severely alter the cross-section of the road causing safety concerns and poor rideability.

• Pulverization: A break down of surface aggregate particles under traffic load creating excessive dust with rolling wheels. Although pulverization may not hinder the riding quality of the road surface, it may create safety hazards and discomfort both to the drivers and in areas within the vicinity.

3.3.2 Flexible pavement

Below is a summary of the most common visible defects/deformations which typically affect flexible pavement performance [27, 41, 60, 96, 104, 112, 125].

• Cracking: There are three types of cracking common to flexible pavement: surface, fatigue, and movement (term used for the purpose of this paper) cracking.

  Surface cracking is associated with aging and deterioration of the surface bituminous layer due to shrinking and hardening. It is not associated with applied load and may appear along the full-width of the pavement. Thermal cracking, a subset of surface cracking, is common in northern regions of the US where temperatures can fall below −23 °C. Thermal cracking forms when the thermal stress on the pavement is greater than the fracture strength. Thermal cracking may also occur in milder climates if the asphalt becomes hardened due to aging or if the road was constructed with hard asphalt.

  Fatigue cracking is associated with traffic loading and appears along the vehicle wheel path. It is often associated with deformation along the asphalt. It is also referred to as alligator cracking because it resembles the skin of the alligator or a chicken-wire pattern. Early signs can be detected from observations of fine parallel longitudinal cracks along the wheel-paths.

  Movement cracking is associated with the movement of the subsurface layers such as the subgrade, concrete slab below the asphalt, culvert, or bridge joints. It typically appears transverse or longitudinal and follows the dimensions of the problematic area underneath the surface.

• Potholes: Bowl-shaped holes similar to those in unpaved roads, typically form as a result of untreated cracks. They are problematic if depth and diameter becomes greater than 25 mm and 150 mm, respectively.

• Rutting: These surface deformations occur along the wheel-path as similarly observed in unpaved roads. They are caused mainly by the deformation of the subsurface layers as a result of the surface traffic load propagating to subsurface layers.

• Swelling: An upward bulge on the pavement surface usually caused by frost action or by swelling subgrade soils. Swelling can appear as a localized bulge or a long gradual wave.

• Shoving: These defects are similar to rutting, however, they typically occur in areas where vehicles frequently stop and start. They are result of shear forces induced by traffic loading and form as localized longitudinal or transverse displacements.

• Raveling: This is the result of traffic abrasive action and is indicated by a progressively damaged surface downward into the pavement layers, such as the binder course, and aggregate loss within the binder course.

• Bleeding of asphalt: Shiny black surface caused by liquid asphalt typically migrating in hot temperatures along the pavement surface. It has a large impact on skid resistance of the asphalt.

• Polished asphalt: Wearing off of the sharp edges in the surface aggregate from traffic. It results in a smooth slippery surface and has a large impact on skid resistance of the asphalt.

As a result of some or all of these defects, the flexible pavement may lose its smoothness (become too rough), skid resistance, macro-texture (ability to drain under wet conditions), and overall rideability quality.

3.3.3 Rigid pavement

Below is a summary of the most common visible defects/deformations which typically affect rigid pavement performance [22, 26, 34, 36, 41, 60, 93, 134].

• Cracking: In general, there are four types of cracking in rigid pavement: surface, durability, cluster, and diagonal cracking.

  Surface cracking is associated with aging and deterioration of the surface concrete layer and does not protrude deeply into the concrete slab. It may form as a series of random cracks, longitudinally parallel to the pavement centerline, or pop-outs of small pieces of pavement broken loose from the surface.

  Durability cracking forms adjacent to joints, cracks, or free edges of the pavement and is initiated at the intersection of cracks and a free edge. It usually appears as closely spaced, crescent-shaped, dark colored, hairline cracking. It is mainly attributed to the response of the material properties to freeze-thaw cycles and aggregate pore structure.

  Cluster cracking is a closely spaced transverse cracking occurring in groups of three or more with spacing ranging between 150-600 mm. This is more of a characteristic of continuously reinforced concrete pavements and is typically associated with changes in conditions below the surface, such as settlement within subsurface layers, poor drainage conditions, and high base friction. However, it may also form as a result of inadequate concrete thickness, lack of concrete consolidation, and construction of concrete during high temperatures. It usually occurs early in the life of the pavement.

  Diagonal cracking indicates an existing foundation problem (settlement or expansion) and forms in a direction oblique to the pavement centerline.

• Blow-ups: A localized upward movement of the concrete pavement surface at cracks or joints typically occurring in high temperatures and precipitation. They occur in older systems where the expansion space within the concrete pavement is insufficient for expansion. Depending on the magnitude of the blow-up, the road may have to be closed to traffic.

• Faulting: Created by a movement along the joint or a crack creating an elevation difference. The name is taken from the movement observed in nature after earthquakes, however, the cause of this type is not typically associated with earthquakes (although they may also form after earthquakes). Faulting occurs when the concrete slab losses its support due to erosion or settlement of the subsurface layers. It is one of the most prominent defects and has a direct impact on road rideability.

• Spalling: Breaking, cracking, or disintegration of the slab edges within 0.6 m of a joint or crack. Spalling is generally associated with a surface weakness within the concrete but if allowed to progress and deepen, will be an indicator of a structural weakness within the concrete.

• Punch-outs: An area enclosed by two closely spaced transverse cracks, a short longitudinal crack, and the pavement edge (resembling a box cut out on the edge of the pavement). It typically initiates from traffic loading of the transverse cracks and is also aided by corrosion of the steel within the concrete.

• Pumping: This results from water seeping into the pavement system or ejecting out of the system through the cracks or joints. In some cases it is detectable by deposits of fine material left on the pavement surface. It is caused by inadequate concrete slab thickness and erodible underlying layers.

• Joint seal damage: This results from joint deterioration, enabling a significant amount of water to infiltrate into the joint from the surface, weed growth at the joint, or intrusion of particles into the joint. It may lead to development of closely spaced transverse cracks or large numbers of interconnected cracks near the joint.

As for the flexible pavements, based on these defects the road may show low rideability quality or eventually be closed to traffic.

4 Traditional assessment of road surface defects

Many road authorities still utilize methods requiring in-person “walk and look” measurements while others use mechanical devices to measure certain surface defects. Manual walking surveys may include 100 % of the area to be surveyed, measured, recorded, and sometimes mapped. [87] provide a comprehensive manual regarding walking surveys of road surface defects using visual inspections and in situ field measurements. The US National Cooperative Highway Research Program (NCHRP) Synthesis 334 summarizes the methods of capturing surface distresses utilizing both in-person surveying as well as semi-automated and automated methods including riding surveys [81]. Traditional riding surveys estimate the severity of road defects while driving along the shoulder at slower speeds or, less accurately, while driving on the pavement at normal speeds.

The transition from manual to automated data collection has increased over the past 20 years. According to the NCHRP Synthesis 203, in 1994 40 states in U.S. were surveying surface defects predominantly using manual methods [47]. In 2004, of the 45 state agencies surveyed, only 17 were still utilizing manual survey methods [81]. The remaining 28 state agencies were implementing some form of digital or analog video surveillance along with automated systems. As of 2007, several well-established firms were providing commercially available semi-automated methods [117]. [124] recently presented a software package based on photogrammetric methods to fully assess the severity of potholes using automated systems. Today, most departments of transportation (DOTs) are open to vendor demonstrations to implement fully automated systems. Some DOTs, such as the Virginia Department of Transportation, have developed data collection requirements to guide vendors on how to generate automated data of acceptable quality [136]. It is clear that many state and local agencies are implementing more automated and remote sensing methods but currently there is no single, well-accepted automated system embraced by all DOTs to evaluate surface defects.

Traditional methods provide accurate and valuable information but obtaining these data can be time consuming. Furthermore, when the interpretation of the severity of the damage is determined based on judgment (even though there are well established rating criteria), the results can vary. Therefore, the integration of more automated and semi-automated remote sensing methods is inevitable and may provide valuable results when generated/interpreted by a computer. The outcome of these surveys is likely to be less expensive, more consistent, faster, and cover wider areas.

The remainder of this article offers an overview of available remote sensing tools to provide industry and government agencies guidance in the selection of appropriate methods for accomplishing specific road assessments.

5 Overview of remote sensing methods

The Sun is the primary source of energy for the Earth. This energy, or electromagnetic (EM) radiation, travels through space in the form of waves which are absorbed, reflected, or scattered by the Earth’s atmosphere and its surface. The amount of energy emitted or absorbed by an object is a function of temperature, and every object with a temperature above 0 degrees Kelvin emits EM radiation. Plank’s equation defines a theoretical relationship between temperature and EM energy emitted, which is used to define blackbodies. Stars most closely approximate the theoretical blackbody emission, whereas all other objects, called greybodies, have emissions lower than this theoretical maximum.

Peak emission is a function of temperature, with wavelength decreasing as temperature increases. Therefore, the sun which has an approximate temperature of 6000 degrees Kelvin peaks in the visible region of the EM spectrum, whereas the Earth, with an average temperature of about 300 degrees Kelvin peaks in the thermal infrared region. This relationship is governed by the Wien law [50].

5.1 Remote sensing techniques

The range of electromagnetic radiation is summarized by wavelength or frequency by the electromagnetic spectrum (Fig. 2). Utilizing different regions of the electromagnetic spectrum allows scientists to gather information in a variety of ways, from photographs to thermal images. For example, data collected from the visible spectrum, such as photographs, are the most common method of remote sensing for pavement analysis. The use of ground penetrating RADAR (GPR) has long been employed by geotechnical engineers to detect subsurface anomalies. While variations in temperature identified in the infrared region can be used to locate defects and cracks in pavement. Techniques such as laser scanning and hyperspectral imagery also contribute to identifying and locating defects and distress, often more rapidly than manual surveying. Sensors, mounted on various types of platforms, gather electromagnetic radiation emitted or reflected from the object or area of interest. The spatial, temporal, and spectral resolutions of the remote sensing data collected vary depending on the type of sensor and platform utilized.

Fig. 2

Electromagnetic Spectrum as a function of frequency. Length of the wave signal is compared to physical objects. Source: NASA

5.2 Remote sensing platforms

Data can be collected remotely from any number of places or platforms. The following section summarizes the most common platforms used to gather remote sensing data.

5.2.1 Satellite

Imagery collected from satellites provides the largest spatial coverage of any remotely sensed data and is used in multiple disciplines ranging from the earth sciences to military reconnaissance. Although these data can cover extremely vast regional or continental areas in a single image; data collection, quality, and usability can be limited by revisit times, atmospheric interferences, and spatial resolution.

A satellite’s orbit and inclination will determine data coverage and availability. For example, geostationary satellites orbit the Earth above the equator traveling at a speed equal to the Earth’s rotation in order to maintain a constant location above the Earth. These high orbit satellites (e.g., GOES⁶) are extremely useful for meteorological applications because they offer continuous coverage over the same area. They are limited by their inability to gather information over polar regions as well as their low spatial resolutions. Because of this low spatial resolution, they are not suitable for road studies.

Alternatively, polar orbiting satellites, such as MODIS’s Terra and Aqua⁷ or Landsat ETM+⁸, are useful for mapping, earth science, or surveillance tasks because they acquire information over every part of the Earth’s surface. They offer a variety of temporal and spatial resolutions depending on their altitude and velocity.

5.2.2 Airplane

Aerial platforms offer higher spatial resolutions than many satellite products with greater tasking flexibility. They are commonly used for remote sensing applications in multiple disciplines, from military to environmental. Airplanes can be fitted with various sensors and recording devices and gather operational data from altitudes ranging from approximately 300-13,000 m⁹ [20].

5.2.3 Unmanned aerial vehicle

Unmanned aerial vehicles (UAV) are capable of providing high resolution, near real-time imagery often with less expense than manned aerial or spaceborne platforms. For example, [35] illustrated how a UAV system can capture images to map roads and vehicles and provide information regarding traffic, accidents, or natural disasters within 2 hours of the event. [150] were able to identify defects such as rutting, washboarding, and potholes on unpaved roads using pattern recognition and image classification techniques from 2D images collected from a UAV. [152] developed a UAV based system to collect 3D high resolution photogrammetric imagery of road surface distresses for unpaved roads. Their quick response times, high maneuverability and resolutions make them important tools for disaster assessment [123]. [10] designed a low cost UAV with a photogrammetric payload for use after natural disasters to estimate and identify infrastructure damages.

5.2.4 Vehicle

Multi-purpose survey vehicles are employed worldwide for pavement evaluation (Fig. 3). Sophisticated survey vehicles offer integrated platforms where multiple conditions such as texture, cracking, rutting can be captured.¹⁰ Vehicular platforms are useful because continuous, high resolution data can be gathered at highway speeds without traffic disruption. They are also capable of collecting data under trees and bridges which would otherwise be obscured from aerial or satellite views.

Fig. 3

Road assessment in Washington, DC

Data collection is gathered using various methods including laser scanners, photo or video cameras, GPR, thermal, or acoustics to identify distresses. [40] designed an automatic pavement distress survey system mounted onboard a vehicle. They collected data by illuminating the road surface with an argon laser light, scanning the illuminated surface using a laser scanner, and recording the profile data in video. GPR data is also collected from vehicular platforms. [77, 109] utilized a van-mounted, air-horn antenna to collect GPR data for road evaluations. [131] illustrated how 3D LiDAR data of the pavement surface can be gathered at highway speeds from van-mounted equipment.

6 Remote sensing methods applicable to road assessment

6.1 Unpaved roads

Although approximately a third of the roads in the US are unpaved, few studies specifically address remote sensing methods for assessing unpaved road conditions.¹¹ While the costs associated with their initial construction are less compared to flexible or rigid pavements, unpaved roads require more frequent assessment because their condition can deteriorate quickly. This additional monitoring often results in increased expenses [11].

Many of the common defects found on unpaved roads (as described in Section 3.3.1) can be identified using remote sensing methods. Digital photos taken from low altitude manned aerial, UAV, or vehicular platforms provide data with appropriate resolutions for identifying distress such as potholes, ruts, and corrugations as well as changes in road surface elevation [13]. The monitoring of unpaved roads is also accomplished by gathering data from lasers, accelerometers, and videos [11].

Using data collected from the visible region of the EM spectrum (eg. photographs), and techniques such as pattern identification, it is possible to identify common defects like rutting, washboarding, or potholes, as well as changes in texture or color which can be indicative of a loss in aggregate materials [106]. Construction of 3D profiles using lasers can contribute to the identification of the road crown as well as potholes. For example, [152] used a UAV and photogrammetric methods to create a 3D model of surface distress, such as ruts and potholes, with a resolution up to 5mm for unpaved roads. Unpaved roads will deteriorate rapidly in conditions of excessive water or moisture. [92] illustrated how a Noise-Modulated Ground Penetrating Radar (GPR) may provide a fast, quantitative approach to identifying moisture in unpaved roads, which is useful for determining if roads are able to sustain heavy vehicular traffic after flooding as well as identifying possible road failures from excessive moisture.

6.2 Paved roads

6.2.1 Visible

Visual methods of pavement assessment, either manual or automatic, are the most common approaches to detecting and classifying surface defects as well as identifying large scale damage from natural or human disasters. These data are collected in multiple ways including, 1D and 2D line scanners on-board moving vehicles as well as from aerial and satellite photos or images. Automatic detection methods are faster and easier to apply to multiple images than manual image interpretation. Automatic interpretation comprises image processing and pattern recognition techniques to identify defects and distresses [58, 86]. When multi-temporal images are available, change detection techniques are commonly used to identify large scale infrastructure damage after disasters [115].

Image processing methods can be used to isolate the defect(s) from the background and create a binary image. The identification and classification of pavement distress is then interpreted from the binary image [42, 69, 97, 148]. Wavelet and Fourier transforms as well as segmentation algorithms are common image processing techniques used for pavement and concrete assessment. Two primary segmentation methods utilized for pavement distress identification are edge-detection and thresholding [100, 115, 127]. [61, 101] applied edge-detection algorithms such as Canny and fast Haar tranforms for crack identification [17]. [68] utilized image segmentation and texture analysis to identify potholes. [110] developed a methodology which included the use of wavelets, segmentation, and thresholding to detect and classify four types of cracking: longitudnal, transverse, block, and alligator, in flexible pavement [100].

The detection of cracks using image processing techniques is difficult because not only do cracks represent a very small portion of the overall image, but also, the road surface texture can disguise irregularities [18]. The automatic detection of pavement distress becomes more complex for images with changes in lighting or with shadows, for roads with variations in surface textures, as well as for roads with variations in their surface’s reflectivity. Also, a simple visual interpretation does not provide information of subsurface failures.

[120] proposed a method for pavement inspection which combines a camera with a laser range finder. They collected pairs of images taken from the same perspective, but with different lighting, to determine crack depth while also increasing the accuracy of the distress assessment. By utilizing two lighting schemes, the issues related to poor lighting, shadows, and reflectivity from the surface were reduced.

Digital imagery and processing can be expensive and hampered by lighting restrictions. Photogrammetry is a low-cost option which offers 3D information and is now being used for pavement assessment. [2, 65] demonstrate how low-cost photogrammetry can accurately recreate pavement surfaces and locate cracks and potholes in 3D.

6.2.2 Ground penetrating radar

Ground penetrating radar (GPR) employs electromagnetic energy in the microwave range, utilizing wavelengths (3m-200mm) to examine subsurface features with either a ground-coupled antenna (3m-60cm) or air-coupled antenna (300-200mm) [109]. Because of differing dielectric constants - especially due to the sensitivity of RADAR to water - changes in materials, moisture contents, and voids may be detected in the returned signal.

GPR can be an effective tool for assessment because it can be operated on-board a moving vehicle traveling at highway speeds, allowing for rapid assessment of road conditions. The most popular and useful applications of GPR in pavement management include the measurement of pavement layer thickness and void discovery [77, 90, 109].

Appraising pavement thickness provides crucial information for establishing load ratings and estimating pavement life by detecting changes in the pavement structure. In situ testing of pavement thickness requires lane closures and can be expensive and time consuming. Using GPR, the thickness of each pavement layer is estimated as a function of the RADAR velocity and the round trip travel time of the signal. Although GPR is a successful tool for measuring the thickness of asphalt pavement [135], the inherent characteristics of Portland cement concrete (PCC) pavement do not yield similar results. PCC has higher moisture and salt contents resulting in RADAR attenuation [15, 77]. Also, the similarity between the dielectric constants of PCC and base materials make distinguishing between the two layers difficult.

Locating voids - both water and air, can be extremely valuable, as moisture between asphalt layers or between the asphalt and base layers is a precursor of pavement deterioration. Moisture related surface distress includes cracking, potholes, rutting, shoving, and raveling [66]. [37] found GPR to be useful for identifying cracks in flexible pavement and measuring crack depths ranging from 50mm to 160mm. This non-destructive technique can be more favorable than the traditional, destructive coring methods for crack depth measurement. [28, 49] were able to identify moisture in the subgrade of flexible pavements using GPR. The early identification of cracks and their depth as well as areas of moisture is crucial for early maintenance and remediation. Recent testing of GPR with a multiple antenna array illustrated its application in identifying moderate to severe stripping, a common cause in pavement delamination [51].

Although GPR can provide valuable data, the signal is complex and requires skilled technicians to interpret the results. Moreover, it only identifies or detects changes in subsurface features, without providing their dimensions.

6.2.3 Infrared thermography

While both GPR and infrared (IR) thermography are effective for locating voids, each technique has its own inherent limitations [78]. GPR is capable of portraying the depth and thickness of subsurface irregularities, but it does not provide accurate horizontal dimensions. In contrast, it is possible to obtain horizontal measurements of voids using infrared thermography, but the technique does not provide depth or thickness measurements [139].

Infrared thermography operates by measuring the amount of radiation emitted from an object in the infrared range (9– 14μm). The measured radiation is a function of the object’s emissivity and temperature, along with surrounding weather and atmospheric conditions. IR thermography is used in multiple medical, construction, and military applications for the identification of thermal irregularities or contrasts.

[102] found IR thermography to be useful for evaluating defects in asphalt pavements. As asphalt ages, the decrease of its oily constituents instigates an increase in surfacing limestone. By utilizing limestone’s high absorption at 11.2 μm they were able to identify areas of deterioration. This technique is not applicable in urban areas because of reflected radiation from the heat island effect. [91] identified cracks and regions of delamination in airport pavements by identifying areas with at least a 0.5 °C temperature differentiation which was exhibited between defects and surrounding materials. IR thermography was also utilized by [31] to identify non-emergent defects in asphalt pavement.

Reflected radiation from the surrounding area, atmospheric absorption of radiation, and outdoor features such as wind, rain or sunlight all affect local temperatures and will increase the complexity of IR thermographic interpretation [23].

6.2.4 LiDAR and terrestrial laser scanning

Similar to RADAR technology, which uses microwave or radio waves, LiDAR (Light Detection and Ranging) captures details by illuminating an area using light from the near-infrared region (approximately 1.0 μm) and measuring the travel time between the transmission of the signal and its reflection or scatter back. The infrared light is commonly emitted at a rate of 5,000 pulses per second [4, 19]. This results in a dense cloud of points in x, y, and z positions which are highly accurate and precise. LiDAR is often used for mapping topography and the creation of digital elevation models. When mounted on a moving vehicle, road surfaces can be mapped using the dense and accurate 3D LiDAR point cloud [89]. Unlike other techniques, such as photogrammetry, LiDAR is not restricted by the sun angle and can be implemented during the day or night.

Recently, LiDAR has been applied in pavement evaluation projects. [19] illustrates how LiDAR and a grid-based processing approach can be applied to pavement distress features, such as potholes, to identify and estimate their volume to calculate the amount of fill material needed. LiDAR 3D surface models can be used to identify uneven or low areas susceptible to drainage problems and flooding within a 2cm elevation accuracy [131].

Terrestrial laser scanning (TLS) is being utilized for the evaluation of pavement surface conditions. Mounted on-board a moving vehicle and used in conjunction with a digital camera, a laser line scanner is used to construct high resolution, 3D continuous pavement surveys. [73] detected distortions, rutting, shoving, and potholes, in asphalt pavement using high-speed 3D transverse scanning. [128] successfully recognized cracks of 2mm and greater in asphalt pavements. [145] demonstrated the use of a multi-sensor, laser scanning method for the detection of cracks by fusing laser line scanned data with video to produce a 3D model of a road surface which identified cracks of a few cm as well as their depth. [130] were able to detect faulting in the joints of concrete pavements with an error of less than 1mm. [138] have developed a prototype pavement data collection system that uses multiple laser scanners to identify surface distress, rutting, roughness, macro-texture and road geometry at a 1mm resolution collected at highway speeds which processes in real-time. [103] utilized a laser line scanning system to assess surface texture and skid resistance. [25] found automated pavement surveys to be safer and less labor intensive than manual collection methods while still providing results consistent with standard techniques.

TLS produces high resolution, continuous transverse pavement profiles and it is insensitive to lighting conditions (day, night, or shadow) or low contrast conditions [126]. The high cost of the TLS instrumentation and hardware may make its implementation cost prohibitive.

6.2.5 Hyperspectral

Hyperspectral imagery utilizes large numbers of narrow, contiguous spectral bands (sometimes ranging from as much .35 − 2.4 μm) to gather detailed spectral information, often regarding chemical and mineral properties, of an observed feature [24, 48, 55, 105]. Because spectroscopic data can provide information regarding the properties of asphalt surfaces, hyperspectral techniques offer unique opportunities to evaluate road characteristics [45].

Asphalt pavement is composed of hydrocarbons which age and deteriorate as they react with the environment (oxygen, solar radiation, heat), resulting in a decrease of oily constituents and changes in composition [9]. This decrease in hydrocarbon constituents results in an increase in the reflectivity of asphalt [55]. [53, 56] compared imaging and ground spectrometry with in situ pavement condition surveys and found a greater than 10 % increase in asphalt reflectance in the near-infrared (NIR) and short wavelength infrared (SWIR) for aged pavement compared to new pavement. Although the distinction between new and aged pavement was evident when comparing their spectral signals, distinguishing the degree of weathering of an aged pavement was more difficult, even when substantial changes were evident in the in situ PCI and SI indexes. Aged pavement spectral signals become more complex when cracks in the asphalt expose unweathered materials, which have a lower reflectivity. Shadows from surface roughness were also shown to decrease reflectivity in the NIR and SWIR as much as 7 %-8 % [53].

[7] found road surface reflectivity governed by not only pavement age, but material quality and road circulation and that a principal component analysis (PCA) performed well at distinguishing between asphalt conditions. Specifically, circulation was found to increase reflectivity while simultaneously causing deterioration, the degree of which was dependent on material quality. This led to an overlapping in spectral signatures in some instances. Using the combined conditions of age, circulation, and material quality they were able to create 5 general categories of road conditions ranging from very good to poor.

Hyperspectral imagery cannot replace an experienced road inspector. For example, cracks expose unweathered material so the differentiation between moderate to severely weathered pavements is not a straightforward process. However, it does offer insights into surface conditions and can reduce the number of areas where the use of destructive and time consuming testing is needed.

6.2.6 Emerging techniques

New remote sensing and data collection techniques are emerging, often taking advantage of the extensive use of internet mobile devices. For example, [85, 88] designed systems which reside on smart phones to detect potholes and bumps using accelerometer and GPS data. The city of Boston, MA uses “Street Bump” a new mobile phone app to detect potholes. The app utilizes wavelets and Kruskal’s algorithm to detect potholes and then sends a message along with a location to a centralized database.¹²

Other unique methods include an acoustic technique for evaluating pavement surface conditions by collecting sounds generated by tires from a vehicle mounted microphone [153]. [121] evaluated flexible pavement conditions using a phase array Synthetic Aperture Radar (SAR). They found that an increase in backscattering in the HH polarization signified poor surface pavement conditions and translated well as a ride quality evaluator with an assessment accuracy of 97 % [121].

6.3 Summary matrices

A summary of recent research regarding the use of remote sensing techniques for pavement assessment is included in the following tables. Table 1 summarizes research regarding unpaved roads, while Tables 2 and 3 illustrate work concerning flexible and rigid pavements, respectively. It is apparent the majority of work concerns crack identification using visible inspections. This is especially evident for flexible pavements from vehicular platforms.

Table 1 Summary of typical unpaved road defects and remote sensing methods for assessment

Table 2 Summary of typical flexible pavement defects and remote sensing methods for assessment

Table 3 Summary of typical rigid pavement defects and remote sensing methods for assessment

This inequality in methods and research agendas may be attributed to a number of factors. For example, the vast majority of research concerns flexible pavements versus unpaved roads or rigid pavements and is likely due to the larger use of flexible pavement in the US. The lack of research regarding unpaved roads is also likely the result of its lower cost as well as its locations in more rural, less traveled areas.

Although the selection of an appropriate remote sensing technique can be problem specific, the abundance of research concerns visible methods. Visible surveys are traditional, familiar, and often less expensive than other methods. Techniques such as TLS or LiDAR can require expensive equipment as well as trained technicians and, therefore, may be slower to integrate into management programs.

7 Hazard assessment

While multiple regions of the electromagnetic spectrum provide opportunities to detect, assess, and measure defects and deterioration in pavement resulting from normal use and weathering; the use of remote sensing methods for assessing roads during and after hazard events is relatively new. Remote sensing has been used for decades to detect and locate floods, forest fires, landslides, and many other hazards of varying type and spatial scale. It is also widely utilized to survey damage to buildings and infrastructure following disasters. The use of remote sensing to specifically assess road damages and accessibility is a relatively new research agenda. While a functioning transportation network is essential in day-to-day life, it is particularly critical during and after hazard events. Information regarding accessibility or obstructed and damaged roadways and bridges is imperative for emergency responders. Natural hazards range in scale from localized landslides affecting a road segment to large regional events such as hurricanes or earthquakes. Because remote sensing methods can provide data with high spatial resolution as well as for inaccessible areas, these data may be used to provide valuable information for the detection and assessment of transportation networks.

Historically, pavement and structural damage from hazards were tested in the field. For example, undetected damage to pavements and roadbeds caused by extensive flooding after Hurricanes Katrina and Rita in Louisiana were evaluated using field techniques such as falling weight deflectometers to assess the structural integrity of road beds by comparing pre- and post-Pavement Condition Indices (PCI) [52, 154]. [29] cataloged road and bridge damages after Hurricane Ivan with photographs from the field.

Recent studies have focused on the application of remote sensing data after earthquakes or flooding to assess transportation networks. [16] used multi-sensor, multi-temporal imagery to identify flooded roads. [33] identified infrastructure and road damage after the 2008 Wenchuan earthquake, using pre- and post-disaster very high resolution (VHR) optical imagery (1m or better). The combination of optical satellite imagery with a digital elevation model (DEM) to assess roads for accessibility after flooding was used to create a model for application in near-real time for emergency managers [38].

The evaluation and identification of transportation regions vulnerable to disruption is also important. LiDAR has been utilized to quantify slope movement and to predict and measure landslides as well as rockfall and other hazards and instabilities along roadways [30, 70, 116]. LiDAR has also been used with optical remote sensing images for post-hazard assessment of structural damage of buildings [98]. Satellite data are extremely useful for disaster assessment especially when before and after imagery is available for change detection [131].

Researchers are also studying new and innovative ways to optimize road assessments following natural disasters.¹³ This new research agenda, funded by the U.S. Department of Transportation, utilizes on-the-ground information culled from social media to identify possible areas of road damage. Once these areas are identified, commercial satellites can be tasked to collect information for designated regions.

8 Future directions

8.1 Traffic cameras

Traffic cameras may provide a possible new resource for gathering pavement data remotely. They are currently utilized by hundreds of cities in the US to provide real-time information regarding congestion and accidents. Additional or new pavement information could be taken by the cameras during periods of low traffic volume when roads are more visible. Currently, there has been no research investigating the use of traffic cameras for pavement assessment.

8.2 Volunteered geographic information

Volunteered geographic information (VGI) is a new and rapidly growing data source frequently available through social media. These data, which are voluntarily contributed and contain spatial and temporal information, harness the power of “humans as sensors” [46]. As a source of real-time, on the ground data VGI has the potential to be a valuable source for pavement monitoring. For example, systems which allow the public to report pavement defects, such as potholes, provide cities or municipalities with valuable, free information [63, 80].

8.3 Ground data integration

Pavement management systems which concurrently employ ground and remote sensing data may provide the most effective way of assessing and managing the nation’s huge transportation infrastructure. Data fusion processes could be utilized to integrate multiple data sources, such as VGI, videos from traffic cameras, and ground data gathered by traditional methods, to increase accuracy and provide a more complete representation than what would be obtained from single data sources.

9 Conclusions

One of the most valuable, extensive, and important resources in the US and Europe is their roads. Assessment and monitoring is crucial to maintaining a safe and effective road system. There are multiple surface and subsurface indicators of distress and defects which are observed using traditional, geotechnical engineering methods. While effective, many of these methods can be time consuming, laborious, destructive, costly, and provide information for only limited areas. The use of remote sensing techniques offers new potential for pavement managers to assess large areas, often in little time. Although remote sensing techniques can never entirely replace traditional geotechnical methods, they do provide an opportunity to reduce the number or size of areas requiring site visits or manual methods. Employing remote sensing methods to evaluate pavement and transportation networks during and after natural or man-made disasters can also provide comprehensive information for emergency managers.