Technology that may help potholes get fixed faster
Christoph Mertz spends his days looking at cracks in the street.
“Once you’re involved in something like this, you see every crack in the road, every pothole, you say, ‘Ohhh, this is interesting,’” he says as he weaves around sizeable potholes on the narrow streets behind Carnegie Mellon University in Pittsburgh. A small camera mounted on his windshield, much like a GPS device, shoots video of the pavement unspooling in front of him as he drives. He says he relishes finding really deteriorated streets because “it’s a really good example for my data.”
Mertz is a researcher at Carnegie Mellon. He works with the university’s Traffic 21, a research arm focusing on practical solutions to transportation problems, and he’s built a computer program that uses photos to detect cracks in street pavement. He’s been testing it using photos extracted from the video he shoots in his own car, but he’s also working with the city to test the technology. He’s placed cameras inside three city vehicles.
For Pittsburgh, which currently uses manual, visual inspections to assess city streets, the technology could one day be a more reliable and cheaper alternative for maintaining roads.
Human vs. computer inspections
Pittsburgh maintains 1,100 miles of streets, divided into 17,000 segments. Three inspectors are responsible for visiting each of those segments to evaluate them. The inspectors use their eyes to assess the streets, to note any cracks, potholes, or rutting, the severity of the deterioration, and its proliferation in the segment. Inspections can be “fairly subjective,” says Lee Haller, deputy director of public works.
Also, the inspectors have other responsibilities; it takes them four to five years to review all of the segments.
The city uses a pavement management system and models to predict a street’s lifespan, but Haller says because of the subjectivity and long inspection periods, there’s a good chance much of the base data is inaccurate. “After winter, the condition of a given street can change rapidly because what was just cracking after a number of freeze-thaw cycles turns into major potholes,” he says.
Pittsburgh’s street inspection system is standard for cities.
Mertz’s program, he says, automates the process, speeds it up and eliminates human bias. It uses photos from the cameras installed in city vehicles that would be making the rounds anyway, and thus not requiring a dedicated employee. The program breaks the pavement in each picture into a grid, and then the photos are combed digitally using an algorithm, looking for texture. A newly paved road looks flat to the machine, but a road with cracks in it will have texture. Then it calculates how much of the given surface is covered by cracks and scores the road’s condition.
A sample city map where streets have been analyzed using Christoph Mertz’s pavement inspection program. The green dots mean the pavement is in good shape, yellow indicates some damage and red means the pavement quality is bad.
The program can “inspect” streets as quickly as the photos from the city cars come in. Mertz says running the algorithms on large data sets can take a while, but for him that meant several days, a relative wink-of-an-eye compared to the city’s yearslong inspection cycle.
For Haller, having access to more accurate, up-to-date street data would make planning easier and more effective. He’d know exactly which street segments need work to meet a quality threshold, for example. He’d be able to ask for money and promise specific results, something he can’t always do now.
“I think when you have the conversation with Council and say these are the extra streets specifically by name that we would be able to do in this upcoming season if we had extra money, it’s more tangible,” he says.
A better, more predictably maintained road network means a more viable city.
“That is not only the public getting to and from work, which is very important, but it’s also bringing goods and services … freight and the like,” says Brian Leshko, an American Society of Civil Engineers fellow. “It really does have a big impact on the economy of a city.”
Working out the kinks
Back at the lab, Mertz is still working out kinks in the program. He pulls up a map of Pittsburgh filled with green, yellow and red dots, each representing an analyzed image of a street segment. Green means the road is good, yellow means it has some damage and red means it’s bad. As he clicks on the dots, images of the pavement pop up.
He clicks on a red dot, but the photo shows smooth pavement, broken only by the shadows of overhanging tree branches. It turns out the algorithm still can’t tell cracks and shadows apart.
There are some other issues, too. For now, files have to be transferred and handled manually, which Haller says doesn’t work for the city. Mertz also hasn’t trained his program to see potholes, patches, rutting, or to analyze non-pavement road surfaces (Pittsburgh has many brick and stone streets). He says he hopes to get to all that.
When he does, the technology could be a game changer for cities like Pittsburgh with aging infrastructure and limited resources.
There’s a lot happening in the world. Through it all, Marketplace is here for you.
You rely on Marketplace to break down the world’s events and tell you how it affects you in a fact-based, approachable way. We rely on your financial support to keep making that possible.
Your donation today powers the independent journalism that you rely on. For just $5/month, you can help sustain Marketplace so we can keep reporting on the things that matter to you.
