Human versus autonomous car race ends before it begins

TOKYO—Racing is hard. It's hard on the teams, it's hard on the owner's bank account, it's hard on the cars, and it's especially hard on the drivers. Driving at the edge for a few hours in a vehicle cockpit that's only slightly wider than your frame can take a toll.

The A2RL (Abu Dhabi Autonomous Racing League) removes one of those elements from its vehicles but, in doing so, creates a whole new list of complexities. Say goodbye to the human driver and hello to 95 kilograms of computers and a whole suite of sensors. That setup was poised to be part of a demonstration "race" against former F1 driver Daniil Kvyat at Suzuka Circuit in Japan during the Super Formula season finale.

But again, racing is hard, and replacing humans doesn't change that. The people who run and participate in A2RL are aware of this, and while many organizations have made it a sport of overselling AI, A2RL is up-front about the limitations of the current state of the technology. One example of the technology's current shortcomings: The vehicles can't swerve back and forth to warm up the tires.

Giovanni Pau, Team Principal of TII Racing, stated during a press briefing regarding the AI system built for racing, "We don't have human intuition. So basically, that is one of the main challenges to drive this type of car. It's impossible today to do a correct grip estimation. A thing my friend Daniil (Kvyat) can do in a nanosecond."

Technology Innovation Institute (TII) develops the hardware and software stack for all the vehicles. Hardware-wise, the eight teams receive the same technology. When it comes to software, the teams need to build out their own system on TII's software stack to get the vehicles to navigate the tracks.

Not quite learning but not quite not learning

In April, four teams raced on the track in Abu Dhabi. As we've noted before, how the vehicles navigate the tracks and world around them isn't actually AI. It's programmed responses to an environment; these vehicles are not learning on their own. Frankly, most of what is called "AI" in the real world is also not AI.

Vehicles driven by the systems still need years of research to come close to the effectiveness of a human beyond the wheel. Kvyat has been working with A2RL since the beginning. In that time, the former F1 driver has been helping engineers understand how to bring the vehicle closer to their limit.

The speed continues to increase as the development progresses. Initially, the vehicles were three to five minutes slower than Kvyat around a lap; now, they are about eight seconds behind. That's a lifetime in a real human-to-human race, but an impressive amount of development for vehicles with 90 kg of computer hardware crammed into the cockpit of a super formula car.

Currently, the vehicles are capable of recreating 90–95 percent of the speed of a human driver, according to Pau. Those capabilities are reduced when a human driver is also on the track, particularly for safety reasons. When asked by Ars what his biggest concern was being on the track with a vehicle that doesn't have a human behind the wheel, Kvyat said he has to "try to follow the car first to see what line it chooses and to understand where it is safe to race it. Some places here [at Suzuka] are quite narrow—on the contrary from the Abu Dhabi track—and there are a lot of long corners. So I really need to be alert and give respect and space to the AI car," Kvyat said.

Kvyat also noted that the AI car is traveling at a more respectable speed, so he really needs to know what's going on.

The predictability of a human driver both on a track and in the real world is one of the issues surrounding AI. As we drive, walk, or bike around a city, we rely on eye contact from drivers, and there are certain behavioral expectations. It's the behavioral outliers that cause issues. Examples include things like running a stop sign, weaving into a lane already occupied by another vehicle, or stopping in the middle of the road for no discernible reason. On the track, an autonomous vehicle might choose to deviate from the racing line around a corner because of a signal input that a human driver would ignore or fold into their driving based on their real-world experience. The context of the rest of a lived life is just as important as what's learned on the track. Life and racing are hard and chaotic.

The “race”

On the Saturday of the race weekend, a demonstration of two A2RL vehicles raced around the circuit. The vehicles were moving quickly down the straight. The corners, though? We were told that they were still a bit tricky for the vehicles to navigate.

Down in the pits, the team watched a bank of monitors. Sensor data came in from the vehicles—zeros and ones representing the track translated into a sea of graphs. To help parse the data quickly, the system shows a green flag when everything is going well and red flags when the values are out of whack with what's supposed to happen. In addition to how the vehicle is moving, information about fuel consumption, brake wear, and tire temperature is shared with the team.

All of this data lets the team know how hard it is pushing the vehicle. If everything looks good, the team can push the vehicle to go a little quicker, to push a little harder for a better lap time. Humans elsewhere in the pits will soon tell their human drivers the same thing. Push harder, be quicker; the car can handle it. The data coming in predicts what will happen in the next few seconds.

Hopefully.

The individual teams will try to find the optimal line, just like the human team, but it doesn't always follow what humans have done before on a track. They work to create an optimal line for the autonomous car instead of just copying what humans are doing.

This team has been at Suzuka for weeks ahead of this race. The HD map they bought from a third party was off by meters. In that time the team had to remap the track for the vehicles and teach them how to drive on a circuit that's narrower than the track at Abu Dhabi.

The car is outfitted with Sony 4K cameras, radars, lidar, high-definition GPS, and other sensors. The electric steering can handle up to five Gs. The hydraulic brakes on each wheel could be triggered individually, but currently, they are not, according to Pau. However, Pau did note that enabling this function would open up new possibilities, especially in cornering.

Pau took a moment while walking us around the vehicle to point to the laser that measures the external temperature of the tire. That, along with the ability to track the tire's pressure, are key to ensuring the vehicle stays on the track.

The next morning, the main event was gearing up. Man versus machine. A modern-day John Henry tale without the drama of the song about a steel-driving man. We all knew Kvyat would win. A2RL was very up-front that the system is not nearly as quick as a human. At least not yet. But it had decided to bring the race to Japan, a country known to be on the cutting edge of technology. The "race" was to be held ahead of the season finale of the Super Formula season.

It was cooler that morning than the previous day. The cars were pushed out to the grid. Kvyat was stationed behind the driverless vehicle. The time between leaving the pits and the race starting felt longer than the day before. The tires were cooling off.

The A2RL vehicle took off approximately 22 seconds ahead of Kvyat, but the race ended before the practice lap was completed. Cameras missed the event, but the A2RL car lost traction and ended up tail-first into a wall. A rather anti-climatic end to weeks of work by the team. In the pits, people gathered around the monitors trying to determine exactly what went wrong.

Khurram Hassan, commercial director of A2RL, told Ars that the cold tires on the cold track caused a loss of traction. A press release sent out later in the day noted that one of the rear tires suddenly lost pressure, causing the vehicle to lose traction and slide into the wall.

Hassan reminded us that the vehicle does not know how to swerve back and forth yet to warm up its tires. But more importantly, he said that the gap between simulation and the real world is very real. "You could do things on a computer screen, but this is so important. Because you have to be on the track," Hassan said.

The reality is that reality is chaos and always changing. When a company notes that it's doing millions of miles of simulated testing, it's vital to remember that a computer-generated world does not equal the one we inhabit.

Reality and intelligence

A2RL doesn't want to replace human-to-human racing. It understands the emotional attachment humans have to watching other humans compete. It also realizes that as these vehicles improve, what the teams learn will not be directly pulled from the track and put on self-driving cars. But by pushing these vehicles to the limit and letting AI determine the best course of action to keep from slamming into a wall or other vehicle, that information could be used in the future as a safety feature in vehicles—a way to keep a collision from happening used in conjunction with other safety features.

The day before the human versus AI race, Super Formula had its penultimate race of the season. During that race, two cars left the pits only to have one of their rear wheels come off. Also, another two cars collided with each another. Racing is hard, and accidents happen.

For A2RL, failure is always an option. It may break the hearts of everyone in the pits that have prepped for weeks for an event, but it's important to remember that it's a controlled environment. A2RL seems to understand and talks about the complications of aiming for an AI-powered vehicle. It would be nice if those companies testing on our streets did the same.