- An experienced US Air Force F-16 pilot went head-to-head with an artificial intelligence algorithm in a simulated dogfight last week and suffered five straight losses in the battle with the machine.
- Former US Navy pilot and TOPGUN instructor Guy Snodgrass told Insider that he was "not surprised" by the AI victory, arguing that the the pilot was forced to play the AI's game and that the AI algorithm would likely have "crashed and burned" in the real world.
- Former Air Force pilot and senior research fellow at the Heritage Foundation John "JV" Venable said the competition was "gamed to a point where you can't beat it."
- That being said, both of the former pilots said they see a not-too-distant future where the US military has mission-capable AI-driven autonomous combat aircraft that can engage other combatants in air-to-air combat.
- Visit Business Insider's homepage for more stories.
An artificial intelligence algorithm absolutely destroyed a seasoned US fighter pilot last week in a simulated dogfight, a result some observers say was to be expected.
"I was not surprised by that outcome," Guy 'Bus' Snodgrass, a former US Navy pilot and TOPGUN instructor, told Insider, arguing that the set-up of the engagement gave the AI an advantage. John "JV" Venable, a former US Air Force F-16 pilot, said the same.
The Defense Advanced Research Projects Agency (DARPA) held the last round of its third and final AlphaDogfight competition Thursday, putting an AI system designed by Heron Systems against a human pilot in a "simulated within-visual-range air combat" situation.
The competing AI algorithm achieved a flawless victory, winning five straight matches without the human pilot — an experienced Air Force pilot and Weapons Instructor Course graduate with the callsign "Banger"— ever scoring a hit.
With advancements in air combat capabilities, there have long been questions about whether dogfighting even matters. Both Venable and Snodgrass said it remains relevant because pilots must be prepared to dogfight should their standoff capabilities be neutralized.
"In a best case scenario, dogfighting is completely irrelevant because you want to see your adversary as far away as possible," Snodgrass explained. But sometimes pilots are unable to defeat their opponent before they find themselves in close combat.
"Now, you're left to a bullet," Venable said.
'Gamed to a point where you can't beat it'
Theresa Hitchens at Breaking Defense characterized the recent simulated engagement as a "one-on-one combat scenario" in which combatants fired "forward guns in a classic, WWII-style dogfight," suggesting that it mimicked certain aspects of close air-to-air combat. That being said, the contest was not necessarily a fair or realistic fight.
"This was gamed to a point where you can't beat it," Venable said, arguing that the AI algorithm appears to have had access to information that it would not have in the real world. The combat environment, as Snodgrass also pointed out, was built to the AI's advantage.
"You have an artificial intelligence program that has been perfectly trained in that environment to conduct a simulated fight, and you have a US Air Force fighter pilot who you are forcing to wear VR goggles," Snodgrass said, saying that the human is "playing the AI's game."
With a background in computer science and experience with some of the Department of Defense's AI research, he explained that "if you give [AI] a very narrow, specific job to accomplish, once it's been trained, once it has had exposure to a very static environment, it does phenomenally well."
"You find that artificial intelligence can begin to outperform human operators in short order," he added.
But, where AI struggles is when it's put in a complex environment with unconstrained variables and asked to think and act like a human being. "We're nowhere near that," Snodgrass said.
"The AlphaDogfight trials were a significant step toward one day providing an unmanned aircraft that can perform dogfighting," the retired Navy commander said, "but what it does not demonstrate is that we're there now."
"I think it's promising for the development of artificial intelligence," he added, "but if you took that same algorithm, put it into an unmanned vehicle and said, 'Okay, go fight a real dogfight,' it would have crashed and burned pretty quick."
A mission-capable AI-driven autonomous combat aircraft is possible in the not-too-distant future though, both he and Venable told Insider.
The AlphaDogfight trials are aimed at moving DARPA's Air Combat Evolution (ACE) program forward.
The ACE program, according to DARPA, is designed to "deliver a capability that enables a pilot to attend to a broader, more global air command mission while their aircraft and teamed unmanned systems are engaged in individual tactics."
Col. Dan Javorsek, the program manager in DARPA's Strategic Technology Office, said last year that the agency envisions "a future in which AI handles the split-second maneuvering during within-visual-range dogfights, keeping pilots safer and more effective as they orchestrate large numbers of unmanned systems into a web of overwhelming combat effects."
The agency's research is aimed at delivering advanced manned-unmanned teaming both inside and outside the cockpit, and DARPA is just one of several teams looking at these capabilities for the US military.
"When you think about all the advancements that have occurred in the last decade, in the last hundred years, I would never bet against technological progress," Snodagrass said.
"I think there's a point in time where the US military will have unmanned aircraft that you could give a mission, load it up, have it take off, and have it potentially fight its way in and fight its way back out," he added. "That's absolutely possible and something likely to happen probably sooner than we ever imagined."
As part of the ongoing Skyborg project, the Air Force is currently working to develop low-cost, attritable AI-driven autonomous aerial combat vehicles to fly alongside manned fighter aircraft in combat as early as 2023. The military is also talking about putting one of these unmanned systems against a manned aircraft in aerial combat as early as next year.
But developing the technology is only part of the process of fielding new warfighting capabilities. The technology also has to be accepted and trusted by pilots.
"The recent 5 to 0 victory of an Artificial Intelligence (AI) pilot developed by Heron Systems over an Air Force F-16 human pilot does not have me scrambling to send out applications for a new job," Navy Cmdr. Colin 'Farva' Price, a F/A-18 squadron commander, wrote in an article for The War Zone. "However, I was impressed by the AlphaDogfight trials and recognize its value in determining where the military can capitalize on AI applications."
He expressed interest in AI-enhanced systems in an aircraft assisting and augmenting the combat capabilities of fighter pilots through machine learning, something the Air Force is already looking at.
Explaining that top US pilots have thousands of hours of experience during a 2018 interview with Inside Defense, Steven Rogers, the head of autonomy at the Air Force Research Laboratory, asked the question, "What happens if I can augment their ability with a system that can have literally millions of hours of training time?"
"I am not ready for Skynet to become self-aware," Price wrote, referring to the evil AI enemy in the Terminator films, "but I am certainly ready to invite AI into the cockpit."