Aptima Personalizes AFRL Pilot Training with AI Agents

Aptima Inc. has secured a four-year contract from U.S. Air Force Research Laboratory Airman Systems Directorate, Warfighter Interactions and Readiness Division (AFRL) to develop an automated training librarian that leverages imperfect Artificial Intelligence (AI) to create more perfect pilot training. The $5.2+ million contract also includes funding for the Gaming Research Integration and Learning Laboratory.

Under the contract, Aptima will manage seven developers of AI agents, who will create artificial enemy pilots that fly missions against human pilot trainees. A prior phase of this program produced numerous pilot agents. The performance of each of these AI varied significantly between scenarios, as if each were an expert pilot in a few types of encounters and a journeyman or novice in others. Aptima will capitalize on this variance. Specifically, it will create an automated librarian that will categorize the AI pilots and match them to the trainee in scenarios to best develop their expertise. NATO recognized this novel concept with an award in 2020.

“For training to be effective, it should be neither too difficult, nor too easy, but in the sweet spot for the trainee to learn and develop their competencies,” said Jared Freeman, Chief Scientist at Aptima, which is overseeing the AI program. “Much like training in sports, where you want to practice against an opponent that stretches and develops your game, an AI agent chosen well by the librarian will be just better enough than the trainee for them to learn how to win, pushing them just to the bounds of their learning envelope.

The AI system will be able to leverage training data in real-time. As performance measures roll in, the model will select the next scenario and agent that will advance the trainee to expertise most quickly and surely. Rather than apply a traditional, one-size-fits-all approach, these ‘adaptive learning’ models personalize learning at scale.

AI pilots offer the potential of being tireless trainers that are always available to rigorously train to the curriculum. AI agents are expected to augment expert human trainers who are in limited supply, and unavailable on-demand.

In addition to developing the automated librarian, Aptima will oversee the development of AI agents by companies that include CHI Systems, Charles River Analytics, Discovery Machines, Eduworks, Soar Technology, Stottler Henke Associates, and TiER1 Performance Solutions. Aptima will also create a cloud-based testbed that scales to enable many AI agents to generate flight data in parallel. Those data should, in turn, help all agent developers train and assess agents. Finally, the $5.2+ million contract will also include the support for the Gaming Research Integration for Learning Laboratory (GRILL).

GRILL provides an environment for testing the capabilities of new technologies and evaluating them for their application to a variety of learning environments from classrooms to operational field settings.