Advancements in Human–Agent Teaming Research Infrastructure: Testbeds, Metrics, and Concepts

As modern military operations become more complex, the need for rapid, coordinated decision-making across multiple domains—air, land, maritime, space, and cyberspace—has never been greater. The U.S. Department of War has identified artificial intelligence (AI) as a critical tool in overcoming these challenges, enabling faster and more efficient responses in high-stakes environments. However, for AI to be effective, it must function well within human teams and organizational structures. This book explores the evolving role of AI in military and defense operations, with a focus on how human-AI teams can be optimized for success. This title offers a practical guide to the next generation of human-AI teaming. Built on the findings of a major research initiative led by the National Academies Board on Human-Systems Integration, this book compiles key insights into the infrastructure, metrics, and conceptual frameworks essential for advancing human-AI collaboration. Readers will gain an understanding of the latest testbed research, validated performance metrics, and novel but critical concepts for evaluating human-AI teams. This book provides a foundation for improving decision-making and coordination in complex operational settings. Advancements in Human Agent Teaming Research Infrastructure: Testbeds, Metrics, and Concepts is an essential resource for researchers, engineers, and policymakers working in AI development, human factors, and defense strategy. It will also benefit military professionals and industry leaders seeking to understand how AI can enhance operational effectiveness while maintaining human oversight and trust.