Cybersecurity and artificial intelligence experts recently gathered at a National Academies event to discuss growing concerns about the security of AI systems and the urgent need for new research priorities. The two-day meeting, organized at the request of the U.S. National Science Foundation, focused on how existing cybersecurity methods can be adapted to increasingly complex AI technologies. Researchers, industry leaders, and government representatives examined threats facing AI systems used in critical areas such as scientific research, drug discovery, and financial services.
A major topic of discussion was the rise of “agentic AI” systems — advanced AI models capable of acting with greater autonomy and performing tasks with limited human supervision. Experts warned that traditional cybersecurity approaches may not be enough to secure these next-generation systems because AI introduces new attack surfaces, unpredictable behaviors, and rapidly evolving capabilities. Participants explored the need for improved threat modeling, benchmarking standards, infrastructure protection, and secure development practices specifically designed for AI-enabled environments.
The event also highlighted increasing concerns that AI security is becoming a national security issue. Governments worldwide are paying closer attention to the risks posed by powerful AI systems, including cyberattacks, misinformation, autonomous operations, and the misuse of frontier AI models. Researchers emphasized that securing AI will require collaboration across academia, industry, and government, as well as significant investments in technical expertise, infrastructure, and governance frameworks.
The discussions are expected to inform an upcoming issue paper outlining future research priorities and gaps in AI security. Organizers hope the findings will guide long-term strategies for improving the resilience and trustworthiness of AI systems as adoption accelerates across society. The growing focus on AI security reflects broader recognition that artificial intelligence is no longer just a technology challenge, but also a major economic, cybersecurity, and geopolitical concern.
