Psychometric Tests for AI Agents and Their Moduli Space
By: Przemyslaw Chojecki
Potential Business Impact:
Tests AI intelligence and finds its core abilities.
We develop a moduli-theoretic view of psychometric test batteries for AI agents and connect it explicitly to the AAI score developed previously. First, we make precise the notion of an AAI functional on a battery and set out axioms that any reasonable autonomy/general intelligence score should satisfy. Second, we show that the composite index ('AAI-Index') defined previously is a special case of our AAI functional. Third, we introduce the notion of a cognitive core of an agent relative to a battery and define the associated AAI$_{\textrm{core}}$ score as the restriction of an AAI functional to that core. Finally, we use these notions to describe invariants of batteries under evaluation-preserving symmetries and outline how moduli of equivalent batteries are organized.
Similar Papers
The Geometry of Benchmarks: A New Path Toward AGI
Artificial Intelligence
Helps AI learn and improve itself better.
An Operational Kardashev-Style Scale for Autonomous AI - Towards AGI and Superintelligence
Artificial Intelligence
Rates AI progress from simple robots to superintelligence.
Self-Improving AI Agents through Self-Play
Artificial Intelligence
Makes AI systems learn and improve themselves.