Active PAR

P3426

Standard for Defining and Measuring the Capabilities of AI Foundation Models

This standard defines and provides criteria to measure the capabilities of foundation models. The standard focuses on measurable and objective capabilities such as perception-oriented capabilities, cognitive capabilities, and learning capabilities. The standard provides guidelines for evaluating these capabilities, drawing inspiration from human intelligence quotient (IQ) definition and measurement, and includes: - Definition of key capabilities pertinent to foundation models. - Standardized methods and metrics for evaluating perception-oriented, cognitive, and learning capabilities. - Framework for comparing different models based on their cognitive capabilities. - Ethical considerations and potential biases in the evaluation process.

Sponsor Committee
C/AISC - Artificial Intelligence Standards Committee
Status
Active PAR
PAR Approval
2023-12-06

Working Group Details

Society
IEEE Computer Society
Learn More About IEEE Computer Society
Sponsor Committee
C/AISC - Artificial Intelligence Standards Committee
Working Group
AI Foundation Models - AI Foundation Model Application Design, Implementation, and Interoperability
IEEE Program Manager
Christy Bahn
Contact Christy Bahn
Working Group Chair
Jie Tang

Other Activities From This Working Group

Current projects that have been authorized by the IEEE SA Standards Board to develop a standard.


No Active Projects

Standards approved by the IEEE SA Standards Board that are within the 10-year lifecycle.


No Active Standards

These standards have been replaced with a revised version of the standard, or by a compilation of the original active standard and all its existing amendments, corrigenda, and errata.


No Superseded Standards

These standards have been removed from active status through a ballot where the standard is made inactive as a consensus decision of a balloting group.


No Inactive-Withdrawn Standards

These standards are removed from active status through an administrative process for standards that have not undergone a revision process within 10 years.


No Inactive-Reserved Standards
Subscribe

Sign up for our monthly newsletter to learn about new developments, including resources, insights and more.