This standard defines and provides criteria to measure the capabilities of foundation models. The standard focuses on measurable and objective capabilities such as perception-oriented capabilities, cognitive capabilities, and learning capabilities. The standard provides guidelines for evaluating these capabilities, drawing inspiration from human intelligence quotient (IQ) definition and measurement, and includes: - Definition of key capabilities pertinent to foundation models. - Standardized methods and metrics for evaluating perception-oriented, cognitive, and learning capabilities. - Framework for comparing different models based on their cognitive capabilities. - Ethical considerations and potential biases in the evaluation process.
- Sponsor Committee
- C/AISC - Artificial Intelligence Standards Committee
- Status
- Active PAR
- PAR Approval
- 2023-12-06
Working Group Details
- Society
- IEEE Computer Society
Learn More About IEEE Computer Society - Sponsor Committee
- C/AISC - Artificial Intelligence Standards Committee
- Working Group
-
AI Foundation Models - AI Foundation Model Application Design, Implementation, and Interoperability
- IEEE Program Manager
- Christy Bahn
Contact Christy Bahn - Working Group Chair
- Jie Tang
Other Activities From This Working Group
Current projects that have been authorized by the IEEE SA Standards Board to develop a standard.
No Active Projects
Standards approved by the IEEE SA Standards Board that are within the 10-year lifecycle.
No Active Standards
These standards have been replaced with a revised version of the standard, or by a compilation of the original active standard and all its existing amendments, corrigenda, and errata.
No Superseded Standards
These standards have been removed from active status through a ballot where the standard is made inactive as a consensus decision of a balloting group.
No Inactive-Withdrawn Standards
These standards are removed from active status through an administrative process for standards that have not undergone a revision process within 10 years.
No Inactive-Reserved Standards