This standard specifies a methodology for benchmarking the performance of large-scale, knowledge-enhanced pre-trained models that are used in the manufacturing industry. The standard specifies testing approaches, performance metrics, and measurement methods. The standard also defines requirements for the testing dataset.
- Standard Committee
- C/KESC - Knowledge Engineering Standards Committee
- Status
- Active PAR
- PAR Approval
- 2025-11-04
Working Group Details
- Society
- IEEE Computer Society
- Standard Committee
- C/KESC - Knowledge Engineering Standards Committee
- Working Group
-
LPMEWG - Large-scale Pre-trained Model Evaluation Working Group
- IEEE Program Manager
- Meng Zhao
Contact Meng Zhao - Working Group Chair
- Ruiqi Li
Other Activities From This Working Group
Current projects that have been authorized by the IEEE SA Standards Board to develop a standard.
No Active Projects
Standards approved by the IEEE SA Standards Board that are within the 10-year lifecycle.
No Active Standards
These standards have been replaced with a revised version of the standard, or by a compilation of the original active standard and all its existing amendments, corrigenda, and errata.
No Superseded Standards
These standards have been removed from active status through a ballot where the standard is made inactive as a consensus decision of a balloting group.
No Inactive-Withdrawn Standards
These standards are removed from active status through an administrative process for standards that have not undergone a revision process within 10 years.
No Inactive-Reserved Standards