This standard specifies general requirements and evaluation methods for the voice interaction capabilities of smart home devices, and specifies the supporting functionalities and corresponding performance metrics. The standard describes four aspects of voice Artificial intelligence (AI) capabilities of smart home devices: speech processing, semantic analytics, AI skill and user interactive experience. · Speech processing includes voice wake-up, voice recognition, text-to-speech and voiceprint recognition. · Semantic analytics includes intent recognition, lexical analysis, syntax analysis and semantic comprehension. · The AI skill includes information retrieval, device voice control, free conversation and life assistant. · User interactive experience indicators range from device response latency to user satisfaction and user engagement. Based on the general specified requirements, the standard also provides test cases and datasets to systematically evaluate the voice interaction capabilities of smart home devices over the four aspects. The requirements included in this standard are language-agnostic, and hence generically applicable to voice interaction assessment of various languages.
- Standard Committee
- CTS/SDSC - Smart Devices Standards Committee
- Status
- Active PAR
- PAR Approval
- 2022-11-10
Working Group Details
- Society
- IEEE Consumer Technology Society
- Standard Committee
- CTS/SDSC - Smart Devices Standards Committee
- Working Group
-
SHDWG - Smart Home Device Working Group
- IEEE Program Manager
- Jiajia Liu
Contact Jiajia Liu - Working Group Chair
- Xiaofei Dong
Other Activities From This Working Group
Current projects that have been authorized by the IEEE SA Standards Board to develop a standard.
P2951
IEEE Draft Technical Requirements and Evaluation Methods for Intelligent Levels of Smart Home Devices
With the development of artificial intelligence technology, the performance of smart home devices has been significantly improved. With the boom in new products, the market is still lacking specifications and evaluation methods to assess product performance. Based on this, an evaluation system to judge the intelligence level of smart home devices from seven dimensions, including foundational capabilities, perception capabilities, cognition capabilities, motion capabilities, coordination capabilities, special skills, and security, has been constructed.
Standards approved by the IEEE SA Standards Board that are within the 10-year lifecycle.
No Active Standards
These standards have been replaced with a revised version of the standard, or by a compilation of the original active standard and all its existing amendments, corrigenda, and errata.
No Superseded Standards
These standards have been removed from active status through a ballot where the standard is made inactive as a consensus decision of a balloting group.
No Inactive-Withdrawn Standards
These standards are removed from active status through an administrative process for standards that have not undergone a revision process within 10 years.
No Inactive-Reserved Standards