This standard specifies general requirements and evaluation methods for the voice interaction capabilities of smart home devices, and specifies the supporting functionalities and corresponding performance metrics. The standard describes four aspects of voice Artificial intelligence (AI) capabilities of smart home devices: speech processing, semantic analytics, AI skill and user interactive experience. · Speech processing includes voice wake-up, voice recognition, text-to-speech and voiceprint recognition. · Semantic analytics includes intent recognition, lexical analysis, syntax analysis and semantic comprehension. · The AI skill includes information retrieval, device voice control, free conversation and life assistant. · User interactive experience indicators range from device response latency to user satisfaction and user engagement. Based on the general specified requirements, the standard also provides test cases and datasets to systematically evaluate the voice interaction capabilities of smart home devices over the four aspects. The requirements included in this standard are language-agnostic, and hence generically applicable to voice interaction assessment of various languages.
- Sponsor Committee
- CTS/SDSC - Smart Devices Standards Committee
- Status
- Active PAR
- PAR Approval
- 2022-11-10
Working Group Details
- Society
- IEEE Consumer Technology Society
Learn More - Sponsor Committee
- CTS/SDSC - Smart Devices Standards Committee
- Working Group
-
SHDWG - Smart Home Device Working Group
Learn More - IEEE Program Manager
- Jiajia Liu
Contact - Working Group Chair
- Xiaofei Dong
Other Activities From This Working Group
Current projects that have been authorized by the IEEE SA Standards Board to develop a standard.
P2951
Technical Requirements and Evaluation Methods for Intelligent Levels of Smart Home Devices
This standard provides a general intelligence level architecture for smart home devices, in order to stipulate their capabilities equipped by various sensors, hardware and software. The standard specifies home device intelligence capabilities mainly from seven aspects, including computation, perception, cognition, motion, coordination, skills, and security. u00b7tThe computation comprises of computing, memory, storage, and network components. u00b7tThe perception includes speech and vision. u00b7tThe cognition is enabled by natural language processing and other related technologies. u00b7tThe motion involves decision-making and route planning. u00b7tThe coordination describes how the device interacts with others. u00b7tThe skills refer to study, education, entertainment, and others based on the type and domain of devices. u00b7tThe security includes electromagnetic compatibility and system security.
Standards approved by the IEEE SA Standards Board that are within the 10-year lifecycle.
No Active Standards
These standards have been replaced with a revised version of the standard, or by a compilation of the original active standard and all its existing amendments, corrigenda, and errata.
No Superseded Standards
These standards have been removed from active status through a ballot where the standard is made inactive as a consensus decision of a balloting group.
No Inactive-Withdrawn Standards
These standards are removed from active status through an administrative process for standards that have not undergone a revision process within 10 years.
No Inactive-Reserved Standards