IEEE Std 2003-1997 IEEE Standard for Information Technology—Requirements and Guidelines for Test Methods Specifications and Test Method Implementations for Measuring Conformance to POSIX® Standards -Description
Abstract: This standard defines the requirements and guidelines for test method specifications and test method implementations for measuring conformance to POSIX standards. Test specification standard developers for other Application Programming Interface (API) standards are encouraged to use this standard. This document is aimed primarily at developers and users of test method specifications and implementations.
Keywords: assertion, assertion test, implementation under test, option, conformance document, conformance test procedure, conformance test software, test method implementation, test method specification, test result code
Content
1. General
1.1 Scope
1.2 References
1.2.1 Normative References
1.2.2 Informative References
1.3 Conformance Criteria
1.3.1 Test Method Specification Conformance Criteria
1.3.2 Test Method Implementation Conformance Criteria
1.4 IUT Conformance Assessment
2. Definitions and General Requirements
2.1 Conventions
2.2 Definitions
2.2.1 Terminology
2.2.2 General Terms
2.2.3 Abbreviations
3. Assertion Definitions, Types, Syntax, and Constructs
3.1 Introduction
3.2 Generic Assertion Structure
3.2.1 For
3.2.2 If then Else
3.2.3 Applicable Standard
3.2.4 Option
3.2.5 Test Support
3.2.6 Setup Requirements
3.2.7 Test Text
3.2.8 Testing Requirements
3.2.9 Notes
3.3 Assertion Types and Constructs
3.3.1 Assertion Identifiers
3.3.2 Basic Assertion
3.3.3 General Assertions
3.3.4 Reference Assertions
3.3.5 Documentation Assertions
3.3.6 General Documentation Assertions
3.3.7 Unused Assertion Identifiers
3.4 Macros
3.4.1 Introduction
3.4.2 Macro Naming Convention and Usage
3.5 Summary
4. Test Result Codes
4.1 Introduction
4.2 Test Method Implementations
4.2.1 Intermediate Test Result Codes
4.2.2 Final Test Result Codes
4.3 Test Method Specifications
4.3.1 Conforming Test Result Codes
5. Test Report
5.1 Test Report
5.2 CD Audit
6. Profiles
6.1 Definition
6.2 Conformance to a Profile
6.2.1 Profile Test Methods
6.2.2 Base Standard Test Methods
6.2.3 Profile-Specific Test Methods
6.3 Conformance Assessment
6.3.1 Using Multiple Base Test Method Standards
6.3.2 Using Profile Test Method Standards
7. Guidelines for Testing and Complexity Levels
7.1 Introduction
7.2 Testing Levels
7.2.1 Exhaustive Testing
7.2.2 Thorough Testing
7.2.3 Identification Testing
7.3 Complexity Levels
7.3.1 Simple
7.3.2 Intermediate
7.3.3 Complex
7.4 Conclusion
8. Guidelines for Writing Assertions
8.1 Introduction
8.1.1 Identifying Conformance Requirements
8.1.2 Identifying Requirements and Assertion Types
8.1.3 Basic Assertions via Examples
8.1.4 Conclusion
8.2 Identifying Preconditions
8.2.1 <Applicable_Standard>
8.2.2 Option
8.2.3 Test Support
8.2.4 Setup
8.3 Writing the <Test_Text>
8.3.1 Using Tables
8.3.2 Using Testing Requirements
8.3.3 Notes
8.4 Other Assertion Types
8.4.1 General Assertions
8.4.2 Reference Assertions
8.4.3 Documentation Assertions
8.5 Macros
9. Comprehensive Examples
9.1 Specification of Allowable Test Result Codes
9.1.1 Example: C Binding Allowable Test Result Codes for write()
9.1.2 Example: C Binding Assertions for write()
9.1.3 Example: Ada Binding Assertions for write()
Annex A Bibliography
A.1 Related Standards
Annex B Rationale and Notes
B.1 General
B.1.1 Scope
B.1.3 Conformance Criteria
B.2 Definitions and General Requirements
B.2.2 Definitions
B.3 Assertion Definitions, Types, Syntax, and Constructs
