Validation

About
The Validation process provides the objective evidence that the capability provided by the system complies with stakeholder performance requirements, achieving its use in its intended operational environment. Validation answers the question, "Is it the right solution to the problem?" Validation consists of evaluating the operational effectiveness, operational suitability, sustainability and survivability (including cybersecurity) or lethality of the system or system elements under operationally realistic conditions.
Roles
The Program Manager (PM) and Systems Engineer support the Validation process. The Chief Developmental Tester is responsible for the execution of the Validation process, which is typically conducted by independent testers as documented in the Test and Evaluation Master Plan (TEMP) (See T&E Enterprise Guidebook. System end users and other stakeholders are typically involved in validation activities. Guidance for managing and coordinating integrated testing activities can be found in the T&E Enterprise Guidebook and DoDI 5000.89, Test and Evaluation. Using and engaging integrated test teams, composed of knowledgeable and experienced Government and industry developmental and operational testers bring different perspectives and allow for an efficient use of resources.
Activities
Validation activities can be conducted in the intended operational environment or on an approved simulated environment. Early program-validation activities assist in the production of validated Concept of Operations/Operational Mode Summary/Mission Profile (CONOPS/OMS/MP), system performance specifications, use cases, functional and physical system architectures and test cases.
Validation is applied to the product baseline to ensure the emerging design meets the end-user needs. Models, simulations, mockups and prototypes may be used in these early activities. They are often combined with the verification activities (see SE Guidebook Section 4.2.6. Verification Process).
Aggressive early validation significantly mitigates the risk to the program by identifying operational issues up front when they are easier and less costly to fix. This ultimately improves system performance during the final validation activity (e.g., operational test and evaluation (OT&E)).
Outputs
Final validation involves operational testing on a production-representative system in an operationally realistic environment. The product of the Validation process is a validated system and enabling system elements, leading to approval for Full-Rate Production (FRP) and/or a Full Deployment (FD) Decision Review (DR).
Products and Tasks
Product | Tasks |
---|---|
AWQI 8-1-1: Evaluate system as suitable and effective in an operationally-representative environment |
|
Source: AWQI eWorkbook
Resources
Key Terms
- Integrated testing (Source: DoDI 5000.89 Glossary)
- Additional Performance Attribute
- Capability Development Document (CDD)
- Concept of Operations (CONOPS)
- Early Operational Assessment (EOA)
- Initial Operational Capability (IOC)
- Initial Operational Test and Evaluation
- Inspection
- Key Performance Parameter
- Key System Attribute
- Lethality
- Mission Profile
- Operational Assessment
- Operational Effectiveness
- Operational Environment
- Operational Mode Summary
- Operational Suitability
- Operational Test and Evaluation (OT&E)
- Operational Test Readiness Review
- Operational Testing
- Test Readiness Review
- Production Representative Article/System
- Survivability
- Sustainability
- Test & Evaluation Master Plan (TEMP)
- Testing
- Validation
- Verification
- Verification, Validation, and Accreditation
Source:
DAU Glossary
DAU ACQuipedia
Policy and Guidance
- SE Guidebook, Section 4.2.7 Validation Process
- DoDI 5000.89, Section 6 Operational Test & Evaluation and Live Fire Test & Evaluation
- IEEE 15288.1-2014 Section 6.4.11 Validation process [no URL provided since document is copyrighted]
- SEBoK ??? System Validation
- DoD Cybersecurity Test and Evaluation Guidebook
- DoD Cybersecurity Test and Evaluation Guidebook Addendum
- Systems Engineering Plan (SEP) Outline Section 2.1 Requirements Development
- Test and Evaluation Enterprise Guidebook
DAU Training Courses
- CLE 002: Introduction to the Test & Evaluation (T&E) of Autonomous Systems
- CLE 023: Modeling and Simulation in Test and Evaluation
- CLE 029: Testing in a Joint Environment
- CLE 030: Integrated Testing
- CLE 039: Environmental Issues in Test and Evaluation
- CLE 060: Practical Software and Systems Measurement
- CLE 079: Chemical, Biological, Radiological, and Nuclear (CBRN) Survivability
- CLE 085: Scientific Test and Analysis Techniques in T&E
- LOG 0030: Supportability Test & Evaluation???
- TST 102: Fundamentals of Test and Evaluation
- TST 2040V: Test and Evaluation for Practitioners
- TST 1100: Intro to Systems Engineering for Testers
- TST 2100: Applied Systems Engineering for Testers
- WSE 006: Engineering Management Workshop (EMW)
- WSE 026: Test & Evaluation Across the Acquisition Life Cycle
- WSS 013: Cyber Training Range ??? Aviation Systems
Media
- Developmental and Operational Testing
- Life Fire Test & Evaluation
- Major Programs: Test & Evaluation
- Test & Evaluation playlist