ML25133A078
| ML25133A078 | |
| Person / Time | |
|---|---|
| Issue date: | 05/13/2025 |
| From: | Brian Green NRC/NRR/DRO |
| To: | |
| References | |
| Download: ML25133A078 (10) | |
Text
Using Glass Top Simulators for Human Factors Evaluations Brian Green, Ph.D.
U.S. Nuclear Regulatory Commission Senior Technical Advisor for Human Factors t,NPIC HMIT=
N 14th International Topical Meeting on Nuclear Plant Instrumentation, Control &
Human-Machine Interface Technologies
Overview
- Background
- Recent Experience: Using Glass Top Simulators Supporting Human Factors Reviews
- Moving Forward: Development of a New Standard - ANS 3.5.1 Disclaimer: This presentation addresses the use of glass top simulators for conducting human factors evaluations. It does not address the acceptability of using glass top simulators for other purposes (such as stimulation testing, procedure validation, evaluation of mathematical models, etc.)
8ANS.
=
Background===
ANS 3.5 simulators provide a high degree of fidelity.
Necessary for operator licensing exams and training
Demand for ANS 3.5 simulator is high Used for other purposes (procedure validation, model validation, human factors evaluations, etc.)
High-fidelity simulation is useful for these applications as well but may not always be necessary.
Glass top simulators are relatively low cost and have potential to support tasks other than operator licensing.
Free up the ANS 3.5 simulator for operator training Facilitate additional testing that isnt otherwise possible due to the limited availability of ANS 3.5 simulators Minimize impact on other licensed activities (like OL exams)
Guidance is needed to understand when a particular glass top simulator is fit for purpose.
TURBIN[ CONTROL & PROT(CTlON SYSTCM
Recent Experience: Using Glass Top Simulators Supporting Human Factors Reviews Lessons Learned from Limerick & Turkey Point
- NRC hosted several public pre-applications meetings to discuss challenges with applying HFE to license amendments under ISG-06.
- Schedule challenges with integrated system validation
- How to modify the simulator without interfering with other regulated activities?
- Glass top simulators considered as a possible solution
- NRC staff interpreted existing guidance in NUREG-0711 regarding HFE testbed fidelity to be inclusive of simulators other than the ANS 3.5 simulator, if the fidelity is sufficient to provide valid results.
8ANS.
- Licensee subject matter experts (SMEs) review capabilities and features of the glass top simulator
- Is the fidelity close to what is described in ANS 3.5?
What are the differences in fidelity?
Identify and document deviations (environment, spacing of panels, line of sight, systems not modeled, etc.)
- SMEs reviews deviations to ensure they do not inappropriately bias conduct of HFE tests or outcomes of HFE activities
- NRC reviews deviations, any supporting evaluations, and observes validation activities to ensure that HFE tests provide believable results.
For an example of a staff audit ADAMS Accession No. ML25070A309.
Note: to date, neither review has been completed. No significant issues regarding the safe use of glass top simulators have been identified.
Assessing the Glass Top Simulator 8ANS.
Moving Forward: Development of a New Draft Standard American Nuclear Society ANS 3.5.1*
Nuclear Power Plant Simulators for Use in Simulation-Assisted Engineering and Non-Operator Training
- Standard number subject to change
Current Scope of DRAFT ANS 3.5.1 General approach: SMEs consider the factors described above and apply them to 6 use types.
- 1. Supporting existing NPP engineering activities and procedure development
- 2. Existing NPP quantitative engineering analysis
- 3. Design analysis and development of new reactor designs
- 4. Reducing risk of site testing and commissioning, interfaces between central and component-specific control systems, and hardware in the loop
- 5. Non-licensed operator and other personnel training
- 6. Early-stage/system-level existing NPP design analyses Recent efforts to simplify, potentially by reducing the discussion of use types and relying on a single evaluation process regardless of use type.
- ANS 3.5 Nuclear Power Plant Simulators for Use in Operator Training and Examination.
- ISG Digital Instrumentation and Controls, DI&C-ISG-06 Licensing Process - Interim Staff Guidance, Revision 2. (ADAMS Accession No. ML18123A118).
- Limerick Generation Station, Units 1 and 2 - Regulatory Audit Report for Review of Human Factors Engineering Portion of Limerick Digital Instrumentation and Controls License Amendment Request (EPID L-2022-LLA-0140), February 7, 2025, (ADAMS Accession No. ML25010A151).
- NRC Presentation 2 - Digital I&C Workshop on Lessons Learned from the Implementation of DI&C-ISG-06, Digital I&C Lessons Learned, (ADAMS Accession No. ML25070A309).
- NUREG-0711 - Human Factors Engineering Program Review Model, Revision 3. (ADAMS Accession No. ML12324A013).
- NUREG-0800 - Chapter 18 Standard Review Plan for the Review of Safety Analysis Reports for Nuclear Power Plants: LWR Edition - Human Factors Engineering, Revision 3. (ADAMS Accession No. ML16125A114).
- OHara, J. (2025) Analytical and Performance-Based Evaluation Alternatives to Full-Scope, High-Fidelity Testbeds, BNL-227577-2025-INRE. (ADAMS Accession No. ML25090A259).
References 8ANS.
Bonus Slides 8ANS.
Testbed Fidelity from NUREG-0711
- 1. Interface completeness
- 2. Interface physical fidelity
- 3. Interface functional fidelity
- 4. Environmental fidelity
- 5. Data completeness fidelity
- 6. Data content fidelity
- 7. Data dynamics fidelity
- 8. Ability to test important actions that occur outside the control room
- 9. Verification of testbed characteristics before use A glass top simulator is another potential approach 11.. 4.3.. 3 Validation *restbeds A testbed is the HSII representation used to perform validation evaluations. O1ne approach an applicant can use to acoeptab ly Im1eet criteria 1 through 7 in this se,ction iis to use a testbed that is co1m1pl~ant with "Nuclear Power Plant s.imulators for ILJlse in Operator Training' 111 (ANS,, 2009).
8ANs*