ML19095B765

RIC 2019 Session T-11, U.S. NRC Operating Experience Data Applications in Risk Modeling Presentation Title: SACADA--A Tool for Operator Training & Human Reliability Analysis Presenter: Y. James Chang

ML19095B765
Person / Time
Issue date:	03/14/2019
From:	James Chang NRC/RES/DRA/HFRB
To:
Lane, John 415-2476
References
Download: ML19095B765 (17)

Text

SACADA Cicada (from Google images)

A Tool for Operator Training and Human Reliability Analysis Y. James Chang, Ph.D.

Human Factors and Reliability Branch Division of Risk Analysis Office of Nuclear Regulatory Research U.S. Nuclear Regulatory Commission Presented at the Regulatory Information Conference Rockville, MD March 12-14, 2019 1

Overview

• A partnership between the U.S. Nuclear Regulatory Commission (NRC) and South Texas Project (STP) developed the SACADA software with two objectives:

- Facilitate operator training

- Provide empirical data to inform human error probability (HEP) estimates

• STP has used SACADA since 2012very positive experience

• The NRC has analyzed SACADA data to inform HEP estimates

• The NRC is developing SACADA-2

• The NRC is looking for more nuclear power plants (NPPs) to use SACADA software SACADA: Scenario Authoring, Characterization, and Debriefing Application 2

What Is SACADA?

(Scenario Authoring, Characterization, and Debriefing Application)

• A tool for operator simulator training

- Author simulation scenarios

- Debrief crew performance

- Other uses (e.g., generate reports, automatically e-mail crew performance information)

• A standalone software

- Not connected to the simulator or other plant systems

• A database for human reliability analysis (HRA)

- Provide an empirical data basis to inform the calculations of HEPs 3

Generic Simulation Scenario Structure Malfunctions/Conditions Initial Condition Fire in No. 12 Condensate Pump Motor US Enter POP04-ZO-0008, Fire/Explosion Elements (Training Activate the fire alarm, make the announcement, CREW Objective and call out the Fire Brigade Elements)

Review 0ERP01-ZV-IN01 for Emergency Plan SM Classification (none required) 4

Scenario Representation in SACADA 5

Different Information Needs between Operator Training and HRA Four students took the same exam with various performance.

60 80 It was somewhat difficult. It was OK.

20 100 Piece of cake It was very difficult.

HRA Analyst:

Training Department: (Predictive Analysis)

(Retrospective How can I reliably Analysis) Find out why predict the failure the two students probability is 50%?

failed the exam and fix the problems.

6

Two Groups of Human Performance Information Retrospective Analysis (Debriefing)

How well was the Predictive Analysis task performed?

(Characterization)

Tell me more about What are the the performance task challenges?

deficiencies.

How to prevent the deficiencies from reoccurring?

7

Authoring Screen Shot 17

Characterization Screen Shot 22

Debriefing Screen Shots Evaluate the Performance Link to INPO Operator Fundamentals 30

Debriefing Screen Shot Understand the Deficiencies

• Seven classes

- Monitoring/Detection

- Diagnosis/Understanding

- Procedure Following/Decisionmaking

- Manipulation

- Supervision

- Teamwork

- Communication

• Stimulate crew to think

• Can choose more than one class 32

Reports Exportable formats: PDF, MS Word, and Excel 44

SACADA-1 vs. SACADA-2 STP and Vogtle Electric Generating Plant, Units 3 and 4, Provide Technical Support for SACADA-2 Development SACADA-1 SACADA-2 Collect Simulator Data Collect Job Performance Measure (JPM) Data Collect Written Exam Results Directly Support Crew Notebook Provide Simulator Guide Track Crew Performance (Simulator only) (All areas)

Track Individual Performance (All areas)

All areas: Simulator, JPM, and written exams.

13

STP Training Departments User Experience

• More efficient and focused debriefing

• Provides consistency between crews in the debriefs

• Ensures the crew addresses an issue

• Issues cannot be minimizeddrills down to the root cause

• Can be used to track individual crew performance as well as overall department performance

• Addresses ACAD Objective 3.3personnel performance and feedback during training are used to evaluate and modify training programs

• Addresses ACAD Objective 3.2managers are engaged in training activities through monitoring and oversight to provide feedback and direction 14

Analyze SACADA Data for HRA

• Three NRC contractors presented methodologies using SACADA to estimate HEPs in an HRA data workshop and PSAM-14 conference in 2018

• The NRC will present the use of SACADA data for HRA methods during the HRA data workshop on March 14-15, 2019, in 3WFB 3A28, NRC HQs

- You are invited to attend the workshop PSAM: Probabilistic Safety Assessment and Management 15

Partner with the NRC on SACADA

• Current NRC partnership with U.S. NPPs includes:

- STP: a user since 2012

- Vogtle Units 3 and 4: started to pilot in January 2019

• Partnership principles:

- The NRC provides free software license, training, and technical support

- NPPs share the data with the NRC for HRA improvements

• The NRC welcomes the partnership of the NPPs 16

NRC Is Happy to Partner with the Nuclear Industry on SACADA Yung Hsien J. Chang, Ph.D. Sean Peters James.Chang@nrc.gov Sean.Peters@nrc.gov Phone: + 1 301-415-2378 Phone: +1 301-415-2293 SACADA Technical Lead Branch Chief and Project Manager 66