ML19011A318
| ML19011A318 | |
| Person / Time | |
|---|---|
| Issue date: | 01/11/2019 |
| From: | Dagostino A, Stephanie Morrow Office of Nuclear Reactor Regulation |
| To: | |
| Rezai A, 3014151328 | |
| References | |
| Download: ML19011A318 (14) | |
Text
Human Factors in NDE:
Progress Update January 2019 NRC: Amy DAgostino, Stephanie Morrow, Niav Hughes, Carol Nove PNNL: Tom Sanquist 1
=
Background===
- Project started in 2015 at NRR request
- Research goals:
- 1. Systematically evaluate the human factors that can affect UT examiners
- 2. Identify future actions to address human factors challenges in NDE
- Multi-method approach 2
Research Approach TOPIC CHARACTERIZATION Obtain high-level understanding of NDE human factors Methods: SME discussions, code reviews, plant visits, EPRI visits NRC Technical Letter Report: Review of Human Factors Research in Nondestructive Examination https://www.nrc.gov/docs
/ML1705/ML17059D745.
pdf 3
Detailed description of examiner task Methods: 61 SME interviews, procedure reviews, plant visits, EPRI visits NRC/PNNL Technical Letter Report (PNNL-27441): Human Factors in Nondestructive Examination: Manual Ultrasonic Testing Task Analysis and Field Research.
https://www.nrc.gov/docs/M L1817/ML18176A055.pdf TASK ANALYSIS Identify areas for future action 2 interactive presentations to stakeholders - what is working, what is not?
Joint NRC/EPRI Presentation publicly available (ML18214A191)
Additional findings will be incorporated into forthcoming NRC NUREG STRATEGIC PLANNING
Factors Identified by Examiners as Important Planning
- Timely communications between utility and vendor
- Completeness and accuracy of work package
- Adequate preparation of component
- Availability of work opportunities and personnel Preparing
- Variations in standards and expectations across organizations
- Adequate time for preparation
- Equipment selection, setup, and usability
- Proper calibration
- Calculation of exam coverage
- Procedure usability
- Last minute changes or delays during preparation
- Quality of pre-job brief Conducting
- Disruptions or delays in conducting exam
- Identification of correct component
- Awareness when conditions do not match expectations
- Accessibility of component
- Distractions from external sources during exam
- Distractions due to physical environment
- Time pressure during scanning
- Field conditions affect signal interpretation (relevant vs. non-relevant)
- Working in pairs Reporting
- Adequate time for documentation
- Lack of standardized process for documentation Training and Practice
- Access to samples to practice detecting flaws
- Opportunities for feedback
- Opportunities for gaining practical on-the-job experience
Summary of Stakeholder Feedback (1 of 2)
- Training and Practice Access to samples improving (e.g., EPRI Specimen Management Tool (SMT))
Post-job briefs would be opportunity for feedback, but not as consistently practiced as pre-job briefs Desire for more practical experience, barriers exist when Level 1 field experience not prioritized
- Planning Exam EPRI Best Practice document addresses utility/vendor communication, potential gap in disseminating best practice information Good practice of having walk down prior to exam
- Preparing for Exam Some equipment allows calibrations to be performed automatically - reduces opportunity for calibration errors Last minute changes are a significant issue, but difficult to change Pre-job brief quality has improved significantly in last 10 years 5
Summary of Stakeholder Feedback (2 of 2)
- Conducting Exam Using Level III as buffer can help with distractions during exam Perceived time pressure recognized as problem, may be lessened through communication (i.e., during pre-job brief)
Positive comments regarding working in pairs, but can be dependent on composition of pairbetter to have two knowledgeable examiners Recent positive results with team scanning seem to be reducing skepticism toward the practice
- Reporting Results Adequate time for documentation is a recognized challenge, can be dependent on workload and pressure from utility Lack of standardized documentation a frustration, errors can be mitigated by sharing sample documentation prior to inspection Possible opportunity to better standardize documentation across industry with same code requirements and more uniform procedures 6
Research Findings Useful for Developing Error Modeling Frameworks to Identify Error Mitigation Opportunities 7
Systematic Identification of Error Types, Precipitating Factors and Potential Consequences (1 of 2) 8
Systematic Identification of Error Types, Precipitating Factors and Potential Consequences (2 of 2) 9
Human Factors in NDE: Next Steps
- NRC team preparing NUREG in FY19 - formal publication of research results
- Human factors insights will be incorporated into other ongoing projects (e.g., Training and Practice)
- NRC may pursue additional human factors research topics following completion of NUREG 10
Training and Practice for NDE 11
How much time does it take for a person to learn to a criterion of mastery?
What are the factors that determine retention of information (e.g.,
time, repeated use, practice)?
How many hours are required to become proficient?
What kinds of hours are required (e.g., field, classroom, lab)?
What kinds of retraining or practice are necessary, over what period?
How much retraining or practice is necessary to maintain or enhance competency?
12 Training and Practice Research Questions
Step 1: Literature Review 13
- Basic Science of Learning Study of how people learn
- Science of Training & Instruction Study of how to help people learn
- Science of Expert Performance Study domain experts Product: Detailed review of the relevant areas and finding, with a written report ~ Summer 2019.
NEXT STEPS:
- Understanding current training/practice Subject matter experts for in-person or telephone interviews are desired -
Please contact us
Thank You If you have questions or interest in participating in future research, please email:
Amy.Dagostino@nrc.gov or Stephanie.Morrow@nrc.gov 14