ML18033A934
| ML18033A934 | |
| Person / Time | |
|---|---|
| Issue date: | 02/15/2018 |
| From: | Carl Weber NRC/NRO/DCIP/CIPB |
| To: | Mcginty T Office of New Reactors |
| Weber C | |
| References | |
| Download: ML18033A934 (15) | |
Text
February 15, 2018 MEMORANDUM TO: Timothy J. McGinty, Director Division of Construction Inspection and Operational Programs Office of New Reactors FROM: Carl Weber, Reactor Operations Engineer /RA/
Construction Inspection Program Branch Division of Construction Inspection and Operational Programs Office of New Reactors
SUBJECT:
CONSTRUCTION REACTOR OVERSIGHT PROCESS PERFORMANCE METRIC REPORT FOR CALENDAR YEAR 2017 The Construction Reactor Oversight Process (cROP) self-assessment program evaluates the effectiveness of the cROP through its success in meeting pre-established goals and intended outcomes. The staff evaluates performance metrics to determine the success of the cROP in meeting these goals and outcomes. The staff performed the Calendar Year (CY) 2017 performance metric analysis in accordance with Inspection Manual Chapter (IMC) 2522, Construction Reactor Oversight Process Self-Assessment Program, dated July 28, 2014, and IMC 2522 Appendix A, Reactor Oversight Process Self-Assessment Metrics, dated October 4, 2017.
IMC 2522 and its associated appendix describe performance metrics associated with each of four cROP program areas: the inspection program (IP), significance determination process (SDP), assessment (AS) program, and inspection, test, analysis, and acceptance criteria program (ITA). The staff designates the program-specific metrics as the IP, SDP, AS, and ITA metrics, respectively. The staff also monitors and analyzes a metric of a more general nature, which is designated as the O metric, to assess the overall performance of the cROP. The staff uses the metric analyses as an input to the annual Commission paper on cROP self-assessment.
The results of the staffs CY 2017 analysis are enclosed. The staff found that the cROP met 8 out of 8 applicable performance metrics by meeting the criteria defined in IMC 2522 Appendix A.
The results of the staffs CY 2017 analyses are enclosed. Enclosure 1 provides a summary of the metric results and enclosure 2 provides the detailed report. Two metrics were deemed not applicable for the CY 2017 self-assessment. These metrics were related to significant events and timeliness of supplemental inspections. There were no significant evets in CY 2017, and there were no supplemental inspections.
CONTACT: Carl Weber, NRO/DCIP 301 415-6689
T. McGinty 2
Enclosures:
- 1. Self-Assessment Metric Overview
- 2. Self-Assessment Metric Report DISTRIBUTION:
WJones PKrohn MErnstes SWalker NCoovert JHeisserer
ML18033A934 NRO-002 OFFICE NRO/DCIP/CIPB NRO/DCIP/CIPB NAME CWeber VHall DATE 2/15/2018 2/15/2018 Calendar Year 2017 cROP Self-Assessment Metric Report (Enclosures 1 and 2)
SELF-ASSESSMENT METRIC OVERVIEW INSPECTION PROGRAM METRICS IP1: Inspection Reports are issued within IP2: NRC's Response to Technical Timeliness Requirements Assistance Requests (TAR) Is Timely Met Met SIGNIFICANCE DETERMINATION PROCESS METRICS SDP1: SDP Results Are Predictable and SDP2: Appeals of SDP Results Repeatable Met Met ASSESSMENT PROGRAM METRICS AS1: Deviations from AS2: Assessment AS3: Timeliness of AS4: Degradations in the Construction Action Program Results Are Supplemental Quality of Matrix Completed in a Timely Inspections Construction are Manner Gradual and Allow Adequate Agency Engagement of the Licensee Met Met N/A Met ITAAC METRIC ITA1: Analysis of ITAAC Reopened After Closure Verification Met OVERALL cROP METRIC O: Analysis of NRCs Responses to Significant Events N/A Enclosure 1
SELF-ASSESSMENT METRIC REPORT INSPECTION MANUAL CHAPTER 2522 APPENDIX A CONSTRUCTION REACTOR OVERSIGHT PROCESS SELF-ASSESSMENT METRICS 2522A-01 INSPECTION PROGRAM METRICS IP-1 Inspection Reports are issued within Timeliness Requirements Met: Yes Definition: Audit 100% of reactor construction inspection reports issued during the calendar year in relation to the inspection report timeliness requirements in IMC 0613, Power Reactor Construction Inspection Reports.
Criteria: The acceptance criteria is that at least 90% of reactor construction inspection reports issued during the calendar year meet the inspection report timeliness requirements in IMC 0613.
Lead: NRO/DCIP (CIPB)
Goals Supported: Objective, Risk-Informed, Predictable, Effective, Open NOTE: For inspections not conducted by a resident inspector, inspection completion is normally defined as the day of the final exit meeting. For resident inspector and integrated inspection reports, inspection completion is normally defined as the last day covered by the inspection report.
Analysis: All reactor construction inspection reports issued during CY 2017 met the timeliness requirements in IMC 0613.
Enclosure 2
IP-2 NRC's Response to Technical Assistance Requests (TAR) Is Timely Met: Yes Definition: Audit 100% of TARs completed in the calendar year in relation to the TAR timeliness requirements in NRO Office Instruction NRO-COM-108, NRO Construction Inspection Interfaces with Region II.
Criteria: The acceptance criteria is that at least 90% of TARs are closed during the calendar year within TAR timeliness goals outlined in NRO-COM-108.
Lead: NRO/DCIP (CIPB)
Goals Supported: Objective, Risk-Informed, Understandable, Open, Effective Analysis: All TARs closed in 2017 were closed in accordance with the timeliness requirements specified in NRO-COM-108.
2
2522A-02 SIGNIFICANCE DETERMINATION PROCESS METRICS SDP-1 SDP Results Are Predictable and Repeatable Met: Yes Definition: Audit 100% of construction inspection program inspection findings issued during the calendar year against the significance determination process in IMC 2519, Construction Significance Determination Process, and its appendices.
Criteria If greater than 10 findings were issued during the calendar year, then at least 90% of them contain adequate detail to enable an independent auditor to trace through the significance determination process in IMC 2519 and its appendices and reach the same significance color characterization.
If 10 or fewer findings were issued during the calendar year, then no more than 1 of them did not contain adequate detail to enable an independent auditor to trace through the significance determination process in IMC 2519 and its appendices and reach the same significance color characterization.
Lead: NRO/DCIP (CIPB)
Goals Supported: Risk-Informed, Predictable Analysis: All findings issued in 2017 were reviewed by an independent auditor from Headquarters, and all of the findings contained adequate detail to enable the independent auditor to trace through the significance determination process in IMC 2519 and its appendices and reach the same significance color characterization.
3
SDP-2 Appeals of SDP Results Met: Yes Definition: Track the total number of appeals of final SDP results during the calendar year.
Criteria: The acceptance criteria is that there are zero appeals of SDP significance that result in a final determination being overturned during the calendar year.
Lead: Regions, NRO/DCIP (CIPB)
Goals Supported: Risk-Informed, Objective, Predictable, Understandable, Open Assessment: There were no appeals of final SDP results during CY 2017.
4
2522A-03 ASSESSMENT PROGRAM METRICS AS-1 Deviations from the Construction Action Matrix Met: Yes Definition: Audit all assessment-related letters during the calendar year and count the number of deviations from the Construction Action Matrix.
Criteria: The acceptance criteria is that there are zero deviations from the Construction Action Matrix during the calendar year.
Lead: NRO/DCIP (CIPB)
Goals Supported: Objective, Risk-Informed, Open Assessment: There were no deviations from the Construction Action Matrix during CY 2017.
5
AS-2 Assessment Program Results (Assessment Reviews, Assessment Letters and Public Meetings) Are Completed in a Timely Manner Met Yes Definition: Audit 100% of Assessment Reviews, Assessment Letters and Public Meetings issued/conducted during the calendar year in relation to the timeliness requirements in IMC 2505, Periodic Assessment of Construction Inspection Program Results.
Criteria: The acceptance criteria is that at least 90% of the timeliness goals for the assessment process are met during the calendar year.
Lead: Region, NRO/DCIP (CIPB)
Goals Supported: Effective, Open, Predictable Assessment: All Assessment Reviews, Assessment Letters and Public Meetings issued/conducted during CY 2017 met the timeliness requirements in IMC 2505, Periodic Assessment of Construction Inspection Program Results.
6
AS-3 Timeliness of Supplemental Inspections Met: N/A Definition: Count the number of instances during the calendar year where a finding was held open for more than six months due to the need to complete the supplemental inspection.
Criteria: The acceptance criteria is that there are no instances during the calendar year when a supplemental inspection has not been completed within six months for which the licensee had indicated they were prepared for the inspection.
Lead: Region, NRO/DCIP (CIPB)
Goals Supported: Effective, Predictable Assessment: There were no supplemental inspections required during CY 2017.
7
AS-4 Degradations in Quality of Construction are Gradual and Allow Adequate Agency Engagement of the Licensee Met: Yes Definition: Track the number of instances during the calendar year in which a construction site moves more than one column to the right in the Construction Action Matrix.
Criteria: The acceptance criteria is that there are no instances during the calendar year in which performance issues cause a construction site to move more than one column to the right in the Construction Action Matrix.
Lead: NRO/DCIP (CIPB)
Goals Supported: Risk-Informed, Predictable Assessment: There were no instances during FY 2017 in which a construction site moved more than one column to the right in the Construction Action Matrix.
8
2522A-04 ITAAC METRICS ITA-1 Analysis of ITAAC Reopened After Closure Verification Met: Yes Definition: Audit 100% of ITAAC that are reopened after closure verification during the calendar year.
Criteria: The acceptance criteria is that there are no ITAAC that have been verified as having been met that are reopened during the calendar year because of a deficiency in the process that was within the NRCs ability to identify before closure verification.
Lead: NRO/DCIP (CIPB, HOIB)
Goals Supported: Effective, Risk-Informed Assessment: There were no ITAAC that were reopened after closure verification during CY 2017.
9
2522A-05 OVERALL cROP METRICS O-1 Analysis of NRCs Responses to Significant Events Met: N/A Definition: Review 100% of incident investigation teams (IITs) and augmented inspection teams (AITs) inspection reports that are issued during the calendar year to determine if major programmatic voids were identified during the cROP review portion of IITs and AITs.
Criteria: The acceptance criteria is that there are no major programmatic voids identified during the cROP review portion of IITs and AITs.
Lead: NRO/DCIP (CIPB)
Goals Supported: Effective, Predictable Assessment: There were no IITs or AITs performed or issued during CY 2017.
10