ML102460722
Text
QF-0426 Rev 2 (FP-PA-SA-01)
Page 1 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATEAction Request Number: 01205468 Assessment Descriptive Title: 2010 PI&R Focused Self-Assessment Assessment Dates:
June 7-11, 2010 Note: Focused Self-Assessment is part of the QATR with requirements described in Section C Assessment and C.2 Self-assessment.
1.0INTRODUCTION
& SCOPE This Focused Self-Assessment was conducted to assess health of the Prairie Island Corrective Action and Self-Assessment Programs as well as to assess readiness for the 2010 Nuclear Regulatory Commission 71152 (Problem Identification and Resolution) Inspection. The scope of the assessment was based upon the Plan and Checklist approved by PARB. Specific information sources are provided as an attachment to this report within the Docume nt List. The completed checklist with details of objectives is also attached to this report. A summary of Objectives is as follows: Objective 1: Verify that station problems are being identified, reported and properly screened. Objective 2: Verify that evaluation of problems and identification of corrective actions are commensurate with the significance of the problem. Objective 3: Determine the effectiveness of corrective actions resolving identified problems. Objective 4: Verify that performance indica tors effectively characterize corrective action program performance and that CAP trending identifies potential adverse trends. Objective 5: Assess the effectiveness of management oversight of the CAP. Objective 6: Assess the effectiveness of the Focused Self-Assessment Program. Objective 7: Assess the effectiveness of the Site's Response to NOS-identified issues. Objective 8: Assess the effectiveness of CAP Liaisons in implementing the corrective action program. 2.0 TEAM MEMBERSTeam Sponsor: Kurt Petersen, Prairie Island Business Support Manager Team Leader: Andy Notbohm, Prairie Island Performance Assessment Supervisor Team Member: Matt Birkel, Prairie Island CAP Coordinator Team Member: Doug Horgen, Monticello Performance Assessment Supervisor Team Member: Mary Lou Fish, Monticello CAP Coordinator Team Member: John Windschill, Fleet Performance Assessment Manager Team Member: Jim Langer, Kewaunee Power Station CAP Coordinator Team Member: Frank Sienczak, Prairie Island Operations CAP Liaison Team Member: Turney Hazlet, Prairie Island Maintenance Supervisor Team Member: Tom Severson, Prairie Island Program Engineer 3.0 EXECUTIVE
SUMMARY
Corrective Action Program performance has improved over the past 12 months, but remains below expectations. One significant gap in oversight of the Corrective Action Program must be corrected prior to the NRC 711152 inspection. Improvement is observable in CAP initiation quality, AR Screen Team decisio n-making, causal evaluation quality, corrective action quality, and oversight enforcement of procedural standards. A significant, but manageable gap persists in oversight of the Corrective Action Program, specifically in manager/supervisor ownership of elemen ts of the Program. The gap is observable in stagnant performance below expectations in Performance Improvement Report Card Key Performance Indicators and Corrective Action implementation quality. From retained in accordance with record retention schedule identified in FP-G-RM-01 NSP000049 QF-0426 Rev 2 (FP-PA-SA-01)
Page 2 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE4.0STRENGTHSThis assessment did not identify any strengths.
5.0ENHANCEMENTS / AREAS FOR IMPROVEMENTArea for Improvement #1 (AR 01187837) Managers and Supervisors do not consistently accept ownership or accountability for the implementation of the Corrective Action Program, specifically in ownership of Performance Improvement Report Card Key Performance Indicators and accountability for Corrective Action Implementation Quality. Supporting Examples:
o Overdue Corrective Action Assignments continues to persist at an unacceptably high level.o Performance Improvement Report Card Key Performance Indicators for many departments have not sustainably nor significantly improved from performance below expectations since inception of the metrics in 4 th Quarter 2009.
o Performance Assessment Review Board and Technical Review Panel continue to reject unacceptably high numbers of completed "A" and "B" Corrective Actions o Maintenance and Training Departments have not been consistently represented during AR Screening.
o RCE 01178236 has not been completed more than 1 year after identification of the Turbine Building Flooding issue and more than 6 months after recognition of the need for the Root Cause Evaluation. Consequences: Failure to correct this condition has resulted in ineffective resolution of the station's most significant issues (as evidenced by repeat events in equipment and human performance reflected in AR 01216005) and stakeholder concerns with Corrective Action Program Effectiveness. This condition has also resulted in a negative impact on station personnel perception of and willingness to utilize the Corrective Action Program, as identified in AR 01211532. Cause: The cause for this condition is inconsistent reinforcement and accountability by senior station management with respect to the behaviors of managers and supervisors. Corrective Actions: The cause will be corrected by senior management reinforcement of expectations and standards for ownership and accountability for the Corrective Action Program. Actions 24-27 to provide clear expectations and reinforcement of desired behaviors have been added to AR 01187837 with a scheduled completion date for these actions of July 31, 2010. Area for Improvement #2 (AR 01232765) Process interfaces between the Corrective Action Program, Work Management, Engineering Change, Procedure Change, and Project Review Group are not consistently ensuring correct priorities, timeliness of actions, and resolution of issues. Supporting Examples:
o AR 01232765: Site DRUM identified trends in error codes related to process interrelationships and action ties between pro cesses. Contributing to the trend was identification of several instances of work tied to OBN/OBD or MR equipment not being completed in a timely manner.
o AR 01236492: NOS identified some WR/WO and CAPs were not correctly cross-referenced.
o AR 01236596: NOS identified instances of PCRs driven by CAPs being scheduled past due dates.
o AR 01236579: NOS identified instances of PCR priority not correlating with CAP priority.o AR 01236577: NOS identified instances of PCRs not correctly corss-referenced to CAPs. o Interviews with process owners indicate that roles and responsibilities are not clear and that consistent prioritization is not achieved from one process to another. From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 3 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE Consequences: Failure to correct this condition may result in actions required to Significant Conditions Adverse to Quality or Conditions Adverse to Quality and their causes; this condition has also resulted in untimely resolution of important equipment issues. Cause: The causes for this condition we re determined to be the following:
o Standards for cross-referencing various processes are complex and contained within multiple procedures, creating error-likely situations where specific requirements for cross-referencing may not be known.
o Roles and responsibilities are not clearly defined for what action must be taken for each interface.
o Passport relies on human interface to make appropriate cross-references in many cases vice an automatic function.
o In some cases, human performance errors due to inattention and lack of knowledge of standards have resulted in missed cross-references or due date compliance. Corrective Actions: AR 01232765 has an acti on (01) to conduct alignment sessions to streamline processes. This action is due July 31. The specific failure modes found during this assessment will be corrected by this action. The assigned-to for the action is aware of the findings of this assessment. Area for Improvement #3 (AR 01222084, 01197730, 01236960) Immediate and Prompt Operability determinations, in some cases, do not provide adequate details to make risk-informed decisions to adequately address the issue. Supporting Examples:
o AR 01233549 (U-2 Charging System Design Pressure Exceeded) NOS Identified potential inadequacy in initial response to the issue. An OPR was initially requested and subsequently cancelled based upon walkdown results not identifying leaks or visible damage to limiting components. During this assessment, it was questioned whether structural integrity was adequately addressed as the maximum pressure was not determined and there is no discussion of impact to elasticity / yield properties of the material. Additionally, it was noted that there was no discussion of impact to required Boric Acid Flowpaths to the core in a shutdown condition (AR 01236955 was written to document and resolve this question).
o AR 01222084: NOS-Identified Adverse Trend in OPR Completion. The performed ACE found that 24 of 88 OPRs in-scope requi red revision for technical or procedural compliance errors.
o AR 01197730: This CAP addresses areas for improvement from a recently-completed Operability/Functionality FSA with respect to quality of Immediate Operability decisions and documentation.
o AR 01193081(FP-30-4, Difficult to Operate) Ops status notes state the "valve is still able to be manipulated and is functional." The team's review determined that the notes do not adequately address impact to the system.
o AR 01198510 (Bent Hangers RLWDH-117, RSIH-484 and RHRRH-7) Ops status notes state "The hangers in question have been evaluated by engineering and determined to still meet the requirements of their function to support the system piping." The team's review determined that the notes do not adequately address impact to the RHR System From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 4 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE o FP-OP-OL-01 requirements with respect to resolution of Functionality issues are not implemented effectively by the fleet. Step 5.3.2.5 states "Corrective Actions for degraded but functional equipment will be tracked per the Corrective Action Program FP-PA-ARP-01." Additionally, Attachment 3 (Guideline for Functionality Assessment) states "Timing of Corrective Actions - When establishing a corrective action plan, the actions should address any degraded or nonconforming condition in a time frame commensurate with the safety significance of the condition. If corrective action plan does not resolve the degraded or nonconforming condition at the first available opportunity or prior to the next scheduled use of the equipment, then the CAP AR should justify a longer completion schedule." Currently neither Prairie Island nor Monticello have a means in place to track resolution of Functionality issues and, in many cases, Functionality issues are closed to the work management process in accordance with the procedure for "C" severity CAPs. Benchmarking with Dominion plants indicates that Dominion does track resolution of Functionality issues within CAP. As it stands, Prairie Island and Monticello are not implementing the requirements of FP-OP-OL-01. The causes are that FP-PA-ARP-01 does not align with FP-OP-OL-01 and the guidance of FP-OP-OL-01 is not sufficiently detailed to describe the intent. Consequences: This condition has resulted in uncorrected con ditions, repeat events, and inadequate screen team decisions. AR 01222084 will address aspects of this AFI related to OPR quality. AR 01197730 will address aspects of this AFI related to Immediate Operability quality. The Operations Manager has been informed of the identified gap related to discussion of component impact on system operability/functionality. AR 01236960 has been written to resolve the aspects of this AFI related to procedural guidance for resolution of Functionality issues. Area For Improvement #4 (AR 01231245) Current Corrective Action structure does not align with industry benchmarking of Dominion, Exelon, and other plants through the Corrective Action Program Owner's Group in that Xcel Energy considers all items tracked under CAP as Corrective Actions while other plants limit Corrective Actions to actions which address Conditions Adverse to Quality, Significant Conditions Adverse to Qu ality, and their causes. Supporting examples:
o Xcel Energy currently utilizes multiple action identifiers in passport and tracks most items as corrective actions. The current station action backlog is approximately 1400 items.o During TRP on 6/9/2010, 4 of 10 completed "B" Actions that were reviewed were viewed by the TRP as unnecessary actions to correct issues. Consequences: This condition creates a lack of focus on true priorities and results in personnel focusing on what action is due next vice what actions are required to correct conditions and their causes. This creates a vulnerability for important actions to be incorrectly assigned lower priorities. The cause is lack of granularity in some action types and insufficient procedural guidance to categorize actions based upon what the intended outcome of the action is.
Corrective Actions: Required actions include creatio n of an additional action type in Passport "CAPA" and modifying FP-PA-ARP-01 to provide guidance to use "CAPR" for actions that address the cause of Significant Conditions Adverse to Quality, "CA" for actions that address Root, Apparent, and Contributing Causes found during RCEs and ACEs, "OPB/OBN/OBD" for resolving Operator Burdens and Nonconforming/Degraded conditions. These action types will be considered part of the corrective action backlog. "OEA" actions will be utilized for resolution of operating experience items, and "CAPA" will be utilized for all other action types. An action to submit a PCR for the required changes has been issued under AR 01231245 with a due date of June 30, 2010. Enhancement #1 (AR 01236948) Causal Evaluation procedures lag industry-leading practice s in that current procedures rely in knowledge-based vice rule-based performance. From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 5 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE Supporting examples:
o Inconsistencies in conduct of MREs within the Prairie Island organization and between Xcel Energy sites o Root Cause and Apparent Cause Evaluation procedures do not contain clear guidance for the conduct of specific sections of the report. This results in inconsistent application of causal analysis tools, extent of condition/cause, and operating experience evaluations.
o The Equipment Apparent Cause guidance does not contain sufficient detail to drive performers to consistent use of support/refute anlaysis nor the specific requirements applicable to equipment ACEs o Condition Evaluations are not structured by guidance, resulting in inconsistent usage and actions not targeted in accordance with INPO 09-011 Success Factor #5 (Change that which needs to be changed and no more). Consequences have been ineffective causal analysis resulting in repeat equipment and human performance issues (reference AR 01216005) The cause is procedures developed for knowledge-based performance vice rule-based performance. Required actions are upgrading existing procures to reflect industry-best practices and providing fleet-wide procedures for equipment ACE, MRE, and CE conduct Enhancement #2 (AR 01236949) Administration of the Corrective Action Program does not consistently achieve efficient use of resources and expectations for quality. Supporting examples:
o Inconsistent application of trend codes by performance assessment personnel and CAP liaisons.
o Inconsistent use of Passport functions to reduce time in administrative roles.
o Inconsistent use of resources to balance work loads. Consequences are reduced time available to monitor quality of program implementation and unreliable trend information. The cause is ineffective management of resources to achieve necessary results. Required actions include use of passport functions to enable backgrounding of repetitive actions after AR Screening decisions are made, assigning Liaisons more administrative roles to reduce Performance Assessment work load and improve Liaison ownership of issues, and information sharing on the trending process. Incre ased monitoring of trending and action initiation quality (in accordance with SMARTS principles) are also required.
6.0 CONCLUSION
SPrairie Island's Corrective Action Program performance does not meet standards or expectations. While performance has improved in many respects, achievement of minimum acceptable standards can only be achieved through increased ownership and accountability of program performance by managers and supervisors. This are a for improvement and additional gaps to excellence that will ensure effective program implementation have been id entified and actions are in place to address these gaps. The station can effectively resolve these issues prior to the NRC 711152 inspection.
7.0REPORT DETAILSObjective 1: The assessment team reviewed previously-screened CAPs for initiation quality, interviewed approximately 45 personnel on willingness to initiate ARs, reviewed station logs from the previous month for items that required CAPs, reviewed the operator burden list and top 10 equipment issue list to verify issues are addressed through use of the Corrective Action Program, reviewed a sampling of recently-screened PCRs and WRs for items that required CAPs. The team did not identify discrepancies. From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 6 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATEThe assessment team reviewed previously-screened CAPs for adequacy of screening decisions, reviewed NRC inspection findings to verify that these issues were appropriately dispositioned, and observed Prescreening and Screening meetings to determine adequacy of conduct of the process. The team found that, in some cases, licensee-identified issues that resulted in NRC violations were not appropriately re-screened for significance to ensure issue resolution. The team determined that there is an adequate process in place to mitigate occurrence and that the small percentage of discrepancies (approximately 5%) were due to individual human performance errors. AR 01236919 was written to document and resolve these discrepancies. The assessment team reviewed Prompt and Immediate Operability determinations associated with CAPs in the assessment scope and determined that previously-identified issues with the Operability Determination Process implementation quality may persist, as specified in AFI #3. Objective 2: The assessment team reviewed 10 A-le vel CAPs to determine adequacy of issue screening, evaluation, and resolution. The team determined that performance in this area has improved over the past 12 months, with continuing concerns related to action implementation quality, timeliness of actions, and a gap to excellence in evaluation quality. These concerns are addressed by existing CAP Excellence Plan items and Enhancement #1. The assessment team reviewed 10 B-le vel CAPs to determine adequacy of issue screening, evaluation, and resolution. The team determined that performance in this area has improved over the past 12 months, with continuing concerns related to action implementation quality, timeliness of actions, and a gap to excellence in evaluation quality. These concerns are addressed by existing CAP Excellence Plan items and Enhancement #1. The assessment team reviewed 40 C-level CAPs to determine adequacy of issue screening, evaluation, and resolution. Included in the scope were reviews of MREs and CEs for adequacy. The team determined that performance in this area has improved over the past 12 months, with continuing concerns related to action implementation quality and timeliness of actions. Additionally, the team found an improvement opportunity for standardization of the MRE process across the Xcel fleet, vice relying on site-specific processes. Th is improvement is captured in Enhancement #1. Objective 3: The assessment team reviewed 10 recently-completed effectiveness reviews for procedural compliance and quality of the evaluation. The team also reviewed CAP data for indication of repeat occurrence of previously-evaluated, significant (A-level) CAPS. The assessment team did not find any areas for conern. Objective 4: The assessment team reviewed CAP Key Performance Indicators for completeness and indication of areas for improvement. The review did not find issues with completeness, but did find indications of inadequate ownership and accountability for process execution, as described in AFI #1. The assessment team evaluated a sampling of approximately 50 completed trends in Passport to assess quality of trending. The team found some inconsistencies in the application of trend codes by various groups. Actions were added to the CAP excellence plan to provide information sharing on the trending process with personnel that complete trending and to create trending job aids. These actions have been completed. Objective 5: The assessment team interviewed RCE Team Leads to determine effectiveness of PARB and Management oversight of completed Root Cause Evaluations. The team determined that, in general, PARB oversight of Root Causes has improved and adequate resources have been provided to complete the task. Additionally, the team determined that the existing process is From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 7 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATEadequate to meet minimum standards, but that causal evaluation procedures could enable excellence through providing better examples and enhanced direction for how to conduct the various sections of the evaluation, as captured in Enhancement 1. The assessment team reviewed Key Performance Indicator data, PARB meeting minutes, and observed PARB meetings to assess the effectiveness of PARB and management oversight of the Corrective Action Program.
The team determined that oversight has improved, but that PARB currently fulfills a role of enforcing standards, rather acting as a forcing function for continuous improvement. This assessment is described in detail with AFI #1. The assessment team reviewed TRP meeting minutes and observed a TRP meeting to evaluate the effectiveness at TRP in ensuring quality ACE conduct and B-level Corrective Action Implementation. The team determined that the TRP was adequately evaluating ACE quality and enforcing standards for action quality. Objective 6: The assessment team reviewed the 2010 Self-Assessment schedule and 3 recently-completed Focused Self-Assessments to evaluate procedural compliance, self-assessment quality, and implementation of improvement activities from completed assessments. The team did not identify any concerns in this objective. Objective 7: The assessment team reviewed Corrective Action Program documents related to NOS-identified issues and interviewed NOS personnel to evaluate effectiveness of station response to those issues. The team found that the station's re sponse to NOS issues has improved over the assessment period and no additional areas for concern were identified. Objective 8: The assessment team interviewed CAP liaison s, managers, and department personnel to assess liaison involvement in the Corrective Action Program. The team reviewed meetings conducted with CAP liaisons to assess effectiveness improving liaison performance. The team determined that, in same cases, CAP liaisons are not adequately engaged in some aspects of the Corrective Action Program. This conc ern is addressed by Enhancement #2. 8.0ATTACHMENT Document List QF 0402 (Focused Self-Assessment Checklist) 9.0 Team Leader Signature: Date: Management Sponsor Signature: Date: PARB Accepted:
_________________
____________Date: _______ From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 8 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE2010 PI&R Focused Self-Assessment Document List #DESCRIPTION DATE/REV OBJECTIVE1Licensing "A" Interview Per Schedule 1A2Projects "A" Interview Per Schedule 1A3Projects "B" Interview Per Schedule 1A4IT "A" Interview Per Schedule 1A5Security "A" Interview Per Schedule 1A6Security "B" Interview Per Schedule 1A7EP "A" Interview Per Schedule 1A8Supply Chain "A" Interview Per Schedule 1A9Warehouse "A" Interview Per Schedule 1A10Admin Support "A" Interview Per Schedule 1A11Procedures "A" Interview Per Schedule 1A12Document Control "A" Interview Per Schedule 1A13System Engineering "A" Interview Per Schedule 1A14System Engineering "B" Interview Per Schedule 1A15Design Engineering "A" Interview Per Schedule 1A16Design Engineering "B" Interview Per Schedule 1A17Programs Engineering "A" Interview Per Schedule 1A18Programs Engineering "B" Interview Per Schedule 1A19Operations "A" Interview Per Schedule 1A20Operations "B" Interview Per Schedule 1A21Production Planning "A" Interview Per Schedule 1A22Production Planning "B" Interview Per Schedule 1A23Facilities/FIN "A" Interview Per Schedule 1A24Facilities/FIN "B" Interview Per Schedule 1A25Mechanical "A" Interview Per Schedule 1A26Mechanical "B" Interview Per Schedule 1A27Electrical "A" Interview Per Schedule 1A28Electrical "B" Interview Per Schedule 1A29I&C "A" Interview Per Schedule 1A30I&C "B" Interview Per Schedule 1A31RP "A" Interview Per Schedule 1A32RP "B" Interview Per Schedule 1A33Chemistry "A" Interview Per Schedule 1A34Chemistry "B" Interview Per Schedule 1A35Liaison "A" Interview Per Schedule 836Liaison "B" Interview Per Schedule 837Liaison "C" Interview Per Schedule 838Liaison "D" Interview Per Schedule 839Liaison "E" Interview Per Schedule 840Liaison "F" Interview Per Schedule 841Liaison "G" Interview Per Schedule 842Liaison "H" Interview Per Schedule 843Screen Team "A" Interview Per Schedule 5, 8 44Screen Team "B" Interview Per Schedule 5, 8 45Screen Team "C" Interview Per Schedule 5, 8 46Screen Team "D" Interview Per Schedule 5, 8 47WR Screen "A" Interview Per Schedule 1A, 1D 48ECR Screen "A" Interview Per Schedule 1A, 1D 49PRG "A" Interview Per Schedule 1A, 1D 50PCR Screen "A" Interview Per Schedule 1A, 1D 51NOS "A" Interview Per Schedule 752NOS "B" Interview Per Schedule 753RCE Lead "A" Interview Per Schedule 254RCE Lead "B" Interview Per Schedule 2From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 9 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE55RCE Lead "C" Interview Per Schedule 256RCE Lead "D" Interview Per Schedule 257RCE Lead "E" Interview Per Schedule 258RCE Lead "F" Interview Per Schedule 259RCE Lead "G" Interview Per Schedule 260RCE Lead "H" Interview Per Schedule 261Prescreening Meeting 6/7/101D62Prescreening Meeting 6/8/101D63Prescreening Meeting 6/9/101D64Prescreening Meeting 6/10/101D65AR Screening Meeting 6/7/101D66AR Screening Meeting 6/9/101D67PARB Meeting 6/8/102, 3, 5 68PARB Meeting 6/10/102, 3, 5 69TRP Meeting 6/9/102, 3, 5 70Operator Burden ListJune 1, 2010 1, 3 71Station Logs May 1 - 31, 2010 1A72WR initiation May 1 - 31, 2010 1A73AR 01144451 (Top Ten List) Per Passport 1, 2, 3 74AR 01038833 (Top Ten List) Per Passport 1, 2, 3 75AR 01115585 (Top Ten List) Per Passport 1, 2, 3 76AR 01173282 (Top Ten List) Per Passport 1, 2, 3 77AR 01173280 (Top Ten List) Per Passport 1, 2, 3 78AR 00866960 (Top Ten List) Per Passport 1, 2, 3 79AR 00866805 (Top Ten List) Per Passport 1, 2, 3 80AR 01173285 (Top Ten List) Per Passport 1, 2, 3 81AR 01137327 (Top Ten List) Per Passport 1, 2, 3 82TRP Meeting Minutes (Consolidated Document) June 1, 2009 - May 31, 2010 583Performance Improvement Report Card (January 2009) January 2010 4, 5 84Performance Improvement Report Card (February 2009) February 2010 4, 5 85Performance Improvement Report Card (March 2009) March 2010 4, 5 86Performance Improvement Report Card (April 2009) April 2010 4, 5 87AT-0358 (CAP Report Card) May 29 2010 4, 5 88PARB Meeting Minutes (Consolidated Document) June 1, 2009 - May 31, 2010 589AR 01184613 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 90AR 01185484 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 91AR 01186791 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 92AR 01188008 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 93AR 01189027 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 94AR 01190549 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 95AR 01191732 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 96AR 01193081 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 97AR 01194255 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 98AR 01195435 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 99AR 01196667 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 100AR 01197578 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 101AR 01198510 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 102AR 01199279 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 103AR 01200182 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 104AR 01201062 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 105AR 01201947 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 106AR 01202798 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 107AR 01203561 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 108AR 01204687 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 109AR 01205723 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 110AR 01206459 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 10 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE111AR 01207507 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 112AR 01208589 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 113AR 01209586 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 114AR 01210924 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 115AR 01212051 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 116AR 01212841 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 117AR 01213945 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 118AR 01214934 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 119AR 01215988 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 120AR 01217180 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 121AR 01218157 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 122AR 01219198 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 123AR 01220312 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 124AR 01221345 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 125AR 01222443 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 126AR 01223339 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 127AR 01224440 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 128AR 01225603 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 129AR 01226532 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 130AR 01227490 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 131AR 01228219 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 132AR 01228996 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 133AR 01229592 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 134AR 01230468 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 135AR 01231252 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 136AR 01231935 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 137AR 01232582 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 138AR 01233488 (Initiation Quality, Operability Status, Screening Decision) Per Passport 1, 4 139AR 01121937 (A - RCE) Per Passport 2, 3, 4 140AR 01145695 (A - RCE) Per Passport 2, 3, 4 141AR 01178236 (A - RCE) Per Passport 2, 3, 4 142AR 01182488 (A - RCE) Per Passport 2, 3, 4 143AR 01211532 (A - RCE) Per Passport 2, 3, 4 144AR 01214773 (A - RCE) Per Passport 2, 3, 4 145AR 01214986 (A - RCE) Per Passport 2, 3, 4 146AR 01221036 (A - RCE) Per Passport 2, 3, 4 147AR 01227647 (A - RCE) Per Passport 2, 3, 4 148AR 01185362 (A - ACE) Per Passport 2, 3, 4 149AR 01194257 (A - MRE) Per Passport 2, 3, 4 150AR 01183937 (B - ACE) Per Passport 2, 3, 4 151AR 01184883 (B - ACE) Per Passport 2, 3, 4 152AR 01186989 (B - ACE) Per Passport 2, 3, 4 153AR 01230039 (B - ACE) Per Passport 2, 3, 4 154AR 01223919 (B - ACE) Per Passport 2, 3, 4 155AR 01217274 (B - ACE) Per Passport 2, 3, 4 156AR 01215266 (B - ACE) Per Passport 2, 3, 4 157AR 01204339 (B - ACE) Per Passport 2, 3, 4 158AR 01221481 (B - OBD) Per Passport 2, 3, 4 159AR 01218940 (B - OBN) Per Passport 2, 3, 4 160AR 01226049 (B - OBD) Per Passport 2, 3, 4 161AR 01191926 (C - MRE) Per Passport 2, 3, 4 162AR 01199201 (C - MRE) Per Passport 2, 3, 4 163AR 01199512 (C - MRE) Per Passport 2, 3, 4 164AR 01201938 (C - MRE) Per Passport 2, 3, 4 165AR 01202331 (C - MRE) Per Passport 2, 3, 4 166AR 01203013 (C - MRE) Per Passport 2, 3, 4 167AR 01205449 (C - MRE) Per Passport 2, 3, 4 168AR 01207063 (C - MRE) Per Passport 2, 3, 4 From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 11 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE169AR 01213978 (C - MRE) Per Passport 2, 3, 4 170AR 01226852 (C - MRE) Per Passport 2, 3, 4 171AR 01230892 (C - MRE) Per Passport 2, 3, 4 172AR 01233984 (C - CE) Per Passport 2, 3, 4 173AR 01183929 (C - CE) Per Passport 2, 3, 4 174AR 01184290 (C - CE) Per Passport 2, 3, 4 175AR 01185113 (C - CE) Per Passport 2, 3, 4 176AR 01189908 (C - CE) Per Passport 2, 3, 4 177AR 01191021 (C - CE) Per Passport 2, 3, 4 178AR 01193807 (C - CE) Per Passport 2, 3, 4 179AR 01200624 (C - CE) Per Passport 2, 3, 4 180AR 01200814 (C - CE) Per Passport 2, 3, 4 181AR 01201207 (C - CE) Per Passport 2, 3, 4 182AR 01210090 (C - CE) Per Passport 2, 3, 4 183AR 01210519 (C - CE) Per Passport 2, 3, 4 184AR 01212303 (C - CE) Per Passport 2, 3, 4 185AR 01221208 (C - CE) Per Passport 2, 3, 4 186AR 01221338 (C - CE) Per Passport 2, 3, 4 187AR 01226376 (C - CE) Per Passport 2, 3, 4 188AR 01230392 (C - CE) Per Passport 2, 3, 4 189AR 01232913 (C - CE) Per Passport 2, 3, 4 190AR 01187619 (C - OPR) Per Passport 2, 3, 4 191AR 01187753 (C - OPR) Per Passport 2, 3, 4 192AR 01196007 (C - OPR) Per Passport 2, 3, 4 193AR 01201964 (C - OPR) Per Passport 2, 3, 4 194AR 01197326 (C - OPR) Per Passport 2, 3, 4 195AR 01204511 (C - OPR) Per Passport 2, 3, 4 196AR 01211288 (C - OPR) Per Passport 2, 3, 4 197AR 01211627 (C - OPR) Per Passport 2, 3, 4 198AR 01214555 (C - OPR) Per Passport 2, 3, 4 199AR 01233549 (C - OPR) Per Passport 2, 3, 4 200EFR 01100615 Per Passport 3201EFR 01117801 Per Passport 3202EFR 01131673 Per Passport 3203EFR 01138923 Per Passport 3204EFR 01154696 Per Passport 3205EFR 01161144 Per Passport 3206EFR 01167124 Per Passport 3207EFR 01178963 Per Passport 3208EFR 01187452 Per Passport 3209EFR 01215132 Per Passport 3210AR 01188924 (FSA) Per Passport 6211AR 01204581 (FSA) Per Passport 6212AR 01205470 (FSA) Per Passport 6213AR 01175093 (FSA) Per Passport 6214AR 01175089 (FSA) Per Passport 6215AR 01175084 (FSA) Per Passport 62162010 Self Assessment Schedule Printed 5/27/10 6217NOS Open Issues ListPrinted5/27/10 7218AR 01178236 (NRC Violation) Per Passport 1, 2, 3 219AR 01226862 (NRC Violation) Per Passport 1, 2, 3 220AR 01220024 (NRC Violation) Per Passport 1, 2, 3 221AR 01211835 & 1217184 (NRC Violation) Per Passport 1, 2, 3 222AR 01159643 & 01221036 (NRC Violation) Per Passport 1, 2, 3 223AR 01050047 (NRC Violation) Per Passport 1, 2, 3 224AR 01217275 (NRC Violation) Per Passport 1, 2, 3 225AR 01222084 (NRC Violation) Per Passport 1, 2, 3 226AR 01215434 (NRC Violation) Per Passport 1, 2, 3 From retained in accordance with record retention schedule identified in FP-G-RM-01 QF-0426 Rev 2 (FP-PA-SA-01)
Page 12 of 21 FOCUSED SELF-ASSESSMENT REPORT TEMPLATE227AR 01217545 (NRC Violation) Per Passport 1, 2, 3 228AR 01197554 (NRC Violation) Per Passport 1, 2, 3 229AR 01210614 (NRC Violation) Per Passport 1, 2, 3 230AR 01214773 (NRC Violation) Per Passport 1, 2, 3 231AR 01214190 (NRC Violation) Per Passport 1, 2, 3 232AR 01223729 (NRC Violation) Per Passport 1, 2, 3 233AR 01182488 (NRC Violation) Per Passport 1, 2, 3 234AR 01212435 (NRC Violation) Per Passport 1, 2, 3 235AR 01212774 (NRC Violation) Per Passport 1, 2, 3 236AR 01201838 (NRC Violation) Per Passport 1, 2, 3 237AR 01193503 (NRC Violation) Per Passport 1, 2, 3 238AR 01201950 and 01201987 (NRC Violation) Per Passport 1, 2, 3 239AR 01200237 (NRC Violation) Per Passport 1, 2, 3 240AR 01206681 (NRC Violation) Per Passport 1, 2, 3 241AR 01198503 (NRC Violation) Per Passport 1, 2, 3 242AR 01184252 (NRC Violation) Per Passport 1, 2, 3 243AR 01198068 (NRC Violation) Per Passport 1, 2, 3 244AR 01192430 (NRC Violation) Per Passport 1, 2, 3 245AR 01197714 (NRC Violation) Per Passport 1, 2, 3 246AR 01176859 (NRC Violation) Per Passport 1, 2, 3 247AR 01145695 (NRC Violation) Per Passport 1, 2, 3 248AR 01174370 (NRC Violation) Per Passport 1, 2, 3 249AR 01186124 (NRC Violation) Per Passport 1, 2, 3 250AR 01192435 (NRC Violation) Per Passport 1, 2, 3 251AR 01192415 (NRC Violation) Per Passport 1, 2, 3 252AR 01158935 (NRC Violation) Per Passport 1, 2, 3 253AR 01182175, 01186151, 01186330 (NRC Violation) Per Passport 1, 2, 3 254AR 01181513 (NRC Violation) Per Passport 1, 2, 3 255AR 01174999 (NRC Violation) Per Passport 1, 2, 3 254AR 01178236 (NRC Violation) Per Passport 1, 2, 3 255AR 01173880 (NRC Violation) Per Passport 1, 2, 3 256AR 01171241 (NRC Violation) Per Passport 1, 2, 3 257AR 01179638 (NRC Violation) Per Passport 1, 2, 3 258AR 01180343 (NRC Violation) Per Passport 1, 2, 3 259AR 01179070 (NRC Violation) Per Passport 1, 2, 3 260AR 01174897 (NRC Violation) Per Passport 1, 2, 3 261AR 01178685 & 01175563 (NRC Violation) Per Passport 1, 2, 3 262AR 01169735 (NRC Violation) Per Passport 1, 2, 3 263AR 01179272 (NRC Violation) Per Passport 1, 2, 3 264AR 01165361 (NRC Violation) Per Passport 1, 2, 3 265AR 01183021 (NRC Violation) Per Passport 1, 2, 3 266AR 01183110 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 267AR 01183112 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 268AR 01183113 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 269AR 01183114 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 270AR 01183115 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 271AR 01165133 (Response to NRC Cross-Cutting Issue) Per Passport 1, 2, 3 272Interview with Operator "C" Per Schedule 1From retained in accordance with record retention schedule identified in FP-G-RM-01 Page 13 of 21 QF-0402 Revision 3 (FP-PA-SA-01)Page1of2Focused Self-Assessment Checklist Self-Assessment Topic: Pre-71152 PI&R NRC inspection Readiness / CAP Process EffectivenessChecklist Index: Checklist Number Objective1. Verify that station problems are being identified, reported and properly screened. 2. Verify that evaluation of problems and identification of corrective actions are commensurate with the significance of the problem. 3. Determine the effectiveness of corrective actions resolving identified problems. 4. Verify that performance indicators effectively characterize corre ctive action program performance and that CAP trending identifies potential adverse trends. 5. Assess the effectiveness of management oversight of the CAP. 6. Assess the effectiveness of the Focused Self-Assessment Program. 7. Assess the effectiveness of the Site's Response to NOS-identified issues. 8. Assess the effectiveness of CAP Liaisons in implementing the corrective action program.Checklist Key Self-Assessment Element - WHAT is to be assessed. A specific facet to be assessed related to an Objective i.e., specific questions, actual practices, data review. Method - HOW the self-assessment element is to be evaluated i.e., interview, observation, material or document review.
Performer- WHO will do the assessing i.e., which team member(s). Objective Evidence - Any documented statement of fact, other information, or record, either quantitative or qualitative, pertaining to the quality of an item or activity based on observations, measurements or tests which can be verified. From retained in accordance with record retention schedule identified in FP-G-RM-01 Page 14 of 21 Focused Self-Assessment Checklist Checklist Number: 1 Objective: Verify that station problems are being ide ntified, reported and properly screened.ItemSelf-Assessment Element Method Performer 1aVerify that issues are being identified at an appropriately low threshold, appropriately characterized, and entered into the corrective action program. [INPO][NRC-71152] Review sample (50) of sub mitted CAPs for content adequacy, completeness and timeliness. Verify that equipment, human performance, and program issues are being identified and
entered into the program. Review NRC Inspection Reports since the last PI&R inspections for issues related to human performance, safety
conscious workforce, and CAP to determine if issues were appropriately entered into the CAP Review the last two INPO/WANO reports to determine if issues in the reports were appropriately entered into the CAP program. Interview personnel on willingness to generate ARs Review station logs for the past 30 days for issues to verify CAPs have been initiated as required. Review Work Requests initiated in the past 30 days to verify CAPs have been initiated as required. Observation, Document Review, Interviews Team 1bVerify that issues are being properly screened, assigned and classified based on the safety significance of the issue. Evaluate the effectiveness of the CAP Screening meetings. [INPO] [NRC 71152] Review sample of screened CAPs (50) to determine if screening reached correct conclusions regarding significance level, evaluation type, operability, and reportability. Determine whether the distribution of CAP significance levels is consistent with industry best practice Observe CAP Screening Team meetings (at least 2) Verify CAP Screeners have the proper knowledge and technical expertise to perform this function Verify that a defined, consistent screening process is employed Proper level of attendance and preparation of screen team members Verify that generic problem implications are considered and addressed when appropriate during screening Determine whether non-CAP and work order issues are reviewed to determine whether CAPs should be generated. Determine whether the screen team adequately challenges CAP problem statements as written to ensure quality.
Observation, Interviews, Document Review Team 1cVerify operator burdens are captured in CAP by reviewing the operator burden list and the CAP database.
Determine if the expected burden resolution dates are supported by the CAP scheduled dates and whether the resolution dates are consistent with the impact of the burden. Document Review Team Lead 1dVerify the top 10 equipment issues are appropriately captured in CAP. Document Engineer QF-0402, Revision 3 (FP-PA-SA-01)Page2of2From retained in accordance with record retention schedule identified in FP-G-RM-01 Page 15 of 21 Review 1eReview CAP generation rate data for any unexplained drops in generation rate.
Interviews, Document Review Team 1fDetermine whether the Work Request, ECR, PRG and PCR screening teams evaluate incoming items to determine if CAPs are needed.
Interviews, Document Review TeamItemObjective Evidence Status1aPer Document List OK1bPer Document List AFI31cPer Document List OK1dPer Document List OK1ePer Document List OK1fPer Document List AFI2Checklist Number: 2 Objective:
Verify that evaluation of problems and identification of corrective actions are commensurate with the significance of the problem.ItemSelf-Assessment Element Method Performer 2aReview a sample of ten (10) level A CAPs since the last PI&R inspection The sample should include at least two issues associated with NRC inspection findings. [71152] Determine whether a RCE was performed or appropriate justification/authorization is provided for performing an ACE or other type of evaluation Review all RCEs completed since the last PI&R inspection for the following attributes:
o Assignment of an RCE was consistent with problem significance o An RCE qualified analyst participated on the team o The RCE team possessed the necessary technical expertise o Structured root cause analysis techniques were used o Organizational and prog rammatic causes were considered o Identified causes directly relate to the problem statement o Past performance and operating experience were examined to obtain insights into causes o Extent of condition was ap propriately considered o Extent of cause was appropriately considered o Corrective actions to prevent recurrence were identified and relate to the root cause(s) and the problem statement o Correction actions for contributing causes focus appropriately on those causes o Out of scope issues are appropriately entered into CAP o Appropriate effectiveness review requirements were identified o Appropriate interim actions were identified and implemented Document Review Internal PeerFrom retained in accordance with record retention schedule identified in FP-G-RM-01 Page 16 of 21 o The RCE was initiated in a time frame consistent wit the significance of the issue.
o The RCE was completed in a time frame consistent wit the significance of the issue o Corrective action due dates were established consistent with the significance of the issue o Corrective actions were completed on or before due dates without extensions o Verify that documented actions a nd actual actions are aligned (sample).
o Management oversight was evident o PARB review timing was consistent with the significance of the issue o PARB comments were incorporated into the RCE as appropriate For any Significant Conditions Adverse to Quality (SCAQs) for which an RCE was not pe rformed, determine whether CAPRs were identified as required and effectiveness reviews were
specified.
2bReview a sample of ten (10) level B CAPs plus all CAPs associated with cited and non-cited NRC violations and generic communications since the last PI&R inspection. [71152] Determine whether an ACE or higher evaluation type was performed or appropriate justification/authorization was provided for performing other types of evaluations. Review 5 ACEs for the following attributes:
o Assignment of an ACE was consistent with problem significance o The ACE was initiated and completed in a time frame consistent with problem significance o Appropriate interim actions were taken o The evaluator(s) possessed the necessary technical expertise o A logical process was used to identify apparent cause(s) o Identified causes directly address the problem statement o Extent of cause/condition was appropriately evaluated o OE/past performance were appropriately factored into the evaluation o Identified corrective actions directly relate to causes and the problem statement o Due dates for corrective actions are consistent with problem significance o Corrective actions were completed by the due dates without extensions o Verify that documented actions a nd actual actions are aligned (sample).
o Organizational and prog rammatic causes were appropriately considered o If the ACE was for a level A issue, verify CAPRs were identified and an effectiveness review was required Document Review Internal PeerFrom retained in accordance with record retention schedule identified in FP-G-RM-01 Page 17 of 21 o PARB review, if performed, was performed in a time frame consistent with problem significance o PARB comments were appropriately incorporated in the ACE o Out of scope issues identified by the ACE were appropriately captured in the CAP.
2c Review a sample of 40 level CAPs initiated since the last PI&R inspection for the following attributes. This should include at least four items associated with NRC or industry operating experience and at least six items associated with aging (such as EQ, erosion/corrosion, or aging of electronic components). [71152] A CE was assigned consistent with the significance of the issue The conclusion(s) of the CE was reasonable with respect to the problem statement The CE was completed in a time frame consistent with problem significance Corrective action(s) addresses the CE conclusion(s) and the problem statement Corrective actions were consistent with issue significance Corrective actions were completed in a time frame commensurate with problem significance Verify that documented actions a nd actual actions are aligned. Interim actions were taken as appropriate. Due date extensions we re justifiable and appropriate. Document Review Operations 2dReview all CAPs written to address NRC/INPO/WANO identified issues since the last PI&R inspection for the following: The level assigned to the CAP was B or higher, or justification for a lower significance level is provided. The evaluation performed included determining why the issue was not identified internally. Document Review Fleet Peer 2eReview the adequacy of 10 recent evaluation of equipment related issues (Maintenance Rule Evaluations). Verify that appropriate analysis and corrective action are being taken for repetitive MPFFs or SSCs exceeding performance goals/criteria Document Review Engineer ItemObjective Evidence Status2aPer Document List AFI2, EN1 2bPer Document List AFI2, EN1 2c Per Document List AFI2, EN1 2dPer Document List OK2ePer Document List EN1Checklist Number: 3 Objective: Determine the effectiveness of corrective actions resolving identified problems.ItemSelf-Assessment Element Method Performer 3aReview and evaluate the documented results of 10 completed corrective action effectiveness reviews. [INPO] Document Review Maintenanc e 3bReview CAP data following implementation of 10 CAPRs to identify whether the problem address by the CAPR was experienced again. Document Review Team 3c Review CAP data since the last PI&R to identify any CAPs written to Document TeamFrom retained in accordance with record retention schedule identified in FP-G-RM-01 Page 18 of 21 document ineffective corrective actions. Review the evaluation of these CAPs to determine whether they address why the actions were ineffective and the adequacy of the corrective actions. Review 3dDetermine if there are any common factors associated with ineffective corrective actions. Document Review TeamItemObjective Evidence Status3aPer Document List OK3bPer Document List OK3cPer Document List OK3dPer Document List OKChecklist Number: 4 Objective: Verify that performance indicators effectively characterize corrective action program performance and that CAP trending identifies potential adverse trends.ItemSelf-Assessment Element Method Performer 4aReview CAP performance indicators for accuracy and completeness. Compare CAP indicators with the most recent NRC PI&R inspection results and INPO/WANO evaluation results for consistency Interviews, Document Review Team Lead 4bEvaluate the trending program (DRUM process) and the effectiveness of trending at the individual department and station level. [71152] Review a sample of 40 CAPs across multiple departments to determine if trend codes are being applied consistently. Determine if trend codes are being applied to all CAPs and if not, why not. Trend coding methodology is utilized Trend data is evaluated and summarized Trending identifies problem areas or areas for improvement which are entered into the CAP Evaluate existing trend codes to assure the scope is appropriate and the number is not so large so as to obscure trends. Trend data is comprehensive and includes CAPs, management observations results, meeting critique results, worker feedback information, self assessment results, and performance indicator information.
Interviews, Document Review CAPCoordinator 4c Review CAP data since the last PI&R to determine if adverse trends are identified by individual departments outside the structured trending process and entered into CAP Interviews, Document Review Team Lead ItemObjective Evidence Status4aPer Document List OK4bPer Document List EN4cPer Document List OKChecklist Number: 5 Objective: Assess the effectiveness of management oversight of the CAP.ItemSelf-Assessment Element MethodPerformer 5aDetermine by interview of all RCE team leads during the past year the extent of senior management involvement/overview of team activities Interviews TeamFrom retained in accordance with record retention schedule identified in FP-G-RM-01 Page 19 of 21 5bReview PARB meeting information to determine the following: Review RCE and ACE grading results for 5 RCEs and 5 ACEs to determine if RCE and ACE grading is performed in a timely manner and provides meaningful feedback which is used in a structured fashion to improve future performance. PARB effectively interfaces with all phases and aspects of the corrective action program. PARB meetings occur regularly and routinely include CAP overview CAP feedback from PARB results in action items to improve CAP performance which are tracked to closure Quality of the meeting minutes as a feedback and action tracking tool.
Interviews, Document Review Team5cObserve a PARB meeting to determine the following: Members were prepared and actively participated in the meeting PARB was critical of CAP effectiveness and provided insights for improvement ObservationTeam5dObserve a TRP meeting to determine the following: Members were prepared and actively participated in the meeting TRP was critical of CAP effectiveness and provided insights for improvement ObservationTeamItemObjective Evidence Status5aPer Document List OK5bPer Document List AFI15cPer Document List AFI15dPer Document List OKChecklist Number: 6 Objective: Assess the effectiveness of the Focused Self-Assessment Program.ItemSelf-Assessment Element Method Performer 6aReview the 2010 Focused Self-Assessment Schedule to determine the following: Self assessment schedule reflects performance improvement initiatives vice inspection / external assessment schedules Self assessment schedule is realistic and will allow for implementation of corrective actions Document Review Maintenanc e 6bReview a sampling (30%) of Self Assessments completed in the last year for the following: Procedural requirements of FP-PA-SA-01 were met Self-assessment was critical of the area being reviewed Corrective actions met the SMART principles Document Review Maintenanc eItemObjective Evidence Status6aPer Document List OK6bPer Document List OKChecklist Number: 7 Objective: Assess the effectiveness of the Site's Response to NOS-identified issues.From retained in accordance with record retention schedule identified in FP-G-RM-01 Page 20 of 21 ItemSelf-Assessment Element Method Performer 7aReview all open NOS issues to determine whether they have been entered into the CAP and whether ad equate priority has been given to those issues Document Review Team Lead 7bReview a sampling (30%) of all open NOS issues to determine the following: Causal evaluations condu cted at appropriate level to understand the issues and causes Corrective actions were commensurate with the risk of the issue Corrective actions were effective in resolving issues (SMART principle) Corrective actions were timely Document Review Team 7cInterview NOS personnel to determine station effectiveness in completing NOS identified issues Interviews Internal PeerItemObjective Evidence Status7aPer Document List OK7bPer Document List OK7cPer Document List OKChecklist Number: 8 Objective: Assess the effectiveness of CAP Liaisons in implementing the corrective action program.ItemSelf-Assessment Element Method Performer 8aInterview CAP liaisons and Department Managers to determine the following: A consistent understanding of the roles and responsibilities of CAP liaisons Departmental CAP effectiveness reflects adequate liaison involvement and ownership Amount of time made available for liaison duties How department CAP performance is monitored/facilitated by liaisons Interviews, Document Review Team8bDetermine the following regarding CAP liaison meetings: How frequently they are conducted The value of topics covered Whether action items are identified and tracked How frequently department and performance assessment management participate in meetings Interviews, Document Review Internal and External Peer 8cDetermine how frequently CAP liaisons attend PARB and screening meetings and for what purpose Interviews TeamItemObjective Evidence Status8aPer Document List EN28bPer Document List OK8cPer Document List OK StatusFrom retained in accordance with record retention schedule identified in FP-G-RM-01 Page 21 of 21 OK = Acceptable AFI= Area for Improvement ST = Strength EN = Enhancement From retained in accordance with record retention schedule identified in FP-G-RM-01