IP 71152, Problem Identification and Resolution (PI&R)

Text

Issue Date: 01/05/06 - 1 - 71152 NRC INSPECTION MANUAL DIRS INSPECTION PROCEDURE 71152 IDENTIFICATION AND RESOLUTION OF PROBLEMS PROGRAM APPLICABILITY: 2515 CORNERSTONES: ALL

==INSPECTION BASIS:== A fundamental goal of the NRC’s reactor oversight process is to establish confidence that each licensee is detecting and correcting problems in a manner that limits the risk to members of the public. A key premise of the revised oversight process is that weaknesses in licensee’s problem identification and resolution (PI & R) programs will manifest themselves as performance issues which will be identified during the baseline inspection program or by crossing predetermined performance indicator thresholds. However, several aspects of PI & R are not specifically addressed by either the individual cornerstone performance indicators or other baseline inspections. These are detailed in the following objectives. Completion of the inspection objectives is accomplished by screening all corrective action program issues, by performing a semiannual trend review, by sampling issues during each inspectable area inspection, by performing focused reviews of four to six samples per year, | and by performing a biennial focused PI & R team inspection. 71152-01 INSPECTION OBJECTIVES 01.01 To provide for early warning of potential performance issues that could result in crossing thresholds in the action matrix 01.02 To help the NRC gage supplemental response should future action matrix thresholds are crossed 01.03 To provide insights into whether licensees have established a safety conscious work environment 01.04 To allow for follow-up of previously identified compliance issues (e.g., NCVs) 01.05 To provide additional information related to cross cutting issues that can be used in the assessment process 01.06 To determine whether licensees are complying with NRC regulations regarding corrective action programs 71152 - 2 - Issue Date: 01/05/06 | 01.07 To verify that the licensee is identifying operator workaround problems at an | appropriate threshold and entering them in the corrective action program. 71152-02 INSPECTION REQUIREMENTS Within the baseline inspection program, problem identification and resolution (PI&R) activities are reviewed in three discrete but interdependent locations: as part of the “plant status” reviews described in Appendix D to Inspection Manual 2515 and as part of specific inspectable area inspection procedures (discussed in section 02.01 of this procedure); during follow-up to selected issues via paragraph 02.02 of this procedure; and during a biennial team inspection as specified in paragraph 02.03 of this procedure. 02.01 Routine Review of Identification and Resolution of Problems As described in Appendix D to Inspection Manual Chapter 2515, “Plant Status” and by baseline inspectable area inspection procedures, conduct inspections of problem identification and resolution activities to: a. Verify that equipment, human performance, and program issues are being identified by the licensee at an appropriate threshold and are being entered into the problem identification and resolution program. b. Verify that corrective actions commensurate with the significance of the issue have been identified and implemented by the licensee. | c. The resident inspector (RIs)should perform a screening review of each item entered into the corrective action program. This review can be accomplished by attending daily corrective action program review board meetings, by viewing computerized corrective action program entries, or by reading hard copies of corrective action program documents. The intent of this review is to be alert to conditions such as repetitive equipment failures or human performance issues that might warrant additional follow-up through other baseline inspection | procedures or through section 02.02 or 02.03 of this inspection procedure. RIs | do not need to document the results of this review nor do they need to follow- | up each item. However, they should be alert for adverse performance trends | and risk significant or repetitive equipment failures. Among the items that might indicate a trend would be repeated entries into technical specifications. The | time spent completing this review should be charged to this procedure and should generally be less than 30 minutes per day. [C1] d. Perform a semiannual review to identify trends (either NRC or licensee identified) that might indicate the existence of a more significant safety issue. Included within the scope of this review should be repetitive or closely related issues that may have been documented by the licensee outside the normal corrective action program, such as in trend reports or performance indicators, major equipment problem lists, repetitive and/or rework maintenance lists, departmental problem/challenges lists, system health reports, quality assurance audit/surveillance reports, self assessment reports, maintenance rule assessments, or corrective action backlog lists. This review can be performed by summarizing the results of the licensee’s reviews and comparing those results to those identified by the NRC through the baseline or supplemental inspection program, including issues identified as a result of the daily review of | corrective action program items discussed above. If a biennial PI&R inspection | is scheduled within six months of the semiannual review, the senior resident | inspector could forward any concerns to the PI&R team. This information | should be incorporated into the scope of the team inspection. The results of this review should be documented as per paragraph 03.01c of this procedure. [C1] Issue Date: 01/05/06 - 3 - 71152 One of the primary goals of these routine reviews is to verify that licensees are identifying issues at an appropriate threshold and entering them into their corrective action program. This can be assessed by comparing those issues identified by the NRC during the conduct of the plant status and inspectable area portions of the program with those issues identified by the licensee. This requirement is normally to be accomplished by Resident Inspectors and Region-based inspectors responsible for conducting Plant Status and baseline inspectable area inspections. These routine reviews, along with those reviews conducted via section 02.02 of the procedure also allow for follow-up to selected issues and operational occurrences to ensure that corrective actions commensurate with the significance of the issue have been identified and implemented by the licensee. During inspector reviews of plant status and during inspections, inspectors should be alert for potentially significant conditions adverse to quality, such as equipment failures, performance deficiencies, inadequate maintenance work practices, personnel errors, inadequate risk assessment, management and emergent work control problems, procedure deficiencies, or noncompliances with procedures or regulatory requirements. When inspectors note such conditions, inspectors should examine the licensee’s corrective action program records and/or attend licensee corrective action program meetings, to verify that the licensee identified the conditions noted by the inspector, and entered those conditions into the licensee’s corrective action program. In addition to the screening review that is required of all issues entered into the corrective action program, inspectors should also review a sample of issues to verify that the licensee has appropriately classified the issue and has taken appropriate short term corrective actions. Inspectors should remain alert to problems/conditions which are potentially not minor and

[C1] for which the licensee’s investigation, conclusions, and/or corrective actions

appear to be, in some way, inadequate. The inspector should also review the circumstances associated with the licensee’s investigation and disposition of the problem/condition, to determine the reason(s) why the licensee’s results were not adequate. The selected samples should be reviewed against the performance attributes contained in paragraph 03.01.b, as applicable. When an inspector finds that the licensee’s identification, classification, immediate disposition, and/or final disposition of a condition adverse to quality are not in compliance with the licensee’s procedures and/or regulatory requirements, the inspector should assess the significance of that finding in accordance with IMC 0609. Document the results in accordance with the quarterly inspection report guidance contained in IMC 0612, Section 4OA2 of the sample inspection report, and section 03.01.c. of this procedure. [C1] 02.02 Selected Issue Follow-up Inspection In addition to the above reviews which are performed as part of “plant status” or other baseline inspection procedures, a sample of four to six issues per year should be selected | for a more in-depth periodic review. One of these samples must be an in-depth review of | the operator workaround program. These samples need not be directly tied to the other | baseline inspection procedure attachments and should generally be spread across the cornerstones of safety. The review of the operator workaround program shall verify that the licensee is identifying | operator workarounds problems at an appropriate threshold, have entered them in the | corrective action program and proposed or implemented appropriate corrective actions. | Use the general guidance contained in section 71152-03 as an aid in selecting samples for review. The selected samples should be reviewed against the performance attributes 71152 - 4 - Issue Date: 01/05/06 | contained in paragraph 03.02.c. Document the inspection results in accordance with the quarterly inspection report guidance contained in IMC 0612, Section 4OA2 of the sample | inspection report, and section 03.02.d. of this procedure. [C1] 02.03 Biennial Problem Identification and Resolution Inspection Perform a biennial inspection of the problem identification and resolution activities as follows: a. Select a sample of risk significant issues that have been processed through the corrective action process. To the extent available, the sample selected should include conditions adverse to quality which are in the licensee’s corrective action program and are associated with cited or noncited violations of regulatory requirements and issues identified through NRC and industry | operating experience. Refer to Field Policy Manual No. 9, “NRC Review of | INPO Documents,” for guidance prior to reviewing any INPO documents. In addition, for a subset of the samples chosen for review, the scope of the review should be expanded to at least five years. Use general guidance contained in sections 71152-03 and 03.03b as an aid in sample selection. [C1] b. Review each condition/problem selected for review using the performance attributes contained in paragraph 03.03.c of the procedure. c. Review recent audits and/or assessments of the licensee’s corrective action program, and compare and contrast the results of those audits and/or assessments with the results developed through this inspection. d. Using the guidance contained in paragraph 03.03.d assess whether there is indication that licensee personnel may be reluctant to report safety issues. e. Develop an assessment of the licensee’s corrective action program, based on the inspection results developed through steps a. through d. Structure the assessment as summaries of inspection results and conclusions suggested by those results. f. Document the team’s results in accordance with the guidance contained in Appendix D to IMC 0612. 71152-03 INSPECTION GUIDANCE General Guidance To the extent possible, this inspection should follow a performance-based approach. Emphasize the products and results of the licensee’s PI & R program. Inspections performed under this procedure should concentrate on the identification of problems and the effectiveness of corrective actions for risk significant issues rather than on reviewing the administrative aspects of the corrective action program and associated procedures. This inspection will examine, in part, a sample of licensee corrective action issues to provide an indication of overall problem identification and resolution performance. In selecting issues for inspection, the inspectors should seek the broadest range of examples within the cornerstone, including the following considerations: 1. Licensee identified issues (including issues identified during audits or self assessments) including a sample of the highest significance level licensee corrective action items. The licensee’s root cause analyses Issue Date: 01/05/06 - 5 - 71152 associated with these high significance level corrective action items should be assessed using the inspection guidance contained in Inspection Procedure 95001 as an aid.* 2. NRC identified issues during routine, team, and special inspections. Discuss such issues with respective NRC inspectors and management as part of inspection preparations. 3. Issues related to NCVs (for the biennial inspection it is mandatory to review the licensee’s response to a sample of NCVs unless no NCVs were issued in the cornerstone)*. 4. Issues identified through NRC generic communications*. 5. Issues identified through industry operating experience exchange mechanisms (including Part 21 reports, NSSS vendor reports, EPRI reports, experience reports from similar facilities, LERs)*. 6. Specific or cross cutting issues identified by safety review committees or other management oversight mechanisms. 7. Issues identified through employee concerns programs. 8. Issues which deal with effects of operator workarounds on the reliability, | availability, and potential for misoperation of the system. |

• mandatory samples during biennial inspection only

Other than for the mandatory samples indicated above, it is not required to select one of each type of issue listed. The guidance is intended to help ensure that, over the course of an assessment cycle and through the performance of the baseline inspections, an appropriate sample will be obtained by which the NRC can obtain indication of the performance of the various elements of a licensee’s corrective action program. In selecting issues for review, inspectors should also use relevant risk insights such as: 1. Maintenance Rule program basis documents, 2. Current licensee risk analysis results or insights, and 3. Significance Determination Program (SDP) Phase 2 worksheets for the plant. For example, in considering the inspection of licensee corrective actions associated with post maintenance testing (as required by IP 71111, Attachment 19), inspectors should review issues associated with high risk mitigating systems. Additional insights for determining appropriate samples can be obtained by region-based inspectors through discussion with resident inspectors or regional inspectors who are familiar with site issues and who are familiar with the licensee’s problem identification and resolution process. Detailed Review Guidance The following additional guidance should be used in conducting a review of licensee problem identification and resolution activities. 03.01 Routine Review of Identification and Resolution of Problems a. Relationship to Baseline Inspectable Area Procedures. Most of the attachments to baseline inspection procedures contain a requirement to inspect problem identification and resolution performance within the attachment’s area. The routine inspection of PI&R performance as part of baseline inspections is intended to ensure that, over the course of an assessment cycle, a sample of PI&R performance in all cornerstones is obtained. As stated in paragraph 02.01, the primary focus of this portion of the PI & R review should be on verifying that licensees are identifying issues at an appropriate threshold and entering them into their corrective action program. b. Performance Attributes. When evaluating the effectiveness of licensee corrective actions for a particular issue, the licensee’s actions must be viewed 71152 - 6 - Issue Date: 01/05/06 against the nature and significance (or potential significance) of the identified problem. While licensee corrective action programs may appropriately consider monetary, plant availability, and other concerns as factors in determining significance, risk should be a primary factor in the licensee’s significance determination. Attributes to consider during review of licensee actions associated with individual issues include: 1. Complete and accurate identification of the problem in a timely manner commensurate with its significance and ease of discovery. 2. Deleted 3. Evaluation and disposition of operability/reportability issues. 4. Consideration of extent of condition, generic implications, common cause, and previous occurrences. 5. Classification and prioritization of the resolution of the problem commensurate with its safety significance. 6. Identification of root and contributing causes of the problem (this attribute will typically only be assessed for significant conditions adverse to quality and may be deferred to the biennial inspection or in-depth reviews performed elsewhere in this procedure). 7. Identification of corrective actions which are appropriately focused to correct the problem (may be deferred to biennial inspection). 8. Completion of corrective actions in a timely manner commensurate with the safety significance of the issue (may be deferred to biennial inspection). If permanent corrective actions require significant time to implement, then verify that interim corrective actions and/or compensatory actions have been identified and implemented to minimize the problem and/or mitigate its effects, until the permanent action could be implemented. It is not expected that the inspectors assess each attribute for every issue selected for followup during these routine reviews. Rather, inspectors may choose to assess licensee performance against selected attributes, as necessary to be most effective. c. Documentation. In order to help focus the biennial PI&R inspection on areas where concerns have been identified and to support a more complete assessment of the effectiveness of the licensee’s PI&R program, it is important that the NRC document findings resulting from the PI & R inspections conducted as part of the baseline procedure attachments. In general, findings associated with the PI & R program itself should be documented in the PI & R section of the inspection report. Findings associated with the inspectable area and cornerstone should be documented in the associated areas of the inspection report. In addition, semiannually, a section should be added to the quarterly resident inspection report to document the inspector’s assessment of trends that might indicate the existence of a more significant safety issue. Unlike the level of documentation for the routine reviews above, the level of documentation for the trend review should include trends that might not rise to the level of an inspection finding. Issue Date: 01/05/06 - 7 - 71152 Additional guidance regarding documenting the inspection scope, the semiannual trend review, and the thresholds for PI&R issues is contained in IMC 0612 and its exhibits. d. Level of Effort. While it is expected that routine reviews of PI & R activities should equate to approximately 10-15 percent of the resources estimated for the associated baseline cornerstone procedures, this is a general estimate only based upon the overall effort expected to be expended in each strategic performance area. It is anticipated that the actual hours required to be expended may vary significantly from attachment to attachment, depending upon the nature and complexity of the issues that arise at the particular facility. Overall, an effort should be made to remain within the 10 to 15 percent estimate on a strategic performance area basis. Inspection time spent assessing PI & R as part of the baseline procedure attachments should be charged to the corresponding baseline procedure attachment. The daily review of corrective action items should take approximately 30 minutes. The semiannual trend review should take an average of 16-24 hours per year. The time spent performing these reviews should be charged to this | procedure. | 03.02 Selected Issue Follow-up Inspection a.. An additional sample of four to six issues (one of which must involve an issue | associated with an operator workaround program) per year should be chosen | for more in depth review, as necessary to verify that the licensee has taken corrective actions commensurate with the significance of the issue. This sample can be chosen using information obtained from plant status reviews and from reviews conducted as part of the baseline inspection procedure attachments, but need not be limited to those issues that are directly related to the inspection procedure attachments. Samples may also be chosen from the list contained in section 71152-03 of this procedure. The selected sample may also be an issue that is tracked by a performance indicator, for which a color change has yet to occur. b. An operator workaround is defined as operator action(s) taken to compensate | for a degraded or non-conforming condition that complicates the operation of | plant equipment. A risk significant operator workaround is defined as operator | action(s) taken to compensate for a degraded or non-conforming condition | which could result in an increase in the baseline core damage or large early | release frequency and, if such actions could not be implemented effectively, | would be a finding with potentially greater than green significance. | | The intention is to evaluate operator workarounds for mitigating systems to | determine if the mitigating system function is affected or the operator’s ability | to implement abnormal and emergency operating procedures is affected. The | inspector should be cognizant of: (1) operator workarounds that have not been | evaluated by the licensee, (2) operator workarounds that have been formalized | as the long-term corrective action for a degraded or non-conforming condition | (and therefore may not be tracked by the licensee as an operator workaround), | and (3) operator workarounds that increase the potential for personnel error, | including operator workarounds that: | | 1. Require operations contrary to past training or require more detailed | knowledge of the system than routinely provided. | | 2. Require a change from longstanding operational practices. | | 71152 - 8 - Issue Date: 01/05/06 | 3. Require operation of system or component in a manner dissimilar from | similar systems or components. | | 4. Create the potential for the compensatory action to be performed on | equipment or under conditions for which it is not appropriate. | | 5. Impair access to required indications, increase dependence on oral | communications, or require actions under adverse environmental | conditions. | | 6. Require the use of equipment and interfaces that had not been designed | with consideration of the task being performed. c. Performance Attributes When evaluating the effectiveness of licensee corrective actions for a particular issue, the licensee’s actions must be viewed against the nature and significance of the identified problem. While licensee corrective action programs may appropriately consider monetary, plant availability, and other concerns as factors in determining significance, risk should be a primary factor in the licensee’s significance determination. Attributes to consider during review of licensee actions associated with individual issues include: 1. Complete and accurate identification of the problem in a timely manner commensurate with its significance and ease of discovery. 2. Deleted 3. Evaluation and disposition of operability/reportability issues. 4. Consideration of extent of condition, generic implications, common cause, and previous occurrences. 5. Classification and prioritization of the resolution of the problem commensurate with its safety significance. 6. Identification of root and contributing causes of the problem (this attribute will typically only be assessed for significant conditions adverse to quality). Use inspection guidance contained in Inspection Procedure 95001 as an aid in assessing the adequacy of licensee root cause analyses. 7. Identification of corrective actions which are appropriately focused to correct the problem. 8. Completion of corrective actions in a timely manner commensurate with the safety significance of the issue. If permanent corrective actions require significant time to implement, then verify that interim corrective actions and/or compensatory actions have been identified and implemented to minimize the problem and/or mitigate its effects, until the permanent action could be implemented. In addition to the general performance attributes contained above, the inspector should refer to Inspection Procedure 95001 for additional guidance on assessing licensee evaluations of significant performance issues. It is not expected that the inspectors assess each attribute for every issue selected for followup during these routine reviews. Rather, inspectors may choose to assess licensee performance against selected attributes, as necessary to be most effective. Issue Date: 01/05/06 - 9 - 71152 d. Documentation The basis for selection and the scope of review of each sample should be documented in the “Scope” section of 4OA2 of the inspection report. In general, issues associated with the PI & R programs implementation should be documented in the “Findings” section of 4OA2 of the report. This documentation should include factual information that relates to the performance attributes listed in 03.01.b, if that information indicates licensee performance weaknesses. This documentation standard is different from the standard used to document issues elsewhere in the quarterly inspection reports. Assessments of PI&R program effectiveness will not be done during these inspections. Such assessments will only be done during the periodic team inspection. Only green or greater findings will be included in the summary of findings of the inspection report. Technical issues associated with other inspectable areas and cornerstones should also be documented in those sections of the report. e. Level of Effort The review of four to six samples should take an average of 56 to 76 | hours for a 1–unit site, 58 to 78 for a 2–unit site, and 60 to 80 hours for | a 3–unit site annually in direct inspection effort and may be completed by | resident and/or regional inspectors. Inspection time associated with this review should be charged to this procedure. 03.03 Biennial Problem Identification and Resolution Inspection. The biennial inspection of problem identification and resolution is intended to complement and expand upon the reviews described in Section 03.01 and 03.02 of this procedure by: 1. Evaluating additional examples of licensee problem identification and resolution. 2. Reviewing the resolution of issues that earlier had been assessed for the licensee’s identification efforts only. 3. Comparing the NRC’s results against the licensee’s own assessment of performance in the PI & R area. 4. Assessing whether PI & R deficiencies exist across cornerstones that might indicate potential programmatic issues. a. Planning. Obtain licensee administrative procedures that control the identification, evaluation, and resolution of problems. Selected licensee documents needed to support the inspection may be obtained prior to the inspection. These documents should only be reviewed to provide the inspectors with sufficient knowledge of the licensee’s programs and processes, as necessary to conduct an effective and efficient inspection. Obtain and review documents for the in-office review, such as a list of corrective action documents issued from the time of the last PI & R inspection (e.g., a list of work orders, work requests, temporary modifications, calibration failures, condition/problem identification reports, operability evaluations and determinations, etc.). Also, obtain relevant licensee corrective action program assessments, program performance information, and trend reports. Obtain and review procedures and documentation on licensee efforts to identify, resolve and prevent structure, system and component (SSC) performance problems through performance monitoring, root cause analysis, 71152 - 10 - Issue Date: 01/05/06 cause determination and corrective action to meet the monitoring requirements of the MR (10 CFR 50.65). Obtain and review all NRC inspection reports issued since the last PI&R inspection, including the inspection reports that contain the semiannual resident | reviews to determine: 1. the extent to which all cornerstones have been sampled by routine reviews of licensee PI&R activities and determine if additional PI&R samples are warranted in any cornerstone(s). 2. the extent to which licensee actions to NCVs have been sampled by routine reviews of licensee PI&R activities. | 3. whether there are any trends or patterns in corrective action program or | performance issues which may warrant additional sampling to confirm. For example, a series of issues associated with “failure to follow procedures” within one cornerstone may indicate a corrective action performance deficiency within a portion of the licensee’s organization; a series of issues associated with failure to follow procedures in multiple cornerstones may indicate a broader concern. Also, a lack of licensee identified corrective action issues within a particular organization may be indicative of a problem with the identification threshold. Consider the need to follow-up on performance trends documented as a result of the semiannual trend review. b. Biennial Inspection Sample Selection. Based on the planning review, identify a sample of licensee corrective actions for review. The samples chosen for review should include a range of issues selected from the list in section 71152- 03, including those sample types that are designated as requiring a mandatory review. In addition, for a subset of the samples chosen for review, the scope of the review should be expanded to at least five years. Among the samples chosen for this extended review should be those issues whose significance might be age dependent, such as issues associated with erosion of piping, boric acid accumulations, aging of electronic components, environmental qualification, etc. This review can be performed by requesting the licensee to perform a corrective action program search (computerized or other) for those items designated by the team for the five-year review. No specific number of previously reviewed or additional samples is specified. Rather, the biennial inspection team leader should choose as many examples as warranted to complement the routine PI&R inspections and ensure a sufficient basis for evaluating the effectiveness of the licensee’s PI&R program. The inspectors, as an option, may consider selecting one or more risk significant systems and using a “vertical slice” approach to picking the inspection sample, so long as the system(s) selected will provide adequate coverage across all cornerstones in the reactor safety strategic performance area. In such cases, additional samples may be required to ensure adequate coverage across cornerstones in the radiations safety or safeguards strategic performance areas. An effort should however be made to maintain the total hours expended in completing this procedure to within the estimated level of resources contained in paragraph 71152-04. The inspection team should make every effort to walkdown applicable portions of the selected systems or perform field verification of selected corrective action samples. c. Performance Attributes. When evaluating the effectiveness of licensee corrective actions for a particular issue or issues, the licensee’s actions must Issue Date: 01/05/06 - 11 - 71152 be viewed against the nature and significance of the identified problem. While licensee corrective action programs may appropriately consider monetary, plant availability, and other concerns as factors in determining significance, risk should be a primary factor in the licensee’s significance determination. Attributes to consider during review of licensee corrective actions include: 1. Complete and accurate identification of the problem in a timely manner commensurate with its significance and ease of discovery. 2. Evaluation and disposition of operability/reportability issues. 3. Consideration of extent of condition, generic implications, common cause, and previous occurrences. 4. Identification of significant negative trends associated with human or equipment performance. 5. Classification and prioritization of the resolution of the problem commensurate with its safety significance. 6. Identification of root and contributing causes of the problem for significant conditions adverse to quality. Use inspection guidance contained in Inspection Procedure 95001 as an aid in assessing the adequacy of licensee root cause analyses. 7. Identification of corrective actions which are appropriately focused to correct the problem (and to address the root and contributing causes for significant conditions adverse to quality). 8. Completion of corrective actions in a timely manner commensurate with the safety significance of the issue (included within this attribute would be justifications for extending corrective action due dates). If permanent corrective actions require significant time to implement, then verify that interim corrective actions and/or compensatory actions have been identified and implemented to minimize the problem and/or mitigate its effects, until the permanent action could be implemented. 9. In addition, for the above samples that involve maintenance effectiveness, the inspector should verify the following: | | (a) Review MR repetitive maintenance preventable functional failures (MPFFs) for indications of weaknesses in the licensee’s corrective action program. In addition, identify any problems with root cause analysis or cause determination and corrective action for SSCs experiencing repetitive MPFFs or exceeding their goals or performance criteria, (b) Ensure that risk assessment, risk management, and emergent work control problems associated with maintenance are identified and resolved promptly. Additional guidance relative to the MR can be found in Inspection Procedure 71111.12. d. Assessment of Safety Conscious Work Environment. In conducting interviews with or observing other activities involving licensee personnel during the inspection, be sensitive to areas where employees may be reluctant to raise concerns. Although the licensee may be implementing an employee concerns program regarding the identification of safety issues, the possibility of existing 71152 - 12 - Issue Date: 01/05/06 underlying factors that would produce a "chilling" effect or reluctance to report such issues could exist and the inspector should be alert for such indications. Such factors could go beyond direct retaliation, and could include issues such as inadequate staffing that results in excessive overtime and an unwillingness to raise issues that might result in further increases to an already high workload. Appendix 1 to this procedure provides a list of questions that can be used when discussing PI & R issues with licensee individuals to help assess whether there are impediments to the establishment of a safety conscious work environment. It is not intended that inspectors conduct formal interviews solely for the purpose of assessing the work environment, but rather, that the inspectors make use of the questions in Appendix 1 during discussions with licensee individuals concerning other attributes of the inspection. It is expected that during this inspection, discussions/interviews will be held with both licensee management and staff. If, as a result of the interviews or observations, the inspector becomes aware of specific examples of employees being discouraged from raising safety or regulatory issues within the licensee’s or contractor’s organization or to the NRC, the inspector should get as complete a set of facts as possible. If the inspector becomes aware of a reluctance of employees to raise safety or regulatory issues unrelated to a specific event or incident, continue pursuing the issue during the remaining interviews and try to determine the reason employees are reluctant to raise issues. However, if any indication of a "chilling" effect is suspected, inform regional management for further review and follow-up. Inspectors should be sensitive to the need to appropriately capture and forward any allegations that may be received during the inspection. e. Development of PI&R Program Performance Insights. By reviewing a sufficient number and breadth of samples, the inspection team should be able to develop insights into the effectiveness of the licensee’s corrective action program. Compare the result of the team’s review of corrective action issues with licensee performance reviews, including specific licensee reviews of the corrective action program. Determine whether licensee reviews are consistent with the NRC review of corrective action issues. The intent of this inspection procedure (both the routine and biennial inspection effort) is to provide insights into licensee performance in the PI & R area based upon a performance-based review of corrective action issues. More detailed programmatic reviews of licensee performance in the PI & R area will be | conducted during supplemental inspections, if established performance | thresholds are crossed. f. Documentation and Evaluation of Program Effectiveness. At the completion of inspection activities, the team should develop a clear and concise discussion of the results of their review. This discussion should be supported by the inspection activities conducted over the assessment cycle including routine inspections, selected sample follow-up inspections, and the biennial inspection of PI&R activities. The discussion should be documented in the inspection report for the biennial PI & R inspection and should be included in the PIM. Included in the documentation should be any issues associated with establishment of a safety conscious work environment that may have been detected during the inspection. Additional evaluation of the licensee’s PI & R programs will be conducted as part of the mid-cycle and/or end of cycle plant performance review by assessing licensee performance using the results of this inspection, as well as other information, including performance indicator data and the results of any supplemental inspections. Additional guidance on documenting the biennial Issue Date: 01/05/06 - 13 - 71152 problem identification and resolution inspection is contained in Appendix D to IMC 0612. 71152-04 RESOURCE ESTIMATE The daily review of corrective action items should take approximately 30 minutes. The semiannual trend review should take an average of 16-24 hours per year. The time spent performing these reviews should be charged to 71152. | The review of the four to six samples per paragraph 02.02 is estimated to take, on an | annual basis, the following direct inspection effort: 56 to 76 hours for a 1–unit site, 58 to | 78 for a 2–unit site; and 60 to 80 hours for a 3–unit site. The time spent reviewing four to | six samples should be charged to 71152. The biennial team inspection will involve on average 212 to 288 hours of direct inspection. Participation (either full or part time) on the inspection team by a member of the resident inspector staff should be strongly considered. The time spent performing the biennial team inspection should be charged to 71152B. 71152-05 REFERENCES | | NRC Inspection Manual Part 9900 ?Resolution of Degraded and Non-Conforming | Conditions” | 71152-06 PROCEDURE COMPLETION | | Inspection of the minimum sample size will constitute completion of this procedure in the | Reactor Program System (RPS). The minimum sample size consists of a total of 7 | samples regardless of the number of reactor units at that site. The inspection samples are | defined as follows: 2 semiannual trend reviews; 4 annual, in-depth reviews per paragraph | 02.02; and 1 sample consisting of the biennial team inspection. | END Appendix: SUGGESTED QUESTIONS FOR USE IN DISCUSSIONS WITH LICENSEE INDIVIDUALS CONCERNING PI & R ISSUES Attachment: Revision History APPENDIX SUGGESTED QUESTIONS FOR USE IN DISCUSSIONS WITH LICENSEE INDIVIDUALS CONCERNING PI & R ISSUES The following are suggested questions that may be used when discussing PI & R issues with licensee individuals. It is not intended that these questions are asked verbatim, but rather, that they form the basis for gathering insights regarding whether there are impediments to the formation of a safety conscious work environment. Suggested Questions 1. How would the individual raise a safety or regulatory issue (e.g., inform supervisor, corrective action program, employee concern program (ECP), NRC)? 2. Why would they pick that approach (e.g., supervisor’s preference, trying to keep numbers down, system difficult to use)? 3. Has the person ever submitted an issue to the corrective action program or the ECP? Was the issue adequately addressed? If not, did he or she pursue the issue? If not, why not? 4. Does the individual know whether employee concerns are tracked to completion and whether employees are informed of the result? 5. Does the individual believe the licensee's corrective action programs are successful in addressing issues submitted? 6. Is the individual aware of any specific instances in which another employee submitted an issue to the corrective action program or ECP and considered the licensee’s response incomplete or unacceptable or was retaliated against for pursuing the issue? (Try to get enough specific information to followup with the other employee.) 7. Does the individual believe there has been a change in the amount of time necessary to resolve corrective action issues or employee concerns? 8. Is the individual aware of or have there been interactions with NRC personnel that suggest that some employees may be hesitant to raise concerns or present information to the NRC? 9. Is the individual aware of any events that would discourage employees from raising concerns (e.g., chastisement for submitting issues to corrective action program, ECP, or NRC; supervisors holding up submittal of concerns). Has there been an unexplainable change in the number or nature of concerns raised by employees to the licensee’s corrective action program or employee concern program or the NRC? 10. Are there any unofficial corrective actions or tracking systems that exist because the existing formal systems are thought to be ineffective? (Unofficial corrective actions that bypass the recognized corrective action program have been previously in engineering and health physics areas.) END ATTACHMENT Revision History - IP 71152 Commitment Tracking Number Issue Date Description of Change Training Needed Training Completion Date Comment Resolution Accession Number N/A 03/06/2001 CN 01-006 Revised to delete certain inspection requirements (collective risk of maintenance backlog and equipment unavailability accounting), eliminate duplication within the procedure, and provide additional guidance concerning the review of a safety conscious work environment. NO N/A N/A N/A 01/17/2002 CN 02-001 Revised to include changing the inspection frequency to biennial and add guidance on the conduct of inspections of 3 to 6 samples per year outside of the team inspections. NO N/A N/A C1 09/08/2003 CN 03-032 Revised to incorporate recommendations made by the PI&R focus group to address several items from the Davis Besse Lessons Learned Task Force. The changes include enhanced requirements regarding the routine PI&R reviews conducted by resident inspectors, biennial reviews of longstanding issues, and biennial reviews of operating experience issues. YES 09/24/2003 N/A N/A 01/05/2006C N 06-001 A requirement to inspect for cumulative effects of operator workarounds to IP 71152 as one of its annual samples was added. Also, the annual sample size and the estimate inspection resources required to complete this IP was increased to support review of operator work arounds. Completed historical CN search. NO N/A N/A Issue Date: 01/05/06 A-1 71152