IR 05000316/2004004
ML041740580 | |
Person / Time | |
---|---|
Site: | Cook |
Issue date: | 06/22/2004 |
From: | Reynolds S Division Reactor Projects III |
To: | Nazar M American Electric Power Co |
References | |
IR-04-004 | |
Download: ML041740580 (29) | |
Text
une 22, 2004
SUBJECT:
DONALD C. COOK NUCLEAR POWER PLANT, UNIT 2 NRC SUPPLEMENTAL INSPECTION REPORT 05000316/2004004 (DRP)
Dear Mr. Nazar:
On April 30, 2004, the U.S. Nuclear Regulatory Commission (NRC) completed a supplemental inspection using Inspection Procedure 95002, Inspection For One Degraded Cornerstone Or Any Three White Inputs In A Strategic Performance Area, at your D. C. Cook Nuclear Power Plant. The enclosed report documents the results of the inspection which were discussed on May 12, 2004, with Mr. J. Jensen and other members of your staff.
As discussed in our annual end-of-cycle assessment letter dated March 4, 2004, plant performance for D. C. Cook Unit 2 was categorized within the Degraded Cornerstone column of the NRCs Action Matrix based on two White performance indicators in the Initiating Events cornerstone. The NRC performed this supplemental inspection as prescribed by the Action Matrix based on this performance.
In July 2003, your second quarter 2003 performance indicator submittal reported that the Unit 2 Scrams With Loss of Normal Heat Removal performance indicator had crossed the Green-to-White threshold. Your third and fourth quarter performance indicator submittals reported that this performance indicator continued to be categorized as White. Your corrective actions to address this White performance indicator were previously evaluated using Inspection Procedure 95001, Inspection For One Or Two White Inputs In A Strategic Performance Area, the results of which were documented in NRC Inspection Report 05000316/2003014 (DRP).
The NRC concluded in that report that you had performed a thorough root cause evaluation and that your corrective actions to address this White performance indicator were reasonable. In January 2004, your fourth quarter 2003 performance indicator submittal reported that the Unit 2 Unplanned Scrams Per 7000 Critical Hours performance indicator had also crossed the Green-to-White threshold.
This supplemental inspection was conducted to review your corrective actions to individually and collectively address both of these White performance indicators and examined activities conducted under your license as they relate to safety and compliance with the Commission's rules and regulations and with the conditions of your license. The inspectors reviewed selected procedures and records, observed activities, and interviewed personnel. The purpose of this inspection was to (1) provide assurance that the root causes and contributing causes for the individual White performance indicators and for the collective performance issues which resulted in the degraded cornerstone were understood; (2) independently assess the extent of condition and extent of cause for the individual White performance indicators and collective performance issues; and (3) provide assurance that your planned corrective actions were sufficient to address the root causes and contributing causes for the White performance indicators and to prevent their recurrence.
Based upon the results of this inspection, no findings of significance were identified. The inspectors determined that your Common Cause Evaluation identified the root causes and contributing causes for the two Unit 2 White performance indicators which resulted in the degraded cornerstone. However, the inspectors identified some disparities between the corrective actions prescribed in your Common Cause Evaluation and the associated D. C. Cook Recovery Plan which you relied upon to implement these corrective actions. The inspectors concluded that these disparities could impact the successful implementation of corrective actions necessary to address the identified root causes and contributing causes which resulted in the White performance indicators.
Also, the inspectors reviewed the causal factors for the White performance indicators and determined that a common denominator was an ineffective corrective action program. Causal factors consistently identified in your evaluations were the failure to take timely and/or effective corrective actions to address identified problems and the inability to identify low level event precursors; elements related to the corrective action program. Because corrective action program deficiencies were also identified during a previous Inspection Procedure 95002 inspection and because a long-standing substantive cross-cutting issue exists in the Problem Identification and Resolution area, continued management attention in this area is warranted.
In accordance with 10 CFR 2.390 of the NRCs "Rules of Practice," a copy of this letter and its enclosure will be made available electronically for public inspection in the NRC Public Document Room or from the Publicly Available Records (PARS) component of NRCs document system (ADAMS). ADAMS is accessible from the NRC Web site at http://www.nrc.gov/reading-rm/adams.html (the Public Electronic Reading Room).
Sincerely,
/RA by Patrick L. Hiland Acting for/
Steven A. Reynolds Acting Director Division of Reactor Projects Docket Nos. 50-315; 50-316 License Nos. DPR-58; DPR-74
Enclosure:
Inspection Report 05000316/2004004(DRP)
w/Attachment: Supplemental Information See Attached Distribution
DOCUMENT NAME: C:\ORPCheckout\FileNET\ML041740580.wpd To receive a copy of this document, indicate in the box: "C" = Copy without attachment/enclosure "E" = Copy with attachment/enclosure "N" = No copy OFFICE RIII RIII RIII NAME RLerch:ags* EDuncan* SReynolds*PLH for DATE 06/07/04 06/08/04 06/22/04 OFFICIAL RECORD COPY
REGION III==
Docket No: 50-316 License No: DPR-74 Report No: 05000316/2004004(DRP)
Licensee: Indiana Michigan Power Company Facility: Donald C. Cook Nuclear Power Plant, Unit 2 Location: 1 Cook Place Bridgman, MI 49106 Dates: April 19 through May 12, 2004 Inspectors: S. Burton, Monticello Senior Resident Inspector C. Phillips, Senior Operator Licensing Examiner P. Snyder, Byron Resident Inspector R. Ng, Reactor Engineer Approved by: E. Duncan, Chief Branch 6 Division of Reactor Projects Enclosure
SUMMARY OF FINDINGS
IR 05000316/2004004(DRP); 04/19/2004-05/12/2004; Indiana Michigan Power Company,
Donald C. Cook Nuclear Power Plant; Inspection Procedure 95002, Inspection For One Degraded Cornerstone Or Any Three White Inputs In A Strategic Performance Area This report covers a supplemental inspection performed by region-based and resident inspectors. The NRC's program for overseeing the safe operation of commercial nuclear power reactors is described in NUREG-1649, "Reactor Oversight Process," Revision 3, dated July 2000.
Cornerstone: Initiating Events
The U.S. Nuclear Regulatory Commission (NRC) performed this supplemental inspection to assess the licensees evaluation of two White performance indicators (PIs) in the Unplanned Scrams Per 7000 Critical Hours and the Scrams With Loss of Normal Heat Removal areas of the Initiating Events cornerstone.
This inspection was conducted in accordance with Inspection Procedure 95002, Inspection For One Degraded Cornerstone Or Any Three White Inputs In A Strategic Performance Area, and evaluated the licensees actions to address these White performance indicators. The inspectors concluded that the licensee performed a comprehensive evaluation of the issues, both individually and collectively. The licensee identified the underlying causal factors as an ineffective corrective action program, an ineffective equipment reliability program, and ineffective human performance improvement initiatives. The licensees planned corrective actions were identified in the associated Common Cause Evaluation and tracked for implementation in the D. C. Cook Recovery Plan.
The inspectors did not identify any findings during their review of the licensees evaluation; however, some disparities between the corrective actions prescribed in the Common Cause Evaluation and the D. C. Cook Recovery Plan which were relied upon to implement these corrective actions were identified. The inspectors concluded that these disparities could impact the successful implementation of actions necessary to address the identified root causes and contributing causes which resulted in the White performance indicators. Although none of the issues identified represented a finding or violation of regulatory requirements of more than minor significance, each represented a weakness within the licensees corrective action process.
REPORT DETAILS
INSPECTION SCOPE
This inspection was conducted in accordance with Inspection Procedure 95002, Inspection For One Degraded Cornerstone Or Any Three White Inputs In A Strategic Performance Area, to assess the licensees evaluation of two White performance indicators (PIs) in the Initiating Events cornerstone. The inspection objectives were to provide assurance that the root causes and contributing causes for the individual White performance indicators and for the collective performance issues which resulted in the degraded cornerstone were understood, to independently assess the extent of condition and extent of cause for the individual White performance indicators and collective performance issues, and to provide assurance that the corrective actions were sufficient to address the root causes and contributing causes for the White performance indicators and to prevent their recurrence.
D. C. Cook Unit 2 entered the Degraded Cornerstone column of the NRCs Action Matrix in the fourth quarter of 2003 as a result of two White performance indicators (PIs) in the Initiating Events cornerstone. In July 2003, the licensees second quarter 2003 performance indicator submittal reported that the Scrams With Loss of Normal Heat Removal performance indicator had crossed the Green-to-White threshold. The third and fourth quarter performance indicator submittals reported that this performance indicator continued to be categorized as White. This performance indicator was previously inspected using Inspection Procedure 95001, Inspection For One Or Two White Inputs In A Strategic Performance Area. The root causes for the trips with a loss of normal heat removal were the failure to implement an effective equipment reliability program to resolve long-standing and repetitive equipment problems, and an inadequate reactor trip response procedure. The NRC concluded that the licensee had performed a thorough root cause evaluation and that the corrective actions identified were reasonable. The results of this inspection and the findings identified during the inspection are documented in NRC Inspection Report 05000316/2003014(DRP).
The scope of this inspection included a review of the root cause evaluation, extent of condition, extent of cause, and corrective actions for a second White performance indicator in the Unplanned Scrams Per 7000 Critical Hours area that was reported in the licensees fourth quarter performance indicator submittal, and the common issues identified for both of the White performance indicators. The licensees evaluation of the second White performance indicator and the common causes for both White performance indicators were documented in Condition Report (CR) 03365036, Common Cause Evaluation (CCE) of the Initiating Events Degraded Cornerstone.
Additionally, the CCE referenced three additional root cause evaluations which independently assessed the contributing causes identified by the licensee during their CCE. In addition to a detailed review of the licensees evaluation, the inspectors performed an independent extent of condition and extent of cause review for the individual and common causes.
The licensees corrective actions also referenced the D. C. Cook Recovery Plan as the mechanism to implement these corrective actions. The D. C. Cook Recovery Plan was a performance improvement initiative to address performance problems that had been previously identified. The Recovery Plan contained many of the corrective action elements identified in the licensees CCE. The Recovery Plan was initiated in the Fall of 2003 prior to the identification of the degraded Initiating Events cornerstone. The inspectors included the D. C. Cook Recovery Plan in their review.
The reactor trips which caused the Unplanned Scrams Per 7000 Critical Hours and Scrams With Loss of Normal Heat Removal performance indicators to cross the Green-to-White threshold are described below:
- An automatic Unit 2 reactor trip occurred on October 7, 2001, due to the failure of a voltage regulator input resistor in the North Control Rod Drive Motor Generator (MG) set. The failure of the resistor resulted in the collapse of the North MG set field and created a rapid voltage transient in the South MG set.
The loss of both MG sets caused multiple rods to drop into the core and resulted in a negative rate reactor trip. In addition, operators closed the Main Steam Isolation Valves (MSIVs) to address excessive reactor coolant system (RCS)cooldown. The closure of the MSIVs isolated the normal heat removal path to the main condenser.
- An automatic Unit 2 reactor trip occurred on May 12, 2002, due to the failure of two redundant power supplies in a reactor control instrumentation cabinet. The failure of the power supplies resulted in the closure of a feedwater regulating valve and caused a reactor trip on low feedwater flow coincident with low steam generator level. In addition, condenser steam dump controls were disabled, resulting in a loss of the normal heat removal path to the main condenser.
- An automatic Unit 2 reactor trip occurred on July 22, 2002, due to a loss of condenser vacuum that occurred during condenser waterbox cleaning.
Operators closed the MSIVs to address excessive RCS cooldown. The closure of the MSIVs isolated the normal heat removal path to the main condenser.
- An automatic Unit 2 reactor trip occurred on February 5, 2003, due to the failure of a 24 Volt Direct Current control group power supply. The failure of the power supply resulted in the closure of a feedwater regulating valve and caused a reactor trip on low feedwater flow coincident with low steam generator level.
Following the reactor trip, operators closed the MSIVs to address excessive RCS cooldown. The closure of the MSIVs isolated the normal heat removal path to the main condenser.
- Unit 1 and Unit 2 manual reactor trips occurred on April 24, 2003, due to a large influx of fish which significantly degraded circulating water flow. The degraded circulating water flow resulted in a loss of condenser vacuum and a loss of the normal heat removal path to the main condenser.
- An automatic Unit 2 reactor trip occurred on December 30, 2003, due to a short-to-ground in the Control Room Instrument Distribution system which occurred during a routine controller calibration. The short-to-ground caused a relay in the power supply circuit for the feedwater isolation valves to de-energize.
As a result, the feedwater isolation valves closed which resulted in a reactor trip on low feedwater flow coincident with low steam generator level.
The following reactor trips were also reviewed as part of the licensees CCE, but did not directly contribute to the White performance indicators since these trips were associated with Unit 1.
- A manual Unit 1 reactor trip occurred on June 14, 2002, due to debris in the main feedwater condensers. An influx of zebra mussel shells and debris following a circulating water pump start caused blockage of the main feedwater pump condensers. A main feedwater pump tripped on low vacuum as the feedwater pump condenser became clogged with zebra mussels. Operators manually tripped Unit 1 in response to the trip of the main feedwater pump.
- An automatic Unit 1 reactor trip occurred on January 15, 2003, due to a fault in the Unit 1 main transformer resulting in a fire. The fault caused an automatic main generator trip and a reactor trip.
The following reactor trips were also reviewed as part of the licensees CCE, but occurred after the performance indicators had crossed the Green-to-White threshold.
- An automatic Unit 2 reactor trip occurred on March 29, 2004, due to the grounding of one phase of the Control Rod Drive MG set when an auxiliary equipment operator incorrectly racked in a reactor trip bypass breaker following a Solid State Protection System test. The grounding of the MG set caused multiple control rods to drop into the core and resulted in a negative rate reactor trip.
- An automatic Unit 2 reactor trip occurred on April 8, 2004, due to a feedwater flow transient. This transient resulted in oscillating flows to the steam generators and a high steam generator level main turbine trip. The main turbine trip caused a reactor trip. The cause of feedwater transient was under investigation at the time of inspection.
The following inspection results are organized by the specific inspection requirements of Inspection Procedure 95002 which are identified in italics in each section.
EVALUATION OF INSPECTION REQUIREMENTS 02.01 Problem Identification a.
Determine that the evaluation identifies who (i.e., licensee, self-revealing, or NRC), and under what conditions the issue was identified.
All reactor trips that contributed to the two White performance indicators were self-revealing events.
As discussed in NRC Inspection Report 05000316/2003014, the NRC resident inspectors questioned two Unit 2 reactor trips that were not reported in the licensees data for the Scrams With Loss of Normal Heat Removal performance indicator. The data-reporting issues identified by the resident inspectors were submitted for resolution using the Frequently Asked Question (FAQ) process. Following the resolution of the FAQs associated with these two trips, the licensee reported that these trips and three other reactor trips on May 12, 2002; July 22, 2002; and April 24, 2003; were performance indicator occurrences that had caused the Scrams With Loss of Normal Heat Removal performance indicator to cross the Green-to-White threshold.
On December 30, 2003, a Unit 2 reactor trip caused the Unplanned Scrams Per 7000 Critical Hours performance indicator to cross the Green-to-White threshold. The licensee identified and documented this trip and the other reactor trips that contributed to this White performance indicator in their CCE. The inspectors determined that the licensee properly identified the root causes and contributing causes which resulted in this performance indicator crossing the Green-to-White threshold; however, the inspectors determined that the licensee had not adequately addressed the problem when identified in condition reports at the precursor level on two previous occasions (Section 2.01.b).
The inspectors reviewed equipment, procedural, and human performance issues that resulted in the reactor trips to verify that the licensee was properly identifying and correcting problems. The inspectors determined that all of the reactor trips and associated performance issues previously identified by the licensee had been entered into the corrective action program. However, the inspectors identified a vulnerability associated with the licensees documentation of the failure of the main generator output breaker to open automatically following a reactor trip.
Post-trip reports for Unit 2 reactor trips on December 30, 2003, and April 8, 2004, identified that the main generator output breaker failed to automatically open as expected. The inspectors identified that these failures were documented in condition reports that contained a number of other unrelated issues and the licensees resolution of those condition reports failed to address the failure of the generator output breaker to open. Although these output breaker failures represented a condition adverse to quality, the generation of a separate condition report to identify this problem was not required by licensee procedures. The inspectors interviewed members of the licensees engineering staff and determined that the technical problem with the generator output breaker was resolved; however the failure to document the issue in a separate condition report impaired the licensees ability to evaluate the condition, to trend the issue, and to analyze a potential extent of condition concern.
The inspectors concluded that the practice of identifying multiple unrelated issues in a single condition report was a vulnerability which could diminish the effectiveness of the licensees corrective action program. The licensee concurred with the observation and generated three condition reports to address the issue. Condition Report 04114060 identified the problem with the identification of multiple unrelated issues in a single condition report; CR 04114064 identified the lack of documentation of the technical evaluation for the failure of the Unit 2 generator output breaker to automatically open following a turbine trip; and CR 04114066 was generated to ensure that all issues identified during the April 8, 2004, Unit 2 reactor trip were captured in individual condition reports.
No additional concerns were identified by the inspectors.
b. Determine that the evaluation documents how long the issue existed, and prior opportunities for identification.
The inspectors determined that the licensee had prior opportunities to identify and evaluate trends that caused the Unplanned Scrams Per 7000 Critical Hours performance indicator to cross the Green-to-White threshold. Condition Report 01102028, dated April 12, 2001, identified that in the first quarter of 2001, the Unplanned Scrams Per 7000 Critical Hours performance indicator had developed an adverse trend. However, no common causes were identified for the reactor trips which impacted this indicator. Instead, the licensee concluded that material condition problems were expected to occur as a result of a 3-year extended shutdown which ended in 2000. The licensees evaluation also concluded that the safety significance of each event was minor and that, overall, there was no decline in plant performance.
Condition Report 02281070, dated October 8, 2002, was also initiated for approaching the Unplanned Scrams Per 7000 Critical Hours performance indicator threshold.
Although performance and equipment reliability issues were identified in the condition report as the causes for the reactor trips which impacted this performance indicator, a decrease in the number of reactor trips in the third quarter of 2002 compared to the second quarter of 2002 was cited as evidence that plant performance was improving.
This logic led licensee personnel to conclude that continued operation through the end of 2002 without another reactor trip would cause the numerical value of the performance indicator to decrease further. As a result, no additional corrective actions or reviews were considered necessary or were performed.
Using licensee data, the inspectors determined that these evaluations failed to recognize that Unit 2 exceeded the average yearly trip rate for pressurized water reactors in the United States by 2.4 times in 2001 and by 2.9 times in 2002. The inspectors concluded that the licensee identified the negative trend in the performance indicator, but failed to collectively review the reactor trips to gain the necessary insights to develop corrective actions to prevent crossing the performance indicator threshold.
c. Determine that the evaluation documents the plant specific risk consequences (as applicable) and compliance concerns associated with the issue(s) both individually and collectively.
The plant specific risk consequences of each reactor trip associated with the Unplanned Scrams Per 7000 Critical Hours performance indicator was evaluated by the licensee and the safety significance was determined to be minimal. This evaluation was accomplished in individual condition reports for each reactor trip and the results were reaffirmed during the CCE. In December 2003, the NRC reviewed the licensees evaluation of the safety significance for the Scrams With Loss of Normal Heat Removal performance indicator. The results of this review were documented in NRC Inspection Report 05000316/2003014. No issues regarding the plant specific risk consequences for the individual reactor trips were identified.
A formal quantitative assessment of the collective risk from the reactor trips which contributed to both White performance indicators was not initially available when requested by the inspectors. The licensees CCE contained a qualitative assessment of the risk; however, no conclusion was clearly stated. Following discussions of this issue with licensee personnel, a collective quantitative risk assessment was performed.
Subsequently, the inspectors were able to verify that although an increase in risk resulted from the combined events, that increase was small. No additional issues regarding the collective risk consequences for the trips were identified.
02.02 Root Cause and Extent of Condition Evaluation a.
Determine that the problem was evaluated using a systematic method(s) to identify root cause(s) and contributing cause(s).
The inspectors concluded that the licensee used a systematic method to identify the root causes and contributing causes for the White performance indicators which resulted in the degraded Initiating Events cornerstone. However, the inspectors determined that the method the licensee utilized was not an industry-recognized method. The licensees CCE did not document the method or assumptions used to perform the CCE and did not include any of the supporting charts or tables used to reach the conclusions documented in the CCE. Due to the lack of documentation, the inspectors relied on interviews with members of the licensees CCE team to reach the conclusion that a systematic method of data analysis was used. Licensee management stated that there was no documented method of performing a common cause analysis available at the site. Licensee management also stated they were in the process of developing a guideline to perform common cause evaluations. The inspectors determined that a corrective action to develop an industry-recognized common cause analysis technique was still in progress at the end of the inspection.
Licensee personnel stated that the CCE for the Unplanned Scrams Per 7000 Critical Hours performance indicator reviewed the causes and the cause codes from the reactor trips resulting in this White performance indicator. Additionally, licensee personnel stated that the causes and cause codes for six additional root cause reports associated with previous Unit 1 and Unit 2 reactor trips, and the root cause report for the White performance indicator in the Scrams With Loss of Normal Heat Removal area were also reviewed. Licensee personnel stated that due to inconsistent and/or incorrect coding, there was not enough useable cause code data from these root cause reports to perform an adequate cause code analysis.
As a result, licensee personnel developed a Trip and Cause matrix for the root causes and contributing causes identified in the previous root cause reports and then categorized these root causes and contributing causes into thematic areas. The six areas developed were Obsolescence/Aging, Failure to Use Operating Experience, Human Performance, Corrective Action Program Failure, Equipment Reliability, and Procedural/Operational Guidance.
Each CCE team member was assigned an area to independently assess the issues within that area. Additionally, the CCE team members searched for other potential problems within their assigned area. For example, the CCE teams engineering representative assigned to the Obsolescence/Aging area interviewed other system engineers to determine the scope of the problem with obsolescence and aging issues.
The licensee identified the following causes for these six thematic areas: an ineffective corrective action program, an ineffective equipment reliability program, and ineffective human performance improvement initiatives.
b. Determine that the root cause evaluation was conducted to a level of detail commensurate with the significance of the problem.
The inspectors concluded that the licensees CCE was conducted to a level of detail commensurate with the significance of the problem. However, the lack of documentation in the CCE on the methods used to perform the CCE combined with the very broad-based common causes was challenging to review.
The inspectors noted that the success of the CCE was predicated on the conclusions and causal factors identified in previous root cause evaluations. The licensees CCE reviewed the root causes and contributing causes identified in previous root cause reports. The inspectors independently reviewed selected root cause reports and previous NRC inspection reports to assess the effectiveness of this methodology.
Additionally, the inspectors compared the results of the licensees CCE against the root causes and contributing causes identified in the selected individual root cause reports.
The inspectors concluded that effective implementation of the planned corrective actions to address the common causes identified in the CCE could have prevented the reactor trips that resulted from these performance deficiencies. The inspectors also questioned the conclusions in one of the root cause evaluations reviewed.
The inspectors questioned the licensees conclusions in CR 03364029, Unit 2 Tripped From 100 Percent Power Due to a Low Steam Generator Level Coincident With Feed Flow Less Than Steam Flow. On December 30, 2003, an instrument maintenance technician was performing a calibration on West Residual Heat Removal Pump PP-35W Discharge Flow Switch 2-IFC-325. During this activity, the technician reconnecting an energized lead inadvertently shorted the lead to the terminal block junction box. The short caused the Train B feedwater isolation valves to close and caused a reactor trip on low steam generator water level coincident with feed flow less than steam flow. This condition report concluded that the apparent cause of the reactor trip was inattention-to-detail by an instrument technician.
The licensee had downgraded this condition report from Category 2 to Category 3 without documenting a justification. This resulted in an apparent cause evaluation to review the circumstances which led to the reactor trip instead of a more rigorous root cause evaluation. The results of the apparent cause evaluation indicated that the instrument maintenance technician shorted the lead to the junction box due to a lack of attention-to-detail.
The inspectors concluded that the apparent cause evaluation did not thoroughly review the manner in which the maintenance was scheduled and performed based on the following information. The calibration of West Residual Heat Removal Pump PP-35W Discharge Flow Switch 2-IFC-325 was a routine task that was normally accomplished without lifting any power leads. The power leads were lifted during the event only because another maintenance task was being performed simultaneously on the valve operated by the flow switch 2-IFC-325. The inspectors confirmed this by reviewing previous job orders and interviewing the instrument maintenance mechanic involved in the work. Additionally, neither the worker nor his supervisor ensured that the metal enclosure housing the energized leads was insulated before the work began. The licensee identified insulating practices and proper integration of work packages as contributing causes in CR 03365009. The licensee entered these contributing causes into the corrective action program for resolution. However, from the inspectors review of the issue and a walkdown of the area of the work, the inspectors concluded that the apparent cause would have been better attributed to the manner in which the maintenance was scheduled and performed. Since both issues were captured in the licensees corrective action process for resolution, the concern was considered to be minor.
The licensee determined the common causes for the reactor trips were an ineffective corrective action program, an ineffective equipment reliability program, and ineffective human performance improvement initiatives. The inspectors reviewed the root causes and contributing causes for the reactor trips which led to the White performance indicators and determined that a common denominator in all the reactor trips was an ineffective corrective action program. The root causes and contributing causes in the licensees evaluations consistently identified a failure to take timely and/or effective corrective actions and the inability to identify low level event precursors.
c. Determine that the root cause evaluation included a consideration of prior occurrences of the problem and knowledge of prior operating experience.
The inspectors concluded that the licensees CCE included consideration of several other prior occurrences and prior operating experience. The licensees CCE included a review of at least 10 different root cause reports associated with previous reactor trips.
One of these reports reviewed additional events other than reactor trips. The CCE reviewed the implementation of previously specified corrective actions to determine process or performance errors which may have contributed to the repetition of reactor trips.
d. Determine that the root cause evaluation addressed the extent of condition and extent of cause of the problem.
The inspectors concluded that the CCE included consideration of the extent of condition and extent of cause of the problem. The licensees CCE stated, Considered in aggregate the common cause is the failure of the organization to take a balanced approach to developing and implementing programs necessary for long-term effective operation of the facility. This statement, in addition to the previously identified common causes, indicated that the actual causes of the problems were broad-based and extended into every organization at the facility.
02.03 Corrective Actions a.
Determine that appropriate corrective action(s) are specified for each root cause and contributing cause or that there is an evaluation that no actions are necessary.
The inspectors determined that the corrective actions identified to address the root causes and contributing causes were appropriate. Corrective actions were established as a result of the CCE and as part of a licensee self-initiated performance improvement program, referred to as the D. C. Cook Recovery Plan, which had been established prior to commencing the CCE.
The licensees CCE summarized that the White performance indicators which led to the degraded Initiating Events cornerstone was due to the failure of the organization to take a balanced approach to developing and implementing programs necessary for the long-term effective operation of the facility. The CCE indicated that the actions needed to resolve this common cause are to balance the priority of work associated with programs needed to understand and to resolve problems with the priority of work to repair and operate the plant. Additionally, the CCE indicated that the Recovery Plan provides the vehicle to bring all of the work into a single system.
The licensee concluded that there were three causal factors which contributed to the root causes and contributing causes for the White performance indicators: an ineffective corrective action program, an ineffective equipment reliability program, and ineffective human performance improvement initiatives. The CCE also concluded that previous root cause evaluations adequately addressed the causal factors for each of the root causes and contributing causes.
Because the Recovery Plan was the corrective action tool for implementing the corrective actions identified in the CCE, the inspectors selected a sample of the corrective actions prescribed by the CCE and verified that these corrective actions were adequately captured in the D. C. Cook Recovery Plan.
In general, the short-term and long-term corrective actions to address the White performance indicators appeared to be comprehensive. Although broad in scope, it appeared that the Recovery Plan, if properly implemented, could be effective in addressing the identified root causes and contributing causes which resulted in the White performance indicators. However, the inspectors identified some examples where corrective action items in the CCE were not properly integrated in the Recovery Plan. The inspectors also identified some examples where Recovery Plan actions referenced by the CCE were not completed, although these actions had been closed as completed. The inspectors concluded that the disparities between the CCE and the Recovery Plan could impact the successful completion of actions necessary to address the root causes and contributing causes which led to the White performance indicators, and that the proper integration of the Recovery Plan and the corrective action program was paramount to the resolution of the identified root causes and contributing causes.
Although no findings or violations of regulatory requirements which were of more than minor significance were identified, the following examples supported this observation:
- The inspectors identified that a Recovery Plan action was inappropriately closed.
Action EQ0004-11 was established to assess equipment aging and life-cycle-management deficiencies; however, it was closed indicating that the newly developed obsolescence guide resolved the concern. Specifically, the action was established to review the impact of equipment aging and life-cycle-management on the facility and not on the ability to procure replacement parts. Because the obsolescence program was established to assess the impact of age and obsolescence on the ability to procure outdated replacement parts, the inspectors concluded that the closure of the Recovery Plan item was inappropriate. The licensee acknowledged the deficiency and initiated CR 04117058 to address the issue.
- The inspectors identified an example where condition report corrective actions and Recovery Plan actions, which were linked together, were closed without all of the required actions being completed. Action Item 19 for CR 03365009 required that an evaluation to identify issues similar to those associated with an inadequate pre-job briefing would be specifically covered in the Recovery Plan.
Action Item 19 referenced Recovery Plan items HP006-27. Recovery Plan item HP006-27 required the licensee to develop training videos covering behaviors such as safety, pre-job briefings, and procedure use and adherence. However, Action Item 19 identified that lessons learned were also identified in the areas of cross-functional communications, self-checks, peer coaching, and stopping work after committing an error. The inspectors noted that Recovery Plan item HP006-27 was not updated to reflect the increased scope identified by the assessment performed for Action Item 19. Additionally, HP006-27 had been closed without having developed training for all areas identified as needing improvement. The licensee acknowledged the deficiency and initiated CR 04114005 to address the issue.
- The inspectors identified that a corrective action due date was extended without assessing the impact on other dependent actions. Action Item 7 for CR 03365009 required the use of the Systematic Approach to Training (SAT) to identify gaps in managerial skills. Action Item 8 required training to be conducted for issues identified by Action Item 7. The licensee extended Action Item 7 beyond the due date for Action Item 8 without extending Action Item 8.
The licensee acknowledged the deficiency and initiated CR 04112062 to address the issue.
- The inspectors identified that a corrective action was closed without completing a necessary supporting action. Action Item 10 for CR 03365009 required that the licensee develop or revise the management monitoring system to include any new elements identified during the SAT-based evaluations performed for Action Item 7. The inspectors identified that Action Item 10 was closed, indicating that the performance appraisal form had been modified and that the form was the mechanism for incorporating issues identified during the performance of the SAT process. The inspectors concluded that closing Action Item 10 without the completion of the SAT-based evaluation required by Action Item 7 was inappropriate because any elements identified during the SAT process would not be included in the closed task. The licensee acknowledged the deficiency and initiated CR 04112067 to address the issue.
- The inspectors identified that Action Item 10 for CR 03365009 was not adequately linked to the Recovery Plan. The condition report indicated that Action Item 10 supported Recovery Plan element OE0004 but, unlike other action items linked to the Recovery Plan, Action Item 10 did not have a link to a specific element in the Recovery Plan. Additionally, the inspectors observed that 12 of the 16 Recovery Plan actions included in OE0004 were complete, and that the open actions did not contain activities that would accomplish the goals outlined in CR 03365009, Action Item 10. The licensee acknowledged the deficiency and initiated CR 04112067 to address the issue.
b. Determine that the corrective actions have been prioritized with consideration of the risk significance and regulatory compliance.
The inspectors reviewed the Recovery Plan, the CCE, and the referenced root cause evaluations and determined that the prioritization of the corrective actions was not directly based upon risk perspectives or analysis, but rather based upon a deterministic approach that considered the significance of each corrective action. The inspectors concluded that, in general, actions of a higher priority were scheduled for completion ahead of those having lesser urgency.
c. Determine that a schedule has been established for implementing and completing the corrective actions.
The licensee had established performance indicators to measure the effectiveness of the recovery process. Additionally, managerial controls had been established to ensure that any corrective action modification or due date change to a Recovery Plan action would be approved by senior management. The inspectors identified some discrepancies as identified in Section 02.03.a; however, the licensee initiated corrective actions for these issues. The inspectors concluded that these tools combined with the initiated corrective actions for the identified issues provided acceptable barriers to promote success of the Recovery Plan and corrective actions.
d. Determine that quantitative or qualitative measures of success have been developed for determining the effectiveness of the corrective actions to prevent recurrence.
The licensee established management reviews and key performance indicators as qualitative measures of success. Additionally, Procedure PMP-7030-CAP-001, Corrective Action Program Process Flow, required that the licensee establish an effectiveness review plan for conditions requiring a root cause evaluation. The CCE indicated that effectiveness reviews would be performed monthly at a management review meeting and that the effectiveness of the Recovery Plan elements to address the two Unit 2 White performance indicators would be evaluated.
02.04 Independent Assessment of Extent of Condition and Extent of Cause The licensee identified in their CCE that age-related control group power supply failures had caused repeated reactor trips. The inspectors performed an independent extent of condition and extent of cause review of the materials control program to verify that measures were established to prevent damage or deterioration of warehoused components. The inspections also reviewed selected actions within the Recovery Plan that addressed age-related equipment issues.
The inspectors reviewed the licensees Quality Assurance Program description and commitments related to in-storage materials management. The inspectors concluded that existing materials management procedures adequately fulfilled these commitments.
The inspectors also verified that warehousing requirements for electrolytic capacitors, solenoid valves, and emergency diesel generator governors conformed to the specified vendor requirements necessary to prevent damage or deterioration. No concerns were identified for these components; however, the inspectors found that Materials Control Procedure MMP-5030-001-001, In-Storage Preventative Maintenance Activities of Parts and Components, had been placed on administrative hold in July 2003. This procedure was developed by the licensee as a result of a self-assessment in 1999, and was an enhancement to the existing in-storage materials control program. The purpose of the procedure was to expand the application of good practices for maintenance of stored material to equipment not covered by existing warehousing procedures. The procedure was approved for use in April 2002, but was never implemented. The inspectors concluded that the delay in implementation of MMP-5030-001-001 represented a potential vulnerability in the licensee's materials control program for preventing or identifying faulty warehoused components. The licensee concurred with the inspectors observations and initiated CR 04117058 to address the issue and to evaluate implementing procedure MMP-5030-001-001. Because the procedure was an enhancement to the minimum requirements committed to by the licensee, the inspectors concluded that there was no violation of NRC requirements.
The inspectors also reviewed selected action items in the D. C. Cook Recovery Plan related to the equipment aging program. The inspectors identified that Action EQ0004-11 of the Recovery Plan was closed without completing the prescribed action.
Action 11 required an assessment of processes and programs, including the Warehousing process, the Stored Equipment Preventative Maintenance program, and the Bill of Material program, that could be affected by implementation of the aging program and the revisions to related processes. The inspectors concluded that this issue represented an additional example of disparities between the CCE and the Recovery Plan discussed in Section 2.03.a. The inspectors did not identify any additional concerns.
03 MANAGEMENT MEETINGS
Exit Meeting Summary
The inspection results were presented to Mr. Jensen and other members of licensee management at the conclusion of the inspection on May 12, 2004. The licensee acknowledged the observations presented.
ATTACHMENT:
SUPPLEMENTAL INFORMATION
KEY POINTS OF CONTACT
Licensee
- M. Nazar, Senior Vice President and Chief Nuclear Officer
- J. Jensen, Site Vice President
- D. Fadel, Vice President Engineering
- J. Zwolinski, Design Engineering and Regulatory Affairs Director
- L. Weber, Performance Assurance Director
- J. Gebbie, Engineering Programs Manager
- J. Miller, Mechanical Maintenance Department Material Manager
- J. Waddell, Site Protective Services Manager
- J. Giuffre, Maintenance Manager
- J. Nadeau, Supervisor Learning Organization
NRC
- P. Hiland, Acting Deputy Director, Division of Reactor Projects
- E. Duncan, Chief, Reactor Projects Branch 6
- B. Kemker, D. C. Cook Senior Resident Inspector
- I. Netzel, D. C. Cook Resident Inspector
LIST OF ITEMS
OPENED, CLOSED AND DISCUSSED
Open None.
Closed
None.
Discussed
None.
Attachment