05000529/LER-2007-001
Palo Verde Nuclear Generating Station | |
Event date: | 02-19-2007 |
---|---|
Report date: | 04-20-2007 |
5292007001R00 - NRC Website | |
Note: All times listed in this event report are approximate and Mountain Standard Time (MST) unless otherwise indicated.
1. REPORTING REQUIREMENT(S):
This LER (50-529/2007-001-00) is being submitted pursuant to 10 CFR 50.73(a)(2)(1)(A) for the completion of a shutdown required by Technical Specification (TS) Limiting Condition for Operation (LCO) 3.5.3, Condition C. Notification of this event was made to the Nuclear Regulatory Commission (NRC) on February 19, 2007, at 17:19 via the Event Notification System (ENS) on ENS report 43173.
2. DESCRIPTION OF STRUCTURE(S), SYSTEM(S) AND COMPONENT(S):
System Description:
The High Pressure Safety Injection (HPSI) system (EIIS Code: BQ) is part of the Emergency Core Cooling System (ECCS). The ECCS prevents significant alteration of core geometry, precludes fuel melting, limits the cladding metal-water reaction, removes the energy generated in the core and maintains sub-critical core conditions during the extended period of time following a Loss of Coolant Accident (LOCA). The primary function of the HPSI system is to inject borated water into the Reactor Coolant System (RCS) (EIIS Code: AB) if a break occurs in the RCS boundary. HPSI system cold leg injection is automatically initiated by a Safety Injection Actuation Signal (SIAS). For small breaks, the RCS pressure remains high for a long period of time following the accident, and the HPSI pumps ensure sufficient flow is injected. The HPSI system is also used during the recirculation mode to maintain borated water flow through the core for extended periods of time following a LOCA. For long-term cooling, the HPSI system is manually realigned for simultaneous hot and cold leg injection. This ensures flushing and sub-cooling of the core independent of break location. For small breaks, the HPSI pumps continue injecting into the RCS to provide makeup for spillage out the break while a normal cool-down progresses.
Pump Description:
The HPSI pump is an Ingersoll-Rand model 4x11 CA-8, horizontal centrifugal pump. The pump is an eight stage, high pressure, barrel type boiler feed pump. The pump runs at approximately 3600 revolutions per minute and is designed to pump 900 gallons per minute at 2850 feet of head. The pump's rotating element incorporates a balancing drum to balance axial hydraulic thrust load and thus minimize the load on the outboard thrust bearings. The rotating element also consists of the following major components: impellers, sleeves, fluid seals, wearing rings, balance drum, and rolling element (ball) bearings.
Oil System Description:
The HPSI bearings provide bearing support and thrust support for the HPSI pump. The pump shaft is 2 1/8" diameter. The roller bearings have a 5 1/2" diameter. At the bottom of the housing is an oil bath. The housing contains an oil slinger that consists of a hoop that rides on a shaft sleeve and extends into the oil bath. When the pump is operating the oil slinger lubricates the bearings by slinging oil throughout the bearing housing.
The shaft penetrates the bearing housing cover through an oil flinger. The flinger is attached to the shaft with a single set screw. The flinger's purpose is to prevent contaminants from entering the oil bath from the outside. There is no seal between the flinger and the pump shaft.
An oiler, attached to the bottom of the bearing housing, provides the capability to make up a small quantity of oil to the bearing. The oiler is used to set the oil level in the bearing housing. The height of the oiler is adjustable over about a 1" range.
Bearing Description and Arrangement:
The pump shaft and bearing arrangement consists of a single inboard ball bearing and a set of two outboard ball bearings. The inboard bearing uses a deep groove ball bearing.
The inboard bearing supports radial loads only and is allowed to move axially in its bearing housing to accommodate shaft thermal growth. The outboard bearing arrangement uses a set of two angular contact bearings mounted back to back. The outboard bearing set is designed to accommodate both radial and axial loads. The outboard bearing set is also designed to be fixed on the shaft and also fixed in its bearing housing. The inboard bearing is allowed to float in its bearing housing.
3. INITIAL PLANT CONDITIONS:
On February 19, 2007, Palo Verde Unit 2 was in Mode 1 (power operations), operating at approximately 100 percent power. The HPSI 2A pump was inoperable and had been since February 16, 2007, at 13:01 when Operations personnel entered LCO 3.5.3, Condition B, placing the plant in a 72 hour8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> action to restore the pump to an operable status.
4. EVENT DESCRIPTION:
In January 2007, NRC personnel requested information related to an Operability Determination (OD) for oil leakage from the bearing housing of the HPSI 2A pump. The OD was prepared to establish a leak rate limit of 1.5 drops/hour based on a 182 day mission time (a previously generated OD had established 3 drops/hour as acceptable).
The new OD addressed non-conservative assumptions developed for the original OD and was approved on February 10, 2007. On February 13, 2007, Palo Verde staff members received a request from NRC personnel to provide a summary of the extent of current oil leakage for the HPSI 2A pump.
On February 16, 2007, with Unit 2 at 100 percent power, a Surveillance Test (ST) (73ST 9SI10), "HPSI Pumps Miniflow - Inservice Test," was performed to demonstrate that the HPSI 2A pump oil leak was within the leak rate established by the OD, which would validate that the HPSI pump could meet its safety function/mission time of 182 days. The HPSI 2A Pump was started at 12:13. At 13:01 on February 16, 2007, Operations personnel declared the HPSI 2A pump inoperable and entered TS LCO 3.5.3, Condition B, placing the plant in a 72 hour8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> action to restore the pump to an operable status. The pump was considered inoperable when the minimum flow recirculation (mini-flow) orifice bypass valve was opened to establish a higher flowrate as required when the system is in the recirculation configuration for greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.
During the test, the outboard bearing began to leak, but the leakage stopped after approximately 5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br /> when the oil in the bearing reservoir reached a lower, optimum level.
Approximately 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> into the pump test, the inboard bearing began to leak. This leak rate increased to approximately 3 drops/hour and on February 17, 2007, at 11:19, with no signs of decreasing leakage from the inboard bearing, the pump was stopped.
Vendor information was provided to Palo Verde and a Temporary Modification (T-Mod) to decrease the reservoir oil level was developed. On February 18, 2007, at 19:11, following the installation of the T-Mod, a second HPSI 2A pump test commenced. The leak rate continued as observed in the previous test and on February 19, 2007, at 09:28, HPSI 2A pump was secured. Later, at 13:01, Operators entered LCO 3.5.3, Condition C and by 14:56 commenced a plant shutdown. At 16:45, with reactor power less than 20 percent, Unit 2 was manually tripped and entered Mode 3.
On February 22, 2007, after installation of the T-Mod and adjustment of clearances for the flinger ring, a 5 hour5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br /> test run was completed on the HPSI 2A pump. No leakage was observed during the run.
5. ASSESSMENT OF SAFETY CONSEQUENCES:
Palo Verde Unit 2 operated within the requirements of its Operating License and complied with the TS actions within the required time. The plant shutdown was based on an inoperable HPSI 2A pump that could not be returned to an operable condition within the TS action statement allowed time.
5.CContributing Cause #2: Interim actions identified during the Significant Investigation for a previous event in Unit 2 (Shutdown Due to Inability to Repair Valve 2JSA-UV-138A Within Time Permitted by Technical Specifications) were not effectively implemented.
6.CApparent Cause #1: Bearing oil leak: The apparent cause of the HPSI pump inboard bearing housing oil leak was a combination of high oil level and flinger ring position.
7.CCORRECTIVE ACTIONS:
The following immediate corrective actions were implemented for both trains in all three units.
1. Installed a T-Mod which decreased the reservoir oil level and added dual 8 ounce oilers on the inboard side of the pump.
2. New clearances were developed for the bearing flinger ring.
3. Mission time for the HPSI pump was evaluated as 30 days.
To prevent recurrence, the following actions are planned.
1. Implement a new process that employs a systematic approach for troubleshooting equipment failures.
2. Formalize the station management team response for entry into time dependent Technical Specification.
3. Implement program/process changes that ensure contingency planning is included as part of the work management process.
Any additional corrective actions taken as a result of this event will be implemented in accordance with the APS corrective action program. If information is subsequently developed that would significantly affect a reader's understanding or perception of this event, a supplement to this LER will be submitted.
8.CPREVIOUS SIMILAR EVENTS:
In the past three years, there were two similar events reported for a TS shutdown that became necessary when attempted repairs could not be performed within the allowed TS LCO action time.
Diesel Generator (EDG). Replacement of the automatic voltage regulator (AVR) required post maintenance load rejection surveillance testing in accordance with Technical Specification Surveillance Requirement 3.8.1.9. Performance of this surveillance is prohibited in Modes 1 through 4, therefore, a shutdown became necessary to support retesting of the AVR. Corrective actions developed for this event would not have prevented this event.
supply valve. The actions developed for this event were not effectively implemented, and as such, did not prevent this event.