05000336/LER-2001-003
Event date: | 04-29-2001 |
---|---|
Report date: | 06-26-2001 |
Reporting criterion: | 10 CFR 50.73(a)(2)(iv), System Actuation 10 CFR 50.73(a)(2)(iv)(A), System Actuation |
3362001003R00 - NRC Website | |
1. Event Description On April 29, 2001, with the plant at 97 percent power an automatic plant trip occurred due to a degraded condenser [COND] [SG] vacuum caused by both Circulating Water pumps [P] (CWP) in one condenser not operating. In preparation for testing the "D" CWP following maintenance activities performed on it, electricians inadvertently caused the "C" CWP to trip when attempting to install a jumper in the "D" CWP breaker [BKR] cubicle. The loss of circulating water resulted in a degrading condenser vacuum which then caused an automatic turbine [TRB] [TA] trip. The turbine trip caused the reactor [RCT] to then automatically trip.
During the performance of circulating water pump and motor [MO] overhaul, it becomes necessary to start or bump the motor uncoupled from the pump. This is done to ensure proper rotation of the motor and to verify that vibration levels are not excessive. This has historically been done during outage times. This evolution was recently changed to an on-line activity. On April 15, 2001, this evolution was successfully performed on the 'C' CWP. It was necessary to install a jumper to override interlock contacts in the 'C' CWP control circuits that would otherwise prevent starting the motor. One jumper was used to bypass all interlock contacts. The motor was successfully run uncoupled and the remainder of the overhaul activity completed without mishap.
The uncoupled run of 'D' CWP was moved up 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> and scheduled for performance on Sunday, April 29. 2001.
One of the electricians that was ultimately called in for this evolution contacted the on site mechanical team lead to inquire about the need to install jumpers based on his discussion with the mechanical team lead involved in successful performance of 'C' CWP bump two weeks earlier. The mechanical team lead confirmed existing plant conditions and the need to install a jumper to perform the motor bump. The mechanical team lead then contacted the on-call electrical team lead who provided the names of the two electricians to call in to install the jumper. The electricians were contacted.
Upon arrival on site, the two electricians discussed the evolution with the mechanical team lead. The mechanical team lead deferred review and decision on jumper installation to operations, feeling he lacked the necessary knowledge. The electricians reviewed the work order and referenced drawing and decided that the 'D' waterbox inlet valve M contacts in the start circuit would need to be bypassed to allow starting the motor. This was discussed with operations work control and the Plant Equipment Operator (PEO) who both concurred with the proposed jumper installation.
The electricians proceeded to install a ring lug jumper in the 'D' CWP breaker cubicle. Once this jumper was installed, operations personnel unsuccessfully attempted to start the 'D' CWP motor. Following the failed attempt, the electricians obtained the work order and prints from the shop and returned to the control room to discuss the situation with operations. The electricians, operations work control, the shift manager and the PEO discussed the installation of additional jumpers without understanding why the first jumper did not produce the desired response.
The electricians suggested bypassing all interlock contacts in the 'D' CWP start circuit. The shift manager and PEO concurred with bypassing all interlock contacts.
In preparation to bypass all interlock contacts in the "D" CWP start circuit, the breaker was racked down and all control fuses [FU] were removed. The electricians then removed the end of the first jumper they had connected and then removed the terminal screw at the point that actually crossed over to the 'C' CWP breaker. Loosening this terminal point broke the connection to the 'C' CWP relay which resulted in the 'C' CWP pump trip.
The "C" CWP was restarted and condenser vacuum improved, however a short time later the turbine tripped followed by an automatic reactor trip. Following the trip, all safety systems functioned as required. The auxiliary feedwater system automatically started due to low steam generator (S/G) level caused by S/G level shrink following the reactor trip.
This event is being reported pursuant to 10 CFR 50.73(a)(2)(iv)(A) as an event that resulted in the automatic actuation of the reactor protection system (RPS), including a reactor trip, and the Auxiliary Feedwater System.
2. Cause The root cause of this event was determined to be inadequate procedures that did not include the correct information or require the correct verifications.
There is no specific procedural guidance for the installation of jumpers or how to bump the motor during circulating water pump overhaul. Given the lack of procedural guidance, specific instructions in the job description of the work order might have been appropriate. If proper instructions were available for the installation of jumpers, this event could have been avoided regardless of all other barriers. In addition to the lack of guidance, there were several occasions leading up to the evolution and during the evolution that someone should have questioned the lack of guidance and stopped the evolution, thus preventing the unit trip.
3. Assessment of Safety Consequences The circulating water pumps provide water flow through the steam condenser that allows steam exiting the turbine to be condensed into water. In the normal plant configuration the "C" and "D" CWP's provide water flow through the "C" and "D" waterboxes in parallel. In the event that one pump is not running, the remaining pump provides flow through both waterboxes through a cross-tie valve. Loss of the remaining pump results in a complete loss of water flow through both water boxes.
This event was of low safety significance. The reactor trip was uncomplicated and all safety functions were accomplished per design without complications.
4. Corrective Action Following the plant trip, work was stopped and briefs were conducted with the appropriate groups. Management expectation to stop all work if the expected results are not achieved was reinforced. Additionally, all lifting of leads or installation of jumpers not already controlled by an approved procedure will require review by the applicable supervisor who is to fully question the work activity and acquire the additional assistance of the proper supervisor should the work activity fall outside the original supervisor's field of expertise.
To prevent recurrence a procedure is being developed by November 1, 2001 to provide guidance to control the running/bumping of motors following on-line maintenance. Additionally, to improve upon the human performance element of this event, the internal operating experience team will communicate to the site the circumstances of this event, the extent of condition and management expectations for maintaining a questioning attitude.
Additional corrective actions are being addressed via the Millstone Corrective Action Program.
5. Previous Occurrences No previous similar events were identified.
Energy Industry Identification System (EDS) codes are identified in the text as [XX].