05000261/LER-2010-005

From kanterella
Jump to navigation Jump to search
LER-2010-005, Emergency Diesel Generator Inoperable Due To Inverter Failure
Docket Number
Event date:
Report date:
Reporting criterion: 10 CFR 50.73(a)(2)(v)(D), Loss of Safety Function - Mitigate the Consequences of an Accident
Initial Reporting
ENS 46045 10 CFR 50.72(b)(3)(v)(D), Loss of Safety Function - Mitigate the Consequences of an Accident
2612010005R01 - NRC Website

I. DESCRIPTION OF EVENT

At 1433 hours0.0166 days <br />0.398 hours <br />0.00237 weeks <br />5.452565e-4 months <br /> EDT on June 24, 2010, with H. B. Robinson Steam Electric Plant (HBRSEP), Unit No. 2, shutdown in Mode 5 during Refueling Outage 26, a loss of Instrument Bus 3 (IB-3) [BU] and Instrument Bus 8 (IB-8) occurred during performance of OST-163, "Safety Injection Test and Emergency Diesel Generator Auto Start on Loss of Power and Safety Injection." The loss of IB-3 was caused by a failure of the power supply Inverter B [INVT]. The loss of IB-3 and Inverter B occurred during the undervoltage testing being performed on Emergency Bus E-1. Inverter A and Inverter B sync power supply is Instrument Bus 6 (IB-6). During OST-163, IB-6 was de-energized (i.e., loss of sync power) and then re-energized. The re-energization of sync power to Inverter B was the likely event initiator to the failure of Inverter B.

The loss of IB-3 resulted in the loss of power to RHR Heat Exchanger Flow Controller HIC-758 [BP:TC]. The failure of IB-3 resulted in reduced RHR flow to approximately 2,700 gallons per minute (gpm) caused by RHR Heat Exchanger Outlet Flow to Cold Legs valve HCV-758 failing closed. RHR Heat Exchanger bypass valve FCV-605 did not change state during this event. In addition, the loss of IB-3 removed power from 'B' Emergency Diesel Generator (EDG) automatic load sequencer [EK:2], which resulted in the one required EDG [EK] becoming inoperable. The 'A' EDG was inoperable due to the need to complete required post-maintenance testing. At 1449 hours0.0168 days <br />0.403 hours <br />0.0024 weeks <br />5.513445e-4 months <br />, power was restored to IB-3 by use of an alternate power supply. At 1451 hours0.0168 days <br />0.403 hours <br />0.0024 weeks <br />5.521055e-4 months <br /> RHR temperature control was restored.

The event notification associated with this event (EN 46045) stated that Residual Heat Removal (RHR) valve FCV-605 [BP:FCV], RHR Heat Exchanger bypass valve, and HCV-758 [BP:HCV], RHR Heat Exchanger Outlet Flow to Cold Legs valve, closed due to the loss of power to IB-3. It has been subsequently determined that FCV-605 did not change position. HCV-758 closed due to the loss of control power when the instrument bus power was lost. Both trains of RHR continued to operate and reactor coolant system temperature remained in the range of approximately 93 to 96 degrees Fahrenheit.

The loss of IB-3 could have prevented the fulfillment of a safety function that is needed to mitigate the consequences of an accident and is reportable under 10 CFR 50.73(a)(2)(v)(D), "Any event or condition that could have prevented the fulfillment of the safety function of structures or systems that are needed to mitigate the consequences of an accident.

During this event, the following Technical Specifications (TS) were entered:

(1) TS 3.4.8, "RCS Loops — Mode 5, Loops not Filled," Condition B for required RHR trains inoperable.

(2) TS 3.8.8, "AC Instrument Bus Sources — Shutdown," Condition A for one or more instrument bus sources inoperable.

(3) TS 3.8.2, "AC Sources - Shutdown," Condition B for the EDG 'B' for the required EDG inoperable.

TS LCO 3.4.8, Condition B, was exited at 1451 hours0.0168 days <br />0.403 hours <br />0.0024 weeks <br />5.521055e-4 months <br /> on June 24, 2010, after restoration of IB-3 using the alternate power supply. TS LCO 3.8.2, Condition B, and LCO 3.8.8, Condition A, were exited on June 27, 2010 at 1109 hours0.0128 days <br />0.308 hours <br />0.00183 weeks <br />4.219745e-4 months <br />, after restoring operability of Inverter B.

II. CAUSE OF EVENT

The cause of the loss of Inverter B was determined to be that the slew rate (the rate in which the inverter output changes to match the sync source) had deteriorated on Inverter B sync board. The deterioration was due to age degradation.

The sync board was not replaced in 2004 along with other internal components as scheduled due to an evaluation that had to be performed on the replacement sync board for compatibility. Replacement was not rescheduled appropriately due to the work order being incorrectly statused as completed satisfactory. Procedure, ADM-NGGC-0104, "Work Management Process," does not explicitly define "complete" when closing Preventive Maintenance work orders. Therefore, the work order was closed as completed even though the entire scope had not been completed. A follow-up work order was not initiated and this allowed the component to exceed its end-of-life expectance.

III. ANALYSIS OF EVENT

This event was investigated in accordance with the HBRSEP, Unit No. 2, Corrective Action Program (CAP) and documented in Significant Adverse Nuclear Condition Report 406834. This reportable event associated with the significant adverse condition investigation was reviewed by the Plant Nuclear Safety Committee on August 18, 2010.

In this event, EDG B was capable of automatically starting and providing power to the associated emergency bus. The automatic loading of the blackout sequence loads was inoperable due to the loss of IB-3. Therefore, manual starting of the required loads would have been required if an actual loss of power had occurred. The service water pumps are needed to maintain cooling water flow to the EDG.

Operator action would have been required to restore service water via the control room in accordance with procedure, AOP-020, "Loss of Residual Heat Removal." AOP-020 is a direct entry procedure for a loss of Residual Heat Removal and includes steps to restore service water. The operators validated the procedural guidance based on conditions similar to the event and it was concluded that it would take approximately 25 minutes to restore the required components that would normally be started via the 'B' Train Blackout Sequencer. The EDG can operate without service water under station blackout loads for approximately 40 minutes.

In addition, the loss of power supply to IB-3 resulted in reduced RHR flow to approximately 2,700 gpm caused by valve HCV-758, RHR Heat Exchanger Outlet Flow to Cold Legs, failing closed. The operators took appropriate actions as directed by procedure AOP-020. The power supply to HIC-758 (RHR Heat Exchanger Flow Controller) was restored after power was restored to IB-3 by use of an alternate power supply. During the period while HCV-758 was closed and control of FCV-605 was lost, an RHR temperature increase from 93.5 degrees Fahrenheit to 96.9 degrees Fahrenheit was observed.

During the performance of OST-163, RHR pump 'A,' which had been idle, started automatically as expected. RHR pump 'A' discharge outlet temperature increased from approximately 94 degrees Fahrenheit to 96 degrees Fahrenheit. The rise in RHR temperature that was observed can be attributed to RHR pump 'A' starting. RHR pump 'B' remained running during this test and RHR pump 'B' outlet temperature (i.e., reactor coolant temperature) remained unchanged at approximately 97 degrees Fahrenheit.

In addition, RHR flow reduced from approximately 3,450 gpm to approximately 2,700 gpm due to the loss of Instrument Bus 3. RHR flow remained approximately 2,700 gpm until 1450 hours0.0168 days <br />0.403 hours <br />0.0024 weeks <br />5.51725e-4 months <br /> on June 24, 2010. During this time, no charging pumps were in operation; therefore there was no boron dilution source to the Reactor Coolant System (RCS) [AB]. Additionally, the measured RCS boron concentration was 2,226 parts per million (ppm). Updated Final Safety Analysis Report (UFSAR), Section 15.4.6, "Chemical and Volume Control System Malfunction That Results in A Decrease in The Boron Concentration in The Reactor Coolant," describes a boron dilution event. The UFSAR event in Mode 5 states that if the RHR flowrate is below 2,800 gpm operators must take action to restore it above 2,800 gpm. The flowrate is to ensure "perfect mixing" as assumed in the analysis. The analysis further assumes all three charging pumps are in operation and delivering 250.5 gpm of primary water and a starting RCS boron concentration of 1,782.1 ppm. With no dilution source present and a significantly higher initial RCS boron concentration, the reduced RHR flow exhibited in this event did not violate the boron dilution analysis as described in UFSAR.

IV. CORRECTIVE ACTIONS

Completed Corrective Actions:

  • Power was restored to IB-3 by use of an alternate power supply.
  • Inverter B was repaired and restored to operable status at 0803 hours0.00929 days <br />0.223 hours <br />0.00133 weeks <br />3.055415e-4 months <br /> on June 27, 2010.
  • Guidance has been provided to personnel regarding the completion and coding of partially performed or not performed Preventive Maintenance work orders. The significance of incomplete work orders was highlighted to ensure work orders are processed in accordance with procedure, ADM-NGGC-0104.

Planned Corrective Actions:

  • Procedure, ADM-NGGC-0104, "Work Management Process," is scheduled to be revised by May 31, 2011, to clarify guidance for partial Preventive Maintenance Work Order completion and the associated technical documentation requirements.

V. ADDITIONAL INFORMATION

Previous Similar Events:

License Event Reports (LERs) for HBRSEP, Unit No. 2, were reviewed from the past 10 years. The following event was identified as being similar to the event described in this LER:

  • LER 2010-002-00, Plant Trip Due to Electrical Fault. This event involved a loss of power to Instrument Bus 3 for approximately two minutes due to the loss of Inverter B. The cause of the loss and restoration of Inverter B was indeterminate, but the failure mechanism is currently considered to be unrelated to the event described in this LER.