IR 05000455/2012008
ML12087A213 | |
Person / Time | |
---|---|
Site: | Byron |
Issue date: | 03/27/2012 |
From: | Stephanie West Division Reactor Projects III |
To: | Pacilio M Exelon Generation Co, Exelon Nuclear |
References | |
IR-12-008 | |
Download: ML12087A213 (38) | |
Text
UNITED STATES rch 27, 2012
SUBJECT:
BYRON UNIT 2 - NRC SPECIAL INSPECTION TEAM (SIT)
REPORT 05000455/2012008
Dear Mr. Pacilio:
On February 13, 2012, the U.S. Nuclear Regulatory Commission (NRC) completed a reactive inspection pursuant to Inspection Procedure 93812, Special Inspection at your Byron Station, Unit 2. The enclosed inspection report documents the inspection results, which were discussed on February 13, 2012, with Mr. Tim Tulon and other members of your staff.
The special inspection was commenced on January 30, 2012, in accordance with NRC Management Directive 8.3, NRC Incident Investigation Program, and Inspection Manual Chapter 0309, Reactive Inspection Decision Basis for Reactors, based on the initial risk and deterministic criteria evaluation made by the NRC on January 30, 2012.
The special inspection reviewed the circumstances surrounding the January 30, 2012, electrical insulator failure in the Byron switchyard that resulted in a Unit 2 automatic reactor trip and Notice of Unusual Event emergency declaration.
The inspectors examined activities conducted under your license as they relate to safety and compliance with the Commissions rules and regulations and with the conditions of your license.
No findings were identified during this inspection. In accordance with 10 CFR 2.390 of the NRC's "Rules of Practice," a copy of this letter, its enclosure, and your response (if any) will be available electronically for public inspection in the NRC Public Document Room or from the Publicly Available Records System (PARS)
component of NRC's document system (ADAMS). ADAMS is accessible from the NRC Web site at http://www.nrc.gov/reading-rm/adams.html (the Public Electronic Reading Room).
Sincerely,
/RA/
Steven West, Director Division of Reactor Projects Docket No. 05000455 License No. NPF-66
Enclosure:
Inspection Report 05000455/2012008 w/Attachments:
1. Supplemental Information 2. Special Inspection Team Charter 3. Timeline of Events
REGION III==
Docket No.: 50-455 License No.: NPF-66 Report No.: 05000455/2012008 Licensee: Exelon Generation Company, LLC Facility: Byron Station, Unit 2 Location: Byron, IL Dates: January 30, 2012 - February 13, 2012 Inspectors: J. Benjamin, Senior Resident Inspector, Team Lead, DRP C. Moore, Operator Licensing Examiner, DRS M. Munir, Reactor Inspector, DRS Observer: J. Draper, Reactor Engineer, DRP Approved by: S. West, Director Division of Reactor Projects Enclosure
SUMMARY OF FINDINGS
Inspection Report 05000455/2012008; 01/30/2012 - 02/13/2012; Byron Station, Unit 2;
Special Inspection.
This report covers a 15-day period of onsite inspection and offsite review from January 30, 2012, through February 13, 2012. A three-person team comprised of the Braidwood Senior Resident Inspector, a Region III Reactor Inspector, and a Region III Operator Licensing Examiner conducted the inspection using Inspection Procedure 93812, Special Inspection.
The NRCs program for overseeing the safe operation of commercial nuclear power reactors is described in NUREG-1649, Reactor Oversight Process, Revision 4, dated December 2006.
NRC-Identified
and Self-Revealed Findings None.
Licensee-Identified Violations
None.
REPORT DETAILS
Event Description On January 30, 2012, a nonsafety-related (NSR) electrical insulator failed in the Byron 345 kilovolt (kV) switchyard that resulted in a Unit 2 automatic reactor trip and Notice of Unusual Event (NOUE) emergency declaration. The failed insulator physically supported the C phase electrical conductor; one of three electrical phases supplying 345kV to the two Unit 2 station auxiliary transformers (SATs). The loss of the Unit 2 SATs resulted in an inoperable Technical Specification (TS) preferred backup power source for Unit 1 until restoration on January 31, 2012. Unit 1 remained at 100 percent power and was not affected by this event.
Following the insulator failure, Byron Unit 2 automatically tripped from full power due to an undervoltage condition on NSR 6.9kV Bus 258 and Bus 259 that supply power to two of four reactor coolant pumps (RCPs). About 30 seconds after the Unit 2 reactor trip, the power source for 6.9kV RCP Bus 256 and Bus 257 and NSR 4kV Bus 243 and Bus 244 automatically fast transferred from the Unit 2 unit auxiliary transformers (UATs) to the (degraded) SATs. As a result, the remaining two RCPs tripped on an overcurrent condition due to the increased current flow through the A and B phases as a result of the open C phase.
The loss of the C phase, however, did not result in an automatic undervoltage protection signal for either safety-related (SR) 4kV engineered safety feature (ESF) Bus 241 or Bus 242 due to a design vulnerability (i.e., Bus 241 and Bus 242 were not designed to be protected from a single phase loss of either the A or C phase). As a result, all running and standby SR equipment powered from Bus 241 and Bus 242 was rendered inoperable and unavailable. This included the centrifugal charging (CV) system which supplied RCP seal injection, the component cooling water (CC) system which supplied RCP seal cooling, and the essential service water (SX)system. These conditions existed until manual operator action to separate from the degraded offsite power by opening the SAT feeder breakers was initiated from the main control room about 8 minutes following the start of the event.
Following the manual action to separate from offsite power, Bus 241 and Bus 242 de-energized and both emergency diesel generators (DGs) started and sequenced ESF equipment onto Bus 241 and Bus 242 as designed. No significant degradation to the RCP seals occurred based on the manual action occurring within the time it would have taken for the RCP seal water volume to deplete (estimated to be about 13 minutes). Reactor decay heat was removed utilizing the 2B (diesel-driven) auxiliary feedwater (AF) pump and steam generator (S/G) power-operated relief valves (PORVs) while the primary system cooled down in the natural circulation mode of operation. On January 31, 2012, Unit 2 entered Mode 5, Cold Shutdown.
During the event a number of other issues occurred that were addressed by the licensee.
These included a water hammer on the secondary side of the plant, a plugged reactor coolant filter, and the wetting of the 2A residual heat removal (RHR) pump motor from a water leak.
The licensee remained in the NOUE until repairs were completed and the Unit 2 SATs were returned to their normal alignment on January 31, 2012.
Inspection Scope A Special Inspection was initiated following the NRCs review of the deterministic and conditional risk criteria specified in NRC Management Directive 8.3, NRC Incident Investigation Program. The inspection was conducted in accordance with NRC Inspection Procedure (IP) 93812, Special Inspection, and the Special Inspection Charter (Attachment 2).
The inspectors utilized information from the plant computer and sequence of events recorder; interviewed licensee personnel who responded to the event; performed physical walkdowns of plant equipment and the switchyard; reviewed procedures, maintenance records, and various technical documents; and reviewed corrective action program documentation and causal evaluations. A list of specific documents reviewed is provided in Attachment 1.
Byron Unit 2 Electrical Design Overview Description of Unit 2 Power Sources (Figure 1)
The Byron Unit 2 electrical design includes 345kV lines that provide two credited NSR sources of preferred offsite power, and DGs that provide two independent SR sources of onsite power.
In addition, the electrical design includes the capability to cross-tie Unit 1 SR ESF Bus 141 and Bus 142 to Unit 2 SR ESF Bus 241 and Bus 242.
The first offsite preferred power source is from 345kV Bus 13 to Unit 2 SATs 242-1 and 242-2.
These SATs then supply NSR power to two RCPs through 6.9kV Bus 258 and Bus 259. The remaining RCP buses (Bus 256 and Bus 257) are powered from UATs 241-1 and 241-2. In addition to the 6.9kV buses, the Unit 2 SATs also supply power to SR Bus 241 and Bus 242.
The second offsite preferred power source is from 345kV Bus 6 through Unit 1 SATs 142-1 and 142-2 and through Unit 1 ESF Bus 141 and Bus 142 utilizing Unit 1 and Unit 2 cross-tie breakers.
Description of Unit 2 SR 4kV Bus 241 and Bus 242 Undervoltage Protection Scheme (Figure 2)
The Unit 2 undervoltage protection scheme for SR Bus 241 and Bus 242 is based on a two-out-of-two coincidence logic. Voltage sensing devices monitor Bus 241 and Bus 242 phase-to-phase differential voltage between the A and B phases (A-B phase voltage differential) and the B and C phases (B-C phase voltage differential). Because the undervoltage protection scheme utilizes contacts that are in series, an undervoltage trip signal is processed only if the voltage sensing device detects a differential voltage of less than 2730 Volts alternating current (Vac) for both the A-B and B-C phases. If only the A phase or C phase voltage is lost, then only one of two undervoltage contacts close, the undervoltage protection logic is not satisfied, and an undervoltage trip signal is not processed. The degraded voltage protection logic is of a similar design. The circuitry for receiving a Bus 241 and Bus 242 undervoltage or degraded voltage alarm in the main control room utilizes the same logic.
4OA5 Other Activities - Special Inspection (IP 93812)
.1 Establish a Sequence of Events (Charter Item 1)
a. Inspection Scope
The inspectors reviewed control room logs, plant parameter recordings, plant procedures, corrective action documents, maintenance work orders (WOs), and work request history as part of the inspection activities. The inspectors conducted interviews with licensed operators and other personnel who responded to the event to determine the sequence of events associated with the insulator failure and plant response for the January 30, 2012, Unit 2 reactor trip.
A narrative description of the event is provided below. A detailed timeline developed by the inspectors is also included as Attachment 3.
b. Findings
Detailed Narrative of the Event On January 30, 2012, at 10:01 a.m., Byron Unit 2 automatically tripped from full power due to an undervoltage condition on 6.9kV Bus 258 and Bus 259 that supply power to two of the four RCPs. The undervoltage condition was caused when the C phase insulator stack for the Unit 2 SAT revenue metering unit broke and part of the insulator fell to the ground (Picture 1).
The broken insulator that was providing vertical support for the C phase conductor resulted in the conductor breaking and isolating the C phase 345kV supply to the Unit 2 SATs. This type of open failure did not result in a desired protective logic actuation for the SATs or switchyard ring bus. The SAT protective relays were designed to trip during a fault or overcurrent condition, neither of which occurred. The differential relays were designed to detect the differential current between the input and output current on a phase-to-phase basis. In this case, both input and output currents were zero, therefore the SAT feeder breakers did not trip open. With only the A and B phases energized, the Unit 2 SATs continued to supply degraded 6.9kV power to NSR Bus 258 and Bus 259, and degraded 4kV power to SR ESF Bus 241 and Bus 242.
6.9kV Bus 258 and Bus 259 powered by the Unit 2 SATs sensed an undervoltage condition on the B-C phase. As a result, an automatic reactor protection signal was processed based upon a predictive loss of two of four operating RCPs. About 30 seconds following the reactor trip, 6.9kV Bus 256 and Bus 257 and NSR 4kV Bus 243 and Bus 244 automatically transferred from the Unit 2 UATs to the (degraded) Unit 2 SATs, as designed. With the open C phase supplying the Unit 2 SATs (and all RCP buses), the A and B phase currents supplying the RCPs increased, resulting in the remaining RCPs tripping on an overcurrent condition about 40 seconds after the transfer.
The loss of C phase voltage, however, did not result in automatic undervoltage protection for Bus 241 and Bus 242 due to an unknown design vulnerability (i.e., safety-related buses were not designed to be protected from a loss of the A or C phase voltage). Both trains of safety-related equipment powered from Bus 241 and Bus 242 tripped on overcurrent within seconds due to the inrush of current on the operating phase voltages. A total loss of seal cooling to all four RCPs occurred since both trains of CV were rendered inoperable and unable to supply seal injection and both trains of CC were rendered inoperable and unable to supply cooling water to the RCP thermal barrier heat exchangers.
Reactor decay heat was removed from the secondary through the S/G PORVs with the primary operating in the natural circulation mode. These PORVs released steam directly to the atmosphere as designed. Feedwater makeup to the S/Gs was supplied by the 2B (diesel-driven) AF pump. The steam released contained extremely low levels of tritium.
Following the completion of procedurally required actions by control room operators in response to the reactor trip, a briefing was conducted to assess plant status prior to transitioning to the Reactor Trip Recovery procedure. Operators recognized that all equipment that was powered from Unit 2 NSR Bus 258 and Bus 259 and SR Bus 241 and Bus 242 had tripped. All equipment that was running had its respective trip disagreement light lit as well as a stop indication on the main control board control switch. Operators observed the 2B AF pump running and providing adequate flow to the S/Gs. Additionally, operators observed that equipment powered from emergency direct current (DC) power was running.
At about 10:04 a.m., operators attempted to start the standby 2B SX pump, but the pump did not start due to the undervoltage condition. Operators then restored Unit 2 SX flow by opening SX system cross-connect valves between Unit 1 and Unit 2 and starting an additional Unit 1 SX pump.
Operators noted that there were no abnormal alarms lit associated with safety-related ESF power and the associated Bus 241 and Bus 242 bus alive lights were lit. The 4kV ESF bus voltages indicated 4kV for the ESF buses. However, when the bus voltage selector switch was switched from monitoring the A-B phase voltage to the B-C and C-A phase voltages, a potential undervoltage condition was immediately identified as both the B-C and C-A phase voltages indicated about 2.5kV. An auxiliary operator was subsequently dispatched to the Unit 2 SATs and reported seeing smoke from both SATs.
Based upon the operators general understanding of an electrical issue resulting in equipment failing to run, lower than expected B-C and C-A phase voltages on the SR 4kV buses, and the report of smoke from the Unit 2 SATs, operators concluded that the voltage on the safety-related buses and condition of the Unit 2 SATs was not acceptable and at about 10:09 a.m. (8 minutes into the event) opened the SAT feeder breakers supplying offsite power to the SATs. After opening these breakers, the undervoltage logic was satisfied, and an ESF undervoltage protection signal was processed for Bus 241 and Bus 242. Accordingly, both DGs started and sequenced safety-related equipment onto Bus 241 and Bus 242, restoring normal plant shutdown components and systems, including RCP seal injection and seal cooling.
At 10:18 a.m., the licensee declared a NOUE in accordance with the Byron Emergency Plan for a loss of offsite power to the Unit 2 SATs for greater than 15 minutes. At 10:23 a.m., the licensee reported this event to the Illinois Emergency Management Agency (IEMA) using the Nuclear Accident Reporting System (NARS).
At 10:23 a.m., based upon the report of smoke from the Unit 2 SATs, the licensee requested offsite assistance from the Byron Fire Department. At 10:48 a.m., two Byron Fire Department trucks entered the Protected Area (PA) and five trucks parked outside the PA as a standby resource. Upon further investigation, no actual fire occurred. The smoke from the Unit 2 SATs was caused by a sudden heatup of the SAT windings due to the inrush of current resulting from the open C phase. At 10:41 a.m., switchyard breakers 7-13 and 12-13 were opened to de-energize 345kV Bus 13 and the Unit 2 SAT high side windings.
Operators proceeded through the Reactor Trip Recovery procedure, which included re-energizing NSR Bus 243 and Bus 244 from SR Bus 241 and Bus 242, respectively.
During the recovery, the crew experienced numerous problems when attempting to start equipment from 480Vac motor control centers (MCCs) that were previously powered from the Unit 2 SATs since the thermal overload protective devices had tripped as a result of the event and operators did not have specific control room indications of these conditions. The thermal overload devices were subsequently reset to restore affected equipment.
Operators performed a reactor cooldown with the primary system operating in the natural circulation mode, utilizing the 2B AF pump and S/G PORVs to remove decay heat in accordance with licensee procedures. Unit 2 subsequently entered Mode 5, Cold Shutdown, on January 31, at 2:28 a.m.
The licensee remained in the NOUE until repairs were completed, the condition of the Unit 2 SATs was evaluated, and offsite power through the Unit 2 SATs to Bus 241 and Bus 242 was restored on January 31.
Unresolved Item: Inadequate Undervoltage Protection
Introduction:
The inspectors identified an unresolved item (URI) pending a determination of whether the undervoltage protection design vulnerability revealed by the loss of the single phase event was within the stations current licensing basis (CLB).
Description:
TS 3.3.5, Loss of Power (LOP) DG Start Instrumentation, required that in Modes 1-4 two channels per bus of the loss of voltage (undervoltage) function and two channels per bus of the degraded voltage function shall be operable. In addition, Technical Specification Surveillance Requirement (TSSR) 3.3.5.2 stated that the acceptable channel calibration values for the undervoltage setpoint was greater than 2730Vac, with a time delay of less than or equal to 1.9 seconds; and for the degraded voltage setpoint, the value was greater than 3930Vac with a time delay of 310 plus or minus 30 seconds. Upon actuation of the undervoltage or degraded voltage function, the DGs were designed to start and provide power to all ESF loads.
However, because the ESF undervoltage and degraded voltage protection schemes were comprised of two contacts in series that monitored differential voltages between the A-B and B-C phases, upon the loss of only the A or C phase, only one protective relay is actuated and therefore does not satisfy the coincidence logic necessary to initiate an undervoltage or degraded voltage protection signal.
The licensee concluded that this event was not within the facilitys CLB and that because the NRC had reviewed and approved the design, that the undervoltage protection design vulnerability did not impact operability and that the requirements of TS 3.3.5 were met.
At the end of this inspection, a detailed NRC review of the CLB was in progress.
This URI will remain open pending the completion of this review and a determination of whether the undervoltage and degraded voltage protection design vulnerability was within the stations CLB. (URI 05000454/2012008-001, 05000455/2012008-001, Inadequate Undervoltage Protection)
.2 Review the Licensees Post-Trip Data and Independently Review Plant Data and
Records (Charter Item 2)
a. Inspection Scope
The inspectors independently reviewed the licensees post-trip data and interviewed operators and engineering personnel to determine the cause of the Unit 2 reactor trip.
Additionally, the inspectors performed plant walkdowns, including the switchyard, and determined whether the licensees assessment and planned corrective actions were adequate.
b. Findings
No findings were identified.
The inspectors determined that the loss of the incoming 345kV C phase to the Unit 2 SATs was caused by an open C phase conductor. The conductor opened when an insulator stack that provided vertical support to the C phase conductor failed.
On January 31, 2012, the licensee shipped the broken insulator stack to an offsite facility for a detailed failure analysis. The licensee planned to include the results of this failure analysis in their root cause review. At the end of this inspection, the results of the analysis were not available.
As part of the licensees immediate corrective actions, the failed insulator was replaced and the SATs were assessed for damage. In addition, the licensee implemented a number of compensatory actions to raise awareness of the design vulnerability and to provide additional annunciator response instructions for the control room operators.
These compensatory actions included the following:
- All active licensed operators were required to complete a read and sign information package during the first shift on duty in the main control room;
- The shiftly/daily surveillances were revised to include a check that the voltage selector switch was placed in the C-A position following rounds checks of bus voltage; and
- A designated operator was assigned to Unit 1 and Unit 2 to take the actions necessary to mitigate a similar event within 30 seconds.
.3 Operator Response Assessment (Charter Item 3)
a. Inspection Scope
To assess operator response to the event, the inspectors reviewed control room logs, plant parameter recordings, plant procedures, corrective actions documents, maintenance WOs, and maintenance work request history. The inspectors also conducted interviews with the operators who responded to the event.
The inspectors independently assessed Operations crew procedure usage and their ability to troubleshoot and take appropriate action during the event. In response to the event, the crew entered the following Emergency Operating Procedures (EOPs) and Abnormal Operating Procedures (AOPs):
- 2BEP-0, Reactor Trip or Safety Injection Unit 2, Revision 202 WOG
[Westinghouse Owners Group] 2;
- 2BEP ES-0.1, Reactor Trip Recovery Unit 2, Revision 203 WOG 2;
- 2BOA Electrical-3, Loss of Offsite Power to Unit 2, Revision 105.
b. Findings
No findings were identified.
Operators properly responded to the event and took the necessary actions when faced with an abnormal reactor trip in which all safety-related motor-driven pumps were inoperable and unavailable for about 8 minutes. This event resulted in a loss of RCP seal cooling with a single train of AF operating and decay heat being removed through the S/G PORVs.
Following the reactor trip, operators performed the first four steps of 2BEP-0, Reactor Trip or Safety Injection Unit 2, Revision 202, WOG 2, and correctly determined that an electrical problem existed on Unit 2. Operators diagnosed that a problem existed with the Unit 2 SATs and took the appropriate actions to open the associated feeder breakers to ESF Bus 241 and Bus 242. This action caused an automatic start of the 2A and 2B DGs and the ESF loads powered from Bus 241 and Bus 242 to automatically sequence onto their respective DGs. This action also re-established cooling to the RCP seals and restored the safety-related equipment necessary to maintain the plant in a safe shutdown condition.
The inspectors reviewed the EOPs and identified that the existing procedures were not adequate to address this specific event. In particular, Step 3 of 2BEP-0 directed operators to perform the following actions:
a.
ESF buses energized - AT LEAST ONE ENERGIZED o Bus 241 o Bus 242 The basis of this step, described in procedure BD-EP-0, Basis Document for Reactor Trip or Safety Injection Procedure, Revision 200, was as follows:
AC [Alternating Current] power must be verified from either offsite sources or the diesel generators to ensure adequate power sources to operate the safeguards [ESF]
equipment. At least one train of safeguards equipment is required to deal with emergency conditions. If at least one train is not available, the operator should try to quickly restore one train, e.g., start a diesel generator and load it on the 4kV ESF bus.
If at least one train cannot be restored quickly, the operator should transfer to CA-0.0, Loss of All AC Power.
The crew initially marked off this step as being met satisfactorily based upon main control room indications and past training. The crew verified that ESF Bus 241 and Bus 242 main control room bus alive lights were lit. Since the 4kV voltage selector switch had been selected to the A-B phase voltage position (for both buses), nominal 4kV was indicated in the control room since the A and B phases were not directly affected by the event. Additionally, 4kV bus undervoltage or degraded voltage alarms were not locked in due to the alarming circuitry requiring a two-out-of-two coincidence logic. Therefore, Operations and Training department expectations for how 2BEP-0, Step 3 was to be performed were not adequate for this event. The inspectors discussed this vulnerability with licensee management and staff. However, the inspectors did not identify any operator performance issues since operators effectively utilized their knowledge of plant operations to address the event in a timely manner.
.4 Review the Licensees Root Cause Evaluation Plan and Schedule (Charter Item 4)
a. Inspection Scope
The inspectors reviewed the licensees root cause evaluation plan, schedule for completion, and the root cause teams technical structure and membership to determine whether the root cause evaluation plan was of sufficient breadth and depth and whether the time allotted to perform the root cause evaluation was commensurate with the safety significance of the issue.
b. Findings
No findings were identified.
The inspectors observed that the root cause team was from a diverse technical background. Representatives from Operations, Design Engineering, Programs Engineering, Corporate Engineering, and Training were included on the team.
Individuals from Commonwealth Edison (ComEd) were also included on the team.
The inspectors reviewed the licensees root cause timeline and concluded that it was scheduled to be completed in accordance with licensee procedures and within a timeframe commensurate with the safety significance of the issues.
The root cause investigation plan was similarly determined to be of adequate depth and breadth and that the time allotted to perform the investigation was appropriate.
.5 Review the Circumstance Surrounding Equipment Problems and Licensee Performance
in Addressing These Issues (Charter Item 5)
a. Inspection Scope
The inspectors evaluated the circumstances surrounding and licensee performance in addressing the following equipment problems and issues associated with the January 30, 2012 event:
- Unit 2 RCP Undervoltage Relay Actuation;
- Switchyard C-Phase Disconnect (Bus 13) Failure;
- Unit 2 SAT Damage Assessment and Operability Determination;
- Unit 2 Secondary Side Water Hammer Impact to Equipment Functionality and Availability;
- Starting of Safety-Related Equipment when the SATs were De-energized from an Undervoltage Condition;
- Reactor Coolant Filter Leakage and the Impact on Safety-Related Equipment, Including the 2A RHR Pump and Motor;
- Assessment of the Release of Tritiated Steam;
- RCP Seal Assessment Following a Total Loss of Seal Cooling for About 8 Minutes;
- Operability Determination Process Usage; and
- Missed Opportunities to Identify a Design Issue through Operating Experience.
The inspectors reviewed plant data records and interviewed licensee personnel to understand the circumstances surrounding these issues, including licensee assessments. Additionally, the inspectors reviewed applicable documents, such as operating procedures, system diagrams, the Updated Final Safety Analysis Report (UFSAR), TS requirements, outstanding WOs, and IRs. The inspectors walked down all levels of the Unit 2 turbine building and portions of the main steam tunnel to identify any adverse impact that the secondary side water hammer transients could have caused (e.g., broken pipe hangers, lifted relief valves, unexplained sources of visible water or debris on floors and structures). Additionally, the inspectors performed walkdowns of the main control room, the 345kV switchyard, and low voltage connections to both SR and NSR buses.
b. Findings
No findings were identified.
Unit 2 RCP Undervoltage Relay Actuation The inspectors identified that RCP Bus 258 and Bus 259 that were powered from the Unit 2 SATs detected the loss of C phase voltage and transmitted undervoltage signals to the reactor protection system (RPS).
Each 6.9kV RCP bus voltage potential is sensed and reduced through two potential transformers to about 120Vac. Two sets of relays monitor this bus potential and actuate on an RCP bus equivalent voltage level of about 5268Vac. One set of relays is designed to monitor the A-B voltage potential and the other set of relays is designed to monitor the B-C voltage potential. Since the B-C phase voltage potential decreased to approximately 3980Vac, one set of relays actuated. These relays are set up in a parallel fashion such that actuation of either (or both) relay sets initiates a protective action signal. With undervoltage conditions present on RCP Bus 258 and Bus 259, the RPS responded as designed by automatically tripping the reactor based upon satisfying the necessary two-out-of-four RPS coincidence logic.
The inspectors concluded that the RCP undervoltage portion of the RPS operated as designed. No issues were identified.
Switchyard C-Phase Disconnect (Bus 13) Failure The inspectors evaluated the licensees response to the bus failure including corrective actions and extent of condition review. The inspectors did not identify any issues based, in part, on the assignment of designated operators and other station actions.
Unit 2 SAT Damage Assessment and Operability Determination The licensee evaluated the impact that the event had on the Unit 2 SATs. The licenses evaluation included a review of past and post-event transformer dissolved gas oil results.
These results were then used to assess the condition of the Unit 2 SATs.
After reviewing the results of the dissolved gas analyses and after discussing these results with a vendor, the licensee concluded that the Unit 2 SATs were not damaged.
The inspectors independently reviewed the oil sample results, the licensees evaluation of the oil sample results, and compared the results to established acceptance criteria.
The inspectors also observed SAT performance prior to re-energizing ESF equipment and after being fully loaded. No issues were identified.
Unit 2 Secondary Side Water Hammer Impact to Equipment Functionality and Availability The licensee concluded that there were two main areas where secondary side water hammer occurred due to hot water flashing and/or collapsing. These areas included low pressure feedwater heater bypass line 2CB01C and the condensate/condensate booster (CD/CB) pump suction and discharge lines. The licensee performed numerous secondary system walkdowns to identify any damage caused by the water hammer events that occurred following the Unit 2 reactor trip. No significant issues were identified.
The suspected mechanism for the water hammer associated with the low pressure feedwater heater bypass line was the combined effects of a system pressure reduction due to the loss of the CD/CB pumps, and a vacuum draw at the high point in the system.
As draining and cooling occurred within this system, flashing and the collapse of vapor pockets caused the vibration and audible water hammer heard by licensee personnel.
The suspected mechanism for the water hammer associated with the CD/CB pump discharge lines was reverse flow through the pump discharge check valves and flow into the main condenser through the recirculation and pump suction lines. After the relatively hot water reached the main condenser, flashing was suspected to have occurred. At the end of the inspection, the licensee planned to determine whether improvements to the sealing capability of the CD/CB pump discharge check valves was necessary.
The inspectors reviewed the licensees secondary side water hammer evaluations and walkdown results. Licensee personnel who heard the water hammer events following the Unit 2 trip were interviewed to gain additional insights. Additionally, the inspectors performed independent walkdowns of all Unit 2 turbine building levels and the main steam tunnels to independently verify the results of the licensees walkdown. No issues were identified.
Starting of Safety-Related Equipment when the Unit 2 SATs were De-energized The inspectors reviewed the plants electrical response to the manual action to open the Unit 2 SAT feeder breakers and de-energize the Unit 2 SATs. Following these actions, ESF Bus 241 and Bus 242 de-energized and the DGs started to supply power for the remainder of the event. Safe shutdown loads automatically sequenced onto ESF Bus 241 and Bus 242 as designed.
The inspectors noted that the 2B DG was in an available, but inoperable, status prior to the event as a result of maintenance work that had recently been completed. The inspectors performed a field walkdown on the morning of January 31, 2012, and observed slight 2B DG speed and frequency oscillations of about 0.5 hertz (hz).
These frequency oscillations, however, did not prevent the 2B DG from performing its safety function during this event. Following the event and after offsite power was restored, maintenance was performed to address the issue and the 2B DG was tested satisfactorily. No issues were identified.
2B SX Pump Failure to Start Prior to De-energizing the SATs The inspectors reviewed the equipment response following an attempt to start the 2B SX pump following the event. The inspectors did not identify any specific performance deficiencies given the unique aspects of this event and requirements within the EOPs. The inspectors determined that following the failure of the 2B SX pump to start, operators took prompt action to restore SX flow by cross-connecting SX between units in a timely manner. No issues were identified.
Reactor Coolant Filter Leakage and the Impact on Safety-Related Equipment During the event, the in-service reactor coolant filter became plugged and contributed to the lifting of the letdown line relief valve to the pressurizer relief tank. As a result of the plugged filter, process radiation monitor 2PR06J experienced a pressure spike. This pressure spike resulted in a 2PR06J isolation valve to begin leaking through a mechanical fitting. The leakage resulted in water flowing into the penetration area below, through the joints and around an equipment access floor plug, and into the 2A RHR room below. The 2A RHR pump motor air outlet fins were positioned in such a manner that provided shielding to prevent the water from actually entering the motor.
The licensee determined that the 2A RHR pump remained operable throughout this event. The licensee took corrective actions to repair the leaking connection and evaluated the impact of the leakage on other components. No issues were identified.
Assessment of Release of Tritiated Steam Following the Unit 2 reactor trip, about 184,000 gallons of water containing trace amounts of tritium was released to the atmosphere through the S/G PORVs in the form of steam. This volume was calculated using the assumption that an equal volume of water was released through the S/G PORVs as was used in AF makeup. Auxiliary feedwater flow rate data over the duration of the release was obtained in 1 minute intervals and summed to obtain a total volume of water used.
The licensee had not recently experienced RCS primary to secondary leakage.
Therefore, the only radionuclide of significance was tritium because tritium diffuses through the S/G tubing and enters the secondary system. The licensee routinely performed sampling of the secondary system for tritium with the most recent sample collected on January 30, 2012. The tritium concentration in this sample was about 27,500 picocuries/liter (pCi/L) with no measurable gamma isotopes. The makeup source to the AF pumps was clean, non-tritiated water from the condensate storage tanks. The calculated organ dose to the maximally exposed individual as a result of this release was calculated to be 0.00000109 millirem (mrem). The licensees quarterly limit was 7.5 mrem with an annual limit of 15 mrem. The release during this event was assigned Permit Number 2012047.
Reactor Coolant Pump Seal Assessment Following a Total Loss of Seal Cooling The inspectors reviewed the licensees assessment to ensure that the licensee had adequately evaluated the integrity of the Unit 2 RCP seals following the loss of seal cooling for about 8 minutes. The licensee determined that the RCP seal packages were not adversely affected based upon a review of plant data records, discussions with the vendor, and the performance of a calculation that supported the data observed.
Specifically, the licensee concluded that the RCP seal outlet temperature remained below the alarm setpoint of 184 degrees Fahrenheit (°F) during and following the loss of seal cooling event. During the reactor cooldown, the RCP seal outlet temperatures lowered as expected. The licensee performed a calculation to determine the time it would take for the RCP internally cooled seal water to deplete assuming a worst case 2.5 gallon per minute (gpm) seal leakoff rate. The 2.5 gpm leakoff rate was used because this value was the highest RCP seal leakoff rate prior to the event. The licensees calculation determined that it would take about 13 minutes for this cooled water volume to deplete. This timeframe is important because if this condition is reached, hot RCS water will begin entering each RCP seal package area. As the temperature increases, the seals will eventually soften and fail.
The inspectors reviewed the details of the licensees reviews and determined that the RCP seals had not been significantly damaged due to the loss of RCP seal cooling. The computer points for the RCP seal outlet temperatures were stable and ranged between 150°F and 160°F. During and after the trip, computer data was not available due to the computer servers losing power. However, control room annunciator 2-7-D3 was set to alarm at 184°F. The significant events recorder did not register this alarm. In addition, when the computer data was available, the temperatures were lower than the indicated pre-event operating temperatures of 150°F-160°F and were decreasing as expected for a plant cooldown. No issues were identified.
Operability Determination Procedure Usage Unresolved Item: Operability Determination Procedure Implementation Concerns
Introduction:
The inspectors identified an URI related to the implementation of operability determination procedure OP-AA-108-115, Operability Determinations (CM-1), Revision 11. Specifically, the inspectors questioned whether OP-AA-108-115 was properly implemented since an operability determination was not performed upon discovery of the design vulnerability that was the subject of this inspection.
Description:
Following a review of the January 30, 2012 event and the undervoltage protection system, the licensee concluded that because the undervoltage protection system functioned as designed, and because the NRC had reviewed and approved the design, the requirements of TS 3.3.5 were met and the identified design vulnerability did not impact operability.
The inspectors were concerned with this conclusion since it appeared that the current design would not adequately mitigate a loss of A or C phase event in the absence of operator action, which appeared to not satisfy the intent of the undervoltage and degraded voltage protection systems to ensure that ESF Bus 241 and Bus 242 were powered from either offsite power or onsite power using the DGs.
Subsequently, the licensee performed an operability determination using OP-AA-108-115, Operability Determinations (CM-1), Revision 11. During a review of the operability determination, the inspectors identified issues with OP-AA-108-115.
Specifically, Inspection Manual Chapter (IMC) Part 9900, Operability Determinations and Functionality Assessments for Resolution of Degraded or Nonconforming Conditions Adverse to Quality or Safety, stated the following:
- Circumstance Warranting Operability Determinations.
Licensees should enter the operability determination process on discovering any of the following circumstance when the operability of any systems, structures, and components described in the TS is called into question:
a. Degraded conditions; b. Nonconforming conditions; and c. Discovery of an unanalyzed condition.
However, the licensee stated that OP-AA-108-115 did not require that an operability determination be performed upon the discovery of an unanalyzed condition, and since the non-conforming condition was not within the scope of structures, systems, and components (SSCs) considered in the operability determination process, an operability determination was not required. This decision was based largely on the licensees position that the event was outside of their CLB.
At the end of this inspection, a detailed NRC review of the CLB was in progress.
This URI will remain open pending the completion of this review and a more detailed review of the licensees processes and discussions with NRC experts to determine whether OP-AA-108-115, Operability Determinations (CM-1), Revision 11 was appropriately implemented. (URI 05000454/2012008-02, 05000455/2012008-02, Operability Determination Procedure Implementation Concerns)
In addition, the inspectors identified that the operability determination process did not establish a time limit for revising an approved operability determination after pertinent information within the evaluation had changed or new information became available that could adversely affect the outcome. The licensee entered this issue into their corrective action program as Issue Report (IR) 1325902, Gaps in Guidance of Op [Operability]
Determination Procedure.
Operating Experience Review Unresolved Item: Potential Missed Opportunities to Identify a Latent Undervoltage Design Issue
Introduction:
The inspectors identified an URI related to potential missed opportunities to identify the ESF undervoltage protection design vulnerability through the use of operating experience. This issue was considered an URI because at the end of the inspection the scope of operating experience available to the station was unclear.
Description:
During the inspection, the inspectors identified that Licensee Event Report (LER) 05000334/07-002, Undetected Loss of 138kV A Phase to System Station Service Transformer Leads to Condition Prohibited by Plant Technical Specifications, discussed an event at Beaver Valley Nuclear Power Plant that was similar to the Byron event when on November 27, 2007, a site construction supervisor discovered that the A phase conductor on a Beaver Valley Power Station three-phase 138kV power line had broken off in the switchyard. This break occurred between the offsite feeder breaker and the A train system service transformer at the line side high voltage terminal to the A phase revenue metering device. Upon discovery, the Beaver Valley licensee declared the A train offsite power circuit inoperable and entered the applicable TS action statement. Since nominal electrical power to the safety-related buses was supplied from the main generator, an actual undervoltage condition or demand for undervoltage protection did not occur.
The inspectors discussed this operating experience with licensee staff and management.
The inspectors determined that the licensee had previously evaluated this operating experience and had concluded at that time that no actions or additional review was needed. The inspectors concluded that it was reasonable for this review to have considered the effects of losing the A (or B, or C) phase supplying the Unit SATs from their high voltage ring bus.
In addition, numerous insulator failures had occurred in both the nuclear and non-nuclear industry. In particular, Technical Bulletin 05-018, HK Porter MK40A Disconnect Insulators, discussed the identification of a series of cracked Ohio Brass insulators on 345kV disconnects. This type of insulator was used in the Byron switchyard.
At the end of this inspection, additional operating experience was being reviewed to determine the complete scope of prior opportunities to identify the design vulnerability.
This URI will remain open pending the completion of that review and a determination of whether the failure to identify operating experience for the identified design vulnerability was indicative of recent performance. (URI 05000454/2012008-03, 05000455/2012008-03, Missed Opportunities to Identify a Latent Undervoltage Protection Design Issue)
4OA6 Management Meetings
Exit Meeting Summary
On February 13, 2012, the inspectors presented the inspection results to Mr. T. Tulon, and other members of the licensee staff. The licensee acknowledged the issues presented. The inspectors confirmed that proprietary information reviewed as part of this inspection was returned to the licensee.
ATTACHMENTS:
1.
SUPPLEMENTAL INFORMATION
KEY POINTS OF CONTACT
Licensee
- T. Tulon, Site Vice President
- B. Youman, Plant Manager
- D. Coltman, Operations Manager
- J. Feimster, Design Engineering Manager
- D. Damptz, Acting Maintenance Director
- S. Swanson, Nuclear Oversight Manager
- R. Gayheart, Training Director
- D. Gudger, Regulatory Assurance Manager
- R. Cameron, Licensed Operator Requalification Lead
Nuclear Regulatory Commission
- S. West, Director, Division of Reactor Projects, Region III
- E. Duncan, Chief, Reactor Projects Branch 3, Region III
LIST OF ITEMS
OPENED, CLOSED AND DISCUSSED
Opened
- 05000454/2012008-01; URI Inadequate Undervoltage Protection
- 05000454/2012008-02; URI Operability Determination Procedure Implementation
- 05000455/2012008-02 Concerns
- 05000454/2012008-03; URI Missed Opportunities to Identify a Latent Undervoltage
- 05000455/2012008-03 Protection Design Issue Attachment 1