05000499/LER-2021-002, Re Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Cooling System and Containment Spray System

Re Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Cooling System and Containment Spray System

ML21355A278
Person / Time
Site:	South Texas
Issue date:	12/21/2021
From:	Schaefer M South Texas
To:	Document Control Desk, Office of Nuclear Reactor Regulation
References
NOC-AE-21003862, STI:35255315 LER 2021-002-00
Download: ML21355A278 (9)

LER-2021-002, Re Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Cooling System and Containment Spray System

Event date:
Report date:
Reporting criterion:	10 CFR 50.73(a)(2)(i)(B), Prohibited by Technical Specifications
4992021002R00 - NRC Website

text

Nuclear Operating Company South Texas Pmfect Electric Generating Station P.O. Box 289 Wadstmrth, Texas 77483 December 21, 2021 NOC-AE-21003862 10CFR 50.73 STI:35255315 ATTN: Document Control Desk U.S. Nuclear Regulatory Commission Washington, DC 20555-0001 South Texas Project Unit 2 Docket No. STN 50-499 Licensee Event Report 2021-002-00 Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Coolinfl System and Containment Spray System Pursuant to 10 CFR 50.73(a)(2)(i)(B), STP Nuclear Operating Company submits South Texas Project (STP) Unit 2 Licensee Event Report 2021-002-00 for a condition prohibited by Technical Specifications due to a failure of an air handling unit hand switch that resulted in the inoperability of one train of the Essential Core Cooling System and Containment Spray System.

This event is reportable pursuant to 10 CFR 50.73(a)(2)(i)(B) because the required action statements for Technical Specifications 3.5.2 and 3.6.2.1 were not met.

The event did not have an adverse effect on the health and safety of the public.

There are no commitments in this letter.

If you should have any questions on this submittal, please contact Zachary Dibbern at (361) 972-4336 or me at (361) 972-7888.

nchael A. Schaefer iite Vice President zd Attachment: STP Unit 2 LER 2021-002-00, Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Cooling System and Containment Spray System ec:

Regional Administrator, Region IV U.S. Nuclear Regulatory Commission 1600 E. Lamar Boulevard Arlington, TX 76011-4511

NOC-AE-21003862 Attachment Attachment STP Unit 2 LER 2021-002-00, Condition Prohibited by Technical Specifications Due to Inoperable Train of Essential Core Cooling System and Containment Spray System

Abstract

On October 15, 2021, at 0133 hours0.00154 days <br />0.0369 hours <br />2.199074e-4 weeks <br />5.06065e-5 months <br />, the South Texas Project Nuclear Operating Company (STPNOC) started High Head Safety Injection (HHSI) Pump 2B for SI Accumulator 2B fill. Neither the HHSI pump room fans nor the containment sump isolation valve cubicle fans auto started as expected. The B-Train Emergency Core Cooling System (ECCS) and Containment Spray were declared inoperable. On October 15, 2021, at 1319 hours0.0153 days <br />0.366 hours <br />0.00218 weeks <br />5.018795e-4 months <br />, troubleshooting commenced and determined the cause for the failure was the B-Train hand switch (B2HFHS9527) was sticking and needed to be replaced. On October 15,2021, at 2318 hours0.0268 days <br />0.644 hours <br />0.00383 weeks <br />8.81999e-4 months <br />, Operations declared B-Train ECCS and Containment Spray operable following completion of corrective maintenance.

On October 27, 2021, at 2058 hours0.0238 days <br />0.572 hours <br />0.0034 weeks <br />7.83069e-4 months <br /> the event was determined to be reportable by Operations as a condition prohibited by Technical Specifications because the required action statement for Technical Specifications 3.5.2 and 3.6.2.1 were not met.

Completed and planned corrective actions resulting from this event include the replacement of the B train hand switch, revising the frequency for the preventative maintenance on this switch type, instituting a process change to require retention of components, and to evaluate operating experience against the risk of de-terming and re-tenning the hand switch given its proximity to other switches, followed by a supplement.

p. Description of Reportab Ie Event

A. Reportable event classification

This event is reportable pursuant to 10 CFR 50.73(a)(2)(i)(B) because the South Texas Project (STP)

Technical Specification 3.5.2 required action statements for an inoperable Essential Core Cooling System (ECCS) and Technical Specification 3.6.2.1 required action statements for an inoperable Containment Spray System were not met.

B, Plant operating conditions prior to event Prior to the event, STP Unit 2 was at 100% power in Mode 1.

C, Status of structures, systems, and components that were inoperable at the start of the event and that contributed to the event No other structures, systems, or components were inoperable at the start of this event that contributed to this event.

D. Background Information

Unit 2 Control Room hand switch (B2HFHS9527), hereafter referred to as the B-Train hand switch, can be operated to turn on the fans that provide cooling for the B-Train Safety Injection (SI) Pump and Containment Spray (CS) Pump cubicles. The B-Train hand switch failed which prevented the cooling fans in air handling units VAH-005 and VAH-013 from starting automatically as designed when High Head Safety Injection (HHSI) Pump 2B was started for testing.

The B-Train hand switch is a General Electric SBM rotary control hand switch, which are used widely throughout industry and at South Texas Project Electric Generating Station (STPEGS). This B-Train hand switch is designed with a manual start position which can start the SI pump valve room VAH-005 fan from the control room, a STOP position to secure the fan, a pull-to-lock position to completely deenergize power to the fans for personal safety and for maintenance, and an AUTO position that allows the cooling fans to start automatically when HHSI Pump 2B is started. Once the fan motors are started, they continue to run until an operator manually stops the fans with the B-Train hand switch. The status of\\

the fans (on/off) can be confirmed in the Control Room by computer point readout.

The function of the VAH-005 and VAH-013 supplemental cooler units is to provide cooling in Fuel Handling Building (FHB) Room 005 and FHB Room 008 which contain the B-Train SI pumps and the Containment Spray Pump. Elevated temperatures in these rooms are detected by thennostats and the VAH-005 and VAH-013 fans are designed to start automatically on high temperature. The fan startup circuits are also interlocked with the startup and running of any one of the pumps in the room.

The FHB Heating, Ventilation, and Air Conditioning (HVAC) System maintains the normal environmental conditions required to ensure the operability of the system components that are located inside the Fuel Handling Building. During normal operation, the supply air subsystem provides the building with a filtered source of outside air at the proper temperature. Cooling coils supplied by the summary of the event Note: all times are approximate and are listed in Central Daylight Time October 5, 2021, 03:44 hours: Operations started HHSI Pump 2B for Accumulator fill. ESF Pump Room and Valve Room Ventilation fans (VAH-005 and VAH-013) started as expected.

October 5, 2021, 03:46 hours: Operations secured HHSI Pump 2B following accumulator fill.

October 5, 2021, 03:48 hours: B-Train SI/CS Pump Room Air Handling Unit 21B fan VAH-005 was stopped by Operations in the Control Room.

October 5, 2021, 03:49 hours: B-Train SVCS Valve Room Air Handling Unit 21B fan VAH-013 was stopped by Operations in the Control Room.

October 15, 2021, 01:33 hours: Operations started HHSI Pump 2B for Accumulator 2B fill. When HHSI pump 2B was started, the B-Train SI/CS Pump Room Air Handling Unit (AHU) 21B and Valve Room AHU.21B failedto start (VAH-005 and VAH-013 fans). B-Train.ECCS and. Containment Spray declared inoperable due to failure of room AHU to start on pump start.

October 15, 2021, 01:34 hours: Operations secured HHSI Pump 2B following accumulator fill and placed it in automatic.

October 15, 2021, 13:19 hours: Troubleshooting commenced to determine the cause for the supplemental cooler fans failing to start as expected. Results of troubleshooting concluded that the B-Train hand switch (B2HFHS9527) was sticking and needed to be replaced.

October 15, 2021, 20:04 hours: Operations started HHSI Pump 2B for post maintenance testing after replacement of the B-Train hand switch. Fans for both VAH-005 and VAH-013 started with the HHSI Pump 2B start.

October 15, 2021, 20:05 hours; Secured HHSI Pump 2B following satisfactory post-maintenance test.

October 15, 2021, 23:18 hours: Operations declared B-Train ECCS and Containment Spray operable following completion of corrective maintenance to replace the B-Train hand switch and successful completion ofpost-maintenance testing.Page 3 of 7(08-2020)

^"^

^'wnv U.S. NUCLEAR REGULATORY COMMISSION LICENSEE EVENT REPORT (LER)

CONTINUATION SHEET (See NUREG-1022, R.3 for instruction and guidance for completing this form httDs://www.nrc.aov/readina-rm/doc-collections/nureas/staff/sr1022/r3/)

APPROVED BY 0MB: NO. 3150-0104 EXPIRES: 08/31/2023 EsUmated

1. FACILITC NAME

2. DOCKET NUMBER

3. LER NUMBER South Texas Project, Unit 2 05000499 YEAR 2021 SEQUENTIAL NUMBER

- 002 REV NO.

- 00 October 27, 2021, 20:58 hours: Event was determined to be reportable by Operations as a condition prohibited by Technical Specifications.

F. Method of discovery

The event was self-revealed when the VAH-005 and VAH-013 fans failed to start when HHSI pump 2B was started for testing.

Engineering evaluation concluded there was firm evidence that the B-Train hand switch failure occurred on October 5, 2021 when the switch was manipulated to stop the VAH-005 fans. The failure of the B-Train hand switch prevented cooling fans VAH-005 and VAH-013 from performing their safety function of heat removal from October 5, 2021 to October 15, 2021, resulting in conditions prohibited by Technical Specifications for exceeding the seven-day allowed outage times for ECCS Technical Specifications 3.5.2 Limiting Condition for Operation Action (a) and the Containment Spray System Technical Specification 3.6,2.1 Limiting Condition for Operation Action (a).

II. Component failures

A. Failure Mode, mechanism, and effects of failed component The failed component in this event was B-Train hand switch (B2HFHS9527). This hand switch is a General Electric rotary SBM. control switch located in the Control Room. This model of hand switches is a rugged design with proven reliability, but they can develop high contact resistance that in rare instances can prevent relay actuations.

Troubleshooting determined that the B-Train hand switch was sticking, as reported by Maintenance personnel during switch replacement. Prior to replacement of the switch. Operations manipulated the switch to the start position and the fans came on at that time, indicating a potential intermittent failure of the switch. The most likely cause of the switch was sticking of the switch and/or high resistance contacts inside the switch.

The failure of the B-Train hand switch resulted in the cooling fans VAH-005 and VAH-013 not automatically starting to provide heat load removal for the B-Train HHSI pump, Low Head Safety Injection (LHSI) pump, and Containment Spray Pump should these pumps be called upon to perform their safety functions during the time window from October 5, 2021 to October 15, 2021. This time frame exceeds the seven-day allowed outage time of the ECCS Technical Specification 3.5.2 Limiting Condition for Operations Action (a) and the seven-day allowed outage time of the Containment Spray System Technical Specification 3.6.2.1 Limiting Condition for Operations Action (a).

B. Cause of component or system failure or personnel error The direct cause of this event was the failure ofB-Train hand switch B2HFHS9527 which resulted in cooling fans VAH-005 and VAH-013 failing to start automatically to provide supplemental heat load removal in the rooms containing the B-Train HHSI pump, LHSI pump, and Containment Spray Pump.

The failure of the hand switch was due to a sticking hand switch or due to a high resistance contact in the l switch. The failed switch was not retained for more detailed failure analysis, but the personnel whoPage 4 of 7(08-2020)

^"^h f%s dw U.S. NUCLEAR REGULATORY COMMISSION LICENSEE EVENT REPORT (LER)

CONTINUATION SHEET (See NUREG-1022, R.3 for instruction and guidance for completing this form httDs://www.nrc.aov/readina-rm/doc-collections/nureas/staff/sr1022/r3/)

APPROVED BY 0MB: NO, 3150-0104 EXPIRES; 08/31/2023

3. LER NUMBER South Texas Project, Unit 2 05000499 YEAR 2021 SEQUENTIAL NUMBER

- 002 REV NO.

- 00 performed the replacement activity reported it was sticking when operating. Additionally, prior to replacement of the B-Train hand switch, Operations manipulated the switch to the start position and the fans started, indicating a potential intennittent failure of the switch.

Engineering evaluation concluded that there is firm evidence that the B-Train hand switch failed when Operations used it to stop the VAH-005 fans, in accordance with procedure. Although the fans are started automatically, to stop the VAH-005 fans after a start due to any cause other than high room temperature, the operator must take the hand switch from the AUTO position to the STOP position. The hand switch should have spring-returned to center, which is the AUTO position. The switch contact would not be expected to go from being closed to open without some external event occurring, therefore South Texas Project Nuclear Operating Company (STPNOC) concluded the component failure occurred when the spring returned to center when VAH-005 was stopped on October 5,2021.

C. Systems or secondary functions that were affected by the failure of components with multiple functions

This event involved a failure in the B-Train supplemental coolers portion of the Fuel Handling Building HVAC system, resulting in the B-Train Safety Injection System and the B-Train Containment Spray System being declared inoperable. The dependency ofB-Train Safety Injection and B-Train Containment Spray on FHB HVAC supplemental coolers is an expected consequence of the approved STPEGS design. No other systems were directly affected.

D. Failed component information

The B-Train hand switch was a General Electric SBM control switch model Q16SBMC4A42S1F1P1.

This model control switch is a four-position, three-stage, with spring return to the central position, Pull-to-Lock capability, and a pistol hand grip. General Electric SBM rotary switches are used widely in the industry and at STPEGS in many applications; most of these are in the Control Board of the Control Room and in Switchgear of the Power Distribution System. They are a rugged design with proven reliability, but they can develop high contact resistance that in rare instances can prevent relay actuations.

II. Analysis of the event

A. Safety system responses that occurred No safety system responses occurred due to this event.

B. Duration of safety system inoperability

The Unit 2 B-Train LHSI, HHSI, and Containment Spray systems were inoperable from October 5, 2021 at 0348 hours0.00403 days <br />0.0967 hours <br />5.753968e-4 weeks <br />1.32414e-4 months <br /> until October 15, 2021 at 2318 hours0.0268 days <br />0.644 hours <br />0.00383 weeks <br />8.81999e-4 months <br />.

C. Safety consequences and implications

Supplemental cooler VAH-005 provides cooling for continued operation of the LHSI Pump 2B, HHSI Pump 2B, and Containment Spray Pump 2B motors, so it is considered required auxiliary equipment to support the B-Train of the ECCS and Containment Spray System. These systems were declared inoperable from October 5, 2021 through October 15, 2021 due to the inability to provide sufficientPage 5 of 7(08.2020)

<"^

&2i^

U.S. NUCLEAR REGULATORY COMMISSION LICENSEE EVENT REPORT (LER)

CONTINUATION SHEET (See NUREG-1022, R.3 for instruction and guidance for completing this fonn https://www.nrc.aov/readina-nm/doc-collections/nureas/staff/sr1022/r3/)

APPROVED BY 0MB: N0.3160-0104 EXPIRES: 08/31/2023

1. FACILIT/NAME

2. DOCKET NUMBER

3. LER NUMBER South Texas Project, Unit 2 05000499 2021 SEQUENTIAL NUMBER

- 002 REV NO.

- 00 HVAC heat removal.

This ten-day period exceeds the seven-day allowed outage time of the ECCS Technical Specification 3.5.2 Limiting Condition for Operations Action (a) and the seven-day allowed outage time of the Containment Spray System Technical Specification 3.6.2.1 Limiting Condition for Operations Action (a).

The period of inoperability for ECCS B-Train and Containment Spray B-Tram is based on the supplemental cooler VAH-005 not providing cooling for continued operation of the LHSI Pump 2B, HHSI Pump 2B, and Containment Spray Pump 2B motors. These pumps were available to start automatically with an ESF signal and would have started successfully and provided their design flow rates. During the ESF mode of operation, the safety-related Fuel Handling Building exhaust air subsystem continues to draw outside air into the building through the relief dampers. The exhaust air subsystem pulls air through return air registers in the cubicles and exhaust ventilation ducts to exit through the plant main vent stack. The exhaust air fans will draw air from the lower elevations of the Fuel Handling Building, and eventually outside air, to the B-Train Safety Injection and Containment Spray pump room. This air flow will be available for some heat removal from the pump room.

Due to the condition with the B-Train hand switch, the VAH-005 and VAH-013 fans would not have started with an ESF actuation through the breaker closed contacts for the LHSI Pump 2B, HHSI Pump 2B, or Containment Spray Pump 2B. VAH-005 would also not have started on high room temperature.

The valve room supplemental cooler VAH-013 would have started automatically if high room temperature was sensed by the thermostat in the valve room (FHB Room 008) and would have provided its design capacity for heat removal with essential chilled water. The high temperature start ofVAH-013 is independent of the control circuit VAH-005.

Considering the size of the B-Train Safety Injection and Containment Spray pump room, the cooling provided air drawn to the exhaust air subsystem, and the availability of supplemental cooler VAH-013 to start on valve room high temperature, engineering judgement indicates the LHSI Pump 2B, HHSI Pump 2B, and Containment Spray Pump 2B motors could have continued to operate successfully if called upon. The failure of the B-Train hand switch (B2HFHS9527) did not significantly compromise plant safety.

HV. Cause of the event The most-likely cause of the event was due to a sticking hand switch or due to a high resistance contact in the switch. The failed switch was not retained for more detailed failure analysis.

fV. Corrective actions As a corrective action, the sticking B-Train hand switch was replaced and a post-maintenance test was successfully performed on October 15, 2021, STPNOC is also planning to revise the frequency for the preventative maintenance on this switch and similar switches from 468 weeks to 234 weeks. Preventative maintenance activities will include cycling the hand switch five to six times to identify potential sticking issues and replacing the hand switch ifPage 6 of 7(08-2020)

^'^

fw*^

U.S. NUCLEAR REGULATORY COMMISSION LICENSEE EVENT REPORT (LER)

CONTINUATION SHEET (See NUREG-1022, R.3 for instruction and guidance for completing this form httDs://www.nrc.aov/readinc]-nn/doc-collections/nureas/staff/sr1022/r3/)

APPROVED BY 0MB: N0.3150-0104 EXPIRES: 08/31/2023

1. FACILiri'NAME

2. DOCKET NUMBER

3. LER NUMBER South Texas Project, Unit 2 05000499 2021 SEQUENTIAL NUMBER

- 002 REV NO.

- 00 degradation is identified.

STPNOC plans to institute a process change to require retention of components for further analysis after they are removed following an unexpected failure.

STPNOC plans to evaluate operating experience and compare it against the risk ofde-terming and re-terming the hand switch given its proximity to other switches of the control board. Once this action is complete a supplement will follow on February 17, 2022.

iVI. Previous similar events

General Electric SBM rotary switches are used widely in the industry and at STPEGS in many applications; most of these are in the Control Board of the Control Room and in the Switchgear of the Power Distribution System. They are a rugged design with proven reliability, but STP experience shows they can develop high contact resistance that in rare instances can prevent relay actuations.

Since the SI and Containment Spray pumps are rarely energized, GE SBM series control room hand switches are not exercised frequently. This can lead to contamination buildup on the contacts or binding in the switch mechanism and develop high contact resistance that in rare instances can prevent relay actjations.

A similar event occurred at STPEGS in 2007. In this similar event, the Unit 1 A-Train fans VAH-004 and VAH-012 failed to start following a start ofLHSI Pump. This failure was attributed to high contact resistance of the associated A-Train hand switch (A1HFHS9517). As a corrective action for this event, STPNOC created preventive maintenance activities to cycle the hand switches to remove contact oxidation and exercise the switch. These actions have proved effective in preventing additional similar events since 2007.

Additionally, there is also industry experience with defective internal cam followers and worn, dirty, or broken contacts that can prevent switch actuation found in a report prepared by Power Technical Associates, Inc., "Generic Qualification of Rotary Hand Switches," May 1983. The defective cam followers were the result of some of the cam followers being exposed to hydrocarbons during manufacturing. The hydrocarbons would cause the cam followers to degrade as they were made of polycarbonate. As a result, maintenance procedures were revised to prohibit the use of hydrocarbons as a cleaner. Industry operating experience has also found multiple instances of failed actiation being caused by tarnished, dirty, or loose contacts.

Additional recent industry guidance can be found in a special inspection report, ML21321A365, that describes a General Electric type SBM control switch that failed to actuate. When examined the switch was found to have fouling on the contacts that prevented the current flow necessary to actuate the system. After further investigation the fouling was determined to be caused by no preventive maintenance activities being performed.Page 7 of 7