Information Notice 2005-21, Plant Trip and Loss of Preferred AC Power from Inadequate Switchyard Maintenance: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
(2 intermediate revisions by the same user not shown) | |||
Line 3: | Line 3: | ||
| issue date = 07/21/2005 | | issue date = 07/21/2005 | ||
| title = Plant Trip and Loss of Preferred AC Power from Inadequate Switchyard Maintenance | | title = Plant Trip and Loss of Preferred AC Power from Inadequate Switchyard Maintenance | ||
| author name = Hiland P | | author name = Hiland P | ||
| author affiliation = NRC/NRR/DIPM/IROB | | author affiliation = NRC/NRR/DIPM/IROB | ||
| addressee name = | | addressee name = | ||
Line 14: | Line 14: | ||
| page count = 4 | | page count = 4 | ||
}} | }} | ||
{{#Wiki_filter:UNITED | {{#Wiki_filter:UNITED STATES | ||
NUCLEAR REGULATORY COMMISSION | |||
OFFICE OF NUCLEAR REACTOR REGULATION | |||
WASHINGTON, D.C. 20555-0001 July 21, 2005 NRC INFORMATION NOTICE 2005-21: PLANT TRIP AND LOSS OF PREFERRED AC | |||
POWER FROM INADEQUATE SWITCHYARD | |||
MAINTENANCE | MAINTENANCE | ||
==ADDRESSEES== | ==ADDRESSEES== | ||
All holders of operating licensees for nuclear power reactors, except those who | All holders of operating licensees for nuclear power reactors, except those who have | ||
permanently ceased operations and have certified that fuel has been permanently removed | |||
from the reactor vessel. | from the reactor vessel. | ||
==PURPOSE== | ==PURPOSE== | ||
The U.S. Nuclear Regulatory Commission (NRC) is issuing this information notice to | The U.S. Nuclear Regulatory Commission (NRC) is issuing this information notice to inform | ||
addressees about loss of power events as a result of inadequate preventive and corrective | |||
recipients will review the information for applicability to their facilities and consider actions, | maintenance practices on switchyard breakers and current transformers. It is expected that | ||
recipients will review the information for applicability to their facilities and consider actions, as | |||
appropriate, to avoid similar problems. However, suggestions contained in this information | |||
notice are not NRC requirements; therefore, no specific action or written response is required. | notice are not NRC requirements; therefore, no specific action or written response is required. | ||
==DESCRIPTION OF CIRCUMSTANCES== | ==DESCRIPTION OF CIRCUMSTANCES== | ||
On May 5, 2004, Dresden Unit 3 was at full power and Dresden Unit 2 was shutdown when | On May 5, 2004, Dresden Unit 3 was at full power and Dresden Unit 2 was shutdown when an | ||
automatic reactor scram and a subsequent loss of offsite power event occurred during activities | |||
switchyard breaker 8-15 in accordance with the switching order. | to reconfigure breakers in the 345 kV switchyard. Operations personnel manually opened | ||
switchyard breaker 8-15 in accordance with the switching order. However, when the A and B | |||
phases opened, the C phase of switchyard breaker 8-15 failed to fully open within the required | phases opened, the C phase of switchyard breaker 8-15 failed to fully open within the required | ||
Line 45: | Line 61: | ||
together through a breaker), which led to the opening of several other switchyard breakers. | together through a breaker), which led to the opening of several other switchyard breakers. | ||
Unit 3 scrammed due to turbine load reject, and offsite power was lost to the Unit 3 safety- related emergency core cooling system (ECCS) busses. | Unit 3 scrammed due to turbine load reject, and offsite power was lost to the Unit 3 safety- related emergency core cooling system (ECCS) busses. The failed breaker was an I-T-E | ||
Imperial Corporation (current vendor ABB) sulfur hexafluoride (SF6) gas circuit breaker (type | Imperial Corporation (current vendor ABB) sulfur hexafluoride (SF6) gas circuit breaker (type | ||
362GA). This breaker used independent pole operators for each of the three phases. | 362GA). This breaker used independent pole operators for each of the three phases. The | ||
breaker was built and installed in the Dresden 345 kV switchyard in the late 1970's.On May 6, 2004, the licensee and personnel of the transmission and distribution company,Exelon Energy Delivery (EED), discovered that ABB, the current breaker vendor, had issued a | breaker was built and installed in the Dresden 345 kV switchyard in the late 1970's. | ||
On May 6, 2004, the licensee and personnel of the transmission and distribution company, Exelon Energy Delivery (EED), discovered that ABB, the current breaker vendor, had issued a | |||
product advisory in July 2003 for I-T-E Imperial Corporation GA and GB breakers to warn that | product advisory in July 2003 for I-T-E Imperial Corporation GA and GB breakers to warn that | ||
Line 57: | Line 75: | ||
the operating mechanisms may experience delayed trip or in some cases failures to trip due to | the operating mechanisms may experience delayed trip or in some cases failures to trip due to | ||
age and application related problems. | age and application related problems. In addition, the advisory noted that the breakers at | ||
highest risk were those operated less than twice per year. The product advisory recommended | |||
that the operating mechanism in high-risk applications be rebuilt using new trip latch | |||
mechanism kits at the earliest convenience. | |||
While disassembling the trip latch mechanism of Breaker 8-15, EED and licensee personnel | |||
discovered that the sealed bearing for the trip latch mechanism did not roll freely. The failure of | |||
the sealed bearing to roll freely, directly contributed to the failure of the C phase of | the sealed bearing to roll freely, directly contributed to the failure of the C phase of | ||
Breaker 8-15 to open within the required time. | Breaker 8-15 to open within the required time. The NRC special inspection team reviewed the | ||
maintenance history of Breaker 8-15. The last preventive maintenance on Breaker 8-15 was | |||
done on March 27, 2002, and included routine inspection, lubrication and maintenance, a | |||
contact resistance test, and a travel timing test. The inspection team noted that the breaker | |||
failed the timing test on the C Phase. The breaker was last cycled in October 2002 and | failed the timing test on the C Phase. The breaker was last cycled in October 2002 and then | ||
remained in the closed position until May 5, 2004. | |||
The NRC inspection team noted that the EED procedure stated that the breaker should be | |||
lubricated after a failed timing test. However, the vendor manual stated that, the operating | |||
mechanism should be disassembled and cleaned and lubricated when the operating | mechanism should be disassembled and cleaned and lubricated when the operating | ||
mechanism showed signs of difficult or sluggish operation. | mechanism showed signs of difficult or sluggish operation. In addition, the manual stated that | ||
under ordinary circumstances, the life of the grease in sealed bearings should be at least | under ordinary circumstances, the life of the grease in sealed bearings should be at least | ||
10 years and that if oxidation of the lubricant made the bearing sluggish, the bearing must | 10 years and that if oxidation of the lubricant made the bearing sluggish, the bearing must be | ||
include routine replacement of worn out breaker parts. | replaced. The EED preventive maintenance program and procedures for breakers did not | ||
include routine replacement of worn out breaker parts. In addition, the EED maintenance | |||
procedures did not instruct maintenance personnel to disassemble sluggish operating | procedures did not instruct maintenance personnel to disassemble sluggish operating | ||
Line 83: | Line 121: | ||
mechanisms to check for degraded bearings, nor did the procedures specify the appropriate | mechanisms to check for degraded bearings, nor did the procedures specify the appropriate | ||
lubricants for the various parts of the breaker. | lubricants for the various parts of the breaker. | ||
of a current transformer for the 345 kV switchyard L breaker. | On June 12, 2002, with DC Cook Unit 1 at approximately 68% power and Unit 2 at 100% | ||
power, an emergency alert condition was entered after a catastrophic failure and resultant fire | |||
of a current transformer for the 345 kV switchyard L breaker. The catastrophic failure of the | |||
current transformer and the subsequent switchyard switching actions resulted in the loss of the | current transformer and the subsequent switchyard switching actions resulted in the loss of the | ||
preferred offsite power source to Units 1 and 2. | preferred offsite power source to Units 1 and 2. On June 19, 2002, the NRC special inspection | ||
team reviewed the licensees preventive maintenance program for 345 kV switchyard current | |||
transformers. The vendors preventive maintenance recommendations included annual | |||
inspections and transformer oil analysis every 2 years. The inspection team reviewed historical | |||
maintenance activities on the L breaker current transformers and determined that | maintenance activities on the L breaker current transformers and determined that preventive | ||
maintenance activities | maintenance activities were last done in October 1998. The periodicity of preventive | ||
with the | maintenance activities was consistent with American Electric Power (AEP) system guidelines, but not with the vendors recommendations. Additionally, the licensee did not periodically | ||
perform several vendor-recommended tests, including tests of oil dielectric strength and oil acid | |||
factor, and a measurement of the resistance of the current transformer primary (to compare | |||
with the results in the test report). During followup discussions, licensee personnel stated that | |||
the types of testing performed and the testing frequencies were based on AEP system | |||
operating experience rather than vendor recommendations. Licensee personnel were unable to | |||
readily provide specific operating experience data that justified the 4-year preventive | |||
maintenance testing frequency. Licensee personnel subsequently determined that there were | |||
current transformers | approximately one hundred twenty six 345 kV current transformers in the AEP system similar in | ||
design to the transformers located in the DC Cook 345 kV switchyard. Since 1990, there have | |||
been two catastrophic failures (both associated with the D. C. Cook 345 kV switchyard L | |||
breaker). No current transformers of this type had been removed from service based on | |||
preventive maintenance testing. Following the June 12, 2002, current transformer failure, AEP collected oil samples from the | |||
D.C. Cook 345 kV switchyard breaker current transformers for analysis. The oil analyses were | |||
completed 3 months before the normal schedule as part of the licensees extent-of-condition | |||
evaluation. During the oil sampling, AEP personnel discovered that two current transformers | |||
for N1 switchyard breaker were last sampled in September 1998, with gas analyses results | |||
significantly above the acceptable level. Based on this result, licensee replaced the N1 breaker | |||
current transformers and returned the breaker to service on June 29, 2002. The AEP system | |||
operating experience data did not justify a less frequent analysis than recommended by the | |||
vendor. | |||
==DISCUSSION== | ==DISCUSSION== | ||
The discrepancies, between the | The discrepancies, between the licensees maintenance practices for switchyard breaker and | ||
busses. | current transformers and the vendor recommendations, contributed to the inadvertent | ||
switchyard breaker trips that resulted in a plant trip and loss of offsite power (LOOP) to safety | |||
busses. Unnecessary plant trips and LOOP events could be reduced by following vendor | |||
recommendations with feedback from operating experience to determine the appropriate | recommendations with feedback from operating experience to determine the appropriate | ||
Line 153: | Line 198: | ||
==CONTACT== | ==CONTACT== | ||
This information notice requires no specific action or written response. | This information notice requires no specific action or written response. Please direct any | ||
questions about this matter to the technical contact listed below or the appropriate Office of | |||
Nuclear Reactor Regulation (NRR) project manager. | |||
/RA/ | |||
Patrick L. Hiland, Chief | |||
Reactor Operations Branch | |||
Division of Inspection Program Management | Division of Inspection Program Management | ||
Office of Nuclear Reactor Regulation | |||
===Technical Contact:=== | ===Technical Contact:=== | ||
Thomas Koshy, | Thomas Koshy, NRR Allan Barker, RIII | ||
301-415-1176 630-829-9679 E-mail: txk@nrc.gov E-mail: arb3@nrc.gov | |||
NRR Project Manager: Richard Laura, NRR | |||
}} | 301-415-1837 E-mail: ral1@nrc.gov | ||
Note: NRC generic communications may be found on the NRC public Website, http://www.nrc.gov, under Electronic Reading Room/Document Collections. | |||
ML051740051 OFFICE EEIB:DE Tech Editor OES:IROB:DIPM BC:EEIB:DE | |||
NAME TKoshy (RLaura for PKleene) RALaura JACalvo | |||
DATE / /2005 07/05/2005 07/05/2005 07/18/2005 OFFICE TL:C:IROB:DIPM C:IROB:DIPM | |||
NAME EJBenner (MJRoss-Lee PLHiland | |||
for) | |||
DATE 07/19/2005 07/21/2005}} | |||
{{Information notice-Nav}} | {{Information notice-Nav}} |
Latest revision as of 01:16, 24 November 2019
ML051740051 | |
Person / Time | |
---|---|
Issue date: | 07/21/2005 |
From: | Hiland P NRC/NRR/DIPM/IROB |
To: | |
Koshy T, NRR/DE/EEIB, 415-1176 | |
References | |
IN-05-021 | |
Download: ML051740051 (4) | |
UNITED STATES
NUCLEAR REGULATORY COMMISSION
OFFICE OF NUCLEAR REACTOR REGULATION
WASHINGTON, D.C. 20555-0001 July 21, 2005 NRC INFORMATION NOTICE 2005-21: PLANT TRIP AND LOSS OF PREFERRED AC
POWER FROM INADEQUATE SWITCHYARD
MAINTENANCE
ADDRESSEES
All holders of operating licensees for nuclear power reactors, except those who have
permanently ceased operations and have certified that fuel has been permanently removed
from the reactor vessel.
PURPOSE
The U.S. Nuclear Regulatory Commission (NRC) is issuing this information notice to inform
addressees about loss of power events as a result of inadequate preventive and corrective
maintenance practices on switchyard breakers and current transformers. It is expected that
recipients will review the information for applicability to their facilities and consider actions, as
appropriate, to avoid similar problems. However, suggestions contained in this information
notice are not NRC requirements; therefore, no specific action or written response is required.
DESCRIPTION OF CIRCUMSTANCES
On May 5, 2004, Dresden Unit 3 was at full power and Dresden Unit 2 was shutdown when an
automatic reactor scram and a subsequent loss of offsite power event occurred during activities
to reconfigure breakers in the 345 kV switchyard. Operations personnel manually opened
switchyard breaker 8-15 in accordance with the switching order. However, when the A and B
phases opened, the C phase of switchyard breaker 8-15 failed to fully open within the required
time. This failure produced current imbalances in Unit 2 and Unit 3 switchyard ring busses (tied
together through a breaker), which led to the opening of several other switchyard breakers.
Unit 3 scrammed due to turbine load reject, and offsite power was lost to the Unit 3 safety- related emergency core cooling system (ECCS) busses. The failed breaker was an I-T-E
Imperial Corporation (current vendor ABB) sulfur hexafluoride (SF6) gas circuit breaker (type
362GA). This breaker used independent pole operators for each of the three phases. The
breaker was built and installed in the Dresden 345 kV switchyard in the late 1970's.
On May 6, 2004, the licensee and personnel of the transmission and distribution company, Exelon Energy Delivery (EED), discovered that ABB, the current breaker vendor, had issued a
product advisory in July 2003 for I-T-E Imperial Corporation GA and GB breakers to warn that
the operating mechanisms may experience delayed trip or in some cases failures to trip due to
age and application related problems. In addition, the advisory noted that the breakers at
highest risk were those operated less than twice per year. The product advisory recommended
that the operating mechanism in high-risk applications be rebuilt using new trip latch
mechanism kits at the earliest convenience.
While disassembling the trip latch mechanism of Breaker 8-15, EED and licensee personnel
discovered that the sealed bearing for the trip latch mechanism did not roll freely. The failure of
the sealed bearing to roll freely, directly contributed to the failure of the C phase of
Breaker 8-15 to open within the required time. The NRC special inspection team reviewed the
maintenance history of Breaker 8-15. The last preventive maintenance on Breaker 8-15 was
done on March 27, 2002, and included routine inspection, lubrication and maintenance, a
contact resistance test, and a travel timing test. The inspection team noted that the breaker
failed the timing test on the C Phase. The breaker was last cycled in October 2002 and then
remained in the closed position until May 5, 2004.
The NRC inspection team noted that the EED procedure stated that the breaker should be
lubricated after a failed timing test. However, the vendor manual stated that, the operating
mechanism should be disassembled and cleaned and lubricated when the operating
mechanism showed signs of difficult or sluggish operation. In addition, the manual stated that
under ordinary circumstances, the life of the grease in sealed bearings should be at least
10 years and that if oxidation of the lubricant made the bearing sluggish, the bearing must be
replaced. The EED preventive maintenance program and procedures for breakers did not
include routine replacement of worn out breaker parts. In addition, the EED maintenance
procedures did not instruct maintenance personnel to disassemble sluggish operating
mechanisms to check for degraded bearings, nor did the procedures specify the appropriate
lubricants for the various parts of the breaker.
On June 12, 2002, with DC Cook Unit 1 at approximately 68% power and Unit 2 at 100%
power, an emergency alert condition was entered after a catastrophic failure and resultant fire
of a current transformer for the 345 kV switchyard L breaker. The catastrophic failure of the
current transformer and the subsequent switchyard switching actions resulted in the loss of the
preferred offsite power source to Units 1 and 2. On June 19, 2002, the NRC special inspection
team reviewed the licensees preventive maintenance program for 345 kV switchyard current
transformers. The vendors preventive maintenance recommendations included annual
inspections and transformer oil analysis every 2 years. The inspection team reviewed historical
maintenance activities on the L breaker current transformers and determined that preventive
maintenance activities were last done in October 1998. The periodicity of preventive
maintenance activities was consistent with American Electric Power (AEP) system guidelines, but not with the vendors recommendations. Additionally, the licensee did not periodically
perform several vendor-recommended tests, including tests of oil dielectric strength and oil acid
factor, and a measurement of the resistance of the current transformer primary (to compare
with the results in the test report). During followup discussions, licensee personnel stated that
the types of testing performed and the testing frequencies were based on AEP system
operating experience rather than vendor recommendations. Licensee personnel were unable to
readily provide specific operating experience data that justified the 4-year preventive
maintenance testing frequency. Licensee personnel subsequently determined that there were
approximately one hundred twenty six 345 kV current transformers in the AEP system similar in
design to the transformers located in the DC Cook 345 kV switchyard. Since 1990, there have
been two catastrophic failures (both associated with the D. C. Cook 345 kV switchyard L
breaker). No current transformers of this type had been removed from service based on
preventive maintenance testing. Following the June 12, 2002, current transformer failure, AEP collected oil samples from the
D.C. Cook 345 kV switchyard breaker current transformers for analysis. The oil analyses were
completed 3 months before the normal schedule as part of the licensees extent-of-condition
evaluation. During the oil sampling, AEP personnel discovered that two current transformers
for N1 switchyard breaker were last sampled in September 1998, with gas analyses results
significantly above the acceptable level. Based on this result, licensee replaced the N1 breaker
current transformers and returned the breaker to service on June 29, 2002. The AEP system
operating experience data did not justify a less frequent analysis than recommended by the
vendor.
DISCUSSION
The discrepancies, between the licensees maintenance practices for switchyard breaker and
current transformers and the vendor recommendations, contributed to the inadvertent
switchyard breaker trips that resulted in a plant trip and loss of offsite power (LOOP) to safety
busses. Unnecessary plant trips and LOOP events could be reduced by following vendor
recommendations with feedback from operating experience to determine the appropriate
schedule and extent of maintenance.
CONTACT
This information notice requires no specific action or written response. Please direct any
questions about this matter to the technical contact listed below or the appropriate Office of
Nuclear Reactor Regulation (NRR) project manager.
/RA/
Patrick L. Hiland, Chief
Reactor Operations Branch
Division of Inspection Program Management
Office of Nuclear Reactor Regulation
Technical Contact:
Thomas Koshy, NRR Allan Barker, RIII
301-415-1176 630-829-9679 E-mail: txk@nrc.gov E-mail: arb3@nrc.gov
NRR Project Manager: Richard Laura, NRR
301-415-1837 E-mail: ral1@nrc.gov
Note: NRC generic communications may be found on the NRC public Website, http://www.nrc.gov, under Electronic Reading Room/Document Collections.
ML051740051 OFFICE EEIB:DE Tech Editor OES:IROB:DIPM BC:EEIB:DE
NAME TKoshy (RLaura for PKleene) RALaura JACalvo
DATE / /2005 07/05/2005 07/05/2005 07/18/2005 OFFICE TL:C:IROB:DIPM C:IROB:DIPM
NAME EJBenner (MJRoss-Lee PLHiland
for)
DATE 07/19/2005 07/21/2005