ML20149D596

From kanterella
Jump to navigation Jump to search
Insp Rept 50-285/97-09 on 970423-0610.Violations Noted But Not Cited & Being Considered for Escalated Enforcement Action.Major Areas Inspected:Operations,Maintenance, Engineering & Mgt Meeting
ML20149D596
Person / Time
Site: Fort Calhoun Omaha Public Power District icon.png
Issue date: 06/17/1997
From:
NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION IV)
To:
Shared Package
ML20149D586 List:
References
50-285-97-09, 50-285-97-9, FACA, NUDOCS 9707170189
Download: ML20149D596 (20)


See also: IR 05000285/1997009

Text

. __ .

.

..

..

. . - . _

.

. _ _ .

_ .

.

..

_,

_

,

-,

3

I

ENCLOSURE

U.S. NUCLEAR REGULATORY COMMISSION

REGION IV

Docket No.:

50-285

License No.:

DPR-40

Report No.:

50-285/97-09

Licensee:

Omaha Public Power District

Facility:

Fort Calhoun Station

Location:

Fort Calhoun Station FC-2-4 Adm.

P.O. Box 399, Hwy. 75 - North of Fort Calhoun

Fort Calhoun, Nebraska

'

Dates:

April 23 through June 10,1997

Inspectors:

J. Shackelford, Senior Reactor Analyst

r

C. Clark, Reactor Inspector, Maintenance Branch

P. Qualls, Reactor Inspector, Engineering Branch

W. Walker, Senior Resident inspector, Projects Branch B

Approved By:

Dwight D. Chamberlain, Deputy Director

,

Division of Reactor Safety

Attachment:

Supplemental Information

.

E

,

~

9707170189 970617

PDR

ADOCK 05000295

G

PDR

r

.

.

..

l

.

- .

,

TABLE OF CONTENTS

t

l

EX EC UTI VE S U M M A RY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iii

l

R e p o rt D e t a il s . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1

1. Operations

. .................... ............................

1

01

Conduct of Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1

01.1 Main Steam Extraction Line Rupture Event

1

................

04

Operator Knowledge and Performance

4

........................

04.1 Operator Performance and Procedural Issues . . . . . . . . . . . . . . .

4

II . M a inte na n c e . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

6

M2

Maintenance and Material Condition of Facilities and Equipment

6

......

M2.1 Erosion / Corrosion Issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

6

M7

Quality Assurance in Maintenance Activities . . . . . . . . . . . . . . . . . . .

11

M7.1 Licensee Root Cause Investigation, Followup Activities and

Corrective Actions . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . .

11

Ill. Engineering

14

..................................................

E8

Plant Damage Assessment

14

...............................

V. M a nagement M e eting s . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

17

X1

Public Meeting and Exit Meeting Summary . . . . . . . . . . . . . . . . . . . .

17

ATTACHMENT: Supplemental Information

>

.

I

i

f

1

3

.

,

EXECUTIVE SUMMARY

Fort Calhoun Station

NRC inspection Report 97-09

This team inspection investigated the causes, circumstances, and corrective actions

associated with the April 21,1997, extraction steam rupture at the Fort Calhoun Station.

The inspection team evaluated the operators' performance, procedural controls, plant and

equipment performance, maintenance, and engineering aspects of the event. The

inspection covered a 4-week period, with 2 of these weeks conducted onsite.

Onerations

The team identified a strength in the overall operator response to the event. The

licensed operators acted in a timely and decisive manner to trip the unit and to

isolate the steam rupture. The subsequent decisions to implement emergency

boration were conservative, and the plant was quickly stabilized.

The inspectors noted a weakness in use of fire protection procedures. The plant

operators displayed a lack of familiarity with the operating procedures used in

isolating selected portions of the fire protection system. This lack of familiarity

resulted in an unnecessary isolation of the entire fire protection system.

Maintenance

it was determined that the licensee had missed a potential opportunity to detect the

e

degraded elbow by not considering the imp!! cations of an upstream pipe

replacement of a similar large radius elbow that had occurred in 1985 and had not

adequately considered industry operating experience in the selection process to

determine inspection locations to identify pipe wall thinning. Additionally, the

inspectors noted that the licensee's analytical model for predicting the relative wear

rate of components (CHECWORKS) had not accurately predicted the actual

observed wear rates associated with large radius elbows in the fourth stage

extraction steam system. These factors contributed significantly to the licensee's

failure to identify the wall thinning in the fourth stage extraction steam elbows.

Enaineerina

The inspectors determined that the overall plant and equipment response to the

event were normal and no anomalies were noted. All equipment functioned as

designed and no safety systems vvere actuated.

.

.

_

-

.

--

- .

- -

..

.

..

2

.

,

(

Reoort Details

l

l

Summarv of Plant Status

-The unit was manually tripped by the operators on April 21,1997, as a result of the

. extraction steam rupture event. The unit was placed in cold shutdown for repairs and was

subsequently returned to 100 percent power.

l. Ooerations

01

Conduct of Operations (93702)

01.1 Main Steam Extraction Line Ruoture Event

On April 21,1997, at approximately 8:20 p.m., the plant operators heard a loud

nome coming from the turbine building at the Fort Calhoun Station. The plant was

opereting at 100 percent power and no unusual operational activities were in

progress at that time. The plant operators opened the control room access to the

turbine building and noted steam emanating from the grating, which separates the

main turbine deck from the areas below. The plant operators determined that a

steam rupture was in progress and manually tripped the reactor. The reactor tnp

g

resulted in a turbine trip.

]

The following is the sequence of events for the main steam extraction line rupture

i

that occurred on April 21,1997.

1

2020

The plant was operating at 100 percent power with norma!

l

surveillance activities in progress.

2022

A loud noise was heard in the control room, presumably emanating

from the turbine building. The shift supervisor opened the control

1

room door and observed a large amount of steam in the north end of

the turbine building. The shift supervisor returned to the control room

and ordered the reactor to be manually tripped.

2023

The reactor was manually tripped and Emergency Operating

Procedure-00, " Standard Post Trip Actions," was entered.

2024

Emergency boration was initiated as a precautionary measure. (The

operators determined that the potential existed for an uncontrolled

heat extraction.)

2045

A notification of unusua; event was declared based on the need for

increased plant awareness.

l

l

l

!

1

,

.

.

-_.

_

i

!

[

.

.

2050

Emergency Operating Procedure-00, " Standard Post Trip Actions,"

was completed. Emergency Operating Procedure-01, " Reactor Trip

Recovery," and Abnormal Operating Procedure-26, " Turbine

Malfunctions," were entered due to lowering vacuum on the

condenser and loss of the turning gear on the turbine. The plant

operators also entered Abnormal Operating Procedure-32, " Loss of

4160 volt or 480 volt Bus Power," due to the loss of Motor-Control

. Center 4C3 and the degradation of Motor-Control Center 4C5. Both

motor-control centers were in the direct path of the steam rupture.

2052

The plant emergency response organization was activated to assist in

assessing the damage from the steam leak and restoring power to the

secondary equipment.

2100

The turbine building fire protection system was isolated by placing

the diesel fire pump and the electric fire pump in pull to lock. This

was done to stop the spraying down of the turbine building by the

,

fire sprinkler system that had actuated as a result of the event.

2114

Plant operators verified that the shutdown margin was adequate.

Emergency boration was secured.

2336

All continuous fire watches were established.

2345

The notification of unusual event was terminated and the emergency

response organization was secured. These decisions were based on

the determinations that plant conditions were stable and that the

damaged equipment had no adverse effect on maintaining a safe

,

shutdown.

0220

The operators exited Emergency Operating Procedure-01, " Reactor

Trip Recovery" and entered Operating Procedure-3A, " Plant

Shutdown."

01.1.1 Plant Performance issues Associated with the Event

a.

Jmoection Scoce (93702)

The inspectors reviewed the plant and equipment response to the event. Both

primary and secondary side plant indications and responses were evaluated. The

performance and reliability of important equipment were assessed, as well as, the

potential for steam and moisture interaction with other plant equipment that was

not directly affected by the rupture.

!

2

,

l

.

.

b.

Observations and Findinas

The inspectors performed a review of the recorded critical plant data for primary

plant parameters associated with the event and no anomalies were noted, it was

also determined that no primary side alarms or abnormal indications were received

following the event. However, several alarms were received on extraction steam

pressure. It was determined that these alarms were to be expected based on the

location of the pipe rupture. No automatic safety-system actuations occurred

j

during the event. However, portions of the fire protection system were actuated

throughout the turbine building due to the heat and temperature rise nssociated

with the steam rupture. The steam from the rupture caused seven wet pipe

sprinkler heads to actuate in the basement level of the turbine building.

These heads were in the immediate vicinity of the steam leek and were designed to

actuate at 160 degrees fahrenheit. The team noted that the steam in the vicinity of

these sprinkler heads exceeded the actuation temperature of the sprinkler heads.

The deluge system for the turbine tube oil reservoir also actuated at the time of

the event. This system contains 15 deluge nozzles that sprayed water in the area

of the reservoir and on the main tube oil pumps. The system was actuated by a

cate of temperature rise probe. (Tnis device will cause a deluge actuation if a

15 degrees fahrenheit per minute temperature increase occurs.) The team noted

that the rate of temperature increase in the area of the steam rupture probably

exceeded that required to actuate the detector. Due to the sprinkler and deluge

system actuations, fire water system pressure decreased and caused the fire

suppression water pumps to start automatically.

Following activation of the fire suppression system, intermittent electrical grounds

were received on Vital DC Bus 1 and 480V Bus 1B4C, both of which are safety

related. These grounds on the safety-related buses were determined to be most

likely due to grounds on the turbine building motor-control centers in the vicinity of

the pipe rupture. These motor-control centers are fed by the safety-related buses

and can be isolated by the tripping of the critical quality equipment feeder breakers

which isolate the nonsafety-related loads from their safety-related source. The

inspectors reviewed the material history of selected critical quality equipment

breakers on the 480V (184C-1) and vital de buses. This review indicated no

operational issues in the past 3 years.

However, the inspectors noted that problems with spurious tripping of safety-

related loads, as a result of grounds on nonsafety-related equipment, had occurred

both in the commercial nuclear industry, as well as, at Fort Calhoun Station.

License Event Report 50-285/95-007-01 documented the licensee's problems with

General Electric RMS-9 trip units. The licensee indicated that 13 RMS-9 trip units

had been replaced on safety-related breakers as of August 22,1996. The basis for

the repir. cement of these particular RMS-9 trip units was the possibility of a

commoa mode failure as the result of receiving multiple grounds resulting from a

l

design basis accident. However, during the inspection, the inspectors noted that an

l

additional 44 RMS-9 trip units existed on safety-related loads and load centers

l

which had not been previously replaced. The licensee's rationale for not replacing

'

3

_

. . -

. _ . . . _ . _ .

_ _ _ _ . _ _ _ _ . _ , _ _ - . _ _ . _ _ . _ . _ . _ . . _ _ _ . _

E

e-

,

.

.

,

t'

i

these breakers was that sufficient redundancy ceuld be demonstrated during design

j

basis scenario's with the worst-case postulated RMS-9 trip unit failures. However,

-

'it was determined that the licensee's approach may not have been conservative in

i

i.

all cases.' In particular,.during some maintenance configurations, the SI-2C high

l

pressure safety injection pump may have been susceptible to postulated RMS-9 trip

unit failures during certain design basis scenarios. The licensee is in the process of

reanalyzing the basis for RMS-9 trip unit. replacements and currently plans to

>

replace all of the RMS-9 trip units, which carry safety-related loads. In addition the

. licensee is reviewing all plant loads associated with RMS-9 trip units and is

.

. developing criteria for replacing some of the nonsafety-related units. This item will

,

l

remain open pending further review regarding the licensee's criteria for not

',

r'eplacing some safety-related RMS-9 trip units in the original modification (50-

i

285/9709-01).

.

. The inspectors evaluated the potential for steam to intrude from the turbine building

,

into the auxiliary building. In particular, the inspection focused on the 125 volt de

battery rooms, the electrical switchgear rooms, and the cable spreading rooms.

The inspectors noted that the only method of communication between the turbine

i

building and these areas was via four fire doors and a damper over the cable

spreading room door. No fire alarms were received from any of these areas of the

j

auxiliary building and inspection of these areas did not indicate any moisture

!

,

intrusion. (It is expected that steam intrusion would have resulted in fire alarms in

'

I

these areas because they are equipped with ionization detectors.) Also, a review of

.

l

the ventilation systems was conducted and discussions were held with the

' ventilation system engineer concerning the potential for steam intrusion from the

turbine building'into the safety-related areas of the auxiliary building. It was

determined that separate ventilation systems exist for the safety-related areas and

+

that no potential existed for steam intrusion via the ventilation systems.

l

'

c .~

Conclusions

The team concluded that the plant and equipment response were normal. All plant

i

systems operated as designed and no equipment failures or abnormal indications

were noted. - Further, the inspectors concluded there was no steam intrusion from

'

the turbine building into the safety-related electrical switchgear rooms. However,

the rupture resulted in significant, challenge to the plant operators and led to a

reduction in the station fire protection capabilities.

L04

- Operator Knowledge and Performance -

04.1 - Operator Performance and Procedural Issues

a.

Inspection Scone

'

The team reviewed the operators' response and procedural issues associated with

the event. Interviews were conducted with plant operators, and control room log

reviews were performed. An overall evaluation of operator performance and

4

t'

- _ - - _ _ _ _ , -

.

, , . -

+ .

,

,,.

. . . - . - ,

+ ,

- --

-

..

. . - - - .

-

.

- -

.

. -

- - - - . . ~ . - - - - ~ . _ - - -

.

3

.

procedural adequacy was performed with respect to the specific operator actions

~

associated with the event.

b.

Observations and Findinas

.

.The inspectors noted that the' operator's actions to respond to the event w'ere

timely, decisive, and conservative. The operators acted quickly by tripping the'

reactor within 19 seconds of the initiation of the event. Additionally, the team

~

determined that the operators took conservative measures by initiating emergency

boration to ensure that an adequate shutdown margin was maintained in

consideration of the potential for an uncontrolled heat extraction during the event.

It was determined that the correct emergency operating and abnormal operating

j

procedures were' implemented during the event. The inspectors responded to the

7

site in the early recovery stages of the event and noted that the control room was

' '

orderly and that good command and control were demonstrated by the licensed

senior operator and the shift supervisor.

However, the inspectors did note a _ weakness during the response to the event

I

with the operators' knowledge of fire protection procedures. Operating

Instruction OI-FP-1, " Fire Protection System Water System," Revision 25, contains

j=

detailed steps on the isoletion of the fire protection system. Specifically,

!'

this procedure contained details on isolating fire protection water to the turbine

building basement, the turbine lube oil deluge and the turbine building mezzanine

U

sprinkler systems. During the event the operators attempted to isolate the fire

'

' protection system using only the piping and instrument drawings and without

l

referring to the proper procedure. The inspectors conducted selected interviews

3 '

with auxiliary operat_ ors, who were attempting to isolate the fire protection

system the night of the event, and each individual interviewed indicated that

,

Operating instruction Ol-FP-1 should have been used. This would have made

4

isolation of the fire protection system more timely and would not have resulted

~

in an isolation of the entire turbina building fire protection capability. The

operators attempted to isolate the fire protection system for approximately

i

40 minutes before a decision was made by the shift supervisor to secure the fire

pumps. This terminated the spraying down of equipment in the turbine building and

,.

rendered the fire protection system inoperable without operator action to restart the

-

fire pumps. The operators placed the fire protection system pumps in pull to lock in

accordance with Standing Order S0-G-103, " Fire Protection Operability Criteria and

Surveillance Requirements," Revision 5. The NRC is reviewing the adequacy of this

j

.-

_

i E

procedure and the results of this review will be dispositioned in NRC Inspection

j

.

- Report 50-285/97-06. The inspectors determined that the lack of familiarity with

-

i

the fire protection procedures resulted in an unnecessary reduction in station fire

j

.

. protection capabilities.

l

!

During the followup to the event, the licensee identified the failure to

establish a continuous fire watch in the required time after securing the fire

_

pumps. -This was documented in Condition Report 199700499, which indicated

i

that the sprinkler system for the diesel rooms was out-of-service for approximately

2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br />. Standing Order SO-G-103, " Fire Protection Operability Criteria and

I

5

-

i

.

-

. . -

, _ . -

- -

_

_

j

- .

_

_ . - _

. _ _ .

.

_

_ - -- . - -._ -_. --.. -

-

.

. ;

j

4

i

e

-.

i

'

,

j

Surveillance Requirements." Revision 5, Attachment 3, Step 2, requires that a

continuous fire watch be established within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> if the sprinkler system is -

-

inoperable. Failing to establish a continuous fire watch within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> is a

violation of Technical Specification 5.8.1. The licensee conducted training and .

i

i

issued an operations memorandum to address this deficiency. Additionally,

!

F

refresher training on the usage of plant fire protection procedures was scheduled

for the licensee's requalification program. This nonrepetitive licensee-identified and

. ;

'

,

corrected v!olation, is being treated as a noncited violation consistent with Section

l

V11.B1 of the NRC Enforcement Policy (50-285/9709-02).

- !

.

4

. c.

Conclusions

'

.

.The team concluded that licensed operator actions were accomplished in an

.

expeditious manner. The operators' decisions were both rational and conservative.

'An overall strength was noted in the area of licensed operator response. A

_ j

t.

'

weakness was noted in the area of the use of the procedures to manually isolate

{

i'

selected fire protection headers.

j

11 Maintenance

,

M2

Maintenance and Material Condition of Facilities and Equipment

M2.1 Erosion / Corrosion issues

4

f

_ a .-

Inspection Scope (49001, 62706)

The team reviewed those aspects of the licensee's maintenance rule and

,

.

erosion / corrosion control programs as they pertained to the circumstances

}

[

surrounding the April 21,1997, pipe rupture event.

' l

.

b.

Observations and Findinas

.i

i:

The licensee determined,' and _the team agreed, that the failure of the piping in

. the fourth stage extraction steam system was most likely due to flow. accelerated

a

'~

corrosion. The design conditions of the fourth stage extraction system were

300 psig/425*F and the system was composed of primarily 12-inch diameter piping

'

fabricated from A-1068 carbon steel with a nominal wall thickness of .375 inches.

-

The;" fishmouth" break, which occurred, was approximately 4 feet long by 1 foot

l

.

wide,'and it was postulated that an approximately 2-4 inch wide by 4 foot long

-

_ section of pipe was below minimum wall thickness before the rupture. _ The failure

.

_

-location occurred on'what is known as a "large radius elbow." The as-found '

readings on the failed pipe revealed a minimum wall thickness of the rupture seam

'

.of .054 inches, whereas the minimum allowable pipe thickness was .126 inches.

i

j

<

j

6

a

'

'

,.

---

.

m

,

. - , -

m

, .-

,

. .m

. ,.

. . .

.

-

. - _ - - - . - - . -

.

- - - - - - _ . - - . - - . .

1

'

.

..

The failure location was modeled in the licensee's erosion / corrosion program (i.e.,

j

Location S-25) but the actual wall thickness had never been measured by

'

nondestructive examination techniques. The licensee had relied on a predictive

methodology (CHECWORKS) to monitor the condition of the large radius elbows in

1

'

the extraction steam system. The CHECWORKS methodology had predicted a

lower wear rate on the large radius elbows relative to other potential wear locations

within the fourth stage extraction steam system.

The team determined that a prior opportunity to detect and prevent the failure had

existed. It was discovered that Field Change 85-94 had been implemented in 1985

'

to replace the piping immediately upstream of the failure location. This modification

included the replacement of the next upstream large radius elbow due to excessive

wear caused by erosion / corrosion. The licensee indicated that the first elbow in the

system (a short radius elbow) had developed a pinhole leak due to flow accelerated

corrosion. During replacement of the short radius elbow, it was discovered that the

-

next downstream elbow (a large radius elbow located immediately upstream of the

site of the April 21,1997, pipe rupture) was also significantly degraded due to

erosion / corrosion and required replacement. The licensee could not produce

documentation to indicate that any inspections were conducted at that time on

Location S-25, (the failure location), or any other large radius elbows in the

extraction steam system. Thus, the team determined that this information would

J

have'been sufficient to indicate that high wear rates were occurring in the large

1

radius elbows despite the predictions made by the analytical methodology.

Additionally, the team determined that the licensee had not adequately incorporated

j

industry operating experience into the erosion / corrosion program. Various NRC

!

information notices and industry notifications were available. They provided

Insights into significant operating failures in extraction steam and other similar

systems. Additionally, several other sources of industry information, which

contained an extensive amount of information related to similar problems in the

extraction steam systems at other plants, were available to the licensee. These

sources of industry information had not been adequately factored into to the

licensee's erosion / corrosion program with respect to choosing suitable piping

inspection locations.

As a result of the rupture, the licensee inspected all other large radius elbows at the

facility, which had not been previously inspected. It was determined that the

furthest downstream large Radius Elbow S-32 in the fourth stage extraction piping

was also significantly below minimum wall thickness and had to be replaced. (The

minimum wall reading was .044 inches.) Inspection Location S-27, another large

radius elbow in the fourth stage extraction piping, was also found to have exhibited

excessive wear, although this particular elbow had not exceeded the minimum

allowable thickness. (This location exhibited a minimum wall reading of .155

inches and was replaced by the licensee.) .The large radius elbow at Location S-27

was in the licensee's analytical model for the erosion / corrosion program and had

never been inspected due to the lower relative wear rate predictions for large radius

elbows which were supplied by the model. The licensee also inspected the large

radius elbows in the second stage extraction steam system and these elbows were

found to have acceptable wall thickness readings.

7

.-

-

-

-

---

- .-.

-

-

_ . _ _ . _ _ . _ _ _ _ _ . _ _

_ _ _ . _ . _ _ _ _ . . _ _ . - _ _

.

'

.

.

l

l

The licensee's staff acknowledged the deficiencies associated with incorporating

j

plant and industry operating experience into the erosion / corrosion program. In

response to this issue, the licensee implemented a panel of industry experts from

'

other utilities and industry groups whose charter was to review the Fort Calhoun

'

Station erosion / corrosion program with respect to the incorporation of industry

insights. The erosion / corrosion program susceptibility evaluation was upgraded to

conform to industry standards. The entire steam seal system, steam generator

j-

blowdown suction / discharge of the blowdown transfer pumps, condensate

j,

' recirculation and steam traps and drains were added to the program.' Additionally,

i'

.this review group identified a number of additional inspection locations which were

not being actively inspected in the licensee's program. The licensee conducted

a

ultrasonic testing inspections of these locations and determined that several other

locations in a different plant system had degraded to the point whereby the walls

had exceeded minimum. wall thickness standards. It was found that three separate

parallel lines in the heater drains system (Location D-95) had very localized areas,

which were below the minimum allowable well thickness and required replacement

(i.e., the minimum readings were .08 inches). Additionally, the licensee identified

that Location S-54 in the sixth stage extraction steamline exhibited unacceptable

. wall thickness reading and required replacement. This particiutar piece of piping

was known as a " pup" piece and was located immediately downstream of piping

that had been replaced in 1985 with an alloy of chromium-molybdenum material.

This location had a minimum wall thickness reading of .107 inches. h summary,

the net result of these programmatic reviews of the licensee's erosion / corrosion

program was the identification of five additional pipe locations (not including the

rupture location) whose wall thicknesses had degraded below the minimum

allowable.

The fourth and sixth stage extraction steam system and the heater drains

system had been included within the scope of the licensee's program to implement

10 CFR 50.65, " Requirements for Monitoring the Effectiveness of Maintenance at

Nuclear Power Plants." These systems were included as subsystems of the main

'

feedwater system and had been classified as being of low risk significance and

were being monitored under Section (a)(2) of the Rule. The system performance

criteria had been identified at the plant level and required that no forced shutdowns,

power reductions, or trips be caused by maintenance preventable functional failures

of the system. The licensee's program plan for. implementation of the Maintenance

Rule (Section 4, paragraph 3) specified that the plant operating experience review

. program would provide the responsible organizations the industry operating

experience necessary for incorporating the required information into the

maintenance rule program. Additionally, paragraph 4 of the program plan specified

that the special services engineering department would maintain specialized

programs to respond to component-specific concerns. The erosion / corrosion

program was considered to be one such specialized program under the umbrella of

maintenance rule implementation. Finally, the Maintenance Rule implementing

Instruction MRil-2, Section 5.3.4, " Condition Monitoring," stated that no specific

condition monitoring was required by the Fort Calhoun Station Maintenance Rule

8

-

. - .

.

__.

,

.

.

Project. The Fort Calhoun Station Maintenance Rule Project made maximum use of

existing programs, such as erosion / corrosion control, to provide the necessary

condition monitoring functions as required by the rule.

The Maintenance Rule,10 CFR 50.65(a)(1), requires, in part, that each holder of an

operating license shall monitor the performance of structures, systems, or

components against licensee established goals, in a manner sufficient to provide

reasonable assurance that such structures, systems, and components are capable

of fulfilling their intended functions. Such goals shall be established commensurate

with safety and, where practical, take into account industry-wide operating

experience.10 CFR 50.65(a)(2) states, in part, that monitoring as specified in

paragraph (a)(1) is not required where it has been demonstrated that the

performance or condition of a structure, system, or component is being effectively

controlled through the performance of appropriate preventive maintenance such

that the structure, system, or component remains capable of performing its

intended function.

The inspectors determined that the licensee had not established appropriate goals

for those components in the fourth and sixth stage extraction steam system, and

the heater drains system whose pipe walls had degraded to the extent that

minimum wall thickness criterion had been exceeded. Additionally, it was

determined that the licensee had not adequately incorporated industry-wide

operating experience in the establishment of goals and performance monitoring

activities, as required by the maintenance rule. As a result, a pipe rupture occurred

on April 21,1997, due to inadequate monitoring of the condition of the fourth

stage extraction steam system. This pipe rupture resulted in a significant plant

transient and personnel hazard. The pipe rupture required the plant operators to trip

the unit and enter the emergency operating procedures in order to stabilize the

plant. Additionally, damage occurred to certain balance-of-plant equipment, and a

significant asbestos hazard was created due to damaged piping insulation in the

vicinity of the rupture. The event also actuated portions of the fire protection

system, which had to be disabled, thus, decreasing the station's fire protection

capabilities. This is considered to be an apparent violation of 10 CFR 50.65 (50-

285/9709-03).

In addition to the apparent violation described above, the inspectors noted the

following deficiencies associated with the predictions generated by the

CHECWORKS analytical model:

Large radius elbows were monitored on the basis of predictive wear analysis

only. There had been no erosior>l corrosion examinations performed of large

radius elbows.

Engineering judgement was not adequately incorporated into the sample of

components selected for erosion / corrosion examination (i.e., only those

components with the highest predicted wear were inspected).

i

i

9

l

!

__- _._._ ._ _ _.. _ .

_ _ _ _ _ . _ _ _ .

__

_ . . _ . _ . - _ _ . ._

t

.

.

[

l

1

,

!

'

'

The erosion / corrosion engineer had not routinely evaluated the accuracy of

the analytical results. Therefore, the relatively poor predictive capability of

i

.

the program with respect to this comparison of predicted wear to measured

2

[

. wear was not detected for the fourth stage extraction steam system at Fort

.:

Calhoun Station.

'

1

>

!-

Actual component' measured wall thickness inspection data from the 1995

i

and.1996 erosion / corrosion examinations had not been incorporated into the -

j

analytical model.

,

1

i

.

.

Minor modeling input errors related to incorrect component geometry codes

l

'were identified by the team. The modeling input errors appeared to be the

_

'

result of incorrect component identification on as-built drawings used to

,

generate input data. A similar deficiency of this type had been identified by

r

the NRC in a routine erosion / corrosion inspection conducted in 1994.

Only one train of multiple train systems had been modeled in the analysis.

j

,

l'

Of particular significance was the fact that the CHECWORKS predictions for the

fourth stage extraction steam system were not consistent with the actual observed

wear rates as measured b' the licensee following the event. in particular, those

y

.

inspection locations whose relative wear rates were predicted to be the highest for.

- this specific application (i.e., short radius elbows and tees) did not exhibit

.significant actual measured wear. Conversely, the larger radius elbows (which had

. been predicted to exhibit a lower relative wear rate) were wearing at rates higher

than predicted for this specific application.

As of'the end date of the inspection, the licensee had not determined the specific

reasons for the discrepancies between the predictions and the actual observed wear

rates for those compunents in the. fourth stage extraction steam system. However,

i

the licensee did identify several other issues associated with the implementation of

.

the CHECWORKS methodology during a self-assessment associated with the

'

steamline rupture event. These self-assessment findings are discussed in Section

M7.1 of this report. As a result of these discrepancies, the licensee issued an

industry notification, which reported the details of the issues associated with

respect to the analytical n.athodology and its impact on this event,

c.

. Conclusions

The team concluded that significant weaknesses existed in the licensee's

erosion / corrosion program. Specifically, the team concluded that the licensee had

. not adequately incorporated industry experience into the program, particularly in the

area of the selection of inspection site locations. Additionally, the licensee had not

properly incorporated prior plant operating inexperience into the program for the

!

selection of inspection site locations. Finally, it was determined that the licensee's

analytical model for predicting wear rates on the affected system components had

not accurately predicted the actual wear rates and that an over-reliance existed

l

10

. - .

.

_

..-. .

.

-- - -.

-.

.

- - - - -

.-

- . . .

-

.

. - -

.

.

.

with respect to the model's predictions for the extraction steam system. The result

of these deficiencies led to significant degradation (i.e., exceeded minimum wall

thickness requirements) in six separate piping locations in three separate plant

systems. One of these areas of degradation resulted in a catastrophic failure of the

piping, which caused an unnecessary plant transient and significant personnel

hazard and contributed to a reduction in the station's fire protection capabilities.

However, at the exit meeting on June 10,1997, the licensee indicated that several

,

i

of these locations which were found to be below minimum wall thickness were not

significant failures. The licensee stated that the piping replacements associated

<

'

with these l'ocations were implemented at > precautionary measure.

f

M7

Quality Assurance in Maintenance Activities

M7.1 Licensee Root Cause Investiaation, Followuo Activities and Corrective Actions

a.

Insoection Scope (93702)

The team reviewed the licensee's self-assessment efforts, root-cause analysis, and

corrective actions associated with the steam rupture event.

b.

Qbservations and Findinas

i

The licensee performed a formal root-cause analy. sis of the extraction steam line

rupture event. The analysis was performed in two phases: Phase 1 was a

j

preliminary root-cause analysis to identify apparent causes and to identify the root

cause of the reason for not detecting the imminent failure of the piping. Phase 2 of

i

the root-cause analysis would provide a final root cause, which would include a

'

failure analysis (including a metallurgical examination) of the failed piping conducted

j

by two separate and independent laboratories.

'

'

The Phase 1 root-cause analysis results determined that the piping failure was most

likely the result of flow-accelerated corrosion, which had occurred over a relatively

I

long period of time. The licensee determined, and the team agreed, that the

degradation in the piping could have been detected well before the event. It was

1

determined that an over-reliance was placed on one predictive factor, the

relationship between elbow radius and predicted wear rate, in determining the

specific locations for ultrasonic testing inspection site locations. Additionally, it

was determined that there had been insufficient consideration of both industry and

plant-specific operating experience in the selection of inspection site locations. The

licensee also determined that the erosion / corrosion program lacked a detailed

methodology to choose ultrasonic testing inspection locations and that inadequate

management oversight existed with respect to the implementation of the program.

The licensee chartered a formal self-assessment team to review the

erosion / corrosion program at the facility. The team was composed of plant

personnel and management, as well as, industry representatives from other utilities,

Electric Power Research Institute, and contract engineering firms. The self-

11

.

_ _ . _ _- .

._ ._

. _._ _ _._

_ _ . _ _ . . . _ _ . ._ _ .

. ~ - .

. _

'I

.

.s

.

assessment team conducted a broad-based review of the erosion / corrosion program

'

and identified various program weaknesses and some strengths. The self-

l

assessment findings were formulated into issues which were to be addressed in

~

three phases: (1) prior to plant startup, (2) pric,r to start-up from the 1998 outage,

and (3) those which were considered to be long-term corrective actions,

i

The most significant findings of the self-assessment effort identified specific factors

which contributed to the failure to identify the eroded piping in the extraction steam

system. In particular, the opportunity to identify excessive wear was missed due to

failure to inspect the S-25 elbow during replacement of the next upstream large

radius elbow in 1985. Additionally, the licensee's team noted that the plant had-

1

consistently missed the opportunity to identify high wear systems by not '

. adequately incorporating industry operating experience into the erosion / corrosion

'

program. The over-reliance on the predictive results of the'CHECWORKS

methodology (which had not accurately predicted the failure) was also a significant -

contributing factor.

,

Additional findings of the licensee's team included observations of various program

weaknesses in the erosion / corrosion program. The licensee's team noted the

following weaknesses in the program:

!

,

.

The licensee had not aggressively pursued the change out of carbon-steel

- with more resistant material.

l

The erosion / corrosion program did not provide a thorough description of

susceptibility criteria or documentation of system susceptibility

determinations.

No detailed procedures existed for how inspection locations should be

,

selected.

j

The measured wear process, which was used, was not consistent with

f

industry standards. The licensee had not been conducting point-to-point

'

comparisons of all the ultrasonic test readings associated with a given

component / location to determine the maximum wear rates. The licensee

had been using the data from the ten lowest thickness locations to

determine the wear rates.

A considerable amount of susceptible piping that was suitable for modeling

!

was not included in the analytical models.

l

c

(

No documentation existed that indicated that the analytical models were

'l

kept current.

'

The analytical models had not been verified.

  • ~

'The erosion / corrosion program had not been maintained current with

industry standards.

i

12

.

_

. ., _ _ _ . . _ _ .

._.___________._m.__.

.__..._. _. . . _ . _

_

,

- .

.

Some data packages could not be located for several inspection point

p

locations from the 1996 outage.

E

As a result of the root-cause analysis and self-assessment team efforts, the

licensee identified specific actions to be accomplished prior to restarting the unit.

i

The following activities were completed prior to the plant's restart on May 12,

.

1997:

'

e

'

I

  • .

Reviews were conducted for all systems within the scope of the erosion /

corrosion control program. The remaining large radius elbows, which had

l

been predicted to exhibit lower relative wear rates, were inspected. Two

.

'

additional elbows in the fourth stage extraction steam piping were replaced

due to excessive wear.

i

.

.

All pipes dominstream of previously replaced piping or components were

evaluated as to whether or not previous inspections had been conducted.

One location was found to have not been previously inspected. An

inspection was conducted on this location and it was found to have an -

'

.

acceptable wall thickness.

1

The erosion / corrosion program susceptibility evaluation was upgraded to

,

,

conform to industry standards. The entire steam seal system, steam

!-

generator blowdown suction / discharge of the blowdown transfer pumps,

i

i

condensate recirculation and steam traps and drains were added to the

!

program. Several additional required inspections were identified during this

j

review and all of the additional inspection locations were found to exhibit '

'

- acceptable wall thicknesses.

!

1

1-

A reinforcing pad was installed on Component S-56 (a branch location on

,

.the sixth stage extraction steam line feeding the low pressure heaters).

<

l-

All 1996 outage inspection packages, which had not been independently

4

reviewed, were reviewed and found to be acceptable.

'

' All missing 1996 outage inspection packages were located. It was

i

i

- *

determined that three of the missing packages had not undergone any

reviews to determine whether the readings for the affected components

4

were below minimum allowable wall thickness. Additionally, several of the

,

missing packages had not undergone the required independent review. All of

the'affected packages were reviewed, and all wall thickness readings were

'l

,

determined to be acceptable.

J

4

' Thirty components .which showed significant wear or whose. wear rate

,

'

could potentially lead to exceeding minimum' wall thickness, were

reevaluated using an industry standard analysis methodology. One of these

components required re-inspaction and the subsequent readings were found

,

to be acceptable,

j

i

i

i

13

i

l

'

'

3

. .

. , n

- ,-

,

.

- - , . .

.

, - .

.

.

- A review of industry operating experience was conducted. This review

resulted in the addition of severalinspection locations. Subsequent

inspections of these additionallocations resulted in the replacement of three

parallel pipes in the heater drain system.

Additionally, the licensee identified the following short-term corrective actions to be

completed prior to the restart from the next refueling outage:

(

Upgrade the erosion / corrosion c'ontrol procedures to include more specific

g'uidance on choosing inspection locations.

Upgrade the measured wear determination process and the sample

expansion process to conform to industry standards.

Revise the erosion / corrosion control program to include a document that

controls the identification of system susceptibility criteria.

Incorporate past outage data into the current CHECWORKS model and

perform a verification of the^model. Additionally, formal controls will be

established to ensure thet model changes are properly documented.

Finally, the licensee identified a long-term corrective action related to the need for a

followup assessment of the erosion / corrosion program. The followup assessment

was intended to be verification that the interim improvements in the program were

providing satisfactory results.

c.

Conclusions

The team concluded that the licensee's self assessment and preliminary

determination of apparent causes were adequate. The root cause associated with

the failure to identify the degraded elbow appeared reasonable. The inspectors

determined tlM the corrective actions completed prior to restart and the proposed

short- and Ic'. , Lttm cosctive actions were acceptable. However, the team

determined that additional actions to properly evaluate the predictive validity of the

model would be necessary in order to maintain an awareness of the model's ability

to reliably predict wear rates. _The final determination regarding the Phase 11

root-cause analysis and the effectiveness of the short- and long-term actions will be

reviewed in future inspections and are characterized as an NRC inspection followup

item (50-285/9709-04). Additionally, further review of the licensee's overall

program for incorporating industry-wide operating experience into applicable plant

programs is planned and was characterized as an NRC inspection followup item

(50-285/9709-05).

14

2

i

l

'

.

.

Ill.Enaineerina

E8

Plant Damage Assessment

a.

insoection Scoce (93702)

l

The team conducted an assessment of the damaged areas of the turbine building.

Additionally, the team reviewed the licensee's plan and scope of activities for

conducting a plant damage assessment and the associated recovery activities.

b.

Observations and Findinas

The licensee's damage assessment team developed criteria in determining the area

to be inspected for damage due to the rupture. The area defined for extensive

assessment included the area of obvious physical damage, as well as, an area

defined by a qualitative assessment of the thermal-hydraulic conditions associated

with the rupture. The licensee defined the " break-affected" zone as that area

extending outward from the break location in a roughly cone-shaped configuration

that terminated at the turbine building wall. This assumption was based on visual

examinations of the steam impingement effects, as well as, assumptions regarding

the temperature and pressure of the steam and the duration of the event.

The scope of the damage assessment included a disposition of every plant system

i

and whether or not the system could have been affected by the rupture. For those

systems that had the potential for damage, damage assessment teams were formed

and walkdowns were conducted. The results of the walkdowns were collated in

" damage assessment reports," which were submitted to the overall damage

assessment effort leaders for tracking purposes. The damage assessment teams,

which were formed, consisted primarily of the cognizant system, design, and

maintenance engineers, as well as, selected craft personnel. The following

paragraphs provide a summary of the significant findings associated with the

damage assessment effort.

The component in the " break-affected" zone with the most extensive damage was

the Motor-Control Center 4C5. The inspectors observed that the motor-control

center was approximately 8 inches out-of-plumb from the top to bottom. The back

panels were bent open and deformed by the effects of steam impingement.

Motor-Control Center 4C3, which was immediately adjacent to 4C5 did not display

any structural damage. However, this particular motor-control center lost power

during the event. (The motor-control center was subsequently re-energized during

the recovery efforts.) There were two other motor-control centers in this area

which did not suffer any obvious physical damage, but had been significantly

" sprayed" with asbestos insulation that had been displaced during the event. The

licensee consulted with the vendor of the motor-control centers and conducted the

necessary repairs to the damaged equipment. A small portion of the bus insulation

in the vertical section of the motor-control center was repaired and extensive clean

l

up was required to remove all of the powdered pipe insulation. The breaker for the

'

turbine seal oil pump required replacement due to physical damage.

l

15

.

.

Several cable trays were also located in the " break-affected" zone. The cable

trays directly in the stearn impingement zone were twisted and the unistrut cable

tray support was significantly damaged. Several cable tray dividers and covers

were displaced. The licensee performed a 100 percent visualinspection of all

36 instrumentation and control cables which were associated with the turbine

control valves and stop valves. In addition, tests were performed prior to the

unit's restart to ensure that the valves retained their ability to perform their

design function. Additionally, visualinspections were conducted on all 480 volt ac

power cables. The licensee implemented a sampling methodology to determine the

electrical condition of the remaining cables in the affected cable trays.

Approximately 33 percent of the remaining cables were meggared with the primary

focus being that of the pump and fan motor loads. There were 56 cables in this

area, and no problems were identified. The licensee indicated that while these

j

cables were not safety related, they had been purche'ed to identical specifications

i

as that of other safety-related cables in the plant.

The licensee stated that all of the electricaljunction boxes in the " break-affected"

i

zone had been inspected for signs of moisture. A total of six junction boxes were

identified to have exhibited signs of moisture intrusion. (Five of these junction

boxes were in the " break-affected" zone.) The one affected junction box, which

was not in the damaged area, was immediately outside the control room. The

licensee postulated that this particular junction box had most likely been sprayed

down during the asbestos clean up of the turbine building. In addition, junction

)

boxes were spot checked throughout other areas of the turbine building (outside of

the break-affected zone) to ensure that moisture from the steam had not impacted

other areas. No additional electricaljunction boxes were identified as having been

impacted by moisture intrusion.

'

Pipe supports and equipment supports in the general area of the pipe rupture were

inspected and three supports were noted to have been damaged. All three of the

affected supports were on the fourth stage extraction steam line near the site of

the pipe ru.pture. All of the damaged supports were either repaired or replaced.

Additionally, it was noted that some damage had occurred to the turbine ,stop and

control valves. Specifically the drain lines for Stop Valve 1 and 2 were bent. Stop

Valves 1 and 2 and Control Valves 1 and 3 were in the direct path of the steam

impingement. These drain lines were heated and straightened, no replacement was

necessary. The solenoid valves and linear variable differential transformers were

inspected on these valves and no obvious damage was noted. However, these

components were replaced as a precautionary measure. Also, the servo valves on

'

Control Valves 1 and 3 were replaced and the limit switches on Stop Valves 1

and 2 were cleaned and inspected. The inspectors noted that the turbine stop

valve limit switches supply a turbine trip signal to the reactor protection system.

16

.

. .

.

_

_

-

_

_.

_

__

. . ..

_.___

.

.

,

!

!

c.

Conclusions

l

The team determined that the scope of the licensee's damage assessment was

!

reasonable and adequate. The observed damage was of a localized nature in the

immediate vicinity of the pipe rupture. No safety-related equipment or equipment

required for safe shutdown was damaged. The licensee indicated that future

additional followup inspections of certain important electrical components would be

conducted periodically following startup to ensure that corrosion due to potentially

undetected moisture would not affect the reliable operation of those components.

V. Manaaement Meetinas

X1

Public Meeting and Exit Meeting Summary

.

The licensee and NRC conducted a public meeting at the site on May 2,1997, to

j

discuss the licensee's root-cause analysis, damage assessment, self assessment,

and corrective action efforts. The team presented the inspection results to

members of licensee management at the conclusion of the inspection on June 10,

1997. _The licensee acknowledged the findings which were presented. The

Inspectors asked the licensee whether any of the materials examined during the

inspection should be considered proprietary. The licensee indicated that the details

associated with the CHECWORKS predictive methodology should be considered

proprietary. None of these details are contained in this report.

.

l

l

17

_

.

.

ATTACHMENT

SUPPLEMENTAL INFORMATION

PARTIAL LIST OF PERSONS CONTACTED

Licensee

R. Andrews, Manager-Nuclear Assessments

C. Br.unnert, Manager Ouality Assurance

J. Chase, Plant Manager

M.. Core, Manager System Engineering

S. Gambhir, Manager-Engineering and Operations Support

J. Gasper, Manager-Nuclear Projects

W. Gates, Vice-President of Nuclear Operations

B. Lisowyj, Station Engineering

E. Matzke, Station Licensing

R. Phelps, Manager-Station Engineering

R. Short, Manager-Operations

H. Sufick, Manager-Security

J. Tills, Manager-Nuclear Licensing

NRC

E. Merschoff, Regional Administrator

A. Howell, Director, Division of Reactor Safety

K. Brockman, Deputy Director, Division of Reactor Projects

D. Chamberlain, Deputy Director, Division of Reactor Safety

D. Graves, Project Engineer, Projects Branch B

R. Wharton, Project Manager, Office of Nuclear Reactor Regulation

INSPECTION PROCEDURES USED

49001

Inspection of Erosion / Corrosion Monitoring Programs

62706

Maintenance Rule

93702

Prompt Onsite Response to Events at Operating Power Reactors

ITEMS OPENED AND CLOSED

.

Opened

50-285/9709-01

IFl

Replacement of RMS-9 trip units (Section 01.1.1)

'

50-285/9709-02

NCV

Establishing required fire watches (Section 04.1)

1

_

,

. . . _

....

_-.---.

....

.-

- . _ . - . .

. . . . .

. - .

f

.

.

.

1

-2-

i

<

50-285/9709-03

APV

Failure to monitor the condition of plant piping systems and

l'

incorporate industry-wide operating experience in

accordance with 10 CFR 50.65 (Section M2.1)

50 285/9709-04

IFl

Adequacy of short- and long-term corrective actions

'

associated with the erosion / corrosion control program

(Section M7.1)

50-285/9709-05

IFl

Incorporation of industry-wide operating experience into

plant programs (Section M7.1)

Closed

50-285/9709-02

NCV

Establishing required fire watches (Section 04.1)

LIST OF DOCUMENTS REVIEWED

Procedures

Revision

Title

NOD-QP-21

6

" Operating Experience Review Program"

PED-gel-56

5

" Configuration Change Closeout"

l

QCP-200

11

" Certification Requirements For Quality Control Inspectors"

. OCP-331

6

" Ultrasonic Thickness Measurement for Erosion / Corrosion"

OCP-332

8

" Gridding Procedure for Erosion / Corrosion"

. SO-G-21

62

" Modification Control"

SS-PM-MX-0800

0

" Ultrasonic inspection of Station Pipe"

Modification Reauests

Title

FC-85-94

" Extraction Steam Elbows"

,

FC-80-102

"6th Stage Extraction Erosion"

2

-,

__

m _

_ . . ,

m,

_m.

- . _ . _ _ _ _ _ _ _ . _ _ _ . . _

. - . _ . . .

. _ ~ .

,

-\\

1

..

.

I

l

3

!..

-3-

l

i

Other Documents

i

,

l-

" Erosion / Corrosion Program Basic Document," Revision 7, dated February 1997

i

.

l-

" Erosion / Corrosion Control Program Technical Reference Manual," Volumes 1 and 2

l

" Omaha Public Power District CHECWORKS Database," Analysis Date: January 4,1995

l

,

" Maintenance Rule Program Plan," dated November 6,1996

)

i

Assessments

Root Cause'and Generic Implications Report, Revision 0, dated May 7,1997

.

i

Damage Assessment Report for the Break in the Extraction Steam Line, Revision 0, dated

)

May 3,1997

'!

Fort Calhoun Station-Erosion / Corrosion Assessment Report, Revision 0, dated May 2,

1997

I

Eauioment/ Examiner Certification

'

Omaha Public Power District, Fort Calhoun Station - For Erosion / Corrosion Examinations

Condition Reoorts

Creation Dato

J

l

199700529

May 05,1997

j

199700445

April 22,- 1997

. 199700129

January 31,1997

199601650

December 31,1996

199601649

December 31,1996

i

199601313

October 25,1996

)

i

.

3

t

-

-.

- ,

,

. . , ._ _. _ _ , -

,

.- .

, _ . .

--

--