ML18059A706

From kanterella
Jump to navigation Jump to search
Insp Rept 50-255/94-02 on 940110-0211.Violation Noted.Major Areas Inspected:Svc Water Sys
ML18059A706
Person / Time
Site: Palisades Entergy icon.png
Issue date: 03/04/1994
From: Burgess S, Wright G
NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION III)
To:
Shared Package
ML18059A705 List:
References
50-255-94-02, 50-255-94-2, NUDOCS 9403090039
Download: ML18059A706 (22)


See also: IR 05000255/1994002

Text

U. S. NUCLEAR REGULATORY COMMISSION

REGION II I

Report No. 50-255/94002(DRS)

Docket No. 50-255 .

License No. DPR-20

  • Licensee:

Consumers Power Company

212 West Michigan Avenue

Jackson, MI

49l01

Facility Name:

Palisades Nuclear Generating Plant

Inspection At:

Palisades Site, Covert, Michigan

Inspection Conducted:

January 10 through February 11, 1994

Inspection Team:

S. Burgess, Team Leader

J. Guzman

J. * Lennartz

R. Lerch

NRC Consultants:

M. Shlyamberg, Parameter, Inc.

  • Approved By:

Approved *By:

/~u-~-

\\s::JD. Burgess, Team Leader

Region III

)tc:,

I __k--**

G. c.~ief

Engineering Branch

Inspection Summary:

3-3-34

  • Date *

?fy/J/

Date

Inspection on January 10 through February 11; 1994 (Repoft No. 255/94002(DRS))

Service water system operational performance inspection (SWSOPI) in accordance

with NRC Temporary Instruction 2515/118.

Results:

The team .determined that Palisad~s' servi~e water and component cooli~g water

systems were operable based on the current low lake temperature.

However, the

systems' ability to fulfill their safety related function at elevated lake

water temperatures combined with other adverse design basis conditions is in

question pending the completion of an engineering analysis.

Because of the

significance and number of design iss.ues identified during the inspection, the

team concluded that engineering did not have a clear understanding of fhe

systems design.

One apparent violation with five examples was identified

regarding inadequate or no corrective actions taken to previously ~dentified

concerns.

Three unresolved items were identified related to the lack of

overpressure protection for CCW heat exchangers (Section 5.3), the engineering

analysis that would determine service water operability margin (Section 5.4),

and the past ESS pump operability based on the integration of IST reference

values and required system performance (Section 8.1).

9403090039 940304

PDR

ADOCK 05000255

G

PDR

TABLE OF CONTENTS

--*-

EXECUTIVE SUMMARY ................................................... .

1.0

INSPECTION SCOPE AND OBJECTIVES ................................ 2

2.0

LICENSEE ACTION ON PREVIOUS INSPECTION FINDINGS ................ 2

3.0

GENERIC LETTER 89-13 IMPLEMENTATION ............................ - 3

4.0

SYSTEM DESCRIPTION................................... . . . . . . . . . . 3

5.0

MECHANICAL DESIGN REVIEW ......................... ~.*............ 4

6.0

OPERATIONS ............ , ....... _................................. 9

7.0

MAINTENANCE . .- ........... -... -.. ; .. * ........... * .................... 11

8.0

SURVEILLANCE AND TESTING ..................................... * .. 12

9.0

QUALITY VERIFICATION AND CORRECTIVE ACTIONS .................... 14

UNRESOLVED ITEMS .................. ;.................... . . . . . . . . 15

EXIT M_EETING ... _ ............... * .. .-.......................... _ .... 15

10.0

11. 0

Appendix A - Personnel Contacted

Appendi~ B :- Generic Letter 89-13 Action* Items

-*

Executive Summary

During the period January 10 through February 11, 1994, a Region III

inspection team conducted a service water system operational performance

inspection (SWSOPI) at Palisades Nuclear Generating Facility.

The inspection

scope encompassed the service water (SW) and component cooling water (CCW)

systems.

For these systems, the inspection included a mechanical design

review;

d~tailed system walkdowns; review of system operation, maintenance;

  • and surveillance; and assessment of quality verification and corrective

actions requested by Generic Letter 89-13, "Service Water System Problems

Affecting Safety Related Equipment," as well as system unavailability.

The team determined that Palisades' SW and CCW systems were operable based on

the current low lake temperature.

However, the systems' ability,to fulfill

their safety related functio~ ~t elevated lake water temperatures combined.

with other adverse design basis conditions is in question pending the

completion of engineering analysis.

The team also identified the following:

(1)

Engineering lacked ari understanding of SW and CCW system design as*

evidenced by:

A previously identified; however unrecognized, single failure

vul*nerability results in the eventual failure of Engin~ered

Safeguards System pumps and loss of the required safety injection

function.

The use of SW as a backup source* of coo 1 i ng to the ESS pumps

during a LOCA condition results in draining CCW to the lake.

A potential water hammer in the SW system could potentially impact

containment integrity during a LOCA cond~tion.

The current IST program ~ould allow the SW.and CCW pumps to

degrade below minimum system f'ow requirements without being

(2)

An apparent violation with five examples was identified where inadequate

or no corrective actions were taken to address previously identified

concerns.

(3)

Self-assessment effectiveness was hindered by inadequate corrective

actibns and lack of management involvement .

-*

DETAILS

1.0

Inspection Scope and ~bjectives

Numerous problems identified at various operating plants in the country have

called into question the service water systems' (SWSs) ability to perform

their design function.

These problems have included:

inadequate heat removal

capability, biofouling, silting, single failure concerns, erosion, corrosion,

insufficient original design margi~, lapses in configuration control or

improper 10 CFR 50.59 safety evaluations; and inadequate testing.

NRC

management concluded that an in-depth examination of SWSs was warranted based

on the identified deficiencies.

The inspection team focused on the mechanical design, operational control,

maintenance, and surveillance of the SWS and evaluated aspects of the quality

assurance and corrective action program~ related to the SWS.

The inspection's

primary objectives were to:

assess SWS performance through an in-depth review of mechanical systems

functional design and thermal-hydraulic performance; operating,

maintenance, .and surveillance procedures and their impfomentation; and

operator training on the SWS,

verify that the SWS's functional designs and operational controls are

capable of meeting the thermal and hydraulic performance requirements

and that SWS components are.operated in a manner consistent with their

design bases,

assess the licensee's planned and completed action~ in response io

.Generic Letter 89-13, "Service Water System Problems Affecting Safety

Related Equipment," July 1989, and

assess SWS unavailability resulting from planned maintenance,

surv~illanc~, and component failures.

The areas reviewed and the concerns identified are described.in Sections *2.0

through 9,0 of this report.

Conclusions are provided after each section.

Personnel contacted and those who attended the exit meeting on February 11,

1994, are identified in Appendix A.

Details pertaining to Generic Letter (GL) 89-13 action items are attached as Appendix B.

2.0

Licensee Action on Previous Inspection Findings

(Open)

Unre~olved Item 50-255/92028-03CDRS):

Use of firewater to backup water

supply for auxiliary feedwater (AFW).

The NRC's concern was based on the lack

of an analysis or testing to verify the fire water system's capability to

provide backup water to*the AFW system.

The licensee committed to complete an

analysis to document the fire water system adequacy under action item request

(AIR) A-PAL-92-098.

This item is considered open .

2

3.0

Generic Letter 89-13 Implementation

The NRC issued GL 89-13, "Service Water System Problems Affecting Safety

Related Equipment," requesting that licensees take certain actions rel~ted to

their SWS.

These actions included establishing the appropriate frequencies

for testing and inspecting safety related heat exchangers over three operating

cycles to ensure the operability of SWSs that are credited for cooling safety

related equipment.

-

The team considered Palisades' response adequate in addressing GL 89-13

concerns.

See Appendix B for details pertaining to each GL 89-13 Action Item.

4.0

System Description

The safety related service water was co~prised of the SW ahd CCW system.

The SW system passes codling water to the following major s~fety related

components:

CCW heat exchangers' tube side that provided heat removal from the CCW

system,

containment .air coolers (CAC) that provided*containment heat removal,

engineered safeguards.system (ESS) room coolers that provided heat

removal from the equipment and piping housed in the ESS rooms, and

condensers for control rocim air conditioners.

The SWS is a once-through system that supplied cooling water to the heat

exchangers listed above and provided an emergency water source for the AFW and

backup to CCW system for ESS pump cooling.

The SWS also provide cooling for

the nonsafety related loads, which were automatically isolated d~ring accident

conditions.

The system consisted of common piping network with redundant

. components instead of the traditional "two independent trains." A limited

"train independence" was achieved by grouping the essential compc:rnents into*

two critical headers.

Critical headers A and B provided redundant cooling to th~ EOG jacket water

and lube oil coolers, ESS room air coolers, backup supply for the AFW and ESS

pump cooling and the nonsafety related plant air compressors.* C~itical header

A provided redundant cooling to the CCW heat exchangers, whereas critical

. header B provided redundant cooling to the CACs.

There were three SW pumps,

each rated for 8,000 gpm at 140 feet.

Depending on the accident event, one or.

two pumps were-required.

Also, there were two CCW heat exchangers and four

CACs.

The CCW system recirculated cooling water to the following major safety

related components:

3

CCW heat exchangers' shell side that provided the heat transfer to the

SW system,

shutdown cooling heat exchanger (SDCHX) that provided the decay heat

removal,

seal cooling and lubricaticin heat removal for the ESS and make-up pumps,

and

spent fuel pool (SFP) cooling.

  • CCW is a closed loop system that provided cooling water to the heat exchangers

listed above as well as nonsafety related loads.

The nonsafety related loads

located outside containment and the SFP cooling were automatically isolated

during the accident conditions. Similar to SW, CCW was also comprised of the

common piping network with redundant components instead of two independent

trains." However, unlike SWS, the essential components were not separated

into two critical headers,

There were three CCW pumps, each ~ated for 6,000

gp~ at 164 feet.

Only one pump was required to provide the safety related

flow in the event of an accident.

5.0 .

Mechanical Design Review

The mechanical design review of Palisades' SW and CCW systems included

determination of whether the systems' design bases, design assumptions,

calc~lations, analyses, boundary conditions, and models met licensin~

  • commitments and. regulatory requirements.

This review also included an

assessment of a single failure impact on the ability to perform required

safety function.

Al~o reviewed were the SW and CCW systems' capability to

meet the thermal and hydraulic performance specifications during accident or

abnormal conditions.

The team also reviewed the systems' seismic

qual.ification, design vulnerabilities, floodin~ mitigation characteristics,

a~d selected modification packages.

The significance and humber of design issues identifi~d during this

inspection, illustrated that not only was.the system design not clearly

understood but there also appeared to be no clear understanding of system

design responsibility betwe~n system and design engine~ring.

5 .1

Single Failure Vulnerabilities

Two potential new single active failures were identified for SW and CCW

configuration for supplying cooling water for seal coolirig and lubrication

heat removal for the ESS pumps.

The first failure could lead. to the loss of

all ESS pumps.

The second failure could lead to a complete loss of CCW during.

a LOCA.

.

5.Ll

Loss of all ESS Pumps

One possible scenario, which exemplified the first failure is a LOCA with a

loss of offsite power (LOOP) and a single. active failure of normally closed

4

isolation valves CV-0913 or CV-0950 to open on receipt of a safety injection

(SI) signal (See Figure 1).

The Palisades cooling sy~tems' desig~ relied on the operator initiated backup

of SW for ESS pump cooling.

However, SW could not provide backup pump cooling

for a LOCA/LOOP scenario because it required opening normally closed, air-to-

open, valves CV-0879 or CV-0880, and CV-0951.

This evolution required an

  • instrument air supply, which is nonsafety related and, hence, cannot be used

to mitigate the accident consequences.

The unavailability of instrument air

is further exacerbated by the fact that these valves do not have a safety

related air backup and do n6t have handles.

The failure to provide coolin9 water for ESS pump seal cooling and lubrication.

heat remova 1 could result in eventua 1 ESS pump fa i 1 ure, s i nee the pumps w*ere

not qualified to perform without cooling when they pump hot water from the

containment sump~ Ess*pump failures would lead to a loss of the required

safety injection and containment cooling functions.

Even if the failure was.

limited to the pump seals, such failure could lead to uncontrolled releas~

from containment.

This vulnerability was previously identified by the licensee's Safety System

Design Confirmation (SSDC) report on May 25, 1989; however, its s1gnificance

had not b~en recognized and no corrective actions were taken~ Failure to take

prompt corrective actions to this previously identified single failure

vulnerability is an example of an apparent violation of 10 CFR Part 50,

Appendix B, Criterion XVI .

5 .1. 2

Loss of CCW During a LOCA

One possible scenario, which exemplified the second failure is a LOCA without

LOOP and a single active failure of one normally closed isolation valve CV-

0913 or CV-0950 to open on rece'ipt of an SI signal (See Figure 1). *

In this ~cenario, *instrument a~r would be availabl~ for ppening normally

closed valves CV-0879 or CV-0880, and CV-0951 .. However, the control circuits

for isolation valves CV-0913 and CV-0950 have a *"seal-in" feature.

These

valves could not be reclosed during an SI actuation, until the SI signal was

reset. As discussed in Section 6.1, bperating procedures prohibited SWS and

CCW valves to and from the ESS pumps to be open at the same time.

Thus,

during this scenario the operator is faced with two following choices:

(1) do

not initiate the SW backup, which results in the loss of ESS pumps, or (2)

violate procedures and initiate the SW backup.

If SW backup cooling was initiated with an SI signal still in; opening valve

CV-0951 created a direct path for draining CCW to the lake, which would result

--*in the loss of shutdown cooling.

The current FSAR containment analysis

credited the use of shutdown cooling in all cases and, thus, relied ri~ CCW

availability .. The loss of shutdown cooling placed the required containment

cooling function outside of Palisades' current licensing bases .

5

5.2

Leak Testing Important SW Valves

The team questioned the Category B designation of SW non-critical ~eader

isolation valve, CV-1359, the SW containment return isolation valve, CV-0824,

and the SW containment supply isolation valve, CV-0827.

Category B meant that

seat leakage was inconsequential for fulfillment of the valves' safety

function.

The team determined that an evaluation should be made to determine

if a Category B designation was appropriate since valve leakage was

consequentiil, based 0n the following:

Test results and engineering evaluations were inconclusive and could not

be used to determine if the SWS would fulfill its safety related

function at elevated lake water temperatures as discussed in Section

5.4. Therefore, the leakage impact of valves CV-0824 and CV-1359 on. SW

system margin could not be presently determined.

As discussed in Section 5.5, leakage of valves CV-0824 and/or CV-0847

could result in a water hammer that had a potential to challenge

containment integrity during a LOCA.

Leakage of valve CV-0847 could lead to an.uncontrolled intr~as~ of the

post-accident maximu~ containment sump levels~

Deviation report (OR) O-PAL-93-272 initiated corrective actions to review the.

need to leak test valves CV-0824, CV-0847, and CV-1359.

the licensee's SW SSDC i~ehtified the importance of incorporating the SW: .

non-critical header isolation ~alve, CV-1359, into a leak~ge test* program on*

May 17, 1990.

The lic~nsee attempted to resolve this issue under action item

req~est (AIR) A-PAL-90-089 and subsequ~ntly under* E-PAL-90~002. However, an

evaluatiorr of leak testing CV-1359 was not completed and t~e issue was never

resolved.

Failure to provide prompt corrective actibns to incorporate SW

valve CV-1359 into a leakage test program is an example of an apparent

violation of 10 CFR Part 50, App~ndix B~ Criterioh XVI.

5.3

Lack of Overpressure Protection for CCW Heat Exchangers

The team identified the lack of overpressure protection for CCW heat

exchangers (HX)

E~54A and E54-B.

The concern involved overpressure due to

thermal expansion stemming from SW valve isolation.

Pali~ades' ASME Code of

record required each vessel to be protected from any conditions of pressure or

temperature that was in excess of design conditions specified in the certified

design specification.

The Code further required to document the degree of

overpressure protection in a summary technical report.

The licensee was

  • unable to retrieve the summary technical report that justified the lack of

overpressure protection prio~ to completion of thi~ inspection;

The licensee

co~~iftea t6.16~ate the report or~erform the technic~l analysis to show Code

compliance.

Pending the licensee's action to resolve the lack of overpressure protection

for the CCW HXs and the subsequent review by NRC, this is considered an

unresolved item (50-255/94002-01) .

6

.,

.--**

5.4

Operability Margin of SWS

The re5ults of tests, calculations and engin~ering evaluations were

inconclusi~e and could not be used to determine if the SWS would fulfill its

safety related function at elevated lake water temperatures combined with

other adverse design basis conditions.

The licensee concluded that the SW and CCW systems were currently operable

because current lake water temperatures were less than.50 °F.

This

temperature provided significant margin to account for all issues impacting

the SW operability margin;

The licensee co~mitted to resolve the following

issues, documented in DR D-PAL-93-272, by mid April 1994.

Neither test results or design basis calculations accounted for

instrument uncertainties.

The analyses that develop required flow rates to HXs served by the SWS

used only the original design fouling.

No calculations had been

performed to evaluate degraded HX performance resulting f~om fouling

beyond the original design value.

-

.

The most limiting system lineup may not have been tested.

The imp act of increased* SW temperatures and reduced 'SW fl ow rates on the

SW and CCW design pressures and temperatures and systems' operation wa*s

not evaluated.

The root cause of declining flow rates to control room. chillers VX-10

and vx~11 had not been determined.

.

As discussed iri Section 8.1, the SW pump IST reference values and pump

degradation was not coupled to the required system performance.

The elevated lake water temperature was not incorporated into the

maximum allowable SW system degradation. *

Pending the licensee's completion of all the actions impacting SWS margin

documented in DR O-PAL-93-272 and review _by the NRC, this is ~onsidered an

unresolved item (50-255/94002-02).

5.5

Potential Water Hammer Event

The team identified a potential water hammer in the SWS that could challenge

containment integrity during a LOCA condition.

One possible scenario that

could result in such an event ts a LOCA with LOOP, and the single active

failure of EOG 1-2.

Since EOG 1:2 powered the CAC fa~s, a~ operator would

close the SW CAC outlet isolation valve tV-082~ per Off Normal

Prti~edure (ONP)

6.1, "Loss of Service Water."

Since this valve was not leak tight, as

discussed in Section 5.2, it is possible, that an operator would close the CAC

inlet isolation valve CV-0847 to assure total CAC isolation. This isolation

could lead to a depressurization of SWS in containment and formation of air

pockets in the 16 inch containment penetrations since that was the SWS high

7

point in containment.

The cause of the depressurization could be preexistent

leaks in the CACs.

When po~er to the CAC fans was restored, an operator would

try to restore water flow to the CACs in order to maximize contatnment

cooling.

Air pockets in the containment penetration would cause a water

hammer.

The licensee agreed with the team's water hammer concern and committed to

provide procedural guidance to eliminate the inadvertent restoration of the

containment SW header that may cause a water hammer.

The licensee failed.to

identify this SWS water hammer susceptibility in their prior review.

The team

considered this an example where the system d~si~n was not clearly understood.

5.6

Use of SW as Alternative Source ~f Cooling for SDCHXs

The licensee was unable to determine the basis for the use of SW as an

alternate source of cooling for the SDCHXs.

Off Normal Procedure (ONP) 17,

"Loss of Shutdown Cooling," Revision 16, required the* alignment of SW to the

SDCHXs in the event CCW supply to the HXs was lost. Since the alternate

supply was estimated to yield only 250 gpm of service water, the effectiveness

of this cooling was questionable. Also, the combination of this small flow

rate and SW pressures being lower then CCW could lead to a potential for vapor

locking of .sw backup cooling for ESS *pumps. *

Since the licensee could not determine why the evol.ution was incorporated into

pl ant' procedures, they committed to evaluate the need and safety of this event

miti~ati-0n strategy..

5.7

Bent Instrument Tubing*

Instrument tubing routed in front of the CCW HXs was bent ~nd had the

appearance of being repeatedly stepped on.

Likewise, the unistrut supports

for the instrument lines were bent.

The team questioned if this configuration

was analyzed and met the seismic support requirements.

The licensee's review

determined that the stresses in the tubing met the allowable values for

operability, but were in excess of the FSAR Section 5.7 committed stress

values based on the tubing specification.

The licensee identified th~ bent tubing on Januaty 4, 1994, with tag# 12553.

Corrective actions on the tag indicated "r.epafr or replace."

The licensee

failed to appropriately question the seismicity of the condition until asked

by the team on January 27, 1994.

Failure to take prompt corrective actions to

address the instrument tubing and unistrut support seismicity is an example of

an apparent violation of 10 CFR Part 50, Appendix B, Criterion XVI.

.5.8

Lack of Isolation of Plant .Air Compressors from SW

Crinirary to the description provided in Section 9.1 of Palisades' FSAR the

nonsafety related air compressors were not automatically isolated from the

critical portion of SW.

The licensee committed to correct this FSAR

discrepancy during the next FSAR revision .

8 ..

. ..

.-.-.

5.9

Conclusions

The significance and number of design issues identified during this

inspection, illustrated that not only was the system design not clearly

understood but there also appeared to be no clear understanding of system

design responsibility between system and design engineering.

Signiffcant

issues included unidentified and/or unrecognized single active failures,

valves with critical shutoff functions were not leak tested, and the SW and

CCW .systems' ability to fulfill their safety related function at the elevated

lake water temperatures was pending the completion of engineering analysis.

6.0

Operations

The team reviewed plant operations to assess operator knowledge and the

accuracy and completeness of procedures and training with regard to the SW and

CCW systems.

The team performed system walkdowns; reviewed procedures for

normal, abnormal, and emergency .conditions; assessed conduct of operations in

the field and control room; and evaluated training manuals, .lesson plans, and

operator actions on simulated SWS/CCW malfunctions.

Overall the team determined that operator response to the simulated SWS

malfu~ctions and the crew's knowledge of SWS operation and SWS role in

accident mitigation were ~dequate.

6 .1

Operation Scenarios

The first scenario required the crew to isolate SWS crjtical .header A tri stop

a leak.

Header A provided cooling to both CCW HXs; therefore, CCW was

inoperable.

The ESS pumps were running due to an SI s1gnal and were needed to

provide cooling to the feactor core.

Operator actions_~enerated the following

concerns:

The crew identified the loss of CCW with the resultant loss of cooling

to the ESS pumps; however, CCW system design ~equired the crew to

violate procedural guidance to maintain cooling to the ESS pumps with

SWS.

Procedure violations resulted in draining CCW to Lake Michigan

with a resultant loss of shutdown ~ooling cap~bilities.

The crew attempted to close the inlet and outlet CCW valves (CV-0913 an~

CV-0950) to the ESS pumps, and without verifying valve response, opened

SWS valves_(CV~0879 or CV-0880, and CV-0951) to the ESS pumps.

The CCW

valves d{d not close due to a sealed in open signal received from the SI

signal that was still active. This resulted in draining the CCW system

to Lake Michigan via th~ SWS.

The CCW surge tank low level annunciator

energized and the crew responded by securing CCW pumps but failed to

-diagnose that the loss of. CCW was .due to the valve manipulations just

performed.

After the scenarip was terminated the crew recognized that

the CCW valves did not close even though the handswitches were in the

close position.

The crew then recognized that the CCW valves could not

be closed until the SI signal was reset .

9

6.2

Station Operating Procedures (SOP) 16, "Component Cooling Water System,"

Revision 11, section 5.0, and SOP 15 section 4.0, contained requirements

that SWS and CCW valves to and from the ESS pumps shall not be open at

the same time.

These procedure sections were not followed by the crew

during the scenario.

However, given the same scenario circumstances and

khowing the valve manipulation precautions and limitations, the crew

indicated that they would again violate the procedure because cooling to

the ESS pumps was essential to operate the pumps so cooling to the

reactor core could be maintained.

The crew then indicated that the

expected loss of CCW would result in a loss of cooling to the SDCHXs,

which would preclude shutdown cooling system operation.

The SWS critical header A leak, which was located in the CCW pump room,

was not isolated until 30 minutes after the event was identified by the

crew.

This created the potential for flooding the CCW pump room.

Because procedure ONP 6.1, "Loss of Service Water," Revision 5, di.d not

contain any specific guidance to isolate the leak, operator aid (OA) 136

was used to determine which valves should be closed to determine leik

location.

QA .136 was a SWS simplified schematic that was attached to

the control panel. Although the crew successfully isolated the SWS

leak, identified leak location, and determined the impact on plant

operation*, the team considered the delay to.coniplete leak isolation

actions a weakness.

Operations Procedures

The team identified the following weaknesses in the licensee's operating

procedures:

SOP 16, steps 5.1.2 and 7.6 prevented initiation of backup cooling from

the SWS to the ESS pumps if normal cooling from CCW was lost concurrent

with an SI signal.

Procedure compliance would prohibit opening the SWS

valves to the ESS pumps with the CCW valves open.

The CCW valves would

remain open until the SI signal could be reset. Current procedur*a1

compliance results in loss of cooling water to the ESS pumps ..

The licensee indicated that the procedure would be revised to allow

opening the SWS.valves to the ESS pumps if the CCW valves were open and

an SI signal was present. A CAUTION preceding step 7.6 would also be

added to a 1 ert the operator that CCW would drain to Lake Mi chi gan w_ith a

resultant loss of CCW system functions, if SWS cooling to the ESS pumps

was aligned with either CCW valve open.

SOP 15, "Service Water System," Revision 7, step 4.1.2 contained a

similar statement as described above .. The licensee indicated that this

procedure would also be revised.

-

Annu.nciator Response Procedure (ARP) 7, window 29, "Service Water Bay Lo

Level," did not provide guidance regarding what level SW pumps should be

tripped if SW bay level was decreasing.

This item was previously

identified during the licensee's SSDC conducted in May 1990.

The

10

licensee indicated that the procedure would be revised to provide

clearer direction on when to.trip the SW pumps based on basin level and

other control room and local indications.

ONP 6.1, Revision 5, Attachment 1, "Alternate Method of Supplying the

Intake Structure," required tripping the SW pumps if warm water

recirculation pump (P-5) was used to supply water to the intake

structure. This did not coincide with SOP-14, "Circulating Water and

Chlorination Systems, Revision 16, step 7.13.1, which provided stepi to

supply the intake structure from P-5 but did not require tripping the SW

pumps.

The licensee indicated that guidance for tripping the SW pumps would be

incorporated into the appropriate ARP and removed from ONP 6.1,

Attachment 1.

No revisions to SOP 14 were deemed necessary.

The team considered a 11 the proposed procedur_e changes acceptable.

6.3

Operations Training

Overall, the team determined that operations training was

adeq~ate with one

exception.

The CCW system design feature of a sealed in open signal from an

SI signal to CCW valves CV-0913 and CV-0950 was not identified in the training.

lesson plans.

As demonstrated during the simulator scenarios, this design

feature could cause serious complications with event mitigation strategies _and

should be included in the training material .

An operations representative, assigned to the training staff during simulator_

training, provided operational based input to the training session when

responding to "in plant" actions.

The individual was a licensed Nuclear

Control Operator, licensed AO, or non-licensed AO and received training as a

simulator operator.

This practice added realism to the training and was

considered a strength.

6.4

Conclusions

Operator tesponse to the s~mulated SWS malfunctions and the crew's knowledge

of SWS operation and SWS role in accident mitigation wer~ adequate.

However,

it was not recognized that the use of SWS as- a backup source of cooling to the

ESS pumps during a tOCA condition could result in draining CCW to the lake,

7.0

Maintenance

The team reviewed maintenance procedures, work history, completed work request

-packages,-.. LERs, DRs, preventive maintenance (PM) tasks for selected

components, performed detailed system walkdowns and observed _selected

maintenance activities to determine if the SW and CCW components and.piping_

were adequately maintained and system equipment that required frequent -

maintenance was identified.

The team also evaluated implementation of GL 89-

13 commitments in the maintenance area .

11

Overall, the team concluded that maintenance performed on SW and CCW

components was effectively accomplished and that maintenance problems were

properly addressed and, where necessary, corrected.

7 .1

Scaffolding

lhe team identified non-seismically conitructed scaffolding, installed in the

west safeguards room over safety-related equipment.

The licensee performed an

engineering analysis, which concluded that the scaffolding did not meet the

requirements of procedure MSM-M-43, "Scaffolding," Revision 0, but was not a

safety concern.

The licensee removed the scaffolding and initiated a revision

to MSM-M-43 that provided additional instructions for scaffolding in safety

telated areas.

The revision would include walkdown inspections, supervisor

sign~off for installation, clarification of requir.ements, and approval and

justification by the system or assigned engineer for deviations from the

procedure.

The team considered this action acceptable. *

7.2

Containment Spray Pump Ground Strap

The team identified that a ground strap was not connected on a recently

replaced containment spray pump motor.

DR D-PAL-94-017 evaluated the problem

and concluded that the work package instructions lacked* the detail necessary

to ensure the ground strap connection.

The package al~o contained other .minor

discrepancies as well.

The licensee connected the ground strap and was

developing corrective actions for the other minor deficiencies .. The ~earn

considered this action acceptable .

'

7.3

SWS Instrument Lines Maintenance

.The team found that the licensee had not full~ evaluated the susceptibility of

SWS instiument line fouling.

Specific flushing requirements had only been

implemented for instruments that had been clogged i~ the past; however,

walkdowns of SWS pump discharge lines found that. instrument lines to pressure

switches for standby pump starting had long stagnant horizontal runs that

might be subject to fouling.

These lines were not checked by periodic

maintenance or surveillance. Also omitted were stagnant lines to and from the

former control room air conditioners; This was not consistent with the GL

intent, which recommended licensees establish routine maintenance rif SWS

piping and components to ensure that silting and biofouling could not degrade

system performance.

The licensee committed to review the maintenance of these

and other instrument lines.

7.4

Conclusions

Overall, the. team concluded that maintenance performed on SW and CCW

components was effecti~ely accomplished.

Weaknesses were identified in the

scope of instrument lines in the GL flushing program, scaffolding installed in

safety related areas, and incomplete maintenance on a containment spray pump.

8.0

Surveillance and Testing

The team reviewed preoperational test procedures, surveillance procedures, and

12

the licensee's inservice test (IST) program and implementing procedurei to

determine if sufficient testing had been conducted to confirm system design

requirements and system operability.

Overall the team determined that the IST program was adequate.

However,

concerns with the SWS pump testing were identified.

8 .1

Uncertainty in IST Pump Acceptance Criteria

DR D-PAL-93-272 identified that the IST acceptance criteria for allowed pump

degradation for all ESS pumps were inadequately tied to the systems' accident

analysis flow rates and differential pressures. Although the acceptance

criteria for the pumps was based on ASME Section XI code limits, the design

requirements for the pumps may be more limiting.

The licensee'~ preliminary

operability assessment indicated that currently all ESS pumps could deliver

the required design.flows.

The team agreed with .the preliminary analysis .

. The SW pump IST reference values and the allowed pump degradation was also

inadequately tied to the required system functional performance.

The allowed

degradation for the SWS pumps did not conside.r that the SW system flow *

balancing tests may have imposed additional restrictions on flow degradation.

This created the potential for the SW pumps to be allowed to degrade below

minimum system flow requirements without being declared inoperable.

On May 4, 1990, the licen~ee's SW SSDC identified that the SW IST pump

reference values were not coupled to the SW flow bal~ncing test.* However, the

licensee fafled to recognize the issues' significan'ce and took no corrective

actions.

Failure to take prompt correctiv~ actions to previously identified*

deficiencies is an example of an apparent violation of 10 CFR Part 50,

Appendix B,. Criterio'n XVI.

Corrective actions in response to DR D-PAL-93-272 will couple the deveiopment

of SWS pump testing reference values and required system performance.

Additionally, the licensee intended to review the basis fo~ IST reference

values and allowed degradation for all Section XI pump t~sts to ensure that

they were adequately coordinated with safety analysis performance criteria.

This issue is considered an unresolved item pending the* licensee's review to

determine impact on the IST reference values a~d the possible effect on past

ESS pump operability ( 50-255/94002-.03).

8.2 *

  • System Testing Deficiencies

SWS test T-216, "Service Water Flow Verification," Revision 4, balanced'flow

.to the CCW HXs at or very near their required flow rates,and did not allow for

pump degradation.

This concern was identified in the SWS SSDC on May 4, 1990.

The licensee dispositioned the issue by stating that n~ margin in flow rates

  • to the CCW HXs was on the operations concern list" with no further corrective

actions taken.

Failure to take prompt corrective actions to previously

identified deficiencies is an example of an apparent violation of 10 CFR Part

50, Appendix B, Criterion XVI .

13

  • 8.3

Conclusions

Although the IST program was adequate, concerns with the SWS pump testing were

identified.

Concerns included allowable IST pump degradation criteria that

was not compared to design requirements that may be more limiting and SW flow

balance testing that did not include flow margins for allowed SW pump

degradation.

9.0

Quality Verification and Corrective Actions

The team reviewed SW and CCW systems and GL 89-13 program implementation

assessments, technical audits, corrective action tracking system to ensure

adequate treatment of related items, and SW and CCW system operational history_

to assess the adequacy of root ca~se analysis ..

Three documents were considered to be "se l f-as.sessments":

the 1990 SWS and

1989 CCW SSDCs, a SWS testing assessment completed December l, 1993, and .an

Nuclear Performance Assessment Department (NPAD) assessment of SW completed

January 12, 1994.

9 .1

SWS and CCW SSDC

The SSDCs were effective in identifying credible design concerns; however,

inadequate corrective actions resulted in the similar concerns during this.

inspection.

Previously identified conce~ns included:

the single failure that.

resulted in the loss of all fSS pumps, not leak-testing the SW non-critical

header isolation valve, uncertainty in IST pump acceptance criteria, and

system testing defi.ciencies.

Because the SSDC concerns were issued ~s low priority action item requests

(AIR), management's involvement and knowledge in the issues was minimal.

Management became aware of concerns if elevated to a DR.

9.2

SW Testing Assessment

The SW testing assessment identified numerous deficiencies that resulted in

questioning the SWS ability to perform its function at elevated lake

temperatures.

As discussed in Section *s.4, the licensee issued DR

D-PAL-93-272, which will address the SW margin issues.

This assessment again identified many of the same issues from the SSDCs. *Most

si~nificant was the determination that the disconnect between analysis inputs

and the system functional requirements questioned the operability of all

Section XI pumps, as discussed in Section 8.1.

9.3

NPAD SW and GL 89-13 Assessment

The NPAD SW assessment was considered to be an improvement from previous

assessments.

Technical engineering issues were identified;* however,

significant issues such as the single failure vulnerabilities or the water

hammer susceptibility were npt identified. The assessment only reviewed the

14

---~

plant's compliance with the GL 89-13 response to the NRC in lieu of addressing

program adequacy in meeting the GL requirements.

The assessment also did not identify the broader issues of the lack of system

design understanding and the "gray" responsibility issues when it came to

system design basis.

9.4

Conclusions

While organizations conducted effec;tive audits on the SW and CCW systems,

inadequate corrective actions and the lack of management's knowledge of the

issues hindered the effectiveness of the self-assessments.

The NPAD

assessment, although improvedl lacked the broad perspective on engineering's

design knowledge.

10.0

Unresolved Items

An unresolved item is a matter requiring more information in order to

ascertain whether it is an acceptable item, a violation, or a deviation.

Unresolved ite~s are identified in Sections 5.3, 5.4, and 8.1.

11.0

Exit Int~r~iew

The team conducted an exit meeting on February 11, 1994, at Palisades Nuclear

Generating Plant to discuss the major a~eas reviewed during the inspection,

. the strengths and weaknesses observed, and the inspection results.

License.e

representatives and NRC personnel in ~ttendance at this exit meeti.ng are

documented in Appendix A.

The team also discussed t~e inspection report's

likely informational content with regard to documents reviewed by the team

during the inspection.

The licensee did not identify any documents* or

processes as proprietary.

--

15

TO LAKE

TO CCW PUMP

SUCTION

CV-0950

. "'

CV-0951

LPSI

CONT

SPRAY

CONT

SPRAY

HPSI

LPSI

CON.T

SPRAY

HPSI

FROM CCW

HEAT EXCHANGERS

CV-0913

CV-0947

CV-0949

CV-0948

FIGURE 1 - COMPONENT COOLING. WATER SYSTEM

CV-0879

CV-0880

SERVICE WATER

BACKUP

APPENDIX A

Consumers Power Company

D. Joos, Senior Vice President, Nuclear

W. Binnington, System Engineer

.J. Blewett, Project Engineer, Configuration Control Program (CCP)

K. Chao, Staff Engineer, Nuclear Performance Assessment Department (NPAD)

D~ Crabtree, Senior Engineer

T. Duffy, Supervisor, Safety Analysis

H. Esch, Adminiitrative Manager

O. Fitzgibbon, Operations Specialist (NPAD)

G. Freeman, Operations

R. Frisch, Outage Planning & Scheduling

  • D. Galle, Sargent &Lundy

. R. Gerling, Man~ger, Reactor & Safety Analysis

P. Gire, Supervisor, Engineering Safeguards Systems

J. Griggs, Director,* Human Resource

B. Harshe, Supervisor, Configuration Control

D. Hoffman, Vice President, Nucl~ar Operations

R. Jenkins, Supervisor, Civil/Structural Engineering

R. Kasper, Manager, Maintenance

D. Malone, Acting Manager, RSD

T. Marz, Engineer

..

R. Mccaleb, Performance Specialist.

R .. Orosz, Manager, Nuclear Engineering & Construction

K. Osborne, Manager, Systems Engineer

T. Palmisano, Manager, Operations & Outage Planning

E. Pearstein, Sargent & Lundy

J. Pomaranski, Manager, Project Management Construction & Testing

R. Rice, Manager, NPAD.

-W. Roberts, Licensing Engineer

D. Rogers,

Dire~tor, Safety & Licensing

G. Slade, General .Manager, Palisades

D. Smedley, Staff Licensing Engineer

G. Szczotka, Assessment Coordinator, NPAD

R. Vincent, Manager, Plant Safety Engineering

U.S. Nuclear Regulatory Commission

J. Martin, RIII Administrator

S. Burgess, Team Leader

G. Grant, Director, Division of Reactor Safety

J. Guzman, Reactor Inspector

J. Lennartz, Reactor Engineer.

L. Miller, Branch Chief, Division of Reactor Projects

D. Passehl, Resident Inspector, Palisades

M. Shlyamberg, Consultant

APPENDIX B

Generic Letter 89-13 Action Items

I.

Biofouling C6ntrol and Surveillance Techniques

Action I of GL 89-13 requested that licensees implement and maintain an

ongoing program of surveillance and control techniques to significantly reduce

the incidence of flow blockage problems as a result of befalling.

The actfon

requ~sted included intake structure inspections, chemical treatment of service

water systems, and periodic service water system flushing/flow testing.

The team reviewed the actions taken by the licensee to address the GL request.

Jntake structure and service water bay inspections were conducted each

refueling outage using Periodic and Predetermined Activity Controls (PPACs).

PPAC SWS-091, Inspection of SWS Pump Intake Bay and.Mixing Basin inspected

for sediment buildup, asiatic clams, zebra mussels -and collected sa~ples of

silt/sediment for analysis.

At the time of their in~tial response to GL 89-

13, the licensee had an established program of SWS chlorination to mitigate

the effects .of b~ological fou)ing.

Since the original response the plant has

experienced the spread -0f zebra mussels into their intake ~tru~ture. To

address this, the SW system was treated periodically with a molluscicide for

Zebra Mussel control. Also, the plant's discharge permit was modified to

allow continuous .chlorination. Additionally, SW system corrosion coupons were

evaluated 6n a regular basis to monito~ the chemical treat~ents affects on

corrosion rates.

The SWS treatments appeared to be effective.

The team found

no c6ncerns with the intake structure inspection and chemical treatment of the

SW system.

In their initial response to GL 89-13 the licensee identified fo~r p1p1ng

sections where possible pipe fouling could take place due to infrequent use:

SW cross ties with fire water, CCW, AFW, and SW supply tri VC-10 and VC-11.

Additionally, the licens~e initially committed to evaluat~ modifiing the

piping to permit periodic flushing of the SW/CCW and SW/AFW cross-ties without

exceeding discharge limits. All four piping sections were initially inspected

and flushed.

After the tests, the licensee withdrew their commitment to

modify piping based on the test results. The SW to fire water cross-ties would

be tested for unrestricted flow every refueling outage and the SW supply lines

to VC-10 and VC-11 would be flushed every 12 months under PPAC X~OPS471.

Based on a test result review, the team considered the current flushing and

flow testing of infrequently used piping to be _adequate.

II.

Monitoring Safety Related Heat Exchanger Performance

Action II of GL 8~-13 requested that licensees implemenf a*test program to

periodically verify the heat transfer capability of all safety* related heat

exchangers cooled by the SWS.

The test program should consist of an initial

test program and a periodic retest program.

Palisades' test program consisted in some cases of both inspecting/cleaning

and performance testing of safety related heat exchangers.

Performance

testing was limited to the CCW heat exchangers since testing the CACs and ESS

room coolers was unsuccessful and did not yield meaningful results.

Inspection/cleaning was conducted on all heat exchangers except the east ESS

room coolers, which will be conducted during the next refueling outage .

lhe performance testing portion of this program was flawed with technical and

.instrumentation errors and exhibited a lack of preplanning and understanding

of the instrumentation accuracy's limitations and its impact on test results.

Neither test results or design basis calculations accounted for the instrument

uncertainties. This condition was further exacerbated by a lack of definitive

values for the minimum required design flows.

Since all the safety related heat exchangers were included in the inspection

  • program the team concluded that the licensee's response to GL 89-13, Action II.

was adequate.

With the revision to improve*CCW heat exchanger performance

test's reliability and with continued implementation of inspection, cleaning

and periodic mainten~nce of safety related heat exchangefs, the GL intent will

be met.

III.

Routine Inspection and Maintenance

Action Ill of GL 89-13 requested that licensees implement a routine inspection

and maintenance program for open-cycle SWS piping and components.

This

program should ensure that corrosion, erosion, protective coating failure,

silting, and biofouling cannot'degr~de the performance of the safety related

systems supplied by the SWS.

The GL inspection and cleaning program was accomplished by use of PPACs.

The

PPACs proceduralized the visual inspection of each heat exchanger pnd provided

for the chemical analysis of scraped samples from within the heat exchangers

for biofouling, MIC, scaling and chemical deposition.

Overall, the team considered the SW PM implementation p~ogram in response to

GL 89-13 effective.

As discussed in Section 7.3, the licensee planned to

review ~ll *instrument and stagnant lines for possible inclusion in the flush

program.

IV.

Design Function Verification and Si~qle Failure Analysis

Action IV of GL 89-13 requested that licensees confirm that the SW and CCW

systems will perform their intended function in accordance with the licensing

basis for the plant. This confirmation should include a review of the ability

to perform required safety functions .in the event of a single active component

failure.

The team reviewed the SW and CCW

sy~tems' ability to perform theit intended

function in accordance with the lic~nsing basis for the plant.

The review

included system configuration, flood and tornado protection, sei~mi~ design,

emergency power supply, and functional logic evaluation. Specific

consideration was given to identify failure of any single component that cou.ld

potentially affect the performance of safety related systems served by either

SW and CCW .

2

3

The team determined that Palisades' SW and CCW systems were Operable ba~ed -0n

the current low lake temperature.

However, the systems' ability to fulfill

their safety related function at elevated lake water temperatures combined

with other adverse design basis conditions is pending the completion of

engineering analysis. This issue is discussed further in Section 5.4.

As identified in Section 5.1, two potential new single active failures were

identified for SW and CCW configuration fo~ supplying cooling water for seal

cooling and lubricatiori heat removal for the ESS pumps.

The first failure

could lead to the loss of.all* ESS pumps.

The second failure could lead to a

c6mplete loss of CCW during a LOCA.

. ,

V.

Training

Action V of GL 89-13 requested that licensees confirm that maintenance

practices, operating and emergency procedures, and training that involves the

SW and CCW systems wer~ adequate to ens~re that safety related equipment

cooled by the SW system will function as intended and that operators of this

equipment will perform effectively.

Based on *the team's review of maintenance practices, operating and emergency*

procedures, and training documentation, the team concluded that overall,

Action V was adequately a~complished. One weakness was noted in the l~ck of

training on the sealed in open signal from an SI signal -to the CCW supply and

discharge valves to the ESS pumps.

This*~S further discuss~d in Section 6.3 .