ML20133K488

From kanterella
Jump to navigation Jump to search
Rev 3 to Findings,Corrective Actions & Generic Implications Rept, Toledo Edison - Main Steam Header Pressure
ML20133K488
Person / Time
Site: Davis Besse Cleveland Electric icon.png
Issue date: 10/03/1985
From: Huston L, Moisidis N
CYGNA ENERGY SERVICES, TOLEDO EDISON CO.
To:
Shared Package
ML20133K483 List:
References
PROC-851003, NUDOCS 8510220040
Download: ML20133K488 (45)


Text

P -

FINDINGS, CORRECTIVE ACTIONS AND GENERIC IMPI.ICATIONS REPORT

~

Title. Toledo Edison - Main Steam Header Pressure Report By: Larry Huston (TED) Plan No. 16 Nick Moisidis (CYGNA) PAGE 1 of 42 i

e WRITTEN APPROVED REV DATE REASON FOR REVISION BY BY 0 8/27/85 Initial Issue N. Moisidis L. Huston L. Grime 1 8/30/85 Incorporate Sections VI, VII 3. Moisidis and VIII and Revised Plan L.'Huston L. Grime O additienal Actions c nd E 2 9/6/85 Additional Findings & Trouble- N. Moisidis D. Mominee shooting Results Incorporated L. Huston 3 10/3/85

_ b '

Additional Findings & Trouble-shooting Results Incorporated N. Moisidis L. Huston J Am_$

/J / l

(.y - _a i.

t r

I l

I 8510220040 851016 I PDR ADOCK 05000346 i P PDR O t

TABLE OF CONTENTS I. ISSUE / CONCERN 3 II. BASIC PRINCIPLE OF OPERATION 6 III.

SUMMARY

OF TROUBLESHOOTING AND INVESTIGATION 9 A. Field Actions Performed 10 B. Analysis Performed 15 C'. Significance of Findings 23 IV. RESULTS/ CONCLUSION OF FINDINGS 28 3 A. Direct Causes 28 B. Root Causes 31 C. Disapproved Hypotheses 31 D. New Hypotheses 31 V. PLANNED ADDITIONAL ACTIONS 32 VI. TECHNICAL JUSTIFICATION OF FINDINGS 35 VII. SPECIFIC CORRECTIVE ACTIONS 38 VIII. GENERIC IMPLICATIONS 40 FIGURE.1 - Simplified Schematic of Module 4-3-4 42

\

s i

O s

O I. ISSUE / CONCERN U

Following the plant trip on June 9,1985, there were several periods during which steam header pressure dropped below the expected control pressure of either the atmospheric vent valves (AWs) or the main steam safety valves (MSSVs). At one point the pressure de-creased by approximately 150 psi on Steam Generator one (SG-1) header. Such a large pressure swing is unexpected. More impor-

. tant, if pressure swings were the result of equipment malfunctions that could cause depressurization of the steam generators, they could cause a trip of the main feedwater pumps (MFPs) followed by a loss of steam generator inventory and potentially loss of the ability to drive the steam-driven auxiliary feedwater pumps (AFPs).

O Q

An examination of the plant instrument pressure plots for both steam headers following the June 9th event revealed five instances when pressure decreased in an unexpected fashion. These are described below:

A. Issue No. 1:

During the period between 1:41:11 and 1:41:25, pressure in the header from SG-1 dropped from 942.4 psig to 924.5 psig while pressure in the header from Steam Generator two (SG-2) dropped from 1001.0 psig to 973.2 psig.

O 4

d

r.

7 i

. . . ..; j J

() B. Issue No. 2:

During the period between 1:50:13 and 1:51:55, pressure in the header from SG-1 dropped from 934.7 psig to 749.6 psig.

C. Issue No. 3:

During the period between 1:36:09 and 1:38:54, pressure in the header from SG-2 dropped from 994.6 psig to 960.3 psig.

D. Issue No. 4:

Q LJ During the period between 1:48:44 and 1:49:27, pressure in the header from SG-2 dropped from 980.0 psig to 927.5 psig.

E. Issue No. 5:

The steam pressure trends in SG-1 between 1:48:33 and 1:50:13 and in SG-2 between 1:46:43 and 1:48:44 are considered abnormal.

F. Other Concerns:

Examination of the pressure plots for both steam headers also revealed several instances in which the MSSVs did not operate as expected. In some cases, the indicated pressure at which O

g__

the valves opened was as much as 3.7% below the expected set

("'}

%s pressure. Specifications for new valves call for a 1% tolerance t

on set presssre. In other cases, the steam pressure data

{

indicate that blowdown following valve opening was possibly as little as 1.5% of the opening pressure. The expected blowdown is 3%. Finally, there were some rapid pressure oscillations in l SG-2 header subsequent to MSSV closure. In all instances, i

the MSSVs performed their required function in that they limited steam pressure to below 105% of system design pressure, and in all cases the MSSVs were reclosed. In no case were these 3 anomalies a cause of uncontrolled steam generator depressuriza-tion. Therefore, they were not potential threats to the operation of the main or auxiliary feedwater pumps. These

/) unexpected trends are being investigated, and their significance N-// l to long-term operation will be assessed.

5 It was also noted that AVV-2 only came partially open at about i

1:39 when the pressure in SG-2 header increased to the AVV }

pressure control setpoint. Temperature data from the AVV exhaust indicate the AVV did open but not fully as would be >

expected since the header pressure ultimately increased to 3 s

approximately 1015 psig and caused the MSSVs to open. AVV-2 l did opera'te properly under automatic control later during the recovery from the reactor trip.

6

, 4

\J t h

t t

..-r

~-ev - , , . , .

h

%J II. BASIC PRINCIPLE OF OPERATION The basic purpose of the main. steam system is to direct the steam produced by the once through steam generators to the turbine through the main steam piping. Steam produced in the steam generators removes heat from the reactor coolant system.

The main steam lines can be isolated (except for steam inlets to the auxiliary feedwater pump turbines) by closing the main steam isola-tion valves (MSIVs).

Following a turbine trip and closure of the MSIVs, eighteen spring loaded safety valves (nine per steam generator) will relieve steam to the Atmosphere if steam pressure exceeds their setpoints. These valves are passive in that no automatic control functions nor operator actions are required for the valves to release steam and prevent overpressurization of the main steam system. The first bank of MSSVs is set to open at 1050 psig. Additional safety valve banks are set to open at pressures up to 1100 psig. The pressure relief capacity is such that the energy generated at the reactor high-power-level trip setting can be dissipated through this system.

The steam bypass system automatically controls the steam supplied to the condenser during startup while the turbine is being brought into service. It also provides the capability of automatically dumping 3 steam to the condenser during minor steam transients at any power level. _ Control signals for automatic operation of the bypass system

7s

( ) are provided by the Integrated Control System (ICS). The system may v

also be controlled by the operator and used to manually dump steam 3 at any load level. The steam bypass system includes the turbine bypass valves and one AVV on each steam generator header.

Following a turbine trip or MSIV closure, header pressure control is maintained by modulation of either the AVVs if the MSIVs are closed or the turbine bypass valves if the MSIVs are open. The AVVs relieve to the atmosphere and the turbine bypass valves relieve to the condenser.

The ICS is a combination of electric and electronically-operated devices designed to produce process variable outputs in accordance m

with desired or set point conditions. The system includes the (v) following major components:

  • Measuring element and signal conversion means
  • Hand-Automatic selector stations
  • Action unit controllers e power operators
  • Valve or drive positioning systems The system uses a standard signal range of -10 to +10 volts DC throughout. All measuring elements and signal conversion means are local. The Hand-Automatic selector stations are on the operator's control board. Power operators are mounted at the valves or dampers 3

/*)

l V

being controlled. Signal converters which convert the -10 to

.. e

+10 volt signal range to the pneumatic signal required by the power operators are mounted near the power operators. .The controllers, signal manipulation devices, and alarm monitors are in the control cabinets. l L.

The Hand-Automatic transfer station and its associated circuitry  ;

allow the operator to transfer either from " automatic to hand" or from " hand to automatic" at any time simply by depressing the correct pushbutton on the selector station. No balancing of the .

selector station is required. However, when transferring to auto- ,

matic control, it is necessary for the operator to insure that the  ;

automatic signal is at the correct level since the automatic system 3

'will, as soon as the transfer is made, begin to correct the position

{

i of the final control element as directed by the automatic signal.

The controllers are of a modular' design and are identified as action units capable of producing one of the following control actions:

i differentiation, integration, proportioning, summing, subtraction, 3 !

t etc. Each action unit is a plug-in device which can be easily [

removed from the cabinet.

{

i The electro-pneumatic converter is a force-balance device in which j i

the electric signal moves a pressure sensitive vane by means of an f electric coil. The resulting change in pressure is fed back through a booster relay to reposition the vane and change the output pres-sure signal of the electro pneumatic converter. The pressure signal 3  ;

is then transmitted to a conventional pneumatic operator.

C ,

p

9 The ranging and biasing components provide, in addition to gain adjustment, changes to the 110 volts DC signal range, f The AWs are equipped with Fisher-type electro pneumatic transducers 3 which receive a milliampere DC current electrical signal and trans-mit a proportional pneumatic output pressure to the AW. An increase in the DC milliampere signal to the transducer coils increases the output pressure to the AW. 3 The AWs also have positioners equipped with an input capsule that serves as a force-balance member to match the valve stem position to the control signal. An increase in the control pressure produces an increas- in air pressure to the top of the actuator and a decrease in pressure at the bottom of the actuator. This difference in 3 pressure will move the piston downward stretching a range spring until the spring tension balances the force resulting from the control pressure signal.

III.

SUMMARY

OF TROUBIISH00 TING AND INVESTIGATION This section provides a summary of the troubleshooting and investi-gation of the large pressure 3 wings experienced on both steam headers following the June 9, 1985 reactor trip.

Action Plan No. 16 provides some of the maintenance, surveillance, and testing history of the AWs and MSSVs prior to the June 9,1985 3 O

a- - - -- -. , - , , .

- , - , - ----e , ,, --n-r 1,,,- -,-v, -,mn ,

s.  ;

trip. Also included in this report are the hypotheses determined to be the probable causes of the large pressure swings of both steam headers during the June 9, 1985 trip.

A. Field Actions Performed Of the eight steps listed in Action Plan No.16 report, the following have been performed:

1. Step Number 1: An inspection of the AWs, turbine bypass valves, and ICS equipment associated with the steam bypass 3 system revealed no visual evidence of unusual or abnormal equipment conditions.

(/

2. Step Number 4: Maintenance Work Orders 1-85-2190-00, 1-85-2344-00 and 1-85-2345-00 provided string checks of the Integrated Control System (ICS) modules which provide automatic control of the AWs.

The testing was done in a manner that closely simulates the actual conditions under which the AWs operate. For the specified input 3 voltages to ICS Modules 4-3-8 (AW-1) and 4-3-9 (AW-2), all measured voltages through the AW control strings were as expected.

O

( An operational check of the HS-SP12A and HS-SP12B hand / auto 3 stations was performed by energizing and de-energizing the component modules and verifying the voltage difference across the pins. The results of this check indicated that the sta-tions were functioning properly.

Bench testing was performed on each module in the AVV ICS channel. All modules, except Module 4-3-4 sum-plus-integral, 3 were found to function properly. Module 4-3-4 was found to give anomalous readings and had an improper gain. This module was sent to Bailey Controls for further troubleshooting (see l

item 4 below). The remaining modules were' reinstalled in the l

l ICS.

)

Operability and calibration checks of the steam header pressure

! transmitters were perforned in accordance with the instructions for Surveillance Test 5036.03 (Section 6.1 only) for steam generator outlet pressure instrument strings SP12A1 and SP12Bl.

j The output from the current buffers and voltage buffers were found to exceed the required tolerances by 130 my and 120 my respectively. However, the actuation pressures from both the pressure indicators and the computer printout were within the tolerances for both instrument strings.

O-s 1

! l

_ _ - _ . . - , _ . . _ e_,. m- .. ,- - - . , -

3. Step Number 6: Maintenance Work Order #1-85-2693-00 provided for testing of eight of the eighteen MSSVs at Wyle Laboratories.

The eight valves selected for testing were the four valves set to actuate at 1050 psig and the four valves set to-actuate at 1070 psig. These valves were picked because they are subjected to the most demanding operational duty, i.e. their lower setpoint pressures cause them to be opened more often and to remain open longer than the valves with higher set pressures. Therefore, these valves were expected to provide conservative indication of any valve degradation that had occurred. All eight valves were subjected to full ~ steam flow testing, and the following 3 items were monitored:

O a. Actual valve setpoint

b. Steam blowdown
c. Steam leakage before actuation and after reseating.

Each valve was actuated at least three times with no more than 10 minutes between each actuation.

P In order to successfully pass the above testing, each valve was required to meet the following conditions:

a. The average actuation pressure for the three test lifts had to be within 13% of the average actuation setpoint measured during the two surveillance test lifts performed at the last plant outage; l

TL

!. g- b. Valves whose average actuation pressure was not

( within 11% of their nominal setpoint but were within the 13% tolerance indicated above had to be adjustable-to within 11% as confirmed by two additional, consecutive test lifts;

c. Valve blowdown had to be no less than 2% and no 3 greater than 7% of the valve actuation pressure;
d. Valves whose blowdown was less than 3% or greater than 4% of the valve actuation pressure had to be adjustable to within this blowdown range as confirmed by two additional consecutive test lifts;

) e. Valves could not exhibit any visual or audible evidence of leakage.

Valves failing any of the above conditions were disassembled, inspected for damage, and repaired.

i Seven of the eight valves failed one or more of the specified test criteria. A variety of problems were found including worn / deformed guides, eroded valve seats, disc rock, gross valve leakage, and one bent valve stem. All i seven valves are being repaired and reassembled.

I O

V I

i L

(~~g 4. Step Number 8: As mentioned above, during the ICS module i

string test, Module 4-3-4 (Bailey Catalog Number 6624151A1C) was found to give anomalous readings and to have an improper gain and was sent to Bailey Controls Company for testing. The testing included checks of the following:

a. Physical appearance
b. Power supplies
c. Calibration and adjustment
d. Heat test The schematic of the Bailey module is illustrated in Figure 1.

O The verification was performed in accordance with Bailey Product Instructions Section E92-60-2.

The findings were:

  • The S3, S4, and S5 switches were corroded and very difficult to operate.
  • Resistances of 1.5-2.0 ohms were found across the closed contacts of switches S3, S4 and SS. Contact resistance of 0.0 ohms was expected.

O

~

  • Bias voltage was found to be at the saturation level of the amplifier (output = +15.1 V as compared to an expected value of +10.0 volts).

Module 4-3-4 was returned to Davis-Besse. Additional testing was conducted to determine the effects of the problems noted 3 above on AVV operation. The results indicated that Module 4-3-4 was not a cause of anomalous operation of AVV-2 following the trip on June 9th.

B. Analysis Performed

1. A review of the Data Acquisition Display System (DADS) and Sequence of Events Monitor (SEM) computer printouts 3 provided the following information:
a. Alarm printouts from the limit switches on the AVVs indicated that following the June 9th trip the AVVs were open at the times shown in the following table:

~

. 16-AVV-1 AVV-2 O\ Position Pressure Position Pressure Time (Z961) (P932) (Z9691_ (P936) 1:35:37 Open 1072.8 1:40:18 Closed 970.0 1:40:23 Open 989.3 1:41:04 Closed 912.8 1:46:29 Open 1033.3 1:48:01 Closed 945.3 1:50:13 Open 934.7 1:53:58 Open 976.4 1:58:28 Closed 916.6 1:59:35 Closed 892.0 2:03:06 Open 970.5 2:03:15. Open 972.0 2:03:23 Closed 966.7 Closed 973.5 3 2:03:31 Open 978.2 Open 981.4

b. The limit switch data in the above table indicate that AVV-2 did not open prior to 1:53:58; however, data from the AVV exhaust stack temperature monitors for the period immediately following the June 9 plant trip clearly indicate that AVV-2 was also open from approximately 1:48:20 to approximately 1:49:20 (data points were recorded only every 30 seconds).

It can therefore be concluded that either the SEM limit switches intended to detect operation of AVV-2 or the' computer logging of the operation of these switches did not operate properly. This will be investigated,

c. The exhaust temperature data also indicate that AVV-2 was being controlled in a partially open position by n

v

the ICS from approximately 1:39 until approximately 1:46.

(V'~'} This is indicated by a slowly rising exhaust stack temperature on AVV-2 during this time period.

d. A review of the computer data indicated that AFP 3 turbine trip throttle valves were open as indicated below:

Time AFP-1 AFP-2, 1:46:27 Open Closed 1:52:15 Open Open 1:58:33 Closed open 1:58:56 Open Open Information from operators on shift on June 9th and the computer alarm logs indicate that all four AFP turbine steam admission valves (MS-106, MS-106A, MS-107, and

{/}

w MS-107A) were open throughout the time shown above.

Therefore, steam to drive the AFP turbines was being taken from both steam generators after 1:46:27.

NOTE: The opening times for the AFP turbine trip throttle valves are inferred from an indica- 3 cation of AFP speed; therefore, they may not be an exact measure of valve opening time.

The closing time is based on indications from the " valve full open" limit switches on the valves. Also, during periods when the valves were open, they were being controlled locally by the equipment operaturs.

(V}

~

18-

2. The following data were extracted from the review of the sequence of events:

At 1:41:11 the Steam and Feedwater Rupture Control System (SFRCS) Steam Generator No. 1 (SG-1) low level trip caused the Auxiliary Feedwater Pump (AFP) No. I to be aligned to draw steam from and provide feed to SG-1. Four seconds later the incorrect actuation of the SFRCS on low steam pressure isolated both Steam Generators preventing the auxiliary feed flow from reaching either Steam Generator.

The immediate effect of steam flow to the AFPTs is a slight drop in header pressure. This was actually observed between 1:41:11 and 1:41:25 in both steam headers.

O 3. Calculations have been performed to explain the trend of the pressure transient from time 1:50:13 (AW-1 open) to 1:58:28 (AW-1 close). The calculations indicate that the pressure profile for SG-1 header can be obtained by consider-ing that an AW remained open (as indicated by the data in 3 Section III B.1) while the steam generator was partially refilled by the Start Up Feedwater Pump (SUFP) (flow for approximately 3.5 minutes at a capacity of approximately 150 spa).

The secondary system operator stated in his interview with 3 the NRC that he reclosed AW-1 when the steam generator pressure was dropping rather rapidly and unexpectedly

..4,

_tg.

during the time when SUFP flow was initially being added to SG-1. However, the SEM computer data indicate that the valve remained open until 1:58:28. This implies that the operator reduced the AVV-1 flow but did not completely close the valve. This action combined with the added flow from the SUFP would cause the repressurization of SG-1.

After the SUFP flow stopped, the pressure in SG-1 started to decrease again until AVV-1 was completely closed at 1.58:28.

4. The temperature downstream of the MSIV in steam line two was found to be consistently higher than the temperature downstream of the MSIV in steam line one. A comparison of temperature and pressure data in steam line two indicates that the steam in this line was superheated from approxi-mately 1:45 a.m. until approximately 6:00 a.m. when the MSIV bypass valve was reopened and the steam line repres- 3 surized. Therefore it can be concluded that there was some leakage through either the MSIV or the MSIV bypass valve from SG-2.

The magnitude of MSIV leakage is difficult to assess accurately. However, several actions were taken to determine 3 if the leakage was significant. First, a nitrogen leak test of the valve was conducted according to Davis-Besse System Procedure SP-1106.08. The test indicated that valve leakage is within specifications with the valve in its current cold condition. Second, Davis-Besse piping drawings l O

~

r (O

\

were reviewed to determine if there are pathways for large amounts of steam to be removed from steam line number two downstream of the MSIV. Only a 3/8" sample line and a supply line to the low pressure gland steam header were found. The supply line to the gland steam header contains a pres:;ure reducing control valve which limits flow to the low pressure header. The sample line is normally isolated during operation.

Finally, since opening of the MSIV bypass valves at approx-imately 6:00 a.m. resulted in a rapid repressurization of the steam lines, a conservative calculation of the flow through the valve was performed to determine an upper limit on leakage through the MSIV or bypass line. The calculation 3 indicated that the maximum flow through the bypass line is approximately 2.5 lb./sec. Leakage through the MSIV or the bypass valve was necessarily much smaller because the steam line did not repressurize prior to opening of the bypass line.

5. The~ operation of the MSSVs is dependent on the piping system natural frequency of vibration during a transient event. Following the plant trip on June 9, 1985, the steam headers can be expected to have experienced combined acoustic and frictional pressure fluctuations caused by the fast traveling waves. Preliminary evaluation indicates L . _ _ _ __ ._ _ _ . . _ _ _ . _ _ _ _ _ _ . _ _ _ _ _ _ _ _ _ _ _ . . _ _ . _ . _ _ . . _ . - _ _ . _ _ _ ._. _ . _ _ _ _ . . . _ _ _ _ _ _ _ _ _ _ . _ _ . _ _ _ _ _ _ _ _ _ _ _ _ _ _ . _ . _ _ _ _ .

l

() that the fluid transient loads and the structural system response and support reactions on the steam headers may cause poor reseating of the MSSVs, valve opening pressures l lower than valve set pressures and lower steam blowdown 1

than expected. A review of the steam header design for 3
both steam generators shows the following:
a. While the configuration of the steam headers is almost 4

identical, the pipe support configuration between the two anchors enclosing the MSSVs and the MSIV is different. The header from SG-1 was provided with a 1ateral snubber (SR-47) as a result of an incorrect

^

stress intensification factor that had been used in l

the seismic piping analysis for that header. The

(}

header from SG-2 has lower seismic loading and does not have this lateral snubber.

i

b. The Davis-Besse MSSV header design incorporates a non-symmetrical arrangement of valve exhausts. In addition, there are no supports provided to withstand thrust loading on the exhaust elbow. The combined

! effects of this design with the valve reaction forces during operation may contribute to valve fluttering.

It should be noted that the team investigating operator actions following the June 9th trip have indicated that safety valve chattering has been noted as a problem by the l _.- - - - - , - - , - . , _ _ ,-, . , _ - .. --.--_ . - ,. - _ - . . . .--- ,- ,. ,,.. ,

r t

O)

(

v operators. Preliminary indications are that, in order to assure proper rescating of the MSSVs, operators have developed the practice of manually reducing header pressure i

subsequent to trips by using the AV\s. l' l

6. Nalco Chemical Co. performed an analysis of the corrosion  ;;

found on the switches of ICS Module 4-3-4. The corrosion t-was found to consist primarily of magnesium, aluminum, silicon, sulfur and chlorine; however, no conclusion could .

be reached as to the source or cause of the corrosion. I i:

Examination of other ICS equipment uncovered additional corroded elements in circuits not related to the AVVs. The 3 investigations also indicated that only modules containing bias circuits, integrators and/or switches seem to be susceptible to the corrosion phenomenon.

7. Energy balance calculations were performed on each steam e generator at several points during the period between 1:36:09 and 1:38:54. During this period, the pressure in SG-1 was being controlled by AVV-1, but the pressure in SG-2 was decreasing. Also, the feedwater flow being supplied to SG-2 through the startup feed control valve was generally 20% - 50% greater than the flow being supplied to SG-1.

The energy balance considered decay heat, reactor coolant

, pump power, and the energy required to heat incoming feed-water. The calculations indicate that the larger feedwater 1

i

(N flow to SG-2 presented a significant additional heat load to that unit. Also, since level in both generators was constant during this period, all feedwater entering the 3

steam generator is assumed to have exited either through the AVVs or MSSVs (or compensated for shrinkage of fluid in SG-2 as its temperature dropped).

C. Significance of Findings

1. Issue No. 1:

The findings relative to the drop in steam pressure in SG-1 & 2 headers at 1:41:11 indicate that this pressure drop was the result of steam flow out of SG-1 and SG-2 to

()N

\~-

the AFPs following the SFRCS actuation. The pressure drop lasted for only fourteen seconds end is thought to repre-sent the time required to pressurize the AFP steam supply line. A detailed thermal-hydraulic analysis indicates that the pressure drop in the AFPT steam supply lines should be 3 cxpected to last approximately 15 to 16 seconds when both admission lines are opened.

2. Issue No. 2:

The findings relative to the drop in header pressure from SG-1 during the period between 1:50:13 and 1:51:55 indicate f

that this pressure drop was the result of:

\~_

- - - - - - - . ~ . _ = _ - . - - _ - .. . . _ - - . . . _ - = _ - = - - . . . - - -- -

j a. Prolonged manual control of AW-1 by the reactor operator; 1

b. To a small degree to the steam flow being provided to l l  !'

j the AFP turbines subsequent to 1:46:27.

1 l The repressurization beginning at 1:51:55 was due to water j being added to SG-1 by the SUFP, as well as a manual J

j reduction of AW flow by the operator. After SUFP flow was stopped, pressure in SG-1 header once again began to i

l decrease because the AW was still open. The decrease in l header pressure ended at 1:58:28 when the AW was closed.

l I

3. Issue No. 3':

j The energy balance calculations indicate that several  !

4 I factors produced the decreasing pressure in SG-2 between l

i 1:36:09 and 1:38:54. Higher than necessary feedwater flow I  ;

j being supplied through the startup feed control valve 3 acted to cool the generator. The energy necessary to heat 1

i up and convert this water to steam was greater than the t i energy being added to the steam generator from the primary system. Since level remained constant during this period and since AW-2 was not opened by the ICS, the flow being added to SG-2 is assumed to have escaped through MSSVs that did not reseat properly following their initial l

i .

j actuation at the tim.: of the plant trip. As a result of both of these factors, the pressure in SG-2 header decreased.

i i

1 _ , _ - - , _ _ _ _ _ _ . _ _ . . , . _ . . - _ , _ . . . , , _ _ ____._,,., - ,__.. _ ____,... _ .__, ___. _...,_,__

. - . .. . .. . - - - . _ _ _ _ _ - .= . _ . . . .

25-The decreasing pressure trend continued until feedwater flow was significantly reduced at approximately 1:39, ,

4 greatly reducing the heat removal from the generator and causing pressure to rise and reopen the MSSVs.

Steam leakage through either the MSIV or the MSIV bypass valve from SG-2 would contribute to the pressure drop during the period between 1:36:09 and 1:38:54 as well as during other time periods. However, this effect was determined to be small both because there are no significant

! steam leakage paths downstream of MSIV-2 and because the I

j pressure in the steam line dropped and stayed below 600 psig i

j for several hours after the plant trip. Additionally, performance testing indicates that valve leakage is currently 3

, within specifications, and prior to this test the valve had i

j not been operated since it was closed on June 9.

The magnitude of MSIV leakage can also be bounded by  !

i considering the bypass valves around the MSIVs. The bypass t valves around both MSIVs were opened several hours after the June 9 trip in order to heat the steam lines and operate the turbine bypass valver. The rapid increase in steam line pressure when these valves were opened provides a basis for assessing the leakage through MSIV-2 or its bypass i I valve. The bypass valves are 1" valves and are installed 1

l in 3/4" lines around each MSIV. Therefore, the flow through O

I

26-1 these lines is small. However, the steam pressure data e 4

from June 9th indicate that pressure downstream of the l

MSIVs increased at. rates of 15-20 psi / min. when the valves

were opened. Since pressure in the steam lines had remained below 600 psig for several hours prior to opening of the bypass valves, it can be concluded that leakage through ,

t either MSIV-2 or its bypass was very much smaller than flow i

j through the 3/4" bypass lines when the bypass valves were opened. This is additional verification that MSIV leakage 3 l had a negligible effect on the SG-2 header pressure between 1 1 i 1:36:09 and 1:38:54.

l I  !

t Finally, operators on shift during the June 9th event indi-cated that MSSVs did not rescat properly after the trip and

, that they used the AVVs to lower steam generator pressure in order to properly rescat these MSSVs. Pressure data from the SG-1 header support this fact. The decreasing

. pressure in SG-1 beginning about 1:38:20 is interpreted to be the result of a manual reduction of the AVV pressure control setpoint by the operator in an attempt to rescat  !

MSSVs.

f i

i  ;

e i

,; 4. Issue No. 4: l l l 1 l 4

i l Temperature data taken from the exhaust stack of AVV-2 i i

clearly show that AVV-2 was opened during the period l I

between approximately 1:48:20 and 1:49:20 even though l indications of valve operation from the SEM limit switches  ;

. . _ . - . _ _ . _ _ _ _ . _ _ _ _ _ _ . _ , . _ _ _ . _ _ _ _ . _ _ _ . _ _ _ . _ , _ _._...._._.__l

i l

i cannot be found in the computer alarm log. This fact is i also consistent with statements from the operators that

they were manually controlling the AVVs during this period q

3 4 of the recovery following the June 9th trip. Operation of the AVV would cause a rapid decrease in SG-2 header pressure i

during this period.

i

] 5. Issue No. 5:

i The opening times of both the AVVs and the AFPT trip throttle valves indicate that the pressure trends in SG-1 l header between 1:48:33 and 1:50:13 and in SG-2 header between 1:46:43 and 1:48:44 were a result of steam flow

{ being provided to the AFP turbines. The trip throttle  ;

s s -

valve to AFP-1 was opened at 1:46:27 and steaa from both steam generators was supplied to AFPT-1. At this time t

AVV-1 was also open and pressure in SG-1 header was de-creasing. At 1:48:01 the AVV was closed; however, AFP-1 I continued to run and take steam from both SGs. The com-bined effects of steam flow ts the AFP turbine and the t >

l decreasing water inventory in SG-1 caused the observed pressure trend in SG-1. Similar effects occurred in SG-2 3

. header. The only difference is that AVV-2 was not open s

.when AFP-1 was started, and therefore, the effects of the l

l nteam flow on SG-2 pressure can be observed very shortly after-AFP-1 was started (: 16 sec.).

f ,

I ('

i >

l

, V o, .;

IV.

I

( RESULTS/ CONCLUSION OF FINDINGS A. Direct Causes

1. Issue No. 1:  ;

l The drop in steam header pressure on both steam generators

between 1
41:11 and 1:41:25 was the direct result of steam '

being supplied from both steam generators to the AFP 3 I turbines following SFRCS actuation. The drop in pressure and subsequent recovery are attributed to the transient ,

pressurization of the AFP turbine steam lines.

r i

l 2. Issue No. 2:

The direct causes of the large pressure swing between

} 1:50:13 and 1:58:28 are:

i

a. Prolonged relief through AVV-1 due to operator action; i
b. To a lesser degree the effects of steam being provided to the AFP turbine; i

i kg f

(

I'

_-.._.-.--_..,r,..,_ _ .__._.~4_. . .-_ _ . . _ ., .._. _ . _ _ . , _ .

c. To the water supplied to the SG-1 by the SUFP which caused the repressurization starting at 1:51:55.
d. Action by the operator at about 1:51:30 to reduca AVV-1 flow.
3. Issue No. 3:

i The direct cause of decreasing pressure in SG-2 between [

1:36:09 and 1:38:54 was the combined effect of cooling [

of the generator by feedwater being supplied through the }

t startup feedwater control valve and leakage through the 3 1 MSSVs. The amount of feedwater supplied through the startup i

f control valve following a plant trip is controlled by the rapid feedwater runback (RFR) signal from the ICS. I

4. Issue No. 4: f The pressure drop in SG-2 header between 1:48:44 an1 . l 1:49:27 was due to operation of AVV-2. Temperatur'es in the  !

exhaust stack confirm this. However, computer logs from 2

the limit switches that indicate AVV-2 position did not show the valve to be opened during this' time. Therefore,  !

{

p further investigation of the'ICS and limit switch indica-  :

i tions will be performed to determine the cause of this  !

discrepancy.

4 .,

5. Issue No. 5:

(

The unexpected pressure response of SG-1 header between 3 1:48:33 and 1:50:13 and SG-2 he'ader between 1:46:43 and 1:48:44 are due to steam flow being provided to the AFP turbines.

6. Other Concerns:

The set pressure variations and steam blowdown variations of the MSSVs were the result of mechanical degredation of the MSSVs. Mechanical problems found when the MSSVs were inspected included worn / deformed guides, valve seat erosion,

(T disc rock, and, in one case, a bent valve stem.

V The rapid pressure oscillations associated with the MSSVs may also be a result of some of the mechanical problems discovered; however, the structural evaluation performed on 3 the headers indicate that these oscillations could be the result of MSSV flutter. This is being investigated.

The partial actuation of AVV-2 at approximately 1:39 when the pressure in SG-2 header first increased to the MSSV actuation pressure is expected to be the result of either sluggish operation or incorrect adjustment of amplifiers in the ICS. These questions are being addressed through additional testing of the ICS.

k

f

/'N B. Root Causes The root causes for issues number 1, 2, 4 and 5 are the same as the direct causes indicated above. The pressure trends in the headers are the expected thermal-hydraulic responses for the 3 steam generator conditions, equipment operation, and operator actions that occurred during the indicated times.

A root cause of issue number 3, in addition to degradation of the MSSVs, is the RFR control settings for the startup feed con- 3 trol valve supplying SG-2. The control system is supplying more feedwater to this generator following a trip than is needed.

p C. Disapproved Hypotheses Action Plan No. 16 dismissed the hypothesis that pressure drops in the steam headers were due to steam flow past the MSIVs (Hypothesis No. 4). At present there are data which indicate that there is MSIV leakage. However, investigations that have 3 been performed indicate this leakage is insignificant.

D. New Hypotheses

-Some of the unexpected pressure trends' in the steam headers following the June 9th trip were the result of steam flow 3 to the AFP turbines.

l l

V. Planned Additional Actions The following additional actions are planned in order to complete the direct / root cause determinations. ,

i l

A. Issue No. 1: [

i i

No further actions are planned.

I B. Issue No. 2: [

I No further actions are planned.

f 1

i i

C. Issue No. 3:

4 1 No further actions are planned. f i

f D. Issues No. 4:  ;

i

{

Proper functioning of the alarm points Z961 and Z969 that {

t provide position status of AVV's will be ensured. Other 3 f limit switches which may affect AVV operation will be l

! determined. To ascertain proper operation of this equip- f

, e

,i t ment, investigation and troubleshooting will be performed, }

t including disassembly if required (see Step No. 3 from Action Plan No. 16 report). [t l

.y s' )

33-l

. ~ \

E. Isrue No. 5: j No further actions are planned.

1 I

l I F. Other Concerns:

l l

1. Toledo Edison will disassemble, inspect, repair as necessary, and adjust the remaining 10 MSSVs. This will i

be done in the presence of representatives from the valve vendor and will include visual inspections, dimensional 3 checks, and adjustment. Any necessary repairs will include correction or replacement of deteriorated parts.

1 All valves will then be sent to Wyle Laboratories for testing to confirm proper operation before the valves are reinstalled in the plant.

i e

2. Proper settings of setpoint pressures of all MSSVs will be confirmed by performing Surveillance Test

- Procedure ST 5070.01 during the next plant startup.

1

3. A review of the fluid transient loads following a turbine 3 P

. trip event and the structural system response and support l reactions wil'1 be performed. The effects of piping feed-back forces on main steam safety valve operability during valve actuation will be assessed. For this review, both thermal-hydraulics and steam line piping analyses will be 3 used and additional materials such as piping modeling, I

e

, - - . - - - - - - - - , .,.,,-, _ -, , , , . - - , ,,,n.~._-.,,-,,n,-,,n-,,,,--,,,,nn-+--n .

t* a' s assumptions made, and fluid transient and structural dy-namics computer analyses will be reviewed. This review may 3 also identify causes for MSIV leakage from SG-2 header.

4. A review of the operability data of spring-loaded self- 3 actuating MSSVs used for overpressure protection in other nuclear plants will be conducted. The review will focus on:
a. set pressure tolerance
b. blowdown I c. ' leakage i

1 5. Additional checks of the ICS modules which provide automatic control of the AVVs will be performed to determine the cause of poor AVV control on SG-2 header at 3 approximately 1:39 following the June 9th trip. This will i

include testing while the AVV is operated.

6. If the actions noted above indicate a need for additional I information, a program for monitoring and analyzing operating conditions which could contribute to degradation of the ICS and MSSVs will be developed (See Step No. 7 from Action Plan No. 16 report).

O

__. - _ _ , , _ _ _ _, , _ _ , - ., , . . - _ - _ ~__ _ - . , _ . , - .- , , ~

VI. Technical Justification of Findings A. Issue No. 1 Steam flow to the AFPTs is physically similar to operation of a pressure control device such as an AVV or MSSV. Steam exiting the SGs to pressurize the AFPT steam lines and drive the tur-bines will cause pressure in the SGs to decrease. This is particularly true when the SG water level is low and limits the amount of steam that can be generated via energy extraction from ,

i the reactor coolant system. Thermal-hydraulic calculations l l

t using detailed computer models indicate that startup of a Davis-Besse AFPT in the configuration that occurred on June 9 should cause a pressure decrease lasting approximately 15-16 seconds. This decrease is followed by a pressure recovery as the AFPT lines pressurize and the AFPT comes up to speed. The actual time 5een in the pressure trends on June 9 was approxi- ,

mately 14 seconds. Therefore, it can be concluded that this trend is the transient effect of AFPT startup.

B. Issue No. 2:

The interviews with the operator that were held Lamediately following the June 9 trip revealed that AVVs were being con-trolled manually during the period between 1:50:13 and 1:51:55.

Moreover,'the computer logs indicate that AVV-1 was open from 1:50:13 until 1:58:28. The operator on shift also stated that O

m .

he closed AVV-1 when he saw SG-1 pressure dropping very low.

While these actions were occurring, the water le'rel in SG-1 was very low indicating a dry or nearly dry unit. Additionally, during this period flow from the SUFP was added to SG-1.

Calculations confirm that the water added to a dry or nearly dry steam generator in conjunction with reduction in flow through AVV-1 can account for the repressurization of SG-1 that occurred at approximately 1:51:30. Thus, it may be concluded that the combined effects of AVV operation under manual control and the addition of water to a dry or nearly dry SG explains the large pressure swing in SG-1 header from 1:50:13 until 1:58:28.

C. Issue No. 3 1

O Supplying excessive amounts of feedwater to a steam generator is a well-recognized cause of overcooling and depressurization of steam generators. Feedwater is typically on the order of 100*-150* subcooled when entering the steam generator. Thus, significant energy is required just to raise the temperature of 3 the water to steam generator conditions. Additionally, under the conditions that existed between 1:36:09 and 1:38:54.on June 9th, much of the water was also being converted to steam because of leakage through the MSSVs thereby causing an even greater amount of energy to be extracted from the steam generator. The combined energy extraction of these two effects was greater

- than the energy'being added to SG-2 from the reactor coolant system, and, as a result, pressure in the unit decreased.

.=. = . . . . - . -. _ _ - _ _ . . . .

9 J 37-D. Issue No. 4 3 As noted above, operators were manually controlling th'e AWs shortly after the plant trip on June 9. Although limit switch l

position indication on AW-2 did not show AW-2 to be open between 1:48:44 and 1:49:27, the exhaust stack temperature clearly indicates the valve was relieving significant amounts of steam during this time. Additionally, the pressure trend shows 4

characteristics that are essentially identical to other periods of decreasing steam pressure when the AWs are clearly indicated i l

as being open both by exhaust stack temperature and limit switch position indication. Thus, it may be concluded that this pressure trend was the result of manual operation of AW-2 by the operators t!

E. Issue No. 5 3 i Information compiled about operation of the AFPTs following the  ;

June 9 trip indicates that steam was supplied to the AFPTs from t

.both SGs starting at 1:46:27. Subsequent to this time, the measured water level in each SG indicated that the units were dry or nearly so. Thus, there was limited capability to maintain  ;

steam pressure in either unit at any time when steam was being extracted. The trends between 1:48:33 and 1:50:13 in S'G-1 ,

header and between 1:46:43 and 1:48:44 in SG-2 header illustrate this effect as a result of steam being supplied to the AFPTs.

O i

t 9 L The causes of the steam header pressure anomalies observed on June 9th have been established. Further investigation and 3 analysis of MSSV operation and degradation is being done.

VII. Specific Corrective Actions -

A. Required Corrective Actions

1. Issue No. I  !

No corrective action is necessary. The steam header

~

pressure trends between 1:41:11 and 1:41:25 are normal for the conditions that existed during that time.

[N e  !

\u, ,

2. Issue No. 2 I

No corrective action is necessary. However, operator i practices relative to manual AVV control following plant i trips are being reviewed. Operator training will reinforce the proper actions and acceptability of manual pressure s control post-trip. This is being done as part of Action Plan 3.

3. Issue No. 3  ;

I i

Prior to plant restart, the AVV controls and RFR control i i

setpoints will be ' evaluated and, if necessary, adjusted to 3 l

f)

s_ /

prevent over feeding of SG-2 following a plant trip.

.3 o

E 1

P

, _. . . - _ . -. , , .-- , . - . . , ,,- . - - . - ,,,-.gr

39-

/"'s As described in Sections III.A.3 and V.F.1, MSSVs will be U disassembled, inspected, repaired as necessary, and 3 adjusted. All MSSVs will be flow tested .to insure proper operation.

4. Issue No. 4 No corrective action is necessary. However, operator

. practices relative to manital AVV control following plant trips are being reviewed. Operator training will reinforce j the proper actions and acceptability of manual pressure

control post-trip. This is being done as part of Action Plan 3.

i

's

5. Issue No. 5 No corrective action is necessary. The steam header pressure trends between 1:48:33 and 1:50:13 in SG-1 and between 1:46:43 and 1:48:44 in SG-2 are normal for the j conditions existing during those times.
6. Other Issues j

See VII.A.3 above.

i Module 4-3-4 in the ICS string controlling AVV-2 will be .

replaced.

k

o. t 40 B. Additional Planned Actions O 1. Additional testing of the ICS modules controlling
operation of AVV-2 will be performed to determine the t cause of improper operation of this valve at approximately 1
39 on June 9th.

3

2. Preventive maintenance procedures to inspect and, if necessary, replace all components of the AVV control strings that are susceptible to corrosion will be established and implemented prior to the next refueling outage.
3. Other corrective actions to improve MSSV operation, if needed, will be defined after the evaluations described in Section V.E. are completed.

O VIII. Generic Implications A. Significance Contact corrosion, as wa's found in Module 4-3-4 of the AVV controls, may also effect other control modules.

l O ,

l C

e' - t e

i i

B. Planned Actions l 1

The need to periodically inspect and replace components that are

. susceptible to corrosion in all ICS control channels will be
evaluated to determine if preventive maintenance procedures 3 i

should be applied to other control equipment besides the AWs.

, bj c/18

! I I

i i

I e

i 1

I e

I f

l I

i i

5 5

5 4 i L

I i  !

l. ,

i~

s I

[

i l

^

i e

  • . : ( 1 Figure 1 l

)

i MODULE l l

BAILET CATALOG NO. 6624151AlC J

  • Al RT(GAINell .

GAIN a f 1 I( W .M" 33

$3 tees (It tNPUT3 6 2( .h >

,3

^

I s - *A

~ 2-# < D

- 12 suteeste CUTPUT

., _ , / ,, INeuf Suaneset g3g 04 88AS SuesastNG PO NT E( m- *fCv0C GAINet y Peor plus

, y v -

35 M INN INTES INPJT t l w, '3

< SJMMING POINT

= ""

, .s. ... (=") P.

NW Coff73toL d

- -A- C

n
c. h Is

[N87 '"E WMC 9 GAsas Rss

  • swygg uter 7 IssPUT 8' e '3 43 33 UMITDt 3
  • ss+0" 1 posmvc

< d 1.*

e' unal? INPUT nePruim

.os-so f s4 , @,

C8' w- sa p,l 3  % , *** 5e

- .+. +T ... +,

+2*r ans -ear t--- >

cN.assis o ouNo Simplified Schematic of Module 4-3-4

Locked Valves Numerous valves throughout Davis-Besse are locked in their desired position using chains and padlocks. This action was taken to comply with a TED NUREG 0737 commitment to prevent unauthorized operation which could render systems unable to perform their emergency function. As demon-strated by the experience gained during the June 9 event, however, this need must be balanced against the possibility that valves may have to be manually repositioned quickly in emergency situations. To assure both needs are met, availability of locked valve keys will be improved. Each of the four plant zone operators will be provided with an emergency-use-only keyring which contains a locked valve key. This keyring will be turned over to the oncoming operator as part of shif t 2 relief. Under normal circumstances, the current administrative controls will govern the operation of locked valves. In an emergency, plant operators will have immediate access to locked valve keys for repositioning locked valves. This corrective action will retain a proven method of control, developed from Davis Besse and nuclear industry experience, yet will allow operators to readily reposition valves in an emergency.

Security Door Access to Vital Areas Vital areas within Davis-Besse are secured using key card readers controlled by a central security computer. Problems have been experienced with card readers in the past. To prevent these problems Appendix C.4.2 4 Rev. 2

from precluding emergency access, several actions have been evaluated and implemented. The results of these evaluations and details of implementation will be submitted as they are completed in accordance with applicable safeguards procedures.

4 1

L Appendix C.4.2 5 Rev. 2

APPE19IX C.3.3 - SINGLE FAILURE EVALUATIONS OF ENGINEERED SAFEGUARD SYSTDtS 2 Evaluations of the Reactor Protection System (RPS) and Engineered Safety Features Actuation System (ESFAS) are in progress. The results of these evaluations will be included in this Appendix following completion, s

l Rev. 2 Appendix C.3.3 1