ML20212J843

From kanterella
Jump to navigation Jump to search
Submits Summary of 990922 Meeting with NEI & Public to Discuss Continued Development of Performance Assessment Process & Insp Program Improvements
ML20212J843
Person / Time
Issue date: 09/28/1999
From: Spector A
NRC (Affiliation Not Assigned)
To: Madison A
NRC (Affiliation Not Assigned)
Shared Package
ML20212J847 List:
References
NUDOCS 9910060009
Download: ML20212J843 (12)


Text

I l

September 28,1999 .

MEMORANDUM TO: Alan Madison Performance Assessment Section Division of Inspection Program Management Office of Nuclear Reactor Regulation

. 'FROM: August Spector inspection Program Branch

~

, Division of Inspection Program Management L Office of Nuclear Reactor Regulation

SUBJECT:

REVISED REACTOR OVERSIGHT PROCESS:

SUMMARY

. OF THE SEPTEMBER 22,1999, MEETING WITH THE NUCLEAR POWER INSTITUTE AND THE PUBLIC TO DISCUSS THE CONTINilED DEVELOPMENT OF THE PERFCRMANCE

' ASSESSMENT PROCESS AND INSPECTION PROGRAM IMPROVEMENTS ,

On September 22,1999, a public meeting was held between the NRC and the NEl to continue exchanging information and views in further development of the concepts sent to the Commission for improving the process of overseeing the safety performance of nuclear power reactors. The meeting agenda, a list of those who attend the meeting, a copy of written I

information exchanged at the meeting, and summary minutes are attached.

Attachments as stated -

- l

Contact:

August Spector q sg l 301-415-2140 :g [

DISTRIBUTION:

NRC File Center  !!PB r/f PUBLIC 74IV [

File Name/ Location (A:\NEl

SUMMARY

.WPD)

To receive a copy of thes document, indicate in the bor "C" a Copu without attachment / enclosure "E" s Copy with attachment / enclosure 'N's No copy OFC: PAS \llPB g , PAS \llPB I

NAME: ASpector AMad DATE: 09/N/99 09/f8/99 OFFICIAL RECORD COPY

,,too6ooo, ,,o,2e nibb .

C c} d - 7 [i b PDR REV0P ER C O f F7 - b NQ p"+

L- - - - _ J

I NRC PUBLIC MEETING PARTICIPANT LIST -

DATE: September 22,1999 PLEASE SIGN IN. THANK YOU NAME AFFILIATION David R. Robison NPPD-Cooper Garret E. Smith NPPD-Cooper l

D. M. Olson Virginia Power August Spector NRC Dennis Hassler PSEG Nuclear William A. Allen AEP-Cook I Wade H. Warren SNC I l

Jim Chase OPPD Don Hickman NRC  ;

John Butler NEl Michael R. Johnson NRC Wally Beck Com Ed William Dean NRR Richard Rosano NRR Jeff Jacobson NRR Laura Collins NRR (via conference call)

Cornie Holden NRR Tim Fye NRR Alan Madison NRC Jim Hutton PECO Energy Kevin Borton PECO Energy Stephen Floyd NEl j Tom Houghton NEl Pat Loftus Com Ed Greg Gibson So Ca! Ed - Rug IV l

t

Sh %

8

l.

.%1 Draft

~

COMMENTS ON SUPPLEMENTAL INSPECTION PROCEDURES i Generic Comments I

- i it is our intent to ensure that the column procedures actions align with the  !

philosophy of each column (column 1thru 5). To complement the procedures further guidance (philosophy) needs to be incorporated in the oversight process {

regarding NRC actions, confidence in the licensee's programs, and indication of  !

failed licensee Corrective Action Program. l The Column 2,3 and 4 procedures need to be revisited (revised) following completion ofindustry guidance on Corrective Actioil Program effectiveness.

Column 2 Procedure General Comments:

Add to inspection Bases Section: .

)

"It is not the intent of this procedure for the inspector to perform all steps of this l procedure for each finding. The inspector may exercise discretion based on the '

inspector's knowledge of,the conditions and steps taken by the licensee".

1. page2,4" bullet at top: programmatic issues should be written consistent with l SECY 99-087 "In other words, the focus is on the safety impact of the - i programmatic violations, not on an assessment of the program."
2. page 2, Section -01 INSPECTION OBJECTIVES, objective 01.03 should be 1 written: Verify that licensee corrective actions to risk significant performance '

issues have been identified bv the licensee and the licensee has identified the actions address the root causes, the contributing causes, and prevent recurrence.

3. Page 2 -02 INSPECTION REQUIREMENTS, should be written to include:

The intent of this inspection procedure is to review the licensee's evaluation l of each issue categorized as White and included in Column Two of the '

Assessment Action Matrix. It is exoected that the insoector will verify the licensee's actions as it certains to the sianificance of the issue. and as described in the licensee's corrective action oroaram. however. It is not a validation nor an indeoendent evaluation of the issue by the insoector. Under the sianificance of colurnn 2. it is exoected that there is confidence reaardina ,

l the licensee's Corrective Action Proaram. The licensee's evaluation should generally address each attribute contained in the inspection requirements section; however, the depth of the licensee's analysis may vary depending on the significance and complexity of the issue and the licensee's program. In some cases, the answers to specific inspection requirements will be self-

- evident with little additional review. Therefore, the emphasis is in the 1 ,

s .

licensee's implementation of their analysis and the Inspection Requirements I are provided as a guide to the inspector. .

4. page 4,1st paragraph, strike cut last two sentences: " Weaknesses in the licensee's.... enforcement action. In addition, weaknesses in the licensee's evaluation may require additional NRC supplemental inspections, ...

' adequate corrective actions are specified." These statementare indicative of a column 3 procedure

5. 1" bullet at the top of page 2: Remove "all" and clarify only the appropriate requirements contained in the procedure need be completed.
6. Specific references to methods or prescriptive requirements of an effective

. CAP should be re-visited once an industry guidance document is made available.

~

Column 3 Procedure

1. Page 2, bullet 4: see same comments as #1 regarding column 2 procedure.
2. Page 2, Section-01 INSPECTION OBJECTIVE (S), add to each objective so not to confuse with aggregate issues: ... understood for individual and collective (multiole white inouts) issues...
3. Page 3,1" paragraph, add: .....and generic implications of the individual and i collective issues, it is the intent not to re-oerform the licensee's evaluation.

however. the insoection should assure that the actions are sufficient to meet l all four of the insoection objectives. The licensee's....

4. Page 4, Section -03, General Guidance,2d sentence add: ...to complete their evaluation and/or self-assessment for multiole inouts.

Column 4 Procedure General comments l

Inspection actions should provide reasonable assurance of safety and/or risk l significant system functionality or programmatic compliance with regulatory requirements. To provide this reasonable assurance, inspections should independently assess the effectiveness of multiple processes or programs that are critical to safe operations. This should be accomplished through a safety focused and risk-informed sampling approach to characterize areas where there is a significant current decline in safety margins. Inspection actions that i prescribe specific management actions or solutions should be eliminated.

Examples include 2.02C and D,3.02 B, C and D and 3.03 E18. Licensees should be encouraged to be self-critical and identify historical issues that, if undetected, could potentially result in a current risk or safety-significant issue.

The procedure is designed considerably different than column 2 and 3 procedures. The intent appears to be a broad look at fundamental issues. Up front it needs to be clear that all areas may not be necessary and the inspector should implement only those portions necessary to address the performance 2

s . .

p.

c.

s' area that has significantly declined l'would suggest that a statement in section 02.01 be added. ,

The inspection objective described in 01.01 needs clarification. The wording implies that a column 4 inspection is designed to see if the plant should move into column 5. Criteria to shift to the 5* column should be defined as the results i of the broad inspections that indicate that the finding and/or additional findings which are of red significance level.

The action matrix and the procedure do not describe the actions that might follow from a significant event (red) that is judged to be a new industry issue rather than a plant performance problem. It needs to cover this possibility if the procedure is intended to be used to evaluate event-related single red findings.

Incorporate the footnote from the action matrix. "This procedures is only applicable in cases where the staff has determined that one Red Input is  !

indicative of overall licensee performance and additional evaluation and supplemental information are needed." Basis: The procedure as written does not recognize that the procedure is not be applied when entry into the procedure is driven by one Red input which is not representative of licensee performance.

The Action Matrix for the " Reactor Oversight and Assessment Process (ROAP)

Handbook 8.X, page 12 issued May 20,1999 by Sam Collins in the " Pilot Program For the New Regulatory Oversight Process" states in Footnote 1, "It is expected that in a few limited situations an inspection finding of this significance will be identified that is not indicative of over licensee performance. The staff will consider treating these inspection findings as exceptions for the purpose of determining appropriate actions."

1. The discussion in 02.03 A.3 does not flow with what follows. It looks like 020.3 A.4 got jammed in the middle. Also, the connection between the number of the attributes elements in 02.03 and the correlation with similar numbering in 03.03 is not obvious. Similarly, the use of the same topic headings for 02.XX and 03.XX is confusing when trying to understand what the section is trying to convey.
2. page 3 Paragraph 02.01 First sentence, strike " Assessment" from Assessment Action Matrix.
3. page 3 Paragraph 02.02 second paragraph first sentence. Correct to state:

"Once significant performance concems have been identified and the Action matrix aoolies.. "  ;

4. Section 02.04 is missing or there a typo,in section labeling, l
5. Page 3 first word , " leeway" needs to be clarified. If the inspection module is meant to be augmented by other processes or modified by deleting unrelated  !

sections of the proposed procedure, the clarification needs to be made I somewhere. See general comments.

6. Section 02.01 Strategic Performance Areas (s) Identification. The use of the parentheses for " area (s)" should continue throughout the section.

3

E n

N

.- 7. How will NRC classify inputs? At Philadelphia, the guidance was that a Finding would stay for 4 quarters. This is a conce,n because you could have .

one yellow finding, and a yellow PI later in the year which really have no common cause, or even a common subject, yet an additional column 4 type inspection would be undertaken to review this area.

8. Section 3.02, B., (page 9). Strike last sentence. It implies th61 management's support of audit and assessment is linked to QA organization
j. staffing. Staffing of QA is not an ind!cator and should not be listed here.

l

9. Section 3.0.2, E (page 10), regarding the employees concems program.

Change to: "... additional safety issues exist that have not been adequately addressed " and strike " captured by the corrective action program."

10.2.02.D on page 3 is too prescriptive and appears to establish a requirement l for the development and implementation of perfo,rmance indicators. While most everyone is doing this, there is no regulatory requirement to do so.

11.Page 14 item d. is too prescriptive and seems to establish a requirement for the composition of vendor evaluation teams.

4

_ .- -_ . _ _ _ . _. . t

,4

,y.

., J -

N%

.T t'

RESPONSE TO PERFORMANCE CONCERNS IDENTIFIED DURING SUPPLEMENTAL INSPECTIONS Numerous questions and comments have been generated during review of the draft .

supplementalinspection procedures with regard to how performance concems, particularly programmatic performance concems, will be handled that are identified during the conduct of supplementalinspections. Three potential approaches are outlined below:

(1). If the original white issue was enforceable and the licensee's response to the violation is unaccepteble, we would inform the licensee that their response is unacceptable and the reasons why. If the originalissue was not enforceable but was risk significant (by definition white issues are risk significant) and the licensee's evaluation of the issue was not sufficient, we would have the option of doing additional supplementalinspections as -

necessary to independently identify the root causes and extent of condition, or we could order the licensee to do so.

With regard to what additional actions need to be taken with regard to the programmatic concern associated with deficiencies in their evaluation, this information could be fed back into the baseline problem identification and resolution (Pl&R) inspection. During the next performance of the Pl&R inspection we would focus on the areas found to be deficient during the supplementalinspection. We would not perform additional supplemental inspections other than those necessary to identify the root causes and extent of condition of the originalissue.

  • ESQ M No change to current assessment Limited regulatory leverage for programmatic infrastructure required concems associate with the corrective action program May require significant additional NRC inspection to identify root causes and extent of condition (2) Regardless of whether the original white issue was enforceable or not, we would hold the issue open (i.e. the white finding would not go away) in the action matrix until we were satisfied that the licensee had performed an adequate evaluation and appropriate corrective actions were proposed. This would alter the current policy of removing the issue from the action matrix after four quarters regardless of the adequacy of corrective actions. We would not perform additionalindependent inspections other than those to re review the licensee's evaluation or as a result of movement within the action matrix.

l EBQ M I Increased regulatory leverage for Would require change to assessment programmatic issues associated with the infrastructure to keep white issues on the corrective action program books if corrective action is not adequate l

Limited additional NRC inspection resources required 1

I

~ ~ - - ~ - -

- - . . . . . .- -= . . ._.

7=

F ,

l

  • y:

,$.}

i l

l (3)- We would issue additional white issues for inadequate corrective action. This would l have the potential to move the licensee further to the right in the action matrix which would result in additional supplemental inspections. We would not perform additional independent inspections other than those to re-review the licensee's evaluation or as a result of movement within the action matrix.

Eao c.on l Maximum regulatoryleverage Could result in significant movement to the i right in the action matrix without the identification of new hardware issues Limited additionalinspection resources Would be departing from SDP philosophy of required not issuing findings for programmatic issues Most pro active of the three approaches No change to current assessment . Would likely be perceived by industry as infrastructure required double jeopardy l

l

i NEI 99-02 (Discussion DraA) 22 September 1999 l

, Calculation 'I The performance indicator is calculated using values reported for the previous four quarters. The

. calculation involves averaging the results of the following two equations.

IDS Unavailability Index = IDS Compensatory hours in the previous 4 quarters i Number of PhysicalSecurity Zones x 8760 hrs CCTV Unavailability Index = CCTV Compensatory hours in the previous 4 quarters Number of Perimeter Cameras x 8760 hrs Indicator Value = IDS Unavilability Index + CCTV Unavailability Index 2

The resulting indicator calculation is augmented by determining whether any individual physical security zones or any perimeter camera exceeded an unavailability of 20% (i.e..

greater than 1752 compensatory hours in the previous 4 quarters).

Definition of Terms 1

Intrusion detection system (IDS) - E-fields, microwave fields, etc.

CCTV- The closed circuit television cameras that support the IDS.

l Compensatory measures: Measures used to meet physical security requirements pending the return of equipment to service. Protected Area protection is not Jiminished by the use of compensatory measures for equipment unavailability.

Compensatory man-hours: 'Ihe man-hours (expressed to the nearest tenth of an hour) that compensatory measures are in place (posted) to address a degradation in the IDS and CCTV systems. When a portion of the system becomes unavailable-incapable of perforndng its intended function-and requires posting ofcompensatory measures, the compensatory man-hour clock is started The period of time ends when the cause of the degraded state has been repaired, tested, and system declared operable. 1 1

If a zone is posted for a degraded IDS and a CCTV camera goes out in the same posted area , the hours for the posting of the IDS will not be double counted. However, if the IDS problem is corrected and no longer requires compensatory posting but the camera requires posting, the hours will start to count for the CCTV category.

Equipment unavailability: When the system has been posted because of a degraded condition (unavailability), the compensatory hours are counted in the PI calculation. If the degradation is caused by environmental conditions, preventive maintenance or scheduled system upgrade, the compensatory hours are not counted in the PI calculation. However, if the equipment is l

99 j

i le e b c as tpaa em c r c od af n rea n /A A

/ /

A A

/

A

/

A

/

A A A A A

/ / / / /

UPI I N N N N N N N N N N N d

n -

a _

. yB r

detos e iI r nno  %  %  %  %  %

uep 0 0 0 0 0 -

qgs A ee e 0 1

0 1 /

0 7

0 6 9 0 I l 3 A

/ 5 5 RRR > > N < < < > > N > >

d n

s'lau -

a rd d yB oi v

't s .i n d de r gd o o s to es vai n l

)9 A9 C hs al aon  %

0  %  %  %  %  % 00 a9 e eup r 0 0 0 0 0 50 r

D 1r S r cgs 0 0 0 0 0 0. 2 R h ee 5 9 4 ne ob O T InRR > 5 6

> < 8

< 9<

5 l

> r'00> >

2 2

s s T s r u A mu e i%

l c uo

) e s v s C miev s ) ns e o i

D I D i r

e s

r e

nu oo c

n ( r (2

2 2 xr ,t s r s i e x e u o

0- N I

ap mg e u u q a

t r

a u

r e v e e

g r

r u d n

e l b

a mf a

r s 9 (yi n ,

q pr p a c t gu E

l t I 9 r a r vuo s )s e t Oe n e

c o e e r

o oo I

E C it u vd yf u er h g Rh c ( c n

c n

p e

ri Pv e N

l art t r s N i t ,

l ht s va i

e E n e s e a (

r yr 7 A ci t n u y uq s yi (

p e n

r r )s n n e i p t

M Am oi o l u o Ki e e s y) e u ce r fo c

l i

bh e

R cl i mver ht r t v n )s n ou ve ct r a r iat i i f cr i s Oa i r c r t e o e l

f g O i c p e

e mp of ex bt e c i

ar a ffe t u P mt e l e n F pS u g msu pr ge i nq e r n t

r r Ri foau r R S mn mo re ar l eu E uu e r eq l u n o ed E )h c i i xr u i v v t

Rq r l f fo m P r n au l

o f s u nt ime l

P S e el p CT md xp (o r si r muo t r Es u u i

mo on s e Rf ( t a e cen ed pa t ef s

n )s ao q or l

af r s ev r

( o e yu s Cet ci v E i

1 ai m mht ( gu P e l

e mtn t

( a n nn S o ea r i

ge y o ri o

/

)l e e e Rl r o i u ow t. Db i

b .

e gve n nv u r P v Ft a a t s c k c id oe l gre o t a e ka o fr e

ye ap u]qag r

T S p

=

S p

- A e i pa t p

ir t

. cn u< )Mnp c

a ir 4 ;e. ne i F r

( op ci c g n1 ye n s, t I

- _L P EusRa ap eh

. i l a ue) dh ol s r fi e ec I t

no f e s

t c ri) at rs r Ti t

o pin,qV I cs e r r e

r g u et c D t

r (e

P apt e N O v Ce At r Si n i

r oa e iT ee c i r- c o Cvt r ya r

t nf e o mga e r l l

i ea d yt itoe r

r Dcn d ua e ur fo l n

a) t a l u dt nt E

x r Daq vu ni a p Oe teq nd -

msr c oh q I n ina ai l pg t b un S u c

/ r r r ns s s r e ncer t /

ct ht e u ot eot i

d a e ou nr Cc S e t l l

Ot h leil r a ci r Tc t o o sr en tn frr a I

n Rmf o Re r

Cp o e Dr i Rag c Ec Ethie Ar e Odu R (o Prfa Pe ev ieu FP q n

t n o g a y n i t

n l t

e o c o t n s f i t e o

i l e d e s aa ia t o

n d C ye nS d r o a r m n cnd n o in a P t

s r

s rC l

t ome i a ee t o ai R l a

e el ct t gr n ie r u as ey n

o r a ep pt ui a ilcy i c

r rF RS C mr e t

e s y c a buaf h o cd a m C B EP OR PS P 2

2 -

c

FS Gry NEI 99-02 (Discussion Draft) 22 September 1999

}

Calculation l

)

The performance indicator is calculated using values reported for the previous four quarters. The calculation involves averaging the results of the following two equations.

IDS Unavailability Index = IDS Compensatory hours in the previous 4 quarters Numberof PhysicalSecurity Zones x 8760 hrs .

CCTV Unavailability Index = CCTV Compensatory hours in the previous 4 quarters Number of Perimeter Cameras x 8760 hrs IDS Unavilability Index + CCTV Unavailability Index or V6 2

The resulting indicator calculation is augmented by determining whether any individual I physical security zones or any perimeter camera exceeded an unavailability of 20% (i.e.,

greater than 1752 compensatory hours in the previous 4 quarters). .

I Definition of Terms Intrusion detection system (IDS) - E-fields, microwave fields, etc.

CCTV- The closed circuit television cameras that support the IDS.

I Compensatory measures: Measures used to meet physical security requirements pending the retum of equipment to service. Protected Area protection is not diminished by the use of compensatory measures for equipment unavailability.

Compensatory man-hours: The man-hours (expressed to the nearest tenth of an hour) that compensatory measures are in place (posted) to address a degradation in the IDS and CCTV systems. When a portion of the system becomes unavailable-incapable of performing its  !

intended function-and requires posting of compensatory measures, the compensatory man-hour l clock is started The period of time ends when the cause of the degraded state has been repaired, l' tested, and system declared operable.

y If a zone is posted for a degraded IDS and a CCTV camera goes out in the same posted area , the i hours for the posting of the IDS will not be double counted. However, if the IDS problem is corrected and no longer requires compensatory posting but the camera requires posting, the hours will start to count for the CCTV category.

Equipment unavailability: When the system has been posted because of a degraded ccadition (unavailability), the compensatory hours are counted in the PI calculation. If the degradation is caused by environmental conditions, preventive maintenance or scheduled system upgrade, the compensatory hours are not counted in the PI calculation. However, if the equipment is i

i

! N L J

l le e b c an t a pm en c

e ed _

nf n rea n /A /

A A A A A A A A A A

/ / / / / /

UPB N N N N N N N N

/

N

/

N

/

N d

n a _

yB r _

deto se r nn % _

iI o uep  %  %

0 0

0 qgs 0 0 ee e 0 1

0 1

A

/

0 0 6

0 9

l A

RRR > > N 7< < <

l 3

/

N 5

5 l

d a -

n u d a rd oi v

't ds yB .i n l de ro es gd o ho v ai n

)9 t

i9 C s stan al e up o % 0  %  %  %

0  %  % 00 0

c9 i 1 S re r cgs 0 0 0

0 0 50 D r R h InRR ee 5 0 5

0 6 9 0 4 0. 2 ne T > > > < 8 5

l 00 2 2 o b. . O 9< > >> > >

i s

s T s r c A mu uo

)

l e s e v

u%

s C miv s ) ns e o i

D 2 I D ie r

e s

r e

nu oo c

n ( r u

(2 xr ,t e x 2

0- N ap mg se aur t r

a se ve r

i e

g r

r 5r l b

e mf a

o I u q u pr p a u n a r s 9

E (yi n l a r s )s q t n

c c I t r gu 9

C r

u vuo e r t Oe e o e e o oo l

E i

t yf ue h Rht c ( c n

c n

p Pv ri N N i t

v d, l l

ar va t

i g

e E n r e s s e a e r yr e A ci t ht s n u y uq s yi p e n

r r) m

(

e it p 7 M Am oi o u ee (

y) e u r o c l

i e c^-

l ci mvre ht r e o Ki s v c f n )s bh R i f c l

nm i

v f cr i t

s r i O

r e a r at g o e l i t

ce mp bt e c mt e i

O e l

tn q_

i of e P en F e pS p u g msu pr g= x e i a ra f e r n t

r r Ri foau r R S . mn mo r r l

eu E f uu e r eq l u u v ev o Rq ed

^

E )h c ii xru i l l i fo m P r n s P S e CT a

md imer (o mir l l

= u r fo r o t

f Es i u qu p

-.fou on nt

  • yu s n or)s

- xp gd s e ae cen Rf ( ti l ao E r e v 1 ( o e mh ( a Ct e ci .s s u e e ai m v c, o t i l

b mtn e e Rl ( t r m a nn o i S o i e r a r ge ty orp i) i i

/

)P el ger Db n

o m u s u a t s c e

gv e d Pv o g rud i

Ft a l

ka ce r t q ye ao fo r

T ep ate i . i c o S p k r pa t a y o2 p1 dain ei r np F

( rop t

n s, L S aA e i cip c g x r S e i

ne yer dh LeL P i tri)c i

f n Euo s Rud ap eh l ae) olusr fece f e s at s ii t

ou r Ms e r c r g u et t

oa e iT i t no i c Pa pt r r e Nd l

ai nv Ce c r c Sin D (e r ee r- c oe Dn dAeq;a eu fo- na t

o Cvt r ya r nf e o mga re l l

iea r

d y i r l r t

a oh l uq d nt x r vu ni Daq t t p a Oe nd s n )s e E l

/ r s nre t ai t c t I n in a pg s ur ce ur ns Otht h treiba

/

i ct a nr S e t ncr r l un ot s n eot d i c n frr a l

n eou o Cr c oe D i Rag ci r c h c t

ofo r e Are Odu R (o P a P e ev ieu l l t _

r I Rmf Re Cp Et hie FP q n

t n y n i o

g a t o t c

n fe l

o t n s i

t e e

i d o e s l

aa a t o

n d C m ye nS i d r t

o l a r n cm ino a P s sC nd r r t om c

i a ee gr taio R l a

e el a

t n r a pt a ilcy t i c ey*=

n ie r u o ep ui s r

o rF a RS C me r r cd c a ua hb fe y C B EP OR PS P 1

2