ML21075A103

NRC Comments on Draft Licensee-Developed Operating Test (Folder 2)

ML21075A103
Person / Time
Site:	Hope Creek
Issue date:	03/09/2021
From:	Todd Fish Operations Branch I
To:	Public Service Enterprise Group
Shared Package
ML19353E011	List: IR 05000354/2021301 ML20132A155 ML21032A102 ML21075A102 ML21075A103 ML21075A105 ML21076A062 ML21076A063 ML21076A064 ML21076A066 ML21117A083 ML21117A084
References
EPID L-2021-OLL-0001
Download: ML21075A103 (8)

Text

Facility:.

H.C2021

'.ExamDate:'FEB.20.211 1

. 2 3

'4.'

. '..5 r

6 utes.

AMM:

. ADMIN.

LOD-

. Admin.

- JPMs Topicand' U/E/S

'Explanation-

'~

'RJA E-4 I/C-

- Critical Scope Perf.

Job Cues.

Overlap:

..KeyM.iriutin-E Focus '. Step.s.

(N/B)

-.-..'l Std....

Link ROA1

. 2.1.18x 12.7 E-ES

'.A

- x ROA2 2:1.4S

~2.9

~

S ROA3.'

' 2.2.41'

'2.9'

~'-

~

S2

- 'S-ROA4.

2.3.11

.3.1~-

S SROA1 2.1.5.

3.3-SROA2

' 2.1.18.

.3.1 S

S'ROA32.'2.41: 3.'2

-S.-

SROA4

2.3.11-

- 3.3 S-SROA5

'2.4.38

~~

- -'3.0'

'-- S'

.1

.Simulator/In-Plant JPMsAND..:.K/A:

. Safety.Function A-5. :

290002A201.

3.0.

--:S'-

B-4 206000A406

'.3'.0

- S C.

'217000A302-

.:3.2'.

' x S

D-6 264000A404 Y3.2:-

S' E-8 400000A301.

3.0

- S

F-7.

j.217005A403.j

13.3'

' j;;

j j jS.

~ G-1.'-201002A102

'3.3'

~

S H-9.

290003A203'3.1-

'-'-.' S'

- I-7x 212000A201~

'.-3.0 S'

J1-

'-201001A207.

3.~1

' :S K-3

. c239002A203

' "3.1-

^

S

ES-301

- --2

.--FormES3017

~

Instructions for.Completing.This

-Table:.

Checkormark

'any item(.s)requ'iring;a comment.and explain th.e issue in'the'space.provid'ed

'using:theguide below.:

1.

- Check each.JPMfor appropriate/administrative topic.reciulrements~

(COO.,

EC,-

Rad,andEP)or safety function requirements andcorresponding K/A..

Markincolumn 1

-.(ES401, D.3and'DA)

'2.Determine the'.level of di'fficulty (EOD) using an'estab'lished'1-5rating scale.

Levels 1and'5 repres^ent:an:irfappropriate (low orhigh) discriminatorylevel forthelic'ense that isbeing

tested, M.ark in.co.Iumn 2(Appendix' D,C.1.f)

'.3.Incolumn 3,"Attri'bute's?'

check:the.appropnatebox:wheri anattribute isnot'met:.

' O Theinitial'.cond'itions and/or initiatin.g cuei's clearto ensure theoperator understands the.task andhowjo begin.

-(Appendix C,BA)

O

. TheJPMcontains appropria'te cues thatclearly indicatewhen theyshould bep;rovided to'the.examinee.

Cues.are:objectiveand:not leading

-(Appendix C,.D.1)'

O

' AIIcritical steps(elements) are.

properlyidentified.

.O

' Thescope ofthetask is'not toonarrow (N).or toobroad.-(B-).

lo

- Excessiveloverlap^does notoccur withJotherparts ofthe operating'testor written examination.

(ES-301,D.1.a, andES-301',

D.2a).

O.'Th'e task performance.standard clearly describes thee'xpected outcom.e'(i.e'.,

endstate).

Each'performancestep identifies.a standard forsuccessful

- completion ofth'e'step-l 0

. Avalid marked'up'key.was provided (e.g;,

graph.'interpretation, initialed steps forharidouts)..'

^4.Forcolumri 4/"Job Content,"

checkthe appropriate box~if.thejob.coriterit flaw does:not meet-the following elements:A O

Topics arelinkedto thejob.content(e.g.,

nota.disguised task,.task recjuiredinreal job).'.

O 'The JPMha's meaningfulperforrnance requirementsthat will provide alegitimatebasisfor evaluating theapplicant's understa'nd.irig andability tosafely

..operate theplan't.

(ES.-'301, D.2'.c)

~

~

5P Basedonthe.re'viewer'sjudgment,.is theJPM as'wiitten (U)nacceptable (req'uiring rep.air.orreplacement),.inneed of(E')nhancement.,

or(S-)atis'factory?

Marktheanswer

- incolumn:5.'

~

- 6. Incolurnrr6, provide a'brief descript.ion ofany-(U)nacceptableo'r (E)nhancement rating from col.timn5A Saveinitial review comrnerits anddetai'I.

subsequent comment'resolutionso that'each ehm-bourid JPM is'markedby;a'('S)atisfactoryresoluti'on onthis form.

ES301

'.-.3 FormES3017

.Facil'it

- Scenario:.1 Exam'Date:

1 2

-. 3

~4'.

5 --

'6 7

8 9

10

.Event'

- ~Realism/Cred.

• fn*sa"oa e',

LOD TS..-'.

CTs.'Ov"e"a'p

'.U/E/S'-

' '.Expla'nation 3

2:3 X.

S

.2

=

2.9'---

~X X

S 3

' '2.9 X

S

- 4 3.0 X

S 5

.3.1 S

e 3.3'-

X X

S 7

- '3'.2 X

S SAMEOPERATORACTIONAS EVENT4INSCENARIO 2.

--8

^

. &.3 R

REPLAGEDTHISEVENTWITH NEWEVENT

ES-301' 4

FormES-3017 Facilit Scenario:

2 ExamDate:

1 2

3 4

5 6

7 28 9

.10 Event

.Realism/Cred.- A*ctns a

n

- LOD-)

.TS CTs 'Oe*"a'

'UlEIS'-

Explanation

. 1 2.3 X

=

s 2

2.9 X

s 3

3.3 X

X s

4 3.3 X

X s

5 3.5

' s 6

3.3

' 'X s

~

7 3.2 X

3 s

.8

~ 3.2 '-

ES301.

5-Form ES3017

-Faciit

.Scenario:

3

-Exam Dae:.

2.

-3 4

5 6

'7 8

9 0'

Even

.Reaism/Cred

• s

,a*cn an

• ^LOD.

f

'TS

'CTs.

R,U/E/S'

Expa'naion

--.24' XX'.'-X.

s 2

.2.9 X'

X

-s:

3

-'3.

X E

s

.4

-.3.2 X

'X s

5

'32

~-

X X

s 6

--32'

---s 7

---30-'-

s

ES-301 6

FormES3017 Instructions.for CompletingThis-Tablet Use'this'table for each scenariofor evaluation.

2

- Checkthisbox if the evenisare.not related (e

g.,seismic eve'nt followed byapipe rupture).O.Rif theevents donotobeythelaws ofphysicsand thermodynamics.

3,:4' Incolumns 3and4,check:the b^ox ifthere isnoverifiable orrequired actio'n, asappl~icablex Exarnples'of

'req.uiredac!tions areasfollow.s:jES-301, D.5f)'

~

opening, closing, andthrottling valves starting and:stopping' equipment'.

raising andlowering'level,

flow, and^p^res.sure.

making decisions andgiving directions

- ackno.wledgingor verifying keyalarms and ~automatic actions.

(U.nc~omplicated'events that require n:o operator action.beyond.

this should not' beincluded.on theoperating test unless th/ey arenecessaryto.set thestage forsubse.quent.everit's.

(Appendix'D, B.3).).

5 Checkthis box.ifthe level ofdifficultyis notappropriate.

6.

- Check this boxiftheeventhasaTS.

7 Check this boxiftheevent~has.a critical task(CT).

If~the same CT.covers morethan

oneevent, checkth^eevent wheretheCT'started.only.-

8 Checkthis boxiftheevent overlaps with another eivent o^nanyof theI'ast two'NRC:examinations.

(Appendix:D, C.1.f).

9' Basedonthereviewer's judgment,is.the'event'as~written (U)nacceptable.(requiririgfepair'or.replace~ment),.in need of-(E)nhancement,.or-(S)atisfactory?.

Marktheanswer incolumn 9.

10

- Record anyexplanations oftheeve~nts here.

Intheshaded b'oxes, su'm.the^number'of check marks ineachcolumn..

- Incolumn 1,sumthenumberofevents.

- Incolumns'2-4, record thetotal;number ofcheck marksforeachcolumri.

. Incolumri 5;based orothe rev~iewer's judgement, place acheckmarkonly jf thescenario's LOD.is not'appropria~te.

- incolurnn 6,TS'are required tob^e a2foreachscenario.-.-(ES-30hD.5.d)'

A Incolumn 7,preidentified CTsshould be22for each'.scenario.

..'(Append.ix D;ES-301c Q.5^.d;'ES-301-4)

- Incolumn 8,record.thenumber ofevents:not'used on'the twopreviou's NRCinitial licensing' exa~ms.^Ascenario iscorisidered x

' x unsatisfactoryifthereisy2new events..(;ES-301.,.D20.b; Append'ix D,C.1.f)

Incoh.irnn 9,record whether:the

'scenari.o'as written (U)nacceptable,

.inneed of(F).nhancement,or (S)atisfactory fromcolumn11'ofthe simulator scenario table.-

ES301-

-- '.7

. Form'ES3017~

~

Fac.ility:

ExamDate:

1 2~

.3

.'4

.5 6

7.---

.8' 1.1

%Unsat:

Scenario "Event.

' 'Events TS

'TS CT

. 'CT

'Explanation Totals

- UnsatL TotalUnsat.Total.

Unsat, Elements 1

8.

1

3 0

2'- :0

- :12.5 "S -

8 0

..3-

-.0

- -2 0

0' S

3 7.

- 0.

.3

~.0

'.3 0

-0. x ---S instructions' forCompleting ThisTable:

- Checkormarkanyitem(s).requiring.comment and'explainthe iss.ue inthespace p'rovided.

1,3,5.

- Foreachsimulatorscenario,'enter thetota1number ofevents (colum.n1-),

TSentries/actions^(column3),

andCTs(colurnn.5).

Thisnumber:shouldmatch therespect~i.vescenario frorn.the eventbased scenario tables'(the sumfrom columns 1,6,:and 7',respectively).

2,4,6 Foreach

'simulator

scenario, evaluate eachevent, TS,:and'.CT a's.(S)atisfactory, (E)nhance, or(U)nsatisfactory based.on thefollowing criteria:

a..Events.

Eacheve'nt'is.described onajForm'ESD-2,'inciliding all switch manipulations,'pertinent

alarms, and'verifiable actions.

Event actions arebalanced between at-the-controls-and balance-of-plant applicants during thescenario. All event-related attributes onFo.rmES-3014 arem'et.

Enterthe total numb.er of

.uns~atisfactory.events incolumn.2.

b. T.S.

A.scenario includes atleast.twoTS entries/actions across atleast twodifferentevents.

TSe'ntries an'da.ctions aredetailed onForm.ES-D-2..

Enter

~the total n'umber.of unsa'tisfactory.TS~entries/actions-irfcohirnn 4.:

(E.S401, D.5d).

w

c. CT.'Check that ascenariolincludes atleast two'preidentifiedCTs^.

~Thiscriterion i's atarget quantitativ'e attribute, notanabsolute mini.mum requirement.

Check

- that eachCTis;explicitlybounded onForm'ES-D-2 with rneasurabl'e performance standards (seeAppendixD);.

Enter the'total numberofu'nsatisfactory CTs'in

.column 6.

244+ 6~

7 Incolum.n'7, calculate th'e.percentage of.unsatisfactoryscenario elem.ents:

' g; 100%

8 Ifthevalue incolumn7 is> 20^%,markthe sceriarioa.s (U)nsatisfactory in'columni

Ifcolumn

'7isi20%,

annotate with (E-)nhancement

^or (S)atisfactory.

9.

In'column 9,explain eachun.sati'sfactory event,"TS,:aridCT.

Editorial comrnents canalsobe~addedhere.

Saveinitial review comments anddetail's.ubsequent c'omment resolutio'nso'thateachexam-bourid scenarioismarked.by a^(S)atisfa~ctory.resolution onthis form.

ES301

=

8.

' -'-Form.ES3017 Sitename:

.Exam Date:

OPERATING.TEST TOTALS Total.

Total

' Total al Explanation C

lJnsat.

.E.di'ts'Sat. Urisat.-

Admin.

.~0 3

9 MINOR-EDITS TOCLARIFY INITIATING 9

- JPMs CUES

/)

~

~

~

~

'Sim./In-Plan't M.INOR.E!DITS TO'CLARIF'INITIATING 11

~

' 0.

1.0' 11 JPMs CUES SCENARIO 1EVENT8HADTHESAME OPERATOR:A'CTION AS'EVENT 4IN

-Sceriar.ios 3

0.

1 3

SCENAR!IO^2'.

R.EPLAC'ED-'EVENT 8WITH NEWEVENT Op.T'est 23

' O 14.

=

23

'O

^ Totals:

Instructions forComple~ting Th'is Table:

Update datafor this table fromq'ualityreviewsand totals intheprevious tables and thencalculatethepercentage of

=

tota'I iterns that'are'urisa'tisfactory andgiv.e an.

explariation inthespace'provided.'

^

^ :

~

1 Enter thetotal nurnberofite.ms submitted fortheoperatin'g test in.the"Total"Acolurnn. Fo'r examp.Ie,.if C

nine administrative JPMsWere subm.itted,

'enter "9"inthe.

"Total

itemscolu.rnn.foradmi.n.istrative JPMs.

Forsceriarios, enter thetotal num.ber'of simulatorscenarios.

Enter thetotal

'numbe.r of(U-)nsatisfacto'ry J.PMs andsc'e.narios fromth'e twoJPMs column5 and 11

s'imulator sc'enarios columnf8

'in th'e.previotis tables.

Provide ane.xpla'nation

'in the.space provi.ded.

3

. Enter totalsfor (E)nhancements rieeded and(S)ati.sfactory.J;P.Ms andsceriarios from.theprevious tables."

This'task

'is for~t'racking orily.

.4.

Total eachcolumnand enter theam.ounts inthe"Op.T'est Totals"row.

g

. ACalculat;e' thepercentag.e

.of theopera'ting test.that is(U)nsatisfactory (Op.Te.st Total Urisat.)/(Op.

Tes.t Total) andplace th;i.s valu.e inthe bolde.d

"%-U.nsat.".cell.

Refer toES-501, E.3.a,torate.the overall operat.ing test asfollows;

' satisfactory, ifth.el".Op.

TestTotal"

"%Unsat."

is520%

:.unsatisfactory, if."Op.

TestTotal"

"%Unsat.":is

> 20%

~. Update.this:tableand thetables abovewith post-exam cha.nges ifth'e

".as-ad~rninistere.d' op.erating'te 6.

're.quired contentchanges,.includi.ng thefollowing:

~TheJPM performance standards weresincorrect.

Theadministrative JPMtasks/keys wereincorrect.

/

CTsWere incorrec.t iri thescenarios

'(riot i'ricludirig postscen'ario critical tasks d.efine.d in Appendix D).

TheIOPstrategy wasincorrect inascenario(s).'

. TSentries/actions were.dete'rmined tobeincorrectan a:scenano s

.