ML21075A103

NRC Comments on Draft Licensee-Developed Operating Test (Folder 2)

ML21075A103
Person / Time
Site:	Hope Creek
Issue date:	03/09/2021
From:	Todd Fish Operations Branch I
To:	Public Service Enterprise Group
Shared Package
ML19353E011	List: IR 05000354/2021301 ML20132A155 ML21032A102 ML21075A102 ML21075A103 ML21075A105 ML21076A062 ML21076A063 ML21076A064 ML21076A066 ML21117A083 ML21117A084
References
EPID L-2021-OLL-0001
Download: ML21075A103 (8)

Text

Facility:. .

H.C2021 -

'. ExamDate:'FEB.20.211 1 -

2 - -

3 -

. '4.' '..5 .

r -

'. 6 ADMIN. LOD- utes. AMM:

Admin.JPMs -

'~

Topicand' E-4 U/E/S -

'Explanation-

'RJA I/C- .

Critical Scope Perf. - -

Job -

Cues. Overlap: ..KeyM.iriutin- E Link Focus '. Step.s. (N/B).-..'l -

Std.... -

ROA1 -

2.1.18x 12.7 E- -

ES

.A - -

x -

ROA2 2:1.4S ~2.9 ~

S ROA3.' 2.2.41' '2.9'

~'- '

~

S2 ROA4. 2.3.11 .3.1~- .

'S-

S SROA1 2.1.5. 3.3-S SROA2 2.1.18. .3.1 S'ROA32.'2.41: 3.'2 -

'. -S.-

S-

SROA4

2.3.11- 3.3 -

SROA5 -

'2.4.38 -'

~~

3.0'

'-- S'

.1

.Simulator/In-Plant JPMsAND..: .K/A:

Safety.Function -'- -

A-5. : 290002A201. 3.0. '-

-- :S'-

.3'.0 S B-4 '

206000A406 ' -

C .

. '217000A302- .:3.2'.

x . ..

. S D-6 . . 264000A404 Y3.2:-

S'

- S E-8 -

400000A301. 3.0 -

F-7.

j.217005A403.j  :;-- jj jS. -

13.3' j;;

~

G-1 .'-201002A102 '3.3'

' ' ~ '

S H-9. '

290003A203 '3.1- -

.' S' I-7x 212000A201~ '.-3.0  : S' J1- : '-201001A207. 3.~1-'. . -

S

'-'- ' S c239002A203

^

K-3 .

"3.1- - -

ES-301

--2

~

-Form ES3017 Instructions for.Completing.This -Table:.

Check .

ormark 'any item(.s)requ'iring;a comment.and explain th.eissue in'the'space.provid'ed

'using:theguide below.:

1. Check each.JPMfor appropriate/administrative topic.reciulrements~ (COO., EC,- Rad,and EP)or safetyfunction requirements andcorresponding K/A..

Mark incolumn 1

.(ES401, D.3and'DA)

'2.Determine the'.levelof di'fficulty (EOD) using an'estab'lished'1-5rating scale. Levels 1and'5 repres^ent:an:irfappropriate (low orhigh) discriminatorylevel forthe lic'ense that isbeing tested, M.ark in. co.Iumn 2 (Appendix' D,C.1.f)

'.3. Incolumn 3,"Attri'bute's?'check:the.appropnatebox:wheri anattribute isnot'met:.

O Theinitial'.cond'itions and/or initiatin.g cue i'sclearto ensure theoperator understands the.task andhowjo begin. C,BA)

-(Appendix .

O TheJPM

. contains appropria'te cues that clearlyindicatewhen they should bep;rovided to'the.examinee. Cues.are:objectiveand:not leading -(Appendix C,.D.1)'

O AII critical steps(elements) are. properlyidentified.

.O Thescope ofthetask is'nottoonarrow (N).or toobroad.-(B-).

lo Excessiveloverlap^does not occur with Jotherparts of the operating'testor written examination. (ES-301,D.1.a, andES-301',

D.2a).

O.'Th'e taskperformance.standard clearly describes thee'xpected outcom.e'(i.e'., endstate). Each'performancestep standard identifies.a for successful completion ofth'e'step- l:

0 A valid . marked'up'key.was provided (e.g;, graph.'interpretation, initialed steps forharidouts)..'

^4.Forcolumri 4/"Job checkthe Content," appropriate box~if.thejob.coriterit flaw does:not meet-the following elements:A O Topics arelinkedto the job.content(e.g., not a.disguised task,.task recjuiredin real job).'.

O 'The JPMha's meaningfulperforrnance requirementsthat will provide a legitimate basisfor evaluating theapplicant's understa'nd.irig andability tosafely

.operate the plan't. (ES.-'301, D.2'.c)

~

~

5P Based onthe.re'viewer'sjudgment,.is theJPM as'wiitten (U)nacceptable (req'uiring rep.air.orreplacement),.inneed of(E')nhancement., or(S-)atis'factory?Marktheanswer incolumn:5.'

' ' ~

6. Incolurnrr6, provide a'brief descript.ion ofany-(U)nacceptableo'r (E)nhancement rating from col.timn5A Saveinitial review comrnerits anddetai'I. subsequent comment'resolutionso that'each ehm-bourid JPM is'markedby;a'('S)atisfactoryresoluti'on onthis form. -

ES301

- . . '.-.3 -

FormES3017

.Facil'it  : -

Scenario: .1 - -

. Exam'Date: .

1 '. -

2 -. 3 . ~4'. -

5 -- -

'6 -

7 -

8 -

. 9 -

10

.Event' -

~Realism/Cred.

fn*s a" oa e', ,- LOD -'.

TS..CTs.'Ov"e"a'p '.U/E/S'- -

'.Expla'nation 3 2:3 X. S 2.9'--- ~X X S

.2 -

- '- = -

3 . .

.  : '2.9 X

'- S 4 .

3.0 X -

S 5 S

.3.1 .

e .

3.3'- X -- X .

S

'3'.2 X S 7 -

&.3 R SAMEOPERATORACTIONAS EVENT4 INSCENARIO 2.

8 REPLAGEDTHISEVENTWITH NEWEVENT

' ^ . - . .

ES-301' 4 -

. FormES-3017 Facilit : Scenario: 2 ExamDate:

1 . 2 . 3 4 -

5 6 . 7 28 9 -

.10 Event .Realism/Cred.- A*ctns a n -

LOD -) .TS CTs 'O e*"a' 'UlEIS'- -

Explanation

. 1 . -

2.3 X -

=

s 2 2.9 X s

3  : 3.3 -

X X .

s 4 -

3.3 -

X -

X -

. s 5 3.5 .

s 6 .

3.3

'X s

~

7 3.2 X 3 .

.8 -

~

3.2 '- -

s

ES3017 Form 0'

Expa'naion Dae:.

Exam -

'U/E/S

s:

-s 9 s s s s s 5- -

R,'

X 'XX 8

3 7 CTs.

X'.'-X. E X X

~-

Scenario:

6 TS X X'X -'

---30-'-

f '

-.24' 5

LOD.

• ^ -

.2.9-

'3. .3.2

'32 -32' -

4 an --

a*cn

• s .

3 Reaism/Cred.

2.

ES301.

-Faciit Even .4 2 3 5 6 7

6 FormES3017 ES-301 - -

Instructions.for CompletingThis-Tablet Use'this'table for each scenariofor evaluation.

2 -

Checkthisbox if the evenisare.not related (e g.,seismic eve'nt followed byapipe rupture).O.Rif the donot events obey ofphysicsand thelaws thermodynamics.

3,:4' Incolumns 3and check:the b^ox 4, ifthere isnoverifiable orrequiredas actio'n, appl~icablex

~

Exarnples'of'req.uiredac!tions are asfollow.s:jES-301, D.5f)'

opening,closing, andthrottling valves .

. and:stopping' starting equipment'.

andlowering'level, raising flow, and^p^res.sure.

. making decisions andgiving directions ackno.wledgingor verifying keyalarms and ~automatic actions. (U.nc~omplicated'events thatrequiren:o operator this action.beyond.

shouldnot' beincluded.on theoperating test unless th/ey arenecessaryto.set the stage for subse.quent.everit's. B.3).).

(Appendix'D, 5 Checkthis box.ifthe level ofdifficultyis notappropriate.

6. Check thisboxiftheevent hasa TS.

Check thisboxifthe event~has.a critical task If~the same CT.covers more than th^eevent the CT'started.only.-

7 (CT). oneevent, check where

8 Check thisboxiftheevent overlaps with another eivent o^nanyof theI'ast two'NRC:examinations. (Appendix:D, C.1.f).

9' Based onthe reviewer's judgment,is.the'event'as~written (U)nacceptable.(requiririgfepair'or.replace~ment),.in need Markthe of-(E)nhancement,.or-(S)atisfactory?. answer incolumn 9.

10 Record anyexplanations oftheeve~nts here.

Inthe shaded b'oxes, su'm.the^number'of check marks ineach column..

Incolumn 1,sumthe number ofevents.

Incolumns'2-4, record the t otal;number ofcheck marks foreachcolumri.

.. Incolumri 5;based orothe rev~iewer's judgement, place acheckmarkonly jfthescenario's LOD.is not'appropria~te.

inc 6, olurnn TS'are required to b^e a 2for e ach scenario.-.-(ES-30hD.5.d)' A .

7,preidentified CTsshould be2 2 for each'.scenario.

. Incolumn ..'(Append.ix D;ES-301c Q.5^.d;'ES-301-4) .. . . .

Incolumn 8,record.thenumber ofevents:not'used on'the twopreviou's NRCinitial licensing' exa~ms.^Ascenario is x corisidered x unsatisfactoryifthereisy2new events..(;ES-301.,.D20.b; Append'ix D,C.1.f)

. Incoh.irnn 9,record whether:the 'scenari.o'as written (U)nacceptable, .inneed of(F).nhancement,or (S)atisfactory from simulator column11'ofthe scenariotable.-

ES301- . .

~

'.7 Form'ES3017~

Fac.ility: .

. . ExamDate:

1 -

2~

.3

.'4 .

.5 . 6 .

7.--- .8' ' '

1.1 -

Scenario -

"Event.

'Events TS -

'TS CT 'CT %Unsat: -

'Explanation Total Unsat.Total. Unsat, Totals UnsatL Elements 1 8.

3 0 2'- :0 --

12.5 "S 1  :

2- 8 0 .0 -2 0 0' S

..3-3 7. 0. .0 '.3 0 -0. x ---S

~

.3 instructions' forCompleting This Table:

Check ormark anyitem(s).requiring.comment and'explainthe iss.ue in the space p'rovided.

1,3,5.Foreachsimulatorscenario,'enter thetota1number o fevents (colum.n1-), TSentries/actions^(column3), andCTs (colurnn.5). -

This number:shouldmatch the respect~i.vescenario frorn.the eventbased scenario tables'(the sumfrom columns 1,6,:and 7',respectively).

2,4,6 Foreach 'simulator scenario, evaluate each event, TS,:and'.CT a's.(S)atisfactory, (E)nhance, or(U)nsatisfactory based.on the following criteria:.

a. .Events. Each eve'nt'is.described onajForm'ESD-2,'inciliding all switch manipulations, 'pertinentalarms, and'verifiable actions. Event actionsarebalanced between at-the-controls-and balance-of-plant applicants during thescenario. All event-related attributes onFo.rmES-3014 arem'et. Enterthe totalnumb.er of

.uns~atisfactory.events incolumn.2. -

b. T.S. A.scenario includes atleast.twoTS entries/actions across atleast twodifferentevents. TSe'ntries an'da.ctions aredetailed onForm.ES-D-2.. Enter

~the total n'umber.of unsa'tisfactory.TS~entries/actions-irfcohirnn 4.: (E.S401, D.5d). . '. w

c. CT.'Check that ascenariolincludes atleast two'preidentifiedCTs^. ~Thiscriterion i's atarget quantitativ'e attribute, not anabsolute mini.mum requirement.

Check that each CTis;explicitlybounded onForm'ES-D-2 with rneasurabl'e performance standards (seeAppendix D);. Enter the'total number ofu'nsatisfactory CTs'in

.column 6.

-- 2 44+ 6~

g; 7 Incolum.n'7, calculate th'e.percentage of.unsatisfactoryscenario elem.ents: 100%

8 . If the value incolumn7 is> 20^%,markthe sceriarioa.s (U)nsatisfactory in'columni :Ifcolumn '7isi20%, annotate with (E-)nhancement ^or (S)atisfactory.

9. In'column 9,explain each un.sati'sfactory event,"TS,:aridCT. Editorial comrnents canalso be~addedhere.

Saveinitial review comments anddetail's.ubsequent c'omment onthisform.

resolutio'nso'thateachexam-bourid scenarioismarked.by a^(S)atisfa~ctory.resolution

-'-Form.ES3017 8.

ES301

=

Sitename: .Exam Date:

OPERATING.TEST TOTALS Total. Total Total %

al Explanation C lJnsat. .E.di'ts 'Sat. Urisat.-

Admin. MINOR-EDITS TOCLARIFY INITIATING JPMs 9 .~0 3 9.

CUES / '

. ) ~ ~ ~ ~ '

'Sim./In-Plan't 11

~ '

0. 1.0' 11 M.INOR.E!DITS TO'CLARIF'INITIATING JPMs .

CUES SCENARIO 1 EVENT8HADTHESAME

-Sceriar.ios 3

0. 1 3 OPERATOR:A'CTION AS'EVENT 4 IN SCENAR!IO^2'. R.EPLAC'ED-'EVENT 8WITH ' '

NEWEVENT Op.T'est 23 '

O -

14. =

23 'O Totals:

^ '

Instructions for Comple~ting Th'is Table:  :

Update datafor this table from q'ualityreviewsand totalsinthe previous then calculatethe percentage of '

tables and =

tota'I that'are'urisa'tisfactory

^ ^ ~

iterns andgiv.e an. explariation in thespace'provided.'  : '

1 '

Enter the total nurnberofite.ms submitted for the operatin'gtest in.the"Total"Acolurnn. Fo'r examp.Ie,.if C nine administrative JPMsWere subm.itted, 'enter "9"inthe. "Total items colu.rnn.for admi.n.istrative JPMs.

Forsceriarios, enter thetotal num.ber'of simulatorscenarios.

Enter the total 'numbe.r of(U-)nsatisfacto'ry J.PMs andsc'e.narios from th'e twoJPMs column5 and 11  : s'imulator sc'enarios columnf8 'in th'e.previotis tables. Provide ane.xpla'nation 'inthe.space provi.ded.

Enter totalsfor (E)nhancements rieeded and(S)ati.sfactory.J;P.Ms andsceriarios from.theprevious  :

3 ' '

tables." This'task 'is for~t'racking orily.

.4. .

Total eachcolumnand enter theam.ounts inthe"Op. T'est Totals"row.

g -

ACalculat;e' thepercentag.e .ofthe opera'ting test.that is(U)nsatisfactory (Op. Te.st Total Urisat.)/(Op. Tes.t

.  : . Total) andplace valu.e th;i.s inthe bolde.d "%-U.nsat.".cell.

Refer toES-501, E.3.a,torate.the overall operat.ing test asfollows; satisfactory, ifth.el".Op. Test Total" "%Unsat." is520%

:.unsatisfactory, if."Op.Test Total" "%Unsat.":is > 20%

6. ~. Update.this:tableand thetables abovewith post-exam cha.nges if th'e ".as-ad~rninistere.d' op.erating'tes

're.quired contentchanges,.includi.ng thefollowing:

. ~TheJPM performance standards weresincorrect.

. Theadministrative JPMtasks/keys wereincorrect.

/ .

CTsWere incorrec.tiri thes cenarios i'ricludirig

'(riot postscen'ario critical tasks d.efine.d in Appendix D).

. TheIOPstrategy wasincorrect inascenario(s).' '

TSentries/actions were.dete'rmined tobeincorrectan a:scenano s

.