ML20260H151

NRC Comments on Draft Licensee-Developed Operating Test (Folder 2)

ML20260H151
Person / Time
Site:	FitzPatrick
Issue date:	10/14/2019
From:	Todd Fish Operations Branch I
To:	Exelon Generation Co
Fish T
Shared Package
ML19105A122	List: ML20043C809 ML20087G852 ML20087H514 ML20260H150 ML20260H151 ML20260H152 ML20260H153 ML20260H154 ML21056A284 ML21056A285 ML21056A306 ML21056A307
References
CAC 000500
Download: ML20260H151 (11)

Text

Facility:

James A. Fitzpatrick ExamDate:

Feb2020 1 2 3 4 5 6 ADMIN Attributes JobContent Admin JPMs LOD Topic U/E/S Explanation andK/A (1-5) l/C Critical Scope Perf.

Cues Overlap Job Key Minutia Link Focus Steps (N/B) Std.

ROC001 C0109 2 S ROCOO2 2 3 3 S ROEC 2.21 3 S RORC 2 34 3 S SROC001 COO E Rearranged onSROworksheet.

2.1.19 2 order ofquestions SROCOO2 2 8 3 S SROEC EC E Deleted ofJPMstep9.

2.2.41 3 extraneous part SRORC RC E Revised 2.3.4 3 staytime for wording clarity SROEP 2.4.40 3 S 1

Safety Simulator/In-Plant Function JPMs andK/A 9

A 290003 2 x E Madeadditional stepcritical.

A4.01 2

B 259001 3 S A4.01 4

C 209001 2 x E Changed initial tomakeadditional conditions step cmial.

A4.01 6

D 262001 3+ S A4.01

5 E 223002 4 S A4.03 F 3 x E Revised task Addedmore standard. detailed indicator 201001 descriptors.

A2.07 3

G 239001 2 S A4.01 7

H 215005 3 S A4.06 5

I 223002 2 S A2.09 6

J 295003 3+ S AA1.04 1

K 201001 2 S 2.1.20

ES301 3 FormES301-7 Instructions for Completing This Table:

Check ormarkany item(s) requiring a comment andexplain theissue inthe space provided using the guidebelow.

1. Check each JPM for appropriate administrative topic requirements (COO, EC,Rad,andEP) orsafetyfunction requirements K/A.

andcorresponding Markincolumn1.

(ES-301, D.3and D.4)

2. Determine thelevel of difficulty (LOD) using anestablished 1-5rating scale. Levels 1and5 represent (low aninappropriate orhigh) for level discriminatory thelicense thatisbeing tested. Mark in column 2 (Appendix D,C.1.f)

3. Incolumn 3,"Attributes," check the appropriate boxwhenanattribute isnotmet:

o Theinitial conditions and/or initiating cueis clear toensure theoperator understands thetaskandhowtobegin. C,B.4)

(Appendix o TheJPMcontains appropriate cues that clearly indicate whenthey should beprovided tothe examinee. andnotleading.

Cuesareobjective (AppendixC,D.1) o AII critical steps (elements) areproperly identified.

O Thescope ofthetask isnottoonarrow (N) ortoobroad (B).

O Excessive overlap does notoccur withother parts ofthe operating test orwritten examination. (ES-301, D.1.a, D.2.a) andES-301, o Thetask performance standard clearly describes the expected outcome ( i.e.,

end state).Each p erformance stepidentifies a standard for successful completion ofthestep.

o A valid marked upkeywasprovided (e.g., graph interpretation, initialed steps for handouts).

4. Forcolumn 4,"Job Content," check theappropriate boxif the job content flaw doesnotmeetthefollowing elements:

o Topics are linked tothe jobcontent (e.g.,nota disguised task, task required inreal job).

o TheJPMhasmeaningful performance requirements thatwill provide a legitimate basis forevaluating theapplicant's understanding andability tosafely operate theplant. (ES-301, D.2.c)

5. Based onthereviewer's judgment, isthe JPMaswritten (U)nacceptable (requiring repairor replacement),inneed (S)atisfactory?

of(E)nhancement, or Marktheanswer incolumn 5.

6. Incolumn 6,provide a brief description ofany(U)nacceptable or(E)nhancement rating from column 5.

Saveinitial reviewcomments anddetail subsequent comment resolution sothat eachexam-bound JPM ismarked resolution bya (S)atisfactory onthis form.

ES301 4 FormES301-7 Facilit

James A. Fitz atrick Scenario:

1 ExamDate:

Feb2020 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred. *@t*sdVge a e LOD TS CTs gSyc9en9.p U/E/S Explanation 1 s 2 X S 3 X X S 4 X S 5 S 6 X S 7 X X S 8 S 9 X X S 9 2 2 4

ES-301 5 FormES301-7 Facilit:James A. Fitz atrick Scenario:2 ExamDate:

Feb2020 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred. *c9t oan n*sde;itLOD

• TS CTs O e*"a^p U/E/S Explanation 1 s 2 X S 3 S 4 X S 5 X X S 6 S 7 X S 8 X X S 8 2 2 5

ES301 6 FormES301-7 Facilit

James A. Fitz atrick Scenario:

3 ExamDate: Feb2020 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred. *c9t Va*

n*sd "n

• LOD TS CTs OSyce*"dp U/E/S Explanation 1 U Replaced tolimit event potential JPMF with overlap 2 X S 3 X S 4 X (*) X S *This eventreuires TSdeterminations tomaketwose arate a licant 5 S 6 X S 7 X X S 8 X S 9 X S 9 1 2 3

ES301 7 FormES3017 Facilit

James A. Fitz atrick Scenario:

4 ExamDate:

Feb2020 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred. Required Ve able LOD TS CTs O e*"a'p U/E/S Explanation 1 X S 2 X S 3 X S 4 S 5 X E Added TSent reardinotential detail 6 X S 7 X X S 8 X S 9 X X S 9 2 3 4

ES301 8 FormES3017 Facilit

James A. Fitz atrick Scenario:5 S are ExamDate:Feb2020 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred. V9e n*sd Sc9t an

• LOD TS CTs Ov I"a^p U/E/S Explanation 1 s 2 X S 3 X S 4 X S 5 S 6 X S 7 X X S 8 X S 8 2 2 5

ES301 9 FormES301-7 forCompleting This Instructions Table:

Usethis tablefor each scenario for evaluation.

2 Checkthis boxif theevents arenotrelated (e.g.,seismic event followed byapipe rupture) ORif the events donotobey thelaws andthermodynamics.

ofphysics 3,4 Incolumns 3and4,check the boxif there isnoverifiable orrequired asapplicable.

action, Examples ofrequired areasfollows:

actions (ES-301, D.5f)

. opening,closing, andthrottling valves

. starting andstopping equipment

. raising andlowering level, flow, and pressure

. making decisions andgiving directions

. acknowledging orverifying keyalarms and automatic actions (Uncomplicated events that require action nooperator this beyond should included not be on the o perating test unless they are necessary t he toset stage for subsequent events. D, (Appendix B.3).)

5 Check boxif this thelevel ofdifficulty isnotappropriate.

6 Checkthisboxif theevent hasa TS.

7 Check boxif this theevent hasacritical task (CT). Ifthe same CTcovers more than oneevent, check theevent wheretheCTstarted only.

8 Check boxif this theevent overlaps with another event onany ofthelast twoNRCexaminations. (Appendix D,C.1.f) 9 Basedonthereviewer's judgment, istheevent aswritten (U)nacceptable repair (requiring orreplacement), inneedof(E)nhancement, theanswer or(S)atisfactory?

Mark incolumn 9.

10 Record anyexplanations oftheevents here.

shaded Inthe boxes, sumthenumber ofcheck marks ineach column.

. Incolumnsumthenumber 1, ofevents.

. Incolumns 2-4, record the total number ofcheck marks for eachcolumn.

. Incolumn 5, based on the reviewer's judgement, place a checkmark only ifthe scenario's LODisnotappropriate.

. Incolumn 6,TSarerequired tobe2 2for eachscenario. (ES-301, D.5.d)

. Incolumn 7,preidentified CTsshould be2 2for eachscenario. (Appendix D;ES-301, D.5.d; ES-301-4)

. Incolumn 8,record thenumber ofevents notused onthetwoprevious NRCinitial licensing exams. A scenario isconsidered unsatisfactoryif there is< 2 newevents. (ES-301, D.5.b; Appendix D,C.1.f)

. Incolumn 9,record whether thescenario aswritten (U)nacceptable, inneedof(E)nhancement, or (S)atisfactory from column11ofthesimulator scenariotable.

ES301 10 FormES301-7 Facility: ExamDate: FEB2020 1 2 3 4 5 6 7 8 11 Scenario  % Unsat Explanation Event Events TS TS CT CT

• "8"0 Totals Unsat. Total Unsat.TotalUnsat.

Elements 1 9 2 2 0 S 2 8 2 2 0 S 3 9 1 2 2 11 S Seescenario #3Table,above 4 9 2 3 0 S 5 (Spare) 8 2 2 0 S for Instructions Completing This Table:

Check ormarkanyitem(s)requiring comment andexplainthe issue inthe space provided.

1,3,5 Foreach scenario, simulator enter the totalnumber of events (column 1), TSentries/actions (column 3), andCTs(column 5).

Thisnumber should match the scenario respective from the event-based scenario tables (thesum from c olumns 1, 6,and 7, respectively).

2,4,6 Foreach simulatorscenario, evaluateeach TS,andCT as (S)atisfactory, (E)nhance, event, or(U)nsatisfactory based onthe following criteria:

a. Events. Each eventisdescribedona FormES-D-2, including allswitch manipulations,pertinent andverifiable alarms, Event actions. arebalanced actions between at-the-controls andbalance-of-plant applicants during thescenario. All event-related onFormES-301-4 attributes aremet.Enter number thetotal of unsatisfactory eventsincolumn 2.

b. TS.A scenario includes twoTSentries/actions atleast across atleast twodifferentevents. TSentriesandactions onFormES-D-2.

aredetailed Enter thetotal number TSentries/actions ofunsatisfactory incolumn 4.(ES-301, D.5d)

c. CL Check that a scenarioincludes atleasttwopreidentified CTs.Thiscriterion isa target attribute, quantitative notanabsoluteminimum Check requirement.

thateach CTisexplicitly bounded onFormES-D-2 with measurable performance standards (see AppendixD). Enter thetotal numberofunsatisfactory CTsin column 6.

7 8

Incolumn If 7,calculate thevalueincolumn thepercentage ofunsatisfactory 7 is> 20%,markthescenario scenario elements:

as(U)nsatisfactory (2

incolumn

+ 4 + 6) 1 + 3+ 5/

8.If column 7 is 5 20%, annotate with or(S)atisfactory.

(E)nhancement 9 incolumn 9,explaineachunsatisfactory TS,andCT.Editorial event, comments canalso beadded here.

Saveinitial reviewcomments anddetail subsequentcomment resolution sothat eachexam-bound scenario ismarked bya (S)atisfactory resolution form.

onthis

ES301 11 FormES3017 Sitename: James A.Fitzpatrick ExamDate: February 2020 OPERATING TESTTOTALS Total Total Total %

Total Explanation Unsat. Edits Sat. Unsat.

Admin. 9 0 3 6 JPMs Sim./In-Plant 11 0 3 8 JPMs Scenarios 5 0 0 5 Op.Test 25 0 6 19 0 Totals:

Instructions forCompleting This Table:

Updatedatafor thistable from qualityreviews andtotals intheprevioustables and then calculate the percentage of total items areunsatisfactory that andgive anexplanation inthespace provided.

1. Enter the total number ofitems submitted fortheoperating test inthe "Total" column.For example, if nine administrative JPMswere submitted,enter"9"inthe "Total" items column for administrative JPMs.

Forscenarios, enter the totalnumber ofsimulator scenarios.

2' Enter thetotal number of(U)nsatisfactoryJPMsandscenarios from the twoJPMs column 5and simulator scenarios column 8 intheprevious tables.Provide anexplanation inthe space provided.

3' Enter totalsfor (E)nhancements needed and(S)atisfactoryJPMsandscenarios from the previous tables. Thistask isfortrackingonly.

4. Total each column andenter the amounts inthe"Op.Test Totals" row.

5' Calculate thepercentage ofthe operatingtestthatis(U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test Total) andplace this value inthebolded "%Unsat." cell.

Refer toES-501, E.3.a,torate theoveralloperatingtestasfollows:

satisfactory,ifthe "Op. TestTotal" "%Unsat." s is 20%

unsatisfactory, "Op.

if TestTotal""%Unsat." is> 20%

6 Update this table andthe tables above with post-examchanges ifthe"as-administered" operating test required content changes, including thefollowing:

. TheJPMperformance standardswere incorrect.

. Theadministrative JPMtasks/keys wereincorrect.

CTswereincorrect inthe scenarios (notincludingpostscenario criticaltasks defined in Appendix D).

. TheEOPstrategy wasincorrect ina scenario(s).

. TSentries/actions were determined tobeincorrect ina scenario s .

i