ML18079A546

From kanterella
Jump to navigation Jump to search
Final Qa/Related Forms (Folder 1)
ML18079A546
Person / Time
Site: Limerick  Constellation icon.png
Issue date: 03/27/2018
From: Brian Fuller
Operations Branch I
To:
Exelon Generation Co
Shared Package
ML17138A091 List:
References
U01956
Download: ML18079A546 (20)
v • d • e


Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: LtM~\C..K. '1 z Date of Examination: 12./Je/J, Developed by: Written: Facility r&l NRC D II Operating Facility ~ NRC D Chief Target Task Description (Reference) Examiner's Date*

Initials

1. Examination administration date confirmed (G.1.a; G.2.a-b). For NRG-prepared exams,

-240 arrangements are made for the facility to submit reference materials (G.1.e; G.3.c; Attachment 3). F

-210 2. NRG examiners and facility contact assigned (G.1.d; G.2.f). F

3. Facility contact briefed on security and other requirements (G.2.c). As applicable, the facility

-210 contact submits to the NRG any prescreened K/As for elimination from the written examination outline, with a description of the facility's prescreening process (ES-401, D.1.b).

F

-210 4. Reference material due for NRG-prepared exams (C.1.e; G.3.c; Attachment 3).

N/A

-210 5. Corporate notification letter sent (C.2.e).

~

6. NRG-developed written examination outline (ES-401-1/2 or ES-401 N-1/2 and ES-401-3 or

-195 ES-401 N-3) sent to facility contact (must be on the exam security agreement) (C.1.e-f; G.2.h; C.3.d-e).

~

7. Operating test outline(s) and other checklists due, including Fonns ES-201-2, ES-201-3, ES-301-1,

-150 ES-301-2, ES-301-5, and ES-D-1, as applicable (C.1.e-f; G.3.d-e). F

-136

8. Operating test outline(s) reviewed by the NRG and feedback provided to facility licensee (G.2.h; C.3.d-e).

p

9. Proposed examinations (written, JPMs, and scenarios, as applicable) and outlines (Forms ES-301-1, ES-301-2, ES-D-1, ES-401-1/2 or ES-401 N-1/2, and ES-401-3 or ES-401 N-3);

-75 supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-6, ES-401N-6, and any Form ES-201-2 and ES-201-3 updates); and reference materials due

~

(C.1.e-h; C.3.d).

-75

10. Examinations prepared by the NRG are approved by the NRG supervisor and forwarded for facility licensee review (C.1.i; C.2.h; C.3.f-g). N/A

-60 11. Preliminary waiver/excusal requests due (G.1.m; C.2.c; ES-202). p

-50 12. Written exam and operating test reviews completed (G.3.f). p

13. Examination review results discussed between the NRG and facility licensee (C.1.i; G.1.k-1;

-35 C.2.h; C.3.g). The NRG and the facility licensee conduct exam preparatory week. F

14. Preliminary license applications and waiver/excusal requests, as applicable (NRG Form 398) due

-30 (G.1.m; C.2.i; ES-202). F

15. Final license applications and waiver/excusal requests, as applicable (NRG Form 398), due and

-14 Form ES-201-4 prepared (C.1.m; C.2.k; ES-202). F

-7 16. Written examinations and operating tests approved by the NRG supervisor (G.2.j-k; G.3.h).

F

-7 17. Request facility licensee management feedback on the examination (C.2.1). 'F""

18. Final applications reviewed; one or two (if more than 10) applications audited to confirm

-7 qualifications/eligibility; and examination approval and waiver/excusal letters sent (C.2.k; Attachment 5; ES-202, G.3.j; ES-204).

F

-7 19. Proctoring/written exam administration guidelines reviewed with facility licensee (G.3.k). F

-7 20. Approved scenarios and job performance measures distributed to NRG examiners (G.3.i).

F"

  • Target dates are based on facility-prepared examinations and the examination date identified in the corporate notification letter.

These dates are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

ES-201, Page 29 of 32

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:

Initials Item Task Description a b* c**

1. a. Verify that the outline(s) fit(s) the appropriate model in accordance with ES-401 or ES-401 N. ~ J*vii!! ~

w R

I

b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401 N and whether all K/A categories are appropriately sampled.

f/8 ;;fiar/ er T

T

c. Assess whether the outline overemphasizes any systems, evolutions, or generic topics. fM i .ff;;( ff E

N

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate. 1lYJ ( !#fl( &f
2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major '141 /Y~f &f s transients.

I M b. Assess whether there are enough scenario sets (and spares) to test the projected number and u mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using at f/1/ di!!( Bf A least one new or significantly modified scenario, that no scenarios are duplicated from the T applicants' audit test(s), and that scenarios will not be repeated on subsequent days.

0 C. To the extent possible, assess whether the outline(s) conforms with the qualitative and R

quantitative criteria specified on Form ES-301-4 and described in Appendix D and in Section D.5, "Specific Instructions for the 'Simulator Operating Test,"' of ES-301 (including 1/JIJ 1//fl( BF overlap).

3. a. Verify that the systems walkthrough outline meets the criteria specified on Form ES-301-2:

(1) The outline(s) contains the required number of control room and in-plant tasks distributed w among the safety functions as specified on the form.

A (2) Task repetition from the last two NRC examinations is within the limits specified on the form. f!1 d(d(

L (3) No tasks are duplicated from the applicant's audit test(s). BF K (4) The number of new or modified tasks meets or exceeds the minimums specified on the form.

T (5) The number of alternate-path, low-power, emergency, and radiologically controlled area H tasks meets the criteria on the form.

R 0 b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

1) 1.k(!(

u G

(1) The tasks are distributed among the topics as specified on the form.

(2) At least one task is new or significantly modified. BF H (3) No more than one task is repeated from the last two NRC licensing examinations.

C. Determine whether there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. f/fJ ,i,r Bt 4.

G

a. Assess whether plant-specific priorities (including probabilistic risk assessment and individual plant examination insights) are covered in the appropriate exam sections. 1f1!J (1//( BF E b. Assess whether the 10 CFR 55.41, 55.43, and 55.45 sampling is appropriate. 1M tftl( ff' N

E

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5. 11-0 t,iMI ' BF' R d. Check for duplication and overlap among exam sections and the last two NRC exams. ~ t,1/1( :i5F A

L e. Check the entire exam for balance of coverage. 1/Y) I

/,. 6/ Bf'

f. Assess whether the exam fits the appropriate job level (RO or SRO). f,kJ *,(,(//

h SF a.

b.

C.

d.

Author Facility Reviewer(*)

NRC Chief Examiner(#)

NRC Supervisor

'/,,I "hD A B.n"-'

/r~Signature

.1

'Bn(M\ .:i, f v l\~ / ~ ~--n,.~F/FVM n... t.J E. _L _u,,._.~/

~

( ti/,;;,,, II l/ i,L I / /~;'7,,:,,Ab/_**~

rh W? lJ--

\ J fl.i I

I

  • Not applicable for NRG-prepared examination outlines.
  1. The independent NRC reviewer initials items in column "c"; the chief examiner's concurrence is required.

ES-201 Examination Securit~reement Form ES-201-3

1. Pre-Examination I acknowledge th t have c uired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of ll l'l 11 ... OI as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have no b en authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination rn To the best of my knowl d e, Id" oj divulge to any unauthorized persons any information concerning the NRC licensing examinations administered N during the week(s) of I It 11-01 I. 1J . From the date that I entered into this security agreement until the completion of examination administration, I did

~ not instruct, evaluate, or provide p rformance feedback to those applicants who were administered these licensing examinations, except as specifically

~ noted below and authorized by the NRC.

D>

(0 CD PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

(,.)

-; 1. ~ cJ.1/1 LAH S, ;...w I"1." &, ;r,/,',v,,{,r'" ~ IJr _,-,.. C.~ II<<' IJ11..,

z:; 2. ~ .8tlf"J Aa 4 4 c ~

~/hi==

<~ I

...... 3.Cfld5 jj)h t ex . . -. -IJrc*fC:*"' c:

4. Bo, Fo"'-s*C h,,,,.,., '!,£"ci o,
5. :fc.c..f+/-. A e ~ ,a i,.. ,J:: *r - s ,n~(<<t~-
6. }&;;+;;%,;;;;

terJ 1,.J£Avt::((.

nu IV.AJ 1.

8.--':;~c::i:i:,~~~~-- ?i..~

.];T-.S:A C. $;~<.,/e;,k,,. 5!f.1P 9.__r:.~~~~~

10.~........ ......,~-<.;.&.........

11.,..q.."""""'LL,.~~~-

µ.a..

@a~frw'.

fP5.,.. '

Cl_""> ~('.jf""l/ie§$

M d

M;;r 12 .........=._,,.:.;:~:..;::..--

13.~ dS ~ - s . r 14 ...?/..w ~ ,§/5 S'~

15 .. S z 4 k ~ B.c 8 /P/"1 f'H lie Sell, B-.lu/ L*"",.:ij J./o1Jli NOTES:

ES-201, Page 31 of 32

ES-201 Examination Securi~reement Form ES-201-3

1. Pre-Examination I acknowledge th t have c ired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of 11- If 11 - 01 05 if as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination ill To the best of my knowl d , I di n t divulge to any unauthorized persons any information concerning the NRC licensing examinations administered

~ during the week(s) of , , , * , 0$. fl . From the date that I entered into this security agreement until the completion of examination administration, I did

~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically

~ noted below and authorized by the NRG.

Ill

~ PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE c..>

fle.r::"fz,11.

~~~.-e3.-.. IC... .  %'

  • o{ldt\1M.

~ fr ::e/'\f Ket-c.,1* att13t-T<*

u"'- u"ltr

~

2,ft.e>

fl( 11 CTufl oNt. tlToR.

'2ee '-.\.r £\,...,.....\.,.

Re:G<- 1t1 it d P(i fl ft1! fl.

C)~;"Of\.S Tc"-1oic"f ,tl.tflr

' >trJl

~

R.ckP

&_O 1.-0p..7' :tr51'Jluc..T'c/l NOTES:

ES-201, Page 31 of 32

ES-201 Examination Securit~reement Form ES-201-3 C) Pre-Examination I acknowledge thUt rave rqwred specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC} licensing examinations scheduled for the week(s} of I IS i1 .. 01 o~ rJ as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback}. Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures} and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination ill To the best of my knowle e, I di n t divulge to any unauthorized persons any information concerning the NRC licensing examinations administered

~ during the week(s} of 12. I 11.. 01 a~ I . From the date that I entered into this security agreement until the completion of examination administration, I did

~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically

~ noted below and authorized by the NRC.

D)

<O (D PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

<,)

1. /Jlli~ r1111bw!Pf,f{fZZ .fl
abdOs {}~

z; 2. Jc>HrJ me "'"'o e.c t.£At> 111,)VJ'"QUC. n>L

-" 3.~,!) " " ' " " ~ C2.J,4~ oKL.11'.D~

4. J(v~s :i:, *"' cn..~c IL ..c., _. Ope,"'-.(.;.-
5. )oH..i L SvwVJtZV . . . S'e;;'lllu!t (ZMra1[ti D~::m(l 6.l!)w'AAf (., L{l~((\\°'\... OQS. J:f'JSJ~UC"\l
7. /{e,_Y) -t. l Hi{A +:b S~ni S f.rt1~rC C<;;:;:_;..

- Overo:mr:

8. f t : r ~  :'5e.w,r ~ Of"':!9?<
9. [Ir, cy; //4d,,~ .r 5., ... ;"o,. l2AA"-'~ . f-t{1W>a.ft'C
10. ~,.. i,5C.. llc71U...- S~i*c>> R~lv, Opnc,~J 11 . Jr;,"' f;fO,Q,, litr Our,1(ar 12.* 6' I ('.) /)_"'::, :Z...U-' 1,t/./C,7t!)/(_

13 . .L!:..;~;.s,...=.!~.:.::;:=::;._ *A4,r;;;,. ~-

14 . ~,.tµ:.l.L..!=!J~~'-,f-, ........ .,---

15. -

NOTES:

ES-201, Page 31 of 32

ES-201 Examination Securi~reement Form ES-201-3

1. Pre-Examination I acknowledge that I h ve acqu*r specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of f) °'

/7 - ()/ 'l'( as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons wh lia

  • not b authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination rn To the best of my know e e, I id ot divulge to any unauthorized persons any information concerning the NRC licensing examinations administered N during the week(s) of/ 1'i: 11- o, o I . From the date that I entered into this security agreement until the completion of examination administration, I did

~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically

,J noted below and authorized by the NRC.

D>

~ PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE u)

1. ,<sJ&M~,.. ,-;~ ~ Mft; ~ ~.zc
.-l- ,/~h' z; 2. K'e+,..1ef
:h 6SM4- cQqs,..,)1.J &: r d:.NYM'fll. 1/,if,f

...... 3. ~ I f .M tt:ie-µ

4. fc,-1 "{ µ ,G /.I tOw.#:

0 Ps. 7[M,.vrllbt

~ i' VII\A ,'\JA{ke'e IAJS'") 1/lf/ll

~-

13:"l??Op 5(./C/t:f~..f 6.~~----

0,'.J r&fioVt?? /A/.t#U,/74-0.,,:::, ~ / - - ' ~ ~ ~

(J_ - -

1 --

7.~~~~~~~

8.~~~~~~~

9.~~-~-~~

10.~~--~~~

11 . ~ - - ~ - - -

12 . ~ - - - - - -

13 . ~ - - - - - -

14 15.. _

~_ -_ -_ --_- _- _

NOTES:

ES-201, Page 31 of 32

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Limerick Date of Examination: 12/18/17 Operatinq Test Number: 001 Initials

1. General Criteria a b* c#
a. The operating test conforms to the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). 14~ 1t:ftd sr
b. There is no day-to-day repetition between this and other operating tests to be administered durinQ this examination.

TM u}ltif Sf"

c. The operatinQ test shall not duplicate items from the applicants' audit test(s) (see Section D.1.a.). '(,61 1iAa{ SF"
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits. r~ 11:tJ( BF
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.

1"~ 1,tfa/ Sf

2. Walkthrough Criteria -- -- --
a. Each JPM includes the following, as applicable:

.. initial conditions initiating cues

. references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific r~ (11{&( 61='

. designation if deemed to be time critical by the facility licensee operationally important specific performance criteria that include-

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walkthrough outlines (Forms ES-301-1 and ES-301-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC 1-fPJ tilU( 8F examinations) specified on those forms and Form ES-201-2.
3. Simulator Criteria -- -- --

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4, and a copy is attached .

1"M 114/t;( bF

.,,- P~#'nature Date

a. Author /o,,/el A B1tr1 / *1, , / I() l!JJ,._:,

1-C -l> //;~4;,_ 1','. ;.&"'*"" ~

~

[1/,.,,.1 b.

c.

Facility Reviewer(*)

NRC Chief Examiner(#)

If

'8,~ ullct'/*~

,,.,, o,i / \ ~

I f}," &.\.,. f. (.. ~}\, ,/&\. } 'Ft',

I I /

d. NRC Supervisor I ltl,_l_[Cl

\. /

  • The facility licensee signature is not applicable for NRG-developed tests.
  1. The independent NRC reviewer initials items in column "c"; the chief examiner concurrence is required.

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Limerick Date of Exam: 12/18/17 Scenario Numbers: 1 I 2 / 3 Operating Test No.: 1 QUALITATIVE ATTRIBUTES Initials a b* c*

1. The initial conditions are realistic in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.

'f.&'J ~)Ht:( af'

2. The scenarios consist mostly of related events. f,4o iiU#f r,f"
3. Each event description consists of the following:
  • the point in the scenario when it is to be initiated
  • the malfunction(s) or conditions that are entered to initiate the event 1P'J ,cW.ttf SF
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable)
4. The events are valid with regard to physics and thermodynamics. 1/)(J 1ulJ/!I/ Bf
5. Sequencing and timing of events is reasonable and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. 1/JI lui&I SF
6. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

1'AtJ ttfltr!

PF

7. The simulator modeling is not altered. 1'~ 11;/,'1( 6P
8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

w rd/4( 13f

9. Scenarios are new or significantly modified in accordance with Section D.5 of ES-301. 1P dliltf 8F
10. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the f,tl form along with the simulator scenarios). <</lilt/ SF
11. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency rating factors as described on Forms ES-303-1 and ES-303-3.) 1"/Ja llit{ 6F
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios). 1~ tdtltl 6F
13. Applicants are evaluated on a similar number of preidentified critical tasks across scenarios, when possible. 1',4tJ {tl/rti 6F
14. The level of difficulty is appropriate to support licensing decisions for each crew position. 1,4.8 /iJ/1,'J BF Target Quantitative Attributes per Scenario (See Section D.5.d) Actual Attributes -- -- --
1. Malfunctions after EOP entry (1-2) 3 / 2 I 2 1"hl /; ,;{7,1,' 6f
2. Abnormal events (2-4) 3 / 4 / 4 1/l/J ti~riri ~F
3. Major transients ( 1-2) 1 / 1 / 1 ~ /14 ~l BF
4. EOPs entered/requiring substantive actions (1-2) 2 I 1 / 1 1"JJ 1//J ~1 RF
5. Entry into a contingency EOP with substantive actions (~ 1 per scenario 2 I 1 / 1 set) 11h l,i/1(; BF
6. Preidentified critical tasks (> 2) 4 / 3 / 4 1"(fJ 1rifJ1 eF
  • The facility licensee signature is not applicable for NRG-developed tests.
  1. An independent NRC reviewer initials items in column "c"; chief examiner concurrence is required.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Limerick Date of Exam: 12/18/2017 Operating Test No.: 1 A E Scenarios p V p (1)2159E (2) 4158E (3) 6217E (4) 3005E Spare T M E

0 I L N CREW POSITION CREW POSITION CREW POSITION CREW POSITION N

I T T C

s A B s A B s A B s A B A

I R T 0 R T 0 R T 0 R T 0 M A T p p p p L N y 0 C 0 C 0 C 0 C u p M(*)

T E R I u RX 0 1 1 0 NOR O* 1 1 1 SRO-U (1) 1/C 2,3,4 6 4 4 2 6,7,8 MAJ 5 1 2 2 1 TS 3,4 2 0 2 2 RX 0 1 1 0 NOR O* 1 1 1 SRO-U (2) 1/C 2,3,4 6 4 4 2 5,6,9 MAJ 7 1 2 2 1 TS 3,4,5 3 0 2 2 RX 2 1 1 1 0 NOR O* 1 1 1 SRO-I (1) 1/C 2,3,4 1,4 2,3,4 14 4 4 2 6,7,8 5,6,9 MAJ 5 5 7 3 2 2 1 TS 3,4 3,4,5 5 0 2 2 RX 1 1 1 1 0 NOR O* 1 1 1 SRO-I (2) 1/C 1,2,3 2,5,8 9 4 4 2 4,6,7 MAJ 5 7 2 2 2 1 TS 2,3 2 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (1/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one 1/C malfunction can be credited toward the two 1/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional 1/C malfunctions on a one-for-one basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.
4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Limerick Date of Exam: 12/18/2017 Operating Test No.: 1 A E Scenarios p V p (1) 2159E (2) 4158E (3) 6217E (4) 3005E Spare T M E

0 I L N CREW POSITION CREW POSITION CREW POSITION CREW POSITION T N I T C

s A B s A B s A B s A B A

I R T 0 R T 0 R T 0 R T 0 M A T N y 0 C p 0 C p 0 C p 0 C p L u p M(*)

T E R I u RX 4 1 1 1 0 NOR O* 1 1 1 SRO-I (3) 1/C 2,3,6 1,2,3 9 4 4 2 4,6,7 MAJ 5 5 2 2 2 1 TS 2,3 2 0 2 2 RX 1 1 1 1 0 NOR 1 1 1 1 1 R0-1 1/C 2.4,7 1,2,3 2,5,8 12 4 4 2 8 6,7 MAJ 5 5 7 3 2 2 1 TS 0 0 2 2 RX 4 1 1 1 0 NOR O* 1 1 1 1/C 2,3,6 1,2,3 3.4.6 12 4 4 2 R0-2 6,7 9 MAJ 5 5 7 3 2 2 1 TS 0 0 2 2 RX 2 1 1 1 0 NOR 1 1 1 1 1 1/C 2.4,7 1.4 3,4,6 10 4 4 2 R0-3 8 9 MAJ 5 5 7 3 2 2 1 TS 0 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (1/C) malfunctions and one major transient. in the ATC position. If an SRO-I additionally serves in the BOP position. one 1/C malfunction can be credited toward the two 1/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section 0.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional 1/C malfunctions on a one-for-one basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.
4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Competencies Checklist Form ES-301-6 Facility: Limerick Date of Examination: 12/18/17 Operating Test No.: 001 APPLICANTS SRO-U (1) SRO-U (2) SRO-I (1) SRO-I (2)

Competencies SCENARIO SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 Interpret/Diagnose Events 2-8 2-9 2-8 1,2 2-9 1-8 1,2 4-6 and Conditions 5,6 8

Comply with and 2-8 1-7,9 2-8 1,2 1-7 1-8 1,2 4-6 9 Use Procedures (1) 5,6 Operate Control 1,2 1,2 Boards (2) 4-6 5,6 Communicate 1-8 1-9 1-8 1,2 1-9 1-8 1,2 4-6 and Interact 5-8 Demonstrate Supervisory 2-8 1-7,9 2-8 1- 1-8 Ability (3) 7,9 Comply with and 3,4 3-4 3,4 3-4 2,3 Use TS (3)

Notes:

( 1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-301 Competencies Checklist Form ES-301-6 Facility: Limerick Date of Examination: 12/18/17 Operating Test No.: 001 APPLICANTS SRO-I (3) R0-1 R0-2 R0-3 Competencies SCENARIO SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 lnterpreUDiagnose Events 2-6 1-8 2,4,5 1-3 1,2 2-6 1-3 3,4 2,4,5 1,2 3,4 7,8 7-8 5,6 7-8 6,9 7,8 4-6 6,9 and Conditions 8

Comply with and 2-6 1-8 2,4,5 1-3 1,2 2-6 1-3 3,4 2,4,5 1,2 3,4 7,8 7-8 5,6 7-8 6,9 7,8 4-6 6,9 Use Procedures (1)

Operate Control 2-6 1,2,4 1-3 1,2 2-6 1-3 3,4 1,2,4 1,2 3,4 5,7,8 7-8 5,6 7-8 6,9 5,7,8 4-6 6,9 Boards (2)

Communicate 2-6 1-8 1,2,4 1-3 1,2 2-6 1-3 3,4 1,2,4 1,2 3,4 5,7,8 7-8 5-8 7-8 6,9 5,7,8 4-6 6,9 and Interact Demonstrate Supervisory 1-8 Ability (3)

Comply with and 2,3 Use TS (3)

Notes:

( 1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Limerick Units 1 and 2 Exam Date: 12/18/17 1 2 3 4 5 6 ADMIN Attributes Job Content LOD Admin JPMs I Topic (1-5) 1---~----.~~-r-~~-r-~~-r-~~----.~~-r-~~+--~~~~~---1 I

U/E/S Explanation and KIA 1/C Critical I Scope I I Perf.

Job Cues I I I Overlap I I Key I Minutia Link Focus I I Steps I (N/B) I I Std.

a. coo 3 s
b. coo 2 s C. EC 3 s
d. RC 2 s
e. EP 3 s s

Simulator/In-Plant I Safety Function JPMs and KIA

a. 1 3 s
b. 2 3 s C. 3 3 s
d. 4 2 s
e. 5 3 s
f. 6 3 s
g. 8 2 s
h. 9 3 s
i. 2 3 s
j. 3 3 s
k. 7 2 s

ES-301 2 Form ES-301-7 Instructions for Completing This Table:

Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.

1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.

(ES-301, D.3 and D.4)

2. Determine the level of difficulty (LOO) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
3. In column 3, "Attributes," check the appropriate box when an attribute is not met:

IJ The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)

D The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)

All critical steps (elements) are properly identified.

L The scope of the task is not too narrow (N) or too broad (B).

n Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)

[ The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.

11 A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).

4. For column 4, "Job Content," check the appropriate box if the job content flaw does not meet the following elements:

iI Topics are linked to the job content (e.g., not a disguised task, task required in real job).

11 The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)

5. Based on the reviewer's judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
6. In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.

Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.

ES-301 3 Form ES-301-7 Facility: Limerick Units 1 and 2 Scenario: Exam Date: 12/18/2017 1 2 3 4 5 6 7 8 9 10 Required Verifiable Seen.

Event Realism/Cred. LOO TS CTs U/E/S Explanation Actions actions Overlap

1. E1 X s E2 X s E3 s E4 X s E5 s E6 X s E7 X s EB s 2.E1 s E2 X s E3 X s E4 s E5 X s E6 X s E7 X s
3. E1 s E2 s E3 X s E4 X s E5 X s E6 s

ES-301 4 Form ES-301-7 E? X s E8 X s E9 X s 8 /7 I 9 0 0 0

ES-301 5 Form ES-301-7 Instructions for Completing This Table:

  • Use this table for each scenario for evaluation.

2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.

3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f)

  • opening, closing, and throttling valves
  • starting and stopping equipment
  • raising and lowering level, flow, and pressure
  • making decisions and giving directions
  • acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).)

5 Check this box if the level of difficulty is not appropriate.

6 Check this box if the event has a TS.

7 Check this box if the event has a critical task {CT). If the same CT covers more than one event, check the event where the CT started only.

8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewer's judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.

10 Record any explanations of the events here.

In the shaded boxes, sum the number of check marks in each column.

  • In column 1, sum the number of events .
  • In columns 2-4, record the total number of check marks for each column .
  • In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOO is not appropriate .
  • In column 6, TS are required to be~ 2 for each scenario. (ES-301, 0.5.d)
  • In column 7, preidentified CTs should be :2: 2 for each scenario. (Appendix D; ES-301, 0.5.d; ES-301-4)
  • In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is< 2 new events. (ES-301, 0.5.b; Appendix D, C.1.f)
  • In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.

ES-301 6 Form ES-301-7 Facility: Limerick Units 1 and 2 Exam Date: 12/18/2017 1 2 3 4 5 6 7 8 11 Scenario  % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.

Elements 1 8 0 2 0 3 0 0 s 2 7 0 2 0 3 0 0 s 3 9 0 3 0 3 0 0 s Instructions for Completing This Table:

Check or mark any item(s) requiring comment and explain the issue in the space provided.

1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).

This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).

2,4,6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:

a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)

C. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-0-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.

7 In column 7, calculate the percentage of unsatisfactory scenario elements: (21 ++ 43 ++ 6)5 100%

8 If the value in column 7 is> 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is:,:; 20%, annotate with (E)nhancement or (S)atisfactory.

9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.

Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.

ES-301 7 Form ES-301-7 Site name: Limerick Units 1 and 2 Exam Date: 12/18/2017 OPERATING TEST TOTALS Total Total Total Total Explanation Unsat. Edits Sat.

Admin.

5 0 0 5 JPMs Sim ./In-Plant 10 0 0 10 JPMs Scenarios 3 0 0 3 Op. Test 18 0 0 18 0 Totals:

Instructions for Completing This Table:

Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.

1. Enter the total number of items submitted for the operating test in the "Total" column. For example, if nine administrative JPMs were submitted, enter "9" in the "Total" items column for administrative JPMs.

For scenarios, enter the total number of simulator scenarios.

Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.

simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.

Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.

tables. This task is for tracking only.

4. Total each column and enter the amounts in the "Op. Test Totals" row.

Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.

Total) and place this value in the balded"% Unsat." cell.

Refer to ES-501, E.3.a, to rate the overall operating test as follows:

  • satisfactory, if the "Op. Test Total""% Unsat." is :s; 20%
  • unsatisfactory, if "Op. Test Total""% Unsat." is> 20%

Update this table and the tables above with post-exam changes if the "as-administered" operating test 6.

required content changes, including the following:

  • The JPM performance standards were incorrect.
  • The administrative JPM tasks/keys were incorrect.
  • CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).
  • The EOP strategy was incorrect in a scenario(s) .
  • TS entries/actions were determined to be incorrect in a scenario(s) .

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Date of Exam: 01/o"lj,Y Exam Level: RO ~ SRO Item Description Initials a b C

1. Clean answer sheets copied before grading
2. Answer key changes and question deletions justified and documented
3. Applicants' scores checked for addition errors SF (reviewers spot check> 25% of examinations)
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail
5. All other failing examinations checked to ensure that grades are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Date Printed Name/Signature 1/l/8'
b. Facility Reviewer(*)

-/oore,,

(I 0,/t,1/(i

c. NRC Chief Examiner (*)

~~~o,foo/,s

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

Retrieved from "https://kanterella.com/w/index.php?title=ML18079A546&oldid=2506497"