ML14141A188

From kanterella
Jump to navigation Jump to search

Final Qa/Related Forms (Folder 1)
ML14141A188
Person / Time
Site: Pilgrim
Issue date: 03/31/2014
From: D'Antonio J
Operations Branch I
To:
Entergy Gulf States Louisiana
Jackson D
Shared Package
ML13295A007 List:
References
TAC U01876
Download: ML14141A188 (21)
v • d • e


Text

{{#Wiki_filter:ES-201 Examination Preparation Checklis:::.:t ____ __;_F.=o.:..:rm~E::;:S:::.;.*=2~01.!..:*:.!1 Facility: e_t. (. (, p,;, Date of Examination: ~(1i-Z-j ~ Examinations Developed by: Facility I NRC (circle one) V>l 'I Target Chief Date* Task Description (Reference) Examiner's Initials -180

1.

Examination administration date confirmed (C.1.a; C.2.a and b) 4 -120

2.

NRC examiners and facility contact assigned (C.1.d; C.2.e) ~ -120

3.

Facility contact briefed on security and other requirem1ents (C.2.c) ~ -120

4.

Corporate notification letter sent (C.2.d)

  • ~

[-90] (5. Reference material due (C.1.e; C.3.c; Attachment 2)] ~ \\~ -75

6.

Integrated examination outline(s) due, including Fonns ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and 4 ES-401-4, as applicable (C.1.e and f; C.3.d) ( -70

7.

Examination outline(s) reviewed by NRC and feedback provided to facility ~- licensee (C.2.h; C.3.e) -45

8.

Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference 4 materials due (C.1.e, f, g and h; C.3.d) -30

9.

Preliminary license applications (NRC Form 398's) dUE~ (C.1.1; C.2.g; fr ES-202) t* -14

10. Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; 4-ES-202)

-14

11. Examination approved by NRC supervisor for facility licensee review 4

(C.2.h; C.3.f) -14

12. Examinations reviewed with facility licensee (C.1.j; C2.f and h; C.3.g) 4

-7

13. Written examinations and operating tests approved by NRC supervisor

/t (C.2.i; C.3.h) -7

14. Final applications reviewed; examination approval and waiver letters sent 4 (C.2.i; Attachment 4; ES-204)

-7

15. Proctoring/written exam administration guidelines reviewed It with facility licensee (C.3.k)

-7

16. Approved scenarios, job performance measures, and questions
t distributed to NRC examiners (C.3.i)

Target dates are keyed to the examination date identified in the c;orporate notification letter. They are for planning purposes and may be adjusted on a case-by-c-..ase basis in coordination with the facility licensee. [ 1 Applies only to examinations prepared by the NRC. ES-201, Page 24 of 27

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination: Initials Item Task Description b* a c#

1.
a.

Verify that the outline(s) fit(s) the appropriate model, in accordance with IES-401. w .1JA cL ~ R

b.

Assess whether the outline was systematically and randomly prepamd in accordance with 1lY_ C~- p/ I Section D.1 of ES-401 and whether all KJA categories are appropriately sampled. T /w?. le(_ /f T

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

E N

d. Assess whether the justifications for deselected or rejected KJA statements are appropriate.

WJj '~oL r

2.
a.

Using Form ES-301-5, verify that the proposed scenario sets cover the required number ~I ~CG of normal evolutions, instrument and component failures. technical specil'ications, tY s and major transients. I M

b.

Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule WJ ~ tV' L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. 0 To the extent possible, assess whether the outline(s) conform(s) with the qualitative ~j o(t(_ rv R

c.

and quantitative criteria specified on Form ES-301-4 and described In Appendix D.

3.

~that the systems walk-through outline meets the criteria specifi!ld on Form ES-301-2: the outline(s) contain(s) the required number of control room and in-plant tasks w If""'"" amoog tho oatoty f~tlooo M '"'""'"' oo the to~ I sk repetition from the last two NRC examinations is within the lim~s specified on the form ~~ T o tasks are duplicated from the applicants' audit test(s) {/j r( e number of new or modified tasks meets or exceeds the minimums specified on the form e number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b~IJ"t the admtot,;catt" o"'lioo moo~ the ctltotl* "Htod oo Fo~ ES-30H W!J ~ti-* c( l:fthe tasks are distributed among the topics as specified on the form at least one task is new or significantly modified Yno more than one task is repeated from the last two NRC licensing examinations

c.

Determine if there are enough different outlines to test the projected number and mix llA ~cV f)/ of applicants and ensure that no items are duplicated on subsequent days.

4.
a.

Assess whether plant-specific priorities (including PRA and IPE insights) are covered ~ J.~ ry in the appropriate exam sections. G qf)! c\\oe-v E

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N Ensure that KJA importance ratings (except for plant-specific priorities) are at least 2.5. /)j./j ~0'-' (\\- E

c.

A R

d. Check for duplication and overlap among exam sections.

~.-j de(; ( A rn vv L

e. Check the entire exam for balance of coverage.

doL--

f.

Assess whether the exam fits the appropriate job level (RO or SRO). i1'!L_ oj()(.. rt. J'v1 }f ~ f, Print~ ... Name/~atur, ~- Date

a. Author a<'

t1 1 C< ao ~/-.... f!!!&.-~ ~ -//;3

b. Facility Reviewer (")

Jf'\\1'\\0Y.C.on~ Oj /1 a~

'1 t'l.. f, 3
c. NRC Chief Examiner(#)
r. 9 A,./f:O,~ /'/ Jvvlf 1'1. f\\.--~

!],- '7:1~:;)

d. NRC Supervisor

~~ lrl J cu~~" L / Q.Jjt V Y..u-:::==";;::- t/iJl'i'- f..._/ I) Note:

  1. Independent NRC reviewer initial items in Column "c"; chief *examiner concurrence required.
  • Not applicable for NRC-prepared examination outlines

0 v ~ ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week( s) of ""tf',, '1 of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have notee'n authorized by the NRC chief examiner. I understand that I am not to instruct. evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration. except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowrN,ZJ;id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week{s) of 1 1 . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY DATE DATE NOTE ~---!!Z... I ~ f "jlll '\\loji~ vn* *- .---~******!.1\\.0y-iAJo'\\ ,f\\J~$lC7-H'[" ~11;1 ~ ~ l1*l . -~1 . ~ -" ---#;,~, /~ n-- '",...,,.-- }............---:0 c:iL1,~ f!.J ~,..~t\\,}-~4t..).l]'> ~ ~~ !lf'f!;!'* __ J 3".t' f tNI'iW , ~~ &rrz () ts/ft{ NY'\\'...~ ~ ' """"" '"'lK"'"'". ~IV\\ ~JiiljV o 'A <,,5'>:-? -q-r_ LV""'""';> 1.1!;./"L v H2l<..(! 3 ";ttq.~r > "{\\. =----...Jj- - ( '-\\ II ~~-..... ( J ~--,--. tJ/51(0 _-_S{ffii ~ CD s t '- r ~" *-- 1 ES-201, Page 27 of 28

1-.cf y ,tJ I I-C.t2.../ 'i1 ;) OJ 4 ES~201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination 3" I 1 'I *) -

d!J'~

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of. -,r '/14 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware ofthe physical security measures and requirements (as documented in the facility licensee's procedures} and understand that violation of tile conditions of this agrement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management cr the NRC chief examiner any Indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my know dge, 1 did n9) divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s} oft

  • "'? IJ( Ftrc¥n the date that I entered into this security agreement until the completion of examination administration, i did not instruct, evaluate, or provide pertfxmimce feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBIUTY DATE (!) j:::.c-JQ I v'IOvA'- vr~ 1.~{ -, *o (2. t>Tv;t..J \\o *....;} t,-z..n: A) c'[) s (. '- PA"-J, S" ~ S. (., t,_.. ('A C...~ (_ E8-201, Page 27 of 28 -*------v-- -*~ <!)"' \\5-:, "-P oF" J.j/ II }l'f

ES-201

1.

Pre-Examination Examination Security Agreement r/ Form ES-201-3 '1, 0 y 0 ylrd!J I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1,1r1{c.., as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my know edge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 1. ,...,.) ":7from the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide peiformance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) SIGNATURE (2) DATE NOTE

1.

.J;M edGe . / J/uk 2 St 6";jt

3.

~~ ~- 4.>qf ~*,

5.

c-R $ 3 lit. I

6.

~PLO ~- Jlti/f-

7.

CJ! ~~-..._;jvt; CfoN£ ~: ~D1=~G* rJ 0 o~0:_

10.
11.
12.
13.
14.
15.

NOTES: ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination 4 0 )C 1/ '3 _, ~- l'f ~ ~.~~ I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as; the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have no orized by the NRC chief examiner. I understand that I am not to instruct, evaluate. or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration. except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I d!c:Y.129t divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ot2-1"N *-:; -;;J1Jf::'Jom the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. JOB TITLE I RESPONS.IBI:ITY ~SIGN_J,HURE (1) OAT~ SIQN~TURE (2) DATE NOTE sf!- op.:;, r~v sr:w~ ~ ~ t 2--1 t'f~"'- ,._..... -.... -~........ r, j(( ~v.imvcr"Ju=- /) .t*z4~'y ).{&l~-2/ r C) Jf. [. t"""' 7 6 0( ) --s-f- "lfll$-,fl'~~u~ 6 oP 1!'- ~7'Tiv?c"i s....,.,- r ors A/1'1J'..... (') P #-r r: J'L. v QD Jr"p.-)011/()...sfJW Pf\\--4.JrC...Jf'f\\l(o:) 1,....) Df 1E5S""" o~~r ._; \\( 'f-K 0 tC 2-/ 2--r.t ---7 z./2.. 7/1 t.J ES-201, Page 27 of 28

I j r

i...... *-***********.. -**-***-- *-*****-..... **----

f'!~"/.;)C!L/ 5 0 j:/ ?:

~---~---

ES*20I Exami11ation security Agreement

  • -*- *Foma$-201..3

,7 1*

  • *Pre:Examinatkm

_ 1. I,...:;.-> 3/ rl 1/ I acknowledge that I haVe aequlre£1 speaaf~ted knowledge abt the.NRC licensing examinations sohedultic.l ft.lr the week(s) of~ as of tile date of mr Signature. I agree that I Wit not kflowingly diVulge any lnlbrmafion abOfJt fh(i$6 examinations to 6UIY perSOJU who have not be$0 auihqrized by tile NRC.ohiefex&rrlin!V. I understand th*l am !'lOt tQ InStruct. eva1t1ate. o.r provld$. psrt'Ormanca feedback to !hose appUcanb scheduled to b~ adminlatered l~li~I1SIIlll examinations from this date until completion o1 qmination admln~on. except wspecifklafly noted below and autno~ by Che NRC (e.g., actrn9 as a slmJJiator booth opellitor or COIIllllUll*rls aoeeptaple If the !ndlvldual daes not selaot tne training content or pnwlde direct Or lndir~ feedback). Furlllermore. I am aware ofti)e physlca!seeuriy measures and requirements (as document$d In the faallty ticensee's pmcedures) aoo undemand tnat*Violation of the eori.ditions of this agreement mav result In cancelletion of the examlnat!Ons and/or an enforcement action against me or the facility liC(!nse&. I wit immediately 111polt to facility management or the NRC chief examlnar any lndil;'ation$ or $\\IS9e&1ions that examination security may have been compiOll'lisacl.

2.

f'ost-El!arn!Mtien Ta the best of my k.nowledg_e, I id not diVUlge to any unar.rthorlzed persons any lnfoJmation concelllfng the NRC licensing examinations admlni&teled during the week(s} or U"-l ~ Jlz J'jFrom the date that I entered into this QCUnty agreement uritilth& completion of examination administration, I did not inslnlct, evaluate, or provide performance feedback: to those applicants who were administered lhfiil licensing examinations, except as specffically noted below and aulhcrized by the NRC. E$-201, Page 27 of28

--or---------------*---..,--- fll 1-C./<.t "1 C)D} L/ ql\\~"-- G Cf zr ES;-201 Examination Security Agreement Fonn ES-201-3

1.

P~nunafion I *acknOwleds**thatl.bave.acquired specialized knowledge aboUt the.NRC licensing exa~ons. scheduled fOr the week(s}. of d /a ztkt/ as aff,he date

  • of my sigrlatqre. !.agree* that t wifl not knowingly di.Vufge aey Info~

~bouttbe$e exaroinations-to anY. ~*wno.have. not be~n authoriZed b11he NRC.cl)lef~min!'9"; I ~e.slanl:f ~ I am not !J?:JuStruct;.,evaJuate; Qrprovtcl~perfOrmanee f~1D tttQse.app!icaotssC:fleduled to be 8QminiStered ~*~I'!Sing exam1na!ions from thiS date unfiJ:~Ietion of ex<llilination adml~on, ~~as.spec:ificafly noted below and au~~!i*by the NRC {e.g.,actirlg.~ a sim!lialcr~ operatQror-~icatorisacc:e~Je if the :irufwiduai:does:riot select the tralrling conlent or pi'OIIide d'lreCtbr indirect ~back). F:urtherrno~ f am awa.:~ of'the physical"~ lneaSUI'e:S and *z:equitements (as docUn'lerited ill1he'facllity licensee's proced~). and. 'understap.d~olalion of.the Condifji:>ns.ofthiS agreement may reSult !n 'Ci;!loellation of the exam1il<$tls and/or an enforcement action against me or 1he*:ft!cility.Ucensee. J will:lmtne.<fatefy report til facilitY nia:nagementor fue NRC chief examiner any'indications or suggestions f:hat examination security may nave been compromised.

2.

Post<xamlnatiOn T.o ~ best Of:I11Y knowledge, I did not dlVulge 'Ill.any Ullautholiz:~ persons any Information o:mcert)fog the NRC licensing.exall'linations administered durin_g 1he ~s) of . From ttJEHlate-1hat I en.tered into this security agreement unbl the completion* cl ~nation admJnistretlon. I did not instruct..evaluate, or provid~ performance feedbacldo those* applicants who were administered these licensing examlnalfons, except as specifically noted below and authorized by 1he NRC. il1

rE TE IJV~l(J.Hl/f!:.t:f::ll/fi:VV qw~

0 y ZQ,<7<<~ v .. x_.. __.] .}<( _)-*:>-I ~*- . ss£ pA£. .:t£ Ca.c;\\1 ?"" <.: ;; t <.. f? ~-It -:1.. - - ~-- ---,~

~------------------*----------------------

'*--------~-------------------------*------------------*

8.
9.

1..._ _______ ------------------------* !11.*. _______ -:--~-------------.,------~ 12-------------~------------------*------------------

13.

==

------r 1~

15.

NOTES: ES-201, Page 27 of 28 ~ -------

[ -* ****-***-*-**--******-**-*--*--***--** I {.1!\\C.."' 7/8

  • ---------**-*- ----*--------......:.L.
  • --J+-. -----
1.

DE' *hAn ,..,..,...,._...,~~...... JIRC._............ tGIIII*dldllrt~tWIII(I}ti <<Ww.d.,.... otmy---.1.-lllltlwlllllltllnaMIW..._a.w~..,.,......,.... *.,,........,..IICt..,..._.,bJfllll NllC.ohllf........ l........... l.lllllttlalllll;t...,..._or~~~~~u-..-.--....s~ge..all I i Md .._.......,_,.. ~~~~tam-.W.unl.....,_llf_tl............................,_...... _,........,.,._NRC (6Q... ___ a........ llocllll..-:cr. !!t*IM***Ja....... fiMI..... _.IIIIGtlbltlllli*lgCGIIIIIII<<~clnctirilloiRc:t ......., ~*--af-pllyllbt....,._........... (eii~la .... lilllliar............... ~._.....,.afV. ~*IIIIi iiettil......,....,_._,..........,.,dlM-**Iiilllll*_....,....,.. _.......,.,_ar lila_..,..._, IWI!lllol It I; IIIPIIIftllfa::Ur......,..,lllllnRC!IbW-*-IIIJ~*r.......... llai-wllllbl~ ~llllr. -.~liiod. ES-201, P1!rgot 27 al28

ES-201 Examination Security Agreement Form ES-201*3

1.

Pre-Examination ~ I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not e uthorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement milly result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. l will immediately report to facllity management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post*Examlnat!on To the best of my knowff;J;id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of

  • '. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provid performance feedback to those a(:jplicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

I JOB TITLE I RESPONSIBILITY PRINTED NAME DATE SIGNATURE (2) DATE NOTE

1.

Vlf:!(.{.,;ol.'f' mo...... Ane {liOlht k"-tl'-' !fJiq. ~~ ~* '%t. o+.~ \\, fo~o~'"'!f..-.'Y !"*~~sc:.Hr tl!il* 1 "t.. I =* " ~~ , * '["I 6 ~ S>.,) !8:wwJ> ~&w""k.

  • ~

~"'-C I -r7 ' ... "t"""" v,.ORQ I =>'*0~1) "*, t".!ljl,l'lf....>>* f:/#&~: -~

  • .... ~.. ~

v**,, ~-*- _.:..;N'-":\\'~~;.;:C::.:___ ______ -LS¢:-U~=~----..u.l...k.7!J...J'~------- ~ $t-o'\\ s~

  • 4"""'7'll) vs;,"!l v HPlY\\

3~/1-hl-{ . s ('-"'1--i f \\,_, "" ~'llo .2.1_~. ""f. I .'1 4 tJ PRO 5{/IL'.J___ j_*_ Oet~tt()1fle-J v1q leleco"'\\ i-Ais Oe{te. !YNf ES-201, Page 27 of 28 9 A~~ '6 ot3 l

DAntonio, Joseph From: Sent: To: Cc:

Subject:

Joe, Cotter, James <jcotter@entergy.com >

Tuesday, April 22, 2014 9:35 AM DAntonio, Joseph Magnatta, Vincent P FW: ES-201-3 The individual's name who is on Short Term Disability and who has been unable to sign off of the exam security agreement is Richard Lawless. Jim Cotter Pilgrim Nuclear Power Station 508-830-8930 From: Magnatta, Vincent P Sent: Monday, April 14, 2014 4:42PM To: DAntonio, Joseph (Joseph.DAntonio@nrc.gov) Cc: Cotter, James; Fountain, David

Subject:

ES-201-3

Joe, One individual is out on short term disability, underwent surgery several weeks ago and will be out for some period.

don't know exactly what you would like me to about this. Vince 1

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Pilgrim Date of Examination: 02124/14 Operating Test Number: 01 Initials

1. General Criteria a
b.

c#

a.

The operating test conforms with the previously approved outline; changes are consistent with IJ!IS!J ~~ l sampling requirements (e.g., 10 CFR 55.45, operational importance, ~nction distribution).

b.

There is no day-to-day repetition between this and other operating tests to be administered ~--3 ~o& {:- during this examination.

c.

The operating test shaU not duplicate items from the applicants' audit test(s}. 1~ Section 0.1.a.) 11l5J ~(j:/ ('

d.

Overlap with the written examination and between different parts of the operating test is Within mx ~d/ !J acceptable limits.

e.

It appears that the operating test Will differentiate between competent and less-than-competent '!Jl8 ~ fl. applicants at the designated license level. I

2. Walk-Through Criteria
a.

Each JPM includes the following, as applicable: initial conditions initiating cues . references and tools, including assOCiated procedures . reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee IJ/IJ ~ 1 operationally important specific performance criteria that include: detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by th11 applicant criteria for successful completion of the task identification of critical steps and their associated performance !:tandards restrictions on the sequence of steps, if applicable

b.

Ensure that any changes from the previously approved systems and administrative walk-through ~g outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance J.~- /) criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with 11/A ~-

IJr Form ES-301-4 and a copy is attached. M a.M ~n-bJ~:n:: N;;;;;_ gw.w~ Date

a.

Author o;/;; /J'-/ ~.a. r_ I ~\\/u/IY.

b.

Facility Reviewer(*) ~' J 2S6Wn'£~ ")) ~~rre/L

c.

NRC Chief Examiner (#) s 'J) /I,JjU.-1~~ l ~:tr< ~ '-/tiLl~tf

d.

NRC Supervisor ~. \\J. _\\,. Kc-J I~}.VI ~-:S- "l.- z.o[ 1 J NOTE:. The facility signature is not applicable for NRC-developed testY lndeoendent NRC reviewer initial items in Column "c": chief examiner com:urrence reouired.

ES-301 Simulator Scenario Quality Checklist Form ES-301-4

1.
2.
3.

rim NRC Date of Exam: 02/14 Scenario Numbers: 1 l 2 13 I 4 /5 Operating Test No.: 1

===---=========-=============

QUALITATIVE ATTRIBUTES The initial conditions are realistic, in that some equipment and/or instrumentattion may be out of service, but it does not cue the operators into expected events. The scenarios consist mostly of related events. Each event description consists of the point in the scenario when it is to be initialed Initials a b* the malfunction(s) that are entered to initiate the event mfO ~ the symptoms/cues that will be visible to the crew 'Iff/) the expected operator actions (by shift position) the event termination point (if applicable) -4'

4.

No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario .dJl 0 1 J,; V without a credible preceding incident such as a seismic event. ':1!/'-1 £:\\"--'

5.

The events are valid with regard to physics. and thermodynamics.

  • ---------f-'11,~1)S...,..,t-CJI-f1ff.-:-/* -+/1--ll
6.

Sequencing and timing of events is reasonable, and allows the examination team Ito obtain

  • triM_){ da:>

~ complete evaluation results commensurate with the scenario objectives. (fl{'

7.

If time compression techniques are used, the scenario summary clearly so indicates. !Jt~ dt£. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.

8.

The simulator modefing is not altered. I.IJfl J !tltf-- !J..

9.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator

!Jl1 j 1 ".

IV performance deficiencies or deviations from the referenced plant have been evaluated '!f/ 1 <A v--* to ensure that functional fidelity is maintained while running the planned scenarios.

t----+----~~1

10.

Every operator will be evaluated using at least one new or significantly modified scenario. Aft 0 \\.r ~ "' All other scenarios have been altered in accordance with Section 0.5 of ES-301. //(..) 0\\lJ-

~~+-~-~~1

11.

All individual operator competencies can be evaluated, as verified using Fom~ ES-301-6 (submit the form along with the simulator scenarios).

12.

Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

13.

The level of difficulty is appropriate to support licensing decisions for each mm position. Target Quantitative Attributes (Per Scenario; See Section D.S.d) A(:tual Attributes

1.

Total malfunctions (5-8) 6 I 5 I 6 I 6 I

2.

Malfunctions after EOP entry (1-2) 1 I 1 I 1 I 2 I

3.

Abnormal events (2-4) 2 I 3 I 4 I 2 I

4.

Major transients (1-2) 1 I 1 I 1 I 1 I

5.

EOPs entered/requiring substantive actions (1-2) 2 I 2 I 1 I 2 I

6.

EOP contingencies requiring substantive actions (0-2) 1 I 1 I 1 I 1 I

7.

Critical tasks (2-3) 3 I 3 I 3 I 3 I FS-':101-4 011114 11/J ~<!.- o/ 1111 ~g> fY 1J!J J? 11.-* 6 2 3 I}J/J I o ct.-- w 1 1 1 2

ES-301 Transient and Event Chec~Jist Form ES-301-5 ~--------------------~~~~~~ Facility: Pilgrim NRC Date of Exam: Feb.2014 Operating Test No.: 1 A E Scenarios p v NRC#1 NRC#2 NRC#3 T M p E 0 I L N CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION A I c s s M A 8 A 8 s A 8 s A 8 L u A T R T 0 R T 0 R T 0 R T 0 M(*) N y 0 c p 0 c p 0 c p 0 c p T p R u E RX 2 NOR 2 R0-1 1/C 4,5, 3,5,7 3,6,8 8 MAJ 7, 6 7 3 TS 0 RX 2 NOR 2 R0-2 1/C 4,5, 3,5,7 3,6,8 8 MAJ 7, 6 7 3 TS 0 RX 2 NOR 2 R0-3 1/C 4,5, 3,5,7 3,6,8 8 MAJ 7, 6 7 3 TS 0 RX 2 NOR SROU-1 1/C 3,4,5 5 ,6,8 MAJ 7 1 TS 4,5 2 ES-301-5 021914.doc Page 1 of4

Facility: Pilgrim NRC Date of Exam: Feb.2014 Operating Test No.: 1 A E Scenarios p v NRC#1 NRC#2 NRC#3 NRC#4 T M p E 0 I L N CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION A I c M s A B s A B s A B s A B L u A T R T 0 R T 0 R T 0 R T 0 M(*) N y 0 c p 0 c p 0 c p 0 c p R I u T p E RX 2 2 2 NOR 1 2 SROI-1 1/C 3,4,5 4,5 4,5,6 9 ,8 MAJ 7 6 7 3 TS 5,6 2 RX 2 2 2 NOR 1 SROI-2 1/C 3,5,8 3,4,5 7 ,7 MAJ 7, 6 2 TS 3,4 2 RX 2 2 2 3 NOR 2 SROI-3 1/C 3,4,5 4,5 3,4,5 11 ,8 ,6,8 MAJ 7 6 7 3 TS 5,6 4,5 4 RX 2 2 2 NOR 2 SROI-4 1/C 3,5,8 3,4,5 4,5,6 10 ,7 MAJ 7, 6 7 3 TS 3,4 2 ES-301-5 021914.doc Page 2 of4

Facility: Pilgrim NRC Date of Exam: Feb.2014 Operating Test No.: 1 A E Scenarios p v NRC#1 NRC#2 NRC#3 NRC#4 T M p E 0 I L N CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION A I c s s M A B A B s A B s A B L u A T R T 0 R T 0 R T 0 R T 0 M(*) N y 0 c p 0 c p 0 c p 0 c p T p R I u E RX 2 2 2 3 1 NOR 1 1 2 1 SROI-5 1/C 3,4,5 4,5 3,4,5 11 4 ,8 ,6,8 MAJ 7 6 7 3 2 TS 5,6 4,5 4 2 RX 2 2 2 1 NOR 1 1 2 1 SROI-6 1/C 3,5,8 3,4,5 4,5,6 10 4 ,7 MAJ 7, 6 7' 3 2 TS 3,4 2 2 RX 1 1 0 NOR 1 1 1 1/C 4 4 2 MAJ 2 2 1 TS 0 2 2 RX 1 1 0 NOR 1 1 1 1/C 4 4 2 MAJ 2 2 1 TS 0 2 2 ES-301-5 021914.doc Page 3 of4

Instructions:

1.

Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (1/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one 1/C malfunction can be credited toward the two 1/C malfunctions required for the ATC position.

2.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunc;tions on a 1-for-1 basis.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.=================================d ES-301-5 021914.doc Page 4 of4

ES-301 NRC Competencies Checklist, ______ F_o_r_m_E_S_-_3_0_1_-6 Facility: Pilgrim Date of Examination: 02/14 Operating Test No.: 1 APPLICANITS SRO (U/1) RO/A.TC BOP SCENARIO SCENARiO SCENARIO Competencies 1 2 3 1 2 3 1 2 3 Interpret/Diagnose 1-8 1-7 1-8 2,3, 2,4, 2.:~. 1,4, 1,3, 1,4, Events and 5,7, 5,6 6,"?, 5,7 5,6, 5,6, Conditions 8 8 7 7 Comply With and Use 1-8 1-7 1-8 2,3, 2,4, 2,3, 1,4, 1,3, 1,4, Procedures ( 1) 5,7, 5,6 6,i', 5,7 5,6, 5,6, 8 8 7 7 Operate Control NA NA NA 2,3, 2,4, 2,3, 1,4, 1,3, 1,4, Boards (2) 5,7, 5,6 6,ir, 5,7 5,6, 5,6, 8 8 7 7 Communicate and 1-8 1-7 1-8 1-8 1-7 1-8 1-8 1-7 1-8 Interact Demonstrate 1-8 1-7 1-8 NA NA NA NA NA NA Supervisory Ability (3) Comply With and Use 5,6 3,4 4,5 NA NA NA NA NA NA Tech. Specs. (3) Notes: (1) Includes Technical Specification compliance for RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. Instructions: Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for Ewery applicant. ES-301-6 021914.doc

ES-401 Written Examination Quality Checklist Fonn ES-401-6 Facility: Pilgrim Date of Exam: 2124114 Exam level: RO ~ SRO 181

=

Initial Item Description a b* c#

1.

Questions and answers are technically accurate and applicable to the facility.

  • ~ lr\\oC if*
2.
a.

NRC KJAs are referenced for aH questions. IIJ!Ji ~ t/1,

b.

Facility learning objectives are referenced as avaUable.

3.

SRO questions are appropriate in accordance with Section 0.2 d of ES-4.01 lm)~ ~uG 7ft:

4.

The sampling process was random and systematic (If more than 4 RO or 2 SRO questions fo were repeated from the last 2 NRC fJCensing exams, consult the NRR Ol~gram office_l

5.

Question duplication from the license screening/audit exam was controllE!d as indicated below (check the item that applies) and appears appropriate: ~ XX the audit exam was systematically and randomly developed; or tf/1 _the audit exam was completed before the license exam was started; or IJ'{)j _ the examinations were developed independently; or _ the licensee certifies that there is no duplication; or _ other (explain)

6.

Bank use meets limits (no more than 75 Bank Modified New percent from the bank, at least 10 percent 111J ~IY I~ new, and the rest new or modified); enter 48%/20% 7%1*1% 45% 176"A. the actual RO I SRO-only questioo 36Qs/5Qs 5Qs/1 Qs 34 Qs/19 Qs distribution(s) at right

7.

Between 50 and 60 percent of the questions MelllOI'y CIA on the RO exam are written at the comprehension/ analysis level; 44%/28% 56%/72% 1/JJ ~"' I~ the SRO exam may exceed 60 percent If the randomly selected K/As support 33Qs/7Qs 42Qs/18Qs the higher cognitive levels; enter the actual RO I SRO questiOn distlibU1iOJiis) at light.

8.

References/handouts provided do not glve away answers r7M ~ 71 or aid in the elimination of distractors.

9.

Question content conforms with specific KIA statements in the previously approved (J1fA f)t rfL examination outfine and is appropriate for the tier to which they are assigned; deviations are justified. /)

10.

Question psychometric quality and format meet the guidelines in ES Appendix B. rJJJ~ *~tf/ v~

11.

The exam contains the required number of one-point. multiple choice items; ?llJ J.) ~ the total is correct and agrees with the value on the cover sheet. J, (

==- ~

a. Author
b. Facility Reviewer (j

~ y

c. NRC Chief Examiner (#)

r~

d. NRC Regional SuperviSor

'( Note:

  • The facility reviewer's Initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column "C"; chief examiner concurrence required.

ES-40 1-6 0220 14a

ES-403 II Facilitv:

1.
2.
3.
4.
5.
6.

Written Examination Grading Quality Checklist Form ES-403-1 Date of Exam: Exam Level: ROD SRO C8J Item Description Clean answer sheets copied before grading Answer key changes and question deletions justified and documented Initials a b c Applicants' scores checked for addition errors ~.J /t (reviewers spot check> 25% of examinations) qoc 1/1 Grading for all borderline cases (80 +/-2% overall and 70 or 80, {11/ 0iCL /"1 as applicable, +/-4% on the SRO-only) reviewed in detail

~-----+----*+---~1 All other failing examinations checked to ensure that grades

('J j /l tJ) t\\* '/h are justified Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature Date

a. Grader Uavg Le Cuvt-\\7/~--r- ~

IA~L s: ea~.e I ol c@~~"

b. Facility Reviewer(*)
c. NRC Chief Examiner(*)
d. NRC Supervisor(*)

\\./ 3-Z.. (- \\ L\\ )*l;) -t"/ J(3t f*i (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403 Written Examination Grading Quality Checklist Form ES-403-1 I Facility: Date of Exam: Exam Level: RO ~ sRoDI Initials Item Description a b c

1.

Clean answer sheets copied before grading 0v" ~o:_ 0

2.

Answer key changes and question deletions justified rJ/A rv/A .v/i'l, and documented

3.

Applicants' scores checked for addition errors (t,.- ~oc /1 (reviewers spot check> 25% of examinations) ,r

4.

Grading for all borderline cases (80 +/-2% overall and 70 or 80, {n/ a{ a:_ 4 as a_QQiicable, +/-4% on the SRO-only) reviewed in detail

5.

All other failing examinations checked to ensure that grades rJjA tJ)A: ,.J l': are justified

6.

Performance on missed questions checked for training via~. lb deficiencies and wording problems; evaluate validity f){/ of questions missed by half or more of the applicants Printed Name/Signature Date

a. Grader Ua~ LP c~¥""'

7/ ~-Y L.L.../ 3-27~/~

b. Facility Reviewer(*)

.:TA.,~.< ~Jrr~./ otO<rJ3"ta,- 3-2'..{- I'-\\ NRC Chief Examiner (*) J J,,vi)r~-J I i1l1v pW; 1' 'L'b r 11

c.
  • I

( i (n,,-. ;..:::2==-

d. NRC Supervisor (*)

D

  • J4t.c~ ~

/ ~: fJflt~c:;= 3&. fr't / (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.}}

Retrieved from "https://kanterella.com/w/index.php?title=ML14141A188&oldid=5209948"