ML17087A086

Final Qa/Related Forms (Folder 1)

ML17087A086
Person / Time
Site:	Millstone
Issue date:	03/23/2017
From:	David Silk Operations Branch I
To:	Operations Branch I
Shared Package
ML16337A097	List: ML17046A604 ML17087A086 ML17087A087 ML17087A088 ML17087A089 ML17087A090 ML17087A091
References
U01968
Download: ML17087A086 (5)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Mt/{sk u.,d-z.,. Date of Examination: -z/lr- J/,/;7 Developed by:

WA:'tA-ntten: Facility D NRC D II Operating Facility ~ NRC D Chief Target Task Description (Reference) Examiner's Date*

Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b)

~rcJ--

-150 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) @:')__

-150 3. Facility contact briefed on security and other requirements (C.2.c) UfJ--

-150 4. Corporate notification letter sent (C.2.d) l~

(-120] 5. Reference material due (C.1.e; C.3.c; Attachment 3) YY'J-

{-90} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-1/2, ES-401-3, ES-401N-3, ES-401-4, and ES-401 N-4, as applicable (C.1.e and f; C.3.d) Jd-

{-85~ 7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e) ~

{-60} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as

., applicable), supporting documentation (including Forms ES-301-3, ES-301-4, I

ES-301-5, ES-301-6, and ES-401-6, ES-401 N-6, and any Form ES-201-2, ES-201-3, ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, f, g and h; tlJ-C.3.d)

-45 9. Written exam and operating test reviews completed. (C.3.f) M-

-30 10. Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; ES-202) CRt1-

-21 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) 01--

-21

12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) !ffe-

-14 13. Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; ES-202) (jJ;L_

-14 14. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

.~

-7

-7 15.

16.

Facility licensee management queried regarding the licensee's views on the examination. (C.2 j)

Final applications reviewed; 1 or 2 (if >10) applications audited to confirm VJI qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204) W-

-7 17. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k) /4

-7 18. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

I})_

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201, Page 25 of 28

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Millstone Unit 2 Date of Examination: 02/28/2017 Initials Item Task Description a b* c#

1.

w

a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N. JJ//l t11)r I~

JJ}A "1/k ~

R b. Assess whether the outline was systematically and randomly prepared in accordance with I

T Section D.1 of ES-401 or ES-401 N and whether all KIA categories are appropriately sampled.

T E c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. N/~ fllJk ~

I'-'/~ ~

N

d. Assess whether the justifications for deselected or rejected KIA statements are appropriate. NIA

>>/fl tJ!A Y--

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major s transients. f I

M b. Assess whether there are enough scenario sets (and spares) to test the projected number and u mix of applicants in accordance with the expected crew composition and rotation schedule IV L without compromising exam integrity, and ensure that each applicant can be tested using at N)J, ~lA-A least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days.

<4t T

0 R

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and Nfa {\/IA- ~

quantitative criteria specified on Form ES-301-4 and described in Appendix D. A*

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed rJl ~-

w among the safety functions as specified on the form A (2) task repetition from the last two NRC examinations is within the limits specified on the form L (3) no tasks are duplicated from the applicants' audit test(s)

K (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T the form.

H R b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

1. t *fL'

~

0 (1) the tasks are distributed among the topics as specified on the form u (2) at least one task is new or significantly modified G (3) no more than one task is repeated from the last two NRC licensing examinations H

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. ~ rJL- ~

4.

G

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections. m rt Mt-E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ~ I~/. 11)).-

N E

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5. u rJL-- ~

R d. Check for duplication and overlap among exam sections. N//i µI tt fl/A A

.-! IA' /VA L e. Check the entire exam for balance of coverage. NIA

f. Assess whether the exam fits the appropriate job level (RO or SRO). ~ ~ rJi-

!fti), ,.Printed Na;f;e17~J12J I!. .~1 Date

a. Author

b. Facility Reviewer(*)

lrl L, C1WIN1 ~VIA l'U rc~e t J. C:Jle"

... /

.1~11/:; ~'

I

~*

I p~ I JJ/J7 n., ..i-1 S-lk I '/j..,,J') ...4.:; ~- - t/1'1(£2

c. NRC Chief Examiner(#)

d. NRC Supervisor n..i...,4-L.O ...l.u.~"""" -

,I ~ LJj I I \ . I l{r.St1j Note: #Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

• Not applicable for NRG-prepared examination outlines.

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Millstone Unit 2 Date of Examination: 02/28/2017 Initials Item Task Description a b* c#

1.

w

a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N. N//l fV /r,r !v,4-R b. Assess whether the outline was systematically and randomly prepared in accordance with iJ)1r 1'4 T

I Section D.1 of ES-401 or ES-401 N and whether all KIA categories are appropriately sampled. .Al/A T

E c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. .llM t-1/.tr ;l/.4-N

d. Assess whether the justifications for deselected or rejected KIA statements are appropriate. llJ1 i-11/' W4-

2. a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major #/,A rJ/ft ;Vf-s transients.

I M b. Assess whether there are enough scenario sets (and spares) to test the projected number and JJ/A rl~

u mix of applicants in accordance with the expected crew composition and rotation schedule L

A without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the N'k T applicants' audit test(s), and that scenarios will not be repeated on subsequent days.

,;);, fl~

0 R

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301 -4 and described in Appendix D.

tV4

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301 -2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed w among the safety functions as specified on the form

~

A L

K (2) task repetition from the last two NRG examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specttied on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on

• 1 :JJ-T the form.

H R b. Verify that the administrative outline meets the criteria specified on Form ES-301 -1:

I#

7~

0 (1) the tasks are distributed among the topics as specified on the form u (2) at least one task is new or significantly modified G (3) no more than one task is repeated from the last two NRG licensing examinations

¥ ~

H

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. ~*

're-I

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the .I/.. A.,/

appropriate exam sections. 'I Ji G ~

E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ~ lly'v N

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5.

~A

~.,,, A~ @-

E R d. Check for duplication and overlap among exam sections.

dh

'V'V

,;))l,. ~

A L e. Check the entire exam for balance of coverage. ~ A ,(,, [#-

f. Assess whether the exam fits the appropriate job level (RO or SRO). f#t. fill v../1')-

I Printed Name/SJ~..a7) ~

a. Author R,,/,nJ A .L rimm{;t Jr_, ~

,J

, ~~~)~

b. Facility Reviewer (*) /1-1."T t..oTE /~1 / i/7/;7

c. NRG Chief Examiner(#) J\.r....)'( s.-11< I A 1~ 1 _,A.JJVV-....  !./W/17 n .. .. ,.., ,__vL I tW. VV r-'., ,-

d. NRG Supervisor

. v z11sl12 Note: # Independent NRG reviewer initial items in Column "c"; chief examiner concurrence required.

• Not applicable for NRG-prepared examination outlines.

ES-201 Examination Security Agreem~!_!! ____ _ Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRG licensing examinations scheduled for the week(s) of .::::..X=l..IA..-t..1--'-'--

of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not by the NRG chief examiner. I understand that I am not to instruct, evaluate, or provide performance feeriback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination aciministrat~on, excepi as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if th0 :ndividual does riot select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requ:rernents (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andior an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To trie best of my* knowledge, I did not divulge to any unauthorized persons any information concerning the NRG licensing examinations administered during the week(s) of '33./:Jf/!L. From the date that I entered into this security agreement until the completion of examination administration, I did not instr:.1:.:t, c-valua!e, or provide pertormance feedback to those applicants who were administered these licensing examinations, except as specifically noted beiow a.r'ci authorized by the NRG.

PR:NTEO ~~A.M!:: JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

~:~~~1~t_-~5~r~;_~

3. f'£i'I!."- .J f- I -nf7-.G!'.-'I.,..,.,?

4./'Vfu',?li:f, / ',--:,~* .~fi,) :£__

- .. ~  :,.K -~

5.

6 . _,,-'-"'~~

7. \:\crb~<~ .'.'.:>ec:._,...k 8.-(hVl:Sh:;:;e Cc....to

• ev(

9.;;?hcu1e L.et2..oJ..ZX _

10./:.**'f ;-/,~. f,: '...c.G1 11.~,_,__i'.l.'.ILi.r.i.:;r~

12._,t:b;.1L-l.~1i1...Q;,.,.

13 .__ ,C<{t,_11j.:L.. ~I~

14 -.CIJ!l :.f:W.A!YJ;/._J:-/J.N 15./:,'; .. *. /./:...:::' ' *~

i~.~cre*~-~ ~r..~~~£t---7t NOTES: t.t*

7. l.)A;...1 t}'liO,'(_

18. J1tS010 t.f. /.311.o-wtJ frtliN 11-6-ER..

1'1- ~ ;j~ ~ J~~0 N ~ c:;, c.....

I Y/-F;F'/A!//J{r

ES-301 Operating Test Quality Checklist Form ES-301-3 Facilit Millstone Unit 2 Date of Examination: 02/28/2017 0 eratin Test Number:

Initials

1. General Criteria a b* c#

a. The operating test conforms with the previously approved outline; changes are consistent with sam lin re uirements e.. , 10 CFR 55.45, o erational im ortance, safe! function distribution .

b. There is no day-to-day repetition between this and other operating tests to be administered durin this examination.

c. Theo eratin test shall not du licate items from the a licants' audit test s . see Section D.1.a.

d. Overlap with the written examination and between different parts of the operating test is within acce table limits.

e. It appears that the operating test will differentiate between competent and less-than-competent a licants at the desi nated license level.

2. Walk-Through Criteria

a. Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on these uence of ste s, if a licable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRG examinations) specified on those forms and Form ES-201-2.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-NIA 301-4 and a co is attached.

Date

a. Author

b. Facility Reviewer(*)

c. NRG Chief Examiner(#)

d. NRG Supervisor NOTE:

• The facility signature is not applicable for NRG-developed tests.

1. lnde endent NRG reviewer initial items in Column "c"; chief examiner concurrence re uired.