ML103050204

From kanterella
Jump to navigation Jump to search
Initial Exam 2010-301 Final Administrative Documents
ML103050204
Person / Time
Site: North Anna  Dominion icon.png
Issue date: 07/16/2010
From:
NRC/RGN-II/DRMA
To:
References
50-338/10-301, 50-339/10-301
Download: ML103050204 (48)
v • d • e


Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: 2010 North Anna Date of Examination: 6/7 - 18/2010 aci1ili NRC Examinations Developed by:

Written/Operating Chief T g Task Description (Reference) Examiners ae Initials

-180 1. Examination administration date confirmed (C. 1 .a; C.2.a and b)

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)

.. . . . /?1

-120 3. Facility contact briefed on secunty and other requirements (C.2.c)

-120 4. Corporate_notification_letter_sent (C.2.d)

[-90] [5. Reference material due (C.l.e; C.3.c; Attachment 2)]

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES 301-1, ES-301-2, ES-301-5, ES-D-Ps, ES-401-1/2, ES-401-3, and ES-401-4, as applicable(C.1.eandfC.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility Oct/Novem licensee (C.2.h; C.3.e)} ber 2009

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.l.e, f, g and h;C.3.d)

-30 9. Preliminary license applications (NRC Form 398Ts) due (C. 1 .1; C.2.g; ES-202) DI

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) 41

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)

-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if>1 0) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i;_Attachment 4;_ES-202,_C.2.e;_ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

flniL ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:

. Initials Item Task Description a b* c#

1 a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

w R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

j

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form I (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301 -1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified c.

(3) no more than one task is repeated from the last two NRC licensing examinations Determine if there are enough different outlines to test the projected number and mix

._.4 of applicants and ensure that no items are duplicated on subsequent days.

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. Jj

d. Check for duplication and overlap among exam sections. 4 A e. Check the entire exam for balance of coverage.

L

f. Assess whether the exam fits the appropriate job level (RO or SR0). jj
  • Printed Name/Signature 2

/cc/ Date

a. Author tZ Facility Reviewer (*)
b. PL-t_

f wat4- Uii 6(271fk

c. NRC Chief Examiner (#) 2 e a /Z%
d. NRC Supervisor ri 1 . Bi-r/ n2JL .

fIR-Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines ES-201, Page 26 of 28

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:

Initials Item Task Description a b*

I a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 w

R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled. 1I

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. *
d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.

hL

2. a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301 -2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form

/ (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered -

in the appropriate exam sections. 7 j), ,

b. Assess whether the 10 CFR 55.41 /43 and 55.45 sampling is appropriate.

N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. jj 4

d. Check for duplication and overlap among exam sections.

A L

e. Check the entire exam for balance of coverage.

.li&

W9

f. Assess whether the exam fits the appropriate job level (RO or SRO).
a. Author
b. Facility Reviewer (*) Uc-1-...x2-. L.O c.EXA_s_
c. NRC Chief Examiner(#) Ec/4,.n Lc Tr
d. NRC Supervisor Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-201, Page 25 of 27

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of it as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administratio instruct, evaluate, or provide performance feedback to those applicants who were administered n, I did not these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIG TURE(1) DATE SIGN TURE(2) DATE NOTE

1. 4%L 62/-/t 2
2. _j/IJ6, 7, /w
3. i7 iv,j_/I7LL._ pf
4. -.jJ g17z) IS
5. C 1 CJf J

j!!

Ups (

uJ&t. (2JLL c-i 2/-/

6. LLt?We 7.

ti 4

c I

4 iL1! tA,u- Ce -io r,JY4k / J

8. /O2i) 7ii,.,iq /jL
9. / %t /2 /
10. D,VLD /cw4M pp

&2tIO (PS - -,. L 45-.

12. i-i etL-

,-to 13.VC . 21-I0 l4.L C&-RII0

15. S-kJ 1 p

1 e-.zf-NOTES:,

J -3t-fc S (;

c/f- . 7-,

ES-201 Examination Security Agreement Form ES-201 -3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 4t.7j2((as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have notbeen authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1

1t12

&p ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination 2O acknowledge that have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of //i./fL4 fAI of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC I (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect I feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of /)p(_From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRiNTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE i._5 R /1 t l-- o fri 3IO

2. 3 ceZ I Y S4rkC) -- d41?L4J L3Ia
3. 4. L3 j f - L4iAbo j3Q 4

. iJiç, fqç tçjer //?-tM c

5. .5k(r(-

(ç/

7 cw 4 Q{

6- )O

6. zio$/1&t v,t/ T c(A Vi5ai/EY t,EcV
7. 3;Li Lclfre f/ -

31 44:-: /

8. J c&ctbA) Rc / c
9. J/t7- I(1-J6 .O /fCm (%FI 7
10. Jc_c-R,.A)t S b /E4 -I -Z /o/io J iL //
12. i2c / (Z)ç4 V&)
13. i1A2l.4/&1,. I W / I4 4vj 2 --(

14.2 r/r4cJ7j7/Jr efciY/ TPn7 ,, Z-22--k Prt 21t%

NOT

çbe ,9-(ot4 cAd /Ac.-

/

1 r1,r2,I 6/4 ES-201, Page 26 of 27

lo Z ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination Zolo acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) offi,flz &jas of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s)of 4/7,?1Qw-fc From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE 1.A7 7 5vis<

2. h, c:4o.- O, c,/

4 3 WZLFIOT-H U,a-r vZWi Jz32: 3) Iiito -

4. ,Q ,47i>

e 2 C.tC- Ii

5. .Jc__

4

6. g7 n 4

g1c /f.- p -

Lf Z

7. /4 -______________________
8. --

9.

10.

11.

12.

13.

14.

15.

NOTES:

ES-201, Page 26 of 27

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination j(

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide director indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of om the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide pe oMqWce feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE

1. 7,& c4AJfh/ ;tiyS7-. (H ) -__________________
2. rv L:E: 4.i

// o r L ,ft z-L-J

3. 5-Ocs Kth,4 4 i M uP/o,Lr j4VI,rL ç( /z3 J
  • 7?//- /4 .iO 941 /- 34.17,0 1 t&k -,-i
5. e ._. - -
4. 1,) 4 Q-3_1_

7J Aa < (:

6(LL4AJ1c&-Lt,.

MiJ3- AUTh

=----

6. jpAJJIe A fl2M6 (A-AAJ L///( /I
7. ip
8.  ?

9.

10.

11 12.

13.

14.

15 NOTES:

ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of fia as of the date of my signature. I agree that 1 will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ///(,qLFrom the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TiTLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

1. ejS yCQ j1Js 3 J)v/ 3/31/1c cc- /a-1/i
2. z.Q / ok(,Q 3.

,k i*i 1

S L; 0 - Lw

4. kvt / 6XAt1 EVI vJ 6/
5. I p 6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

NOTES:

ES-201, Page 27 of 28

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: North Anna (JPM Set A FINAL)

- Date of Examination: 6/21/2010 Exam Level: RO SRO-l SRO-U Operating Test No.: 1 Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System / JPM Title (KA) Safety Type Code* Function a.) 026 / Terminate quench spray (1/2-E-1). (A4.05) C, D, E, EN, L (ALL) b.) 005 / Restore RHR flow (1-AP-1 1). (A4.01) A, L, M, 5 4 (Pri)

(ALL) c.) 0Gl / Borate the reactor coolant system using the blender (1-GOP-8.3.4). (A4.02) A, D, 1

(ALL) d.) 039/059/061 / Identify and isolate a ruptured steam generator (EA1.32) A, M, 5 4 (Sec)

(RO and SRO-I) e.) 062 / Reset load shed (0-AP-47). (A4.01) C, D, E 6

(RO and SRO-I) f.) 073 / Restore the blowdown radiation monitors (1-E-1). (A4.02) D, E, 5 (RO and SRO-I) g.) 075/ Respond to circulating water flooding in the turbine building (0-AP-39.1). (A2.02) A, D, E, 8

(RO and SRO-I) h.) 006 / Fill the safety injection accumulators (1-OP-7.3). (A4.02) D, EN, S (RO)

In-Plant Systems (3 for RO; 3 for SRO-l; 3 or 2 for SRO-U) i.) 063/ Place a battery charger in operation on the safeguards watchstation (1-OP-26.4.1). (A4.01) 0 6 (ALL) j.) 003 / Isolate the reactor coolant pump seals locally (1-ECA-0.0) 0, E, R 2 (ALL) k.) 061 / Reset the auxiliary feedwater turbine trip and throttle valve (1/2-AR-F-D8). (A204) 0, E 4 (RO and SRO-I)

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO-l / SRO-U (A)Iternate path 4-6 I 4-6 / 2-3 (C)ontrol room (D)irectfrombank 9/814 (E)mergency or abnormal in-plant 1 i> 1 / 1 (EN)gineered safety feature - / / > 1 (control room system)

(L)ow-Power / Shutdown > 1 i> 1 i> 1 (N)ew or (M)odified from bank including 1 (A) > 2/> 2/> 1 (P)revious 2 exams (similar topic) < 3 I < 3 / < 2 (randomly selected)

(R)CA (S)imulator

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: North Anna (JPM Set B FINAL) Date of Examination: 6/21/2010 Exam Level: RO SRO-I SRO-U Operating Test No.: 1 Control Room Systems (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System / JPM Title (KA) Safety Type Code* Function a.) 001 / Respond to a misaligned control rod (1-AP-1.3). (A1.02) A, E, M, P, 5 1

(RO and SRO-I) b.) 055 / Manually align condenser air ejector discharge to containment (1E3). (A4.01) D, E, L, S 4 (Sec)

(RO_and_SRO-I) c.) 003 / Respond to a loss of reactor coolant pump seal cooling (1AP33.2). (AA1 .22) A, E, M, S 4 (Pri)

(ALL) d.) 026/ Configure emergency bus loads to prevent emergency diesel overload (0-AP-lO). (A2.05) D, E, S 6

(RO) e.) 004 / Charging flow control valve fails closed (1-AP-49). (A4.06) A, D, E, S 2

(ALL) f.) 073 / Respond to recirculation spray heat exchanger service water radiation monitor alarm C, D, E, P (1-AP-5). (A4.01)

(RO and SRO-I) g.) 006/ Establish Redundant cold leg injection flow paths (1-E-1). (A4.06) A, D, EN, 5 (ALL) h.) 022 / Reduce containment pressure to subatmospheric (1/2-FR-Z4). (A4.04) C, A, D, EN (RO and SRO-I)

In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U) i.) 004 /Align a charging flowpath locally. (A2.07) D, R 2 (ALL) j.) 055 / Prepare the station blackout diesel generator for loading following an automatic start D, E, L 6 (0-OP-6.4), (EA2.03)

(ALL) k.) 061 / Align both motor driven auxiliary feedwater pumps to feed the steam generator by way of D, E, L 4 (Sec) the motor operated valve header (1-AP-22.1). (A2.04)

(RO and SRO-I)

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RD I S RD-I I SRO-U (A)Iternate path 4-6/ 4-6 / 2-3 (C)ontrol room (D)irect from bank <9/<8/<4 (E)mergency or abnormal in-plant 1 /> 1 /> 1 (EN)gineered safety feature - I - I 1 (control room system)

(L)ow-Power / Shutdown > i /> 1 /> 1 (N)ew or (M)odified from bank including 1 (A) 2/> 2/> 1 (P)revious 2 exams (similar topic) < 3 / < 3 / < 2 (randomly selected)

(R)CA >11>11>1 (S)imulator

tr ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Date of Examination: Operating Test Number:

Initials

1. General Criteria a b* c#
a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 .a.) 4
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
2. Walk-Through Criteria --
a. Each JPM includes the following, as applicable:
  • initial conditions
  • initiating cues
  • references and tools, including associated procedures
  • reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee 4,
  • operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified U .4i on those forms and Form ES-201-2.
3. Simulator Criteria --

The associated simulator operating tests (scenario sets) have been reviewed in accordance with 7 Form ES-301-4 and a copy is attached.

Printed Name I Signature Date

a. Author Ct s r
b. Facility Reviewer(*) r 1

JLd; ( Lflc I

c. NRCChiefExaminer(#)
d. NRCSupervisor 1t\

NOTE: The facility signature is not applicable for NRC-developed tests.

  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301, Page 24 of 27

rit\)AL ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: North Anna Date of Exam: 6/7/2010 Scenario Numbers: 1 / 2 / 3/4/5/6 Operating Test No.: 1 QUALITATIVE ATTRIBUTES Initials a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. V &7
2. The scenarios consist mostly of related events. çj F
3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) that are entered to initiate the event

. the symptoms/cues that will be visible to the crew

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. (JM
5. The events are valid with regard to physics and thermodynamics.
6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

8. The simulator modeling is not altered.

(jf2:::

9. The scenarios have been validated. Pursuant to 10CFR55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
10. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.

çç

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios). cg3
13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes 1 /2/3/5/6 4

1. Total malfunctions (58) 8/7/8/8/9 clcil. ,_4i %/
2. Malfunctions after EOP entry (12) 3/3/3/3/3 ci.iL e
3. Abnormal events (24) 5/3/4/5/5
4. Majortransients (12) 1 / 1 / 1 / 1/1
5. EOP5 entered/requiring substantive actions (12) 2/2/ 1 /2/2
6. EOP contingencies requiring substantive actions (02) 0/0/ 1 / 1 /0
7. Critical tasks (23) 4/4/2/3/3

ES-301 Transient and Event Checklist Form ES-301-5 NOTE: I/C Events in bold happen before EOP entry Facility: North Anna Power Station Date of Exam: 6/7/2010 Operating Test No.:l A E Scenarios P V P E 1 2 3 5 T M L N I r CREW CREW CREW CREW N C POSITION POSITION POSITION POSITION T A T N y S A B S A B S A B S A B T p R T 0 R T 0 R T 0 R T 0 L U E 0 C P 0 c P o C P 0 C p MO R IU RO RX 1 4 1 2a 110 NOR 144a 111 SRO-I I/C 3,6,9 2,4, 2,4a 1,3,6 2,4,7 3,5,7 1,2a, 2,4,7, 4 4 2 SRO-U 6,8 6,7 8 8 8 D MAJ 7 7 5 5 6 6 6 6 221 TS 022 RX 1 4 1 2a 1 1 0 NOR 2a 4a 1 1 1 SRO-I I/C 2,3,4, 1,2,3, 2,3,4 1,2,3, x 6,8,9 4a,6, 5,7,8 4,7,8 SRO-U x MAJ 7 5 6 6 221 TS 3,5 2,3 2,4,5 4,5 0 2 2 NOR 4a SROl x I/C 3,6,9 2,4a 2,4,7 1,3,7 4 4 2 SRO-U 6,7 MAJ 7 5 6 6 221 TS 022 NOR oi I/C 442 SRO-U MAJ 2 2 1 TS 022

ES-301 Transient and Event Checklist Form ES-301-5 NOTE: I/C Events in bold happen before EOP entry Facility: North Anna Power Station Date of Exam: 6/7/2010 Operating Test No.: 1 A E Scenarios P V P E 6(spare) T M L N I T CREW CREW CREW N C POSITION POSITION POSITION T A T A N y S A B S A B S A B M T P R T 0 R T 0 R T o L U M(*)

E o c p o c p o c p R IU RO RX 5a 110 NOR la 5a 1 1 1 SRO-l I/C 1,3,5 2,4,5 4 4 2 SRO-U 7,8,9 MAJ 6 6 221 TS 022 RX 5a 1 1 0 NOR la 111 SRO-l I/C 1,2,3, 4 x

SRO-U x MAJ 6 221 TS 1,4 022 NOR oi X I/C 1,3,5 4 4 2 SRO-U MAJ 6 221 TS 022 NOR SROI I/C 442 SRO-U MAJ 2 2 1 TS 022

ES-301 Competencies Checklist Form ES-301-6 Facility: North Anna Date of Examination: 6/7/2010 Operating Test No.: 1 APPLICANTS RO/BOP X RO X RO El RO El SROi El SRO-I X SRO-l X SRO-l El SRO-U El SRO-U El SRO-U El SRO-U x Competencies NIjO_ CNJO_

1235123512351235 Interpret/Diagnose 2,3, 1,2, 2,3, 1,2, 3,5, 2,4, 2,4, 1,3, 2,3, 1,2, 2,3, 1,2, 2,3, 1,2, 2,3, 1,2, 4,5, 3,4a 4,5, 3,4, 6,7, 4a,5 6,7 5,6, 4,5, 3,4a 4,5, 3,4, 4,5, 3,4a 4,5, 3,4, Events and Conditions 6,7, 5,6, 6,7, 5,6, 9 6 7 6,7, 5,6, 6,7, 5,6, 6,7, 5,6, 6,7, 5,6, 8,9 8 8 7,8 8,9 8 8 7,8 8,9 8 8 7,8 Comply With and 1,2 1,2, 1,2, 1,2, 1,3, 2,4, 1,2, 1,2a 1,2 1,2, 1,2, 1,2, 1,2 1,2, 1,2, 1,2, 3,4, 2a,3 3,4, 2a,3 5,7 4a,5 4,4a 3,4, 3,4, 2a,3 3,4, 2a,3 3,4, 2a,3 3,4, 2a,3 Use Procedures (1 5 6 4 4a 4a 5 45 6 6,7 5,6 5,6 4,4a 4a,5 4 5 5,6 4,4a 4a 5 4 5 7,8 5,6, 6,7, 6,7, 7 7,8 5,6, 6,7, 6,7, 7,8 5,6, 6,7, 6,7, 8 8 8 8 8 8 8 8 8 Operate Control 1,2, 1,2, 1,2, 1,2a 1,3, 2,2a 1,2, 1,2a 2,3 3,4, 3,4, 6,7 3,4, 4,4a 3,6 Boards 2 6,8, 4,4a 4a,5 6,7 4a,5 6,7 7,9 5,6, 6,7, 8 6 8 8 Communicate 1,2, 1,2, 1,2, 1,2, 1,3, 2,2a 1,2, 1,2a 1,2, 1,2, 1,2, 1,2, 1,2, 1,2, 1,2, 1,2, 3,4, 2a,3 3,4, 2a,3 5,6, 3,4 4,6, 3,4, 3,4, 2a,3 3,4, 2a,3 3,4, 2a,3 3,4, 2a,3 and Interact 5,6, 4,4a 4a,5 4,5, 7 4a,5 7 5,6, 5,6, 4,4a 4a,5 4,5, 5,6, 4,4a 4a,5 4,5, 7,8, 5,6, 6,7, 6,7, 6 7 7,8, 5,6, 6,7, 6,7, 7,8, 5,6, 6,7, 6,7, 9 8 8 8, 9 8 8 8, 9 8 8 8, Demonstrate 1,2, 1,2, 1,2, 1,2a 1,2, 1,2, 1,2, 1,2a 3,4, 2a,3 3,4, 3,4, 3,4, 2a,3 3,4, 3,4, Su ervisor y Abilit (3 56 44a 4a5 56 56 44a 4a5 56 7,8 5,6 6,7 7,8 7,8 5,6 6,7 7,8 9 8 9 8 Comply With and 3,5 2,3 2,4 4,5 3,5 2,3 2,4 4,5 Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate ever, applicable competency for ever, applicant.

iiL ES-301 Competencies Checklist Form ES-301-6 Facility: North Anna Date of Examination: 6/7/2010 Operating Test No.: 1 APPLICANTS RO/BOP X RO X RO LI RO LI SRO-I LI SRO-I X SRO-l X SRO-l LI SRO-U LI SRO-U El SRO-U LI SRO-U x Competencies NIjO_ SNJO_

6 6 6 6 Interpret/Diagnose 1,2, 1,3, 1,2, 1,2, Events and Conditions 5,6 3,4, 3,4, 5,6, 5,6, 5,6, 7,8, 7,8, 7,8, 9 9 9 Comply Vvith and 1,la 1,1a 1,1a I,Ia Use Procedures (1) 5a,6 5a,6 5a,6 7,8 7,8 7,8 9 9 9 Operate Control 1,la 1,la 2,3, 3,5a Boards (2)

Communicate 1,la 1,la 1,la 1,la and Interact 5a,6 5a,6 5a,6 7,8, 7,8, 7,8, 9 9 9 Demonstrate 1,la 1,la Supervisory Ability (3) 2,3, 2,3, 5a,6 5a,6

. 7,8 7,8 Comply With and 1,4 1,4 UseTech.Specs.(3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

11/18/2e09 12:22 4845b2455 NRC PAGE 82/15 S-4O1, Rev. 9 PWR Examination Outline.. Form ES-401-2 FacIlIty North Anna DateofExam: 2010 RO IdA Categofy Poinla SRO.OnIy Points liar group KKKKIdKAAAAG A2 G* Total 1 2 3 4 5 6 1 2 3 4

  • Total 1, 1 333 33 3 18 3 3 6 Emergency& 2 4 2 292 NIA NIA OlUtiOns Tier Totals 5 5 4 4 4 5 27 5 5 10 1 331333 32223 28 3 2 5 2 1111111101110 2O 1 Systems rT,tla 44244443234 35 5 3 8 3, Genailo Knowledge and AbUitlee 1 2 3 4 10 1 2 3 4 7 CategorIes 3 2 3 2 2 j 2 1 I Cn,airo Uiat at least two topics from every applicable KIA category are sampled wltbln each tier ci the RD and SRO-only outflnea (i.e., axcapUor one category In Tier 3 of the $50-only outline, the Tler Tetair In each IdA category shea not be lane then two).
2. The poInt toil for each group and tier In the proposed outline must match that specified In the table.

The final pclnttotal for each group and tIer may deviate by *1 from that specified hi the table based on NRC revIsions.

The final RO exam meat total 78 poInts and the SRO-ordy amm must total 25 poInts.

3. Systemolevclutlone within each group are Identified en the associated outline; systems or evolutions that do not apply at the facilily should be deleted and IcaUftod; operationally importaflt alte4padflc syaten at are not Indutled on the outline should be added. Refer to section 0.1 .b of ES-401 for guidance regmdlnq the elImInatIon of Inappropilata KIA statements.
4. Select topics from as many systems and evolutions as poselble sample every system or evolution In the group before selecting a second topic for any system or evolution.
5. Absent a plar*-speclflc priorIty, only those KlAs having an Importance rating (IR) of 2.6 or higher ahali be selected.

Use the RO and SItO rathige for the RO and SRO.only portions, respectively.

6. Select SRO topics for liar, I and 2 from the shaded systems end KIA categorIes.
7. Ths goneric (0) kIAa in Tiara I and 2 shell be selected from SectIon 2 of the IdA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to section D.I.b of ES-401 for the applicable kAs.
8. On the following pages, enter the IdA numbers, a brief descrIption of each topic, the tcplcs Importance ratIngs (IRs) for the apphcable license level, and the point totals (C) for each system and category. Enter the group and tier totals for each category in the table above; Iffuel handling equipment Is sampled In other than Category *2 or G on the SRO-only exam, enter It on the mR side of Column A2 for liar 2, Group 2 (NOte #1 does not apply). Use duplicate pages for RD and 850-only esams.
9. For TierS, select topics from Sactlo 2 of the lilA catalog, end enter the lilA numbers, deseilptlona, IRS, and polnttotala (0) On Form S.4Q1$. UmltSflO selections to hAs thatare linked tolO CFR 58.43..

11/18/2889 12:22 4045624955 NRC PAGE 03/15 c4, I 01 W

I I I 0.

C C13 C

8 § I . ° -

a -

S (0

.0) 0)

it N

V 8

I a

j z 0)

C C fl C C C C C C C C C C C C C C C C IC C C C C C C 0 C 0 C C C C C C C C C C C C C C C C C C C C C C C IC C IC C IC C IC C IC C C IC C C C ID C C C C C C C C C C IC C C C C IC C C C C C C IC C C C C C C C C C C C C C C C C C C 0 0 to (0 r. a (0 to to tO (0 ci d 2: to 0 I o

0)

Z 8 C?

U) a .

to E we 8

0. 6

- & U) w .,I U) 1 C

I i I

ES-401, REV 9 T1GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR 1(1 1(2 K3 K4 KS K8 Al A2 A3 A4 G TOPIC:

no sao

()56A02.4.9 L.ossoiOff-eltePcweris 3.8 42 I

[1 El El El El [1 U Li El El [

.3 siratogles. .3 057AG2.4.45 Loss at Vital AC Inst Brie 16 4.1 4.3 C] C] fl C] (E fl C] Ability to prioritize and iMerleet the eignifianCe of each aieicfatoi or alarm.

(Ji 0

0624A2.01 Loss of Nucie Svc Water! 4 2.9 3.5 El U El El [] Li U l U [] [] L.ocal(cn at a leak rn the SWS k)

LD (31 (31 (165AG2.1.27 soFInstru,nentAr18 Krowtectgeatsystam purpose andarfwichori.

El C] El El El El El 1] [] El J O7TAA1 .02 Generator Voltage arid ElectrIc (3rfd Turbrnel generator controls Drsluibai,ces 16 LI Li C] [1 [1 C] ]Ofl El El WEOSEX3.3 Inadequate Heat Transfer Loss of 4.0 4,1 Mançulallon of controls required to obtain desed Secondary Heat Sink! 4

[] El El El El [I El El El El opetaFng resiihs thjrfrrg abnormal arid emergency situations.

WE1 1 EA2.1 Lass of Emergency Coolant Racirc. 14 34 4.2 El [I [1 El [I U LI fI C] 1] C] Facitly ccrtdillcns and selection of approprIate procedures during abiormel and ensrgancy operations.

Page 2o12 11,1212009 2:00PM

i.

ES401, REV T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAMEISAFETY FUNCTION: IR l1 K2 KS 1(4 1(5 1(8 Al A2 AS A4 G TOPIC: 3 RO SRO w OOIAJ(1.03 CotntrousRdWIthclrav.l1i 3 R&atiorlswp at reactivity and reactor power to rod

[1 LI LI [1 El El [1 [1 [3 El moveinenl 032AA2.09 Lose olSaurce Range Nl17 2.5 2.9 Effect at lai proper HV setting

[] [3 [3 [] f] [] [J LI LI OGaAA1 .01 Loss ol lrtte!medrate Range NIl 7 2 3.1 Power-available Indicators In cabinets or equipment C,

[3 [] fl [3 fl [] [ U [] Li El drawers U,

3 C.

C 036AK3.C1 Fuel Handling Acclderitl8 ai .7 [] LI Il El LI [1 LI LI Li LI U DIffear,t Inputs that 4U cause a reactor btdirg evacuation 0G7A02.1 .19 Steam Generator tube Leak 13 39 3.8 El El El El El El LI El LI LI AbilIty to use pPant computer to evaluale system Or component status.

LYI4EKI.03 mad. Core Coclng!4 Processes for renioving decay heat frum the core

° i El Li El LI U C] LI LI Li LI WEO2EK2.I Z SlTernilnatlonl3 34 3.9 [3 [3 [1 LI LI U Li LI C] C] Components and functIons of control and safely systems.

including rnslnrionaa&n, sIe1e, Interlocks, faIlUre C) modes and automatic wid manual features.

WEI5EK2.2 Containment Flooding 15 2.7 2.9 [] LI C] El El El Li [] 1] CI FacIlWs beat removal syalems. Including primary cooIarit emergency coolanI die decay heat removal systems and relations between the proper cperalion ci these systems to the operation of the ?ac1ty.

weI6EG2 4.50 High Conlalna ant RadIation 19 4.2 4.0 AbSity to verIfy system alarm sefpornla arid operate UULIElElEJOElE1El controls lder*Ifled In his alarm response manuaL

-o U

Page 1 of I 11/1212009 2:00 PM C

ES-401, 11EV 9 T2G1 PWR EXAMINATION OUTLINE QRM ES-401-2 KA NAME/SAFETYFIJNCTJON: WI 1(1 K2K3K4K5KSA1A2A3A4G TOPIC BC SRO 0031(5.02 Reactor Coolant Pump 2.B 32 & RCP Coaatthw RCS parameters

[] [] El El LI LI LI El El E] On 004G2.L19 Chernrcal and Volume Control 3.9 as Q [] U [] LI [] El [] [] [] J Al eplami computer to evae system or oomponerd slabs.

0041(6.16 Chemical and Volume Car,lrol 283.1 Beacon for venting VCT aiid pump casings wIila Itiling:

fl fl [] U [] LI LI [] [] El vents must connect to LBS 0051(8.03 Reidal Heat iRemoval 26 2.6 RHA heat exohailger

[] [] [] [] J [] [J [] fl fl 006K6.18 Einerency Core Cooling 3.6 3.9 [j [] [1 [J [] { [] [] fl fl [] Subcocllng margin indicators 0071(4.01 Pressurlzar ReflefiCuench Tank 26 2.9 [] [J fl ] [] [] U Li [] El [] Oueiicti tank COcifl z

C) 0O7K502 PreaswzerflellefJQuenchTejik 3.1 Method of lomling a steam bubble In Uie PZR LI [1 ü U [ Li El C] U El []

008A3. 10 Component CooJing Water 2.9 3.0 [] [] [] C] [] [J [J C ] C] CCW pump U18trtTientS arid theIr respective sensors.

lncJudlng flow, pressure, ci level and discharge temperature 008G2.4A5 Component Cooling Water 4.1 4,3 Abluy to prfodllze and Interpret Uie sIgiilicanca ci ascii Q LI El LI U Li LI El Li Li annunclatorcr alarm.

010A3.01 Pressu.lzer Pressure Control 3.0 3.2 PAT temperature nd pressure during PORV Lasting El El LI El El El El C] C] U 0121(2.01 Reactor Proteclien 3. 3.7 [1 El C] [1 C] [I U [1 [1 C] HPS channels components and Int&coa,nedlails

-o m

0, Page 1013 1111212009 2:00PM CT

11/19/2 12:22 44562455 NRC PA6E 7/15 1

0 ljJ I a,

8 II a

I -

z Q.

I U.

8 D D D ID ID ID ID ID ID ID ID ID C C ID ID ID ID ID ID ID ID C ID ID ID ID C ID ID C ID ID a, ID ID ID C ID ID C] ID ID ID ID ID ID C ID ID ID C ID ID ID ID C ID ID C C ID ID C ID C C ID ID C ID ID ID C ID ID C ID ID ID ID C] C ID ID ID ID ID ID C ID ID ID ID ID L P. (0 0c) 0 01 to a, to P.

ci oz D

IL.

U.

I LI.

f U.

w .

a) 8 w 2

LU LA. U.

8 (I

0 Q

o 0

-J o 2 Cd, m 3 0 w m 3

I

-ç

. 1 5

C z

CJ )

(7.

M Ca 0 G)

D Li LI Li d LI Li LI Li Li LI Li LI C LI LI Li LI Li LI Li LI Li LI 0 LI LI LI Li LI LI Li Li LI LI LI Li Li LI LI LI LI Li LI 0 0 Li LI LI LI I- fll Ca c,z g

9. i.

ft 3 0.

c Il-S C TI S

I 9I/8 3Sd 99EP9l :i 6OG/81/tt

m Q

Ill a E a

2 a -

C) 2.

g N $0

  • Ui =

N p p p LZi C C C C C C C C C C C C C C C C C C C C C C C C C C C c

C C C C C C C C C C C C C C C C C C C C C C C C C z

S F -

8 S  ! a 8

a m

0) 0

-4 91/60 3Sd DJN 995 :t 6@0/81/1t

ES-401, REV 9 13 PWR EXAMINATION OUTUNE FORM ES.401-2 KA NAME ISAFETY FUNCTION: fl k1K21c3IC4IC5KBAIA2A3A4G TOPIQ:

no sf0 02.1.10 Conduct of operallons 3,9 3.6 DDflflDJLJDfl to use plant ccniputer evaluate systeen or component status.

02.1.20 Conduct of opallona 4.6 4.8 DDLJEJLJLJEJUOEJ Abilty to eaeçute procedure steps.

Gal .9 Conduct of operations 2.9

  • L1UDDLJDUE1DflI Ability to direct personnel acflvilfas Inside the control morn.

02.2.2 EquIpment Crnt,oI 4.6 flDflflDUUUDflI Ability to manipuiata the console controle as reqelred to operate the facil4ty between &iutdovm and deslgiatad poweflevels.

02.2.37 EquIpment ConIro 3.6 4.6 AbilIty to determine operabiOty anoforavallabllty of safety relaled equipment 02.3.11 RadiatIon Control 3.8 4.3 ODD L][JLJ[JDD[J[ Atility to control radiation r&eaaes.

023.13 Paalion Ccnol 3.4 0] DUD U U U 1 Knevtadgo of radiological safety procedures pedainhg to licensed operator duties 02.3.4 Raalion Conkol 32 3.7 UU[]0DD0[]U[]I Knowledge of radiation exposure lirnita under norrn and mnergency conditions 02.127 Emergency ProceduresiPtans 3,4 3° E1UDE1DDDUUDt Knowledge of lire hi U,e plant procedures. -_____

02.44 Emergency ProcerIuras/Pans 15

  • 000QDUU000 AbUily to recognize abnormal Indications for system operathig parameters whicit are entry-level conditions for emergency and abnourial operating procedures.

Page 1 of 1 11112/2009 00PM

I-.

REV9 5

ES-401 -

SRO TIG1 PWR EXAMIAflQN OUtLINE FORM E8.46I-2 KA NAME ISAFETY FUNCTION: Laki 1(2 1(3 1(4 1(5 K6 Al A2 MM 0 TOPIC:

RO SRO COBAA2.25 PreseuthUr Vapor Space AccIdent! 3 2.8 3.4 flE]I][]IiDCi[] Expected Iek rate from open PORV or code safety (125AG2.2.36 Loss at RHI System 14 3.1 4.2 AblIty Ia analyze te effect ci maintenance sctMtlee.

suct as degraded power scwcee. on ine status of rmiting contlons of operations Ui 058M2.02 Loss of DC Power IS 3.33.6 [][J[J[JflQ[)[j[][] 126V dc bus voltage. iowcdtlca1 tow. elami Q1 1s3

.0 a

a 066A02.l.19 Loss of Inelnineni Air! 8 3.9 38 Ability to use plant computer to evatuate syatem or -

component status.

WEO4EA2.1 LOCA Outside Contalnrnentl3 4 4.3 OODDJL1E1EJ Facility corIloiis and selection of appropriate procedures during ahncrmal and emergency opelaons.

weO5EG2.4.2 Inadequate Heat Transfer Loss of

- 3.8 4l flJJEJ Knowledge of operational Implications of EOP warnings.

Secondary Heat Sink 14 cautions and notes, z

Page 1011 11/1212900 2:110 PM I.

U

ES-401, REV 9 SRO TIG2 PWR EXAMINATION OUTLINE FOIM ES4D1-2 NAME/SAFETY FIJNCTLON: I Ki 1(2 1(3 1(4 KS K Al A2 A3 A4 (3 TOPIC:

RO 3R0 OOIAA2.03 ConUnuous Rod MThfrai Il 4.5 4.8 U U U LI Li LI Li I El U U Proper actions to be taken It automatic safety functions have not taken place O8AA2.O8 Presauwizai Level Malfunction 12 3.1 35 Q U Li Li U [1 El El E][] P2R tevel as a function of power Ievd 038AG2.4.8 Fuel Handling Accident F 8 L]U U LI [1 [1 [1 [1 [1 U II Knowledge of how abnomil operating procedues we used iii conjunction with EOPs.

OC8AG2.2.40 Ccntml Room Evac. 18 3.4 4* U U U E] [][]U [1 1] El [1 AblIfty to apçly tecimical specifications for a system.

z Page 1 of I 11)1212000 2:00PM (ii

0 m

I z m

0 3 1 m

a Co a C 0

ci ci ci ci ci ci ci ci ci ci ci ci ci ci C i:i ci ci ci ci ci ci ci ci ci ci ci ci ci ci D ci ci ci >

o ci ci z ci ci ci ci ci ci ci ci ci ci ci ci ci 0

. . -C h

1 i

91/E1 39Vd DIN 99@t, 6GG/8I/tt

ci 2

m

-n o C 0

-I 0

2 1%)

0 C i: D C 1 C C C C C C ci C C C C C C C C C C

C C C C C C C

C C

i.

(.

0 F..,

2 I/t 39d DdN 6GG/8I/II

I1/18/20e9 12:22 4e45624955 NRC PAGE 15/15 I

o1 i U.

1 8 fi I h S.

.1 E

. I i .2 L o 2

ø_ 0 82* .

2*

. 0-

[0 111 !I ii ll UI L C C C C C C C C C C C C C C C C C C C C C C C C

C C

C C

C C C

C I C C C C I 0 0

C C C (4

(4 C

C C

C cr5 C

C C

C Q

cr4 0

I z I

I jç,

1 0.

0 V

I I I

E (4

0 0

LJ

ES-401 Record of Rejected KIAs Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected K/A 3 G2.1 .35 G2.1.38 - Unable to prepare a question at the SRO-only level 1/1 038EA2.16 038EA2.05 Unable to prepare operationally valid, psychometrically sound question ES-401, Page 27 of 33

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: North Anna Date of Exam: 06/16/10 Exam Level: R0SRO Initial Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. &15
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401
4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions 7Jz 4 4 were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).
5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or

>c the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only 33 / 4 6 / 2 36 / 19 question_distribution(s)_at_right.
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension/ analysis level; ,-

the SRO exam may exceed 60 percent if the randomly  ? F9 selected K/As support the higher cognitive levels; enter 30 / 6 45 / 19 the actual RO / SRO question distribution(s) at right.

8. References/handouts provided do not give away answers (J,3 or aid in the elimination of distractors.
9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; ç4f v.

deviations are justified.

10. Question psychometric quality and format meet the guidelines in ES Appendix B. f /L
11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. I
a. Author
b. Facility Reviewer (*)
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor Note:
  • The facility reviewers initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401, Page 29 of 33

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

LOK LOD (F/H) (1-5) UIEIS , Explanation Stem Cues T/F Job- Minutia #1 Back- Q SRO Focus Link units ward K/A Only NORTH ANNA 2010 RO Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

Check the appropriate box if a job content error is identified:

  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check Questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2 S 2 H 2 X E fIhy did you select 23.4 and 27.7 in distracters B & 0? Consider using

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F I Cred. Partial Job- Minutia #1 Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only he same values. DECIDED TO USE THE NUMBERS AS PROVIDED.

3 H 2 S Provide information as to where/if the other parameters information can be 4 F 1 S? ound (location). PROVIDED INFORMATION NEEDED TO SUPPORT QUESTION.

Need to look at the plausibility of distractors C & D. Need to discuss how he plant/system would respond to a stuck open relief valve. Will consider making changes to the distractors after discussion. DISCUSSED RELIEF E

IALVE OPERATION. DECIDED TO USE QUESTION. EVEN THOUGH HE CPs DO NOT HAVE RELIEF VALVES, THERE ARE OTHER PUMPS WHICH DO.

Need to discuss plausibility of distractors A & B. Explore using different leak rates and evaluate outcome. Discuss what would occur if charging H 3 X E/U vas in auto. What would ever cause RHR pump flow to remain the same?

DECIDED TO USE QUESTION AS IS 7 H 3 S 8 F 2 S Need to look a Rx flange 0-ring drain path. DECIDED THAT QUESTION DID NOT ADDRESS THE COOLING OF THE QUENCH TANK (K/A) 9 H 2 S ILL REWRITE QUESTION 5/24... STILL WAITING FOR A RESPONSE. REVISED QUESTION (OK) 10 H 2 S 11 H 3 S Need to make sure there are not two correct answers. A & B. Need to 12 H 2 X E inswer the question concerning the enthalpy process. Does distance have any affect? CHANGED WORDS IN DISTRACTORS A & B.

Please explain relationship between the breakers and alarms. Explain selection of time delays. Why is it that in C & D you identify pump and not 13 H 3 X EIS in A & B? Appears to be unnecessary information. ADDED WORDS TO FHE STEM AND THE WORD BREAKER TO THE DISTRACTORS.

QUESTION IS OK.

14 H 2 S 15 H 2 S

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

LOK LCD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #/ Back- Q= SRO Focus Link units ward K/A Only

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only Based on the information provided, need to make sure that Natural 16 H 3 irculation is not occurring. NATURAL CIRC WAS NOT OCCURING.

There appears to be unnecessary information in the stem. Clarify what 17 F 2 X E ou are asking. Are you asking Train A and Train B of  ? Reword stem. REMOVED/REWORDED STEM AS SUGGESTED. (OK)

)nly concern here is that this question addresses bases. Is this an RO 18 F 2 luestion?

19 F 1 S LCD.

20 H 2 S This is a memory level question LCD. Stem can be improved to make sure hat question matches all aspects of the K/A.Distractor A & C are not plausible. Please identify an event where following the loss of a normal power source where there is a backup power supply that can be used 21 F? 1 X X U orever. LICENSEE PROVIDED INFORMATION WHICH INDICATED HAT THERE ARE SYSTEM WHICH COULD LOSE POWER AN BE ON BACKUP POWER FOR AN INDEFINITE PERIOD OF TIME. THIS MAKES DISTRACTORS A & B PLAUSIBLE. SHOULD NOT HAVE BEEN

. U.

22 S It appears that the stem ask for only the system response. The distractors 23 H 2 X E provide answers for a two part stem. AGREED WITH COMMENT.

MODIFIED QUESTION. (OK) 24 H 2 S 25 S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only K/A doesnt match. Question should address loss of RHR. LICENSEE EXPLAINED HOW A LOSS OF SERVICE WATER WOULD EFFECT THE 26 H 3 X U

\BILITYTOCOOLUSINGRHR. LESSCOOLINGWATERTOTHERHR HEAT EXCHANGERS. SHOULD NOT HAVE BEEN A U.

Can the operators be dispatched to locally open the valves? If this can be 27 H 2 X SI? tone, what is the outcome? WILL PROVIDE ADMIN PROCEDURE FOR

/ALVE OPERATION. CHANGED WORDING IN STEM.

Please provide additional information as to why you consider A plausible.

,Vhat can does chilled water be used to cool? CHILLED WATER IS

° USED THROUGH THE PLANT TO PROVIDE A SOURCE OF COOLING.

(OK).

29 H 3 S 30 F 2 S 31 F 2 S.

rhe K/A ask for ability to monitor power-available indicators in cabinets or quipment draws. This concept is not included in the question.

UNDERSTANDING THATA BLOWN FUSE ON THE CABINET WOULD

)

RESULT IN A LOSS OF CONTROL POWER TO THE DETECTORS.

HIS WOULD CAUSE A REACTOR TRIP AND DUE TO ONE OUT OF WO LOGIC ASSOCIATED WITH THE NI SYSTEM.

Please re-write question such that is evaluate to operator ability to operate r monitor from the control room radiations levels. LICENSEE DISCUSSED REASON WHY AND WE AGREE THAT THE K/A 33 H 3 X U MATCHES AND IT IS AN RO LEVEL QUESTION. CARF TRIPS WILL RESULT IN SELECTED MONITORS TO BE INOPERABLE, THEREFORE THE ABILITY TO DETECT RADIATION LEVELS ARE REMOVED. QUESTION IS OK.

34 F 2 S Is this a RO level question? LICENSEE SAID THAT THEY CONSIDER IT 35 H 3 SI? \PPROPRIATE FOR THEIR RO. ADDED THE WORD CREW TO THE STEM REMOVED APPROPRIATE (OK).

K/A doesnt match. After looking at the question and your comments I 36 Ii suggest replacing the K/A. WILL REPLACE K/A AND PROVIDE NEW QUESTION. AGREED WITH OUR COMMENTS.

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #1 Back- Q= SRO Focus Link units ward K/A Only

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only rhe K/A discusses operating/monitoring from the control room. Can hrottling not be done from the control room? Your procedure appears to indicate that it can be done form there. If it can then there are two correct 37 H 3 X El? answers. Not sure why someone would pick 150. Provide additions information to justify. DETERMINED QUESTION WAS OK BASED ON HE FACT THAT THE 3 INCH BYPASS ARE USED TO CONTROL HEATUP RATE.

Not a direct match to K/A. K/A addresses steam line rupture. Question loesnt. Two possible answers C & D. excessive RCS cooldown could

-affect Nil Ductility. AGREED WITH OUR COMMENTS. WILL WRITE A U

NEW QUESTION USING VOTGLE AND ANO EXAM QUESTION AS EXAMPLES. REPLACE QUESTION. REVIEWED THE REPLACEMENT ON 5/20. AGREED IT WAS ACCEPTABLE.

K/A not matched. Question doesnt address main turbine system.

\GREED WITH THE LICENSEE THAT THE QUESTION DID MATCH IHE K/A. PLANT PRAMATERS PROVIDED WAS AN INDICATION OF A MT/G SYSTEM PROBLEM. MODIFIED DISTRACTORS.

Ihe question states that SG pressure is 190 psig. The Caution in 1 ECA 0.0 states that SG pressure should be maintained greater than 190 psig.

Ihere may not be a correct answer since pressure is not greater than 190 40 X X E psig. This is on the line such that it could be correct or incorrect.

Distracter B is not plausible because it is a procedural requirement as

)pposed to a physical consequence. REPLACED 190 PSIG WITH 180 PSIG. REWORDED DISTRACTOR B (OK).

Explain the correlation between the steamline radiation monitor identified 41 UIE in the question and the condenser air removal system (which is required t be addressed by the K/A). As is I do not see the K/A match.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO U/EIS Explanation Focus Dist. Link units ward K/A Only

.CCEPTED QUESTION AS IS.

Explain why you consider this a loss of offsite power. PROVIDED 42 H 3 X U/S DRAWING AND INFORMATION WHICH EXPLAINED WHY IT WAS A LOSS OF OFFSITE POWER. (OK) 43 H S Question fails to address power level restrictions for MFW system as 44 X U required by K/A. LICENSEE AGREED WITH COMMENT. WROTE NEW QUESTION.

45 H 3 S Need to make sure that B & C are not correct. ONLY ONE CORRECT 46 H 3 NSWER. WILL MAKE DISTRACTORB LOOK LIKE A 47 H 2 S 48 H 2 5 49 H 2 S 50 H 2 S Dist D is not plausible. Cant think of any situations where an operator can 51 F 2 X E electively arrange tripping of loads. ACCEPTED COMMENT. MADE NO CHANGE.

K/A doesnt match. K/A ask for knowledge of system purpose or function.

52 F 2 X U REWROTE STEM. IT NOW APPEARS TO MATCH THE K/A. DID NOTHING TO THE DISTRACTORS. SHOULD NOT HAVE BEEN A U.

53 S Change the stem to address /ask what will occur as a result of the alarm (expected valve position). Then ask what must be done to re-establish the 54 H X E release. QUESTION WAS DETERMINED TO BE OK. RICK SUGGESTED BUT WORD VERIFY WAS FROM PROCEDURE 55 H 3 S 56 F 2 S Consider re-wording the stem such that it ask which item alone will 57 F 2 X X E Iiscriminate or provide indication of need to verify simulator. Which answer is correct? Make sure there are not two correct answers.. .ADDED

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

LOK LOD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #/ Back- Q= SRO Focus Link units ward K/A Only

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO UIEIS Explanation Focus Dist. Link units ward K/A Only fJORDS TO THE STEM (OK)...

58 F 2 S 2uestion doesnt appear to match. K/A. Need to discuss normal pump 59 H X U/E? )peration and pump operation under spray condition. Could not locate information to evaluate. ACCEPTED QUESTIONS AS IS.

)uestion doesnt appear to match. K/A. DECIDED TO LET THEM USE 60 U HE QUESTION AS IS. NOT A U.

61 F 2 5 Both A & B appear to be correct. DETERMINED THAT THERE WERE

, NOT TWO CORRECT ANSWERS VERIVY CONDENSER PRESSURE VAS AN IMMEDIATE ACTION IN AP-14. QUESTION SHOULD NOT HAVE BEEN A U.

LOD. Unnecessary information in the stem. This is a list of true false 63 F I X X E tatements. REWORDED DISTRACTOR A Re word stem. Consider: Which one of the following describe the correct 64 F 3 X EIS sequence that must be performed when a fast load reduction is required in 9ccordance with.... REWORDED STEM (OK).

Distractors A and D are not plausible. Why would actions need to be aken if a component is operable or why would actions not have to be 65 H 2 X U aken if a component inoperable? OK WITH REASION PROVIDED BY HE LICENSEE. SHOULD NOT HAVE BEEN A U.

66 5 67 H 1 X S LOD meets K/A

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO U/E/5 Explanation Focus Dist. Link units ward K/A Only 68 1 S LOD meets K/A 69 S Change identified leakage to an even number (15) and power lost to 20 70 F 2 X E minutes. CHANGED DISTRACTOR D TO 30 MINUTES AND NFORMATION TO STEM

? Would indications be different if both trains failed to reset? PROVIDED 71 H 3 NFORMATION AS REQUESTED (OK) 72 S here may be two correct answers based on the fact that you have completed Step 9 of 1-ES-1.3. There is another question similar to this 73 H 3 X E ne concerning transition requirement between EOP and FR. DECIDED QUESTION (OK)

Distractors A & B are not plausible. Information provided in the stem tates that ORANGE Path conditions exist. Therefore, the crew knows that at some point and time the condition which caused the ORANGE Path must be addressed and a transition to FR-Z.2 would be entered.

LICENSEE PROVIDED INDICATIONS WHY THEY CONSIDERED DISTRACTOR A WAS PLAUSIBLE. AGREED WITH REASONS DID -

NOT REVISE DISTRACTORS. QUESTIONS SHOULD NOT HAVE BEEN A U.

Distractors B & D are not plausible. Why would one expect the need to 75 H 2 X U/E vacuate the Fuel Building? Could not locate any information that would support your answer. REVISED (OK)

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #/ Back- Q SRO Focus Link units ward K/A Only ES-401, Rev. 9 2 Form ES-401-9

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #/ Back- Q= SRO

= Focus Link units ward K/A Only NORTH ANNA 2010 SRO Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

Check the appropriate box if a job content error is identified:

  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check ciuestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 76(1) H 2 X X X U

[Rules It appears that the question can be answered with RO only knowledge.

for procedure usage may be used to answer first part of the huestion - RO knowledge. Can immediately eliminate distractors A & B.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only Nhen an ATWAS is identified, the first action taken is to attempt to trip the reactor as directed by E-0. Also would one not expect the RO to know vhat system lineup would be best to lower reactivity. The stem ask which ne identifies the procedure flow path to mitigate the event. Distractors A 9nd B do not identify a procedure flowpath. Consider rewriting the stem 9nd modifying distracters A & B. Need to take a look a possible two correct answers. Explain actions in step 5 of the procedure. How would maximum boration through the blender effect reactivity? ACCEPTED LICENSEES COMMENTS. QUESTION SHOULD NOT HAVE BEEN A U (OK) 77 RO know that C & D would not put you in a TS. Therefore, why is C & D F? 3 X U considered/ LICENSEE PROVIDED SUPPORTING INFORMATION TO IUSTIFY USE OF QUESTION AS IS (OK) 78 Stem could be reworded. REWORDED STEM AS SUGGESTED.

H 3 (3)

Explain why you consider this an SRO only question. Is it not common H 3 )perator knowledge to know which RCP should be tripped when a (4) X UP particular PRZR spray valve and block valve cant be closed?

DETERMINED QUESTION WAS OK. NOT A U.

\s the stem is written there appears to be two correct answers. Allowing 80 \FD to drift in either direction would place the AFD closer to an

,5\ H 3 X X U/E unacceptable operating region. Can this question be answered by only knowing the meaning of AFD? MADE CHANGES AS WE SUGGESTED.

(OK)

H 2 S (6) 82 None of the distractors contain the actual TS required time (1 in 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> H 3 X X E information). Also need to make sure that the answer provided is totally correct.

H 2 S Explain why this is considered an SRO level question. Expected actions Q4 re identified in the normal ops procedure. Who makes to report?

H 3 X DONCLUDED THAT IT WAS SRO ONLY BASED ON WHO IS (9)

REQUIRED TO MAKE REPORT FOLLOWING ENTRY INTO TS/SRMs.

(OK)

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

LOK LOD (F/H) (1-5) U/E/S Explanation Stem Cues T/F Job- Minutia #1 Back- Q= SRO Focus Link units ward K/A Only 1 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 85 t appears that this question can be answered with RO only knowledge.

(10) Vhat is the purpose of the pressurizer high level trip function? Is this not H 2 >

omething the RO should know- system purpose? ACCEPTABLE BASED ON COMMENTS AND OUR GUDIANCE.

his question can be answered with RO knowledge only.

System/component knowledge what makes a PORV 86 U perable/inoperable. The applicant doesnt need to know anything about H 2 X LCO 3.7.4. BASED ON COMMENTS PROVIDED, QUESTION IS CCEPTABLE AS SRO PER OUR GUIDANCE.

H 2 H 2 S LOD. First part of question can be answered with RO only knowledge. Is 89 EIS there a 30 minute associated with DG operation. NO CHANGES WERE F 1 14 MADE TO THE QUESTION BASED ON LICENSEES COMMENT. (OK) t appears that this question can be answered by RO only knowledge tril 90 et point and immediate operator actions that must be performed once 1-UP (15) ES-0.1 has been entered. ACCEPTED LICENSEES COMMENTS.

DETERMINED THAT QUESTATION WAS SAT.

F 3 S onsider rewording conditions in the stem. Containment pressure 21 psia 92 E nd slowly increasing Fans are not operated by the procedure H 2 X 17 MADE CHANGES AS SUGGESTED. (OK)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only LOD. RO level of knowledge. The question asks how the RO will carry

)ut this action. What is unique to SRO? PROVIDED ANOTHER K/A.

93 X U NEW QUESTION. PROVIDED NEW QUESTION Reviewed question.

H? 1 ....

18

Had a concern about one of the distractors. Talked to Steve Allen about changing the distractor. Will get back with me L 2 5 (19)

H? 3 5 (20)

It appears that the question can be answered with RO only knowledge.

Ihat equipment is required to give you two trains of MCRJESGR EVS.

re the ROs not aware that Fan 1-HV-F-141 is not used to determine 96 perability due to location of fan? Therefore, when determining H 3 X (21) ,perability, it is nota part of the equation. Also, the second part of Iistracters B & D do not appear to be plausible. ACCEPTED QUESTION S IS BASED ON INFORMATION PROVIDED BY THE LICENSEE.

SHOULD NOT HAVE BEEN A U. (OK)

Distractors B & D are not plausible. Do not know of any 0.1 rem limits.

97 U Consider using the information contained in the bases 0.5 rem in 2 H 3 X ----

22

hours Explain what makes this a SRO only question. Would like to review fire brigade training lesson. Distractor D is not plausible. When would you 98 replace a licensed operator with a non licensed operator? BASED ON H 3 X IJ/E (23) INFORMATION PROVIDED ASSOCIATED WITH OUR CONCERE, DETERMINED THAT THE QUESTION IS SRO. SHOULD NOT HAVE BEEN A U (OK)

H 3 S (24)

This is a memory question. None of the information in the stem is required to answer the question explain the Caution and its bases.

100 Distractors B & D do not appear to be plausible. Please explain why they 2 X X U/E (25) ire. Are there any references in FR-H-i which refer to creep rupture ailure. PROVIDED INFORMATION SHOWING THAT DISTRACTORS

/ERE PLAUSIBLE. ADDED INFORMATION TO THE STEM (OK)

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LCD (F/H) (1-5) U/E/S Explanation Stem Cues TIF Job- Minutia #/ Back- Q= SRO Focus Link units ward K/A Only ES-401, Rev. 9 2 Form ES-401-9

Written Examination Grading Form ES-403-1 ES-403 Quality Checklist Facility: North Anna Date of Exam: 06/16/10 Exam Level: RO SRO Initials a b C Item Description

1. Clean answer sheets copied before grading
2. Answer key changes and question deletions justified 7.

c and documented

3. Applicants scores checked for addition errors (75 (reviewers spot check > 25% of examinations) I
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, _ _

3 ii as applicable, +/-4% on the S RD-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified Performance on missed questions checked for training 6.

deficiencies and wording problems; evaluate validity $ ( p of questions missed by half or more of the applicants M Printed Name/Signature Date

a. Grader MM

/ .

op

b. Facility Reviewer(*) ( I. /
c. NRC Chief Examiner

(*) i Lica 1

.Cc 4 7/12/10

(*) £LLI.

d. NRC Supervisor graded by the NRC;

(*) The facility reviewers signature is not applicable for examinations two independent NRC reviews are required.

ES-403, Page 5 of 5

Retrieved from "https://kanterella.com/w/index.php?title=ML103050204&oldid=2553994"