Text

302 Final Administrative Documents
	ML17165A491
Person / Time
Site:	Watts Bar
Issue date:	06/14/2017
From:	; NRC/RGN-II
To:	; Tennessee Valley Authority
References
	Download: ML17165A491 (89)
	v • d • e

r1 fl21)rQ-Qunl -fina1-fnrms-m rlnn ES-201 - Ecimination Preparation Checklist Form ES-201-1 Facility: LilA 7/5 &9i Date of Examination:

Developed by: Written - Facility NRC II Operating Facility

- NRC Target Chief Date* Task Description (Reference) Examiners Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b)

-120 2. NRC examiners and facility contact assigned (C.1 .d; C.2.e)

-120 3. Facility contact briefed on security and other requirements fC.2.c)

-120 4. Corporate notification letter sent (C.2.d)

[-90] [5. Reference material due (C.1 .e; C.3.c; Attachment 3)]

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1s, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1 .e and f; C.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, 1, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; ES-202)

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202)

-14 1 1. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (Cli; C.2.f and h; C.3.g)

-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 15. Proctodng/wriften exam administration guidelines reviewed with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.

[Applies only] {Does not apply) to examinations prepared by the NRC.

Sv&17/ 777-9L oitlL f OPEgI VNó TEsr (wR17TE,u Xt1#1 Th 8 cts,vigri 17E)

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:

Initials Item Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. N/,

R I

b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KIA categories are appropriately sampled.

A J ftf

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. M/A %

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.

YA

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications. ,

S and major transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using 0 A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

C c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D. )t4

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form I (2) task repetition from the last two NRC examinations is within the limits specified on the form 43 j T (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task Is new or significantly modified 0

(3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. 0

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

b. Assess whether the 10 CFR 55.41143 and 55,45 sampling is appropriate. ,f-N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. .-O

d. Check for duplication and overlap among exam sections. 0 A

L

e. Check the entire exam for balance of coverage. -O 4 #7 Assess whether the exam fits the appropriate job level (RO or SRO). -Q I- 7 Printed NamelSlgnature Date

a. Author i7H .&iSL ,

-?

b. FacllityReviewer(*) 5

)__ lO/F7/7%j

c. NRC Chief Examiner (#) 1l/71L 66,k /

d, NRC Supervisor 4/4k44 7.

Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines ES-201, Page 26 0128

Wi VE,V 72 ESO1 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:

Initials Item Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

J.

R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. 0

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate. -0 J

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, J/

S and major transients. f M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule ti/ tJ/

4,.j/

L without compromising exam integrity, and ensure that each applicant can be tested using 4r A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative M/ i.y 4/

and quantitative criteria specified on Form ES-301-4 and described in Appendix D. i (F)

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form &, / /tJ/

I T

(2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants audit test(s) ff II

/4 (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified °/ /

/1n A//,.,

(3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

N/

IP In tjl f

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. 0 J..

R d. Check for duplication and overlap among exam sections. V L e. Check the entire exam for balance of coverage. -V

f. Assess whether the exam fits the appropriate job level (RO or SRO). t2 *&

Printed Name/Signature Date

a. Author iII.,T!4 Sku1I%Z

/ -i) 7 ic/9/i3

b. Facility Reviewer () riino / 3

c. NRC Chief Examiner (#) /Q/d/di /)/1cA5/

d. NRC Supervisor 1AtIid.kt. W1ZIJA.tLd/

Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines

(A[3N OQTOiP.- G?3 v-i ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of I3

%/ Jk/ i3as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of gp v . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE

1. JJ,t) ?C4 kJIIc-A]6Am QVtopt4--ç 4-1L

2. b1 (:, 0, c

3. ?&e tl. £cazi .Let/ Or, 4- /tjicsil( JGpLIv (Qj7 32ii,. ,i,i,,-IZ

5. . v-.-r,e Ee 7 kA7

6. - 1 013 IL (Ce c 4fW3 (%4:7t

7. Mls 5+ ?JIy/13 4,A ( (J/I/i013.

8. . ?:a.3Lj 4(ec.F

9. KQ Skut3bt ,.,pc TA,J6 - 4724/13

10. )7)iV A /

11. LCI.kLLS PGlA o51t3 I LfQ

12. i3 IL f .P,a)NMLc , O i2-4 OS -5v/P fw4 3129h3

13. :J /77/ 441 ii- 33 z

14. ack:i oc

15. E VL./-,r f% -&L 1i//3 NOTES:

st&Net tNtVtUftL FoRi7 s-,o(3 6ELOLJ 0

EflhfItL. MTEII 6ELOLJ ES-201, Page 27 of 28

v3 N 0 3 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Exarnination I acicnowledge that 1 have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of J : 3as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth opetator or communicator is acceptable if the individual does not select the training content or provide direct or inriltect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chiel examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, ot provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE! RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1,

e. 4 A

4 j__1.L j? £1 JL&L C L-L -__-

_L4i IJ 5 _Lt__________

6 t,.. KCy r2

7. ..

8 ,

tjtZ (.JJfl )

. rFJ5

9. , %rJat 4f/!3 7vd.

--ii -

12.iNWL t P 47-S -PP

-i_________ . V 14 1tM _-.Li _*4_

iw 15 fr, -?

NOTES:

ES-201, Page 27 of 28

Skubisz, Keith Robert From: Smith, Steven Vaughn Sent: Tuesday, November 05, 2013 4:38 PM To: Skubisz, Keith Robert

Subject:

Re: Please sign off exam security

Keith, I am in Florida on AL... .so here goes:

I have not violated the security agreement requirements of ES-201-3 in any way for the WBN ILT 1303 class. I have not given any exam info to any unauthorized person. Keith please sign off the agreement for me per this e-mail.

Steven Smith - SQN Original Message From: Skubisz, Keith Robert Sent: Tuesday, November 05, 2013 10:18 AM To: Smith, Steven Vaughn

Subject:

Please sign off exam security Please sign off of exam security. Please either print, sign and subsequently scan the 201-3 form or simply reply that you have met the requirements of such agreement. I have attached the appropriate page of the 201-3. Thank you.

V/ R, KR Skubisz 1

LkiA) %/3 5xA-viA ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of ,o/14 4.10/21 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not ben authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of biLl . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY (1) DATE SIGNATURE (2) DATE NOTE C

(7, .

2. 1%] e4b.l t%1oO ll/Ø3

3. E Ta / SOc) /r?-I3 svi/lrj LLb ri 4T%_

-V--

c--t -_F%.

4. ). /

5. VL \

6. i;L etp_&LvL.) 9Ps T124- iiii CP-w.

7. Øctt.c I1rwcAC c5 SMPPT 1[Zf 3

8. M:LI4Ai- K, j3rrFF OPS SuP a cto3 3

9. qtLb 0P5 Th S.p ..II CCiJi3_ johch

10. Stli 1C(Ic7 QCOLLSf _IOuil/L3.. tt14/c

11. I-I4gii 1 JD1iil,i

12. - - -. - - S \LI

13. 1 s- .ALJ4: 71 w)3/

.,1

14. SAc7 iii4rtc/pi.t t2r/I31iJJ*(RV/

15.

NOTES:

EM4IL. MiE cee (pJ/J( vtj vAt S/bA) -ofF FOIA1 ES -2c/..- 3 ES-201, Page 27 of 28

Skubisz, Keith Robert From: Gattis, Cameron L Sent: Tuesday, November 05, 2013 7:35 PM To: Skubisz, Keith Robert

Subject:

RE: Exam Security I have met the requirements of the ES-201-3 C. L. Gattis Winning is not a sometime thing, it is an all the time thing. You dont do things right once in a while...you do them right all the time.

Vince Lombardi NOTICE: This electronic message transmission contains information which may be TVA SENSITIVE, TVA RESTRICTED or TVA CONFIDENTIAL. Any misuse or unauthorized disclosure can result in both civil and criminal penalties. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the content of this information is prohibited. If you have received this communication in error, please notify me immediately by email and delete the original message.

Original Message From: Skubisz, Keith Robert Sent: Tuesday, November 05, 2013 10:23 AM To: Gattis, Cameron L

Subject:

Exam Security Please sign off of exam security. Please either print, sign and subsequently scan the 201-3 form or simply reply that you have met the requirements of such agreement. I have attached the appropriate page of the 201-3. Thank you.

V/ R, KR Skubisz 1

A

1. t ,

& -1 /

Examination Security Agreement Form ES-201-3

1. Pro-Examination acknowledge that have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of J!as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered by the NRC these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized if the individual does not select the training content or provide direct or indirect (e.g acting as a sImulator booth operator or communicator is acceptable feedback). Furthermore. I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or understand the facility licensee. I wilt immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination FO the best of my knowleqe, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, I did not specifically noted instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY NATURE (1) DATE SIGNATURE (2) DATE NOTE

.) t*.

/

t;;

2.

3 T.

7kr-* T 13 4, /

5, 4-I-(L 6 ic:iL L__. ; .;

t,..,.,,,., (c /

sw of S g, p rc.SS .

11.4 V.

1 2. -.- 1 13 1 I 14 f.-itw

/ A )-rqj 15.

NOTES.

ES-201, Page 27 of 28

J dAi cc 7j/_ %R4% /xAAA ES-201 Examination Security Agreement Form ES-201 -3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of cya ti! as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may fiave been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of lolL I . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY LGNKWRE (1) DATE SIGNATURE (2) DATE NOTE

1. /.}L ,

2. VJ%% S.

t%iOO C.1),)

3L_.% t/ll 7

4. u-Ia k41 L-c-L i,/ilj 7i.; :j,l(v\. 2Th

7. (% stq :j-r.r-_ f%4.

8. c4A- k. 3rFf aPs sp air.o3 1r r 1o.:v1 l?roejf tOflI/Iç

11. -

12. . s_ -

13. %.. .

p_..,

14 . )*o t.4LCI Sa v/2r11.3 15.

NOTES:

ES-201, Page 27 of 28

Oro3& 213/3 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination i.J (/

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of _//,1as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 2.1 . From the date that I entered into this security agreement until the completion of examination administration, I did not

°i instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TItLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE A&;cr4 7 )b

3. \r Sitit. Ui /a1cL ?f3/i3 IcII3

4. 5n !1 tV7obt f)pest -f]//3 n ,

5. , LI gliyi w, SA;fr1 7/ D//7 4

6. lcv c 73oI n,il

7. j,4 ?CIe4s J? 43 c F1 b r 4W5 /%jz74,,Jt tWsd15 1O.J AtIt ?.L k -

ii. 7c6:AIt ,4r,cZ2 912 2:E /3 fr7cLt,4)cC. - (2

12. SC4EL. -jciJ t? S7,iw9.r 9I?4,/i3 13.?, 5)se1k f2 c%5I5 3 c1 3

14. [/ ATC-i qj/j3

15.

riAQ L4. 9J29I.3 NOTES:

? cc&MEt 1tJttUt&u11L gn ot1-3 gs sC-E 6Etct t1A7E 6tol3 ES-201, Page 27 of 28

ziOC& 2J/ 3 ES-201 Examination Security Agreement Form ES-201 -3

1. Pre-Examination I

acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been aUthorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowled9e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of °1 2.1 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TItLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

(

yp-I 7/3 -.

3 ccL t)1 cJ,s 4 - rtrLd.

__.; ilL &1c-r

5. E3.1I, SA,- 7/i/ii

6. 7/ I5TL/V\,- 7i 31It

/

LIrenw brc%or :W+/-flJ3 1 O. It, /1

11. ft/. //,(7e /z y//g ic iVIC.C /) c[

1 2. t5iS LLZ Lf1

, (fI5(3 13.c.2.5 .)k 14.

pr_..__ t .Th

15. fric:,..

NOTES:

ES-201, Page 27 of 28

1O%GS2 2/3 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination

, t/j I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of P/,;as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been abthorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best ci my knowledQe. I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of iof i . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE. (2) DATE NOTE

3. U1 2/ /13

4. .. ir jL /;<: :-,

5. B1L7 SA.- J1-tt,l6 t/T V1 7/i..?,?

rz.

6. :_*.(

7 B. c sGc 9S4 S+ irn brt%or 7 1 O. 1Y1,i f. I S.

7/ Zy//

11.

/1 - / - /3

!_4...L,c, c_ --

12.

13 %.)k 14.

A -

l.) ,AO ----_.z NOTES ES-201, Page 27 of 28

C1C /2 / .7 E 2t) i Examination Security Agreement Form ES 201 I )in-Examination ii I vluiIijc that I have acquired specralize[l knowledge about the NRC licensing examinations scheduled for the week(s) o1 as ol the late ii my iiriatiire agree that I wifl not knowingly divulge any information about these examinations to any persons who have not hceii ritithorized by the Nl( :hjef *xariiiiier I understand Ihat I am not to instruct, evaluate, or l)ruVide performance feedback to those applicants scheduled to be adrTiIFlIste!ed II 3 i using exrlminatioiis from this date until completion 01 examination administration, except as specifically noted below and authorized by the NI t ctuiq as ii sIiIIulatt)r lioutli operator or communicator is acceptable if the individuat does not select the training content or [)FOVide diiict iii ifl(tilOi.i tiiiihhs:k) F rirhhiermore I aiii aware of the physical security measures and requirements (as documented in the facility licensees piocedcires) i,id Ihiat violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against rue or tine li lily luenisee. I will immediately reporl to facility management or the NRC chief examiner any indications or suggestions that exainiinmtionn sectinity F) liv I, vi t Flu-iF 1 II iiprt FF1 used

2. Post-Examination lii lie best of niny knowtc*clge. I did not divulge to any unauthorized persons any information concerning the NRC licensing exannirations 5iJiiiiriisierml U iii in q le week(s) iii Dl From the date that I entered into this security agreement until the completion of exanninalion adinir rislr ihnur i I lid is it IfistrIle! vihtinto or provide performance feedback to those apphcants who were administered these licensing examination except as siwcihrcally rieir-st tsrIos arid at ithintizecl by the NRC.

HINt E[) NAtvE JOB hiLL / RESPONSIBILITY SIGNATURE (1) DATE SIGNATIJRt: (2) NA H N()ll 3 * ç)c, 7/3 FJ3 I / x,. ..

h F)t I u-*l11, .

hi *..

i- .-.

or -

F) 3dsr. c1-4-L If)

12. ---.

ii. j ) ..)i H___.

l:. I. *-

ric, ii; ES-201, Page 27 o128

Skubisz, Keith Robert F torn: Newport, J Adam Sent: Friday, November 08, 2013 7:55 PM To: Skubisz, Keith Robert

Subject:

RE: Exam Security I did not talk to anyone about anything. Mote specifically, I did not discuss anything relating to class 1310 with anyone, anywhere, at any time, ever.

Original Message From: Skubisz, Keith Robert Sent: Tuesday, November 05, 2013 10:22 AM To: Newport, J Adam

Subject:

Exam Security Please sign off of exam security. Please either print, sign and subsequently scan the 201-3 form or simply reply that you have met the requirements of such agreement. I have attached the appropriate page of the 201-3. Thank you.

V/ R, KR Skubisz 1

tAJ131\ OcrDE 2013 EXAM ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of °t ft as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of jolz] . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or proiide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

1. t pJ1t p ill/LoiS

2. D7,--t/eQ

. ri,?

g A-f 53i. /i3,c A4C,.,rLJ %f -L-e _1 ,:4-__

4. T-f/L ;Q 4 1c rA -:;R iit/fJ

5. Pt.jct4lo 7/101/3 ,

6. L.

7.

8. //i5

9. &t L3%/4-4 _ -

10. i A,i,c/TA. e- t4 t.& cV

11. jf, (/)/A) .-;,?At,il)A)l; Y)),lctT1Y7

12. -

(1O 37W% tty1qj

,i4L/

13. qz,ç2,

14. sg - tilt

15. . cir,.Jii,o ci NOTES:

c66 tJoou,JIENY5 ci 64 IN/Jtt/Q3 ti%L Fi)1 S- ,7otr3 ES-201, Page 27 of 28

The following individuals have yet to sign off of the Examination Security Agreement:

Conrad Ottenfeld, WBN SRO Adam Newport, WBN RO The appropriate pages of the 201-3 form will be forwarded to the chief examiner when completed.

F.R. Godwin is no longer employed by the Tennessee Valley Authority. His employment ended before the Operating Test began. If desired, and when the applicants for the 2013-302 exam return from leave, a certification can be signed by the applicants that F.R. Godwin provided no assistance or performance feedback to them.

We, the undersigned, received no assistance or information (relative to the 2013-302 NRC exam) from a previous TVA employee, FR. Godwin.

NAME SIGNATURE DATE

/1/12/13 tL1Nw VA1 L c ;\

3 I4L_ L/it 3 EbkOt 1d 7L 11/2/I t2K 5l(jj C &QQo /12113 I ?t2/- / / /1 L /13 Lf frJ R-

i i3 Nk OCTI)8 E 2013 Y..A ES-201 Examination Security Agreement Form ES-201-3 1 Pro-Examination

/tiJ I ickr kdge that I have acquired specialized knowledge about the NRC licensing examinations scheduled For the week(s) of t as of the date of my siiinatcire. t agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these lrct3nsing exairrinations from this date until conipletion of examination administration, except as specifically noted below and authorized by the NRe e g, Jctiriq as a siniulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedbak) Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) antI understand that violation of the conditions ot this agreement may result in cancellation of the examinations and/or an enforcement action against nrc Or the lacility licensee. I will imrriediately report to facility management or the NRC chief examiner any indications or suggestions that examination securily may have been cornprnmised 2 Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered durinq the week(s) of oL . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct ivaluate. or provide performance feedback to those applicants who wore administered those licensing examinations, except as specifically noted below and auttrnriced by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

.1 1

1 if; (

-I 3 ,fr --,, ,. ___________________________________

5 1:2JLC(O 6 I... Ltf 7 r.

6 - -.

L

p- C 10.

. :)/j tl -

(a?77 12 -

- i:io )fr 7/Wt%

13. ., 1: /.(

./%-*

A.

NOTES ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 4 ,ofias of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1 .__________

/ //

zrj \ \ r/( j-_-\ N i

3. SE4 &-l -NL ZY )o)zIiJ/i

4. 1PI3 P6i-/ 5 /;Y1 1ft/i3 /t/

5.

6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

NOTES:

ES-201, Page 27 of 28

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar Date of Examination: October 2013 Examination Level: RO SRO LI Operating Test Number: 302 Administrative Topic Tvne Describe activity to be performed (See Note) Code

1. Perform Hand Calculation Of Boric Acid And Primary Water Integrator Settings For Manual Makeup To VCT.

Conduct of Operations M,R

2. 7.25 Ability to interpret reference materials, such as graphs, curves, tables, etc. (3.9/4.2) (CFR: 41.10 /

43.5/45.12) I

2. Determine AFW Pump Requirements Conduct of Operations N,R 2. 7.32 Ability to explain and apply system limits and precautions. 3.8/4.0 (CFR: 41.10 / 43.2 / 45.12)

3. Review 1-Sl-0-4, Monthly Surveillances.

Equipment Control M,R 2.2.12 Knowledge of surveillance procedures.3. 7/4.7 (CFR 47. 70/45. 73)

4. Calculate Stay Time For Emergency Exposure M,R 2.3.4 Knowledge of radiation exposure limits under Radiation Control normal or emergency conditions. 3.2/3.7 (CFR:

47.12/43.4/45.10,)

Emergency Procedures N/A N/A NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (,. 3 for ROs; <4 for SROs & RO retakes)

(N)ew or (M)odified from bank (> 1)

(P)revious 2 exams (< 1; randomly selected)

ES 301, Page 22 of 27

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar Date of Examination: October 2013 Examination Level: RO D SRO Operating Test Number: 302 Administrative Topic Tvne Describe activity to be performed (See Note) Code

1. Perform Hand Calculation Of Boric Acid And Primary Water Integrator Settings For Manual Makeup To VCT.

Conduct of Operations M,R 2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc. (3. 9/4.2) (CFR:

41.10/43.5/4512) I

2. Determine AFW Pump Requirements.

Conduct of Operations N,R 2.1.32 Ability to explain and apply system limits and precautions. 3.8/4.0 (CFR: 41.10 / 43.2 / 45.12)

3. Determine Risk Level using EOOS Software.

. 2.2.14 Knowledge of the process for controlling Equipment Control M,R equipment configuration or status. 3.9/4.3 (CFR 41.10/43.3/45. 73)

4. Determine Requirements for Authorizing Emergency Exposure.

Radiation Control M,R 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions. 3.2/3.7 (CFR:

41.72/43.4/45.10)

5. Classify an Event.

Emergency Procedures I 2.4.41 Knowledge of the emergency action level MR Plan , thresholds and classifications. 2.9/4.6 (CER:

41. 70/43.5/45.11)

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (< 3 for ROs; <4 for SROs & RO retakes)

(N)ew or (M)odified from bank (> 1)

(P)revious 2 exams ( 1; randomly selected)

ES 301, Page 22 of27

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: October 2013 Exam Level: RO SRO-I LI SRO-U LI Operating Test Number:302 Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System I JPM Title Type Code*

A. Aux Feedwater LCV to Bypass Reg Transfer During Plant Startup. L,N 4S 059 A4.o8 3.0/2.9 CFR 41.7/45.5 to 45.8 B Perform ES-1,3, Transfer to Containment Sump. AEN,L,M 3 EA1.11 4.2/4.2 CFR41.7/45.5 /45.6 C. Return N43 Power Range To Service. M 7 015 A4.02 3.9/3.9 CFR 41.7 / 45.5 to 45.8 D. Perform a Manual Makeup to the VCT. A M 2 004 A4.12 3.8/3.3 CFR 41.7/ 45.5 to 45.8 E. Transfer 1A RCP Board from Alternate to Normal. D 6 062 A4.01 3.3/3.1 CFR 41.4/45.5 to 45.8 F. Align lB-B CCS Pump to lB Supply Header. M 8 008 A4.ol 3.3/3.1 CFR: 41.7/45.5 G. Complete 1-Sl-85-2 Reactivity Control Systems Movable Control Assemblies (Modes 1 and 2). A M 001 A4.o3 4.0/3.7 CFR 41.7/45.5 to 45.8 H. Respond to RHR Pump Trip Per AOl-14. D 4P 025 AA1 .09 3.1/3.2 CFR: 41.7 / 45.5/ 45.6 In-Plant Systemstm (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

I. Bypassing 1-PCV-62-81, CVCS LETDOWN HX PRESS CNTL For Local Control DE,R 2 004 A1.1 1 3.0/ 3.0 CFR 41,5/45,5 J. Local Restart of C&SS Air Compressors. AD,E 8 065 AK3.08 3.7/3.9 CFR 41.541.10/ 45.6 / 45.13 K. Transfer 250v DC TURB BLDG DIST BD #1 from Normal to Alternate. D 6 063 K4.02 2.8/2.9 CFR 41.7

@ All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO-l I SRO-U (A)lternate path 4-6 I 4-6 / 2-3 fC)ontrol room (D)irect from bank 9 I 8 I <4 (E)mergency or abnormal in-plant > 1 I > 1 I > 1 (EN)gineered safety feature - I - I 1 (L)ow-Power I Shutdown 1 I > 1 I > 1 (N)ew or (M)odified from bank including 1 (A) 2 I 2 I 1 (P)revious 2 exams < 3 < 3 I < 2 (randomly selected)

(R)CA >1 / >1 / >1 (S)imulator

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: October 2013 Exam Level: RD 2 SRO-I SRO-U Operating Test Number: 302 Control Room Systems (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System I 1PM Title Type Code*

Function A. Aux Feedwater CCV to Bypass Reg Transfer During Plant Startup. L,N 4S 059 A4.08 30/2.9 CFR 41.7/45.5 to 45.8 B Perform ES-1.3, Transfer to Containment Sump. A,EN,L,M 3 EA1 .11 4,2/4.2 CFR 41.7/45.5 / 45.6 C. Return N43 Power Range To Service. M 7 015 A4.02 3.9/3.9 CFR 41.7 / 45.5 to 45.8 D. Perform a Manual Makeup to the VCT. A, M 2 004 A4.12 3.8/3.3 CFR 41.7 / 45.5 to 45.8 B. Transfer 1A RCP Board from Alternate to Normal. 0 6 062 A4.01 3.3/3.1 CFR 41.4/45.5 to 45.8 F. Align lB-B CCS Pump to 18 Supply Header. M 8 008 A4.01 3.3/3.1 CFR: 41.7/ 45.5 G. Complete 1-Sl-85-2, Reactivity Control Systems Movable Control Assemblies (Modes 1 and 2). A, M 1 001 A4.03 4.0/3,7 CFR 41.7/45.5 to 45.8 H. N/A In-Plant Systems (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

I. Bypassing 1-PCV-62-81, CVCS LETDOWN HX PRESS CNTL, For Local Control D,E,R 2 004 AJ.11 3,0/ 3.0 CFR 41.5/45.5

]. Local Restart of C&SS Air Compressors, A,D,E 8 065 AK3.08 3.7/3.9 CFR 41.5,41,10/ 45.6 / 45.13 K. Transfer 250v DC TURB BLDG 01ST BD #1 from Normal to Alternate. 0 6 063 K4.02 2.8/2.9 CFR 41.7

@ All RD and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 3RD-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO I SRO-l I SRO-U fA)ltemate path 4-6 / 4-6 I 2-3 (C)ontrol room (D)irect from bank 9 I 8 / < 4 (E)mergency or abnormal in-plant 1 I > 1 I > 1 (EN)gineered safety feature - - > 1 (L)ow-Power I Shutdown 1 I > 1 I > 1 (N)ew or (M)odified from bank including 1 (A) 2 / 2 / 1 (P)revious 2 exams < 3 < 3 / < 2 (randomly selected)

(R)CA >1 I >1 / >1 (S)imulator

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: October 2013 Exam Level: RO SRO-I SRO-U Operating Test Number: 302 Control Room Systems© (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System I JPM Title Type Code Functn A. Aux Feedwater LCV to Bypass Reg Transfer During Plant Startup. L,N 4S 059 A4.08 3.0/2.9 CFR 41.7/45.B to 45.8 B Perform ES-1.3, Transfer to Containment Sump. AENL,M 3 EA1 .11 4.2/4.2 CFR 41.7/45.5 / 45.6 C. Not Applicable D. Not Applicable E. Not Applicable F. Not Applicable G. Not Applicable H. Not Applicable In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

I. Bypassing 1-PCV-62-81 CVCS LETDOWN HX PRESS CNTL, For Local Control D,E,R 2 004 A1.11 3.0/ 3.0 CFR 41 .5/45.5 J. Local Restart of C&SS Air Compressors. AD,E 8 065 AK3.08 3.7/3.9 CFR 41.5,41.10 / 45.6 / 45.13 K. Transfer 250v DC TURB BLDG DIST OD #1 from Normal to Alternate. D 6 063 K4.02 2.8/2.9 CFR 41.7

@ All RD and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RD / SRO-l I S RD-U (A)lternate path 4-6 / 4-6 I 2-3 (C)ontrol room (D)irect from bank 9 / 8 I < 4 (E)mergency or abnormal in-plant 1 I 1 / 1 (EN)gineered safety feature - / - I 1 (L)ow-Power I Shutdown > 1 / > 1 I > 1 (N)ew or (M)odified from bank including 1 (A) 2 I 2 I 1 (P)revious 2 exams < 3 < 3 I < 2 (randomly selected)

(R)CA >1 I >1 I >1 (S)imulator

ES-3d Operating lest Quality Checklist Form ES-301-3 Facility: Date of Examination: Operating Test Number:

Initials

1. General Criteria a b*

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. -

c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 .a.) 2

d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.

e. It appears that the operating test will differentiate between competent and less-than-competent -,

applicants at the designated license level.

2. Walk-Through Criteria

a. Each JPM includes the following, as applicable:

initial conditions

initiating cues

references and tools, including associated procedures

reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee

operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified

.Q 1 17 on those forms and Form ES-201-2.

3. Simulator Criteria --

j-.

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

,j 7 Printed Name I Signature Date

a. Author iiH .&ict / -Q7 io/2/3

b. Facility Reviewer(*) / iCi..N ( //,3

c. NRC Chief Examiner (#) %f/CN4EL £E,kc

d. NRC Supervisor IAXL(T Wi741.4M1A5/ .

LX NOTE: The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column cU; chief examiner concurrence required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist Form ES-301 -4 rity: Watts Bar Date of Exam:10114113 Scenario Numbers: 1121314 Operating Test No.:302 InWals QUALITATIVE ATTRIBUTES a b*

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.

2. The scenarios consist mostly of related events. 1)7

3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) that are entered to initiate the event

. the symptoms/cues that will be visible to the crew 0

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.

5. The events are valid with regard to physics and thermodynamics. Q 2)7

6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints. % 07 Cues are given.

8. The simulator modeling is not altered. r ,7

9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated 0 to ensure that functional fidelity is maintained while running the planned scenarios.

10. Every operator will be evaluated using at least one new or significantly modified scenario. Q All other scenarios have been altered in accordance with Section D.5 of ES-301.

1 1. All individual operator competencies can be evaluated, as verified using Form ES-301-6 ,

(submit the form along with the simulator scenarios).

12. Each applicant will be significantly involved in the minimum number of transients and events .

specified on Form ES-301 -5 (submit the form with the simulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes --

1. Total malfunctions (58) 6161616 Q ,fr

2. Malfunctions after EOP entry (12) 1111112 O 8t

3. Abnormal events (24) 4141414 0 -

4. Major transients (12) 11112/1 -Q

5. EOPs entered/requiring substantive actions (12) 112/212 I2

6. EOP contingencies requiring substantive actions (02) 1111110 -12

7. Critical tasks (23) 3121214 0

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: October 2013 Operating Test No.: 302 A E Scenarios P V T M E Scenario 1 I

L N CREW CREW CREW CREW T N I T A I C POSITION POSITION POSITION POSITION L M A T S A B S A B S A B S A B U R 1 0 R 1 0 R T 0 R T 0 M 0 C P 0 C P 0 C P 0 C P RU E

RO RX 0110 SRO-I NOR 1 1 1 1 I/C 2,3,4,5,6 5 4 4 2 SRO-U MAJ 1221 TS 2,3,4,6 4 0 2 2 RO RX 1 110 NOR 1 1 111 SRO-l I/C 2,5,6 3 4 4 2 SRO-U MAJ 7 1 221 TS 0022 RO RX 0110 NOR 0111 SRO-I I/C 34 2 442 SRO-U MAJ 7 1 221 TS 0 022 RO RX 110 NOR 111 SRO-l I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: October 2013 Operating Test No.: 302 A E Scenarios Scenario2 T M 0 I L N T N I T CREW CREW CREW CREW A I C POSITION POSITION POSITION POSITION L M A T Th i i u N Y R T 0 R T 0 R T 0 R T 0 Mf*

ROT RX 0110 NOR 1 1 1 1 SRO-I I/C 2.3,4.5,6 5 4 4 2 SRO-U MAJ 71221 TS 2,3,5,6 4 0 2 2 RO RX 0110 NOR 1 1 111 SRO-I I/C 2,4,5 3 4 4 2 SRO-U MAJ 1 2 2 1 TS 0 022 RO RX 0110 NOR 0111 SRO-I I/C 3,5 2 442 SRO-U MAJ 7 1 221 IS 0 022 RO RX 110 NOR 111 SRO-I I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (AIC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: October 2013 Operating Test No.: 302 A E Scenarios Scenario 3 T M I

L N T N I T CREW CREW CREW CREW C POSITION POSITION POSITION POSITION A i u N Y R T 0 R T 0 R T 0 R T 0 M(*)

T P o C P 0 C P 0 C P 0 C P RIU RO RX 6 1 110 NOR 1 i i i SRO-I I/C 2,3A,5 4 4 4 2 SRO-U MAJ 1 221 TS 24,6 3 0 2 2 RO RX 6 1 110 NOR 0111 SRO-I I/C 2 4 4 2 SRO-U MAJ 1 2 2 1 TS 0 022 RO RX 0110 NOR 1 111 SRO-I I/C 2,5 2 442 SRO-U MAJ 7 . 1 221 TS 0 022 RO RX 1 10 NOR 111 SRO-I I/C 442 SRO-U MAJ 2 21 15 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-l event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant fBOPy positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to

(*) Reactivity and normal Section D.5.d) but must be significant per Section C.2.a of Appendix D.

evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-30f Transient and Event Checklist Form ES-301-5 Facility: Wafts Bar Date of Exam: October 2013 Operating Test No.: 302 A E Scenarios P V T M Scenario 4 P E I L N I CREW CREW CREW CREW C POSITION POSITION POSITION POSITION A T S A B S A B S A B S A B U N R 1 0 R 1 0 R T 0 R T 0 Mf*)

T P 0 C P 0 C P 0 C P 0 C P RIU RO RX 1 1 110 SRO-l NOR 0 1 1 1 I/C 2,34,5 4 4 4 2 SRO-U MAJ 61221 IS 2M,5 4022 RO RX 1 110 NOR 0111 SRO-l I/C 2 4 42 SRO-U MAJ 6 . 1 2 2 1 IS 0 022 RO RX 0110 NOR 0111 SRO-l I/C 2 1 442 SRO-U MAJ 6 1 2 2 1 TS 0 022 RO RX 110 NOR 111 SRO-I I/C 442 SRO-U MA] 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; IS are not applicable for RO applicants. ROs must serve in both the at-the-controls fATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component fl/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions frefer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Competencies Checklist Form ES-301-6 Facility: Wafts Bar Date of Examination: 1011412013 Operating Test No.: 302 APPLICANTS RD X RO RD RD SRD-l SRO-I X SRD-l SRO-l SRD-U SRO-U SRD-U X x

Competencies SRO-U SCENARIO SCENARIO SCENARIO SCENARIO 2.3,4, 2,3,4, 2,3,4, 22,4, 2,3,4, 2,3,4, 2,3,4, 2,3,4, 2,3,4, 2,3,4, 2,3,4, 2,3,4, Interpret/Diagnose 5,6,7 5,6,7 5,6,7 5,6, 5,6,7 5,6,7 5.6,7 5,6, 5,6,7 5,6,7 5,6,7 5,6, Events and Conditions ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL Comply With and UseProcedures(1) 1,2,3, ALL ALL 1,2,4, 123, ALL ALL 12.4, Operate Control 4,5,6 5,6 4,5,6 5,6 Boards(2)

ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL Communicate andlnteract 4,5,7 2,3,5, 2,4,5, ALL 4,5,7 2,3,5, 2,4,5, ALL Demonstrate Supervisory Ability (3) 23,4, 2,3,5, 2,4,6 2.3,4, 2,3,4, 23,5, 2,4,6 2,3,4, Comply With and 6 6 5 6 6 5 UseTech. Specs. (3) = = = = = = = = = = = = = = = =

Notes:

(1) Includes Technical Specification compliance for an RD.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant

Note for Watts Bar 2013-302 Exam ADAMS Package:

Final Administrative Document Form ES-4o1-2/3 can be obtained by applying Form ES-4o1-4 to the Draft written exam sample plan.

Watts Bar October 2013 RO Exam NRC Exam 2 ES-401 Record of Rejected KIAs Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected K/A Overlap with another K/A 2/1 078 K3.03 Replaced with : 078 K3.01 078 Instrument Air System (lAS)

K3 Knowledge of the effect that a loss or malfunction of the lAS will have on the following:

(CFR: 41.7 / 45.6)

K3.01 Containment air system . 3.1*3.4*

Replaced by Chief examiner on 04/19/13

Watts Bar October 2013 SRO Exam NRC Exam 2 ES-401 Record of Rejected KIAs Form ES-401 -4 Tier I Randomly Reason for Rejection Group Selected K/A Unable to write question at the SRO level.

1/1 008 AA2.02 Replaced with: 008AA2.12 AA2. Ability to determine and interpret the following as they apply to the Pressurizer Vapor Space Accident:

(CFR: 43.5 I 45.13)

AA2.12 PZR level indicators 3.4 3.7 Replaced by Chief examiner on 04/19/13 Unable to write question at the SRO level 054 AA2.08 Replaced with: 054AA2.04 AA2. Ability to determine and interpret the following as they apply to the Loss of Main Feedwater (MFW):

(CFR: 43.5 I 45.13)

AA2.04 Proper operation of AFW pumps and regulating valves. 4.2 4.3 Replaced by Chief examiner on 04/19/13 Unable to write question at the SRO level.

1/1 055 EG2.2.36 Replaced with: 055EG2.4.41 2.4.41 Knowledge of the emergency action level thresholds and classifications.

I(CFR: 41.10/43.5/45.11)

IMPORTANCE RO 2.9 SRO 4.6 Replaced by Chief examiner on 04/19/13

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Watts Bar I Unit 1 Date of Exam: 7 0/22/73 Exam Level: RD SRDE Initial Item Description a b c#

1. Questions and answers are technically accurate and applicable to the facility. 0

2. a. NRC K/As are referenced for all questions.

b. Facility learning objectives are referenced as available.

0

3. SRD questions are appropriate in accordance with Section D.2.d of ES-401 V

4. The sampling process was random and systematic (If more than 4 RD or 2 SRD questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or x the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RD / SRD-only 27 31 45-17 / 6 2 / 17 question distribution(s) at right.

7. Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension/ analysis level; the SRD exam may exceed 60 percent if the randomly C selected K/As support the higher cognitive levels; enter 31 / 8 44 / 17 the actual RD I SRD question distribution(s) at right.

8. References/handouts provided do not give away answers or aid in the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; 0 deviations are justified.

10. Question_psychometric_quality_and_format_meet the_guidelines_in_ES_Appendix_B.

11. The exam contains the required number of one-point, multiple choice items; 0 the total is correct and agrees with the value on the cover sheet.

Printed Name / Signature Date

a. Author Keith R. Skubisz .-f? Y,, ,

10/09/13

b. Facility Reviewer Brian S. Mcllnay J 10/09/13

c. NRC Chief Examiner (#) /,/cHi96L ,%M/7/h /969/zci;

d. NRC Regional Supervisor ,AJ4LttLLLR WjpCL4JJ4./ t/fn Note:

The facility reviewers initials/signature are not applicable for NRC-developed examinations.

Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401, Page 29 of 33

Watts Bar Nuclear Station October 2013 ILO Exam ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) ( 1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are samoled for conformance with the approved K/A and those that are designated $RO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. Ata minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

J

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only H 3 X x Y N N E K/A 007EK1.02

1. Q=K/A, Q=RO only.

2. Be careful herenot sure if there is technically a correct answer as written because TS LCO 3.1.1 does not require SDM for MODE 1 conditions. However, the surveillance procedure 1-51-0-10 does set a requirement for MODE 1. We will have to ask a very specific question in order to be as clear and technically accurate as possible.

3. Recommend modifying/re-writing the question as follows:

Given the following:

0900 Unit 1 has been operating at 100% power for 200 days of continuous operation.

0901 An unexpected automatic reactor trip occurs. All rod bottom lights are lit.

1100 Operators transition from ES-0.1, Reactor Trip Response, to normal plant procedures. The unit is stable in MODE 3 with the RCS at normal No Load temperature and pressure. No boration or dilution of the RCS has occurred post-trip.

Based on the given conditions, which ONE of the following completes the below statements?

The actual Shutdown Margin (5DM) of the core at 1100 is (1 )_ than the actual SDM of the core at 0900.

In accordance with TS, the minimum required SDM at 1100 is (2) than the minimum required SDM at 0900, as specified by 1-Sl-0-10, Shutdown Margin.

Q appears E at this time.

Update: Licensee recommended maintaining proposed revision. NRC disagreed.

Licensee agreed to modify Q as requested. Q appears SAT at this time. MKM

( 2 L

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 2 Y N B . 008AK2.01 fl 1. QK/A, Q=RO only.

2. Distractor C is non plausible, because applicant cannot determine specifically where the leak is. Distractors C and D are non plausible as a set because they are in essentially the same location and provide the same thermodynamic properties. With two tracters being the same, a candidate would have a 50/50 pick between A and B.

eed to replace C and D with other plausible locations.

J. Used on the Sequoyah May 2013 exam. Heres a potential fix:

Which ONE of the following identifies the leak location?

Reactor Vessel Head vent line Incore Instrument guide tube Pressurizer safety valve Pressurizer heater well

.2 is U due to multiple non plausible distractors as written.

Licensee disagreed with NRC comments, lively discussion followed. Facility licensee agreed to modify Q in accordance with NRC comments, Q now appears SAT.

t

1. J

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) f 1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 3 H 2 x x Y N B K/A OO9EK1.02

1. Q=KIA, Q=RO level

2. The bullet in the initial conditions that states, the operating crew is depressurizing the RCS to refill the Pressurizer needs to be removed. This provides a very good cue to the applicants. The statement In response to a small break LOCA can be removed, the fact that you are in ES-i .2 gives the same information.

3. Used on the Sequoyah May 2013 exam and the Sequoyah 01/2009 retake exam.

4. Use of the term RCS subcooling is lost is somewhat ambiguous. Potential recommendation below.

5. Need to change Tave to Thot due to being in natural circulation.

6. The second part of distractors A and B is not plausible. There is no cause and effect relationship between the cooldown and refilling the Pressurizer.

7. Potential fix:

Which ONE of the following completes the statements below?

Based on the given conditions, the current RCS subcooling margin is (1).

If RCS subcooling lowers to 0 F during the depressurization, _(2)_.

Change distractors A(2) and B(2) to: the RCS cooldown will stop until minimum subcooling is restored.

0 is U due to more than one non-plausible distractor.

Facility licensee presented slightly modified 0 during in-office exam review. Further modifications made, 0 now appears SAT. MKM

( *1 C J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD (F/H) (1-5) Stem Cues T/F I Cred. Partial Job Minutia #1 Back- Q SRO B/M/N U/E/S Explanation Focus j Dist. Link units ward K/A Only 4 H 2 X x Y N B E K/AOJ5AK2.08

1. QK/A, QRO level

2. Distractor D is non plausible as written because it is an open ended statement when it comes to timing. Given the alarms, it is obvious that some impact on RCP operations will occur at some indeterminate point in the future.

3. Used on the Sequoyah 01/2012 NRC exam (modified).

4. Potential recommendation:

Based on the given conditions, which ONE of the following identifies the tial adverse effect, if any, on continued RCP operation for the next 8 hours9.259259e-5 days 0.00222 hours 1.322751e-5 weeks 3.044e-6 months ?

Distractors A,B,C as written.

D. The RCPs are allowed to continue operation for 8 hours9.259259e-5 days 0.00222 hours 1.322751e-5 weeks 3.044e-6 months to allow for an orderly reactor shutdown.

Q appears E at this time due to one non plausible distractor.

Update 09/19: Facility licensee modified Q as recommended. 0 now appears SAT.

MKM C

L

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N UIE/S Explanation Focus Dist. Link units ward K/A Only 5 H 2 x M E K/A 022AK1 .01

1. Q=K/A, Q=RO only.

2. All distractors: recommend changing all verbiage to ...prevent potential damage..

as detailed below. Please add Watts Bar-specific nomenclature to distractor D so it reads: . . .to prevent potentially lifting 1-62-XYZ, Letdown Line Relief Valve [use the correct WB nomenclature hereJ.

3. Add required to the 0 statement as detailed below. Does the reason for the action come from the referenced ARI, or another procedure(s)?

4. Recommendation:

CCP-lB-B is required to be started A. immediately, to prevent potential damage to the RCP seals B. immediately, to prevent potential damage to the RCP Thermal Barrier Heat Exchangers C. only after letdown is isolated, to prevent potential damage to the CVCS Regenerative Heat Exchanger D. only after letdown is isolated, to prevent potentially lifting 1-62-XYZ, Letdown Line Relief Valve [use the correct WB nomenclature here]

Q appears E at this time, Update 09/19: Facility licensee modified Q as requested. Q now appears SAT. MKM.

6 H 4 N K/A 026AA2.03

1. 0 does not meet K/A. No knowledge of the required valve lineups to restart the CCW system is required to answer the question, because that information is provided in the 0 stem.

I 2. Job link: 0 is 3RD only on the RD exam. Operability determinations are SRO-only material; it is not a normal job function of the RD to determine exit times for LCOs based upon complicated system restoration conditions.

3. There is a 026AA2.03 question in the banks from the 10/2011 exam that may be useful (?).

is U due to not meeting K/A, also due to SRO-only aspect on the RD exam.

Update 09/19: Facility licensee agreed w/NRC comments and developed a new 0 for this K/A. After further minor modifications, the new 0 appears SAT at this time. MKM.

C 6

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 7 F 3 X Y N M E K/A 029EK2.06

1. QK/A, QRO only

2. Minor recommendation to clearly define the use of only in the distractors as detailed below:

The turbine trip signal is designed to result in a reactor trip through actuation of the reactor trip breaker (1).

When 1-RT-1 was placed in the trip position, the reactor trip occurred through actuation of the reactor trip breaker (2).

A. (1) UV coils; the turbine trip signal does NOT actuate the reactor trip breaker 52SH coils (2) 52SH coils; 1-RI-i does NOT actuate the reactor trip breaker UV coils B. (1) UV coils; the turbine trip signal does NOT actuate the reactor trip breaker 52SH coils (2) UV coils and the 52SH coils C. (1)UV coils and the 52SH coils (2) 52SH coils; 1-RT-1 does NOT actuate the reactor trip breaker UV coils.

D. (1) UV coils and the 525H coils (2) UV coils and the 52SH coils O appears E at this time.

Update 09/19: Facility licensee modified 0 as recommended, 0 now appears SAT.

MKM 1

C J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 8 H 2 X Y N M E K/A O4OAA1.19

1. QK/A, Q=RO level

2. The picture needs to be clearer, perhaps on a separate page in color?

3. Add third bullet that specifically states that operators have blocked low steam line pressure SI. (try not to be conditional in Q statement).

4. Recommend adding procedural reference to Q statement, other minor mods as follows:

Based on the given conditions, an automatic Low Steam Line Pressure SI (1) have occurred.

In accordance with Tl-12.04, Users Guide for Abnormal and Emergency Operating Instructions a MAXIMUM of SG #2 pressure indicators (as shown in the picture) are qualified as PAM instruments Q appears E at this time.

Update 09/19: Facility licensee modified 0 as requested. Q now appears SAT. MKM 9 H 2 Y N M S K/A 054 AK3.04

1. QK/A, QRO level.

2. Technical Q: does it matter if MFP 1 B trips manually or automatically?

0 appears SAT at this time.

8

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 10 F 2 x x Y N B K/A 055EA2.03

1. Q=KIA, Q=RO level.

2. Distractors C and D are non plausible; it is common knowledge that in all cases in ECA-0.0 there are important loads that are placed in PTL condition. Why would it be good operation to have all kinds of automatic actuations occur on restoration of power?

Why would only one train be placed in PTL when youre not sure which train will be restored first?

3. Can delete the bullet stating A Loss of All AC Power has occurred, that information is provided by default by saying the crew is in ECA-0.0.

4. A better approach might be to test on the correct ERCW pump alignments. Potential recommendation using this approach:

Given the following:

- The crew is performing 1-ECA-0.0, Loss of Shutdown Power.

- All safeguards electrical buses remain de-energized.

In accordance with 1-ECA-0.0, which ONE of the following is a correct alignment of the ERCW system for the current plant conditions?

. All ERCW pumps in Pull-to-Lock (PTL).

B. A-A ERCW pump in automatic, all other ERCW pumps in PTL.

C. A-A and B-A ERCW pumps in automatic, all other ERCW pumps in PTL.

D. A-A and B-B ERCW pumps in automatic, all other ERCW pumps in PTL.

I Q is U as written due to multiple non plausible distractors.

Update 09/19: Facility licensee proposed new variant of 0 (not as recommended I above), this 0 was determined to be SAT following minor modifications. MKM 9

{ J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/MIN U/E/S Explanation Focus Dist. Link unitsjI ward K/A Only 11 H 3 X Y N M E K/A056AG2.1.7

1. 0=1</A, QRO level

2. Minor modification: Add bullet after first bullet that states: The operators are at the step in 1-ES-0.2 to DETERMINE maximum permitted RCS cooldown rate when the 1B-B Diesel Generator trips. Then list current conditions, etc. as written and delete the last bullet. This is needed because ES-0.2 step 7 is not a continuous action step/we need to put the operators ata specific step in the procedure.

0 appears E at this time Update 09/19: Facility licensee updated 0 as requested, following further minor modifications 0 appears SAT at this time. MKM 12 H 2 X Y N N E K/A 058AK3.01

1. Q=K/A, QRO level.

2. Distractor analysis is not clear as to the operational effects of the loss of 125vDC control power from the D/G battery distribution panel. In the distractors, wouldnt we need to specify whether we are talking about manual starts vs. automatically starting?

Please discuss.

0 appears E at this time.

Update 09/19: Facility licensee clarified technical aspects of the 0. 0 appears SAT at this time. MKM.

13 F 2 X Y N N E K/A 062M1 .01

1. QK/A, QRO level.

2. Need to capitalize ONE in WOOTF statement for consistency.

3. Please add LCO reference to second part Q statement, i.e. The UHS currently required to be OPERABLE in accordance with LCO 3.7.9, Ultimate Heat Sink (UHS).

q 0 appears E at this time.

Update 09/19: Facility licensee modified 0 as requested. Q appears SAT at this time.

MKM.

14 H 2 Y N B S K/A 065AK3.03

1. QK/A, Q=RO level.

Q appears SAT at this time.

1 10 L

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LCD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/EIS Explanation Focus Dist. Link units ward K/A Only 15 H 2 X X Y N N E K/A 077G2.4.45

1. 0=1K/A, Q=RC level.

2. Check w/licensee about first part correct answerprovided references a little confusing as to what state the voltage regulator will transition to.

3. Recommend slight modification to second part C statement as follows: If the current conditions do not change, these conditions require the Load Dispatcher/Transmission Operator

4. Offsite notifications are potential SRO level (second part C); check with licensee to see if ROs at Watts Bar would call the TO? Probably o.k. as written.

I C appears E at this time Update 09/19: Facility licensee modified C as requested by NRC. C appears SAT at this time. MKM.

16 H 2 X Y N B E K/AW/EO4EA1.3

1. QK/A, QRC level

2. Recommend add In accordance with ECA-1 .2,... to WOOTF/Q statement.

3. Distractor B is non plausible, applicant is told that 1-FCV-74-33 is closed in the C statement.

C is E at this time due to one non plausible distractor.

Update 09/19: Facility licensee modified C as requested by NRC, and provided a new distractor for choice B. Q appears SAT at this time. MKM 17 H 2 X Y N B E K/AW/EO5EA2.2

1. QK/A, QRO level

2. Note: believe this C is higher cog level due to analysis of consequences beyond recall of information; lower cog for this type of Q might be: CAUTION statement in FR-1-1.1 says

3. Believe that distractor A is a partially correct answer, may need another distractor here. As RCS temps and pressures go up due to the loss of heat sink, isnt there a possibility that an overpressure condition could challenge the reactor vessel? In other words, why do we know that distractor A is incorrect?

Q appears E at this time.

Update 09/20: Facility licensee modified C as requested by NRC, and provided a new

-4 distractor for choice A. C appears SAT at this time. MKM t 11 J

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 H 2 X X Y N M E K/AW/E1JG2.1.25

1. Q=K/A, Q=RO level.

2. Cueing/teaching in the stem: can remove .due to the failure of both RHR pumps.

From the 1025 bullet. Can also remove .19 RNO... from the 1040 bullet (not needed).

3. Recommend adding Based on the current conditions fat 1040), WOOTF to the 0 statement.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested. 0 now appears SAT. MKM.

19 F 2 x x Y N M U K/A 001 G2.4.49

1. Q=K/A, QRO level.

2. Recommend to move the statement in accordance with AOl-2 to the second part Q statement.

3. Distractors A(1) and B(1) are non plausible; common knowledge that 8 steps per minute is an automatic rod speed, not a manual rod speed. Does WB have a different rod speed for shutdown banks than for control banks? Would be a better choice for distractors here if so.

Q is U due to more than one non plausible distractor.

Update 09/20: Facility licensee modified Q as requested, Q now appears SAT. MKM 20 F 2 x Y N M E K/A 036AA1 .04

1. Q=K/A, QRO level.

2. Recommend slight modifications for 0 statements as detailed below:

Before closing 1-ISV-78-600, FUEL TRANSFER TUBE ISOL, the fuel transfer cart is required to (1 )_ side.

A MINIMUM of _(2)...... are required to be dispatched to close 1-ISV-78-600.

Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested. Q now appears SAT. MKM.

t 1

= J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD I I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 I I Back- Q SRO B/M/N UIEIS Explanation Focus Dist. Link units ward K/A Only

__[

21 H 2 Y N N -. , 037AK3.05

1. Q=K/A, QRO level.

2. B is non plausible; what is the cause and effect relationship between starting an additional CCP and letdown flow limits?

3. D is non plausible; there is always a mismatch between charging and letdown when, or instance, restoring normal letdown following a pzr level malfunction; why would it be concern under these conditions?

) is U due to more than one non plausible distractor.

pdate 09/20: Facility licensee developed completely new Q for this K/A, Q appears AT. MKM 22 H 2 Y N M 051AA2.02

1. Q=K/A, Q=RO level.

2. Recommend slight mods to Q statement as follows: Which ONE of the following identifies the NE)(T required action(s) in accordance with Aol-il for the current conditions (at 1005)?

3. Recommend adding manually to all distractors to read e.g. Manually trip the turbine and Manually trip the reactor...

0 appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

23 H 2 X Y N M E K/AO68AA1.l2

1. Q=K/A, 0R0 level.

2. Recommend defining ACR in the 1040 bullet (MCR is defined in the 1030 bullet).

O appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

13 II

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 24 F 3 X Y N M E K/A076AK3.06

1. Q=K/A, Q=RO level.

2. Recommend slight modification to distractor C to match the language in the AOl; e.g.

C. implement Tl-7.004, Fuel Integrity Assessment Program Q appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

25 H 2 X Y N N E K/A W/EO6EK2.2

1. QK/A, Q=RO level.

2. Distractors A(1) and B(1): do we need only the to make them grammatically match the 0 statement?

0 appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. 0 appears SAT at this time. MKM.

26 F 2 X Y N N E K/A W/E08EK1 .01

1. Q=K/A, Q=RO level.

2. Cueing: can delete responding to an ORANGE Path on PTS from the second bullet, should know if you are in 1-FR-P.1 you have a RED or ORANGE path. Second bullet could read: The operating crew is currently performing 1-FR-P.1, Pressurized Thermal Shock, and is determining if conditions allow COPS to be ARMED.

3. Recommend adding Based on the given conditions before the WOOTF statement.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

27 H 3 N N S K/AW/EO9EA2.2

1. Q=K/A, Q=RO level.

Q appears SAT at this time.

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 28 F 2 X X Y N N E K)A003A4.07

1. QK/A, QRO level.

2. Why 1300 psig in the 0 statement? Not sure why we need this info.

3. Distractor D is non plausiblecommon knowledge about 200 psi delta P requirement for RCP seals. 310 psig may be about as low as would be plausible?

0 is E due to one non-plausible distractor.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

29 H 2 X Y N B E K/A003K5.04

1. Q=K/A, Q=RO level.

2. Recommend replacing immediate with initial in Q statement; specify narrow range level in 0 statement.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

30 F 2 X Y N M E K/A 004G2.1.23

1. QK/A, QRO level.

2. First part Q statement, recommend changing ...OAC will position to .. .OAC is required to position...

0 appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. 0 appears SAT at this time. MKM.

C 15

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 31 H 3 X X Y M K/AOO5A1.07

1. Q=K/A, 0 does not meet RO level (see below)

2. Operability determinations are generally SRO-only level questions, the question of operable or not in this case is probably not above the line Tech Spec knowledge.

3. Distractors B. and C. are not plausible due to the interplay between the first part and second part of the distractors. Distractor B-if the valve is OPERABLE, why would you not be allowed to perform a second stroke time test? Distractor C-if the valve is INOPERABLE, why would you be allowed to perform a second stroke time test? If it was successful, would you be able to declare the valve OPERABLE?

0 is U due to multiple non plausible distractors, SRO only aspects on RO exam.

Update 09/20: Facility licensee agreed with NRC comments and developed a completely new 0 for this K/A. However, this Q had further psychometric flaws and required additional significant modifications based on NRC recommendations during in-office review. 0 now appears SAT at this time. MKM 32 F 2 Y N N S K/A 005K2.03

1. Q=K/A, Q=RO level.

0 appears SAT at this time.

33 F 3 X Y N M E K/A 006A3.03

1. Q=K/A, Q=RO level.

2. Recommend add decimal points to all distractors (34.0%) for parallelism.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

34 F 2 X X Y N B E K/A 007K4.01

1. Q=KIA, Q=RO level.

2. Recommend modifying the second part Q to ask whether or not the RCDT pump will, or will NOT automatically start:

.RCDT, is manually opened and RCDT pump B _(2)_ automatically start when 1-FCV-68-310 is fully open.

Q appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

t 16 *1

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 35 H 2 X X Y N B E K/AOOSG2.4.11

1. Q=KIA, Q=RO level.

2. Psychometrically/logically, the only differentiation in the second part Q is whether or not the 2B-B CCS pump is required to be placed in PTLthe C-S CCS pump is a logical

true statement. In these cases its better to simply ask the will/will NOT question. Use of only as a logical differentiation may not be completely technically correct in these casesits often best to specify exactly what the use of only is intended to convey.

3. Can delete .due to the imminent loss of level on the Train B side of the surge tank, as teaching in the Q statementlcueing. Recommend the following:

Based on the given conditions, which ONE of the following completes the statements below?

During performance of 1-AOl-15, a reactor trip be required.

During performance of 1-AOl-i 5, CCS Pump 2B-B be required to be stopped and placed in Pull-to-Lock (PTL).

Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

36 F 2 X x Y N M U K/AO1OA3.01

1. Q=K/A, Q=RO level

2. Is there a missing bulletfinformation in this 0 stem? Q is very confusing; first part Q asks the cause of PRT press. and temp. rising, but we are not told this information in the O stem. Second part 0 tells us that a PORV has momentarily opened, again this information is not indicated in the 0. Please discuss.

3. Distractors A(1) and B(1) are non plausible: what is the cause-effect relationship between leaving a valve handswitch in AUTO and PRT pressure and temperature rising?

O is U due to multiple non plausible distractors.

Update 09/20: Facility licensee agreed with NRC comments, and provided a completely new 0 to meet this K/A. The newly proposed Q appears SAT at this time. MKM.

r 17 I,. 1

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 37 F 2 X X X Y N M E K/A012K5.O1

1. Q=K/A, QRO level

2. DNB Limits is not the official title of LCO 3.4.1, but we cant use the official title because that gives away the answerrecommend just leaving off the title and just ask (1) two parameters monitored to ensure compliance with Technical Specification LCO 3.4.1

3. Spell out what AFD means and provide the I abbreviation for plausibility with the OT-delta T function.

4. Second part Q needs to specifically ask for a reactor trip that is designed to provide protection from DNB; OP-delta T provides protection against DNB but it is not specifically designed for this function (potential partial correct answers)

Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

18

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 38 H 3 x Y N B E K/A 013K6.01

1. 0= K/A, QRO level.

2. How would the RO know that 1-LT-63-50 is failed? Indication would be just offscale high.

3. 0 statement asks for initial impact of the failure, but the correct answer is that there is no impact. Recommend something like the following, ensure its technically correct for WB:

Initial conditions:

-Reactor power is 100%

-After a failure of RWST level instrument 1-LT-63-52, the applicable Technical Specification requirements were met, and 1-LT-63-52 was removed from service.

Current conditions:

-The RO records the following RWST levels:

LT-63-50 is offscale high LT-63-51 is 98% and stable LT-63-52 is out-of-service LT-63-53 is 99% and stable Which ONE of the following describes the impact, if any, of the current RWST level instrumentation status on the RHR suction auto swapover function?

Distractors as written.

O appears E at this time.

Update 09/20: Facility licensee accepted NRC recommended fixes. 0 appears SAT at this time. MKM.

C 19

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 39 F 3 X X Y N M E K/A022A1.02

1. Q=K/A, QRO level.

2. Fourth bullet is somewhat teaching in the stem; maybe a better way to state it as follows: The operating crew is unable to reduce the temperature to less than the setpoint within the required time period of ARI 104-B.

3. Recommend adding an additional bullet in the Q stem that gives Containment pressure as +0.2 psid relative to the annulus to set up the conditions for the second part Q statement.

4. Distractors A(1) and B(1), Containment Spray do not exactly fit grammatically with the first part Q statement. Recommend modifying first part Q statement to say: The ARI for 1 04-B will first direct the operators to_ti). Then have distractors A(1) and B(1) state INITIATE Containment Spray, and have distractors C(1) and D(1) state START Containment Air Return Fans this will be more exactly parallel with the language in the ARI step.

5. May be useful to bold/underline first in the second part Q statement as well.

0 appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

40 F 3 Y N M S K/A 025A1.03

1. Q=K/A, QRO level.

Q appears SAT at this time.

t 20

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N UIEIS Explanation Focusj Dist. Link units ward K/A Only 41 H 2 X X Y N N E K/A 025A4.01

1. QK/A, QRO level.

2. Stem focus and cues: how would an operator know a medium break LOCA occurred? That information is essentially given by the peak containment pressure value.

Also, third bullet can be deleted as superfluous information.

3. Recommend re-write as follows:

Given the following:

-Unit 1 was at 100% power.

-An automatic reactor trip and automatic SI occurred due to a LOCA.

-Peak containment pressure was 2.6 psig.

-No operator actions have occurred.

Which ONE of the following completes the statements below?

Based on the given conditions, both 1-FCV-61-191 and 1-FCV-61-193 will be If both 1 -FCV-61-1 91 and 1-FCV-61 -193 are closed, manual action required to protect the Glycol circulation pumps.

Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

42 H 2 x Y N M E K/A 026A2.03

1. Q=KJA, Q=RO level.

2. Recommend slight mod to Q statement as follows: FR-Z.1 will NOT direct placing RHR spray in service at 0905 because Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

C 21 L

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 43 H 2 X Y N M E K/A 039K2.05

1. Q=K/A, QRO level.

2. Recommend adding a second bullet to the 0 stem that states All controls are aligned in accordance with GOl twhatever the procedure title is] for the current power level. This is to ensure the applicants understand that SDs are in pressure mode.

3. Recommend splitting up the 0 statement into two separate sentences for readability, change valves to controllers as follows:

Prior to action by the operating crew, the initial RCS Tavg change will result in a (1) in reactor power.

The Steam Dump controllers will be set to respond to changes in Q appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

44 H 2 Y N N E K/A059K1.04

1. QK/A, 0R0 level.

2. Recommend adding a third bullet No other equipment is out-of-service after the current second bullet.

3. Recommend adding Based on the given conditions,... to the WOOTF statement.

4. Unsure of the meaning of the language forced to in the first 0 statement, recommend something like SG 2 MFW reg valve controller will automatically shift to a (1) mode of control. As long as this is what you meant/is technically correct.

Q appears E at this time.

.. Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

45 F 2 Y N M S K/A 061K4.04

1. Q=KIA, QRO level.

Q appears SAT at this time.

I 22 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 H Y N B K/A061K6.02

1. QK/A, Q=RO level.

2. First part 0 statement is LOD=1; it should be common knowledge to all operators that lB-B AFW pump only feeds 3&4 S/Cs. A(1) and B(1) distractors are non plausible.

0 is U due to multiple non plausible distractors/LOD=1 Update 09/20: Facility licensee agreed with NRC comments and provided a completely new Q to meet this K/A. New Q appears SAT at this time. MKM.

47 F 2 V N M K/A062K4.07

1. QK/A, Q=RO level.

0 appears SAT at this time.

48 F 2 V N B S. K/A063K2.01

1. 0=1</A, Q=RO level.

0 appears SAT at this time.

49 F 2 x X Y N N E K/A 064A2.05

1. Q=K/A, QRO level.

2. Grammar: second bullet change ran to run; 41h bullet change is being emitted to has been emitted

3. Recommend slight mod to 0 statement as follows:

Which ONE of the following completes the statement below?

Based on the given conditions, 501-82.01 first directs the operators that DC lA-A is Believe this change is necessary for timing aspect: if the DG continued to emit thick black smoke, B may be argued a correct answer.

Q appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

23

-(

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 50 F 2 Y N N E K/A 064K1.02

1. QK/A, QRO level.

2. Can delete using 1-1-15-82-14, START-STOP, on 0-M-26 from first bullet as unnecessary information.

3. Recommend modification to second part 0 statement as follows: The DC is designed to automatically trip when the Jacket Water Temperature fjt rises to the setpoint of _(2)_.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC, with the exception of number 2 above. 0 appears SAT at this time. MKM.

S K/A 073K3.01

1. Q=K/A, QRO level.

Q appears SAT at this time.

52 F 2 Y N M K/A 076G2.l.28

1. QK/A, QRO level.

2. Distractors A and D are non plausible due to the interplay between the first part and second part distractors. For example, for A if the purpose of the switch is to ensure (only) one pump is running, how does that prevent excessive DC loading when compared with ensuring any DC cooling at all? Also, for D if the purpose of the switch is to set the order the pumps will be starting, the concern isnt ensuring j1Y DC cooling available at all, rather its a concern over sequence order.

Q is U due to multiple non-plausible distractors.

Update 09/20: Facility licensee agreed with NRC comments and provided a completely new 0 to meet this K/A. This new Q appears SAT at this time. MKM.

( 24

)

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q ISRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 53 H 2 x x Y N N E KIA 078A4.0i

1. Q=K/A, QRO level.

2. Can delete the and on 1-M-15 in the second bullet, should read: During performance of ES-i .2, Post LOCA Cooldown and Depressutization, the CR0 is directed to open the containment air supply valves.

3. Can we add nomenclature for 0-Pl-32-105A?

4. Need to be more specific as to which valves we are asking about in first part Q statement. Maybe just say i-FCV-32-i02, WATTS BAR NOMENCLATURE HERE, was closed due to the (1) 0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

54 F 2 x Y N B U K/A 078K3.Oi

1. Q=K/A, QRO level.

2. Distractors A(2) and C(2) are not credible. Why would the plant be designed to have a Pzr spray valve fail OPEN and cause a drastic loss of RCS pressure that would potentially result in an automatic Rx trip and maybe even SI?

3. Recommendation for second part 0 statement: The above conditions _(2)_ result in the Loop 2 Pressurizer Spray valve failing closed. distractors will/will NOT.

Q is U due to multiple non plausible distractors.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM. Evaluation of this 0 now E due to ease of correction of 2x2 format.

C 25 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 55 H 1 X X X Y N M .103K1.08

1. QKIA, QRO level.

2 It is common knowledge that some kind of manual action is required to reset the phase A and phase B containment isolation signals Steps requiring these actions are all over the Westinghouse EOPs. Under what conditions would SI, Phase A, or Phase B wer reset automatically? Distractors A,B, and D are not plausible and Q is LOD1 as vritten.

3. Recommendation: in the Q stem, give a peak containment pressure that is above the phase B actuation setpoint and a current containment pressure somewhere between phase A and phase B. Then give a condition in the stem that Slis NOT reset. Now iave the operators attempt to reset phase A and phase B. Will the signals reset or not?

Will one reset and another not reset? Something like this should be able to work for the K/A.

is U as written due to LOD=1 and three non plausible distractors.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

56 H 2 X x x Y N N E K/A 002K1.17

1. QK/A, Q=RO level.

2. In the first bullet, to state that unit is at 20% power following a refueling outage weakens the plausibility of Nis in the first part Q because they wouldnt have been calibrated yet. Recommend stating that unit is at 20% power following a forced outage after 100 days of continuous operation (or equivalent).

3. Need to be very clear as to what we are asking in the first part Q statement, maybe tweak it a bit: For the current power level, 1-GO-3 states that the preferred indication of power level is _(1)_. As written, the statement as turbine load is being raised may cause confusion.

4. There is a subset issue with the second part Q: if I incorrectly believed that A(2) and C(2) were correct, then logically B(2) and D(2) would also be correct, so I can dismiss distractors A and C. Giving BOD here.

5. For second part 0: how can the applicant be sure that Tref will be exactly the same as the program Tavg schedule? Maybe just ask here what the programmed Tavg should be at the power levelan alternate approach may work better than trying to fix the deviation approach with minimums/maximums etc 2 Q appears E at this time Update 09/20 Facility licensee modified 0 as requested by the NRC Q appears SAT at this time. MKM.

t 26 I. )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD I (F/H) (1-5) Stem ICues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/M/N U/E/S Explanation Focusj Dist. Link units ward K/A Only 57 F 2 X X X Y N N E K/AO11K2.02

1. Q=K/A, QRO level.

2. Do we need to provide switch positions in the Q stem (e.g. ON vs. A-P auto, etc.) to ensure technically correct answer?

3. Is it operationally valid to ask Blackout sequence timing? Would it not be more operationally valid to ask if the C or D heaters would re-energize automatically after the completion of the blackout sequencer? Please discuss.

Q appears E at this time.

Update 09/20: Discussed technical concerns with facility licensee during in-office review. Now agree with facility licensee that 0 should be SAT as submitted. MKM.

58 H 2 x x Y N N E K/A 014K3.02

1. Q=K/A, QRO level.

2. Last bullet states that both CERPI screens are unaffected and display normal rod height data but how would the operator know this? Slight cueing here, recommend stating -Both CERPI screens are displaying the same rod height values as before the 83-D alarm.

3. Slight logical conundrum with the second part Q statement when read closely: would actions required by LCO 3.1.8 be required? Maybe rewrite the Q statements as follows:

Based on the given conditions, which ONE of the following completes the statements below?

Rod height values on ICS would be displayed in a (1) color.

Entry into REQUIRED ACTIONS of LCO 3.1.8, Rod Position Indication, _(2) required.

With second part distractors are/are NOT 0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

f 77 L J

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 H Y N B K/A 017A3.01

1. QK/A, QRO level.

2. This question is LOD1 due to GFES-level knowledge of natural circulation conditions. License-level knowledge of natural circulation conditions would include site-specific setpoints, etc. and knowledge of specific parameters to be evaluated.

3. Credible distractors: It is common knowledge that the conditions with RCPs off or RCPs running will lead to different conditions in TC and Tcold readings; therefore distractors A and D are non plausible due to interplay between first and second part questions.

4. Partial correct/indeterminate: Distractors use indeterminate language such as slightly above and several degrees without defining the terms. It could be argued correctly that there are multiple correct answers provided, depending on the assumptions that the applicants would be making as to what we mean by this indeterminate terminology.

Q is U due to LOD1, more than one non plausible distractor.

Update 09/20: Facility licensee agreed with NRC comments and proposed new Q to meet this K/A. Newly proposed 0 appears SAT at this time. MKM.

60 H 2 x Y N M E K/A 029K4.02

1. Q=KJA, Q=RO level

2. Slight cueing issues in the two 0 statements. Need to delete to prevent opening of ice doors, and to ensure a negative press in Lower Containment compared to Upper Containment. Recommend re-writing as follows:

SO1-30.02 directs (1).

SO1-30.02 section 5.2, Start Up Lower Containment Purge, directs the Train A Containment Purge and Exhaust Fans to be started _(2)_ opening 1-FCV-30-2, PURGE SUP FAN 1A DISCH damper.

Q appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

C 28 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 61 H 3 x x Y N N E K/A 033A1.02

1. Q=K/A, Q=RO level.

2. Can delete the last bullet as providing unnecessary information.

3. Recommend rewriting third bullet in Q stem as follows to enhance the plausibility of distractors C(1) and D(1): -Fuel shuffles are being conducted in the Spent Fuel Pool in preparation for core reload.

4. Recommend slight rewording of the second part Q statement for parallelism with first part Q statement (also remove slight cue of one of the two): With 1-RM-90-1 02, Spent Fuel Pool Area Monitor, reading ABOVE its HIGH radiation setpoint and 1-RM-90-103, Spent Fuel Pool Area Monitor, reading BELOW its HIGH radiation setpoint, _(2)_ of the running Auxiliary Building Supply Fans will have automatically tripped.

0 appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. 0 appears SAT at this time. MKM.

62 F 2 x Y N M E KIA 035K6.02

1. Q=KIA, Q=RO level.

2. Can delete the third bullet as providing unnecessary information.

3. Credible distractors: it is common knowledge that S/C PORVs are required to be set higher than normal for SGTL and SGTR situations, therefore Afi) and C(1) are very very weakly plausible. Just use 1170 for A(1) and C(1) and its much more plausible. BOD given here due to ease of correction.

4. Just to be precise, recommend adding in accordance with 1-AOI-33 to the second bullet so it reads as follows: -Following the isolation of SC #3 in accordance with 1 -AOl-33, Steam Generator Tube Leak, the pressure in SG #3 began to rise.

5. Cueing in the 0 statement (designed to trip full open). Recommend split up the 0 statement into two separate statements and slight re-write as follows:

Based on the given conditions, which ONE of the following completes the statements below?

As the pressure in SG #3 continues to rise, PCV-1-23 (SG 3 PORV) will be full open when the pressure rises to (1 )_ psig.

If PCV-1-23 (SC 3 PORV) fails to open, the first Safety Valve on the SC is set to lift when the pressure reaches _(2) psig.

O appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

t 79

=

I. )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 63 H 4 x x x Y N B E K/A 045K5.17

1. 0= K/A, Q=RO level.

2. First part 0 is very low LCD and distractors B(1) and D(1) are weakly plausible.

3. Second part 0 does not appear to be operationally valid and has a very high LCD.

Why would a RC know or care that the value of MTC is most negative by varying Cb while holding rod heights constant as load in raised from 50% to 75%?

4. This may be a hard K/A to meet, might need a K/A replacement here. Please discuss. BCD given due to 0 having a very difficult K/A.

0 appears E at this time.

Update 09/20: Facility licensee provided new 0 for another K/A as requested by the NRC. 0 appears SAT at this time. MKM.

64 H 2 x x Y N? M K/A 068A2.02

1. Q=KIA. 0 is weak tie to RO level for the second part 0 statementcontrol of release permits could be argued to be SRO-only knowledge. Potentially willing to accept based on the information being in an important procedural NOTE. Please discuss to ensure we are on solid RC-level knowledge ground here.

2. Distractors C(1) and D( 1) are weakly plausible. Distractor analysis talks about potentially using a portable pump for recirculation. In order to strengthen this aspect, recommend adding a first bullet that states: Unit 1 is in a refueling outage with the core fully off-loaded into the Spent Fuel Pool.

3. Recommend adding Based on the given conditions to the WOOlF statement.

4. The second part 0 statement could be read to be asking if the systems alignment would or would not allow the release to be restarted (i.e. is it physically possible to restart the release?). Recommend asking whether or not the procedure allows the release to be restarted as follows: If the Monitor Tank isolates due to a HI RAD signal during the release, SOl-77.01 _(2)_ allow the release to be restarted using the same release permit. distractors then become does/does NOT.

Q appears E at this time pursuant to resolution of questions over SRO-only aspects.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

t 30 1.

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 65 H 3 x Y N M E K/A 079A4.01

1. Q=K/A, Q=RO level.

2. Q statement language causes this alarm is somewhat non-specific.

3. As written second part Q statement asks status of 0-FCV-32-1 10, but does not specify when this status is requested.

4. Recommend slight re-writes of last bullet and Q statement to address the above concerns as follows:

-Control air pressure dropped to a low of 76 psig, and is currently 76 psig and stable.

Based on the given conditions, which ONE of the following identifies...

the decreasing Control Air system pressure setoint that caused 42-F to alarm, and the current status of 0-FCV-32-110, Non-essential Air Containment Isolation Valve?

Q appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT at this time. MKM.

C 31 1.

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 66 H 3 Y N B ....G2.1.43

1. Q=KIA, QRO level

2. The title of the given procedure section (Power Coastdown) makes the first part of O and D implausible.

3. The second part of distracter A and C are weakly plausible. Stating that 1-GO-4 limits the rate of change of power to 1% per hour is teaching/cueing in the stem. Does rate of power change have a direct cause-effect relationship with MTC? Please discuss.

4. Similar Q on the 2013 Sequoyah NRC exam.

Potential recommendation:

i the following:

-Unit 1 is conducting a coastdown at EOL in accordance with 1-GO-4, Normal Power Operation.

Based on the given condition, which ONE of the following identifies...

(1) how the unit will be operated during the coastdown, and

2) why does 1-GO-4 specify a restrictive limit on the rate of power changes during the coastdown?

. .then keep distractors as written.

) is U as written due to more than one non-plausible distracter.

Update 09/20: Facility licensee modified Q as requested by the NRC. Q appears SAT it this time. MKM.

67 H 2 Y N B S KJAG2.1.45

1. QKIA, QRO level.

0 appears SAT at this time.

32 I. }

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues TIE Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 68 H 3 X Y N N E K/AG2.1.8

1. Q=K/A, Q=RO level.

2. Recommend underlining and/or bolding the words raise and controller output in the second part 0 statement to be as clear as possible.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

69 H 2 x Y N M K/AG 2.2.1

1. Q=KIA, QRO level.

2. Cred Dist: IS LCO 3.1.4 appears to prohibit operation with a positive MTC at Watts Bar. Therefore, it is not plausible that a rising Tave would result in rising Rx power, or conversely that a lowering Tave would result in lowering Rx power. Distractors B and C are non plausible due to the above discussion.

Q is U due to multiple non plausible distractors.

Update 09/20: Facility licensee agreed with NRC comments, and provided newly developed Q to meet this K/A. New 0 appears SAT at this time. MKM.

70 F 3 Y B K/A G 2.2.7

1. QK/A, 0 is not RO level. Second part question is SRO-only because ROs are not expected to know requirements for Shift Manager coverage during CIPTEs.

2. Recommendation for second part Q statement: In accordance with NPG-SPP 06.9.1, Conduct of Testing, during the performance of a CIPTE at least one additional active licensed RO _(2)_ required to be stationed in the Main Control Room (MCR).

and then use distractors is/is NOT. This would then make the 0 operationally valid for ROs.

is U as written due to SRO-only content (2 part 0)/license level mismatch.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT this time. MKM.

33

{

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues TIE Cred. Partial Job- Minutia #/ Back-I 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 71 F 2 X Y N N E K/AG2.3.15

1. Q=KJA, Q=RO level.

2. Recommend slight mod to second part 0 statement, at the end of statement add in accordance with RCI-153, Radiation Work Permits (RWPs), and the appropriate RWP.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

72 F 2 X Y N B E K/A G2.3.4

1. Q=K/A, Q=RO level.

2. Just need to tighten up the two 0 statements to be as specific/clear as possible.

Recommend:

One of the 10 CFR 20 annual occupational dose limit for adults is _(1 )_ TEDE.

At Watts Bar, NPG-SPP-05.1, Radiological Controls, states that RPM/RSO signature authorization is required to exceed _(2) TEDE.

0 appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

34

{

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO E/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 73 F 2 x Y N B

G 2.4.20

1. Q=KIA, QRO level.

2. Distractor D is non plausible. Common knowledge that CCPs will not be discharging through the regenerative heat exchanger/normal charging line during EOPs until after SI Termination and realignment to normal charging, which has not happened in this case.

3. Distractor B is non plausible. Given that the LOCA is big enough to go to ES-i.3, RCPs have probably been tripped long ago due to RCP trip criteria or Phase B actuation concerns. In any event, the loss of offsite power will secure the RCPs as well. There are no additional conditions in the Q stem that may lead someone to believe that thermally shocking the RCP seals is the primary concern here.

4. Potential recommendation with same material:

Given the following:

-A LOCA has occurred on Unit 1.

-ES-i .3, Transfer to Containment Sump, is being implemented by the operating crew and cold leg recirculation has been established.

-The operators have just completed the step in ES-i .3 to RESET SI and have verified that SI ACTUATED is DARK and AUTO SI BLOCKED is LIT.

-A total loss of offsite power occurs.

-RCS pressure is 700 psig and slowly lowering.

ased on the given conditions, which ONE of the following is the correct sequence of operator actions in accordance with ES-i.3?

A. Verify CCPs have automatically restarted, then manually restart RHR pumps, then manually restart SI pumps.

3. Verity CCPs have automatically restarted, then manually restart RHR pumps. SI pumps are not required to be restarted.

C. Place CCPs in Pull-to-Lock, then manually restart RHR pumps, then manually restart CCPs, then manually restart SI pumps.

D. Place CCPs in Pull-to-Lock, then manually restart RHR pumps, then manually restart CCPs. SI pumps are not required to be restarted.

Q is U as written due to multiple non plausible distractors.

Update 09/20: Facility licensee modified 0 as requested by the NRC. Q appears SAT at this time. MKM.

t 35 I. )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 74 F 2 X X Y N B E K/AG2.4.28

1. Q=K/A, QRO level.

2. Subset issue: need to add minimum to first part 0 statement?

3. Not sure if B(1) and C(1) are plausiblecheck with AOl when available to review. To say two ROs and one SRO seems more plausible. Recommend spell out Main Control Room (MCR) in first part 0 statement, then use MCR in distractors as mentioned below.

4. Modify second part 0 statement to say: AOl-42.O1 requires the Diesel Fire Pump to be started (2)_ with distractors locally and from the MCR O appears E at this time.

Update 09/20: Facility licensee modified Q as requested by the NRC. 0 appears SAT at this time. MKM.

C 36 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO B/MIN U/E/S Explanation Focus Dist. Link units ward K/A Only 75 F 2 X X V N B E K/A G 2.4.29

1. Q=K/A, Q=RO level.

2. Think there is a potential for multiple correct answers with this 0 as written. For example, isnt the SED in the TSC responsible for all evolutions once the SED responsibilities are transferred from the control room to the TSC? Could be argued that the SED/TSC is really the ultimate responsibility for dispatching ERTs, because the OSC Manager reports to the SED/TSC.

3. Another view of second part 0 is that if the SED feels it is needed, then he could staff the ERO at a NOUE, so there is potentially correct answer here as well. If we fix that problem in the second part 0 by stating something like the lowest level emergency that will result in the emergency center being required to be staffed under all conditions then were cueing the correct answer. Giving BOD here.

Potential replacement? Consider the following:

Which ONE of the following completes the statements below?

(1) EPIP-7, Activation and Operation of the Operations Support Center (OSC), states that the activation time for the OSC is approximately _(1 )_ minutes.

(2) Upon declaration of a Notice of Unusual Event (NOUE), the Shift Manager/interim Site Emergency Director (SED) _(2) authorized to fully staff the emergency response organization.

A.60 is B. 60 is NOT C.90 is D. 90 is NOT O appears E at this time.

Update 09/20: Facility licensee modified 0 as requested by the NRC. 0 appears SAT at this time. MKM.

t 37 J

Watts Bar Nuclear Station October 2013 ILO Exam

7. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only SRO Questions 76 H 2 X X X Y Y N E K/A 008M2.12

1. Q=K/A, QSRO-only 51h

2. bullet: add comma after PZR PRESS and all caps for low

3. 0 statement: change complete to completes.

4. Add noun names in all caps for 1-Ll-68-339 and 7-Ll-68-320 for parallelism with the three instruments above.

5. Second part distractors: remove the action from the distractor, just test on the required procedure transition. The action is not required logically/psychometrically to arrive at two unique second part distractor choices. Change the second part 0 statement to read something like: In accordance with ES-I .1, the required procedure transition is to GO TO (2).

O appears E at this time.

Update 09/1 9:

Facility licensee incorporated comments 1-4 as requested, some disagreement over comment 5. NRC explained reasoning that foldout page requirements are considered RO-level knowledge, and therefore may not meet SRO-only guidance requirements because procedure selection would not need to be elicited to anive at the correct answer. Facility further modified 0 using comment 5 as requested.

0 appears SAT at this time. MKM.

t 3$ .1 L .1

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 H 3 X X X X Y Y N E K/A054AA2.04

1. Q=K/A, Q=SRO-only

2. 1400 time statement change due to leak to due to a leak

3. Potential for cueing correct answer and plausibility: what if the erratic steam generator level control resulted in a low-low S/G level? Applicant doesnt know, this weakens the plausibility of distractors A(1) and B(1). Recommend something like A Feed Water Isolation occurs due to one S/G HIGH level. Can delete during the runback, teaching in the stem.

4. Recommend changing first Q statement to read: The earliest time all AFW pumps will have received an automatic start signal is (1) the loss of offsite power.

5. Recommend changing second Q statement to read: In accordance with LCO 3.7.5, Auxiliary Feedwater(AFW) System, a maximum of(2) AFW Trains are OPERABLE at 1431.

O appears E at this time.

Update 09/19:

Facility licensee incorporated comments as requested, 0 now appears SAT.

t L )

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 78 H 3 x x x Y Y N E K/A 055EG2.4.41

1. QK/A, Q=SRO-only

2. As written this Q has potential for no correct answer, because EPIP-3 step 3.5 13] is conditional; i.e. states IF Assembly and Accountability is warranted, THEN INITIATE EPIP-8, WHILE continuing with this procedure. So it is left to SRO judgment as to warranted. We have to test things that are clearly required, or not required, in order to ensure all choices are logically independent of each other/dont inadvertently provide multiple correct answers. Also the time from 1440 to 1453 is only 13 minutes, so an argument could be made that the condition of loss of offsite power for >15 minutes did not yet exist and REP declaration is technically not yet required. BOD given here due to ease of correction.

3. Change time of 1440 to 0740.

4. Change time of 1450 to 0750. Change bullet to read Unit 1 RCS Temperature is currently 252 °F and slowly rising.

5. Change time of 1453 to 0800.

6. Add bullet stating Do NOT use SED judgment as a basis for REP declaration or equivalent Watts Bar terminology/acronyms.

7. With the above changes made, correct answer should now be C please verify.

Q appears E at this time.

Update 09/19:

Facility licensee recommends a separate modification to this Q, under evaluation. NRC re-recommended changing the Q as specified above.

Update 09/20:

Facility modified 0 as requested by NRC. 0 now appears SAT. MKM I 40 L

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 79 H 3 X X Y Y N E K/A058AA2.01

1. QK/A, Q=SRO-only

2. Second part 0 statement use of currently is somewhat vague. Recommend using Initial Conditions and Current conditions, or using a timeline, to be clear as to what is being asked.

. 3. Recommend modification to first bullet: The plant is operating at 100% power with no systems out-of-service.

4. Fourth bullet states Battery board voltage is Which battery board voltage?

Please provide/add plant-specific nomenclature and indication designation.

5. First 0 statement add comma after AMPS Q appears E at this time.

Update 09/19:

Facility modified 0 as requested by the NRC. Q now appears SAT at this time. MKM.

80 H 2 x Y Y N c/A 077AG2.2.37

1. Q=KIA, QSRO-only

2. It is not plausible to think that shutdown to MODE 3 will NOT be requited by TS, given the conditions in the stem. It would almost be conservative to declare LCO 3.0.3 entry on the loss of offsite power. Shutdown to MODE 3 would be required even if you mis-applied the TS entry from 3.8.1 Condition A to 3.8.1 Condition B. Distractors C(2) and D(2) are not plausible.

3. Potential fix: add no systems out of service to first bullet. Add a time to the fourth bullet, have it read No further manipulations of the electrical system have been performed. SI Pump lA-A remains tagged for maintenance. Then in second part Q, test on when (what time) an administrative requirement for MODE 3 entry is first required. Provide plant-specific nomenclature for Alternate power supply distractors.

0 is U as written due to multiple non-plausible distractors.

Update 09/19:

Facility proposed new modified version of this 0 to resolve the issue with the second part distractors. All second part distractors were re-written and the other comments as listed above incorporated into the modified 0. Q now appears SAT. MKM.

t 41 I. )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD I (F/H) (1-5) Stem ICues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focusj Dist. Link units ward K/A Only 81 H 3 X X X Y Y N E K/AWE05EG2.i.20

1. QK/A, 0=5 RD-only

2. Can delete Subsequently: in the Q stem as unnecessary.

3. Second bullet: need to specifically put the team at step 1 of FR-Hi. Recommend having second bullet read something like: The crew has just entered 1-FR-Hi, Loss of Secondary Heat Sink, and is about to perform the first step in the procedure to CHECK if secondary heat sink is required.

4. All caps ONE in WOOlF statement.

5. Distractors A(2) and B(2) are almost not plausible with the second question statement while a red path exists. Benefit of doubt given due to ease of correction.

Recommend modifying A(2) and 8(2) to read: at least once every 10-20 minutes.

6. Recommend changing Q statements to read as follows:

Which ONE of the following completes the statements below?

Based on the current conditions, i-FR-H.1 will require......(i)_.

In accordance with TI-12.04, Users Guide for Abnormal and Emergency Operating Instructions, the STA will be required to monitor Status Trees _(2)...... after the team completes the first step of i-FR-Hi.

Q is E at this time.

Update 09/19:

Facility licensee modified 0 as requested by NRC. Q now appears SAT. MKM.

82 H 2 x x Y Y N U K/A 028AG2.4.2i J 1. Q=K/A, Q=SRO-only

2. Distractors C. and D. are not plausible. Due to the logical structure of the status trees, when is there a case where the trees terminate in more than one procedure? (i.e.

logically the yes/no questions always lead to one unique endpoint) Furthermore, there is never a requirement to perform a YELLOW path procedure before another YELLOW path procedure.

3. Is there a requirement at Watts Bar for SRDs to know YELLOW path procedure entry from memory? May not be operationally valid.

4. Not sure how to repair this 0, may need a new approach.

Q is U due to more than one non-plausible distractor.

Update 09/i9:

Facility licensee proposed completely new 0 for this K/A. New 0 appears SAT at this time. MKM.

L r 42 L )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 83 H 3 X Y Y M E K/A068AG2.1.7

1. QK/A, Q=SRO-only

2. Stem focus: need to change RCS Hot Leg Temps to Cold Leg Temps? Also to be technical is another column needed to RCS Tavg (for MODE purposes)?

Q appears E at this time.

Update 09/19:

Facility licensee was correct in only providing hot leg temperatures because the auxiliary control room only has indications of S/C pressures and ThotNRC withdraws comment

2. Above. Q appears SAT at this time. MKM 84 H 5 x Y Y N U K/A 076AA2.06

1. Q=K/A, QSRO-only

2. LOD=5 and operational validity: need to provide references for >1 hour IS actions.

is also overlap between this Q and an RO Q on the same AOl.

3. If references added, would it become a direct-look-upneed to check.

)is U as written due to L0D5 and operational validity (>1 hr TS actions w/no reference).

Update 09/19:

acility licensee agreed with NRC comments, and proposed heavily modified 0 to meet his K/A that included new second part Q and revision of all distractors. New 0 much etter, appears SAT at this time. MKM.

t 43 J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 85 H 3 X X Y Y M E KIAWE15EA2.2

1. QK/A, Q=SRO-only

2. First part of distractor A is teaching in the distractor. Need to re-write 0 so that all distractor choices are just procedural titles. Recommendation:

Based on the given conditions, which ONE of the following identifies the NE)(T required procedure transition?

A. Transition to ES-i .3, Transfer to Containment Sump.

BC, D as written.

Q appears E at this time.

Update 09/19:

Facility licensee made modifications as requested by NRC. Q appears SAT at this time.

MKM.

86 H 2 x x x Y Y N U K/A 004G2.2.i2

1. Q=KIA but weak, QSRO-only

2. 0 statement allows ICS point F0131A to be used as an alternate indicationso why would there ever be a requirement to place the plant in MODE 3? Potential for no correct answer.

I 3. Is it operationally valid for SROs to know the Fire Protection required instrumentation from memory when it is a 30 day spec? Provided references blank this out.

4. Not sure how to recommend repairs to this Q.

Q is U due to no correct answer (?), operational validity concerns.

Update 09/1 9:

Facility licensee provided additional information to clarify the confusing first part of the Q, along with a slightly modified Q in order to address NRCs concerns. Facility will provide updated open-source references for this Q as discussed during the regional review.

This 0 is now evaluated as an E instead of a U, Q appears SAT at this time. MKM.

I C )

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 8.

LOK LOD (F/H) (1-5) Stem Cues TIE Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N Explanation Focus Dist. Link units ward K/A Only 87 F 2 Y Y M * .. 013G2.2.40

1. Q=K/A, Q=SRO-only

2. NOTE: As written this is a lower cog Q, only testing recall of LCO 3.0.5.

Distractors B, D, not plausible. B: Not logical that TS would allow restoration to I service for troubleshooting, but not post-maintenance testing. D: Not logical that IS ot allow restoration in either case.

4. Possible fix is to more closely test the specifics of LCO 3.0.5 exceptions?

)is U due to more than one non-plausible distractor.

Update 09/1 9:

Facility licensee proposed completely new 0 to meet this K/A, including completely new stem and statement and all new distractors. This new Q is much better than the previous version. Same LOK and LOD, new Q appears SAT at this time. MKM.

88 H 2 x y y N U I K/A 059A2.05

1. QK/A, Q=SRO-only

2. Distractors A(2) and C(2) non plausible. Provided reference NPG-SPP-03.5 p. 23 step 3.1 3.a.(1) requires 8-hour notification based on reactor trip alone, no need to analyze for AFW actuation.

is U due to more than one non-plausible distractor.

Update 09/19:

ility licensee proposed slight modifications to second part 0 to address NRC

oncerns, however these modifications did not fully alleviate the concerns over lausibility given the open-reference nature of the 0. During the regional review, further modifications were made jointly between the NRC and facility. Final version of this Q appears SAT. MKM.

Update 12/05:

-acuity licensee submitted post-exam comment demonstrating that it is possible for both if the first part answers to be correct; however, this is logically impossible. Therefore, in accordance with NUREG-1 021 section ES-403, this 0 will be deleted from the exam as containing two contradictory correct answers. BC and other senior operations engineers concurred with this decision. MKM.

t L J

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD (F/H) (1-5) Stem Cuesl T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 89 H 2 x x x Y Y N E K/A 061A2.06

1. Q=KJA, Q=SRO only

2. Second part Q needs to be tightened in order to ensure A(2) and 5(2) are truly plausible, because performance of IDO is a little unclear, OPDP-8 process is a two-stage process. Recommend revision to Q statements to read as follows:

Based on the given conditions, the 15-B MDAFWP is first required to be (1)_of SOI-3.02, Auxiliary Feedwater System.

OPDP-8, Operability Determination Process and Limiting Conditions for Operation Tracking, _(2)_ allow the INITIAL performance of an Immediate Determination of OPERABILITY (IDO) to be completed by a licensed, on shift RO. A licensed SRO will then check and concur with the IDO and any resultant operability/inoperability declarations.

And change second part 0 distracters to does and does NOT.

Q appears E at this time.

Update 09/19:

Facility licensee provided updated 0 that was modified to address NRC concerns listed above. Newly modified 0 appears SAT at this time. MKM.

C 46 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 H 2 x Y M K/A 064A2.09

1. Q=K/A, Q does not meet SRO-only requirements

2. Distractor C is not plausible. Based on the interplay between the two elements, it does not make sense that the diesel test run is allowed to be continued, along with a requirement to emergency start all dieselswouldnt that mean the test run is not 9llowed to be continued?

3. The correct answer to the first part Q is simple recall of major precautions and limitations in the surveillance procedure, knowledge of TS bases not needed. RO knowledge can be used to arrive at the correct answer.

Q is U due to not meeting SRO-only requirements.

Update 09/19:

Facility licensee agreed with NRC comments above, and proposed completely new Q to meet this K/A. New Q same LOK and LOD, meets K/A and SRO-only requirements. 0 appears SAT at this time. MKM.

Jpdate 10/01:

Based on validation comments, facility licensee proposed slight modification to Q90 via email to add a bullet stating all minimum voltage requirements are met to the Q stem.

NRC agrees with the licensee recommendation. Q still appears SAT at this time. MKM.

C 47 L .1

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 91 H 2 x VA 001 G2.1.31 Q=K/A, 0 is not

2. Distractor A(2) is not plausible, it is commonsense that rod realignment should be conducted <100% power. Distractors C(2) and D(2) weakly plausible, if C(2) is true then D(2) is probably true as well.

3. SRO-only knowledge is not required for this 0; xenon and fission product behavior during reactor operations is GFE knowledge and not exclusive to TS bases.

) is U due to not meeting SRO-only requirements.

Ddate 09/19:

Facility licensee agreed with NRC comments, and proposed a completely new 0 to meet his K/A. However, new Q still has issues with second part distractors/second part 0 neeting SRO requirements. First part 0 distractors only weakly plausible. Facility

-e agreed to table this 0 and continue development of another approach to meeting this same K/A statement.

Update 09/20:

Facility proposed new version of this 0 to meet same K/A statement. This new version of the 0 takes the given stem information from the original 0 and asks two completely new Qs with all-new distractors. New version is better Q, appears SAT at this time.

MKM.

92 H 2 x K/A 015A2.04

1. Q=KJA, but not at the SRO-only level as required

2. K/A requires use of procedures to correct, control, mitigate and must be at the SRO only level; however, AOl entry conditions (first part 0) are RO-level knowledge.

O is U due to not meeting K/A at the SRO level.

Update 09/19:

Facility licensee proposed slightly modified 0 to address NRC concerns. Further significant modification was requited to both first part 0 and distractors and second part 0 and distractors in order to ensure SRO-only requirements were met and ensure that the 0 was properly examining TS bases knowledge specific to the SRO position. Newly modified 0 appears SAT at this time. MKM.

A 48

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 F 3 X Y Y N E K/A034A3.01

1. 0=1K/A, Q=SRO only

2. Recommend delete word physically in first part Q statement.

3. Recommend slight modifications to second part 0 statement to more closely match the TR bases. Such as: The bases of TR 3.9.4, Crane Travel Spent Fuel Storage Building, states that the weight restriction on the movement of loads over fuel assemblies in the storage pool areas ensures that, in the event the load is dropped, the activity release will be limited to that contained in _(2)_.

O appears E at this time.

Update 09/19:

Facility licensee incorporated all NRC comments as requested. 0 appears SAT at this time. MKM.

94 F 2 X y Y B K/A G2.1.38

1. QK/A, QSRO-only

2. Distractors B(2) and C(2) are non plausible due to the references provided for SRO Q I #88 (NPG-SPP-03.5). There are no 15 minute reporting requirements listed in that procedure for the NRC.

3. Potential fix for second part Q: Ask In accordance with NPG-SPP-03.5, Regulatory Reporting Requirements, the state of Tennessee _(2) required to be notified of the action taken. Second part distractors now is/is NOT 0 is U as written due to more than one non-plausible distractor Update 09/19:

Facility licensee proposed slightly modified 0, but contended that 15 minutes for a notification was plausible. NRC continued to disagree with licensee, and licensee agreed to continue modifying the second part of the distractors to test knowledge of 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months vs. 4 hour4.62963e-5 days 0.00111 hours 6.613757e-6 weeks 1.522e-6 months notifications instead of 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months vs. 15 minute notifications. Newly modified 0 now appears SAT at this time. MKM.

(

1. 1

Watts Bar Nuclear Station October 2013 ILO Exam

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 F 3 X Y Y N E K/A G2.2.21

1. Q=K/A, Q=SRO-only

2. Recommend adding Following fuse replacement to the first part Q statement.

3. Not sure if the provided references completely support the correct/incorrect answer.

Is there any other reference that more clearly states that one-for-one fuse replacement does not require stroke time testing for operability determination?

0 appears E at this time, provided correct answer can be proven correct.

Update 09/19:

Facility licensee provided adequate explanation for NRC concerns listed above. Q now appears SAT at this time. MKM.

96 F 2 X Y Y B E K/AG2.2.23

1. QK/A, QSRO-only

2. Q statement is very wordy. Any way to make it clearer?

0 appears E at this time.

Update 09/19:

Discussed this 0 with licensee during regional in-office review. Agree with facility that Q is adequate as written, and that all information in the 0 stem and distractors is needed to elicit correct answer. 0 now appears SAT at this time. MKM.

97 F 2 X Y Y N E K/AG 2.3.14

1. Q=K/A, Q=SRO-only

2. Need capitalize ONE in WOOTF statement.

3. Recommend modification to first 0 statement as follows: Based on the given conditions, EPIP-15, Emergency Exposure Guidelines, states that Potassium Iodide (KI) (1) be issued to members of the emergency response organization.

4. Recommend modification to the second Q statement as follows: Uln accordance with EPIP-15, the Site Emergency Director (SED) _(2)_ required to approve the distribution of KI prior to issuance. Second part distracters now is/is NOT.

0 appears E at this time.

Update 09/19:

Facility licensee modified the 0 as requested by the NRC. Q now appears SAT at this time. MKM.

( 50 L

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues I/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 98 F 2 X X Y Y B E K/AG2.3.6

1. Q=KIA, QSRO-only.

2. At Watts Bar, is Chemistry Manager the same as Chemistry Duty Manager? may need to modify first part distractors to exactly match procedure.

3. How is approval granted for a release permit? Maybe we need to ask which final signature is required on the release permit paperwork instead of approval, which is a

. little bit more subjective. Please discuss during review.

0 appears E at this time.

Update 09/19:

Facility licensee modified the 0 as requested by NRC. Q now appears SAT at this time.

MKM.

99 H 2 X X X Y Y B E K/AG2.4.18

1. QK/A, Q=SRO-only.

2. Where did the crew get to in FR-Z.1? Are they at the beginning of the procedure or at the end? Makes a difference in the plausibility of distractors A(2) and C(2).

Recommend modifying the third bullet to state: While the crew was performing 1-FR-Z.1 step 1, the crew transitioned to 1-FR-P.1

3. Recommend slight modification to first part Q statement as follows: In accordance with the Westinghouse background document for FR-P.1, the basis of the FR-P.1.

step

4. Second part 0 statement if a transition is made from FR-P.1 during performance of the step is teaching/cueing in the stem and really lowers the probability of plausibility for distractors C(1) and D(1). Recommend the following: Based on the given conditions, if a procedure step in 1-FR-P.1 directs the operator to RETURN TO Instruction in effect, the team is required to transition to (2) 0 appears E at this time.

Update 09/19 Facility licensee modified this 0 with all comments requested by the NRC. Q now appears SAT at this time MKM t 51

Watts Bar Nuclear Station October 2013 ILO Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 100 F 2 X X Y Y N KIAG2.4.43

1. QKJA, Q=SRO-only.

2. NOTE: believe this Q is lower cog as written (recall).

3. It is common knowledge that only one phone call is received per day from the NRC with the authentication codes. No additional call is mentioned by the question statement. Therefore, 12 hour1.388889e-4 days 0.00333 hours 1.984127e-5 weeks 4.566e-6 months validity is non-plausible.

4. Are PARs required to be reported to the NRC? Why would they be needed to be protected with authentication codes when compared to a threat or physical attack event?

PARs is non-plausible.

5. Potential fix: First part 0 have the site receive a threat warning phone call from the NRC at time 0600, after having received the call at 0400 giving the code for the new day. Which authentication code is required to be used? Second part 0 operators do or do NOT have to control the authentication code as SAFEGUARDS information?

0 is U as submitted due to multiple non plausible distractors.

Update 09/19:

Facility licensee proposed completely new 0 to address the same K/A statement. This T new 0 partially incorporated NRC recommendations listed above. QKIA, QSRO only, LOK is F and LOD is 3. New Q now appears SAT at this time. MKM.

V C 52 L *1

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: kJ#/-c Date of Exam: Exam Level: RO SRO Initials Item Description a b c

1. Clean answer sheets copied before grading .422 47

2. Answer key changes and question deletions justified /

and documented - A-//i_

3. Applicants scores checked for addition errors (reviewers spot check > 25% of examinations) v P1/4- *

4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail s i)/,4-

5. All other failing examinations checked to ensure that grades are justified 1) ,tJ% f

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants / J/

1 Printed Name/Signature Date

a. Grader I ii

b. FacUityRenewer(*)

U. NRC Supervisor (*)

c/

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ML17165A491

Contents

Text

Subject:

Subject:

Subject:

Subject:

Subject:

Subject:

Navigation menu

ML17165A491

Text

Subject:

Subject:

Subject:

Subject:

Subject:

Subject:

Navigation menu

Search