ML101590095

Initial Exam 2010-301 Final Administrative Documents

ML101590095
Person / Time
Site:	Brunswick
Issue date:	05/03/2010
From:	NRC/RGN-II
To:	Progress Energy Carolinas
References
50-324/10-301, 50-325/10-301
Download: ML101590095 (90)

Text

sri 020r9-sunl -final-forms-rns.doc ES-201 Examination Preparation Checklist Form ES-201-1 Facility:

iRLL1JOk_--.

Date of Examination: 4

/S/ID Developed by: Written

- Facility RC D II Operating

- Facility RC D Target Chief Date*

Task Description (Reference)

Examiners Initials

-180 1.

Examination administration date confirmed (Cia; C.2.a and b)

-120 2.

NRC examiners and facility contact assigned (C.1.d; C.2.e)

-120 3.

Facility contact briefed on security and other requirements (C.2.c)

-120 4.

Corporate notification letter sent (C.2.d)

[-90]

[5.

Reference material due (C.1.e; C.3.c; Attachment 3)]

{-75}

6.

Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70}

{7.

Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}

{-45}

8.

Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 9.

Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; ES-202)

-14 10.

Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202)

-14 11.

Examination approved by NRC supervisorforfacility licensee review (C.2.h; C.3.f)

V

-14 12.

Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)

-7 13.

Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14.

Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 15.

Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k)

-7 16.

Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

f2c4 4thh WC l7u17d4 C-k h-Wt? & E&2 sr~Q2Qr9-su.pJ -fioal-forms-ms.dQc*

Form ES-201-1 Facility: is-R.ltN SW Iclc Date of Examination: 41.:;;-ltD Developed by: Written - Facility ~NRC D II

/

Operating - Facility UJ NRC D Target Chief Date*

Task Description (Reference)

Examiner's Initials

-180

1.

Examination administration date confirmed (C.1.a; C.2.a and b)

'#J(.

-120

2.

NRC examiners and facility contact assigned (C.1.d; C.2.e) 18u-

-120

3.

Facility contact briefed on security and other requirements (C.2.c)

~

-120

4.

Corporate notification letter sent (C.2.d)

-1bL

[-90]

[5.

Reference material due (C.1.e; C.3.c; Attachment 3)]

-nru-

{-75}

6.

Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3,

~

ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70}

{7.

Examination outline(s) reviewed by NRC and feedback provided to facility

.~

licensee (C.2.h; C.3.e)}

{-45}

8.

Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms

~

ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, arid any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30

9.

Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; 1ffYc ES-202)

-14

10.

Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; 7/fJL ES-202)

-14

11.

Examination approved by NRC supervisor for facility licensee review

~

(C.2.h; C.3.f)

-14

12.

Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)

/JK

-7

13.

Written examinations and operating tests approved by NRC supervisor

?bL (C.2.i; C.3.h)

-7

14.

Final applications reviewed; 1 or 2 (if >1 0) applications audited to confirm

~

qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7

15.

Proctoring/written exam administration guidelines reviewed...

with facility licensee (C.3.k)

'JM..,

-7

16.

Approved scenarios, job performance measures, and questions

~

distributed to NRC examiners (C.3.i)

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:

Date of Examination:

Initials Item Task Description

1.

a.

Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

) (

R b.

Assess whether the outline was systematically and randomly prepared in accordance with

/I I

Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

fr l

T T

c.

Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

j,_

1) d.

Assess whether the justifications for deselected or rejected KJA statements are appropriate.

1Q 2.

a.

Using Form ES-301-5, verify that the proposed scenario sets cover the required number

/L of normal evolutions, instrument and component failures, technical specifications, S

and major transients.

M b.

Assess whether there are enough scenario sets (and spares) to test the projected number u

and mix of applicants in accordance with the expected crew composition and rotation schedule L

without compromising exam integrity, and ensure that each applicant can be tested using A

at least one new or significantly modified scenario, that no scenarios are duplicated T

from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c.

To the extent possible, assess whether the outline(s) conform(s) with the qualitative

,f

,, (

and quantitative criteria specified on Form ES-301-4 and described in Appendix 0.

I 3.

a.

Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W

distributed among the safety functions as specified on the form I

(2) task repetition from the last two NRC examinations is within the limits specified on the form

) ;(

T (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b.

Verify that the administrative outline meets the criteria specified on Form ES-301 -1:

(1) the tasks are distributed among the topics as specified on the form J

(2) at least one task is new or significantly modified I

(./

(3) no more than one task is repeated from the last two NRC licensing examinations c.

Determine if there are enough different outlines to test the projected number and mix j/

of applicants and ensure that no items are duplicated on subsequent days.

4.

a.

Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

, -i G

E b.

Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate, c.

Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

R d.

Check for duplication and overlap among exam sections.

J L

e.

Check the entire exam for balance of coverage.

j (

f.

Assess whether the exam fits the appropriate job level (RO or SRO).

j jj 27-(

Pri te Na eSig ature Date

a. Author

b. Facility Reviewer ()

12, Zt4.i

c. NRCCtiiefExaminer(#)

R1AO

(

4/

3-3110

d. NRC Supervisor 1

t1W0f4A,.

Note:

1. Independent NRC reviewer initial items in Column c: chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:

Date of Examination:

Initials Item Task Description a

b*

c#

1.

a.

Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

IJ) tJtr JIi1 w

R

b. Assess whether the outline was systematically and randomly prepared in accordance with p) tJ~ 11J{

I Section 0.1 of ES-401 and whether allKJA categories are appropriately sampled.

T IV?

JJt. /IJ(

T

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

E

d. Assess whether the justifications for deselected or rejected KJA statements are appropriate.

I~

(\\ij~ 1'fi{

N

2.

a.

Using Form ES-301-5, verify that the proposed scenario sets cover the required number

(~ ~ 1/Jl(

of normal evolutions, instrument and component failures. technical specifications, S

and major transients.

I M

b. Assess whether there are enough scenario sets (and spares) to test the projected number U

and mix of applicants in accordance with the expected crew composition and rotation schedule

~b

/ffJ1 L

without compromising exam integrity, and ensure that each applicant can be tested using A

at least one new or significantly modified scenario, that no scenarios are duplicated T

from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days.

0 To the extent possible, assess whether the outline(s) conform(s) with the qualitative tv~ ~ 1M R

c.

and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3.

a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W

distributed among the safety functions as specified on the form

.~

I (2) task repetition from the last two NRC examinations is within the limits specified on the form

$I(

T (3) no tasks are duplicated from the applicants' audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the fonn (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

~

(1 )

the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations Determine if there are enough different outlines to test the projected number and mix lh

~

1/ ~

c.

)

of applicants and ensure that no items are duplicated on subsequent days.

4.

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered

~ ~ ~. #X in the appropriate exam sections.

G Jh t 1!tL E

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5.

Ih

~

E

c.

R

d. Check for duplication and overlap among exam sections.

~~

1U<

A L

e. Check the entire exam for balance of coverage.

V?

J{l. 1J;(

f.

Assess whether the exam fits the appropriate job level (RO or SRO).

~b tfo, 11171-A,(,,8,>/;. ='"

.. 1<1/)//1

a. Author

)l)j '1

/", f)

b. Facility Reviewer (0)

'-..c,,IIi.J!O i2. K~. L..d..

K'. tSLJlJL.

3 ~J6-f

c. NRC Chief Examiner (#)

f?j2.lANO CltSkl.A£/t-O

. 0:J/.etUJ/UJ 3-3f-IO

d. NRC Supervisor IJAtCofM. 7'. "WIOJlJ.l(,vN / "-

-./

I/Md.Jf>

IA fjJtiji1'Q I1J;>>.- -

Note:

1. Independent NRC reviewer initial items in Colum~"; chief examiner concurrence required.

• Not applicable for NRC-prepared examination outlines

ES-201 Examination Security Agreement Form ES-201-3 1.

Pre-Examination L,k I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1#27, as of the date of my signature.

I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination 7L)

/1 A//

1eS 1 J

1 1/

a 4ir/

To the best of my knowl9dge) did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of Y 9/From the date that I entered into this security agreement until the completion of examination administration I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2)

DATE NOTE

.1

• 2.

(flwe r4E1r E-

-if 3

ce5 I

4 V

?

5.

5.CLr USIr S1v 4d c /

8:

/V 4

J;J 1

9

/.

10. Afr+f

&)i P5 3

A ii

71v7 J

12 b LL 0P3 /AJ 13 2

4 1 2t /-t Dn 2

eiere I Jec-%f NOTES:

c/A

)\\A iIrI,i jL f.,y 1

\\,

iTh &.Lz4/4 tiiio K 4

,t-

__ i6

/4:AI I

Ai-(

-/ /i/

2:.k Icc./

2*jS/O

/!i7

1. 7 I jé...

zsLcLQ

-1I

/_ k..

1 V-/

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination L/!5-I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the Week(S)Jr~~ as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knOw~dge,) did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ?(t-j:" 7'.b9!.t:From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY r

~k.

mle.MM~J,...... ~

v:..

~< 'l '" ~ -.,. *,- '

~.. _ i*-

SIGNATURE (1)

_....A 'Y.1

'T,~_!"",f/l.

}.,..-..

~-~~

.*li'Ll~* --

DATE SIGNATURE (2)

DATE NOTE

"'1'X" q' _. y Ll j'zsll C*

"I '1'-

ff' 7 Dl7V

~

,k""'" ~.\\., _~W

~....L-=L

. <::.,i'i\\ IV;'~

'-'!'.. '" V "')'\\

v.:~,(?V. r"-l \\,?:f\\'T1.\\ <> ~

, '" ~

• f

. 'JfJ.--I!.::L

. h

,'C",

,V >,

Tn

~

t4,V',~.,,- :,.

~' '

,,,I"'DiI,lr,,,

. -on

~

1. -/

/ C:\\. ~

~+-YV:(;. r ou: _I

-t V

..,(I

,/

v.;, J." ~ f'

-"L:'

=, y""", DMJ ",t.:>

. ~.~. =--.

'f'l(,. /0,. ___ _

NOTES:..

02> ij~"I:J.+/-'.~

'~<;;f,'?J." ~.. >

,%::1(;/°

-rr

1. 7rL.(A~~---- ()~l';fQ --"

~/t

~ ft..

tt

.:?

",.... jl4., I

• "h I f.7

¥ 2:7'/0

ES-201 Examination Security Agreement Form ES-201-3 1.

Pre-Examination

/

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature.

agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowleØge, jdid not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of Yi 71k)From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

0

\\ I

j Z.(

i_

/t /5 2s.

1 A. -(

iIs/1A I

1/7<,?

I

_V-/v

)

/

Y,,OrV

.iJ 4-

q4-e4h

,, y7;;/7 4

w9

,4,-.

ES-201, Page 27 of 28

/

AL r *

/

PRINTED NAME JOB TITLE) RESPONSIBILITY SIGNATURE (1) iG :

a.

, Le 4.

/1t

5. /)i.Lk IL h4ti

6. fCLe,,. i\\\\.

s -

7/1JsL3 ST 4

/

Th.Li...

DATE SIGNATURE (2)

DATE NOTE 2k/

,44v/,4.tjt4_ 4/ /0 S 2.c)

), -

- L 5 r

/

3j-7;) /

CRS/ Vg1cJ.v SQO 3

p,,i21;

c 1

ç C4Lf/,4-?zI

/3sS 9.

)41.

10. -

11. ri 4-(zoi 12, 1jc

--: /1

13. 7

,iy teAIQ

14. A/ A-2 11 15

/

NOTES:

$(,vL-4 ç(

1b7

& c-1?

k.

/,

-/-,:i /

ES-201

___.. ________.. _____ ~~rnit:lClti()n Securi!Y~greement Form ES-201-3

1.

Pre-Examination

<."'I i

1i /," I?~

I 0'- 1/1'11 It.-'

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct. evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration. except as specifically noted below and authorized by the NRC (e.g.. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowlepge. lidid not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of Aj/ifr-1IrrhFrom the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate. or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1)

NOTES:

JV f>.;."

~..-\\~

/

,(./~ t j.,Id'r #tf

,q ES-201. Page 27 of 28

• ".;i;~~(~

-<Y#>-t.!i' >~ I ~h t <::. 4 I "

'1-;;:-1/0

Nemec, Michael From:

Lucky, Archie Sent:

Monday, April 26, 2010 10:47 AM To:

Nernec, Michael

Subject:

RE: NRC Security Agreement Post-Exam Signoff I just got back from vacation.

I am very pleased to see you have 10 for 10.

I could not get the voting button to work. But...you can sign me off.

To the best of my knowledge, Archie Lucky did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5

- 4/20/2010. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

Call me when you have some time.

1iz4 Senior Nuclear Operations Instructor Licensed Operator Continuing Training Harris Nuclear Plant 919-362-3386 VNet 772-3386 Prorss Enery From: Nemec, Michael Sent: Tuesday, April 20, 2010 4:40 PM To: Bain, Don; BelIer, Leonard; Bolin, Bob; Booker, Jimmy; Dahlin, Nils; Dillmann, Doug; Grosch, Gustav; Hawkins, Edward; Johnson, Jeremy (8NP); Kennedy, Alan T.; Knuth, Matt; Long, Michael; Lucky, Archie; Moore, Rick; Naylor, Michael; Nemec, Michael; Nils Home (nils@advantagenets.com); Odell, Robert; Pearson, Tony; Pierce, Jerry; Schall, Mark; Vansiyke, Chuck; Westermark, Hans; Williams, Michael D.; Williams, Michael S.; Wolf, Dwayne

Subject:

NRC Security Agreement Post-Exam Signoff Importance: High

All, HLC 2010-1 has completed all phases of NRC examination. Please stop by the exam room (across from the EOF) to sign off the agreement and turn in your HLC Exam Security Badge.

For those of you not currently located within the Brunswick Nuclear Plant area (Nils, Archie, Alan, and Rick),

acknowledge the statement below by voting (using the button in the upper left hand corner), and I will use the voting reply to sign you off the agreement.

To the best of your knowledge, YOU did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5

- 4/20/2010. From the date that you entered into this security agreement until the completion of examination administration, you did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

Nemec, Michael From:

Sent:

To;

Subject:

Lucky, Archie Monday, April 26, 2010 10:47 AM Nemec, Michael RE: NRC Security Agreement Post-Exam Signoff I just got back from vacation. I am very pleased to see you have 10 for 10.

I could not get the voting button to work. But... you can sign me off.

To the best of my knowledge, Archie Lucky did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5 - 4/20/2010. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

Call me when you have some time.

Ifl<-eltk Lao/,

Senior Nuclear Operations Instructor licensed Operator Continuing Training H(omis Nuclear Plant 9 19-362-3386 VNet 772-3386 From: Nemec, Michael Sent: Tuesday, April 20, 2010 4:40 PM To: Bain, Don; Belier, Leonard; Bolin, Bob; Booker, Jimmy; Dahlin, Nils; Dillmann, Doug; Grosch, Gustav; Hawkins, Edward; Johnson, Jeremy (BNP)i Kennedy, Alan T.; Knuth, Matt; Long, Michael; Lucky, Archie; Moore, Rick; Naylor, Michael; Nemec, Michael; Nils Home (nils@advantagenets.com); O'dell, Robert; Pearson, Tony; Pierce, Jerry; Schall, Mark; Vanslyke, Chuck; Westermark, Hans; Williams, Michael D.; Williams, Michael S.; Wolf, Dwayne

Subject:

NRC Security Agreement Post-Exam Signoff Importance: High

All, HLC 2010-1 has completed all phases of NRC examination. Please stop by the exam room (across from the EOF) to sign off the agreement and turn in your HLC Exam Security Badge.

For those of you not currently located within the Brunswick Nuclear Plant area (Nils, Archie, Alan, and Rick),

acknowledge the statement below by voting (using the button in the upper left hand corner), and I will use the voting reply to sign you off the agreement.

To the best of your knowledge, YOU did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5 - 4/20/2010. From the date that you entered into this security agreement until the completion of examination administration, you did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

Nemec, Michael From:

Kennedy, Alan T.

Sent:

Thursday, April 22, 2010 9:00 AM To:

Nemec, Michael

Subject:

I have not compromised the HLC 2010-1 exam security agreement: NRC Security Agreement Post-Exam Signoff Nemec, Michael From:

Sent:

To:

Subject:

Kennedy, Alan T.

Thursday, April 22, 2010 9:00 AM Nemec, Michael I have not compromised the HLC 2010*1 exam security agreement: NRC Security Agreement Post-Exam Signoff

Nemec, Michael From; Moore, Rick Sent Tuesday, April 20, 2010 8:04 PM To:

Nemec, Michael

Subject:

I have not compromised the HLC 2010-i exam security agreement: NRC Security Agreement Post-Exam Signoff 1

Nemec, Michael From:

Sent:

To:

Subject:

Moore. Rick Tuesday. April 20. 2010 8:04 PM Nemec, Michael I have not compromised the HLC 2010-1 exam security agreement: NRC Security Agreement Post-Exam Signoff 1

Nemec, Michael From:

Nils Dahlin [nllsadvantagenets.com1 Sent:

Tuesday, April 20, 2010 9:15 PM To:

Nemec, Michael

Subject:

RE: NRC Security Agreement Post-Exam Signoff Hi Mike, My version of Outlook does not have a vote option. You will have to use this response as my official signing off.

How was the test? 100% pass rate? I hope so.

Best wishes, Nils Dahlin From: Nemec, Michael [mailto:MichaeLNemec@pgnmail,comj Sent: Tuesday, April 20, 2010 4:40 PM To: Bain, Don; Belier 1 Leonard; Bolin, Bob; Booker, Jimmy; Dahlin, Nils; Dillmann, Doug; Grosch, Gustav; Hawkins, Edward; Johnson, Jeremy (BNP); Kennedy, Alan T.; Knuth, Matt; Long, Michael; Lucky, Archie; Moore, Rick; Naylor, Michael; Nemec, Michael; Nils Home (nils@advantagenets.com); Odell, Robert; Pearson, Tony; Pierce, Jerry; Schall, Mark; Vanslyke, Chuck; Westermark, Hans; Williams, Michael D.; Williams, Michael S.; Wolf, Dwayne

Subject:

NRC Security Agreement Post-Exam Signoff Importance: High

All, HLC 2010-1 has completed all phases of NRC examination. Please stop by the exam room (across from the EOF) to sign off the agreement and turn in your HLC Exam Security Badge.

For those of you not currently located within the Brunswick Nuclear Plant area (MIs, Archie, Alan, and Rick),

acknowledge the statement below by voting (using the button in the upper left hand corner), and I will use the voting reply to sign you off the agreement.

To the best of your knowledge, YOU did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5 - 4/20/2010. From the date that you entered into this security agreement until the completion of examination administration, you did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

dae Operations Initial Training Brunswick Nuclear Plant 910.457.2204 Nemec, Michael From:

Sent:

To:

Subject:

Hi Mike.

Nils Dahlin [nils@advantagenets.coml Tuesday, April 20, 20109:15 PM Nemec, Michael RE: NRC Security Agreement Post-Exam Signoff My version of Outlook does not have a "vote" option. You will have to use this response as my official "signing off".

How was the test? 100% pass rate? I hope so.

Best wishes, Nils Dahlin From: Nemec, Michael [1]

Sent: Tuesday, April 20, 2010 4:40 PM To: Sain, Doni Bellerf Leonard; Solin, Bob; Booker, Jimmy; Dahlin, Nils; Dillmann, Doug; Grosch, Gustav; Hawkins, Edward; Johnson, Jeremy (BNP); Kennedy, Alan T.; Knuth, Matt; Long, Michael; Lucky, Archie; Moore, Rick; Naylor, Michael; Nemec, Michael; Nils Home (nils@advantagenets.com); O'dell, Robert; Pearson, Tony; Pierce, Jerry; Schall, Mark; Vanslyke, Chuck; Westermark, Hans; Williamst Michael D.; Williams, Michael S.; Wolft Dwayne

Subject:

NRC Security Agreement Post-Exam Signoff Importance: High

All, HLC 2010-1 has completed all phases of NRC examination. Please stop by the exam room (across from the EOF) to sign off the agreement and turn in your HLC Exam Security Badge.

For those of you not currently located within the Brunswick Nuclear Plant area (Nils, Archie, Alan, and Rick),

acknowledge the statement below by voting (using the button in the upper left hand corner), and I will use the voting reply to sign you off the agreement.

To the best of your knowledge, YOU did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 4/5 - 4/20/2010. From the date that you entered into this security agreement until the completion of examination administration, you did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations.

Operations Initial Training Brunswick Nuclear Plant 910.457.2204

ES-301 Administrative Topics Outline Form ES-301 -1 Facility:

Brunswick Date of Examination: April 2010 Examination Level:

RO SRO-i Operating Test Number:

FINAL Administrative Topic Type Describe activity to be performed (see Note)

Code*

R, M, D Core Performance Check

- APRM parameter Conduct of Operations check R, M, P Drywell Average Air Temperature Calculation Conduct of Operations R, P (SRO-l only) Refueling Technical Specifications R, D RCC Clearance Equipment Control R, M Calculation of Stay Times Radiation Control R, M (SRO-l only) Emergency Action Level Determinations Emergency Procedures/Plan NOTE:

All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

• Type Codes & Criteria:

(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

Ac ES-301 Administrative Topics Outline Form ES-301-1 Facility:

Brunswick Date of Examination: April 2010 Examination Level: RO

• SRO-J

• Operating Test Number: FINAL Administrative Topic Type Describe activity to be performed (see Note)

Code*

R,M,D Core Performance Check - APRM parameter Conduct of Operations check R,M,P Drywell Average Air Temperature Calculation Conduct of Operations R,P (SRO-I only) Refueling Technical Specifications R,D RCC Clearance Equipment Control R,M Calculation of Stay Times Radiation Control R,M (SRO-I only) Emergency Action Level Emergency Procedures/Plan Determinations NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

• Type Codes & Criteria:

(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (::; 3 for ROs; ::; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank (2! 1)

(P)revious 2 exams (::; 1; randomly selected)

Conduct of Operations Core Performance Check RO/SROI R, M, D K/A 2.1.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation This is a banked modified Administrative JPM that will require the examinee perform 1PT-Oi.ii recognizing APRM GAF adjustment required. Modified to allow performance in a classroom setting and CMFLPD limit exceeded.

Conduct of Operations Drywell Average Air Temperature Calculation (RO Only)

R, M, P K/A 2.1.20 Ability to interpret and execute procedure steps This is a modified classroom Administrative JPM that will require the examinee perform OPT-i 6.2. Modified to allow performance in a classroom setting and values changed resulting in different answer. This JPM was used on one of the last two NRC exams (November 08) and was randomly selected for this exam.

Conduct of Operations Evaluate Refueling Technical Specifications (SRO-l Only)

R, P K/A 2.1.40 Knowledge of refueling administrative requirements This is a banked classroom Administrative JPM that requires the examinee to evaluate Technical Specifications to allow removal of Shutdown Cooling from operation during Refueling operations. This JPM was used on one of the last two NRC exams (April 08) and was randomly selected for this exam. Modified to include core alteration allowance.

Equipment Control RCC Clearance R, D K/A 2.2.13 Knowledge of tagging and clearance procedures This is a banked classroom Administrative JPM that will require the examinee identify Clearance Boundaries for RBCCW Pump 2C by completing Attachment 4 of OPS-NGGC-1 301.

Radiation Control Calculation of Stay Times R, M K/A 2.3.7 Ability to comply with radiation work permit requirements during normal and abnormal conditions This is a modified banked classroom Administrative JPM that will require the examinee to determine the total dose accumulated for two workers and if any Brunswick administrative dose limitations will be exceeded. Modified the values and area resulting in a different answer.

Emergency ProcedureslPlan Emergency Action Level Determinations (SRO-l Only)

R, M K/A 2.4.29 Knowledge of the Emergency Plan This is a modified banked classroom Administrative JPM that will require the examinee to classify an emergency per PEP-02.1. Modified to incorporate NEI 99-01 EALs.

p

)

Conduct of Operations Core Performance Check RO/SROI R, M, D KIA 2.1.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation This is a banked modified Administrative JPM that will require the examinee perform 1 PT-01.11 recognizing APRM GAF adjustment required. Modified to allow performance in a classroom setting and CMFLPD limit exceeded.

Conduct of Operations Drywell Average Air Temperature Calculation (RO Only)

R, M, P KIA 2.1.20 Ability to interpret and execute procedure steps This is a modified classroom Administrative JPM that will require the examinee perform OPT-16.2. Modified to allow performance in a classroom setting and values changed resulting in different answer. This JPM was used on one of the last two NRC exams (November 08) and was randomly selected for this exam.

Conduct of Operations Evaluate Refueling Technical Specifications (SRO-I Only) R, P KIA 2.1.40 Knowledge of refueling administrative requirements This is a banked classroom Administrative JPM that requires the examinee to evaluate Technical Specifications to allow removal of Shutdown Cooling from operation during Refueling operations. This JPM was used on one of the last two NRC exams (April 08) and was randomly selected for this exam. Modified to include core alteration allowance.

Equipment Control RCC Clearance R, D KIA 2.2.13 Knowledge of tagging and clearance procedures This is a banked classroom Administrative JPM that will require the examinee identify Clearance Boundaries for RBCCW Pump 2C by completing Attachment 4 of OPS-NGGC-1301.

Radiation Control Calculation of Stay Times R, M KIA 2.3.7 Ability to comply with radiation work permit requirements during normal and abnormal conditions This is a modified banked classroom Administrative JPM that will require the examinee to determine the total dose accumulated for two workers and if any Brunswick administrative dose limitations will be exceeded. Modified the values and area resulting in a different answer.

Emergency Procedures/Plan Emergency Action Level Determinations (SRO-I Only)

R, M KIA 2.4.29 Knowledge of the Emergency Plan This is a modified banked classroom Administrative JPM that will require the examinee to classify an emergency per PEP-02.1. Modified to incorporate NEI 99-01 EALs.

ES-301 Control Room!ln-Plant Systems Outline Form ES-301-2 Facility: Brunswick Date of Examination: April 2010 Exam Level: RO SRO-l Operating Test No.: Final Control Room Systems@ (8 for RO); (7 for SRO-l)

System I JPM Title Type Code*

Safety Function

a. Bypass a LPRM S, D 7

b. Restart RBHVAC with Failure to Isolate S, A, M 9

c. Place B Loop RHR in SPC lAW hard card NSW header failure S, A, P 5

d. Place HPCI in Pressure control S, A, P 3

e. Place UAT Backfeed in service S, D 6

f. Secure Main Turbine with failure of PCB to open S, A, N 4

g. SULCV in service after scram 5, L, D 2

h. (RO only) Restart CRD S, D 1

In-Plant Systems@ (3 for RO/S RD-I)

i. LEP-Ol Alternate Coolant Injection, SLC wI Fire Water R, M, E 2

j. Fire Pump power supply to alternate D, A 8

k. SAMA DG R, P, M, E 6

All RD and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RD I SRO-l I SRO-U (A)lternate path 4-6 I 4-6 I 2-3 (C)ontrol room (D)irectfrombank 91814 (E)mergency or abnormal in-plant 1 I 1 I 1

(EN)gineered safety feature

- I I 1 (control room system)

(L)ow-Power I Shutdown 1 /

1 /

1 (N)ew or (M)odified from bank including 1 (A) 2 I 2 /

1 (P)revious 2 exams 3 /

3 /

2 (randomly selected)

(R)CA (S)imulator ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Brunswick Date of Examination: April 2010 Exam Level: RO

• SRO-I.

Operating Test No.: Final Control Room Systems@ (8 for RO); (7 for SRO-I)

System I JPM Title Type Code*

Safety Function

a. Bypass a LPRM S,D 7

b. Restart RBHVAC with Failure to Isolate S,A, M 9

c. Place BLoop RHR in SPC lAW hard card - NSW header failure S,A, P 5

d. Place HPCI in Pressure control S,A, P 3

e. Place UAT Backfeed in service S,D 6

f. Secure Main Turbine with failure of PCB to open S,A, N 4

g. SULCV in service after scram S, L, D 2

h. (RO only) Restart CRD S,D 1

In-Plant Systems@ (3 for RO/SRO-I)

i. LEP-01 Alternate Coolant Injection, SLC wi Fire Water R,M,E 2

j. Fire Pump power supply to alternate D,A 8

k. SAMA DG R, P, M, E 6

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO 1 SRO-I 1 SRO-U (A)lternate path 4-6 1 4-6 1 2-3 (C)ontrol room (D)irect from bank S9/s8/s4 (E)mergency or abnormal in-plant

~1/~1/~1 (EN)gineered safety feature 1 ~1 (control room system)

(L)ow-Power 1 Shutdown

~1/~1/~1 (N)ew or (M)odified from bank including 1 (A)

~2/~2/~1 (P)revious 2 exams s 3 1 s 3 1 s 2 (randomly selected)

(R)CA

~1/~1/~1 (S)imulator

a.

Bypass a LPRM 215005 A2.02 Ability to predict impacts on APRM and based on those predictions, use procedures to correct, control or mitigate consequences of those abnormal conditions.

This is a banked simulator JPM that will require the examinee to bypass an LPRM.

b.

Restart RBHVAC with Failure to Isolate 288000 A3.01 Ability to monitor Plant Ventilation System automatic isolation/initiation signals in the control room This is a modified banked simulator JPM that will require the examinee to restart the RB Ventilation system. As an alternate path when the fans are started the high radiation condition alarm re-occur and the examinee will have to isolate the system.

c.

Place B Loop RHR in SPC lAW hard card NSW header failure 219000 A4.12 Ability to manually operate and/or monitor in the control room:

suppression pool temperature.

This is a banked simulator JPM that will require the examinee to place the B loop of RHR into SPC. As an alternate path they will have to use the conventional service water header. This is an engineered safety feature JPM. This JPM was used on one of the last two NRC exams (Nov. 08) and was randomly selected for this exam.

d.

Place HPCI in Pressure Control 295025 EA1.04 Ability to operate and/or monitor the following as they apply to High Reactor Pressure: HPCI (plant specific)

This is a banked simulator JPM that will require the examinee to place HPCI into pressure control mode of operation. As an alternate path there is a exhaust diaphragm failure. This JPM was used on one of the last two NRC exams (Nov. 08) and was randomly selected for this exam.

e.

Place UAT Backfeed in service 262001 A2.03 Use procedure to mitigate consequences of loss of off-site power.

This is a banked simulator JPM that will require the examinee energize 4 kV Bus from the UAT.

a. Bypass a LPRM 215005 A2.02 Ability to predict impacts on APRM and based on those predictions, use procedures to correct, control or mitigate consequences of those abnormal conditions.

This is a banked simulator JPM that will require the examinee to bypass an LPRM.

b. Restart RBHVAC with Failure to Isolate 288000 A3.01 Ability to monitor Plant Ventilation System automatic isolation/initiation signals in the control room This is a modified banked simulator JPM that will require the examinee to restart the RB Ventilation system. As an alternate path when the fans are started the high radiation condition alarm re-occur and the examinee will have to isolate the system.

c. Place BLoop RHR in SPC lAW hard card - NSW header failure 219000 A4.12 Ability to manually operate and/or monitor in the control room:

suppression pool temperature.

This is a banked simulator JPM that will require the examinee to place the B loop of RHR into SPC. As an alternate path they will have to use the conventional service water header. This is an engineered safety feature JPM. This JPM was used on one of the last two NRC exams (Nov. 08) and was randomly selected for this exam.

d.

Place HPCI in Pressure Control 295025 EA 1.04 Ability to operate and/or monitor the following as they apply to High Reactor Pressure: HPCI (plant specific)

This is a banked simulator JPM that will require the examinee to place HPCI into pressure control mode of operation. As an alternate path there is a exhaust diaphragm failure. This JPM was used on one of the last two NRC exams (Nov. 08) and was randomly selected for this exam.

e. Place UAT Backfeed in service 262001 A2.03 Use procedure to mitigate consequences of loss of off-site power.

This is a banked simulator JPM that will require the examinee energize 4 kV Bus from the UA T.

f.

Main Turbine Shutdown 245000 A2.01 Ability to predict impacts of a turbine trip on the Main Turbine Generator and Auxiliary Systems; and based on those predictions, use procedures to correct, control or mitigate consequences of those abnormal conditions.

This is a new simulator JPM that will require the examinee to shutdown the turbine. As an alternate path one of the PCBs will fail to auto open and the examinee will have to open the PCB manually.

g.

SULCV in service after scram 295001 A4.02 Ability to manually start/control a REP in the control room.

This is a banked low power simulator JPM that will require the examinee to place the Startup Level Control Valve in service, restart a Reactor Eeed Pump and restore RPV water level.

h.

(RO only) Restart CRD 201001 A2.01 Ability to predict the impact of a CRD pump trip on the CRD Hydraulic System and use procedures to correct, control or mitigate the consequences.

This is a banked simulator JPM that will require the examinee to restart the CRD system.

i.

LEP-Ol Alternate Coolant Injection, SLC w/ Fire Water 295031 EA1.08 Ability To Operate/Monitor Alternate Coolant Injection Systems.

This is an in-plant JPM that will require the examinee to simulate aligning Eire Water to the SLC pumps for alternate coolant injection per LEP-Ol. This JPM is performed in the RCA. This JPM was modified due to a plant modification incorporating a new connector to the fire water hose.

j.

Fire Pump power supply to alternate 286000 Al.05 Ability to predict and/or monitor changes in parameters associated with operating the Eire Protection System controls including: System lineups.

This is a banked in-plant JPM that will require the examinee to simulate the transfer of the Electric Eire Pump to its alternate power supply and start the Diesel Eire Pump locally with a battery failure and having to use the other battery as an alternate path.

k.

SAMA DG 295003 AAI.02 Ability to Operate and/or Monitor Emergency Generators as it applies to a Station Blackout This is a banked in-plant JPM that will require the examinee to simulate aligning the SAMA Diesel to a battery charger. This JPM is performed in the RCA. This JPM was modified due to a plant modification to the equipment. This JPM contains actions for a Station Blackout.

f.

Main Turbine Shutdown 245000 A2.01 Ability to predict impacts of a turbine trip on the Main Turbine Generator and Auxiliary Systems; and based on those predictions, use procedures to correct, control or mitigate consequences of those abnormal conditions.

This is a new simulator JPM that will require the examinee to shutdown the turbine. As an alternate path one of the PCBs will fail to auto open and the examinee will have to open the PCB manually.

g. SULCV in service after scram 295001 A4.02 Ability to manually start/control a RFP in the control room.

This is a banked low power simulator JPM that will require the examinee to place the Startup Level Control Valve in service, restart a Reactor Feed Pump and restore RPV water level.

h. (RO only) Restart CRD 201001 A2.01 Ability to predict the impact of a CRD pump trip on the CRD Hydraulic System and use procedures to correct, control or mitigate the consequences.

This is a banked simulator JPM that will require the examinee to restart the CRD system.

i.

LEP-01 Alternate Coolant Injection, SLC wi Fire Water 295031 EA 1. 08 Ability To Operate/Monitor Alternate Coolant I njection Systems.

This is an in-plant JPM that will require the examinee to simulate aligning Fire Water to the SLC pumps for alternate coolant injection per LEP-01. This JPM is performed in the RCA. This JPM was modified due to a plant modification incorporating a new connector to the fire water hose.

j.

Fire Pump power supply to alternate 286000 A 1.05 Ability to predict and/or monitor changes in parameters associated with operating the Fire Protection System controls including: System lineups.

k. SAMA DG 295003 AA 1.02 This is a banked in-plant JPM that will require the examinee to simulate the transfer of the Electric Fire Pump to its alternate power supply and start the Diesel Fire Pump locally with a battery failure and having to use the other battery as an alternate path.

Ability to Operate and/or Monitor Emergency Generators as it applies to a Station Blackout This is a banked in-plant JPM that will require the examinee to simulate aligning the SAMA Diesel to a battery charger. This JPM is performed in the RCA. This JPM was modified due to a plant modification to the equipment. This JPM contains actions for a Station Blackout.

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:

Date of Examination:

2cw Operating Test Number: --

Initials

1. General Criteria a

b*

c#

a.

The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b.

There is no day-to-day repetition between this and other operating tests to be administered during this examination.

U]

c.

The operating test shall not duplicate items from the applicants audit test(s). (see Section D. l.a.)

(2

• 2 d.

Overlap with the written examination and between different parts of the operating test is within acceptable limits.

e.

It appears that the operating test will differentiate between competent and less-than-competent iA applicants at the designated license level.

r k

2. Walk-Through Criteria a.

Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature

system response and other examiner cues

statements describing important observations to be made by lhe applicant

criteria for successful completion of the task

identification of critical steps and their associated performance standards

restrictions on the sequence of steps, if applicable b.

Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g. item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.

3. Simulator Criteria

The associated simulator operating tests (scenario sets) have been reviewed in accordance with

/

Form ES-301-4 and a copy is attached.

Printed Name / Signature Date a.

Author A

3c b.

Facility Reviewer()

LJ60,JAR ELL1.

c.

NRC Chief Examiner(#) JO kAt_L 330-/V d.

NRC Supervisor

£LoL 1

-...-i ti/t, NOTE:

The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301 Operating Test Quality Checklist Date of Examination:

1. General Criteria

a.

The operating test conforms with the previously approved outline; changes are consistent with samplin requirements (e..,10 CFR 55.45, operational im ortance, safet function distribution).

b.

There is no day-to-day repetition between this and other operating tests to be administered durin this examination.

c.

The 0 eratin test shall not du licate items from the a licants' audit testes). (see Section D.1.a.)

d.

Overlap with the written examination and between different parts of the operating test is within acceptable limits.

e.

It appears that the operating test will differentiate between competent and less-than-competent a

licants at the desi nated license level.

2. Walk-Through Criteria

a.

Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools. including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the se uence of ste s, if applicable

b.

Ensure that any changes from the previously approved systems and administrative walk*through outlines (Forms ES-301*1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES*301*4 and a cop is attached.

Printed Name / Signature

a.

Author

b.

Facility Reviewer(')

c.

NRC Chief Examiner (#)

d.

NRC Supervisor NOTE:

The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

Form ES-301-3 Date

ES-3d Simulator Scenario Quahty Checklist Form ES-301-4 Facilty:

Date of Exam:/j Scenario Numbers:

/ zf3ft(cOperating Test No.:

QUALITATIVE ATTRIBUTES Irshals

ac#

1.

The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events,

2.

The scenarios consist mostly of related events.

b 3.

Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew J3 the expected operator actions (by shift position) the event termination point (if applicable) 4.

No more than one non-mechanistic failure (e.g.. pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.

I 5.

The events are valid with regard to physics and thermodynamics.

2 -4? -

S.

Sequencing and timing of events is reasonable, and allows the examination team to obtain 1)2 LL complete evaluation results commensurate with the scenario objectives.

I 7.

Ii time compression techniques are used, the scenario summary clearly so indicates, Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

Lj..

8.

The simulator modeling is not altered.

j 9.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator

()

performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

10.

Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES3D1.

l ft 11.

All individual operator competencies can be evaluated, as verified using Form ES-301-6 ih (submit the form along with the simulator scenarios).

/

Yf) 12.

Each applicant will be significantly involved in the minimum number of transients and events 1h specified on Form ES-301-5 (submit the form with the simulator scenarios).

fri

13.

The level of difficulty is appropriate to suppo licensing decisions for each crew position.

j /2

/

/

Target Quantitative Attributes (Per Scenario; See Section D.5d)

Actual Attributes

1.

Total malfunctions (58)

, /

/ i/

/ q 2.

Malfunctions after EOP entry (12)

( / ( / 2.-) 2

.-f I,d (j_ ;Ø,(

3.

Abnormalevents(24) 3 /iti 3/3 4,

Major transients (12)

(

1/ i.-/

2.../

(

4?

5.

EOPs entered/requiring substantive actions (12) 2 /

/ 3 I 2_/ 3 S.

EOP contingencies requiring substantive actions (02)

/ 3 /

2 2-/ 3 7.

Critical tasks (23) 3 / Z1 3 / 2f 1

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facilty: '7:;'1 uVl ":. ~'" '<:. K Date of Exam: "t; /0 Scenario Numbers: i Il.l '3 {<fL~Operating Test No.: j::, '\\<\\ \\

QUALITATIVE ATTRIBUTES Initials a

b* ()

C#

1.

The initial conditions are realistic, in that some equipment and/or instrumentation may be out, ~ $(

of service, but it does not cue the operators into expected events,

2.

The scenarios consist mostly of related events.

Itb un, 1$<

3.

Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event 1fK.

the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

4.

No more than one non-mechanistic failure (e.g.. pipe break) is incorporated into the scenario

~ /iA without a credible preceding incident such as a seismic event.

5.

The events are valid with regard to physics and thermodynamics.

fib

~ ~

6.

Sequencing and timing of events is reasonable. and allows the examination team to obtain

/b M~ ~

complete evaluation results commensurate with the scenario objectives.

7.

If time compression techniques are used, the scenario summary clearly so indicates.

~l 1J(.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

8.

The simulator modeling is not altered.

fj)

~ 1M

9.

The scenarios have been validated. Pursuant to 10 CFR 55,46(d). any open simulator

.~ fP1i performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

10.

Every operator will be evaluated using at least one new or significantly modified scenario.

fh.~ IJ(

All other scenarios have been altered in accordance with Section 0.5 of ES-301.

11.

All individual operator competencies can be evaluated, as verified using Form ES-301-6

~ fit (submit the form along with the simulator scenarios).

12.

Each applicant will be significantly involved in the minimum number of transients and events J~ If 1JIt-specified on Form ES-301-5 (submit the form with the simulator scenarios).

13.

The level of difficulty is appropriate to support licenSing decisions for each crew position.

J,b i/11 fI1t Target Quantitative Attributes (Per Scenario; See Section D.S.d)

I ~ttua( Aftribut~/ S

1.

Total malfunctions (5-8) lCi 7 / S-/lv/l.i to tk 1M

2.

Malfunctions after EOP entry (1-2)

I l'if"1-1 2-/ I

/l~

It(

3.

Abnormal events (2-4)

J/!:,1Z- / 3/3 /Jf 1;1<...

4.

Major transients (1-2) i ( 2.. 1 1,-1 2.-1 I ;@

'1/JIt-

5.

EOPs enteredlrequiring sUbstantive actions (1-2) 2-I 2-1 "' 1 "-I 3 ;f5 U

6.

EOP contingencies requiring substantive actions (0-2) z.. { 3> 1 l-! "1-1.3 If!i_

7.

Critical tasks (2-3)

'3 I 7-1.3 I 7_1 2- ;!b

ES-301 Transient and Event Checklist Form ES-301-5 A

E Scenarios P

V 1

2 5

T M

L N

CREW CREW CREW CREW T

N I

T POSmON POSfl1ON POSITION POSITION A

C S

A B

S A

B S

A B

S A

B L

u A

T R

T 0

R T

0 R

T 0

R T

M(*

N y

0 C

P 0

C P

0 C

P 0

C P

T p

R IU E

ROl RX 1

1 1

10 SRO-l NOR 1

2 2

1 11 D

tic 2a, 7, 4,6, 4,6,9 8

4 4

2 SRO-U 8

D MAJ 6

7 5,8 4

221 TS 022 RX 3

1 1

10 RO 2

NOR 2

3 2

1 11 SRO-I I/C 3,4, 2,6, 1,5 8

4 4

2 D

5 7

RO-U MAJ 6

7 5,6 4

221 TS 022 j

3 RX

1 1

1 1

0 NOR 2

1 2

1 11 D

I/C 3,4, 4,6, 3a,7, 8

4 4

2 SRO-U 5

10 D

MAJ 6

7 5,8 4

221 TS 022 4RVRX 1

1 1

10 SRO-I NOR 21 2111 I/C 3,4, 4,6, 3a,7, 8

4 4

2 SRO-U 5

10 D

MAJ 6

7 5,8 4

221 TS 022 instructions:

Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.

If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2.

Reactivity manipulations may be conducted under normal or contmlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

D ility:

3 LiS DateofExam:

OperatingTestNo.:

ES-301 Transient and Event Checklist Form ES-301-5 ility: o,vV\\.sw ILL Date of Exam:

1\\-",,...: \\

Lo!.::>

Operating Test No.: or:,,,-c.. \\

A E

Scenarios P

V 3

1 2

T P

E 5

M 0

I L

N CREW CREW CREW CREW T

N I

T POSITION POSITION POSITION POSITION A

I C

M S

A B

S A

B S

A B

S A

B L

A T

R T

0 R

T 0

R T

0 R

T 0

u N

y 0

C P

0 C

P 0

C P

0 C

P M(*)

T P

R I

U E

RO 1 RX 1

1 1

1 0

II NOR 1

2 2

1 1

1 SRO-I D

IIC 2a,7, 4,6, 4,6,9 8

4 4

2 SRO-U 8

D MAJ 6

7 5,8 4

2 2

1 TS 0

2 2

RX 3

1 1

1 0

RO 2

NOR 2

3 2

1 1

1 SRO-I I/C 3,4, 2,6, 1,5 8

4 4

2 D

5 7

~RO-U J

MAJ 6

7 5,6 4

2 2

1 TS 0

2 2

P-() 3 RX 1

1 1

1 0

.1

__ 1 SRO-I NOR 2

1 2

1 1

1 D

I/C 3,4, 4,6, 3a,7, 8

4 4

2 SRO-U 5

10 D

MAJ 6

7 5,8 4

2 2

1 TS I

0 2

2 li4RO RX 1

1 1

1 0

SRO-I NOR 2

1 2

1 1

1 D

I/C 3,4, 4,6, 3a,7, 8

4 4

2 SRO-U 5

10 D

MAJ 6

7 5,8 4

2 2

1 TS 0

2 2

instructions:

1.

Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)"

positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 iIity:

Date of Exam: tsci Zo. b Operating Test No.:

3 A

P P

L C

A N

T E

V E

N T

T Y

P E

1 Scenarios 2

CREW CREW CREW CREW POSITION POSITION POSITION POSITION 5

S A

B S

A B

S A

B S

A B

R T

0 R

T 0

R T

0 R

T 0

0 C

P 0

C P

0 C

P 0

C P

T 0

T A

L M

N M

U M(*)

R U

RO RX 1

1 3

3 110 NOR 2

2 2

iii I/C 2a,3, 3,3a, 4,7 15 4

4 2

0-U 4,5,7, 4,6,7, 8

9,10 MAJ 6

5,8 5,6 5

2 2

1 TS 3

3 2

022 RO RX 3

1 3

3 1

10 NOR 1

3 2

1 11 SROI 2 I/C 2,4,5, 3a,7, 1,4,5, 12 4

4 2

I.

6,7 10 7

SR0-U MAJ 7

8 6

5 221 TS 2,5 1,4 4

0 2

2 0-I3 NOR 2

I/C 2a,3, 2,6, 3,3a, 16 4

4 2

SRO-U 4,5,7, 7

4,6,7, 8

9,10 MAJ 6

7 5,8 4

221 TS 3

3 2

022 SPO-14 NOR 1

22+/-+/-i I/C 2a, 7, 2,4,5, 4,6,9 11 4

4 2

SRO-U 8

6,7 MAJ 6

7 5,8 4

221 TS 2,5 2

022 NOR 2

I/C 2a,3, 2,6, 3,3a, 16 4

4 2

SRO-U

,5,7,

/

I6,7, D

MAJ 6

7 5,8 4

221 TS 3

3 2

022 RX 1

3 2

1 10 NOR 1

2 2

1 11 SROI 6 I/C 2a, 7, 2,4,5, 4,6,9 11 4

4 2

J; 5,7 SRO-U MAJ 67

8422i

TS 2,5 2

0 2

2

$c. \\\\)

ES-301 Transient and Event Checklist Form ES-301-5

~--" 'sility: 6 I-v V\\ 'S "" \\ C. k-Date of Exam: f\\ry{L\\L.. Z-O\\b Operating Test No,: 1=,A.( ITL A

E Scenarios P

V 3

1 2

5 T

M P

E 0

I L

N CREW CREW CREW CREW T

N I

T POSITION POSITION POSITION POSITION A

I C

S A

B S

A B

S A

S M

B A

B L

U A

T R

T 0

R T

0 R

T 0

R T

0 M(*)

N Y

0 e

p 0

e p

0 e

p 0

e p

T P

R I

U E

RO RX 1

1 3

3 1

1 0

D NOR 2

2 2

1 1

1 SRO-11 II lie 2a,3, 3,3a, 4,7 15 4

4 2

SRO-U 4,5,7, 4,6,7, D

8 9,10 MAJ 6

5,8 5,6 5

2 2

1 TS 3

3 2

0 2

2 RO RX 3

1 3

3 1

1 0

D NOR 1

3 2

1 1

1 SRO-12 lIe 2,4,5, 3a,7, 1,4,5, 12 4

4 2

II 6,7 10 7

SRO-U MAJ 7

5,8 5,6 5

2 2

1 1

TS 2,5 1,4 4

0 2

2 RO RX 1

3 1

3 1

1 0

D NOR 2

2 SRO-13 2

1 1

1

.1 lIe 2a,3, 2,6, 3,3a, 16 4

4 2

~

4,5,7, 7

4,6,7, SRO-U D

8 9,10 MAJ 6

7 5,8 4

2 2

1 TS 3

3 2

0 2

2 RO RX 1

3 2

1 1

0 D

NOR 1

2 2

1 1

1 SRO-14 I.

lIe 2a,7, 2,4,5, 4,6,9 11 4

4 2

L:i SRO-U 8

6,7 D

MAJ 6

7 5,8 4

2 2

1 TS 2,5 2

0 2

2 RO RX 1

3 1

3 1

1 0

D NOR 2

2 2

1 1

1 SRO-15

• lIe 2a,3, 2,6, 3,3a, 16 4

4 2

SRO-U

~,5,7, 7

4,6,7, D

~

9,10 MAJ 6

7 5,8 4

2 2

1 TS 3

3 2

0 2

2 RX 1

3 2

1 1

0

<0 D

NOR 1

2 2

1 1

1 SRO-16 lIe 2a,7, 2,4,5, 4,6,9 11 4

4 2

8

~,7 SRO-U MAJ 6

7 5,8 4

2 2

1 D

TS 2,5 2

0 2 2

ES-301 Competencies Checklist Form ES-301 -6 I

Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLI CANTS ROl 1

R02 R

RO3 1

R04

• SRO-l El SRO-I El SRO-l El SRO-l El SRO-U El SRO-U El SRO-U El SRO-U El Competencies SCENARIO 312 31 5312531 2

Interpret/Diagnose Events 25 4,6, 4,5 3,4 2,6, 1,5 3,4 4,6, 37 3,4 4,6,7, 37 and Conditions 8

9 6

6 6

Comply With and 1,

1,4, 2,4 2,3 2,3, 1,3 2,3 1,4, 1,3a 2,3 1,4,6, 1,3a 2a,5 6,7, 5,

4, 6,7, 5,

4, 6,7, 5,7, 4,

7,8 5,7, Use Procedures (1) 6,7, 8

6,9 5,6 8

6 5,6 8

8,10 5,6 8,10 8

,12 12

12

1,4, 2,3, 1,4, 1,4,6, Operate Control 1,

6,7, 2,4 2,3 6,7, 1,3 2,3 6,7, 1,3a 2,3 7,8 1,3a 2a,5 8

5 8

5 4

8 57 5,7, Boards (2) 6,7, 6,9 5,6 6

5,6 8,10 5,6 8,10 8

12

,9

,9 12

,9 12 Communicate All All All All All All All All All All All All and Interact

Demonstrate Supervisory Ability (3)

Corn ply With and I

Use Tech. Specs. (3)

Notes:

(1)

Includes Technical Specification compliance for an RO.

(2)

Optional for an SRO-U.

(3)

Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLICANTS R01 II]

R02

• SRO-I D

SRO-I D

SRO-U D SRO-U D Competencies SCENARIO SCENARIO InterpretlDiagnose Events and Conditions Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact Demonstrate Supervisory Abilit (3)

Comply With and Use Tech. Specs. (3) 3 1

2a,5 4,6,

,6,7, 7,8 8

1, 1,4, 2a,5 6,7,

,6,7, 8

8 1,4, 1,

6,7, 2a,5 8

,6,7, 8

All All Notes:

(1 )

(2)

Includes Technical Specification compliance for an RO.

Optional for an SRO-U.

(3)

Only applicable to SROs.

Instructions:

R03 SRO-I SRO-U 3

1 3,4 4,6,

,5, 7,8 6

2,3 1,4,

,4, 6,7, 5,6 8

1,4, 2,3 6,7,

,4, 8

5,6

,9 All All D

D R04 II]

SRO-I "0 SRO-U D Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301 Competencies Checklist Form ES-301-6 Competencies Interpret/Diagnose Events 23 and Conditions 8

Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact Demonstrate Supervisory All Ability (3)

Comply With and Use Tech.

Specs.

(3)

=

Notes:

(1)

(2)

(3)

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate even, applicable competency for every applicant.

V Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLICANTS RO El RO El RO El RO El SRO-I1 U

SRO-12 B]

SRO-I3 SRO-I4 B SRO-U El SRO-U El SRO-U El SRO-U El SCENARIO i25 3,4,5, 6,7,9, 47 10 SCENARIO SCENARIO SCENARIO All All 3,4,5, 6,7 3,4,5, 6,7 1

2 5

3 1

2 5

3 12 3,4, 2,3,4, 3a,7 1,4, 2a,3 2,6 56 2a, 2,3,4, 4,5, 5,6,7, 10 5,7 4,5, 7,

79 5,6 5,6,7, 6,9 8

6,7, 8

10 7,

8 8

8 All 1 3a All All 2 3 All 1

All 2 4 5,7,

,6, 2a, 5,6, 8,10 7,8 5,6 9,12 12 7,

8 2,3 6,

Ii 7,8 I 2a, I 5,6 I

7 8

All All All All All All All 1,3a 5,7, 8,10 12 All All All All All All All All ZE 3

3 II 2,5 Includes Technical Specification compliance for an RO.

Optional for an SRO-U.

Only applicable to SROs.

ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLICANTS RO D

RO D

RO D

RO D

SRO-11

• SRO-12.-

SRO-13.'

SRO-14

• SRO-U D SRO-U D SRO-U 0" SRO-U 0 Competencies SCENARIO SCENARIO SCENARIO SCENARIO 3

1 2

5

3.

1 2

5 3

1 2 5 3 1

2 ?5**

......,; 3,4,5, I.

3,4, I~~

.* i:

I nterpretlDiagnose Events 2a,3 :; 6,7,9, 4,7 1<

2,3,4, 3a,7 1,4, 2a,3 2,6 5,6, 2a, 2,3,4, 4,5, Y~1 and Conditions

,4,5, 10

'. 5,6,7,

,10 5,7

,4,5,

,7, 7,9, 5,6 5,6,7, 6,9 6,7,

.:\\

I;::

8 6,7, 8

10

,7, 8

8 8

8 iit:

I**,**.**

I'!l~);i

",i f

Comply With and All All 3,4,5, All 1,3a All All 2,3 All 1,

All 2,4,

~l"i':

6,7

,5,7,

,6, 2a, 5,6, Use Procedures (1)

I:

8,10 7,8

,,} 5,6 9,12 ;/j Ii;.,

,12

,7,

):i I,

8 Ii*

• .*.**..... '\\

<.. i

!i:;"X:

".0/ 2,3 ;f,;,t I/,i, i~'1 Ij Operate Control

.,.. }

3,4,5, 1,3a

)~~~.:.::~

,6, 1,

2,4,

,; 6,7

,5,7, 7,8 I i;;iil~~

2a, 5,6, Boards (2)

..** :?

.. *i.,

I, 8,10 5,6 9,12

"';'0'

,12

,7, J

I:':*.. *.

... *Ii.:

'i'

'~

8 Ii:'

I *********

![~.~.::

I...,'"

..*..... ),':

L"

.. }

,.1 1

• • ,.****./

./'

Alit",,','

1" Communicate All All All All All All All All All All All k:

and Interact 1'.<

I',:'

All All All

'.1:<

All All

.. :i....

All

{p' ','

All I;ty~~

I,*'

Demonstrate Supervisory

{i; It::::

Ability (3)

',:).

./.)

~

l";

ii~

I)~'L I:!\\~!"[

Comply With and 3 :t.

3 2,5 1,4 3

3 2,5

,;i:~

,'~.;

1:;('

Use Tech. Specs. (3)

Notes:

(1)

Includes Technical Specification compliance for an RO.

(2)

Optional for an SRO-U.

(3)

Only applicable to SROs.

Instructions:

Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLICANTS RD LI RD LI RD El RD El SRO-15 :

SRD-16 SRO-l LI SRD-I LI SRD-U El SRD-U El SRD-U LI SRD-U LI Competencies SCENARIO SCENARIO SCENARIO SCENARIO 31 2531 2512341234 Interpret/Diagnose Events 2a,3 2,6, 3,4,5, 2a, 2,3,4, 4,5, 4 5, 7,8 6,7,9, 5,6 5,6,7, 6,9 and Conditions 6,7, 10 7,

8 8

8 Comply With and All 2,3, All 1,

All 2,4, 6,7, 2a, 5,6, Use Procedures (1) 8 5,6 9,12 7,

8 2,3, Operate Control 6,7, 1,

2,4, 8

2a, 5,6, Boards (2) 5,6 9,12

.7, 8

Communicate All All All All All All and Interact Demonstrate Supervisory All All All Ability (3)

Comply With and 3

3 2,5 Use Tech. Specs. (3)

Notes:

(1)

Includes Technical Specification compliance for an RO.

(2)

Optional for an SRO-U.

(3)

Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: April 2010 Operating Test No.: FINAL APPLICANTS RO D

RO D

RO D

RO D

SRO-15

• SRO-16

• SRO-I D

SRO-I D

SRO-U 0' SRO-U D SRO-U D SRO-U D Competencies SCENARIO SCENARIO SCENARIO SCENARIO 3

1 2

5 3

1 2

5:

1 2

3 4

1

,',/

I nterpret/Diagnose Events 2a,3 2,6, 3,4,5,

2a, 2,3,4, 4,5, and Conditions

,4,5, 7,8 6,7,9,..

',', 5,6 5,6,7, 6,9 :,:.

6,7, 10

,7, 8

8 8

Comply With and All 2,3, All 1,

All 2,4, "

Use Procedures (1) 6,7, 2a, 5,6, 8

5,6 9,12

,7, 8

2,3, I

Operate Control 6,7, 1,

2,4, >'

Boards (2) 8 2a, 5,6, 5,6 Iii!

9,12

,7,

'., ;:r.,

8 i"

I

)

./,

Communicate All All All All All All and Interact Supervisory All All All Demonstrate Ability (3)

I*'

I"'"

Comply With and 3

3 2,5 Use Tech. Specs. (3)

Notes:

(1 )

Includes Technical Specification compliance for an RO.

(2)

Optional for an SRO-U.

(3)

Only applicable to SROs.

Instructions:

Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

2 3

4

ES-401, Rev. 9 BWR Examination Outline Form ES-401 -1 Facility:

BRUNSWICK Date of Exam: APRIL 2010 RO K/A Category Points SRO-Only Points Tier Group KXKKKKAAAAG A2 G*

Total 1

2 3

4 5

6 1

2 3

4 Total i.

4 3

3

=

4 3

20 3

4 7

Emergency &

2 2

1 1

7 1

2 3

Abnormal Plant

N/A

N/A

Evolutions Tier Totals

=

=

=

27 6

10 3

2 3

2 2

3 3

3 2

1 2

2 2

3 5

2.

2 1

1 1

11 1

21 1

1 1

12 0

1 2

3 Plant

Systems Tier Totals 3

3 4

5 4

3 2

3 38 3

5 8

3. Generic Knowledge and Abilities 1

2 3

4 10 1

2 3

4 7

Categories 3

3 2

2 2

2 1

2 1.

Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tior Totals in each K/A category shall not be less than two).

2.

The point total for each group and tier in the proposed outline must match that specified in the table.

The final point total for each group and tier may deviate by ii from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3.

Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to ES-401, Attachment 2, for guidance regarding the elimination of inappropriate K/A statements, 4.

Select topics from as many systems and evolutions as possible; sample eery system or evolution in the group before selecting a second topic for any system or evolution.

5.

Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6.

Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.

7.

The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system.

8.

On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note

1. I does not apply).

Use duplicate pages for RO and SRO-only exams.

9.

For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 5543.

• -------~-."~-

ES-401, Rev. 9 BWR examination Outline Form ES-401*1 Facility:

BRUNSWICK Date of Exam: APRIL 2010 RO KIA Category Points SRO-Only Points r

Tier Group K

K K

K K

K A

A A

A G

A2 G*

Total 1

2 3

4 5

6 1

2 3

4 Total

1.

1 4

3 3

4 3

3 20 3

4 7

Emergency &

2 1

1 1

2 1

1 7

1 2

3 Abnormal Plant N/A N/A Evolutions Tier Totals 5

4 4

6 4

4 27 4

6 10 1

3 2

3 2

2 3

3 3

2 1

2 2El

• 2 3

5

2.

1 1

1 1

1 1

2 1

1 1

1 12 0

1 2

3 Plant 2

Systems Tier Totals 4

3 4

3 3

4 5

4 3

2 3

38 3

5 8

3. Generic Knowledge and Abilities 1

2 3

4 10 1

2 3

4 7

Categories 3

3 2

2 2

2 1

2

1.

Ensure that at least two topics from every applicable KIA category are sampled within each tier of the RO and SRO-only outlines (Le.* except for one category in Tier 3 ofthe SRO-only outline. the "Tier Totals' in each KIA category shall not be less than two).

2.

The point total for each group and tier in the proposed outline must match that specified in the table.

The final point total for each group and tier may deviate by +/- 1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3.

Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to ES-401. Attachment 2. for guidance regarding the elimination of inappropriate KIA statements.

4.

Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.

5.

Absent a plant-specific priority. only those KIAs having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6.

Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categories.

7.

• The generic (G) KIAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog. but the topics must be relevant to the applicable evolution or system.

8.

On the following pages, enter the KIA numbers. a brief description of each topic, the topics' importance ratings (IRs) for the applicable license level. and the point totals (#) for ~ach system and category. Enter the group and tier totals for each category in the table above; iffuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam. enter it on the left side of Column A2 for Tier 2. Group 2 (Note

1. 1 does not apply). Use duplicate pages for RO and SRO-only exams.

9.

For Tier 3. select topics from Section 2 of the KIA catalog. and enter the KIA numbers. descriptions. IRs.

and point totals (#) on Form ES-401-3. limit SRO selections to KIAs that are linked to 10 CFR 55.43.

FORM ES-401-1 Ability to determine operability and/or availability of safety related equipment ES-401, REV 9 I-Z)

TIGI BWR EXAMINATION OUTLINE KA NAME! SAFETY FUNCTION:

JR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G

TOPIC:

RO SRO 295001AK1.03 Partial or Complete Loss of Forced 3.6 4.1 El Thermal limits Core Flow Circulation / 1 & 4 295003AA2.05 Partial or Complete Loss of AC! 6 3.9 4.2 Whether a partial or complete loss of A.C. power has occurred 295004AA1 02 Partial or Total Loss of DC Pwr / 6 3.8 4.1 El El El El Systems necessary to assure safe plant shutdown 295005AA1.07 Main Turbine Generator Trip I 3 3.3 3.3 El fl A.C. electrical distribution 295006AK1.02 SCRAM / 1 3.4 3.7 fl El El ElE2 El El El El El Shutdown margin 295016G2.4.1 Control Room Abandonment / 7 4.6 4.8 LI El LI El El El El El El El KnoMedge of EOP entry conditions and immediate action steps.

295O18A1.02 Partial or Total Loss of CCW / 8 3.3 3.4 El El El El El El El El El System loads 295019G2.2.37 Partial or Total Loss of Inst. Air! 8 3.6 4.6 fl El Ability to determine operability and/or availability of safety related equipment 295021M2.02 Loss of Shutdown Cooling 14 3.4 3.4 El El El El El El fl fl fl El RHR/shutdown cooling system flow 295023AK3.03 Refueling Acc Cooling Mode / 8 3.3 3.6 El El El El El El El El El El Ventilation isolation 295024G2.2.37 High Drywell Pressure! 5 3.6 4.6 El El El El El El El El El El Page 1 of 2 06/18/2009 8:52 AM ES-401, REV 9 KA NAME / SAFETY FUNCTION:

295001AK1.03 Partial or Complete Loss of Forced Core Flow Circulation 11 & 4 295003AA2.05 Partial or Complete Loss of AC 16 295004AA1.02 Partial or Total Loss of DC Pwr 16 295005AA 1.07 Main Turbine Generator Trip I 3 295006AK1.02 SCRAM 11 295016G2.4.1 Control Room Abandonment! 7 295018AA 1.02 Partial or Total Loss of CCW I 8 295019G2.2.37 Partial or Total Loss of Ins!. Air 18 295021AA2.02 Loss of Shutdown Cooling 14 295023AK3.03 Refueling Acc Cooling Mode I 8 295024G2.2.37 High Drywell Pressure I 5 R-V T1G1 BWR EXAMINATION OUTLINE FORM ES-401-1 IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 3.6 4.1 21 0 [] 0 0 0 0 0 0 0 0 Thermal limits........................................

3.9 4.2 0 0 0 0 0 0 0 21 0 0 0 Whether a partial or complete loss of A.C. power has 3.8 4.1 0 [] 0 0 0 ~ 0 0 0 0 3.3 3.3 0 0 [] 0 C 0 ~ 0 0 0 0 3.4 3.7

~ 0 0 0 0 0 0 0 0 0 0 4.6 4.8 0 0 0 0 0 0 0 0 0 0 21 3.3 3.4 0 0 0 0 0 [] ~ 0 0 0 0 3.6 4.6 0 DO 0 0 0 0 0 0 0 21 3.4 3.4 0 0 0 0 0 0 0 ~ COD 3.3 3.6 0 0 ~ 0 0 0 0 0 0 0 0 3.6 4.6 0 0 0 0 0 0 0 0 0 0 21 Page 1 of 2 occurred..............................................

Systems necessary to assure safe plant shutdown.......

A.C. electrical distribution..........................

Shutdown margin.......................................

Knowledge of EOP entry conditions and immediate action steps.

System loads..........................................

Ability to detennine operability andlor availability of safety related equipment RHRlshutdown cooling system flow Ventilation isolation.................................

Ability to detennine operability andlor availability of safety related equipment 06118/2009 8:52 AM

Generator Voltage and Electric Grid 3.3 D D Distrurbancecs TIGI BWR EXAMINATION OUTLINE ES-401, REV 9 FORM ES-401-1 KA NAME / SAFETY FUNCTION:

IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 295025EA2.05 High Reactor Pressure / 3 3.4 3.6

[}

E Decay heat generation 295026EA1.01 Suppression Pool High Water Temp. /

4.1 4.1 Suppression pool cooling 5

295028EK3.05 High Drywell Temperature / 5 3.6 3.7 fl fl fl Reactor SCRAM 295030EK2.09 Low Suppression Pool Wtr Lvi /5 2.5 2.8 SPDS/ERIS/CRIDS/GDS: Plant-Specific 295031 EK3.03 Reactor Low Water Level? 2 4.1 4.4 Spray cooling 295037EK1.03 SCRAM Condition Present and Power 4.2 4.4 D fl Boron effects on reactor power (SBLC)

Above APRM Downscale or Unknown

/1 295038EK2.12 High Off-site Release Rate / g 3.5 3.8 Feedwater leakage control: BWR-6

-Lu* Z95o to 600000AK2.01 Plant Fire On Site / 8 2.6 2.7 LI LI LI Sensors / detectors and valves 700000AK1.02 Over-excitation LILILILI Page 2 of 2 06/18/2009 8:52 AM fGV ES*401, REV 9 T1G1 BWR EXAMINATION OUTLINE KA NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2. A3 A4 G RO SRO 295025EA2.05 High Reactor Pressure I 3 3.4 3.6 0 0 0 0 0 0 0 ~ 0 0 0 295026EA1.01 Suppression Pool High Water Temp. I 4.1 4.1 0 0 0 0 0 0

~ 0 0 5

o 295028EK3.05 High Drywell Temperature 15 3.6 3.7 0 0 ~ 0 0 0 0 0 0 0 0 295030EK2.09 Low Suppression Pool Wtr Lvi I 5 2.5 2.8 0 ~ 0 0 0 0 0 0 0 0 0 295031 EK3.03 Reactor Low Water Level I 2 4.1 4.4 0 0 ~ 0 0 0 0 0 0 0 0 295037EK1.03 SCRAM Condition Present and Power 4.2 4.4

~ 0 0 0 0 0 0 0 0 0 0 Above APRM Downscale or Unknown I 1 295038EK2.12 High Off-site Release Rate 1 9 600000AK2.01 Plant Fire On Site 1 8

• 700000AK1.02 Generator Voltage and Electric Grid Distrurbancecs 3.5 3.8 0 ~ 0 0 0 0 0 0 0 0 0 rLe-~ '2'15 o3g

~~dO 2.6 2.7 0 ~ 0 0 0 0 0 0 0 0 0 3.3 3.4

~ 0 0 0 0 0 0 0 0 0 0 Page 2 of2 FORM ES-401*1 TOPIC:

Decay heat generation...........................,.....

Suppression pool cooling..............................

Reactor SCRAM.........................................

SPDS/ERIS/CRIDS/GDS: Plant-Specific..................

Spray cooling.........................................

Boron effects on reactor power (SBLC).................

Feedwater leakage control: BWR-6.....................

N/A Sensors 1 detectors and valves Over-excitation 06/18/2009 8:52 AM

ES-401, REV 9 KA NAME / SAFETY FUNCTION:

295008AK1.01 High Reactor Water Level 1 2 295014AA03 Inadvertent Reactivity Addition I I 295015AK3.01 Incomplete SCRAM / I 295020G2.4.1 Inadvertent Cont. Isolation / 5 & 7 295032EK2.02 High Secondary Containment Area Temperature I 5 295033EA1.05 High Secondary Containment Area Radiation Levels / 9 295035EA1.01 Secondary Containment High Differential Pressure / 5 FORM ES-401-1 TOPIC:

Moisture carryover Cause of reactivity addition Bypassing rod insertion blocks Knowtadge of EOP entry conditions and immediate action steps.

Secondary containment ventilation Affected systems so as to isolate damaged portions....

Secondary containment ventilation system RD T1G2 BWR EXAMINATION OUTLINE IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G

SRO 3.2 3.7 4.8 3.7 4.0 3.6 RO 3.0 4.0 3.4 4.6 3.6 3.9 3.6 Page 1 of 06/18/2009 8:52 AM ES*401, REV 9 KA NAME / SAFETY FUNCTION:

295008AK1.01 High Reactor Water Levell 2 295014AA2.03 Inadvertent Reactivity Addition 11 295015AK3.01 Incomplete SCRAM 11 295020G2.4.1 Inadvertent Cont. Isolation I 5 & 7 295032EK2.02 High Secondary Containment Area Temperature 15 295033EA 1.05 High Secondary Containment Area Radiation Levels I 9 295035EA1.01 Secondary Containment High Differential Pressure I 5 RD T1G2 BWR EXAMINATION OUTLINE IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO 3.0 3.2

~ 0 0 0 0 0 0 0 0 0 0 4.0 4.3 0 0 0 0 0 0 0 ~ 0 0 0 3.4 3.7 0 0 ~ 0 0 0 0 0 0 0 0 4.6 4.8 0 0 0 0 0 0 0 0 0 0 ~

3.6 3.7 0 ~ 0 0 0 0 0 0 0 0 0 3.9 4.0 0 0 0 0 0 0 ~ 0 0 0 0 3.6 3.6 0 0 0 0 0 0 ~ 0 0 0 0 Page 1 of 1 FORM ES-401*1 TOPIC:

Moisture canyover....................................

Cause of reactivity addition..........................

Bypassing rod insertion blocks........................

Knowledge of EOP entry conditions and immediate action steps.

Secondary containment ventilation.....................

Affected systems so as to isolate damaged portions....

Secondary containment ventilation system..............

06/18/2009 8:52 AM

RD T2GI BWR EXAMINATION OUTLINE FORM ES-401-1 ES-401, REV 9 KA NAME I SAFETY FUNCTION:

IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 203000K1.01 RHRILPCI: Injection Mode 2.8 2.8 E

Li Li Li Li LI []

Condensate storage and transfer system: Plant-Specific

çthd oooo ioz 205000G2421 Shutdown Cooling 4.0 4.6 Li Knowledge of the parameters and logic used to assess the status of safety functions 206000K4.02 HPCI 3.9 4

Li fl System isolation: 8WR-23,4 209001 K3.01 LPCS 3.8 3.9 Li Li Li Li Li Li Li Li Li Li Reactor water level 209001K303 LPCS 2.9 3.0 Li Li Li Fj Li Li Li Li Li Li Emergency generators 211000K101 SLC 3.0 3.3 Core spray line break detection: Plant-Specific 211000K109 SLC 3.2 3.4 Li Li Li Li Li Li Li Li Li Li Core spray system: Plant-Specific st-C, k/iV CcLt4J 4ooo Lo7 212000K2.01 RPS 3.2 3.3 Li Li Li Li Li Li Li Li Li Li RPS motor-generator sets 215003A2.02 IRM 3.5 3.7 Li Li Li Li Li Li Li [] Li Li Li IRM mop condition 215004K5.03 Source Range Monitor 2.8 2.8 Li Li Li Li Li Li Li Li Li Li Changing detector position 215005A2.05 APRM / LPRM 3.5 3.6 Li Li Li Li Li Li Li Li Loss of recirculation flow signal Page 1 of 3 06/1812009 8:52 AM ES-401, REV 9 KA NAME I SAFETY FUNCTION:

203000K1.01 RHRlLPCI: Injection Mode 20S000G2.4.21 Shutdown Cooling 206000K4.02 HPCI 209001 K3.01 LPCS 209001K3.03 LPCS 211000K1.01 SLC 211000K1.09 SLC

~

G~ K./Ais 212000K2.01 RPS 21S003A2.02 IRM 21S004K5.03 Source Range Monitor 21S005A2.05 APRM I LPRM

<<.0 T2G1 BWR EXAMINATION OUTLINE IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO 2.8 2.8

~ 0 0 0 [J [J 0 0 0 0 0 iU.-~deJ ~03000 K 1.0'2..

4.0 4.6 0 0 0 [] [J 0 0 0 0 0 ~

3.9 4

DDD21DDODDDD 3.8 3.9 0 0 ~ 0 0 0 0 0 0 0 0 2.9 3.0 0 0 ~ 0 0 0 0 0 0 0 0 3.0 3.3

~ 0 0 0 0 0 0 0 0 0 0 FORM ES-401-1 TOPIC:

Condensate storage and transfer system: Plant-Specific

,JjJ4 Knowledge of the parameters and logic used to assess the status of safety functions System isolation: BWR-2.3,4 Reactor water level Emergency generators Core spray line break detection: Plant-Specific 3.2 3.4

~ 0 0 0 0 0 0 0 0 0 0 Core spray system: Plant-Specific (e,-~d!-J ~(P4DO{) K I.01 3.2 3.3 D ~ 0 0 0 0 0 0 0 0 0 RPS motor-generator sets 3.5 3.7 0 0 0 0 0 0 0 ~ 0 0 0 IRM inop condition 2.8 2.8 nOD' 0 ~ 0 0 0 0 0 0 Changing detector position 3.5 3.6 0 0 0 0 0 0 0 ~ 0 0 []

Loss of recirculation flow signal Page 1 of 3 06/18/2009 8:52 AM

Ability to identify post-accident instrumentation.

piI frr\\UfS T2GI BWR EXAMINATION OUTLINE FORM ES-401-i ES-401, REV 9 KA NAME / SAFETY FUNCTION:

IR 1(1 1(2 K3 1<4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 215005A2.07 APRM / LPRM 3.2 3.4

[] []

[] [J Recirculation flow channels flow mismatch flice lc)ooc

?LO 217000k1Oi RCIC 3.7 3.7 jj J RCIC flow 217000A1.04 RCIC 3.6 3.6 Reactor pressure 2180001(3.01 ADS

4.4 4.4 Restoration of reactor water level aftera break that does not depressurize the reactor when required 223002A3.03 PCISINuclear Steam Supply Shutoff 2.5 2.8 D

fl J

SPDS/ERIS/CRIDS/GDS: Plant-Specific 239002A4.04 SRVs 4.3 4.3 LI LI Suppression pool temperature 259002K6.04 Reactor Water Level Control 3.1 3.1 LI LI LI LI LI LI LI LI LI LI Reactor feedwater flow input 261000A3.01 SGTS 3.2 3.3 LI LI [] LI LI LI fl LI LI fl System flow 2620011<6.01 AC EctricaI Distribution 3.1 3.4 fl fl fl H D.C. power 262001K6.02 AC Electrical Distribution 3.6 3.9 LI LI LI LI LI LI LI LI LI LI Off-site power 262002G2.4.3 UPS (AC/DC) 3.7 39 LI LI LI LI LI LI LI LI LI LI F fl-th 0

A 2oO &,.:L4 )

Page 2 of 3 06/18/2009 8:52 AM RO ES-401, REV 9 T2G1 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2. A3 A4 G TOPIC:

RO SRO 215005A2.07 APRM / LPRM 3.2 3.4 0 0 0 0 0 0 0 ~ 0 0 0 Recirculation flow channels flow mismatch (k-~ ;;{IS DDS-A;;t.04-217000A1.01 RCIC 3.7 3.7 0 0 0 0 0 0 ~ 0 0 0 0 217000A1.04 RCiC 3.6 3.6 0 0 0 0 0 0 ~ 0 0 0 0 218000K3.01 ADS 4.4 4.4 0 0 ~ 0 0 0 0 0 0 0 0 223002A3.03 PCIS/Nuclear Steam Supply Shutoff 2.5 2.8 0 0 0 0 0 0 0 0 ~ 0 0 239002A4.04 SRVs 4.3 4.3 0 0 0 0 0 0 0 0 0 0 0 259002K6.04 Reactor Water Level Control 3.1 3.1 0 0 0 0 0 0 0 0 0 0 0 261000A3.01 SGTS 3.2 3.3 0 0 0 0 0 00000 262001K6.01 AC Electrical Distribution 3.1 3.4 0 0 0 0 0 0 0 0 0 0 0 262001K6.02 AC Electrical Distribution 3.6 3.9 0 0 0 0 0 0 0 0 0 0 0 262002G2.4.3 UPS (AC/DC) 3.7 3.9 0 0 0 0 0 0 0 0 0 0 0 RCICftow Reactor pressure Restoration of reactor water level 'after a break that does not depressurize the reactor when required SPDS/ERIS/CRIDS/GDS: Plant-Specific Suppression pool temperature Reactor feedwater flow input System flow D.C. power Off-site power Ability to identify post-accident instrumentation.

(k- ~c:kJ J.~'J,.OO~ G.:<.4, 1\\

,vI);~

uy\\ U r.5 Page 2 of3 06/18/2009 8:52 AM

ftD T2G1 BWR EXAMINATION OUTLINE FORM ES-401-1 ES-401, REVS KA NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 2630001(2.01 DC Electrical Distribution 3.1 3.4

[] [ D fl fl

[]

Major D.C. loads 264000A1.01 EDGs 3.0 3.0 D

Lube oil temperature 3000001(5.13 Instrument Air 2.9 2.9

[]

[]

Filters 400000K4.01 Component Cooling Water 3.4 3.9 U

Automatic start of standby pump Page 3 of 3 06/18/2009 8:52 AM R.O ES-401, REV 9 T2G1 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 263000K2.01 DC Electrical Distribution 3.1 3.4 0 ~ 0 0 0 0 0 0 0 0 0 Major D.C. loads 264000A1.01 EDGs 3.0 3.0 0 0 0 0 0 0 ~ 0 0 0 0 Lube oil temperature 3OOO00K5.13 Instrument Air 2.9 2.9 0 0 0 0 ~ 0 0 0 0 0 0 Filters 400000K4.01 Component Cooling Water 3.4 3.9 0 0 0 ~ 0 0 0 0 0 0 0 Automatic start of standby pump Page 3 of 3 06/18/2009 8:52 AM

Ability to verify that the alarms are consistent with the plant conditions.

ES-401, REVS Ro T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION:

IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 201001A1 03 CRD Hydraulic 2.9 2.8 El fJ El El fi CRD system flow 201002K6.01 RMCS 2.5 2.6 El Select matrix power

201006K5.01 RWM 3*

El El El El El El El El El El Minimize clad damage if a control rod drop accident (CRDA) occurs: P-Spec(Not-BWR6) 214000A3.04 RPIS 3.5 3.8 El El El El El El El El El El RCIS: Plant-Specific 216000K201 Nuclear Boiler Inst.

2.8 2.8 El El El El El El El El ElEl Analog trip system: Plant-Specific 230000A1.06 RHRILPCI.Tonjs/Pool Spray Mode 3.3 3.3 fl

[]

Suppression pool level 234000A4.02 Fuel Handling Equipment 3.4 3.7 El El El El El El El El El Control rod drive system 259001A2.06 Reactor Feedwater 3.2 3.2 El El fl El El El El fl fl fi Loss of A.C. electrical power 272000K3.05 Radiation Monitoring 3.5 3.7 El El El El El El El El El Oftgas system 285000K1.04 Plant Ventilation 2.6 2.6 El El El El El El f] El El El Applicablecomponent cooling water system: Plant Specific 290002G2.4.46 Reactor Vessel Intemals 4.2 4.2 El El El El El El El El El El Page 1 of 2 06/18/2009 8:52 AM ES-401, REV 9 KA NAME I SAFETY FUNCTION:

201001A1.03 CRD Hydraulic 201002K6.01 RMCS 201006K5.01 RWM 214000A3.04 RPIS 216000K2.01 Nuclear Boiler Inst.

230000A 1.06 RHRJLPCI: Torus/Pool Spray Mode 234000A4.02 Fuel Handling Equipment 259001A2.06 Reactor Feedwater 272OQOK3.05 Radiation Monitoririg 28aOOOK1.04 Plant Ventilation 290002G2.4.4B Reactor Vessel Intemals (Co T2G2 BWR EXAMINATION OUTLINE IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO 2.9 2.8 0 0 0 0 0 0 ~ 0 0 0 [J 2.5 2.6 DDDDD~DDDDD 3.3 3.7 DDDD~DDDDDD 3.5 3.8 DDDDDDDD~DD 2.8 2.8 D~DDDOODDOO 3.3 3.3 DODODD~DODO 3.4 3.7 0 0 0 0 0 0 0 0 0 ~ 0 3.2 3.2 0 0 0 0 0 0 0 ~ n 0 C 3.5 3.7 0 0 ~ 0 0 0 0 0 0 0 0 2.6 2.6

~ 0 0 0 0 0 0 0 0 0 0 f{Q,~de& ;;Z g ~ DO D K I /0 J 4.2 4.2 0 0 0 0 0 0 0 0 0 0 ~

Page 1 of 2 FORM ES-401-1 TOPIC:

CRD system flow Select matrix power Minimize clad damage if a control rod drop accident (CRDA) occurs: P-Spec(Not-BWR6)

RCIS: Plant-Specific Analog trip system: Plant-Specific Suppression pool level Control rod drive system Loss of AC. electrical power Offgas system

'c Applicable component cooling water system: Plant-Specific tJ j /A Ability to verify that the alarms are consistent with the plant conditions.

06/18/2009 8:52 AM

ES-401, REV9 go T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION:

IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 290003K401 Contro Room HVAC 3.1 3.2 fl,

[1 System nitiatons/reconfiguration: Pant-Specific Page 2 of 2 06/18/2009 8:52 AM Ro ES-401, REV 9 T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 290003K4.01 Control Room HVAC 3.1 3.2 0 0 0 21 0 0 0 0 0 0 0 System initiations/reconfiguration: Plant-Specific Page 2 of2 06/18/2009 8:52 AM

T3 BWR EXAMINATION OUTLINE KA NAME I SAFETY FUNCTION:

IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G

TOPIC:

RO SRO G2.1.27 Conduct of operations 3.9 4

Knowledge of system purpose and or function.

G2.1.31 Conduct of operations 4.6 4.3 Ability to locate control room switches, controls and indications and to determine that they are correctly reflecting the desired plant lineup.

G2.1.39 Conduct of operations 3.6 4.3 knowledge of conservative decision making practices G2.2.15 Equipment Control 3.9 4.3 Ability to determine the expected plant configuration using design and configu ation control documentaion (2

- d4 i z. - (k 1

G2.2.25 Equipment Control 3.2 4.2 Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.

G2.2.39 Equipment Control 3.9 4.5 Knowledge of less than one hour technical specification action statements for systems.

G2.3.14 Radiation Control 3.4 3.8 Knowledge of radiation or contamination hazards that may anse dunng normal, abnormal, oremergency G2.3.6 Radiation Control 3.8 fl fl Ability to aprove release permits 2 3, 4 G2.4.1 Emergency Procedures/Plans 4.6 4.8

[]

Knowledge of EOP entry conditions and immediate action steps.

G2.4.9 Emergency Procedures/Plans 3.8 4.2 Knowledge of low power! shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

ES-401, REV 9 FORM ES-401-1 Page 1 of 1 06/18/2009 8:52 AM (2.{)

ES-401, REV 9 T3 BWR EXAMINATION OUTLINE FORM ES-401*1 KA G2.1.27 G2.1.31 G2.1.39 G2.2.15 G2.2.25 G2.2.39 G2.3.14 G2.3.6 G2.4.1 G2.4.9 NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO Conduct of operations 3.9 4

0 0 0 0 0 0 0 [] 0 0 ~

Conduct of operations 4.6 4.3 0 0 0 0 0 0 U [] 0 0 ~

Conduct of operations 3.6 4.3 0 0 0 0 0 0 0 0 0 0 ~

Equipment Control 3.9 4.3 0 0 0 0 0 0 0 0 0 0 ~

fLe - ~.~ G:l' '2, Z. 4-G Equipment Control 3.2 4.2 0 0 0 0 0 0 0 0 0 0 ~

Equipment Control 3.9 4.5 0 0 0 0 0 0 0 0 0 0 ~

TOPIC:

Knowledge of system purpose and or function.

Ability to locate control room switches, controls and indications and to determine that they are correctly reflecting the desired plant lineup.

Knowledge of conservative decision making practices Ability to determine the expected plant configuration using design and configuration control documentaion t£Ca;(.e UVl siZ.eJ Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.

Knowledge of less than one hour technical specification action statements for systems.

Radiation Control 3.4 3.8 0 0 0 0 0 0 0 0 0 0 ~

~

OV\\ StU) f2e--~ ~'2, 3., IS-Knowledge of radiation or contamination hazards that may arise during normal. abnormal, or emergency conditions or activities Radiation Control Emergency Procedures/Plans Emergency Procedures/Plans

~3.8 DDDDDDDDDD~

~

fk--~ck4 Gi 2,3./4 Ability to aprove release permits

---=~--~--~~~------~---------------

4.6 4.8 0 0 0 0 0 0 0 0 0 0 ~

Knowledge of EOP entry conditions and immediate action steps.

3.8 4.2 0 0 0 0 0 0 0 [] U 0 ~

Page 1 of 1 Knowledge of low power I shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

06/18/2009 8:52 AM

ES-401, REV9 KA NAME / SAFETY FUNCTION:

295006G2.2.22 SCRAM/I 295021AA2.03 Loss of Shutdown Cooling I 4 295023G24.46 Refueling Acc Cooling Mode I 8 295026EA2.03 Suppression Pool High Water Temp. /

5 295028 EA2.05 High Dryef Temperature I 5 295038G2.2.42 High Off-site Release Rate I 9 600000G2.2.37 Plant Fire On Site / 8 SRO TIGI BWR EXAMINATION OUTLINE IR K1K2K3K4K5K6A1A2A3A4G RO SRO 4.0 4.7 3.5 4.2 4.2 stha P23 3.9 4.0 3.6 3.8 3.9 4.6 3.6 4.6 FORM ES-401-1 TOPIC:

Knowledge of limiting conditions for operations and safety limits.

Reactor water level Ability to verify that the alarms are consistent with the plant conditions.

41 Reactor pressure Torus/suppression chamber pressure: Plant-Specific...

Ability to recognize system parameters that are entry-level conditions for Technical Specifications Ability to determine operability and/or availability of safety related equipment Page 1 of 1 06/18/2009 8:52 AM ES-401, REV 9 SRO T1G1 BWR EXAMINATION OUTLINE KA NAME I SAFETY FUNCTION:

IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO 295006G2.2.22 SCRAM 11 4.0 4.7

[] [J [] 0 [] [] 0 [] [] 0 ~

295021AA2.03 Loss of Shutdown Cooling 14 3.5 3.5

[] [] 0 [] [] [] [] ~ 0 0 []

FORM ES-401-1 TOPIC:

Knowledge of limiting conditions for operations and safety limits.

Reactor water level 295023G2.4.46 Refueling Acc Cooling Mode I 8 4.2 4.2

[] 0 [] 0 0 0 0 0 0 [] ~

Ability to verify that the alarms are consistent with the

~~

~ vJ;( LT.

f fL.e - sd..eck:J ;) CJS-p:2.3 G '~. q.. 4-9 t

conditions.

295026EA2.03 Suppression Pool High Water Temp. I 3.9 4.0 0 [] 0 [] [] [] 0 ~ 0 [] 0 Reactor pressure......................................

5 295028EA2.05 High Orywell Temperature 15 295038G2.2.42 High Off-site Release Rate I 9 600000G2.2.37 Plant Fire On Site I 8 3.6 3.8 0 0 [] 0 [] [] 0 ~ 0 0 0 3.9 4.6 0 0 0 0 0 [] 0 [] [] 0 ~

3.6 4.6

[] 0 [] 0 0 0 0 0 0 0 ~

Page 1 of 1 Toruslsuppression chamber pressure: Plant-Specific...

Ability to recognize system parameters that are entry-level conditions for Technical Specifications Ability to determine operability andlor availability of safety related equipment 06118/2009 8:52 AM

ES-401, REV 9 SRO TIG2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION:

IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G

TOPIC:

RO SRO 295008AA2.05 High Reactor Water Level /2 2.9 3.1 Swell 295014G2.1.19 Inadvertent Reactivity Addition / 1 3.9 3.8

[1

[j [1 E]

Ability to use plant computer to evaluate system or component status.

C-dtheJ 295029G2.1.7 High Suppression Pool Wtr Lvi / 5 4.4 4.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

Page 1 of 1 06/18/2009 8:52 AM ES-401, REV 9 KA NAME I SAFETY FUNCTION:

295008AA2.05 High Reactor Water level I 2 295014G2.1.19 Inadvertent Reactivity Addition 11 295029G2.1.7 High Suppression Pool Wtr lvllS SRO T1G2 BWR EXAMINATION OUTLINE FORM ES-401*1 IR K1 K2 K3 K4 KS K6 A1 A2 A3 A4 G TOPIC:

RO SRO 2.9 3.1 0 0 0 0 0 0 0 ~ 0 0 0 Swell.................................................

3.9 3.8 0 0 0 0 0 0 0 CJ 0 0 ~

Ability to use plant computer to evaluate system or n ~

component status.

\\~ - ~

cfc:d ; II' 3.6 3.9 0 0 0 0 0 0 0 ~ 0 0 0 4.2 4.1 0 0 0 0 0 U 0 0 0 0 ~

V1e.. -~e.ct:.& ;2., ~':S ODD GL, 0 Page 1 of 1 Overtravel/in-out Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects tJ ~

06/18/2009 8:52 AM

ES4O1, REVS SRO T3 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION:

IR Ki K2 K3 K4 KS K6 Al A2 A3 A4 G

TOPIC:

RO SRO G2.1 42 Conduct of operations 2.5 3.4 fl fl fl fl Knowledge of new and spent fuel movement procedures G2.1.5 Conduct of operations 2.9 3.9 E

Ability to locate and use procedures related to shift staffing, such as minimum crew complement, overtime limitations, etc.

G2.2.15 Equipment Control 3.9 4.3 Ability to determine the expected plant configuration using design and configuration control documentaion G2.2.22 Equipment Control 4.0 4.7 Knowledge of limiting conditions for operations and safety limits.

G2.3.11 Radiation Control 3.8 4.3

[ fl D

Ability to control radiation releases G2.4.1 7 Emergency Procedures/Plans 3.9 4.3 U Li Knowledge of EOP terms and definitions.

G2.4.35 Emergency Procedures(Plans 3.8 4.0 U U U U U U U Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects Page 1 of 1 06/18/2009 8:52 AM ES-401, REV 9 KA NAME / SAFETY FUNCTION:

G2.1.42 Conduct of operations G2.1.5 Conduct of operations G2.2.15 Equipment Control G2.2.22 Equipment Control G2.3.11 Radiation Control G2.4.17 Emergency Procedures/Plans G2.4.35 Emergency Procedures/Plans SRO T3 BWR EXAMINATION OUTLINE IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G RO SRO 2.5 3.4 0 0 0 0 0 0 0 0 0 0 21 2.9 3.9 0 0 0 0 0 0 0 0 0 0 ~

3.9 4.3 0 0 0 0 0 0 0 0 0 0 ~

4.0 4.7 0 0 0 0 0 0 0 0 0 0 ~

3.8 4.3 0 0 0 0 0 0 0 0 0 0 ~

3.9 4.3 0 0 0 0 0 0 0 0 0 0 ~

3.8 4.0 0 0 0 0 0 0 0 0 0 0 ~

Page 1 of 1 FORM ES-401-1 TOPIC:

Knowledge of new and spent fuel movement procedures Ability to locate and use procedures related to shift staffing. such as minimum crew complement. overtime limitations. etc.

Ability to determine the expected plant configuration using design and configuration control documentaion Knowledge of limiting conditions for operations and safety limits.

Ability to control radiation releases Knowledge of EOP terms and definitions.

Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects 06/18/2009 8:52 AM

4%

ES-401, Rev. 9 Record of Rejected K/As Form ES-401-4 Brunswick Initial Exam April 2010 Tier I Randomly Selected Reason for Rejection Group K/A RO T3 G 2.3.6 KA less than 2.5, actually 2.0.

KA reselected by Chief Examiner (CE) selected G. 2.3.14 RO T3 0 2,2.15 KA is repeated on the SRO examination.

Did not want to have the SRO have the same KA two times. KA reselected by the CE. Selected 0 2.2.4 SRO T1G2 295014G2.1.19 KA reselected by the CE. Selected 29501402.1.25 SRO T2G2 20400002.2.3 No unit differences.

KA reselected by the CE. Selected 20400002.2.25 SRO T2G2 23300002.4.34 No RO tasks outside the main control associated with the spent fuel pool/Clean up system.

KA replaced by the CE. Selected 23300002.4,6 RO T2G1 21 1000K 1.09 Had enough SLC KAs.

KA replaced by the CE. Selected 264000K1.07 RO T2G1 215005A2.07 KA replaced by the CE. CE selected by the CE 215005A2.04 i

& 2.f!

i c

__3_tc__,..

4

• .Q ti_c t/i/(a (p r 5

%cica

/iiIr

.__ii&2 2./t

.oq 4*

2xx E

t/(

.o

. 2cyr> I<.t OL 1

0 T2 4

2c (

c yc 3(O il(

0a:3 f

Li a

&2 q, e]/

c ES-401, R.ev. 9 Tier /

Randomly Selected Group KIA ROT3 G 2.3.6 ROT3 G 2.2.15 SRO T1G2 295014G2.1.19 SRO T2G2 204000G2.2.3 SRO T2G2 233000G2.4.34 RO T2G1 211000K1.09 RO T2G1 215005A2.07

"),0 '-r ~

fs2~ Ie.\\;

(>0 i\\L"7i dJI'So :':>'i!.

1t,2.,z..

[U;

'c 2-cr 2..

2.'(;'i, (;,C';~

\\.<" I,.;) ~

~10 TZ-G..-l

,;)_O-::}C:J£'lO i<1, 01

)ROTI6-(

l.1~O2,.,

' 6'2,'1 qb l~DT2t-1

,?'",t C (;,;; C;;: ihl,0;' 5 Record of Rejected K/As Brunswick Initial Exam April 2010 Form ES-401-4 Reason for Rejection KA less than 2.5, actually 2.0. KA reselected by Chief Examiner (CE) selected G.2.3.14 KA is repeated on the SRO examination. Did not want to have the SRO have the same KA two times. KA res elected by the CEo Selected G 2.2.4 KA reselected by the CE. Selected 295014G2.1.25 No unit differences. KA reselected by the CEo Selected 204000G2.2.25 No RO tasks outside the main control associated with the spent fuel pool/Clean up system. KA replaced by the CE. Selected 233000G2.4.6 Had enough SLC KA's. KA replaced by the CEo Selected 264000K1.07 KA replaced by the CEo CE selected by the CE 215005A2.04 kl\\

\\~

~(::.[)p(L.I"..~

n

\\

S f/...p E;\\t:.~1..)'

(:

2- '3,:)

.::;..:.. \\v~<.J*t'..Q. b'1 c..E 1/ J '\\ I {'-'

J I';""v.-".S"',L\\::..\\'0",,,,,,)vI, ht.<~

<r: \\. *.; \\ ""£~ If:,t;:. <. \\!, (.<;C) ",!,-*..., \\

'2.,,"( S-D '6 't;

~z. to

'::'~...\\If..L~t hI C't::

\\/ {iLLe>

'y...'V\\ 0>"", wk c\\,;,,<:':>,~{

h,;~~,

(,0 "'¥l.iICV,,?,.~J

.~').", \\ \\\\.,v'\\'-.

..... (e,\\.c r

~,~

\\\\~,,,,I;-

'-'f~,\\{, \\0,\\.-;'" ~'

2'lr'l\\.cxx' 1.<,.1,0\\

"'.0 \\ ",A* "".[1 bi.1 t.E t/ Ie: 111.)1 P l.,.~, ;;,4'1<'<',,<:;, <.

,~"I!v*~v "' ~,4,,{~~'f-~ t

>.. "" ~

H:::~~V\\

..;J 1/'\\

{Lt~ li......

\\ <'<

Ii\\.

~ eU'd, \\, c <'~b\\Q ' 2c'-:::,000 1<\\ <..")L

) <.. \\. (i,.t... ' \\a" e:£ Co.;{J v\\.(>'\\

'~

''",'.. ;i:'

<)':(D l",,-,-,,- \\ a ~t"!;{-(O"\\,v,**f£....

iJ \\ """>*';c, \\; i.e Cl "\\ "S,~ <-, ~::.

6 cf..'f1

.:::'.:: ! ~, 1,...(1 b'f C £'.

t J

~"~i 2/ 'i//o

.... ~6r\\.,>>,,,f.. v

\\(

kn..::<.,

VH){

\\.-\\1% v"-.

\\)*A It",

",J

c. ("~\\o ~"t"",

')u,) c? t '.if

(;:""0 J¥.

uf>S ULo'C":?.. (: 7... 0'1-t I

/,,,;,.1,(, "J-ej(

be, e, f'" '" ~

~,t.,) \\.'"

06)//Jo

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:

Date of Exam:

Exam Level: ROE SRO Initial Item Description a

c 1

Questions and answers are technically accurate and applicable to the facility.

2.

a.

NRC K/As are referenced for all questions.

b.

Facility learning objectives are referenced as available.

3.

SRO questions are appropriate in accordance with Section D.2.d of ES..401 j

4.

The sampling process was random and systematic (If more than 4 RO or 2 SRO questions A.)/,,t were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).

tr 5.

Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or Vi) the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6.

Bank use meets limits (no more than 75 percent Bank Modified New p

from the bank, at least 10 percent new, and the rest

(&)

jh øt new or modified); enter the actual RO I SRO-only

32. / 4 c I Q q3 / t.i question_distribution(s)_at_right.

7.

Between 50 and so percent of the questions on the RO Memory C/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly

/

selected K/As support the higher cognitive levels; enter 3

2 i.

the actual RO

, SRO question distribution(s) at right.

8.

References/handouts provided do not give away answers

/tP j4:;4

ø

if:.

or aid in the elimination of distractors.

9.

Question content conforms with specific K/A statements in the previously approved 1

examination outline and is appropriate for the tier to which they are assigned; f

(

deviations are justified.

,u 10.

Question psychometric quality and format meet the guidelines in ES Appendix B.

i

11.

The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.

Printed Name /Signature Date

a. Author

/

b. Facility Reviewer (*)

ff)A/AEc ?. a.ee

,4.

c. NRC Chief Examiner (it)

/

p,&,1Z

d. NRC Regional Supervisor

£tLCLLtArao..tL4J cV//4Qo Note:

• The facility reviewers initials/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: -b, U <I,;:,{."I, C k, Date of Exam: Y /ze/, 0 Exam Level: Ro0 SRo0 Initial Item Description a

Q' c#

1, Questions and answers are technically accurate and applicable to the facility.

/J;~

~f73 #U-

2.

a.

NRC KJAs are referenced for all questions.

/lJ~ ~ (it£

b.

Facility learning objectives are referenced as available.

3.

SRO questions are appropriate in accordance with Section D.2.d of ES-401 fb Jtff. 19IJ<.

4.

The sampling process was random and systematic (If more than 4 RO or 2 SRO questions AfA-1d '9JL were repeated from the last 2 NRC licensing exams, consult the NRR OL proqram office).

5.

Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

y, the audit exam was systematically and randomly developed; or

~

_ the audit exam was completed before the license exam was started: or

_ the examinations were developed independently: or

_ the licensee certifies that there is no duplication: or

_ other (explain)

6.

Bank use meets limits (no more than 75 percent Bank Modified New

$5 ~

from the bank. at least 10 percent new, and the rest 32 nl 4.3 I J\\

new or modified); enter the actual RO I SRO-only OlD question distribution(s) at right.

7.

Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension/ analysis level; I}tt the SRO exam may exceed 60 percent if the randomly

')'1 I 3

-,1.'1 / 2. (."

selected KJAs support the higher cognitive levels; enter

-)~

the actual RO I SRO question distribution(s) at right.

8.

References/handouts provided do not give away answers

~ ;(IJ{

or aid in the elimination of distractors.

9.

Question content conforms with specific KIA statements in the previously approved

~ 11U.

examination outline and is appropriate for the tier to which they are assigned; deviations are justified.

10.

Question psychometric quality and fonmat meet the guidelines in ES Appendix B.

,tP; vttJ 1/IJ(

11.

The exam contains the required number of one-point, multiple choice items; PJ ~$U-the total is correc

""h the value on the cover sheet.

Printed Name I Signature Date

a. Author 3).0.eo';;:,

/'. ;Z;~,;;

Ii

b. Facility Reviewer (*)

!.£(}/JA2.D 'P. f!,J;LL.E...R.. / ~

<Jo/;f (1

c. NRC Chief Examiner (#)

gta.U.NO ~

1 P1Lr\\ / ~

0.

'AD 4

If>

d. NRC Regional Supervisor J JA.Jfthl JJ,.... T;\\1Ilr"'JIJAAti f /

.I *

()

j/(j ~~

Note:

• The facility reviewer's initials/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

10

ES-401 Written Examination Review Worksheet Form ES-401-9 Q#

LOK (F/H) 2.

LCD (1-5)

Stem Focus

3. Psychometric Flaws Cues TIF Cred.

Dist.

Partial

4. Job Content Flaws Job-Link Minutia

1. 1 units Back ward

5. Other Q=

K/A SRO Only 6.

BIM/N 7.

U/E/S 8.

Explanation 5 Unsat SRO questions (20% borderline) 15 Unsat RO questions (20% borderline)

1:i::::_

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the followffig concepts.]

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LCD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., it the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recll of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

- The question contains data with an unrealistic level of accura,cy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5.

Check guestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6.

Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7.

Based on the reviewers judgment, is the question as written (U)nsatistactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8.

At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 Written Examination Review Worksheet Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 5 Unsat SRO questions (20% borderline) 15 Unsat RO questions (20% borderline)

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

_One or more distractors is (are.) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).

- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

. The question contains data with an unrealistic level of accura,cy or inconsistent units (e.g., panel meter in percent with que!?tion in gallons).

The question requires reverse logic or application compared to the job requirements.

5.

Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).

6.

Enter question source: (B}ank, (M)odified, or (N)ew. Check that (M}odified questions meet criteria of ES-401 Section D.2.f.

7.

Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E}ditorial enhancement, or (S}atisfactory?

8.

At a minimum, explain any "un ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2

Form ES-401-9 2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only H

2 x

x E

201001 A1.03, High, Bank S

1.

Partial: Because the stem does not specify which way the operator is throttling, then an applicant can argue any of the choices correct.

2.

Stem Focus: Because of the lead in wording starts out with restarting the system, the question is confusing because the applicant doesnt know which pump was running or restarted.

Clarify better>>The Unit was operating when the running CRD pump tripped, the CRD is being restarted 3.

Comments incorporated. Question is SAT.

2 H

3 x

x E

201002K6.01, Bank, High

1. Stem Focus and/or Cred Dist: Specify the 2 nd part of A and B

[full core diplsay, 4 rod group display, ERFIS, process computerj in order to ensure the plausibility of the 2 part of C and D. The 2 fill-in-the blank-statement can be modified to accomplish this.

2. Stem Focus: Identify the Emergency IN switch in quotations as seen, is the word IN capitalized in your nomenclature, if so/not make it either way.

3. Comments incorporated. Question is SAT 3

F 2

5 201006 K5.01, Low, Bank, ES-401 2

Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

i Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only I

1 H

2 x

x E

201001 A 1.03, High, Bank I

S

1.

Partial: Because the stem does not specify which way the operator is throttling, then an applicant can argue any of the choices correct.

2.

Stem Focus: Because of the lead in wording starts out with "restarting the system", the question is confusing because the applicant doesn't know which pump was running or restarted.

Clarify better>>The Unit was operating when the running CRD pump tripped, the CRD is being restarted...... "

3.

Comments incorporated. Question is SAT.

2 H

3 x

x E

201 002K6.01, Bank, High S

1. Stem Focus and/or Cred Dist: Specify the 2 nd part of "A" and "B"

[full core diplsay, 4 rod group display, ERFIS, process computer] in order to ensure the plausibility of the 2 nd part of "c" and "D." The 2nd fill-in-the blank-statement can be modified to accomplish this.

2. Stem Focus: Identify the "Emergency IN" switch in quotations as seen, is the word IN capitalized in your nomenclature, if so/not make it either way.

3. Comments incorporated. Question is SAT 3

F 2

S 201006 K5.01, Low, Bank,

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 4

H 3

X x

E 203000 K1.02, High, New S

1. Stem Focus:

Is it assumed in the question that both these alarms come in simultaneously?

It seems that the second alarm would come in some time later, since the pressure in the RHR loop should decrease fast and the volume being pumped into the Suppression Chamber would be ONLY a small amount. The valve has not failed open, just is seated improperly. This needs to be cleared up. Add a time frame that the other alarm comes in to ensure operational validity.

2. Stem Focus: Ask the licensee to explain why the word only is needed in the 2 part of the fill-in-the-blank statement.

3. Stem Focus: Provide the annunciator window location in parenthesis after the alarm window wording.

4. Cred Dist: Subsequently recognized that a and b were not plausible because of low torus level condition. 4/13/10

5. Recommended testing knowledge of torus alignment during a LOCA and expected flow rate. Question is SAT.

5 H

3 x

x U

205000 G 2.04.21, High, Bank

1. Q=KJA:

KA does NOT Match because this is a Tier 2 K/A, which should test the applicants knowledge of the safety related functions of the system operation.

If this were a Tier 1 K/A, then a loss of shutdown cooling would be appropriate.

Suggest testing the applicants knowledge of the minimum required flow rate when operating the shutdown cooling SYSTEM (Tier 2) to ensure core heat removal and preclude stagnation or mode changes.

2. Cred Dist: C and D are not plausibte because under the LOOP conditions proposed, NO flow would be available in Recirc or RHR due to the loss of power.

3. Licensee changed question to test applicants knowledge of how reactor pressure would respond following an RPS MG set trip (with shutdown cooling in service) and when a rriode change would occur.

Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 4

H 3

X x

E 203000 K1.02, High, New S

1. Stem Focus: Is it assumed in the question that both these alarms come in simultaneously? It seems that the second alarm would come in some time later, since the pressure in the RHR loop should decrease fast and the volume being pumped into the Suppression Chamber would be ONLY a small amount. The valve has not failed open, just is seated improperly. This needs to be cleared up. Add a time frame that the other alarm comes in to ensure operational validity.

2. Stem Focus: Ask the licensee to explain why the word "only" is needed in the 2nd part of the fill-in-the-blank statement.

3. Stem Focus: Provide the annunciator window location in parenthesis after the alarm window wording.

4. Cred Dist: Subsequently recognized that "a" and "b" were not plausible because of low torus level condition. 4/13/10

5. Recommended testing knowledge of torus alignment during a LOCA and expected flow rate. Question is SAT.

5 H

3 x

x U

205000 G 2.04.21, High, Bank S

1. Q=KlA: KA does NOT Match because this is a Tier 2 KIA, which should test the applicants' knowledge of the safety related functions of the system operation. If this were a Tier 1 KIA, then a loss of shutdown cooling would be appropriate.

Suggest testing the applicants' knowledge of the minimum required flow rate when operating the shutdown cooling SYSTEM (Tier 2) to ensure core heat removal and preclude stagnation or mode changes.

\\

2. Cred Dist: "C" and "D" are not plausible because under the LOOP conditions proposed, NO flow would be available in Recirc or RHR due to the loss of power.

~

3. Licensee changed question to test applicants' knowledge of how reactor pressure would respond following an RPS MG set trip (with shutdown cooling in service) and when a mode change would occur.

Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

I 1

(F/H)

(1-5)

Stem Cues! T/F Cred.

Partial Job-Minutia I

1. 1 Back-Q=

SRO B/M/N U/B/S Explanation Focus Dist.

Link junits ward KJA Only 6

F 2

X X

X E

206000 K4.02, Low, Bank

1. Cues: Change the temperature at which the isolation occurs and make It higher so as NOT to have the applicant recognize a temperature that they are familiar with. Change this to 203 deg. F so that the applicants have to recognize that they are above the setpoint vs simply recognizing the setpoint.

2. Stem Focus: For the word current either bold, underline or identify it so it is NOT missed by the applicant. When I read this question I did.

3. Partial: Licensee, is it possible that D could be considered as correct since the exact temperature sensor/location designators are not provided in the stem?

4. Comments incorporated. Question is SAT.

7 H

3 X

X U

209001 K3.01, High, New S

1. Q=K/A: This question does not test the applicants knowledge of how a loss of Core Spray affects RPV water level. The K/A is only testing the applicants knowledge of available power supplies following a LOOP when DG1 is under clearance.

2. The theme of this question overlaps with Q#28.

3. Stem Focus: Add a line space between the IC and the busses.

4. Licensee argued that Core Spray was unit specific with respect to power supplies whereas RHR has cross-unit power supplies.

Licensee also stated that question was testing how a malfunction of core spray would affect level since the applicant had to evaluate the LOCA and loss of power. Comments incorporated. Question is SAT.

8 H

3 X

B 209001 K 3.03, High, Bank 1.

Tough K/Ato hit.

Stem Focus: An applknt can argue that there is no correct answer because the stem question asks for the cause of the DG1 problems and D is not really the cause. The blown fuses may be a symptom of a larger problem, but may not be the cause of the DG1 problems. Discuss w/ licensee.

2.

Agreed to test applicants knowledge of how the DG output breaker responds when a core spray pump was running and its control power fuses blew and then a LOCA occurred. Question is SAT.

9 F

2 5

211000 K1.01, Low, Bank.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only i

6 F

2 X

X X

E 206000 K4.02, Low, Bank

1. Cues: Change the temperature at which the isolation occurs and make it higher so as NOT to have the applicant recognize a temperature that they are familiar with. Change this to 203 deg. F so that the applicants have to recognize that they are above the setpoint vs simply recognizing the setpoint.

2. Stem Focus: For the word "current" either bold, underline or identify it so it is NOT missed by the applicant. When I read this question I did.

3. Partial: Licensee, is it possible that 0 could be considered as correct since the exact temperature sensor/location designators are not provided in the stem?

4. Comments incorporated. Question is SAT.

7 H

3 X

X U

209001 K3.01, High, New S

1. Q=KlA: This question does not test the applicants knowledge of how a loss of Core Spray affects RPV water level. The KIA is only testing the applicants' knowledge of available power supplies following a LOOP when DG1 is under clearance.

2. The "theme" of this question overlaps with Q#28.

3. Stem Focus: Add a line space between the IC and the busses.

4. Licensee argued that Core Spray was unit specific with respect to power supplies whereas RHR has cross-unit power supplies.

Licensee also stated that question was testing how a malfunction of core spray would affect level since the applicant had to evaluate the LOCA and loss of po~er. Comments incorporated. Question is SAT.

8 H

• '3 X

~

'E 209001 K 3.03, High, Bc1nk S

1.

Tough KIA to hit.

~

Stem Focus: An applicant can argue that there is no correct answer because the stem question asks for the "cause" of the DG1 problems and "0" is not really the "cause." The blown fuses may be a symptom of a larger problem, but may not be the "cause" of the DG1 problems. Discuss w/licensee.

2.

Agreed to test applicants' knowledge of how the DG output breaker responds when a core spray pump was running and its control power fuses blew and then a LOCA occurred. Question is SAT.

9 F

2 S

211000 K 1.01, Low, Bank.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 10 F

2 5

212000K2.01,Low,Bank

1. Stem Focus: The stem question does not solicit the 1 portion response of the fill-in-the-blank question. Re-word stem question to ask for which MG set(s) is/are affected in addition to EPA breakers.

11 F

2 X

X E

214000A3.04,Low,Bank S

1.

Stem Focus: Several grammar errors (four rod display GOES out, then GOES out again (vs go); COMES on (vs come on).

2.

Stem Focus: Need to add quotations around FF. Also need to include a semi-colon after FF to ensure the applicants know that a separate issue is being presented, i.e., whether or not an inferred position is provided.

3.

Cred Dist:

B is not plausible because it does not provide the plausible inferred position of 12, i.e., it is not similar to D.

4.

Comments incorporated. Question is SAT.

12 H

3 X

E 215003 A2.02, High, New S

1.

Stem Focus: the words on the high voltage power supply for in the 1 sentence is confusing and not necessary to elicit the correct response. Re-word the l sentence as follows:

A plant startup was in progress when the high voltage power supply to IRM G failed low. All IRMs are on Range 1.

2.

Stem Focus: Spflt out the fill-in-the-blank staternents into two separate sentences.

3.

Stem Focus: Urderline the word clear in the 2 fill-in the-blank statement.

4.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Sack-Q=

SRO S/M/N u/E/S Explanation Focus Dist.

Link units ward KIA Only 10 F

2 S

212000 K 2.01, Low, Sank

1. Stem Focus: The stem question does not solicit the 1 st portion response of the fill-in-the-blank question. Re-word stem question to ask for which MG set(s) is/are affected in addition to EPA breakers.

11 F

2 X

X E

214000 A 3.04, Low, Sank S

1.

Stem Focus: Several grammar errors (four rod display GOES out, then GOES out again (vs go); COMES on (vs come on).

2.

Stem Focus: Need to add quotations around FF. Also need to include a semi-colon after FF to ensure the applicants' know that a separate issue is being presented, i.e., whether or not an inferred position is provided.

3.

Cred Dist: "s" is not plausible because it does not provide the plausible inferred position of 12, i.e., it is not similar to "D."

4.

Comments incorporated. Question is SAT.

12 H

3 X

E 215003 A2.02, High, New S

1.

Stem Focus: the words "on the high voltage power supply for... " in the 1st sentence is confusing and not necessary to elicit the correct response. Re-word the 1 st sentence as follows:

"A plant startup was in progress when the high voltage power supply to IRM G failed low. AlIlRMs are on Range l

1."

2.

Stem Focus: Spnt out the fill-in-the-blank staterrlents into two separate sentences.

3.

Stem Focus: Ufl,derline the word "clear" in the 2nd fill-in-the-blank statement.

4.

Comments incorporated. Question is SAT.

112.

3. Psychometric Flaws

4. Job Content Flaws

5. Other F 8.

Q#

jLOD viz CreJ.

1 Job-Minutia

FS1BIMlN UIEIS Explanation Focus Dist. [

Jjs ward 13 H

3 X

E 215004, K5.03, High. New S

1.

Stem Focus: Because distractors C and D have 2 actions while A and B have only one, re-word the stem question as follows:

WOOTF is the minimum required action(s) that will clear the control rod block?

2.

Stem Focus:

In the first part of the stem, the question talks about a control rod block. In the last part of the stem the question refers to an annunciator (is that what italics means?).

Is it necessary to include an alarm, or can the question simply state to clear the control rod block.

3.

Distracter analysis: The description for distractor D states that IRM B and D are in Div II and are below 3, is this true or is it IRM F vice D as the answer states?

4.

Comments incorporated. Question is SAT.

14 H

3 X

U 215005 A2.04, High, New.

S 1.Q=KIA: The proposed question does not meet the K/A because the 2 part of the fill-in-the-blank statement can be answered without the name of the procedure. Suggest testing the applicants knowledge of required AOP to enter or some required AOP action that deals with overall mitigative strategy.

2. Question was originally sat because Chief Examiner got RD vs SRO confused. [As long as the choices are procedurally directed actions, then the 2 nd part of the question meets the intent of the A2 K/A EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE THE CORRECT ANSWER.]

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

I Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 13 H

3 X

E 215004, K5.03, High. New S

1.

Stem Focus: Because distractors C and 0 have 2 actions while A and B have only one, re-word the stem question as follows:

WOOTF is the minimum required action(s) that will clear the control rod block?

2.

Stem Focus: In the first part of the stem, the question talks about a "control rod block." In the last part of the stem the question refers to an annunciator (is that what italics means?).

Is it necessary to include an alarm, or can the question simply state to clear the control rod block.

3.

Distracter analysis: The description for distractor 0 states that IRM Band 0 are in Div II and are below 3, is this true or is it IRM F vice 0 as the answer states?

4.

Comments incorporated. Question is SAT.

14 H

3 X

U 215005 A2.04, High, New.

S 1.Q=KlA: The proposed question does not meet the KIA because the 2

nd part of the fill-in-the-blank statement can be answered without the name of the procedure. Suggest testing the applicants' knowledge of required AOP to enter or some required AOP action that deals with overall mitigative strategy.

2. Question was originally sat because Chief Examiner got RO vs SRO confused. [As long as the choices are procedurally directed actions, then the 2nd part of the question meets the intent of the A2 KIA - EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE,THE CORRECT ANSWER.], ~

~

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q SRO BIM/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 15 H

2 X

x U

215005A2.05, High, New E

• Q=K/A: The question does not test the K/A because the second part of choices B and D can be eliminated by knowing how the S

RBM system works. After B and D are eliminated, the applicant does not have to know what the procedure requires.

2. Cred Dist: (borderline) B and D are not plausible because the RBM B has no association with APRM 1. Change the APRM to 4.

3. the question can be answered by using knowledge of is what is the procedure action, the applicant has to know the system response and to know that RBM B never transfer automatically to APRM 1.

NOT plausible, makes this UNSAT

4. Question was originally ENHANCEMENT because Chief Examiner got RO vs SRO confused. [As long as the choices are procedurally directed actions, then the 2 part of the question meets the intent of the A2 K/A EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE THE CORRECT ANSWER.]

5. Comments incorporated. Question is SAT 16 F

2 X

X E

216000K2.10,Low,Bank 1.

Stem Focus: Include the word panel forC and D 2.

Cred Dist: Discuss w/ licensee about using the power supplies for the ECCS Trip Cabinets instead of the ones listed in A and B to add plausibility. Alternatively, suggest a 25OVDC cabinet 3.

Licensee wrote question to include 125 VDC Panel 3A and S

125 VDC Panel 4A. Question is SAT.

217000 A1.01, High, Bank 1.

Cues: The information related tolow water level in the l sentence is not necessary to elicit the correct response, i.e.,

simply state that RCIC automatically initiated.

2.

Cues:

In the current plant status the applicant should already know that the F045 will be closed following a high water level trip.

3.

Cues: Does the FOl 3 also automatically close? If not, then the information about F013 is acceptable.

If it does, then this is a cue.

17 H

3 E

S 4.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 15 H

2 X

X U

215005A2.05, High, New E

1. Q=KlA: The question does not test the KIA because the second S

part of choices "B" and "D" can be eliminated by knowing how the RBM system works. After "B" and "D" are eliminated, the applicant does not have to know what the procedure requires.

2. Cred Dist: (borderline) "B" and "0" are not plausible because the RBM B has no association with APRM 1. Change the APRM to 4.

3. the question can be answered by using knowledge of is what is the procedure action, the applicant has to know the system response and to know that RBM B never transfer automatically to APRM 1.

NOT plausible, makes this UNSAT

4. Question was originally ENHANCEMENT because Chief Examiner got RO vs SRO confused. [As long as the choices are procedurally directed actions, then the 2 nd part of the question meets the intent of the A2 KIA - EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE THE CORRECT ANSWER.]

5. Comments incorporated. Question is SAT 16 F

2 X

X E

216000 K 2.10, Low, Bank S

1.

Stem Focus: Include the word "panel" for "C" and "D"

2.

Cred Dist: Discuss wi licensee about using the power supplies for the ECCS Trip Cabinets instead of the ones listed in "A" and "B" to add plausibility. Alternatively, suggest a 250VDC cabinet

3.

Licensee wrote question to include 125 VDC Panel 3A and

\\

125 VDC Panel4A. QuestIon is SAT.

17 H

3

,X E

217000A1.01, High, Bank S

1.

Cues: The information related to "low water level" in the 1 51 sentence is not necessary to elicit the correct response, Le.,

simply state that RCIC automatically initiated.

2.

Cues: In the "current plant status" the applicant should already know that the F045 will be closed following a high water level trip.

3.

Cues: Does the F013 also automatically close? If not, then the information about F013 is acceptable. If it does, then this is a cue.

4.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 18 H

3 X

S 217000 Al.04, High, New 1.

Stem Focus: Ask the licensee if the word stabilized is strong enough to ensure that applicants cannot argue more than one correct answer.

2.

Comments incorporated. Question was SAT.

19 H

3 X

x U

218000 K3.01, High, New.

E Q=KA: The KA is not being met because the applicants are not being directly tested on the water level restoration method S

following a loss/malt of the ADS. Instead, this question is testing the applicants knowledge of whether the ADS logic will initiate, which may be indirectly testing their knowledge of whether the vessel is depressurized following a losslmalf of the ADS.

Suggest asking a 2 part question to test the applicants knowledge of 1) will ADS automatically initiate (yes/no) and 2) when it will initiate (for the two yes choices) or what the minimum required reactor water level is for a manual ED (for the no choices). By doing this, the reactor water level parameter is being tested.

2.

Cred Dist:

A is not plausible because the fluid flow detection would only occur AFTER the ADS valve opening; therefore, it is not logical that the sonic detectors provide input to the initiation of ADS.

3.

Stem Focus: The stem question does not solicit a reason for whether ADS will or will not initiate even though each choice

provides a reason. Ensure the stem question is worded to elicit both parts of each choice.

4.

Licensee argued that question met the K/A because it tested the applicants knowledge of w,hether ADS will/will not actuate AND which RHR loop will subsequently be available. Question was originally an ENHANCEMENT. Other comments incorporated.

Question is SAT.

20 F

2 5

223002 A 3.03, Bank, High.

1.

Discuss with the licensee why this question is a Higher level question.

It may be a Memory.

If there is some diagnosis involved, then it may be a higher question.

2.

Licensee agreed with Fundamental (Lower) Cog classification.

Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 18 H

3 X

S 217000 A1.04, High, New

1.

Stem Focus: Ask the licensee if the word "stabilized" is strong enough to ensure that applicants' cannot argue more than one correct answer.

2.

Comments incorporated. Question was SAT.

19 H

3 X

X U

218000 K3.01, High, New.

E

1.

Q=KA: The KA is not being met because the applicants' are not S

being directly tested on the water level restoration method follOwing a loss/malf of the ADS. Instead, this question is testing the applicants' knowledge of whether the ADS logic will initiate, which may be indirectly testing their knowledge of whether the vessel is depressurized following a loss/malf of the ADS.

Suggest asking a 2 part question to test the applicants' knowledge of 1) will ADS automatically initiate (yes/no) and 2) when it will initiate (for the two "yes" choices) or what the minimum required reactor water level is for a manual ED (for the "no" choices). By doing this, the reactor water level parameter is being tested.

2.

Cred Dist: "A" is not plausible because the fluid flow detection would only occur AFTER the ADS valve opening; therefore, it is not logical that the sonic detectors provide input to the initiation of ADS.

3.

Stem Focus: The stem question does not solicit a "reason" for whether ADS will or will not initiate even though each choice I

provides a "reason." Ensure the stem question is worded to elicit both parts of each choice.

4.

Licensee argued that question met the KIA because it tested the applicants' knowledge of 'A(hether ADS will/will not actuate AND which RHR loop will subsequently be available. Question was I

originally an ENHANCEMENT. Other comments incorporated.

Question is SAT.

20 F

2 S

223002 A 3.03, Bank, High.

1.

Discuss with the licensee why this question is a Higher level question. It may be a Memory. If there is some diagnosis involved, then it may be a higher question.

2.

Licensee agreed with Fundamental (Lower) Cog classification, Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LCD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 21 H

3 X

X E

230000 A1.06, High, New.

S 1.

Job-Link:

Is it verifiable in the simulator that narrow range torus level will slightly rise following the initiation of pool sprays?

If not, then an applicant can successfully argue that this item is not valid.

If this phenomena is reproducible on the simulator, then include the exact values of containment parameters in the stem based on the simulator test.

2.

Stem Focus: Provide the name and number of the level indicator being referred to in the fill-in-the-blank statement.

3.

Stem Focus: Is the slight level rise going to occur immediately when sprays are initiated?

If so, then the word immediately needs to be included. Or is this a gradual level rise? Discuss w/ licensee.

4.

Licensee verified in the simulator. All other comments incorporated. Question is SAT.

22 H

X X

E 234000 A 4.02, High, Bank, S

1.

Stem Focus: An applicant can argue that there is no correct answer because of the words adverse consequences in the stem question.

2.

Stem Focus: Instead of using the term select block, re-word to test applicants knowledge of whether or not 1) a rod can be selected and 2) whether the Control Rod Out Permissive light on the apron section will be lit or off.

3.

Stem Focus: Provide the control rod number in the stem.

4.

Stem Focus: The 3 rd and 4 th bullets are not ncessary to elicit the correct respOnse, i.e., the rod will be selected if it is being withdrawn and the rod select power will be on if it is being withdrawn.

5.

Stem Focus: the words for uncoupling in the last part of the stem question are confusing in their placement in this question.

These words are not necessary to elicit the correct response.

6.

Stem Focus: Provide the position of the mode switch instead of saying the unit is in Mode 5 because the rod logic is critical for the applicant to deduce.

7.

Job-Link: Include the name and number of the refueling procedure in the stem thats being used by the operator to uncouple the rod.

8.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only J

21 H

3 X

X E

230000 A 1.06, High, New.

S

1.

Job-Link: Is it verifiable in the simulator that narrow range torus level will slightly rise following the initiation of pool sprays? If not, then an applicant can successfully argue that this item is not valid. If this phenomena l§. reproducible on the simulator, then include the exact values of containment parameters in the stem based on the simulator test.

2.

Stem Focus: Provide the name and number of the level indicator being referred to in the fill-in-the-blank statement.

3.

Stem Focus: Is the slight level rise going to occur immediately when sprays are initiated? If so, then the word "immediately" needs to be included. Or is this a gradual level rise? Discuss wI licensee.

4.

Licensee verified in the simulator. All other comments incorporated. Question is SAT.

22 H

X X

E 234000 A 4.02, High, Bank, S

1.

Stem Focus: An applicant can argue that there is no correct answer because of the words "adverse consequences" in the stem question.

2.

Stem Focus: Instead of using the term "select block", re-word to test applicants' knowledge of whether or not 1) a rod can be selected and 2) whether the Control Rod Out Permissive light on the apron section will be lit or off.

3.

Stem Focus: Provide the control rod number in the stem.

\\

4.

Stem Focus: The 3 rd and 4th bullets are not necessary to elicit the correct response, i.e., the rod will be selected if it is being withdrawn and the rod select power will be on if it is being withdrawn.

5.

Stem Focus: the words "for uncoupling" in the last part of the stem question are confusing in their placement in this question.

These words are not necessary to elicit the correct response.

6.

Stem Focus: Provide the position of the mode switch instead of saying the unit is in Mode 5 because the rod logic is critical for the applicant to deduce.

7.

Job-Link: Include the name and number of the refueling procedure in the stem that's being used by the operator to uncouple the rod.

8.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 23 F

2 X

X X

E 239002 A 4.04, Bank, Low S

1. Stem Focus: remove the word correct from the Which one of the following (WOOTF) statement.

2. Partial: An applicant can potential argue that there is no correct answer because of the words ust reached versus exceeded or at.

3. Stem Focus: The Blue Bar information is not needed to elicit the correct response.

4. Q=K/A: (borderline) The question is only asking for the alarm setpoint. None of the information about the SRVs is needed to get the correct answer. Discuss w/ licensee.

5. Comments incorporated. Question is now SAT.

24 H

3 X

x x

U 259001 A 2.06. High, Bank, E

1.

Q=K/A: The KA is not being met because the question does not test the RO applicants ability to use procedures. The 2 5

portion of the question can be answered without knowledge of procedures used to correct, control, or mitigate. Suggest testing RO knowledge of either AOP or APP specifics, ie., the correct one to enter.

2.

Q=K/A: The KA is not being met because the question does not test the applicants knowledge of how a loss of AC power will affect the feedwater system. The proposed question tests the applicants knowledge of how a loss of digital control signal affects the feed pumps; however, because the question does not require knowledge of power supplies, the K/A is not being met. Suggest modifying question so that the applicant is tested on the power supply to the DFQS.

3.

Stem Focus: Split out the 2fl bullet into two separate bullets, i.e., RFP Manual controller (include number) and DFCS Selector Switch (include number).

4.

Cred Dist: Choices C and D are not plausible because the 2 bullet already provides information that controller is in Manual.

5.

Question was originally ENHANCEMENT because Chief Examiner got RO vs SRO confused. [As lon as the choices are procedurally directed actions, then the 2 part of the question meets the intent of the A2 K/A EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE THE CORRECT ANSWER.]

6.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 23 F

2 X

X X

E 239002 A 4.04, Bank, Low S

1. Stem Focus: remove the word "correct" from the Which one of the following (WOOTF) statement.

2. Partial: An applicant can potential argue that there is no correct answer because of the words "just reached" versus exceeded or at.

3. Stem Focus: The Blue Bar information is not needed to elicit the correct response.

4. Q=KlA: (borderline) The question is only asking for the alarm setpoint. None of the information about the SRVs is needed to get the correct answer. Discuss wI licensee.

5. Comments incorporated. Question is now SAT.

24 H

3 X

X X

U 259001 A 2.06, High, Bank, E

1.

Q=KlA: The KA is not being met because the question does not S

test the RO applicants' ability to use procedures. The 2nd portion of the question can be answered without knowledge of procedures used to correct, control, or mitigate. Suggest testing RO knowledge of either AOP or APP specifics, ie., the correct one to enter.

2.

Q=KlA: The KA is not being met because the question does not test the applicants' knowledge of how a loss of AC power will affect the feedwater system. The proposed question tests the applicants' knowledge of how a loss of digital control signal affects the feed pumps; however, because the question does not require knowledge of power supplies, the KIA is not being met. Suggest modifying question so that the applicant is tested qn the power supply to the DFC,S.

3.

Stem Focus: Split out the 2 nd bullet into two separate bullets, i.e., RFP Manual controller (include number) and DFCS Selector Switch (include number).

I

4.

Cred Dist: Choices "C" and "0" ~re not plausible because the,

/'

2 nd bullet already provides information that controller is in Manual.

5.

Question was originally ENHANCEMENT because Chief Examiner got RO vs SRO confused. [As lon2 as the choices are procedurally directed actions, then the 2 part of the question meets the intent of the A2 KIA - EVEN IF SYSTEM KNOWLEDGE CAN BE USED TO DETERMINE THE CORRECT ANSWER.]

6.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other T

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q SRO BIM/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 25 H

2 x

x E

259002 K6.04, High New, S

1. Cred Dist:

B and D are borderline plausible because the feedpumps speed will not change if the DFCS transfers to 1-element.

The question needs to be re-worked to test the applicants knowledge of 1) Will RPV level change? And 2) Will DFCS transfer to 1-element or remain in 3-element.

2. Stem Focus: Put the statement in parenthesis (Assume NO operator Actions)

3. Stem Focus: Change stem to read:

The unit is operating at power when a loss of the B Feed water Flow indicator occurs, WOOTF identifies the effect of this on DFCS control and reactor water level?

4. Comments incorporated. Question is SAT.

26 H

2 X

X E

261000A3.01,New S

1.

Stem Focus or #/units: Re-word the stem question and the fill-in-the-blank statements (to be consistent with the control panel and eliminate the vague term the RO would verify) as follows:

Given these plant conditions, which ONE of the following choices predicts the SBGT flow indications at the XU-51 panel?

SBGT Train A flow (Fl-3150-1) is________ scfm.

SBGT Train B flow (Fl-3151-1) is________ scfm.

2.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 25 H

2 x

x E

259002 K6.04, High New, S

1. Cred Dis!: "B" and "D" are borderline plausible because the feedpumps speed will not change if the DFCS transfers to 1-element.

The question needs to be re-worked to test the applicants knowledge of 1) Will RPV level change? And 2) Will DFCS transfer to 1-element or remain in 3-element.

2. Stem Focus: Put the statement in parenthesis (Assume NO operator Actions)

3. Stem Focus: Change stem to read: The unit is operating at power when a loss of the "B" Feed water Flow indicator occurs, WOOTF identifies the effect of this on DFCS control and reactor water level?

4. Comments incorporated. Question is SAT.

26 H

2 X

X E

261000 A3.01, New S

1.

Stem Focus or #/units: Re-word the stem question and the fill-in-the-blank statements (to be consistent with the control panel and eliminate the vague term "the RO would verify") as follows:

Given these plant conditions, which ONE of the fol/owing choices predicts the SBGT flow indications at the XU-51 panel?

SBGT Train A flow (FI-3150-1) is scfm.

SBGT Train B flow (FI-3151-1) is scfm.

2.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

(F/H)

(1-5)

Stem Cues 1 T/F jaial Job- [Minutia

1. 1 Back-Q=[SRO B/M/N U/E/S Explanation Focus Dist.

units ward jJOnly 27 F

2 X

X X

E 262001 K6.01, Bank S

1. Stem Focus and/or Partial: The term manually initiated, automatically executed fast bus trsnsfe? uses conflicting words, i.e.,

manual and automatic.

Suggest the following to ensure applicants cannot argue potentially partially correct answers are not confused:

2. #/units: The fill-in-the-blank statements do not specify what voltage busses are being described, i.e., it should say 4KV Bus 18, etc.

A loss of 125VDC Panel 9A has occurred with the Unit operating at 100%.

Which ONE of the following identities whether the 4160 V Bus can still be manually transferred from its normal power source to its alternate source without a power interruption?

4160 V Bus 18 be transferred without power interruption.

4160 V Bus IC be transferred without power interruption.

A.

can still; can still B. can still; cannot C. cannot; can still D.

cannot; cannot

3. Comments incorporated. Question is SAT.

28 F

2 X

E 262001 K6.02, New 1.

Stem Focus: The word correctly is not necessary to elicit the answer or to preclude an appeal since the question begins with Which ONE of the following....

2.

Stem Focus: Modify tle fill-in-the-blank statements as follows:

The 28 RHR Pump lost its power supply.

The 2-El 1-FO 158, LPCI Inboard Injection Valve, lost its power supply.

3.

Discuss w/ the licensee how this question is different than Q#7.

4.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N UlE/S Explanation Focus Dist.

Link units ward KIA Only 27 F

2 X

X X

E 262001 K6.01, Bank S

1. Stem Focus and/or Partial: The term "manually initiated, automatically executed fast bus transfer' uses conflicting words, i.e.,

manual and automatic.

Suggest the following to ensure applicants cannot argue potentially partially correct answers are not confused:

2. #/units: The fill-in-the-blank statements do not specify what voltage busses are being described, i.e., it should say 4KV Bus 1 B, etc.

A loss of 125VOC Panel 9A has occurred with the Unit operating at 100%.

Which ONE of the following identifies whether the 4160 V Bus can still be manually transferred from its normal power source to its alternate source without a power interruption?

4160 V Bus 1B be transferred without power interruption.

4160 V Bus 1C be transferred without power interruption.

A. can still; can still B. can still; cannot C. cannot; can still O. cannot cannot

3. Comments incorporated. Question is SAT.

28 F

2 X

E 262001 K6.02, New r

r S

1.

Stem Focus: The word )'correctly " is not necessary to elicit the answer or to preclude an appeal since the question begins with "Which ONE of the following... ".

2.

Stem Focus: Modify the fill-in-the-blank statements as follows:

The 2B RHR Pump lost its power supply.

The 2-E11-F015B, LPCllnboard Injection Valve, __ lost its power supply.

3.

Discuss w/ the licensee how this question is different than Q#7.

4.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 29 F

3 X

X E

262000 G2.04.03, New 1.

1. /units; The term UPS needs to be specific as to the exact power supply bus, panel, etc., including the full noun name, i.e.,

120 V UPS Distribution Panel 1-V9A (verify correct with the licensee).

2.

1. /units: Each of the choices needs to have the exact component number and noun name as listed on its associated control panel label. For example, the Reactor Pressure Vessel Recorder should also include its associated number, C32-LPR-R608 3.

Cred Dist: 0 is not plausible because the stem asks for one instrument (i.e., an instrument) whereas D is plural.

4.

Licensee subsequently determined ( because of comment #1) that 01-50.5 load list stated that all PAM instruments are 125 VDC or E-bus power supply panels, i.e., K/A not applicable.

Chief Examiner randomly re-selected K/A 262002, G2.41 1.

Licensee re-worked question to test applicants knowledge of whether the Loss of UPS requires AOP-2.0 entry and an action listed in AOP 12.0. (symptom from AOP-2.0 and TCC-V117 action) QUESTION IS SAT.

30 F

2 X

X U

263000K2.01,Bank 1.

Cred Dist:

A and B are not plausible because the turbine auxiliaries are never an ESF load nor are they (emergency oil pumps) typically AC loads; therefore, an applicant could eliminate these choices solely based on the presumption that the EBOP is not an ESF load or an AC load. Suggest providing all four choices with DC sources.

2.

1. /units: Include the exact name and designator of the power supply to the EBOP (and for all distracters), e.g., 250 VDC Switchgear 1B, for Unit 1, 48OVAC Bus ES., etc.

3.

Licensee incoporated comments. Questionis SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

I Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 29 F

3 X

X E

262000 G2.04.03, New

1.

1. /units: The term "UPS" needs to be specific as to the exact power supply bus, panel, etc., including the full noun name, i.e.,

120 V UPS Distribution Pane11-V9A (verify correct with the licensee).

2.

1. /units: Each of the choices needs to have the exact component number and noun name as listed on its associated control panel label. For example, the Reactor Pressure Vessel Recorder should also include its associated number, C32-LPR-R608

3.

Cred Dist: "D" is not plausible because the stem asks for one instrument (i.e., an instrument) whereas "D" is plural.

4.

Licensee subsequently determined ( because of comment #1) that 01-50.5 load list stated that all PAM instruments are 125 VDC or E-bus power supply panels, i.e., KIA not applicable.

Chief Examiner randomly re-selected KIA 262002, G2.411.

Licensee re-worked question to test applicants' knowledge of whether the Loss of UPS requires AOP-2.0 entry and an action listed in AOP 12.0. (symptom from AOP-2.0 and TCC-V117 action) QUESTION IS SAT.

30 F

2 X

X U

263000 K2.01, Bank S

1.

Cred Dist: "A" and "B" are not plausible because the turbine auxiliaries are never an ESF load nor are they (emergency oil pumps) typically AC loads; therefore, an applicant could eliminate these choices solely based on the presumption that the EBOP is not an ESF load or an AC load. Suggest providing all four choices with DC sources.

1

2.

1. /units: Include the exact name and designator of the power supply to the EBOP (and for all distracters), e.g., 250 VDC Switchgear 1 B, for Unit 1, 480VAC Bus E5., etc.

3.

Licensee incolporated comments. Question'ls SAT.

tJE

3. Psychometric Flaws

4. Job Content Flaws

5. Other T

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 31 H

1 x

x U

264000A1.01,Bank S

1.

Cred Dist: C and D are not plausible because the fill-in-the-blank statement states that initially the DG2 oil temperature will as the load on the diesel is increased. Since the 1 st part of C and D states lower, this is contrary to any engine, i.e.,

increasing load makes the oil get hotter.

2.

LOD=1: The l part of this question can be answered using knowledge from the generic fundamentals exam section (knowledge associated with an engine generating heat) even though this is the plant specific exam.

3.

Partial: An applicant can also argue that B is correct because the 2 d part of the question deals with a 3 way TCV. One part of the 3way TCV will throttle closed to ensure no oil is bypassing the heat exchanger; however, an applicant can argue that the other part of the 3way TCV is throttling open to admit more oil thru the heat exchanger.

4.

Licensee changed the question. New question is SAT.

32 H

2 X

E 264000 K1.07 S

1.

Cred Dist: A (8 seconds) is not plausible because there is no electricity to the pumps yet. The stem states that the diesels energize the busses at 10 seconds. Since the site has lost power and the diesels havent yet energized the busses, then there is no electricity available to the LPCI pumps.

2.

Ask the licensee when the diesels (what time) will auto-start based on the sequence of events. Discuss w/ licensee.

3.

Re-worked the time choices to eliminate 8 seconds. Question is

SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOO (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Oist.

Link units ward KIA Only 31 H

1 X

X U

264000 A 1.01, Bank S

1.

Cred Oist: "C" and "0" are not plausible because the fill-in-the-blank statement states that initially the OG2 oil temperature will

__ as the load on the diesel is increased. Since the 1 st part of "C" and "0" states "lower", this is contrary to any engine, i.e.,

increasing load makes the oil get hotter.

2.

LOO=1: The 1 st part of this question can be answered using knowledge from the generic fundamentals exam section (knowledge associated with an engine generating heat) even though this is the plant specific exam.

3.

Partial: An applicant can also argue that "B" is correct because the 2 nd part of the question deals with a 3 way TCV. One part of the 3way TCV will throttle closed to ensure no oil is bypassing the heat exchanger; however, an applicant can argue that the other part of the 3way TCV is throttling open to admit more oil thru the heat exchanger.

4.

Licensee changed the question. New question is SAT.

32 H

2 X

E 264000 K1.07 S

1.

Cred Oist: "A" (8 seconds) is not plausible because there is no electricity to the pumps yet. The stem states that the diesels energize the busses at 10 seconds. Since the site has lost power and the diesels haven't yet energized the busses, then there is no electricity available to the LPCI pumps.

2.

Ask the licensee when the diesels (what time) will auto-start based on the sequence of events. Discuss wi licensee.

3.

Re-worked the time choices to eliminate 8 seconds. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/E Cred.

Partial Job-Minutia

1. 1 Back-0=

SRO BIMIN UIEIS Explanation Focus Dist.

Link units ward K/A Only 33 H

2 X

X x

E 272000 K 3.05, Bank, High S

Cred Dist:

D is not plausible because IF the A SJAE rad monitor is in the INOP position (as stated in the stem) and then the B SJAE rad monitor lost power, THEN any subsequent hi-hi rad condition could never have any effect because there are only the two rad monitors and theyre both out of service.

C is not plausible because of the word irrespective, i.e., its not logical for a system design that would allow the charcoal filters to be continuously bypassed irrespective of any radiation condition.

Suggest keeping the 1 st part of A and B and testing the applicants knowledge of another piece of knowledge associated such as the expected position of the inlet/outlet isolation valves or system flow indication.

2.

Job-Link: Is it acceptable to perform PT-4.1.7 when AOG is bypassed and a ODCM compensatory measure is required? Is it acceptable in accordance with ODCM 7.3.10 to operate the unit indefinitely when the AOG system is bypassed?

Ask the licensee whether either unit has continuously operated with AOG bypassed.

Discuss the feasibility of performing this type of test when the AOG is bypassed w/ licensee.

3.

Cue: Re word the stem as follows to avoid cueing the applicant to the status of the AOG system, instead, provide the position of the valve:

Unit 1 is operating at 100% power with the AOG SYSTEM BYPASS VALVE, AOG-HCV-102, in the OPEN position and the control switch located at Panel XU-80 is in the AUTO position.

4.

Licensee re-worked th&question. Comments incorporated. Question isSAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 33 H

2 X

X X

E 272000 K 3.05, Bank, High S

1.

Cred Dist: "0" is not plausible because IF the A SJAE rad monitor is in the INOP position (as stated in the stem) and then the B SJAE rad monitor lost power, THEN any subsequent hi-hi rad condition could never have any effect because there are only the two rad monitors and they're both out of service.

"C" is not plausible because of the word irrespective, i.e., it's not logical for a system design that would allow the charcoal filters to be continuouslv bypassed irrespective of any radiation condition.

Suggest keeping the 1 st part of "A" and "B" and testing the applicants knowledge of another piece of knowledge associated such as the expected position of the inlet/outlet isolation valves or system flow indication.

2.

Job-Link: Is it acceptable to perform PT -4.1.7 when AOG is bypassed and a ODCM compensatory measure is required? Is it acceptable in accordance with ODCM 7.3.10 to operate the unit indefinitely when the AOG system is bypassed? Ask the licensee whether either unit has continuously operated with AOG bypassed.

Discuss the feasibility of performing this type of test when the AOG is bypassed wI licensee.

3.

Cue: Re word the stem as follows to avoid cueing the applicant to the status of the AOG system, instead, provide the position of the valve:

Unit 1 is operating at 100% power with the AOG SYSTEM BYPASS VALVE, AOG-HCV-102, in the OPEN position and the control switch located at Panel XU-80 is in the AUTO position.

4.

Licensee re-worked the'qyestion. Comments incorporated. Question is'SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

r T

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Qt SRO B/M/N U/E/S Explanation Focus Link!

units ward KIA Only 34 H

2 X

E 288000 K1.04, Bank, High 1.

Stem Focus: Add parenthesis after the stem question (Assume each fan is started one-at-a-time) to preclude an applicant stating that the total starting current may exceed the loading capability.

2.

Stem Focus: Re-word the stem question as follows to ensure clarity with respect to the 3850 KW value and number/type of fans being started:

WOOTF identifies whether the maximum allowed diesel generator load will be exceeded if two supply fans and two exhaust fans are powered from MCC 1XG and one supply fan and one exhaust fan are powered from MCC IXH?

(Assume each fan is started one at a time.)

3.

Comments incorporated. Question is SAT.

35 H

2 x

x U

290002 G2.04.46, New 1.

Cred Dist:

A, B, and D are not plausible because C (correct answer) is the only choice that deals with the vessel.

B and D are not plausible because theres no way that these conditions can be received without first getting C. (subset issue too)

Suggest testing the applicants knowledge of when the RPV Flange Seal LeaK alarm will be received (600 psig vs some other plausible pressure) and which additional alarm represents a failure of both 0-rings (Seal Leakage Flow Detection Hi (wrong) OR PRI CTMT Hl/LO PRESS (right))

2.

1. /units: Ensure that the annunciator location is provided in parenthesis following each alarm. For the exam, ensure that the exact annunciator window wording is used for all alarms (this question looks acceptable from the perspective of the wording on the alarms).

3.

Question re-worked to test applicants knowledge of which 0-ring had failed and the type of instrumentation used to detect this failure. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 8ack-Q=

SRO 8/M/N U/E/S Explanation Focus Dis!.

Link units ward KIA Only 34 H

2 X

E 288000 K1.04, 8ank, High

1.

Stem Focus: Add parenthesis after the stem question (Assume each fan is started one-at-a-time) to preclude an applicant stating that the total starting current may exceed the loading capability.

2.

Stem Focus: Re-word the stem question as follows to ensure clarity with respect to the 3850 KW value and number/type of fans being started:

WOOTF identifies whether the maximum allowed diesel generator load will be exceeded if:

. two supply fans and two exhaust fans are powered from MCC1XG and

. one supply fan and one exhaust fan are powered from MCC 1XH?

(Assume each fan is started one at a time.)

3.

Comments incorporated. Question is SAT.

35 H

2 X

X U

290002 G2.04.46, New S

1.

Cred Dis!: "A", "8", and "D" are not plausible because "C" (correct answer) is the only choice that deals with the vessel.

"8" and "0" are not plausible because there's no way that these conditions can be received without first getting "C." (subset issue too)

Suggest testing the applicants' knowledge of when the RPV Flange Seal Leak,alarm will be received (600 ps\\g vs some r

other plausible pres,sure) and which additional alarm represents a failure of both O-rings (Seal Leakage Flow Detection Hi (wrong) OR PRI CTMT HIILO PRESS (right))

2.

1. /units: Ensure that the annunciator location is provided in parenthesis follOwing each alarm. For the exam, ensure that the exact annunciator Window wording is used for all alarms (this question looks acceptable from the perspective of the wording on the alarms).

3.

Question re-worked to test applicants' knowledge of which 0-ring had failed and the type of instrumentation used to detect this failure. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN U/EIS Explanation Focus Dist.

Link units ward K/A Only 36 F

2 X

E 290003 K4.01, New S

1.

Stem Focus: Add the alarm window location in parenthesis after alarm window names provided in each choice. Ensure that the alarm wording is exactly as provided on the control board.

2.

Stem Focus: spell out the word auto (automatically) and CREV (Control Room Emerg...)

3.

Stem Focus: Re-word the stem question to ask the following:

Which ONE of the following valid alarm conditions will result in an automatic start of the CREV? (consider each choice separately) 4.

Comment incorporated. Question is SAT.

37 F

1 U

295001 K1.03, Bank S

1.

LOD = 1: This question can be answered solely using the knowledge associated with the generic fundamentals exam section; i.e., when core flow goes down, the power that will cause transition boiling goes down. This is the plant specific written exam; therefore, the question should be associated with a plant specific knowledge.

2.

Question re-worked to test applicants knowledge of 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action associated with adjusting thermal limits following a single recirc pump trip.

38 H

2 X

X E

295003 A2.05, New 1.

Partial: An applicant can also argue that B is correct because it is not necessarily wrong to enter AOP-36.1 t7rst..and THEN transition over to AOP-36.2. Because the choices arent exclusive, then there is more than one 6orrect answer.

2.

Stem Focus: In the initial conditions, provide a list of all of the breaker;indications associated with theSAT and UAT transformers, and switchyard PCB5 to test the applicants ability to determine the AC power availability based on control board indications.

3.

Licensee re-worked question. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 36 F

2 X

E 290003 K4.01, New S

1.

Stem Focus: Add the alarm window location in parenthesis after alarm window names provided in each choice. Ensure that the alarm wording is exactly as provided on the control board.

2.

Stem Focus: spell out the word "auto" (automatically) and CREV (Control Room Emerg... )

3.

Stem Focus: Re-word the stem question to ask the following:

"Which ONE ofthe following valid alarm conditions will result in an automatic start of the CREV?" (consider each choice separately)

4.

Comment incorporated. Question is SAT.

37 F

1 U

295001 K1.03, Bank S

1.

LOD = 1: This question can be answered solely using the knowiedge associated with the generic fundamentals exam section; i.e., when core flow goes down, the power that will cause transition boiling goes down. This is the plant specific written exam; therefore, the question should be associated with a plant specific knowledge.

2.

Question re-worked to test applicants knowiedge of 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action associated with adjusting thermal limits following a single recirc pump trip.

38 H

2 X

X E

295003 A2.05, New

1.

Partial: An applicant can also argue that "B" is correct because it is not necessarily wrong to enter AQP-36.1 first.. and THEN transition over to AOP-36.2. Because' the choices aren't exclusive, then there is more than one correct answer.

2.

Stem Focus: In the initial conditions, provide a list of all of the breaker',indications associated with the,SAT and UAT transformers, and switchyard PCBs to test the applicants' ability to determine the AC power availability based on control board indications.

3.

Licensee re-worked question. Question is SAT.

L......---_

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/EIS Explanation Focus Dist.

Link units ward K/A Only 39 H

2 X

E 295004 A1.02, Bank S

1.

Stem Focus: State that HPCI and RCIC are being used to restore level and THEN a loss of Battery Bus 2A-1 and 2A-2 subsequently occurs. This will provide a timeline to ensure that the applicant assesses the subsequent loss of the battery busses on HPCIIRCIC operation. As currently written, it is unclear which comes first, the HPCI and RCIC running or the loss of the battery boards.

2.

Stem Focus: The word correctly is not necessary to elicit the correct response since the stem question states which ONE of the following...

3.

Stem Focus: Re-word the stem question as follows: Given these plant conditions, WOOTF choices completes both statements?

4.

Stem Focus: Re-word the fill-in-the-blank statement to ask the applicant about the capability to trip on high water level (maintained or not). As written, the applicant may be confused that he/she is supposed to know the actual RPV water trend.

5.

Stem Focus: Ask the licensee why the wording associated with RCIC tripping on high water level is different than the wording associated with HPCI tripping on high water level.

6.

Comments incorporated. Question is SAT.

40 H

2 S

2950005A1.07,Bank

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N U/E/S Explanation Focus Dis!.

Link units ward KIA Only 39 H

2 X

E 295004 A 1.02, Bank S

1.

Stem Focus: State that HPCI and RCIC are being used to restore level and THEN a loss of Battery Bus 2A-1 and 2A-2 subsequently occurs. This will provide a timeline to ensure that the applicant assesses the subsequent loss of the battery busses on HPCI/RCIC operation. As currently written, it is unclear which comes first, the HPCI and RCIC running or the loss of the battery boards.

2.

Stem Focus: The word "correctly" is not necessary to elicit the correct response since the stem question states which ONE of the following...

3.

Stem Focus: Re-word the stem question as follows: Given these plant conditions, WOOTF choices completes both statements?

4.

Stem Focus: Re-word the fill-in-the-blank statement to ask the applicant about the capability to trip on high water level (maintained or not). As written, the applicant may be confused that he/she is supposed to know the actual RPV water trend.

5.

Stem Focus: Ask the licensee why the wording associated with RCIC tripping on high water level is different than the wording associated with HPCI tripping on high water level.

6.

Comments incorporated. Question is SAT.

40 H

2 S

2950005 A 1.07, Bank

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q SRO B/M/N UIE/S Explanation Focus Dist.

Link units ward K/A Only 41 F

2 U

1.

QK/A: The K/A is testing the applicants knowledge of the definition of SHUTDOWN MARGIN in Tech Specs. The ATINS E

condition on Unit 2 is not related NOR is it needed to choose the s

correct answer. The K/A is supposed to test the applicants knowledge of the ATWS condition as it relates to shutdown margin. Section 295006 in the K/A catalog is reserved specifically for the ATWS abnormal condition in BWRs and is a Tier 1 topic in the written exam sample plan. The question must test the applicants knowledge of an ATWS. As written, the question only tests the applicants recall of the Tech Spec definition of shutdown margin. Suggest changing the stem to make one of the other choices correct and this may hit the K/A, i.e., required minimum tank level at which a cooldown can be commenced.

2.

Chief Examiner didnt see that K/A was for Scram (NOT the ATWS condition discussed above.). Question was originally ENHANCEMENT. Licensee subsequently resolved by listing 9 rods at position 02 and testing applicants knowledge of whether shutdown and the required procedure to insert rods.

42 F

1 X

X E

295008,K1.01 1.

LOD=1 and/or (borderline) Q=KA: The proposed test item may not meet the intent of the KA because it does not test the applicants knowledge of the so what if lower steam quality exiting the vessel, i.e., the operational implications. Suggest testing the applicants knowledge of the operational implication:

turbine damage (correct) vs NPSH (incorrect).

2.

Stem Focus: The word correctly is not necessary to elicit the correct response because the stem states which ONE of the following.

3.

Comments incorporated. Question is SAT 43 H

2 E

295014,A2.03 S

1.

Stem Focus: Re-word A to state: An uncoupled control rod which was inserted at position 06 drops to position 48.

2.

Stem Focus: Re-word C to state: Following the start of a circulating water pump, the 2A Recirc Pump speed rises from 62% to 64% speed.

3.

Stem Focus: Provide the initial and final values of core thermal power and main generator electrical output in the stem.

4.

Comments incorporated. Question is SAT.

i.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 41 F

2 U

1.

Q=KlA: The KIA is testing the applicants' knowledge of the E

definition of SHUTDOWN MARGIN in Tech Specs. The ATWS condition on Unit 2 is not related NOR is it needed to choose the S

correct answer. The KIA is supposed to test the applicants' knowledge of the A TWS condition as it relates to shutdown margin. Section 295006 in the KIA catalog is reserved specifically for the A TWS abnormal condition in BWRs and is a Tier 1 topic in the written exam sample plan. The question must test the applicants' knowledge of an A TWS. As written, the question only tests the applicants' recall of the Tech Spec definition of shutdown margin. Suggest changing the stem to make one of the other choices correct and this may hit the KIA, i.e., required minimum tank level at which a cooldown can be commenced.

2.

Chief Examiner didn't see that KIA was for "Scram" (NOT the ATWS condition discussed above.). Question was originally ENHANCEMENT. Licensee subsequently resolved by listing 9 rods at position 02 and testing applicants' knowledge of whether shutdown and the required procedure to insert rods.

42 F

1 X

X E

295008, K1.01 S

1.

LOD=1 and/or (borderline) Q=KA: The proposed test item may not meet the intent of the KA because it does not test the applicants' knowledge of the "so what" if lower steam quality exiting the vessel, i.e., the operational implications. Suggest testing the applicant's knowledge of the operational implication:

turbine damage (correct) vs NPSH (incorrect).

I O.

2.

Stem Focus: The word "correctly" is not necessary to elicit the 0

correct response because the stem states which ONE of the following.

3.

Comments incorporated. Question is SAT 43 H

2 X

E 295014, A2.03 S

1.

Stem Focus: Re-word "A" to state: An uncoupled control rod which was inserted at position 06 drops to position 48.

2.

Stem Focus: Re-word "C" to state: Following the start of a circulating water pump, the 2A Recirc Pump speed rises from 62% to 64% speed.

3.

Stem Focus: Provide the initial and final values of core thermal power and main generator electrical output in the stem.

4.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q SRO B/MIN UIEIS Explanation Focus Dist.

Link units ward K/A Only 44 F

2 X

E 295015K3.O1,New S

1.

Partial; An applicant can successfully argue that A and B are also correct because RWM does input to the RMCS to initiate SELECT BLOCKS. The LEP-02 procedure provides guidance to override ALL blocks generated from the RWM to allow control rods to be selected and inserted. Suggest the following:

WOOTF choices completes both statements in accordance with LEP-02, Alternate Control Rod Insertion?

The RWM is bypassed using the The reason that the RWM is bypassed position is because the A.

Keylock switch; Emergency Rod In Switch will not work when an Insert Block exists B.

Joystick; Emergency Rod In Switch will not work when an Insert Block exists C.

Keylock switch; Mode Switch in Shutdown generates a control rod block D.

Joystick; Mode Switch in Shutdown generates a control rod block 2.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q= SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only I~~====~==*===~==~==*===~===*===*====*===~==~==*===~==~===*========================================~

44 F

2 X

E 295015 K3.01, New S

1.

Partial: An applicant can successfully argue that "A" and "B" are I

also correct because RWM does input to the RMCS to initiate SELECT BLOCKS. The LEP-02 procedure provides guidance I

to override ALL blocks generated from the RWM to allow control rods to be selected and inserted. Suggest the following:

WOOTF choices completes both statements in accordance with LEP-02, Alternate Control Rod Insertion?

The RWM is bypassed using the __ _

The reason that the RWM is bypassed position is because the A.

Keylock switch; Emergency Rod In Switch will not work when an Insert Block exists B.

Joystick; Emergency Rod In Switch will not work when an Insert Block exists C.

Keylock switch; Mode Switch in Shutdown generates a control rod block D.

Joystick; Mode Switch in Shutdown generates a control rod block

_. ___ '-----_.. ______ L...

~2. _

Com~nt:'inc~rporated. Question is SAT.

~

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UIEIS Explanation Focus Dist.

Link units ward K/A Only 45 F

2 S

S E

295016G2.4.1,New S

1.

Note:

It is acceptable to apply this generic K/A to the Control Room Abandonment AOP since no EOP for control room abandonment exists at Brunswick.

2.

Cred Dist: A and B are not plausible because the stem does not include information that could be mis-interpreted as a requirement to enter the ASSD network, i.e. no fire anywhere.

Also, C and D are the only choices that include the phrase control room which is similar to the first two words in the question.

This combination makes A and B not plausible.

Suggest including information that a heater drain pump room fire is in progress and an unrelated toxic gas enters the control room.

Suggest testing the applicants knowledge of the next required action lAW AOP-32 (for Unit 1) once the turbine has been tripped. See the following choices:

A. Immediately place the mode switch to shutdown B. Wait until steam flow is 3x10 Ibm/hr THEN place the mode switch to shutdown C. Trip both Recirc Pumps D. Manually scram the reactor 3.

Stem Focus: The word correctly is not necessary to elicit the correct response because the stem states which ONE of the following.

4.

Discuss w/ licensee whether question is F or H level of knowledge.

5.

Licensee re-wQrked question. Question is 46 F

2 X

X E

295018 A1.02 S

1 Cred Dist: D is not plausible because it is not a system load such as a pump. Suggest changing this choice to indefinately

and re-word the stem question as follows:

2.

Stem Focus: The stem question should include the phrase without cooling water. Re-word the stem as follows:

A manual reactor scram was performed on Unit 2 foiowing a complete loss of RBCCW WOOTF identifies MAXIMUM time that a CRD pump can be operated without coo/hg water in accordance with OAOP-16.O, RBCCW System Failure?

3.

Comments incorporated. Question is SAT.

~~-

.. _------ -.---... ------~--~---~----

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 45 F

2 S

S E

295016 G2.4.1, New S

1.

Note: It is acceptable to apply this generic KIA to the Control Room Abandonment AOP since no EOP for control room abandonment exists at Brunswick.

2.

Cred Dist: "A" and "B" are not plausible because the stem does not include information that could be mis-interpreted as a requirement to enter the ASSD network, i.e. no fire anywhere.

Also, "c" and "0" are the only choices that include the phrase "control room" which is similar to the first two words in the question. This combination makes "A" and "B" not plausible.

Suggest including information that a heater drain pump room fire is in progress and an unrelated toxic gas enters the control room.

Suggest testing the applicants' knowledge of the next required action lAW AOP-32 (for Unit 1) once the turbine has been tripped. See the following choices:

A. Immediately place the mode switch to shutdown B. Wait until steam flow is 3x10 Ibmlhr THEN place the mode switch to shutdown C. Trip both Recirc Pumps D. Manually scram the reactor

3.

Stem Focus: The word "correctly" is not necessary to elicit the correct response because the stem states which ONE of the following.

4.

Discuss wI licensee whether question is F or H level of knowledge.

5.

Licensee re-~Qrked question. Question is SAT.

46 F

2 X

X E

295018 A 1.02 t

~

S

1.

Cred Dist: "[3" is not plausible because it is not a system load such as a pump. Suggest changing this choice to 'indefinately" and re-word the stem question as follows:

2.

Stem Focus: The stem question should include the phrase "without cooling water." Re-word the stem as follows:

A manual reactor scram was performed on Unit 2 following a complete loss of RBCCW WOOTF identifies MAXIMUM time that a CRD pump can be operated without cooling water in accordance with OA OP-16. 0, RBCCW System Failure?

3.

Comments incorporated. Question is SAT.

-_._- L ____ ------ -

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UIEIS Explanation Focus Dist.

Link units ward K/A Only 47 F

2 X

X E

295019 02.2.37, Bank Partial:

A can also be argued as correct if the applicant interprets the question to ask for the initial effect on the MSIVS, i.e., the accumulators will hold the MSIV open initially. Discuss WI licensee.

2.

Stem Focus: Re-word the l sentence to be precise for the header that has depressurized, i.e., the Pneumatic Nitrogen Supply is not affected. Discuss the following WI licensee:

The unit is operating at 100% power.

The Unit 2 Non Interruptible Instrument Air (RNA) Header pressure has lowered to 65 psig due to a leak.

WOOTF predicts how the Outboard MSIVs will be affected if the RNA Header pressure remains at this value, including the reason?

A.

Remain open; the Pneumatic Nitrogen System is supplying the valve actuators in Mode I B.

Remain open; the Backup Nitrogen System is automatically re-aligned to the valve actuators C.

Immediately close due to an automatic isolation signal D.

Eventually drift closed due to the diminishing pneumatic supply to the actuator 3.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 47 F

2 X

X E

295019 G2.2.37, Bank S

1.

Partial: "A" can also be argued as correct if the applicant interprets the question to ask for the initial effect on the MSIVS, i.e., the accumulators will hold the MSIV open initially. Discuss wI licensee.

2.

Stem Focus: Re-word the 1 st sentence to be precise for the header that has depressurized, i.e., the Pneumatic Nitrogen Supply is not affected. Discuss the following wI licensee:

The unit is operating at 100% power. The Unit 2 Non-Interruptible Instrument Air (RNA) Header pressure has lowered to 65 psig due to a leak.

WOOTF predicts how the Outboard MSIVs will be affected if the RNA Header pressure remains at this value, including the reason?

A.

Remain open; the Pneumatic Nitrogen System is supplying the valve actuators in Mode 1 B.

Remain open; the Backup Nitrogen System is automatically re-aligned to the valve actuators C.

Immediately close due to an automatic isolation signal D.

Eventually drift closed due to the diminishing pneumatic supply to the actuator

3.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 48 H

2 X

E 295020 G2.4.1 Note: Typically, the easiest way to hit the Inadvertent Containment Isolation K/A category is to write a question involving the trip of one RPS MG set.

Note: The licensee stated that the Brunswick EOPs do not have any immediate operator actions, so the question was written for only the EOP entry portion of the Generic K/A statement> Knowledge of EOP entry conditions and Immediate actions steps. This approach (testing applicants knowledge of EOP entry conditions) will work; however, discuss W/ licensee the option to test applicants knowledge of those actions in the EOP network which require immediate action, e.g.., unsafe region of graph requiring ED or ATWS conditions requiring immediate action to lower level. The term immediate actions steps is not exclusively referring to operation immediate actions in AOPs.

1.

Job-Link: An applicant can successfully argue that this question is invalid because following a reactor scram and inadvertent Group 1 isolation, the RVCP flowchart has already been entered. Even though the stem question specifically asks the applicants to identify the latest time before a manual reactor scram is required due to high torus temperature, this is irrelevant at the point when the scram and group 1 occurred.

Suggest writing a question where an RPS MG set tripped and causes a SCCP flowchart or PCCP flowchart entry condition.

Alternatively, write a question for a RIP valve penetration that is inadvertently closed during testing activities, that causes a half scram signal (alarm) in conjunction with some other plant condition that results in a full scram signal where the scram does not occur.

2.

Licensee wrote question to test applicants knowledge of 1 torus temp requiring PCCP entry and any additional EOP requirements. Queslion is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UlE/S Explanation Focus Dist.

Link units ward KIA Only 48 H

2 X

E 295020 G2.4.1 Note: Typically, the easiest way to hit the "Inadvertent Containment Isolation" KIA category is to write a question involving the trip of one RPS MG set.

Note: The licensee stated that the Brunswick EOPs do not have any immediate operator actions, so the question was written for only the EOP entry portion of the Generic KIA statement> "Knowledge of EOP entry conditions and Immediate actions steps". This approach (testing applicants' knowledge of EOP entry conditions) will work; however, discuss wI licensee the option to test applicants' knowledge of those actions in the EOP network which require immediate action, e.g.., unsafe region of graph requiring ED or ATWS conditions requiring immediate action to lower level. The term "immediate actions steps" is not exclusively referring to operation immediate actions in AOPs.

1.

Job-Link: An applicant can successfully argue that this question is invalid because following a reactor scram and inadvertent Group 1 isolation, the RVCP flowchart has already been entered. Even though the stem question specifically asks the applicants to identify the latest time before a manual reactor scram is required due to high torus temperature, this is irrelevant at the point when the scram and group 1 occurred.

Suggest writing a question where an RPS MG set tripped and causes a SCCP flowchart or PCCP flowchart entry condition.

Alternatively, write a question for a RIP valve penetration that is inadvertently closed during testing activities, that causes a half scram signal (alarm) in conjunction with some other plant condition that result,s in a full scram signal where the scram does not occur.

2.

Licensee wrote question to test applicants' knowledge of 1st torus temp requiring PCCP entry and any additional EOP requirements. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KJA Only 49 H

2 X

M U

295021 A2.02 s

1.

There are several problems with this test question, which preclude it from being used on the exam. Chief Examiner grade as U.

2.

Partial: A can be successfully argued as correct because if shutdown cooling is lost, eventually the vessel will re-pressurize into Mode 3.

3.

Partial:

B can be successfully argued as correct because if vessel level was decreasing, then the REACTOR WATER LEVEL HIGH/LOW annunciator would be in alarm, even at the point at which the low level isolation occurred.

4.

Partial: An applicant can successfully argue that there is no correct answer because the way choice C is worded implies that the alarm is intermittently clearing and re-alarming. This choice should be re-worded as Annunciator CORE SPRAYOR RHR PUMPS RUNNING begins flashing, i.e., clears.

5.

Licensee replaced question with one testing alternate shutdown cooling knowledges. New Question is SAT.

50 F

1 x

U 295023 K3.03 Low, Bank s

1. Cred Dist: Second part of C & D is not plausible because a ground level release will never be a reason for starting SBGT because this affects the general population.

2. LOD1: This question will not discriminate.

Suggest writing a question to test the applicants knowledge of the required actions from AOP-5.0 following a dropped fuel bundle, including the reason why CREV is an immediate operator action.

3.

Ensure final version does not overlap with Q 57 & 59 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

4.

Licensee re-workedto test applicants knowledge Of whether the auto isolation occurred and the reason why isolation is required.

Question is SAT.

51 H

3 X

X E

295024 G2.02.37 High, New

1. Cred Dist:

B is not plausible because the HPCI turbine is still tripped, i.e., opening the discharge valve wont cause injection.

2. Stem Focus: Re-word D to:

nly if the High Water Level Signal Reset Pushbutton is depressed FIRST and the Injection Valve manually opened.

3.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N U/E/S Explanation Focus Dis!.

Link units ward KIA Only 49 H

2 X

M U

295021 A2.02 S

1.

There are several problems with this test question, which preclude it from being used on the exam. Chief Examiner grade as "U."

2.

Partial: "A" can be successfully argued as correct because if shutdown cooling is lost, eventually the vessel will re-pressurize into Mode 3.

3.

Partial: "B" can be successfully argued as correct because if vessel level was decreasing, then the REACTOR WATER LEVEL HIGH/LOW annunciator would be in alarm, even at the point at which the low level isolation occurred.

4.

Partial: An applicant can successfully argue that there is no correct answer because the way choice "C" is worded implies that the alarm is intermittently clearing and re-alarming. This choice should be re-worded as "Annunciator CORE SPRA Y OR RHR PUMPS RUNNING begins flashing, i.e., clears.

5.

Licensee replaced question with one testing alternate shutdown cooling knowledges. New Question is SAT.

50 F

1 X

U 295023 K3.03 Low, Bank S

1. Cred Dis!: Second part of C & 0 is not plausible because a "ground level" release will never be a reason for starting SBGT because this affects the general population.

2. LOD=1: This question will not discriminate.

Suggest writing a question to test the applicants' knowledge of the required actions from AOP-5.0 following a dropped fuel bundle, including the reason why CREV is an immediate operajor action.

~

3.

Ensure final version does not overlap with Q 57 & 59 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

1

~

4.

Licensee re-worked'to test applicants' knowledge of whether the auto isolation occurI;,ed and the reason why isolatioll is required.

Question is SAT.

51 H

3 X

X E

295024 G2.02.37 High, New S

1. Cred Dis!: B is not plausible because the HPCI turbine is still tripped, i.e., opening the discharge valve won't cause injection.

2. Stem Focus: Re-word "0" to:

"only if the High Water Level Signal Reset Pushbutton is depressed FIRST and the Injection Valve manually opened."

3.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(FIH)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UIEIS Explanation Focus Dist.

Link units ward K/A Only 52 H

3 X

X E

295025 A2.05 High, New s

1. Stem Focus: The 2 part of the stem question is difficult to understand because of the word this decision and the phrase regardless of off-site power status.

2. Stem Focus:

It may not be clear to the applicants that the question is NOT asking about inventory makeup, i.e., the design of RCIC to accommodate inventory at the 15 minute point after a scram is a very high plausibility answer if the applicant does not see that the stem question is asking for reactor pressure control.

3. Cred Dist: D is not plausible because it suggests that HPCI and RCIC can provide enough steam flow immediately after a scram and it takes 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> to be within the capacity of just HPCI.

4. Cred Dist: Second part of A & C are not plausible because they dont answer the question.

5. Discuss a cleaner way to ask a 2 part question w/ the licensee.

6. Licensee re-worked question. Question is SAT.

53 H

3 X

X E

295026 A1.01 High, New

1. Stem Focus: Ensure that C and D are worded to imply a sequence; i.e., use the word first.

2. #/units: Ensure that the exact label wording for the Think Switch and the 2/3 core height switches are provided in this question. Do NOT use the word Think switch.

3. Licensee stated that label says Think Switch. Comments incorporated. Question is SAT.

54 F

2 x

x x

U 295028 K3.05 Low, New 1.

Backwards Logic: This 2-part question l disjointed because it mixes the requirement for a scram with the actions needed before initiating drywell sprays.

2.

Partial: C can also be argued as correct because if temperature cannot be restored and maintained less than 300 degrees a scram is also required.

3.

Cred Dist: The 2 part ofA and C should say reactor operation at power is not allowed or desired without recirc pumps in service. f--- this is the REASON for the scram lAW 01-37.8.

If the 2 part is worded as such, then the drywell cooler distracter choices dont make sense.

4.

Licensee re-worked question. Question is SAT.

!i i

i i

i i

i i

i

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 52 H

3 X

X E

295025 A2.05 High, New S

1. Stem Focus: The 2 nd part of the stem question is difficult to understand because of the word "this decision" and the phrase "regardless of off-site power status."

2. Stem Focus: It may not be clear to the applicants' that the question is NOT asking about inventory makeup, i.e., the design of RCIC to accommodate inventory at the 15 minute point after a scram is a very high plausibility answer if the applicant does not see that the stem question is asking for reactor pressure control.

3. Cred Dist: 0 is not plausible because it suggests that HPCI and RCIC can provide enough steam flow immediately after a scram and it takes 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> to be within the capacity of just HPCI.

4. Cred Dist: Second part of A & C are not plausible because they don't answer the question.

5. Discuss a cleaner way to ask a 2 part question wi the licensee.

6. Licensee re-worked question. Question is SAT.

53 H

3 X

X E

295026 A 1.01 High, New S

1. Stem Focus: Ensure that "C" and "0" are worded to imply a sequence; i.e., use the word "first."

2. #/units: Ensure that the exact label wording for the Think Switch and the 2/3 core height switches are provided in this question. Do NOT use the word "Think" switch.

3. Licensee stated that label says "Think Switch". Comments incorporated. Question is SAT.

54 F

2 X

X X

U 295028 K3.05 Low, New S

1.

Backwards Logic: This 2-part question is disjointed because it mixes the requirement for a scram with the actions needed before i~itiating drywell sprays.

2.

Partial: "C" can also be argued as correct because if temperature cannot be restored and maintained less than 300

/

degrees a scram is also required.

3.

Cred Dist: The 2 nd part of "A" and "C" should say "reactor operation at power is not allowed or desired without recirc pumps in service." ~-- this is the REASON for the scram lAW 01-37.8. If the 2nd part is worded as such, then the drywell cooler distracter choices don't make sense.

4.

Licensee re-worked question. Question is SAT.

L.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

1 (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q I SRO BIMIN U/EIS Explanation Focus Dist.

Link units ward K/A jonly 55 F

2 X

E 295030 K2.09 Low, New S

1.

Cred Dist: Cyan is not plausible because there is no information in the stem that suggests that the input would be bad. Suggest making a 2-part question keeping the yellow and red display answers but including another knowledge item associated with the SPDS display 2.

Licensee pointed out that Cyan is one of the colors listed on the process computer. Question is SAT.

56 F

2 x

x E

295031 K3.03 High, New S

1.

Partial: The stem of the question creates a subset issue in that if 4700 gpm would provide adequate core cooling, then 5000 gpm surely would. Suggest re-wording the fill-in-the-blank statement as follows:

WOOTF completes the statement/n accordance with OEOP1-UG?

With reactor water level at the the minimum required injection rate from one core spray pump to ensure adequate core cooling is A.

jet pump suction, 4700 gpm B.

jet pump suction, 5000 gpm C.

fop of active fuel, 4700 gpm D.

fop of active fuel, 5000 gpm 2.

Stem Focus: Incorporate the Users Guide name and number in the stem as in accordance with OEOP-01 -UG 3.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 55 F

2 X

E 295030 K2.09 Low, New S

1.

Cred Dist: Cyan is not plausible because there is no information in the stem that suggests that the input would be bad. Suggest making a 2-part question keeping the yellow and red display answers but including another knowledge item associated wlth the SPDS display

2.

Licensee pointed out that Cyan is one of the colors listed on the process computer. Question is SAT.

56 F

2 x

x E

295031 K3.03 High, New S

1.

Partial: The stem of the question creates a subset issue in that if 4700 gpm would provide adequate core cooling, then 5000 gpm surely would. Suggest re-wording the fill-in-the-blank statement as follows:

WOOTF completes the statement in accordance with OEOP UG?

'With reactor water level at the

, the minimum required injection rate from one core spray pump to ensure adequate core cooling is ___."

A.

jet pump suction, 4700 gpm B.

jet pump suction, 5000 gpm C.

top of active fuel, 4700 gpm D.

top of active fuel, 5000 gpm

2.

Stem Focus: Incorporate the User's Guide name and number in the stem as "in accordance with OEOP-01-UG

3.

Comments incorporated.' Question is SAT.

e 0"

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 57 H

2 X

X E

295032 K2.02 High, New S

1. Note: Ensure no Overlap with # 59 and 50 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

2. Cred Dist: The 2 d part of B is not plausible, i.e., continuing to operate HVAC because the rad monitor reading are not reliable is not logical.

2. Stem Focus: The stem question does not elicit the 2 part of the choices. Split out each choice as follows:

A. Continue to operate HVAC; B. Continue to operate HVAC; C. Isolate HVAC and start SBGT; D. Isolate HVAC and start SBGT;

3. Licensee re-worked to test applicants knowledge of whether to continue or to ensure isolation, including the reason. Question is SAT.

58 H

3 X

X E

295033 Al.05 High, New 1.

Partial: An applicant can successfully argue that D is correct because RWCU is supposed to auto-isolate; therefore, it is always right to ensure automatic actions occur. Also, the applicant can argue that not enough information is presented in the stem to absolutely pinpoint the leak on the SDV. There could be other sources that an applicant can argue. Discuss the following with the licensee:

WOOTF identifies the source of the leak and the required actions?

A.

SDV; open 7ADS valves B.

RBCCVv open 7ADS valves C.

SDV; cooldown with Tech spec limits D.

RBCCV4 cooloown within Tech spec limits 2.

Stem Focus: Change the Rad and Temperature values to approaching max safe.

3.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 57 H

2 X

X E

295032 K2.02 High, New S

1. Note: Ensure no Overlap with # 59 and 50 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

2. Cred Dist: The 2 nd part of "B" is not plausible, i.e., continuing to operate HVAC because the rad monitor reading are not reliable is not logical.

2. Stem Focus: The stem question does not elicit the 2 nd part of the choices. Split out each choice as follows:

A. Continue to operate HVAC; B. Continue to operate HVAC; C. Isolate HVAC and start SBGT; D. Isolate HVAC and start SBGT;

3. Licensee re-worked to test applicants' knowledge of whether to continue or to ensure isolation, including the reason. Question is SAT.

58 H

3 X

X E

295033 A 1.05 High, New S

1.

Partial: An applicant can successfully argue that "0" is correct because RWCU is supposed to auto-isolate; therefore, it is always right to ensure automatic actions occur. Also, the applicant can argue that not enough information is presented in the stem to absolutely pinpoint the leak on the SDV. There could be other sources that an applicant can argue. Discuss the following with the licensee:

WOOTF identifies the source of the leak and the required actions?

A.

SDV; open 7 ADS valves B.

RBCCW; open 7 ADS valves C.

SDV; cooldown with Tech spec limits D.

RBCCW; cooletown within Tech spec limits

2.

Stem Focus: Change the Rad and Temperature values to "approaching max safe."

3.

Comments incorporated. Question is SAT.

~-.. --,

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cuesi T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 59 F

2 X

X E

295035 A1.01 Low, Bank S

1. Ensure no overlap with 57 & 50 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

2. Cred Dist: A is not plausible because the choice does not provide the location of the area rad monitor, i.e., A only states the alarm window but should also state the rad monitor location causing the alarm (a plausible one). As written, the ARM could be anhere in the Rx Bldg.

3. Stem Focus: Re-word the stem question to include the phrase a condition that automatically trips the Reactor Building..

Alternatively, consider the following:

The unit is operating at 100% power and the following alarm is received:

RX BLDG DIFF PRESS HIGH/LOW WOOTF completes the following statement?

The Reactor Building Supply and Exhaust Fans________ receive a trip signal and the Standby Gas Treatment System receive a start signal.

A. will / will B. will! will NOT C. will NOT/will D. will NOT/will NOT

4. Comments incorporated. Question is SAT.

60 F

1

x U

295037 K1.03 I,ow, New S

1. LOD=1: An applicant can answer this question based on the knowledge from the generic fundamentals exam section. This is the plant specific whtten exam.

2. Cred Dist: Aand B are not plausible because voids are not a positive reactivity effect.

3. Licensee re-worked question to test applicants knowledge of the minimum SLC tank level and the pounds of borax required. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 59 F

2 X

X E

295035 A 1.01 Low, Bank S

1. Ensure no overlap with 57 & 50 with respect to RB Vent Rad levels and RB HVAC and SBGT operation.

2. Cred Dist: A is not plausible because the choice does not provide the location of the area rad monitor, i.e., "A" only states the alarm window but should also state the rad monitor location causing the alarm (a plausible one). As written, the ARM could be anywhere in the Rx Bldg.

3. Stem Focus: Re-word the stem question to include the phrase "a condition that automatically trips the Reactor Building... "

Alternatively, consider the following:

The unit is operating at 100% power and the following alarm is received:

RX BLDG DIFF PRESS HIGH/LOW WOOTF completes the following statement?

The Reactor Building Supply and Exhaust Fans receive a trip signal and the Standby Gas Treatment System receive a start signal.

A. will/will B. will / will NOT C. will NOT / will D. will NOT /will NOT

4. Comments incorporated. Question is SAT.

60 F

1 X

U 295037 K1.03 I,.ow, New S

1. LOD=1: An applicant can answer this question based on the knowledge from the generic fundamentals exam section. This is the plant specific written exam.

2. Cred Dist: "A"and "B" are not plausible because voids are not a positive reactivity effect.

3. Licensee re-worked question to test applicants' knowledge of the minimum SLC tank level and the pounds of borax required. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 61 H

2 x

U 295038 K2.10 Low, New S

Cred Dist: The 2 part of B and D are not plausible because a the reason for a Hi radiation alarm is never to prevent a hydrogen explosion.

Suggest writing a question dealing with a reactor startup when the MVPs are running and the operator subsequently receives high MSL rad. Test the applicants knowledge of the auto-actions (MVP trip and OG-V7 closure).

K/A will be hit from the standpoint that MSL rad is indirectly related to high offsite release rate. Alternatively, write a question dealing with the entry conditions associated with EOP-04-RRCP and actions related to off-gas system.

2.

Licensee re-worked question to test applicants knowledge of how hogging pumps respond to one MSL rad monitor being in the Hi-Hi alarm condition. Question is SAT.

62 F

2 X

E 300000 K5.13 Low, Bank 1.

Stem Focus: Remove as the filter continues to plug.

2.

Comments incorporated. Question is SAT.

63 F

2 X

X E

400000 K4.01 Low, Bank

1. Note: Because NUREG 1123 does not include a category for service water, the service water system (at Brunswick) can be classified as a component cooling water system in the Plant Service Systems. Refer to OL Feedback FAQ 401.51. This is acceptable to hit K/A

2. Ensure no overlap with scenario event?

3. Stem focus: Add CSW before system in the beginning of the stem.

Discuss the location of the pressure transmitter w/ the licensee to ensure that an applicant cannot argue no correct answer.

4. Stem Focus and/or Partial: If the applicant does not know the auto-start set point of the standby pump, he/she can deduce that A and

B are not correct based on the way the fill-in-the-blank statement is worded., i.e., if he thinks 65 is the set point, then he will pick 40 psig to be sure because of the statement wording. The way the question is worded, even if 65 is correct, 40 will also be correct. Same argument for the 2 part of the question. Suggest including the words minimum and earliest time when so eliminate this concern.

5. Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UlE/S Explanation Focus Dist.

Link units ward KIA Only 61 H

2 X

U 295038 K2.1 0 Low, New S

1.

Cred Dist: The 2 nd part of "B" and "0" are not plausible because a the reason for a Hi radiation alarm is never to prevent a hydrogen explosion.

Suggest writing a question dealing with a reactor startup when the MVPs are running and the operator subsequently receives high MSL rad. Test the applicants' knowledge of the auto-actions (MVP trip and OG-V7 closure). KIA will be hit from the standpoint that MSL rad is indirectly related to high offsite release rate. Alternatively, write a question dealing with the entry conditions associated with EOP-04-RRCP and actions related to off-gas system.

2.

Licensee re-worked question to test applicants' knowledge of how hogging pumps respond to one MSL rad monitor being in the Hi-Hi alarm condition. Question is SAT.

62 F

2 X

E 300000 K5.13 Low, Bank S

1.

Stem Focus: Remove "as the filter continues to plug".

2.

Comments incorporated. Question is SAT.

63 F

2 X

X E

400000 K4.01 Low, Bank S

1. Note: Because NUREG 1123 does not include a category for service water, the service water system (at Brunswick) can be classified as a "component cooling water system" in the "Plant Service Systems." Refer to OL Feedback FAQ 401.51. This is acceptable to hit KIA

2. Ensure no overlap with scenario event?

I

3. Stem focus: Add CSW before system in the beginning of the stem.

Discuss the location of the pressure transmitter wI the licensee to ensure that an applicant cannot argue no correct answer.

4. Stem Focus and/or Partial: If the applicapt does not know the auto-start set point of the standby pump, he/she can deduce that "A" and "B" are not correct based on the way the fill-in-the-blank statement is worded., i.e., if he thinks 65 is the set point, then he will pick 40 psig to be sure because of the statement wording. The way the question is worded, even if 65 is correct, 40 will also be correct. Same argument for the 2 nd part of the question. Suggest including the words "minimum" and "earliest time when" so eliminate this concern.

5. Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 64 F

2 X

E 600000 K2.01 Low, New S

1. Cred Dist: (borderline) The 2 part of A and C is not plausible because a fire suppression system never waits for the system to shutdown before it initiates, e.g., sprinkler systems initiate when the fire is in progress.

IF the plausibility is that the train will experience high temperature during a LOCA, then there may be some plausibility to these choices.

Recommend for 2 nd part:

If a fire is indicated, the fire suppression system for a SBGT carbon bank automatically inject. (Assume No Operator Actions).

Answer is will or will NOT.

2.

Comments incorporated. Question is SAT.

65 H

2 X

X E

700000 K1.02 High, New

1. Stem Focus: Add windings after (1)

2. Stem Focus: Change would overheat to could overheat. You are right on the line if you have 60 psig hydrogen.

3. Job-Link: Discuss the associated hydrogen pressure and 100%

load with the licensee to ensure that the plot on the spider graph is correct.

Licensee provide rated power? The attachment looks like 960 MWe.

Licensee state if the distribution curve going to be an attachment?

3.

Stem Focus: Re-word the fill-in-the-blank statement to use the words most limiting component. Break up the fill-in-the-blank statement into two sentences.

4.

Comments incorporated. Questin is SAT.

66 F

2 5

G2.01.27 Low, New 1.

Stem Focus: Provide an in accordance with phrase in the stem question. Cannot be system description, must be licensed document such as Tech Spec Bases.

2.

Comment incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (FtH)

(1-5)

Stem Cues TtF Credo Partial Job-Minutia

1. t Back-Q=

SRO BtMtN utEtS Explanation Focus Dist.

Link units ward KIA Only 64 F

2 X

E 600000 K2.01 Low, New S

1. Cred Dis!: (borderline) The 2nd part of "A" and "C" is not plausible because a fire suppression system never waits for the system to shutdown before it initiates, e.g., sprinkler systems initiate when the fire is in progress. IF the plausibility is that the train will experience high temperature during a LOCA, then there may be some plausibility to these choices.

Recommend for 2 nd part:

If a fire is indicated, the fire suppression system for a SBGT carbon bank automatically inject. (Assume No Operator Actions).

Answer is will or will NOT.

2.

Comments incorporated. Question is SAT.

65 H

2 X

X E

700000 K1.02 High, New S

1. Stem Focus: Add "windings" after (1 )

2. Stem Focus: Change "would overheat" to "could overheat". You are right on the line if you have 60 psig hydrogen.

3. Job-Link: Discuss the associated hydrogen pressure and 100%

load with the licensee to ensure that the plot on the spider graph is correct.

Licensee provide rated power? The attachment looks like -960 MWe.

Licensee state if the distribution curve going to be an attachment?

3.

Stem Focus: Re-word the fill-in-the-blank statement to use the words "most limiting component." Break up the fill-in-the-blank statement into two sentences.

4.

Comments incorporated. Question is SAT.

66 F

2 S

G2.01.27 Low, New

1.

Stem Focus: Provide an "in accordance with" phrase in the stem question. Cannot be system description, must be licensed document such as Tech Spec Bases.

2.

Comment incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD}

(F/H)

(1-5)

Stem Icues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN U/E/S Explanation Dist.

Link units ward K/A Only 67 H

2 X

x U

G2.01.31 Low, New E

Cred Dist: C & D are not plausible because the controls for the CREV system are on U2 only (no switch on Unit 1) and S

because the damper (RED) indication will always be correct when the fan is running.

2.

Stem Focus: Change Red to Open and Green to Closed.

3.

Changed original classification from U to E because the mechanical equipment room fans have to be placed in the OFF position. Comments incorporated. Question is SAT.

68 H

2 X

E G2.01.39 High, Previous Exam 1.

Stem Focus: Re-word D as follows:

states that rod positioning restrictions may be waived in the Scram Avoidance Region of the power to flow map.

2.

Licensee re-worked to test applicants knowledge of when single notch (vs continuous) is required/allowed using a fill-in-the-blank statement on page 27 of 01-1.02. Question is SAT.

69 F

2 X

E G2.02.04 Low, Bank 1.

Overlap with the in-plant JPM. Discuss w/ the licensee.

2.

Stem Focus: Re-word the stem to make A read as follows:

The Electric Fire Pump can only be started locally. This will ensure its plausibility.

3.

The JPM tested applicants ability to locally start electric fire pump whereas this question tests applicants knowledge of which control room location could start fire pump. Comment incorporated. Question is SAT.

i.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

B.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 67 H

2 X

X U

G2.01.31 Low, New E

1.

Cred Dist: "C" & "D" are not plausible because the controls for S

the CREV system are on U2 only (no switch on Unit 1) and because the damper (RED) indication will always be correct when the fan is running.

2.

Stem Focus: Change Red to Open and Green to Closed.

3.

Changed original classification from U to E because the mechanical equipment room fans have to be placed in the OFF position. Comments incorporated. Question is SAT.

6B H

2 X

E G2.01.39 High, Previous Exam S

1.

Stem Focus: Re-word "D" as follows:

"states that rod positioning restrictions may be waived in the Scram Avoidance Region of the power to flow map."

2.

Licensee re-worked to test applicants' knowledge of when single notch (vs continuous) is required/allowed using a fill-in-the-blank statement on page 27 of 01-1.02. Question is SAT.

69 F

2 X

E G2.02.04 Low, Bank

1.

Overlap with the in-plant JPM. Discuss wI the licensee.

2.

Stem Focus: Re-word the stem to make "A" read as follows:'

"The Electric Fire Pump can only be started locally." This will ensure it's plausibility.

3.

The JPM tested applicants' ability to locally start electric fire pump whereas this question tests applicants' knowledge of which control room location could start fire pump. Comment I

I incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN U/EIS Explanation Focus Dist.

Link units ward K/A Only 70 F

2 X

X E

G2.02.25 Low, New s

1.

Partial: To ensure no other answers can be argued as correct, include the phrase in accordance with Tech Spec Bases 2.1.1, Reactor Core Safety Limits to the stem question.

2.

Stem Focus: Eliminate the fill-in-the-blank statement so that the correct choice can exactly match the sentence on page 32.1.1-1 of the TS bases.

3.

Stem Focus: make the wording for A and B exactly match the 10CFR5O wording associated with the ECCS design criteria.

The calculated total oxidation shall no where exceed 0.17 times the total cladding thickness before oxidation.

The calculated changes in core geometiy shall be such that the core remains amenable to coollng.

4.

Comments incorporated. Question is SAT.

71 H

3 X

X E

G2.02.39 High, Bank

1. Stem Focus: State what happened with the other CRD pump...

failed to start, tagged out...

2. Stem Focus: Include the phrase in accordance with Tech Spec 3.1.5, Control Rod Scram Accumulators.

3. Cred Dist: C is not plausible because IF an immediate scram is required, waiting for AO confirmation is never required.

Recommend answers for:

A. Scram is required immediately.

B. Restore charging water header to > 940 psig within 20 mTh or scram C. Fully insert CR 18-19 immediately and declare INOP within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

D. Scram is retjuired ONLY if a second accumulator alarm is

receiveçl.

4. Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 70 F

2 X

X E

G2.02.25 Low, New S

1.

Partial: To ensure no other answers can be argued as correct, include the phrase "in accordance with Tech Spec Bases 2.1.1, Reactor Core Safety Limits" to the stem question.

2.

Stem Focus: Eliminate the fill-in-the-blank statement so that the correct choice can exactly match the sentence on page B2.1.1-1 of the TS bases.

3.

Stem Focus: make the wording for "A" and "B" exactly match the 10CFR50 wording associated with the ECCS design criteria.

"The calculated total oxidation shall no where exceed O. 17 times the total cladding thickness before oxidation."

"The calculated changes in core geometry shall be such that the core remains amenable to cooling."

4.

Comments incorporated. Question is SAT.

71 H

3 X

X E

G2.02.39 High, Bank S

1. Stem Focus: State what happened with the other CRD pump...

failed to start, tagged out...

2. Stem Focus: Include the phrase "in accordance with" Tech Spec 3.1.5, Control Rod Scram Accumulators."

3. Cred Dist: C is not plausible because IF an immediate scram is required, waiting for AO confirmation is never required.

Recommend answers for:

A. Scram is required immediately.

B. Restore charging water header to > 940 psig within 20 min or scram:

C. Fully insert CR 18-19 immediately and declare INOP within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

D. Scram is required ONL Y if a second accumulator alarm is receiveg.

4. Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIE Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO BIMIN U/E/S Explanation Focus Dist.

Link units ward K/A Only 72 F

2 x

U G2.03.14 Low, New 1.

Cred Dist: A and B are not plausible because with more hydrogen there is more radiation. Before hydrogen was added, turbine building rad levels were drastically lower. When hydrogen water chemistry is in service, theres always higher rad levels.

Suggest testing the applicants knowledge of the second portion of the fill-in-the-blank statement and one other piece of knowledge.

2.

Licensee to explain the distracter analysis which states being at a lower power level as if a power reduction had occurred and had something to do with the answer. Explain.

3.

Licensee re-worked question to test applicants knowledge of how reactor power is derived for the HWC system and why the turbine bldg rad levels rise. Question is SAT.

73 F

2 X

E G2.03.15 Low, New

1. Cred Dist: D not plausible because there is not a way to read this number on this meter.

Recommendation: Is there an interlock or required action associated with this meter or this rad level? Make it a 2 part question.

2.

Question should have been SAT because licensee explained credibility of D.

74 F

2 x

U G2.04.O1 Low, Bank

1. Cred. Dist: A not plausible because its the only answer that doesnt involve a vent path and the questiQn asks for entry to a Release control procedure.

2. Cred. Dist: D not plausible because entry to any procedure associated with radiation release is always at the HI alarm (Choice C) versus the HI-HI alarm (Choice D). Ask the licensee for an example.

3. Licensee re-worked question. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOO (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Oist.

Link units ward KIA Only 72 F

2 X

U G2.03.14 Low, New S

1.

Cred Oist: "A" and "B" are not plausible because with more hydrogen there is more radiation. Before hydrogen was added, turbine building rad levels were drastically lower. When hydrogen water chemistry is in service, there's always higher rad levels.

Suggest testing the applicants' knowledge of the second portion of the fill-in-the-blank statement and one other piece of knowledge.

2.

Licensee to explain the distracter analysis which states being at a lower power level as if a power reduction had occurred and had something to do with the answer. Explain.

3.

Licensee re-worked question to test applicants' knowledge of how reactor power is derived for the HWC system and why the turbine bldg rad levels rise. Question is SAT.

73 F

2 X

E G2.03.15 Low, New S

1. Cred Oist: "0" not plausible because there is not a way to read this number on this meter.

Recommendation: Is there an interlock or required action associated with this meter or this rad level? Make it a 2 part question.

2.

Question should have been SAT because licensee explained credibility of O.

74 F

2 X

U G2.04.01 Low, Bank S

1. Credo Oist: "A" not plausible because it's the only answer that doesn't involve a vent path and the question asks for entry to a c

"Release" cOf).trol procedure.

2. Credo Oist: "0" not plausible because entry to any procedure associated with radiation release is always at the HI alarm (Choice "C") versus the HI-HI alarm (Choice "0"). Ask the licensee for an example.

3. Licensee re-worked question. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-0=

SRO B!MIN U/E/S Explanation Focus Dist.

Link units ward K/A Only 75 H

3 X

X E

G2.04.09 High, Bank S

1. Stem Focus: Not sure if CRD is the only system injecting or its available and nothing is injecting, If CRD is the only system injecting and 19 CRs are still out, is it plausible that reactor water level is stable? Need to clarify.

2. Partial: Ask the licensee when the APRM downscale lights (apron section) illuminate. The annunciator set point is 2.4%.

If the downscale lights (apron section) have the same set point as the annunciator, then there is a possibility for multiple correct answers.

The EOP asks whether the operator can determine power to be below 2%; however, there is no information in the stem to positively determine that the power level is less than 2%.

Licensee explain how the information provided establishes power less than 2% or modify the question stem to do so.

3.

Licensee provided technical reference which allows using the apron section lights even though setpoint was 2.4 %

(EOP-O1-NL, page 68 of 256). Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N u/E/S Explanation Focus Dis!.

Link units ward KIA Only 75 H

3 X

X E

G2.04.09 High, Bank S

1. Stem Focus: Not sure if CRD is the only system injecting or its available and nothing is injecting. If CRD is the only system injecting and 19 CRs are still out, is it plausible that reactor water level is stable? Need to clarify.

2. Partial: Ask the licensee when the APRM downscale lights (apron section) illuminate. The annunciator set point is 2.4%. If the downscale lights (apron section) have the same set point as the annunciator, then there is a possibility for multiple correct answers.

The EOP asks whether the operator can determine power to be below 2%; however, there is no information in the stem to positively determine that the power level is less than 2%.

Licensee explain how the information provided establishes power less than 2% or modify the question stem to do so.

3.

Licensee provided technical reference which allows using the apron section lights even though setpoint was 2.4 %

(EOP-01-NL, page 68 of 256). Question is SAT.

1 2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN U/E/S Explanation Focus Dist.

Link units ward K/A Only 76 F

3 X

x x

U 204000 G 2.02.25, NEW, Low, S

1. QK/A: The current question tests applicants knowledge of a PCIS instrument, i.e., SLC control switch, which is testing the knowledge that SLC needs cleanup isolated only when the rods are out. The proposed question is not testing Tech Specs associated with RWCU, instead, it is testing Tech Specs knowledge associated with when SLC is required.

There are RWCU Tech Specs for FOOl & F004, or sampling; suggest testing knowledge associated with PCIV FOOl being inoperable, including either procedure selection or tech specs (or bases) knowledge. Ensure no overlap with Q# 83.

If these are not doable, then discuss replacing K/A with Chief Examiner.

2. SRO-only: The l part of the question can be deduced using the knowledge of when the SLC PCIS function is required; i.e.,

only when rods are withdrawn > Modes 1 & 2. ROs are expected to know the LCO statement and applicability, i.e., the information above the line; i.e., when the equipment is required to be operable, i.e., pumps, valves, etc. The 2 part of the question can be deduced gjjy using systems knowledge of the rod block logic and mode switch position. Just because the information is listed in the bases does not mean that the question requires bases knowledge to answer.

3. Stem Focus: The word NOT is to be avoided. Re-work question to avoid the use of the word NOT in the stem fill-in-the-blank question.

4. Stem Focus: The grammar associated with the 2 part of choices A and C does not flow with the grammar of the fill-in the-blank statemant.

5. Licensee stated that the RWCU portion of the PCIS Tech Spec included the SLC control switch, i.e., the SLC control switch was an RWCU PCIS instrument; however, the proposed question can still bo answered solely using RO knowledge.

6. Licensee re-worked question to test SRO applicants knowledge of TS 3.6.1.3 content. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 76 F

3 X

X X

U 204000 G 2.02.25, NEW, Low, S

1. Q=KlA: The current question tests applicants knowledge of a PCIS instrument, i.e., SLC control switch, which is testing the knowledge that SLC "needs" cleanup isolated only when the rods are out. The proposed question is not testing Tech Specs associated with RWCU, instead, it is testing Tech Specs knowledge associated with when SLC is required.

There are RWCU Tech Specs for F001 & F004, or sampling; suggest testing knowledge associated with PCIV F001 being inoperable, including either procedure selection or tech specs (or bases) knowledge. Ensure no overlap with Q# 83. If these are not doable, then discuss replacing KIA with Chief Examiner.

2. SRO-only: The 1st part of the question can be deduced using the knowledge of "when" the SLC PCIS function is required; i.e.,

only when rods are withdrawn> Modes 1 & 2. ROs are expected to know the LCO statement and applicability, i.e., the information "above the line"; i.e., when the equipment is required to be operable, i.e., pumps, valves, etc. The 2 nd part of the question can be deduced solelv using systems knowledge of the rod block logic and mode switch position. Just because the information is listed in the bases does not mean that the question requires bases knowledge to answer.

3. Stem Focus: The word "NOT" is to be avoided. Re-work question to avoid the use of the word NOT in the stem fill-in-the-blank question.

4. Stem Focus: The grammar associated with the 2nd part of choices "A" and "c" does not flow with the grammar of the fill-in-the-blank statem El.nt.

5. Licensee stated that the RWCU portion of the P.CIS Tech Spec included the SLC control switch, i.e., the SLC control switch was an RWCU PCIS instrument; however, the proposed

'I*

question can still be answered solely using RO knowledge.

6. Licensee re-worked question to test SRO applicants' knowledge of TS 3.6.1.3 content. Question is SAT.

L--L- __

A 2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIE Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 77 H

3 X

X E

212000 A2.12, Bank, High S

1.

Chief Examiner Note: This question may be an EXACT repeat used on a recent Brunswick NRC exam. Suggest an enhancement to change the 2 d part of the question to test applicants knowledge of the tech spec bases knowledge associated with the control valve fast closure signal, i.e., the reactor scram reduces the amount of energy required to be absorbed and ensures that the MCPR SL is not exceeded.

2.

Cred Dist: Ask the licensee to explain why C and D are plausible.

If the reason is that this question was previously used on another NRC exam, then modify the stem with other voltage and frequency indications to make C and D more plausible.

3.

Stem Focus: Make this question a little easier to read.

Separate the alarms with a descriptor that states; the following alarms are in alarm I or words to that effect.

4.

1. /units:

In the explanation of the question, the abbreviations TCV and TSV are used, however, these are NOT used in the question. Is there a reason for this? Should the word Turbine be put in each of the first parts of the question?

5.

Comments incorporated. Question is SAT.

78 H

3 x

x U

214000 A 2.03, New, High E

1.

Cred Dist: The 2 part of B and D are not plausible because

1) the stem does not include any information which may make these choices plausible; 2) a SRO applicant who does not know the requirements of Tech Spec 3.1.3 can reasonably deduce

that these chdices do not place the failed eqoipment in a safe condition and 3) the actions listed in the 2 part of B and D do not exist in Tech Spec 3.1.3.

2.

The package indicates the question is both, Low Cog Level and High Cog level. Ask licensee to identify which it is?

3.

Licensee argued that based on the fact the Control Rod OperabilityTS 3.1.3 Action C contained a note dealing with RWM TS 3.3.2.1 this question should only be ENHANCEMENT.

4.

Partial: Chief Examiner subsequently pointed out that based on their argument, then D was also a correct answer.

5.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOO (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Oist.

Link units ward KIA Only 77 H

3 X

X E

212000 A2.12, Bank, High S

1.

Chief Examiner Note: This question may be an EXACT repeat used on a recent Brunswick NRC exam. Suggest an enhancement to change the 2nd part of the question to test applicants knowledge of the tech spec bases knowledge associated with the control valve fast closure signal, i.e., the reactor scram reduces the amount of energ'l. required to be absorbed and ensures that the MCPR SL is not exceeded.

2.

Cred Oist: Ask the licensee to explain why "C" and "0" are plausible. If the QJJ}x. reason is that this question was previously used on another NRC exam, then modify the stem with other voltage and frequency indications to make "C" and "0" more plausible.

3.

Stem Focus: Make this question a little easier to read.

Separate the alarms with a descriptor that states; the following alarms are in alarm I or words to that effect.

4.

1. /units: In the explanation of the question, the abbreviations TCV and TSV are used, however, these are NOT used in the question. Is there a reason for this? Should the word Turbine be put in each of the first parts of the question?

5.

Comments incorporated. Question is SAT.

78 H

3 X

X U

214000 A 2.03, New, High E

1.

Cred Oist: The 2 nd part of "B" and "0" are not plausible because S

1) the stem does not include any information which may make these choices plausible; 2) a SRO applicant who does not know the requirements of Tech Spec 3.1.3 can reasonably deduce

.J that these chdlces do not place the failed equipment in a safe condition and 3) the actions listed in the 2nd part of "B" and "0"

\\

do not exist i~ Tech Spec 3.1.3.

\\.

2.

The package indicates the question is both, Low Cog Level and High Cog level. Ask licensee to identify whiCh it is?

3.

Licensee argued that based on the fact the Control Rod Operability TS 3.1.3 Action C contained a note dealing with RWM TS 3.3.2.1 this question should only be ENHANCEMENT.

4.

Partial: Chief Examiner subsequently pointed out that based on their argument, then "0" was also a correct answer.

5.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LCD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 79 H

3 X

X E

217000 02.04.08, New, High s

1 SRO-only: The listed actions include RO knowledge of the ATWS/EOP overall mitigative strategies [i.e. ROs are required to know 1) that RCIC is not required to be terminated and prevented and 2) is the only available source for boron injection.] One area of SRO level knowledge (with respect to prescribing or selecting a procedure) is knowledge of the content of the procedure versus knowledge of the procedures overall mitigative strategy or purpose. IF the question was linked to 1 OCFR55.43 (b) (5) [procedure selection], then the applicant must be tested on which procedure is required without the accompanying actions listed in each choice.

Suggest testing the applicants knowledge of 1) whether RCIC is required (or not required) to be isolated (this hits K/A) and 2) which procedure leg is used to perform emergency depressurization later.

2.

Cues: Instead of using the phrase Given the following ATWS conditions say The following conditions currently exist on Unit Two. Applicant should be able to deduce an ATWS exists.

3.

Removed the terminated and prevented and re-worked question to a 2-part question to test SRO applicants knowledge of whether RCUC was required to remain running or be isolated AND the procedure which directs this action (AOP-5 or SCCP).

Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N u/E/S Explanation Focus Dist.

Link units ward KIA Only 79 H

3 X

X E

217000 G2.04.08, New, High S

1.

SRO-only: The listed actions include RO knowledge of the ATWS/EOP overall mitigative strategies [Le., ROs are required to know 1) that RCIC is not required to be terminated and prevented and 2) is the only available source for boron injection.] One area of SRO level knowledge (with respect to prescribing or selecting a procedure) is knowledge of the content of the procedure versus knowledge of the procedure's overall mitigative strategy or purpose. 1£ the question was linked to 10CFR55.43 (b) (5) [procedure selection], then the applicant must be tested on which procedure is required without the accompanying actions listed in each choice.

Suggest testing the applicants' knowledge of 1) whether RCIC is required (or not required) to be isolated (this hits KIA) and 2) which procedure leg is used to perform emergency depressurization later.

2.

Cues: Instead of using the phrase "Given the following ATWS conditions.... " say "The following conditions currently exist on Unit Two." Applicant should be able to deduce an ATWS exists.

3.

Removed the "terminated and prevented" and re-worked question to a 2-part question to test SRO applicants' knowledge of whether RCUC was required to remain running or be isolated AND the procedure which directs this action (AOP-5 or SCCP).

Question is SAT.

~

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UIE/S Explanation Focus Dist.

Link j units ward K/A Only 80 H

3 X

X X

E 233000 G 2.04.06, New, High S

1.

Partial: From an appeal standpoint, there may be room for an applicant to argue no correct answer based on the stem wording of first makeup source to be used. Does AOP-38 clearly state that there is a preferred order? [AOP-38 lists items in an order of 1, 2, 3, and so on; however, an applicant can successfully argue that this listing does not constitute an implied hierarchy.]

Discuss the word first in the stem question wl the licensee.

2.

SRO-only: Modify the stem to clearly test the applicants knowledge of 1) which procedure is required and 2) whether or not RRCP is required to be entered or not as follows:

A.

AOP-38; RRCP is required to be entered B.

AOP-38; RRCP is NOT required to be entered C.

OEDMG-002; RRCP is required to be entered D.

OEDMG-002; RRCP is NoTrequired to be entered 3.

Stem Focus: The 2 nd bullet information about the test weight is not needed to answer the question. The bullet can simply say that fuel pool level is rapidly lowering.

4.

Licensee argued that procedure did specify a hierarchy. Some of the amplifying comments in the choices (i.e., hoses and via Fuel Pool cooling) were eliminated to add plausibility. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 80 H

3 X

X X

E 233000 G 2.04.06, New, High S

1.

Partial: From an appeal standpoint, there may be room for an applicant to argue no correct answer based on the stem wording of "first makeup source to be used." Does AOP-38 clearly state that there is a preferred order? [AOP-38 lists items in an order of 1, 2, 3, and so on; however, an applicant can successfully argue that this listing does not constitute an implied hierarchy.]

Discuss the word "first" in the stem question wi the licensee.

2.

SRO-only: Modify the stem to clearly test the applicants' knowledge of 1) which procedure is required and 2) whether or not RRCP is required to be entered or not as follows:

A.

AOP-38; RRCP is required to be entered B.

AOP-38; RRCP is NOT required to be entered C.

OEDMG-002; RRCP is required to be entered D.

OEDMG-002; RRCP is NOT required to be entered

3.

Stem Focus: The 2nd bullet information about the test weight is not needed to answer the question. The bullet can simply say that fuel pool level is rapidly lowering.

4.

Licensee argued that procedure did specify a hierarchy. Some of the amplifying comments in the choices (Le., "hoses and via Fuel Pool cooling") were eliminated to add plausibility. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN UIEIS Explanation Focus Dist.

Link units ward K/A Only 81 F

1 X

E 239002 G2.02.025, New, Low 1.

Partial: V can also be argued as correct since the TS bases has the following wording:

The overpressure protection system must accommodate the most severe pressurization transient. Evaluations have determined that the most severe transient is the closure of all main steam isolation valves (MSIVs), followed by reactor scram on high neutron flux (i.e., failure of the direct scram associated with MSIV position)

Re-work the 2 part of the question to be EXACT with the bases wording (do not paraphrase) and ensure plausibility of alternate choice.

2.

Add a line space between the first part between identifies: and the (1).

3.

LOD = 1; This question may not discriminate between a competent and incompetent operator.

If the comments for item

1. 1 are incorporated, this may remedy. Discuss w/ licensee.

4.

Licensee re-worked question to align more closely with the basis. Comments incorporated. Question is SAT.

82 H

3 X

E 262002 G 2.01.23, New, High 1.

Stem Focus: The first sentence is not needed to elicit the correct answer. Suggest re-working the stem to present the applicant with the corresponding alarms that are present following the loss of the Main Stack Rad Monitor normal power supply (all alarms that would be received), and.hen testing the applicants knowledge of the 1) failure and 2) required procedure and/or tech specs.

2.

LOK: Do not agree with level of knowledge. This question is a memory not a hiher cognitive question.

3.

Stem Focus: Underline the word lost to ensure the applicants read this word or bold, whatever is ok.

4.

Licensee argued that the p lausiblity of Ui procedures is because the power supply will originate from Ui AFTER transferring. Licensee argued that asking the procedure was minutia (based on validation); however, Chief Examiner disagreed. Question is SAT.

I

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N u/E/S Explanation Focus Dist.

Link units ward KIA Only 81 F

1 X

E 239002 G2.02.025, New, Low S

1.

Partial: "D" can also be argued as correct since the TS bases has the following wording:

"The overpressure protection system must accommodate the most severe pressurization transient. Evaluations have determined that the most severe transient is the closure of all main steam isolation valves (MSIVs), followed by reactor scram on high neutron flux (i.e., failure of the direct scram associated with MSIV position)"

Re-work the 2 nd part of the question to be EXACT with the bases wording (do not paraphrase) and ensure plausibility of alternate choice.

2.

Add a line space between the first part between identifies: and the (1).

3.

LOD = 1; This question may not discriminate between a competent and incompetent operator. If the comments for item

1. 1 are incorporated, this may remedy. Discuss w/ licensee.

4.

Licensee re-worked question to align more closely with the basis. Comments incorporated. Question is SAT.

82 H

3 X

E 262002 G 2.01.23, New, High S

1.

Stem Focus: The first sentence is not needed to elicit the correct answer. Suggest re-working the stem to present the applicant with the corresponding alarms that are present following the loss of the Main Stack Rad Monitor normal power supply (all alarm,S that would be received), and.,then testing the applicants knowleiJge of the 1) failure and 2) reql,lired procedure and/or tech specs.

2.

LOK: Do not agree with level of knowledge. This question is a memory not a higher cognitive question.

3.

Stem Focus: Underline the word lost to ensure the applicants read this word or bold, whatever is ok.

4.

Licensee argued that the p lausiblity of U 1 procedures is because the power supply will originate from U1 AFTER transferring. Licensee argued that asking the procedure was minutia (based on validation); however, Chief Examiner disagreed. Question is SAT.

295006 G 2.02.22, New, High Ensure this question does not overlap the re-worked Q#76 2.

Note to Chief Examiner: The first part of the question (1) tests the applicants knowledge of which piece of equipment (level switch alarm or isolation valve) has malfunctioned and the associated TS, which is RO knowledge. [ROs are expected to know the LCO statement, applicability, and any notes, i.e., the information above the double line separating the actions from the LCO and applicability statements for standardized TS.}

The second part of the question (2), requires the applicant to understand when the TS action statement must be timed from.

This requirement is identified in OEOP-01-UG and appears to be SRO-only knowledge.

3.

Partial: C can also be argued as correct since the words when the condition occurred are vague; i.e., an applicant can argue that this phrase means the same thing as RSP is exited.

Suggest adding times to the stem (for when F004 failed to close and when EOPs were exited) and then suggest the following:

Which ONE of the following identifies the required actions in accordance with OEOP-01-UG and Tech Spec 3.6.1.3, Primary Containment Isolation Valves (PCIV5)?

A.

The LCO start time is 09:00; The required Tech Spec 3.6.1.3 actions for the F004 are fully met B.

The LCO start time is 11:00; The required Tech Spec 3.6.1.3 actions for the F004 are fully met C.

The LCO start time is 09:00; The required Tech Spec 3.6.1.3 actions for the F004 are NOT fully met D.

The LCO start time is 11:00; The fequired Tech Spec 3.6.1.3 actions for the F004 are NOT fully met 4.

Stem Fqcus: Is it necessary to have the reason for the inability for F004 failed to close due to motor overload? Instead, can it be limited to failed to close on a valid signal? What clue does the information provide or NOT provide.

5.

Stem Focus: Is RSP a recognized abbreviation?

If not add Reactor Scram procedure. The full name is used in question 84.

83 H

3 x

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-0=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only x

E S

6.

Comments incorporated. Question is SAT.

~~- --

~---

-~----

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 83 H

3 X

X E

295006 G 2.02.22, New, High S

1.

Ensure this question does not overlap the re-worked Q#76

2.

Note to Chief Examiner: The first part of the question (1) tests the applicants' knowledge of which piece of equipment (level switch alarm or isolation valve) has malfunctioned and the associated TS, which is RO knowledge. [ROs are expected to know the LCO statement, applicability, and any notes, i.e., the information above the double line separating the actions from the LCO and applicability statements for standardized TS.]

The second part of the question (2), requires the applicant to understand when the TS action statement must be timed from.

This requirement is identified in OEOP-01-UG and appears to be SRO-only knowledge.

3.

Partial: "C" can also be argued as correct since the words "when the condition occurred" are vague; i.e., an applicant can argue that this phrase means the same thing as "RSP is exited."

Suggest adding times to the stem (for when F004 failed to close and when EOPs were exited) and then suggest the following:

Which ONE of the following identifies the required actions in accordance with OEOP-01-UG and Tech Spec 3.6.1.3, Primary Containment Isolation Valves (PCIVs)?

A. The LCO start time is 09:00; The required Tech Spec 3.6.1.3 actions for the F004 are fully met B. The LCO start time is 11:00; The required Tech Spec 3.6.1.3 actions for the F004 are fully met C.

The LCO start time is 09:00; The required Tech Spec t

3.6.1.3 actions for the F004 are NOT fully met D. The LCO start time is 11:00; The required Tech Spec 3.6.1.3 actions for the F004 are NOT fully met

~

4.

Stem Focus: Is it necessary to have thE:! reason for the inability for F004 failed to close due to motor overload? Instead, can it be limited to "failed to close on a valid signal?" What clue does the information provide or NOT provide.

5.

Stem Focus: Is RSP a recognized abbreviation? If not add Reactor Scram procedure. The full name is used in question

84.

6.

Comments incorporated. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-0=

SRO B/MIN U/E/S Explanation Focus Dist.

Link units ward K/A Only 84 F

2 X

x U

295008 A 2.05, New, Higher S

Cred Dist:

B and D are not plausible because the stem states that a scram has occurred; therefore, the guidance for water level control is not in accordance with an alarm response procedure. An unknowledgable SRO applicant can correctly arrive that C is correct solely based on knowledge of shrink and swell effects after opening an SRVj he knows that the water level control is in the scram procedure. This is RO knowledge of overall mitigative strategy. Because the applicants know that the EQP network has been entered, an alarm procedure is not plausible.

2.

Stem Focus: Remove the word correctly in the first sentence.

3.

Stem Focus: Add a line space between the first sentence and the first question.

4.

Stem Focus:

In (1), need to underline,itial this will ensure the applicants know where they are being asked to determine the response. We could actually use the word IMMEDIATE.

5.

Licensee re-worked question to change to RVCP procedure decision step. Question is SAT.

~~ -

~-.-.-.... ---

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 84 F

2 X

X U

295008 A 2.05, New, Higher S

1.

Cred Dist: "B" and "0" are not plausible because the stem states that a scram has occurred; therefore, the guidance for water level control is not in accordance with an alarm response procedure. An unknowledgable SRO applicant can correctly arrive that "C" is correct solely based on knowledge of shrink and swell effects after opening an SRV 1£ he knows that the water level control is in the scram procedure. This is RO knowledge of overall mitigative strategy. Because the applicants know that the EOP network has been entered, an alarm procedure is not plausible.

2.

Stem Focus: Remove the word "correct/y" in the first sentence.

3.

Stem Focus: Add a line space between the first sentence and the first question.

4.

Stem Focus: In (1), need to underline initial this will ensure the applicants know where they are being asked to determine the response. We could actually use the word IMMEDIATE.

5.

Licensee re-worked question to change to RVCP procedure decision step. Question is SAT.

-~

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

FT I

(F/H)

(1-5)

Stem Cuesj T/F I Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Link units ward K/A Only 85 H

2 X

x X

U 295014, G2.01.25, New, High E

1.

Cred Dist:

D is not plausible because nothing in the stem identifies that turbine bypass is or is NOT out of service to S

invoke TS 3.7.6. Discuss WI licensee.

B is not plausible because it lists an administrative procedure requirement for a manual reactor scram.

2.

SRO-only: (borderline) Since each of the procedure choices include an accompanying action, an applicant may be able to deduce the correct answer using the RO knowledge associated with the overall strategy for reducing feed water temperature, including the requirements for a unit shutdown or immediate scram. To target procedure selection, streamline each choice to only list a procedure (no actions). Alternatively, re-work the stem to test the applicants knowledge of the reasons and Tech Spec allowances following an inadvertent reactivity addition as for the following proposed choices:

A.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is assured A thermal limit penalty is required in accordance with Tech Specs for continued operation B.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is assured A thermal limit penalty is NOT required C.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is NOT assured A thermal limit penalty is required in accordance with Tech Specs for continued operation D.

Unit Operatioi within the bounds of the LOss of Feedwater Heating Analysis is NOT assured A thermal limit penalty to allow continued, operation is NOT allowed; a unit shutdown is required 3.

Stem Focus: The stem needs to be tightened, example, the applicants do not know, from the way the question is now, how much the bypass valve is open. We need to add that it is FULL open, so there is no question when it comes to determining if distractors actions will or will not work.

4.

Stem Focus: The first sentence could be shortened to make it easier to read. Add the last sentence to the first. Unit 2 is operating at 74% power with an initial FW Temperature of 404 F when This would be better.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOO (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Sack-Q=

SRO S/M/N U/E/S Explanation Focus Oist.

Link units ward KIA Only 85 H

2 X

X X

U 295014, G 2.01.25, New, High E

1.

Cred Oist: "0" is not plausible because nothing in the stem S

identifies that turbine bypass is or is NOT out of service to invoke TS 3.7.6. Oiscuss wI licensee. "S" is not plausible because it lists an administrative procedure requirement for a manual reactor scram.

2.

SRO-only: (borderline) Since each of the procedure choices include an accompanying action, an applicant may be able to deduce the correct answer using the RO knowledge associated with the overall strategy for reducing feed water temperature, including the requirements for a unit shutdown or immediate scram. To target "procedure selection", streamline each choice to only list a procedure (no actions). Alternatively, re-work the stem to test the applicants knowledge of the reasons and Tech Spec allowances following an inadvertent reactivity addition as for the following proposed choices:

A.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is assured A thermal limit penalty is required in accordance with Tech Specs for continued operation B.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is assured A thermal limit penalty is NOT required C.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is NOT assured A thermal limit penalty is required in accordance with Tech Specs for continued operation D.

Unit Operation within the bounds of the Loss of Feedwater Heating Analysis is NOT assured A thermallil17it penalty to aI/ow continued operation is NOT aI/owed; a unit shutdown is required

3.

Stem Focus: The stem needs to be tightened, example, the applicants do not know, from the way the question is now, how much the bypass valve is open. We need to add that it is FULL open, so there is no question when it comes to determining if distractors actions will or will not work.

4.

Stem Focus: The first sentence could be shortened to make it easier to read. Add the last sentence to the first. "Unit 2 is operating at 74% power with an initial FW Temperature of 404 F when..... " This would be better.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UIE/S Explanation Focus Dist.

Link units ward K/A Only 5.

Stem Focus: Since the required action is listed in 20P-32, this should be in the stem of the question to ensure no other plant procedure can create another partially correct answer.

6.

Licensee argued that since 01-1.01 (BNP Conduct of Ops Supplement) stated that FWHOOS required a thermal limit penalty that B and D were plausible. Question should have originally been an ENHANCEMENT.

7.

Licensee re-worked question to test the SRO applicants knowledge of whether continued operation was allowed and the required action or procedure. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (FtH)

(1-5)

Stem Cues TtF Credo Partial Job-Minutia

1. t Back-Q=

SRO BtMtN utEtS Explanation Focus Dist.

Link units ward KIA Only I

5.

Stem Focus: Since the required action is listed in 20P-32, this should be in the stem of the question to ensure no other plant I

procedure can create another partially correct answer.

6.

Licensee argued that since 01-1.01 (BNP Conduct of Ops Supplement) stated that FWHOOS required a thermal limit penalty that "B" and "0" were plausible. Question should have originally been an ENHANCEMENT.

7.

Licensee re-worked question to test the SRO applicants' knowledge of whether continued operation was allowed and the required action or procedure. Question is SAT.

c *..

295021A 2.03, New, High SRO-only: RO knowledge can be used to eliminate A and C because the fuel pool system flow path requires the gates to be removed. Therefore, the correct answer (B) can be deduced solely using RO knowledge of fuel pool system flow path and minimum required level for natural circ. Additionally, applicants are responsible for AOP entry conditions, including the overall mitigative strategy associated with AOP-1 5. Suggest testing applicants knowledge of Technical Specifications 3.4.7, 3.4.8, 3.9.7, and 3.9.8 for actions required for loss of RHR shutdown cooling.

2.

Stem Focus: This question could be shortened to have a statement like #76 has, Which one of the following (WOOTF) completes the statement(s) below?

Stem Focus: Highlight the word minimum in (1).

Job Link: Does AOP-15.0 specifically preclude using the RHR loop for decay heat removal when the F009 is in mid-position?

Are the pumps able to be manually started (on the Diesels) with only the F009 problem? Discuss wI the licensee.

5.

Stem Focus: Choices A and C provide the name/description using Alternate Decay Heat Removal, however, the procedure uses Alternate Shutdown Cooling Mode Utilizing the Fuel Pool Heat Exchangers (8.10 vs 8.16). Why not use the same words.

The one in the procedure.

Stem Focus: PFCCS and SSFPC not defined.

Licensee argued that they had a section of OP-i 7 that allowed fuel pool cooling with the gates installed. Question should have been an ENHANCEMENT.

8.

Licensee re-worked the item to test SRO applicants knowledge of mm required level (following a loss of SDCg) for natural circ and the ALERT threshold point onRCS pressure. Question is SAT.

86 H

3 x

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KJA Only x

x U

E S

3.

4.

6.

7.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dis!.

Link units ward KIA Only 86 H

3 X

X X

U 295021A 2.03, New, High E

1.

SRO-only: RO knowledge can be used to eliminate "A" and "C" S

because the fuel pool system flow path requires the gates to be removed. Therefore, the correct answer ("B") can be deduced solely using RO knowledge of fuel pool system flow path and minimum required level for natural circ. Additionally, applicants are responsible for AOP entry conditions, including the overall mitigative strategy associated with AOP-15. Suggest testing applicants knowledge of Technical Specifications 3.4.7, 3.4.8, 3.9.7, and 3.9.8 for actions required for loss of RHR shutdown cooling.

2.

Stem Focus: This question could be shortened to have a statement like #76 has, Which one of the following (WOOTF) completes the statement(s) below?

3.

Stem Focus: Highlight the word "minimum" in (1).

4.

Job Link: Does AOP-15.0 specifically preclude using the RHR loop for decay heat removal when the F009 is in mid-position?

Are the pumps able to be manually started (on the Diesels) with only the F009 problem? Discuss wi the licensee.

5.

Stem Focus: Choices "A" and "C" provide the name/description using Alternate Decay Heat Removal, however, the procedure uses Alternate Shutdown Cooling Mode Utilizing the Fuel Pool Heat Exchangers (8.10 vs 8.16). Why not use the same words.

The one in the procedure.

6.

Stem Focus: PFCCS and SSFPC not defined.

7.

Licensee argued that they had a section of OP-17 that allowed fuel pool cooling with the gates installed. Question should have been an ENHANCEMENT.

1

8.

Licensee re-worked the item to test SRO applicants' knowledge of min required level (following a loss of SDC'g) for natural circ

'1.

and the ALERT threshold point on,RCS pressure. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD1 (FIN)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/MIN UIEIS Explanation Focus Dist.

Link j units ward K/A Only 87 H

2 X

x x

U 295023 G2.04.49, New, High 2

1.

Q=KIA: None of the choices present operator actions even though the K/A (and stem) require the applicant to identify the S

correct immediate operator action.

the CREV automatically starts, then ensuring the CREV has started is not a required operator immediate action. What is the required operator immediate action? Discuss w/ the licensee. Additionally, this K/A may be very difficult to hit from the SRO license level since immediate operator actions are by their very nature RO knowledge.

Discuss replacing K/A with Chief Examiner, if necessary.

2.

Minutia: The proposed SRO portion of this question tests the applicants knowledge of details in FSAR Section 6.4.4.1.2 (Fuel Handling Accident Analysis) pertaining to a postulated fuel handling accident dose to the control room operator. The proposed question links a required automatic action to an accident analysis in the FSAR for a postulated fuel handling accident. Testing information in the FSAR is usually not done on the initial exam; however, if the licensee agrees that this level of detail is not minutia, then the stem should be modified to say in accordance with the FSAR Fuel Hand/mg Accident Analysis.

3.

add line space between the question and (1).

4.

Stem Focus: Include in accordance with to the 1 item in the stem question, i.e., OAOP-0.5.0.

5.

Stem Focus: The Design Fuel Handling accident is not explicit, is it a dropped fuel bundle as discussed in the stem of the question? Is this clear enough that the stem is a DBA? The 2 portion of the stem question should include in accordance with something. Discuss w/ the licensee.

6.

The licensee argued that the CREV did not automatically start; therefore, question should have been an ENHANCEMENT.

7.

AOP-5, Section 4.0 has a geherai discussion section which supports the basis. Question is SAT.

88 H

3 5

295026, A 2.03, High, Previous 1.

List where this question was previously used (plant & year) in the question writeup.

2.

Verify wI licensee exactly which portions of the HCTL curve will be provided to applicants to ensure that the directions for which line must be used are not provided (as listed in the UG).

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 87 H

2 X

X X

U 295023 G2.04.49, New, High E

1.

Q=KlA: None of the choices present operator actions even S

though the KIA (and stem) require the applicant to identify the correct immediate operator action. LEthe CREV automatically starts, then "ensuring" the CREV has started is not a required operator immediate action. What is the required operator immediate action? Discuss wI the licensee. Additionally, this KIA may be very difficult to hit from the SRO license level since immediate operator actions are by their very nature "RO knowledge." Discuss replacing KIA with Chief Examiner, if necessary.

2.

Minutia: The proposed SRO portion of this question tests the applicants knowledge of details in FSAR Section 6.4.4.1.2 (Fuel Handling Accident Analysis) pertaining to a postulated fuel handling accident dose to the control room operator. The proposed question links a required automatic action to an accident analysis in the FSAR for a postulated fuel handling accident. Testing information in the FSAR is usually not done on the initial exam; however, if the licensee agrees that this level of detail is not minutia, then the stem should be modified to say "in accordance with the FSAR Fuel Handling Accident Analysis."

3.

add line space between the question and (1).

4.

Stem Focus: Include "in accordance with... " to the 1 st item in the stem question, i.e., OAOP-0.5.0.

5.

Stem Focus: The Design Fuel Handling accident is not explicit, is it a dropped fuel bundle as discussed in the stem of the question? Is this clear enough that the stem is a DBA? The 2 nd portion of the stem questiol1 should include "in accordance with" something. Discuss wI the Ii~ensee.

6.

The licensee argued that the CREV did not automatically start; therefore, question should have been an ENHANCEMENT.

7.

AOP-5, Section 4.0 has a general discussion section which

. supports the basis. Question is SAT.

88 H

3 S

295026, A 2.03, High, Previous

1.

List where this question was previously used (plant & year) in the question writeup.

2.

Verify wi licensee exactly which portions of the HCTL curve will be provided to applicants to ensure that the directions for which line must be used are not provided (as listed in the UG).

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD rFi

(F/H)

(1-5)

Stem Cues T/F I Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/EIS Explanation Focus Dist.

Link units ward KIA Only 89 H

3 X

X E

295028 A 2.05, High, New, S

1.

Stem Focus: Delete the 1 st phrase in the first fill-in-the-blank statement, i.e., As DW temperature rises is not needed to elicit the correct response.

2.

Partial: Why is A wrong? What proof does the licensee have that A is wrong? Verify on the simulator.

3.

Licensee verified on the simulator. Comments incorporated.

Question is SAT.

90 H

3 X

X U

295029 G 2.01.07, Bank, High S

SRO-only: The SRO applicants knowledge of procedure selection is not being tested because each of the choices includes an accompanying action associated with HPCI equipment limitations. RO knowledge can be used to determine that NPSH is not a concern (i.e., no need to lower rpm) and hot torus water is the need for transferring HPCI back to the CST.

The SRO applicants ability to select the correct procedure is not being testing because the actions in each choice have their basis in HPCI equipment operating limitations.

2.

Stem Focus: Change the stem question to ask WOOTF completes the following statement?

3.

Licensee re-worked question to test SRO applicants knowledge of reason for shifting sources during an ATWS w/ Gp 1 isolation AND procedure that requires. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N u/E/S Explanation Focus Dis!.

Link units ward KIA Only 89 H

3 X

X E

295028 A 2.05, High, New, I

S

1.

Stem Focus: Delete the 1 st phrase in the first fill-in-the-blank statement, i.e., "As DW temperature rises" is not needed to elicit the correct response.

2.

Partial: Why is "A" wrong? What proof does the licensee have that "A" is wrong? Verify on the simulator.

3.

Licensee verified on the simulator. Comments incorporated.

Question is SAT.

90 H

3 X

X U

295029 G 2.01.07, Bank, High S

1.

SRO-only: The SRO applicants' knowledge of procedure selection is not being tested because each of the choices includes an accompanying action associated with HPCI equipment limitations. RO knowledge can be used to determine that NPSH is not a concern (i.e., no need to lower rpm) and hot torus water is the need for transferring HPCI back to the CST.

The SRO applicants ability to select the correct procedure is not being testing because the actions in each choice have their basis in HPCI equipment operating limitations.

2.

Stem Focus: Change the stem question to ask 'WOOTF completes the following statement?"

3.

Licensee re-worked question to test SRO applicants' knowledge of reason for shifting sources during an ATWS wI Gp 1 isolation AND procedure that requires. Question is SAT.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 91 H

3 X

E 295038 G 2.02.42, High, New, s

1 Stem Focus: The words controlling document are not well defined since the document choices are Tech Specs and ODCM. Suggest re-writing the stem as follows:

The Unit is operating at 100% power and both SJAE Offgas Radiation Monitor readings have increased 50%.

W00TF completes the statement?

In accordance with

, the release rate must be confirmed within limits within A.

00CM 7.3.2, Radioactive Gaseous Effluent Monitoring Instrumentation; 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> B.

Tech Spec 3. 7.5, Main Condenser Offgas; 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> C.

00CM 7.3.2; 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> 0.

TS3.7.5, l2hours 2.

Comments incorporated. Question is SAT.

92 H

3 X

x U

3000000 A2.01, High, New, E

1.

SRO-only: B and D can be eliminated using RO knowledge because the Service Air Low Pressure alarm procedure is associated with turbine building equipment; whereas the Rx Bldg BFIVs are located in the Reactor Building and are operated on a different air system. Once B and D are eliminated (using solely RO knowledge), then C can be eliminated solely by knowing the systems knowledge associated with SA-PV 5067. The SRO applicants are not being tested on procedure selection because the correct answer can be deduced solely using RO systems knowledge.

2.

Stem Focus:

In the stem, remove the words, due to a malfunction of the Air Dryer, because this is not necessary to elicit thecorrect answer.

3.

Stem Focus: Delete the word correct in the stem question because this is not necessary to elicit the correct answer.

4.

Stem Focus: place a line space between the sentence WOOTF and (1). And put a line space between (1) and (2).

5.

Licensee argued that service air affects the Rx Bldg (as evidenced by Air Receiver low pressure). Question should have been ENHANCEMENT.

6.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N UlE/S Explanation Focus Dis!.

Link units ward KIA Only 91 H

3 X

E 295038 G 2.02.42, High, New, S

1.

Stem Focus: The words "controlling document" are not well defined since the document choices are Tech Specs and ODCM. Suggest re-writing the stem as follows:

The Unit is operating at 100% power and both SJAE Off gas Radiation Monitor readings have increased 50%.

WOOTF completes the statement?

In accordance with

, the release rate must be confirmed within limits within A.

ODCM 7.3.2, Radioactive Gaseous Effluent Monitoring Instrumentation; 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> B.

Tech Spec 3.7.5, Main Condenser Off gas; 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> C.

ODCM 7.3.2; 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> D.

TS 3.7.5, 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />

2.

Comments incorporated. Question is SAT.

92 H

3 X

X U

3000000 A2.01, High, New, E

1.

SRO-only: "B" and "0" can be eliminated using RO knowledge S

because the Service Air Low Pressure alarm procedure is associated with turbine building equipment; whereas the Rx Bldg BFIVs are located in the Reactor Building and are operated on a different air system. Once "B" and "0" are eliminated (using solely RO knowledge), then "C" can be eliminated solely by knowing the systems knowledge associated with SA-PV-5067. The SRO applicants' are not being tested on procedure selection because the correct answer can be deduced solely using RO,systems knowledge.

2.

Stem Focus: In the stem, remove the words, "due to a malfunction of the Air Dryer," because this is not necessary to elicit the 'correct answer.

J.

3.

Stem Focus: Delete the word "correcf' in the stem question because this is not necessary to elicit the correct answer.

4.

Stem Focus: place a line space between the sentence WOOTF and (1). And put a line space between (1) and (2).

5.

Licensee argued that service air affects the Rx Bldg (as evidenced by Air Receiver low pressure). Question should have been ENHANCEMENT.

6.

Comments incorporated. Question is SAT.

_._- ~

-~

L __

-~

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. /

Back-Q=

SRO B/MIN U/E/S Explanation Focus Dist.

Link units ward K/A Only 93 H

3 X

E 600000 G 2.02.37, High, New S

1.

Job Link: Has the licensee ever operated in Single Loop Operation for an extended period of time due to abnormal seal leakage? Discuss this with the licensee, if this has not been done, then an applicant can argue that the premise of the question is operationally invalid.

2.

Job Link: The premise of the question is that the plant is implementing fire procedures; however, the choices represent business-as-usual operation procedures. The stem question asks for the procedure which provides this guidance under the above plant conditions? Do the fire procedures reference OAP 025, BNP Integrated Scheduling? Discuss W/ the licensee how the Integrated Scheduling procedure is related to fire procedures. The Site Incident Commander will request that MCC 2XA-2 be de-energized in accordance with a local fire procedure, not BNP Integrated Scheduling. Discuss w/

licensee. As written, this question does not appear to be operationally valid.

3.

Licensee replaced with new question testing SRO applicants knowledge of how a fire in the U2 Rx Bldg 20 North would affect RHR equipment AND the required procedure the CRS must enter. (pre-fire plan). Question is SAT.

94 H

2 X

X U

G 2.01.05, High, New E

Cred Dist:

B and D are not plausible because 1) there is no action statement listed in TS 5.2.2, Facility Staff Organization, 5

when staffing is below minimum and 3) the stem includes the term ASSD; therefore an applicant can reasonably guess that A and C are possible correctanswers since both of these choices use the similar acronym.

Suggest keeping the 2 part of the question as written (document which provides guidaçce for dropping below minimum complement) but develop another testable item for the

SRO applicants.

2.

Stem focus: The fill-in-the-blank statement should have the words required by instead ofprovided by..

3.

LOK: Appears that this item is memory level. Discuss w/ the licensee how the applicant uses higher cognitive skills.

4.

Licensee argued that there is a checksheet listed in the LCOS computer program that targets Tech Spec 5.2.2 for writing an LCO against. Question should have been an ENHANCEMENT.

5.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 93 H

3 X

E 600000 G 2.02.37, High, New S

1.

Job Link: Has the licensee ever operated in Single Loop Operation for an extended period of time due to abnormal seal leakage? Discuss this with the licensee, if this has not been done, then an applicant can argue that the premise of the question is operationally invalid.

2.

Job Link: The premise of the question is that the plant is implementing fire procedures; however, the choices represent "business-as-usual" operation procedures. The stem question asks for "the procedure which provides this guidance under the above plant conditions?" Do the fire procedures reference OAP-025, BNP Integrated Scheduling? Discuss wI the licensee how the Integrated Scheduling procedure is related to fire procedures. The Site Incident Commander will request that MCC 2XA-2 be de-energized in accordance with a local fire procedure, not BNP Integrated Scheduling. Discuss wI licensee. As written, this question does not appear to be operationally valid.

3.

Licensee replaced with new question testing SRO applicants' knowiedge of how a fire in the U2 Rx Bldg 20' North would affect RHR equipment AND the required procedure the CRS must enter. (pre-fire plan). Question is SAT.

94 H

2 X

X U

G 2.01.05, High, New E

1.

Cred Dis!: "B" and "0" are not plausible because 1) there is no S

action statement listed in TS 5.2.2, Facility Staff Organization, when staffing is below minimum and 3) the stem includes the term "ASSD"; therefore an applicant can reasonably "guess" that I

"A" and "C" are possible correct 'answers since both of these choices use the similar acronym. F Suggest keeping the 2nd part of the question as written (document which provides guida~ce for dropping below minimum complement) but develop another testable item for the SRO applicants.

2.

Stem focus: The fill-in-the-blank statement should have the words "required by" instead of "provided by.. "

3.

LOK: Appears that this item is memory level. Discuss wI the licensee how the applicant uses higher cognitive skills.

4.

Licensee argued that there is a checksheet listed in the LCOS computer program that targets Tech Spec 5.2.2 for writing an LCO against. Question should have been an ENHANCEMENT.

5.

Comments incorporated. Question is SAT.

L.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 95 H

3 x

S S 2.01.42, High, Bank 1.

Cues: The first sentence is not necessary to elicit the correct response.

2.

Comment incorporated. Question is SAT.

96 H

3 X

X E

S G 2/02/02, High, New.

s 1.

Partial: An applicant can successfully argue that both A and B are correct, i.e., question would have to be deleted since the applicants can argue that if the equipment is inoperable, therefore it is unavailable from a Tech Spec perspective. Ask the licensee to provide documentation which states when 20P-16, Section 8.12 is permitted.

If not defined, then this further supports that two correct answers exist.

2.

Cues: Ensure that the proposed reference is not a direct look up.

3.

Licensee re-worked question to test SRO applicants knowledge of operable/inoperable [when APP-A-3, 3-5 alarm present] AND available/unavailable. Question is SAT.

I

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

B.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 95 H

3 X

S S 2.01.42, High, Bank

1.

Cues: The first sentence is not necessary to elicit the correct response.

2.

Comment incorporated. Question is SAT.

96 H

3 X

X E

S G 2/02/02, High, New.

S

1.

Partial: An applicant can successfully argue that both "A" and B" are correct, i.e., question would have to be deleted since the applicants can argue that if the equipment is inoperable, therefore it is unavailable from a Tech Spec perspective. Ask the licensee to provide documentation which states when 20P-16, Section B.12 is permitted. If not defined, then this further supports that two correct answers exist.

2.

Cues: Ensure that the proposed reference is not a direct look up.

3.

Licensee re-worked question to test SRO applicants' knowledge of operable/inoperable [when APP-A-3, 3-5 alarm present] AND available/unavailable. Question is SAT.

~.

'1.'

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD

(F/H)

(1-5)

Stem Cues T/F Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 97 H

3 x

x x

x E

S G 2.02.22, High, New, s

1 Partial: An applicant can also argue C as correct because pump speed is causing the flow mismatch, i.e., the loop flow mismatch is a result of the pump speed mismatch; therefore both are correct. Suggest the following:

Unit I is operating at 79% power with the following conditions:

Jet Pump Flow Loop A 22 Mlbslhr Jet Pump Flow Loop B 33 Mibs/hr Total Core Flow (UICPWTCF) 55 Mlbs!hr WOOTF completes both statements in accordance with Tech Spec 3.4.1, Recirculation Loops Operating and Bases?

The current Jet Pump Flow Mismatch When Jet Pump Flows are NOT matched within limits THEN A.

Is within limits; the loop with the higher flow must be considered not in operation B.

Is NOT within limits; the loop with the higher flow must be considered not in operation C.

Is within limits; the loop with the lower flow must be considered not in operation 0.

Is NOT within limits; the loop with the lower flow must be considered not in operation.

2.

Job Link:,Discuss w/ the licensee when the criteria for mismatch loops changed from pump spees to jet pump flows.

Ask the licensee for the basis of why this change occurred.

3.

Stem Focus: For parameters provided in the stem, include the associatedinstrument ID #, including exact wording on the label.

4.

Cue: The portion of the fill-in-the-blankstatement contains a cue as to which ioop must be considered not in operation. This information is not necessary to answer either the first or second portion of the statement.

5.

Comments incorporated. Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q= SRO B/M/N u/E/S Explanation Focus Dist.

Link units ward KIA Only 97 H

3 x

x x

x E

S G 2.02.22, High, New, S

1.

Partial: An applicant can also argue "C" as correct because pump speed is causing the flow mismatch, Le., the loop flow mismatch is a result of the pump speed mismatch; therefore both are correct. Suggest the following:

Unit 1 is operating at 79% power with the following conditions:

I Jet Pump Flow Loop A 22 Mlbslhr Jet Pump Flow Loop B 33 Mlbslhr Total Core Flow (U1CPWTCF) 55 Mlbslhr WOOTF completes both statements in accordance with Tech Spec 3.4.1, Recirculation Loops Operating and Bases?

The current Jet Pump Flow Mismatch ___.

When Jet Pump Flows are NOT matched within limits, THEN A.

Is within limits; the loop with the higher flow must be considered not in operation B.

Is NOT within limits; the loop with the higher flow must be considered not in operation C.

Is within limits; the loop with the lower flow must be considered not in operation D.

Is NOT within limits; the loop with the lower flow must be considered not in operation.

2.

Job Link: Discuss wi the licensee when the criteria for mismatch'lqops changed from pump speegs to jet pump flows.

Ask the licensee for the basis of why this change occurred.

3.

Stem Focus: For parameters provided in the stem, include the associated'instrument 10 #, including exaGt wording on the label.

4.

Cue: The 1 st portion of the fill-in-the-blank,statement contains a cue as to which loop must be considered not in operation. This information is not necessary to answer either the first or second portion of the statement.

5.

Comments incorporated. Question is SAT.

L

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues 7/F Cred.

Partial Job-Minutia I

1. 1 Back-Q=

SRO BIM/N U/E/S Explanation Focus Dist.

Link junits ward K/A Only 98 H

2-3 x

x U

S 2.02.11, High, New, s

1.

Cred Dist: B and C are not plausible because if the containment pressure was very high to threaten the PCPL-A limit, then venting within normal limits does not make sense.

If the applicants reason that venting within normal release limits is not logical when pressure is extremely high, then B and D can be eliminated.

2.

Partial: The stem uses the phrase control drywell pressure and does not specify the current value of drywell pressure and the trend; consequently, the applicant could assume that drywell pressure was 2 psig and argue that there is no correct answer or that B is also correct since both Section 1 and Section 2 attempt to vent the torus first within release limits to control the pressure.

Suggest writing a two part question which tests applicants ability to recognize conditions (trends, etc) when venting y.Jj.in offsite release rates is required and the correct procedure SEP 01 Section 2 or Section 3.

3.

Licensee argued; however, Chief Examiner disagreed.

Licensee replaced item to test applicants procedure selection knowledge. Question is SAT.

99 H

3 x

x U

SG 2.04.17, High, New E

1.

Cred Dist: A and C are not plausible because primary containment flooding will not remedy a situation when the reactor remains pressurized. Primary containment flooding is a level contingency not a pressure contingency.

2.

Stem Focus: The stem states thatihere are non-ATWS conditions; however, the term minimum alternate reactor flooding pressure is rooted in the A1\\NS event. This could

cause applicants to choose the wrbng answer. Suggest deleting the non-ATWS comment. Discuss W/ licensee.

3.

Licensee argued that Primary Containment Flooding was required when a minimum # of SRVs was not available during both non-ATWS and ATWS. Question should have been ENHANCEMENT.

4.

Comments incorporated (to streamline). Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 8ack-Q=

SRO 8/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 98 H

2-3 x

x U

S 2.02.11, High, New, S

1.

Cred Dis!: "8" and "C" are not plausible because if the containment pressure was very high to threaten the PCPL-A limit, then venting within normal limits does not make sense. If the applicants reason that venting within normal release limits is not logical when pressure is extremely high, then "8" and "0" can be eliminated.

2.

Partial: The stem uses the phrase "control drywell pressure" and does not specify the current value of drywell pressure and the trend; consequently, the applicant could assume that drywell pressure was 2 psig and argue that there is no correct answer or that "8" is also correct since both Section 1 and Section 2 attempt to vent the torus first within release limits to "control" the pressure.

Suggest writing a two part question which tests applicants' ability to recognize conditions (trends, etc) when venting within offsite release rates is required and the correct procedure SEP-01 Section 2 or Section 3.

3.

Licensee argued; however, Chief Examiner disagreed.

Licensee replaced item to test applicants' procedure selection knowledge. Question is SAT.

99 H

3 x

x U

SG 2.04.17, High, New E

1.

Cred Dis!: "A" and "C" are not plausible because primary S

containment flooding will not remedy a situation when the reactor remains pressurized. Primary containment flooding is a

\\

level contingency not a pressure contingency.

2.

Stem Focus: The stem states that'there are "non-ATWS conditions"; however, the term "minimum alternate reactor flooding pressure" is rooted in the ATWS event. This could cause applicants to choose the wrong answer. Suggest deleting the non-ATWS comment. Discuss wI licensee.

3.

Licensee argued that Primary Containment Flooding was required when a minimum # of SRVs was not available during both non-ATWS and ATWS. Question should have been ENHANCEMENT.

4.

Comments incorporated (to streamline). Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other 6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues TIF Cred.

Partial Job-Minutia

1. 1 Back-Q=

SRO BIM/N U/E/S Explanation Focus Dist.

Link units ward K/A Only 100 H

3 x

U SG2.04.35 S

SRO-only: Based on the conditions provided in the stem, it is apparent that the scram air header failed to vent; i.e., venting the scram air header is required. This correct answer can be selected without having knowledge of the content of the procedure. The correct answer can be deduced solely using systems knowledge.

2.

Licensee removed the titles and asked which section of the procedure was required. Verified w/ Ops Mgmt that this was not minutia since there are no titles for sub-sections of procedure.

Question is SAT.

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dis!.

Link units ward KIA Only 100 H

3 x

U SG2.04.35 S

1.

SRO-only: Based on the conditions provided in the stem, it is apparent that the scram air header failed to vent; i.e., venting the scram air header is required. This correct answer can be selected without having knowledge of the content of the procedure. The correct answer can be deduced solely using systems knowledge.

2.

Licensee removed the titles and asked which section of the procedure was required. Verified wI Ops Mgmt that this was not minutia since there are no titles for sub-sections of procedure.

Question is SAT.

\\'

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility:

R kt.\\ S IA) I c-j4 Date of Exam: 4/20/, D Exam Level: RO LB SRO Initials Item Description a

b c

1.

Clean answer sheets copied before grading ifr4 2.

Answer key changes and question deletions justified and documented

/tt 3.

Applicants scores checked for addition errors (reviewers spot check > 25% of examinations)

I 4.

Grading for all borderline cases (80 +/-2% overall and 70 or 80, i

as applicable, +/-4% on the SRO-only) reviewed in detail IV

(

i 5.

All other failing examinations checked to ensure that grades I

are justified

/11 4,

1 6.

Performance on missed questions checked for training j

deficiencies and wording problems; evaluate validity 1-of questions missed by half or more of the applicants I

/

Printed Name/Signature Date

a. Grader UNO CA1Le(W

b. Facility Reviewer(*)

c. NRC Chief Examiner(*)

d. NRC Supervisor (*)

/(1

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403 Written Examination Grading Quality Checklist Form ES-403-1 Facility: e R (AN $ WI 61<'

Date of Exam: 4120 h 0 Exam Level: RO ~

SRoCBi Initials Item Description a

b c

1.

Clean answer sheets copied before grading

~ )./L fA (iU;,

I A/4

2.

Answer key changes and question deletions justified I

/11/4-and documented

3.

Applicants' scores checked for addition errors

$n

/~

(reviewers spot check> 25% of examinations)

4.

Grading for all borderline cases (80 +/-2% overall and 70 or 80, ~

fbI, as applicable, +/-4% on the SRO-only) reviewed in detail

5.

All other failing examinations checked to ensure that grades Al)}

~~

are justified

6.

Performance on missed questions checked for training 1fJ1- %

deficiencies and wording problems; evaluate validity (fib of questions missed by half or more of the applicants i' /

Printed Name/Signature Date

a. Grader

-C-<S'-IO

b. Facility Reviewer(*)

AJjq

c. NRC Chief Examiner (*) 12lotfVl...D a~~L/} NI,J Mt?""~ /(d':.

5/s1x;/1)

d. NRC Supervisor (*)

)J.J.J.h)W-T.'vJl~I\\..Y~~

/ ("-

J

~

(*)

The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.