ML092881151

Initial Initial Exam Retake 2009-302 Final Administrative

ML092881151
Person / Time
Site:	Sequoyah
Issue date:	10/15/2009
From:	Operator Licensing and Human Performance Branch
To:
References
50-327/09-302, 50-328/09-302
Download: ML092881151 (31)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Seguo:yah Written Retake 2009 Seguoxah Date of Examination: 9/9/2009 Examinations Developed by: ~ NRC Gritt;:>/

Gritt;:>/ Operating Test Test Written / Operating Test Chief Target Task Description (Reference) Examiner's Date**

Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) fJ}c

~J}c

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) t~

+~

-120 3. Facility contact briefed on security and other requirements (C.2.c) ~

-120 4. Corporate notification letter sent (C.2.d) ~.k f-k

[-90] [5. Reference material due (C. (C.1.e; I.e; C.3.c; Attachment 2)] tjL-tje

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-ES-D-l's, ES-401-1I2, ES-401-3, and ES-401-4, as 301-1, ES-301-2, ES-301-5, ES-D-1's, tJ1,c f$L (C.1.e applicable (C. I.e and f; C.3.d)

{-70}

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility 4>~L iJJtL licensee (C.2.h; C.3.e)}

{-45}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C. (C.1.e, I.e, f, g and

~~

~jA-h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398's) due (C.l.l; (C.Ll; C.2.g; ES-202) ~JY--

i>J)L

-14 10. Final license applications due and Form ES-20 ES-201-4 (C.Ll; C.2.i; ES-202) 1-4 prepared (C.1.l; ~

-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) +¥

~JK

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) ~.!J-<--

~)J,c j~ratiag teSH;

13. Written examinations and ~t=atiag

-7 (C.2.i; C.3.h) tests approved by NRC supervisor

~~

4lc

-7 14. Final applications reviewed; 1 or 2 (if> 10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) fY-

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k) 1.¥--

1Jk-

-7 16. Approved scenarios, job performance measures, and questions distributed to ~)}L

~~

NRC examiners (C.3.i)

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Sequoyah 1 & 2 Date of Examination: 9/2009 Initials Item Task Description a b* C#

c#

1.

w W

a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

I~ Pit- ~~

R b. Assess whether the outline was systematically and randomly prepared in accordance with T

I Section 0.1 of ES-401 and whether all KIA categories are appropriately sampled.

~ Z1+ ~Jk T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. topiCS. ()Iv 11+- ~JU

~

E N d. Assess whether the justifications for deselected or rejected KIA statements are appropriate. 114- IJJ'L

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number nla nla tJ~A-A-of normal evolutions, instrument and component failures, technical specifications, S and major transients.

I M

M b. Assess whether there are enough scenario sets (and spares) to test the projected number nla nla ~~

,J~

U and mix of applicants in accordance with the expected crew composition and rotation schedule L

L without compromising exam integrity, and ensure that each applicant can be tested using A

A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days.

o 0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative nla nla tJi'I

~rt R

and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2: nla nla rJA.

rJl\

(1 ) the outline(s) contain(s) the required number of control room and in-plant tasks (1)

W distributed among the safety functions as specified on the form

/ (2) task repetition from the last two NRC examinations is within the limits specified on the form T

T (3) no tasks are duplicated from the applicants' audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1: nla nla NA N/\

(1 ) the tasks are distributed among the topicstopiCS as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix nla nla rJp, rJP!

of applicants and ensure that no items are duplicated on subsequent days.

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered f};;z..

~lJ;o 7ff"Ztf ~

in the appropriate exam sections.

G E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. I~

P" 141- ~L N

E

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5. ~-

~ -Vlr- tM-vtf-- t!L-R d. Check for duplication and overlap among exam sections. ()(ll/, 14:)- ~JYL f}(J/t 1.4.)- ~Y!A-A L

L e. Check the entire exam for balance of coverage. I~

If#' 1fJ- 1ft-" ~~~.D<-

f. Assess whether the exam fits the appropriate job level (RO or SRO). r~

'~ 11.j- ~M 11-/- 4A.L

~nt~~ture

~

rinte~~N~~ture f))?rfu,

a. Author John B. Roden / ~_ '-2_~_

b. Facility Reviewer (*) Van L. Ford / Ct--- ,;:t - ~ 7/1'316 9

c. NRC Chief Examiner (#) "1:h" \-Il) b_ Cc.:~ek"'r-r I ~.J1 ( A<\ ~ ,,::2 &'fidDj

d. NRC Supervisor l1Alfhl .JA.i". WIOCUNJIJ I r~ .... O'l/1l..(6?

( tr~lT~ ~

Note: # Independent NRC reviewer initial items in C¥mn "c"; chief examiner concurrence required.

• Not applicable for NRC-prepared examination outlines

£6QUOYAH 10a q R6 r fll( 6 PA~§ I ~2 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 9) q)91 of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the 91 () q (J as of the date NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authOrized authorized by the NRC (e.g" (e.g., acting as a simulator booth operator or communicatOr communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/oran and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knOWlrgl' knOWlr9!, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 9 9 q 909.

<<01. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE iRESPONSIBILITY

/ RESPONSIBILITY SIGNATURE (2) DATE NOTE

1. -:fuHN B. R\)~bI

2. S'Tt£VCIJ V. SM'IE}!

3. ~A\l7.b A PDRn'F R'HUV. "" .. " ..... , ""

US/.srd J ". " .... * " " * ... 0 r ~~

/: --v ~ _~V.

5.~'1.0'

-~~:za . '~ ~.- __

\~

4. a~/s' r  ;;> -

• I - '1-:-:;:;;--

5. C4lltS-e."

6*1if~cr

7. E.

8. VQ.lr\ L. i=Of'"

~t" S~ seQ SN\. ~Y;O kD

~

==,~

~. ./~'~

t.1.~\"~==U ~

~..

~ /

1-'i

~

~I

9. * ' i , . "... " '

11. (.p (1l1*.41Nt D A

10.W i LL: 0..,,", L Ch,,/J t..,. IV I L S

l)~

R ()

12(:;)

12. f'B.¥t< 2t2/:N$ S.to

13. ~~K7<:f6w::-/<.",4H' /)<<1."'1 Nil i.tf"J.eA

14. . \ "1",,,\ t . . .""-lM. r(~-......,)

15. L~(LtC\Y...>(;, J,.... f(.M.-+=M...vatta7S'In~-k\

NOTES: )\7~~1E.

?c?~

ES-201, Page 27 of 28

2.., I 'J....

S~Lby4U 2 0 09 7Z~K-C ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation ofof the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. '

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY DATE NOTE

~:='fi~ ~~~~"brr.lt"J=,

3. If/UJenr'~ .zo~ Y 'r( sl ,.,.e.o

~ G!f.-

4. ~"c.... StV\l\~,.r ap> M(;.Cl- ~~

5.~'t &-fCY ~L$A.D ~~

6. ""VI (J:M/1f£ (~ $A.~ .J.U3....a.:L

7. _ _ _ _ _ _ _ _ _ _ _ _ _I_ _ _ _ _ _ _ _ _ _ _-'-_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ __ __ _ ___

8. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ ___ ___

9. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ __ _____

10 . _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

10. ___ __ ___

11 . _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

11. ___ __ ___

12 . _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

12. __ __ _ ___

13.,. _

13 ___ __ __ __ _ ____ ___ __ __ _ __ __ __ _____ __ _ __ __ __ _ ____ ___ ____ _ __ __ __ _ ____ __ _ __ ____ _ _____ _ _ _ _ __

14.,_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

14. __ _ __ __

15._ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _~---------'----------- _ _ __ _

NOTES:

ES-201, Page 27 of 28

Sequoyah 2009 Initial Retake Exam Final Outline ES-401, Rev. 9 ES-401! PWR Examination examination Outline Form ES-401-2!

I

Facility

Sequoyah Date of Exam: 2009 Retake Exam RO KIA Category Points SRO-Only Points Tier Group K K K K K K A A A A G A2 G* Total 1 2 3 4 5 6 1 2 3 4

• Total

1. 1 3 3 3 3 3 3 18 3 3 6 Emergency & 2 1 1 2 2 4 2 1 2 2 9 Abnormal Plant N/A N/A Evolutions Tier Totals 4 5 5 5 4 4 27 5 5 10 1 2 2 4 3 2 2 2 3 2 3 3 28 3 2 5 2.

2 0 1 1 1 1 1 1 1 1 1 1 10 2 1 3 Plant Systems Tier Totals 2 3 5 4 3 3 3 4 3 4 4 38 5 3 8

3. Generic Knowledge and Abilities 1 2 3 4 10 1 2 3 4 7 Categories 2 2 3 3 1 2 2 2

1. Ensure that at least two topics from every applicable KIA category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the "Tier Totals' in each KIA category shall not be less than two).

2. The point total for each group and tier in the proposed outline must match that specified in the table.

The final point total for each group and tier may deviate by +/- 1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3. Systemslevolutions within each group are Identified identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to ES-401, Attachment 2, for guidance regarding the elimination of inappropriate KIA statements.

4. Select topics topiCS from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topiC for any system or evolution.

5. Absent a plant-specific priority, only those KIAs having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6. TIers 1 and 2 from the shaded systems and KIA categories.

Select SRO topics for Tiers

7. *The generic (G) KIAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system.

S. On the following pages, enter the KIA numbers, a brief description of each topic, the topics' importance ratings (IRs) for the applicable license level, and the point toulls tobills (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment Is is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the Ileft.lIeft side of Column A2 for Tier 2, Group 2 (Note

1. 1 does not apply). Use duplicate pages for RO and SRO-only exams.

9. For Tier 3, select topics from Section 2 of the KIA catalog, anoi anCiI enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections till KIAs that are linked to 10 CFR 55.43.

tCiI K/As Ii

ES-401, REV 9 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A 1 A2 A3 A4 G TOPIC:

RO SRO 007EK2.03 Reactor Trip - Stabilization - Recovery 3.5 3.6 D 0 ~ D 0 0 D 0D 0 D 0 D 0 D 0D 0D 0D Reactor trip status panel I 1 11 009EK1.02 Small Break LOCA 13 I3 3.5 4.2 ~ 0 D D 0 D0 D0 0 D 0 D D 0 0D D0 0D Use of steam tables 011EK2.02 Large Break LOCA/3 2.6 2.7 0 D ~ 0 D 0D 000 D D D D 0 D 0 D0 D0 Pumps 015AK2.10 RCP Malfunctions I 4 2.8 2.8 0 ~ 0 D D 0 0 D D 0 D 0 0D 0DOD0 0 RCP indicators and controls 022AG2.1.31 Loss of Rx Coolant Makeup 12 I2 4.6 4.3 D 0 D 0 D 0 0D D 0 D 0 D 0 D0 0D 0D ~

~ Ability to locate control room switches, controls and indications and to determine that they are correctly reflecting the desired plant lineup.

026AA2.02 Loss of Component Cooling Water 18 I8 2.9 3.6 0 D 0 D 0 DOD0 0 0 D 0 D ~ 0 D D 0 D0 The cause of possible CCW loss 029EG2.2.22 ATWS ATWS 11 I 1 4.0 4.7 0 0 0 0 0 0 0 0 0 0 000 ~ Knowledge of limiting conditions for operations and safety limits.

038EA1.13 Rupture I 3 Steam Gen. Tube Rupture/3 3.7 3.7 3.6 3.6 0 0 0 0 0 0 ~

~ 0 0 0 0 Steam flow indicators 040AA1.09 040AA 1.09 Line Rupture - Excessive Heat Steam Une 3.4 3.4 ODD 0 0 0 ~ 0 0 0 0 DDDDDD~DDDD Setpoints of main steam safety and PORVs Transfer 14 I4 054AK1.02 Loss of Main Feedwater 14 I4 3.6 4.2 ~ ODD 0 DODO 0 0

~DDDDDDDDDD Effects of feedwater introduction on dry SIG S/G 055EK3.02 I6 Station Blackout 16 4.3 4.6 0 0 ~ 0 0 0 0 0 0 0 0 DD~DDDDDDDD Actions contained in EOP for loss of offsite and onsite power Page 1 of 2 2111/2009 12:16 PM 211112009

ES-401, REV 9 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I/ SAFETY FUNCTION: IR IR Kl K1 K2 K3 K4 K5 K6 Al A1 A2 A3 A4 G TOPIC:

AO RO SAO SRO 056AA1.11 056AA1.ll Loss of Off-site Power / 6 3.7 3.7 3.7 3.7 0DDDDDD~DDDD 0 0 0 0 0 ~ 0 0 0 0 HPI system 057AK3.01 Loss of Vital AC Ins!.

Inst. Bus / 6 4.1 4.4 0DD~DDDDDDDD 0 ~ 0 0 0 0 0 0 0 0 Actions contained in EOP for loss of vital ac electrical instrument bus 058AK1.0l 058AK1.01 Loss of DC Power /6 /6 2.8 3.1 3.1 ~ 0 0 0 0 0 0 0 0 0 0

~DDDDDDDDDD Battery charger equipment equipment and instrumentation 062AK3.01 Loss of Nuclear Svc Water / 4 3.2 3.5 0 D D 0 ~~ D0 D0 D 0 D 0 D 0 D0 D0 0D The conditions that will initiate the automatic opening and closing of the SWS isolation valves to the nuclear service water coolers 065AA2.05 Loss of Instrument Air / 8 3.4 4.1 0 D D 0 D 0 D0 D 0 0D D 0 ~ 0 D D 0 D0 When to commence plant shutdown if instrument air pressure is decreasing 077AG2.2.39 Generator Voltage and Electric Grid 3.9 4.5 0 D D 0 D 0 0D D 0 D 0 D 0 D 0 D 0 D0 ~ Knowledge of less than one hour technical specification Disturbances / 6 action statements for systems.

WE11 EA2.1 WEll Aecirc. / 4 Loss of Emergency Coolant Recirc. 3.4 4.2 0D D 0 D 0 D0 D 0 D 0 D 0 ~ 0 D D 0 D0 Facility conditions and selection of appropriate procedures during abnormal and emergency operations.

Page 2 of 2 2I11/200912:16PM 2111/2009 12:16 PM

ES-401, REV 9 T1G2 T1 G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I/ SAFETY FUNCTION: IR IR K1 K2 K3 K4 KS K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 003AK3.06 Dropped Control Rod 11 /1 2.7 3 DD D D ~ DD D DD DD DD DDDD DD D Reset of demand position counter to zero 032AK1.01 Loss of Source Range NI/7 NI / 7 2.S 2.5 3.1 ~ DD D DD DD DD DD DD D DOD D LJ D Effects of voltage changes on performance 058AI~.02 Accidelital Accideillal Liquid Rad .....aste ReI. I' 8 2.7 2.7 D~ DDDDDDDDD

~D D D DD D D DD 059AI<2.02 RadWaste 9 2.7 2.7 Radioaeti.e RadiOtieti. e gas monitors 059AK2.01 059AK2.01 Accidental Accidental Gaseous Gaseous RadWaste RadWaste ReI.

ReI. 2.6 2.6 2.9 2.9 D induding the nonnal ARM system, including normal rad-Ievel indications and the op status.

068AG2.1.27 Control Room Evac. I/ 8 3.9 3.9 4 4 DDDDDDDDDD DDDDDDDDDD~ ~ Knowledge of system purpose and or function.

076AA1.04 076AA 1.04 High Reactor Coolant Activity 19 /9 3.2 3.4 D D D D D D ~ D D D D DDDDDD~DDDD Failed fuel-monitoring equipment WE03EK3.4 LOCA Cooldown - Depress. 14 /4 3.5 3.9 D D ~ D D D D D D D D DD~DDDDDDDD RO or SRO function within the control room team as appropriate to the assigned position, in such a way that procedures are adhered to and the limitations in the facilities license and amendments are not violated.

WE07EA2.1 Saturated Core Cooling Core Cooling 3.2 4.0 D D D D D D 0 ~ D D D DDDDDDD~DDD Facility conditions and selection of appropriate 14

/4 procedures during abnormal and emergency operations.

WE10EK2.1 Natural Circ. With Seam Void! 4 3.3 3.5 D ~ D D D D D D D D D D~DDDDDDDDD Components and functions of control and safety systems,systems.

Signals. interlocks, including instrumentation, signals, interlocks. failure modes and automatic and manual features.

WE16EA1.3 WE16EA 1.3 High Containment Radiation I/ 9 2.9 3.3 D D D D D D ~ D D D D DDDDDD~DDDD Desired operating results during abnormal and emergency situations.

Page 1 of 1 2111/2009 12:16 PM

ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 003A3.03 Reactor Coolant Pump 3.2 3.2 3.1 3.1 0DDDDDDDD~DD 0 0 0 0 0 0 0 ~ 0 0 Seal D/P 004A1.12 Chemical and Volume Control 2.8 2.S 3.2 3.2 0DDDDDD~DDDD 0 0 0 0 0 ~ 0 0 0 0 Rate of boron concentration reduction in RCS as a function of letdown flow while deborating demineralizer is in service 004A2.25 004A2.2S Chemical and Volume Control 3.8 3.S 4.3 4.3 0DDDDDDD~DDD 0 0 0 0 0 0 ~ 0 0 0 Uncontrolled boration or dilution 005K1.13 00SK1.13 Residual Heat Removal 3.3 3.3 3.5 3.S Iii'lDDDDDDDDDD

~ 0 0 0 0 0 0 0 0 0 0 SIS 006K5.06 006KS.06 Emergency Core Cooling 3.5 3.S 3.9 3.9 0DDDD~DDDDDD 0 0 0 ~ 0 0 0 0 0 0 Relationship between ECCS flow and RCS pressure 007A2.01 Pressurizer Relief/Quench Tank 3.9 3.9 4.2 4.2 0DDDDDDD~DDD 0 0 0 0 0 0 ~ 0 0 0 Stuck-open PORV or code safety 007A4.09 Pressurizer Relief/Quench Tank 2.5 2.S 2.7 2.7 0DDDDDDDDD~D 0 0 0 0 0 0 0 0 ~ 0 Relationships between PZR level and changing levels of the PRT and bleed holdup tank 008K3.01 00SK3.01 Component Cooling Water 3.4 3.4 3.5 3.S 0DD~DDDDDDDD 0 ~ 0 0 0 0 0 0 0 0 Loads cooled by CCWS 010G2.4.30 010G2.4.30 Pressurizer Pressure Control 2.7 4.1 0DDDDDDDDDD~

0 0 0 0 0 0 0 0 0 ~ Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.

0121<8.09 0121t6.6S Reactor Reactor Protection Protection :T.6--S:7 3:6-&.'7 0DDDDD~DDDDD 0 0 0 0 ~ 0 0 0 0 0 ~ Trip logic circuits 012K6.03 3.3 3.5 013K5.02 013KS.02 Engineered Safety Features Actuation 2.9 3.3 0 0 0 0 ~ 0 0 0 0 0 0 DDDD~DDDDDD Safety system logic and reliability of3 Page 1 of 3 2/1112009 12:16 PM 2/11/200912:16PM

ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I/ SAFETY FUNCTION: IR K1 K2 K3 K4 K5 KS K6 A1 A2 A3 A4 G TOPIC:

RO SRO 022K3.02 Containment Cooling 3.0 3.3 0 0D D ~ 0 D D 0 0D 0D 0D D 0 D 0 D 0 Containment instrumentation readings 025A4.02 Ice Condenser 2.7 2.5 2.S 0 D D 0 D0 0D D 0 D 0 D 0 D 0 0D ~ 0D Containment vent fans 025G2.2.42 Ice Condenser 3.9 4.6 0D D0 D0 0D 0D D 0 D 0 D 0 D 0 0D ~ Ability to recognize system parameters that are entry-level conditions for Technical Specifications 026K2.01 Containment Spray 3.4 3.6 0D ~ 0 D D 0 0D D 0 D 0 D 0 D 0 D0 0D Containment spray pumps

~~:~~~

0261<3.01 eOiitaiiiiiibllt Splay OOlitaililiieli1 Splay ~:~

3.9  ::~

4.1 D 0 0D ~ ~ D0 D 0 0D 0D 0D 0D D 0 D0 6G&

GG&

026K3.02 4.2 4.3 Recirc Spray System 039A 1.03 039A1.03 Main and Reheat Steam 2.6 2.7 00 D D 0D D0 D 0 0D ~ 0D D 0 D0 D0 Primary system temperature indications and required values, during main steam system warm-up 059K4.02 Main Feedwater 3.3 3.S 3.5 D 0 0D 0D ~ D 0 0D 0D 0D D 0 D00 D Automatic turbine/reactor trip runback 061A3.03 Auxiliary/Emergency Feedwater 3.9 3.9 0D 0D 0D 0D 0D 0D D 0 0D ~ D 0 D0 AFW S/G level control on automatic start 061K6.02 061 K6.02 Auxiliary/Emergency Feedwater 2.6 2.7 00 D D 0 D D0 D0 ~ 0 D D 0 D 0 D0 D0 Pumps 062K2.01 AC Electrical Distribution 3.3 3.4 0 D ~ 0D 0D 0D D 0 D 0 D0 0D 0D 0D Major system loads 063A4.02 DC Electrical Distribution 2.8 2.9 0D D 0 D0 0D D 0 0D D 0 D0 0D ~ 0D Battery voltage indicator Page 2 of3 of 3 2I11/200912:16PM 2/11/2009 12:16 PM

ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 064K4.03 Emergency Diesel Generator 2.5 3.0 D D D ~

Ii'] D D D D D D D Governor valve operation 073A2.01 Process Radiation Monitoring 2.5 2.9 0D 0D 0D 0D 0D 0D 0D Ii'] D D

~ 0 D DD Erratic or failed power supply 076K3.02 Service Water 2.5 2.8 D D ~

Ii'] D D D D D D D D Secondary closed cooling water 076K4.03 Service Water 2.9 3.4 D D D ~

Ii'] D D D D 0D 0D D DODD Autornatic opening features associated with SWS Automatic isolation valves to CCW heat exchanges

~~~ _ _ _ _~______ ~ ___ - _ _ _ _ _ _ _ _ 0 ____ _

-~---~---------~-- ____-----,,---____--c-------,-____----::------::-____- -

078G2.2.38 Instrurnent Air Instrument 3.6 3.6 4.5 4.5 0 D DOD

[J DOD DODD D DOD D D D Ii']

~ Knowledge of conditions and limitations lirnitations in the facility license.

103K1.03 Containment 3.1 3.5 ~

Ii'] D D D D D D D D D D Shield building vent system Page 3 of 3 2111/2009 2I11/200912:16PM 12:16 PM

ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 011A1.03 Pressurizer Level Control 2.8 3.2 DDDDDD~DDDD VCTlevel VCT level 015K2.01 Nuclear Instrumentation 3.3 3.7 D~DDDDDDDDD NIS channels, components and interconnections 028K3.01 Hydrogen Recombiner and Purge 3.3 4.0 DD~DDDDDDDD Hydrogen concentration in containment Control 029G2.1.31 Containment Purge 4.6 4.3 DDDDDDDDDD~ Ability to locate control room switches, controls and indications and to determine that they are correctly reflecting the desired plant lineup.

033K4.01 Spent Fuel Pool Cooling 2.9 3.2 DDD~DDDDDDD Maintenance of spent fuel level 034K6.02 Fuel Handling Equipment 2.6 3.3 DDDDD~DDDDD Radiation monitoring systems 041K5.05 Steam DumplTurbine Dumprrurbine Bypass Control 2.6 3.2 DDDD~DDDDDD Basis for RCS design pressure limits 071A2.02 Waste Gas Disposal 3.3 3.6 DDDDDDD~DDD Use of waste gas release monitors, radiation, gas flow rate and totalizer 079A4.01 Station Air 2.7 2.7 DDDDDDDDD~D Cross-tie valves with lAS

. 086A3.03 Fire Protection 2.9 3.3 DDDDDDDD~DD Actuation of fire detectors Page 1 of 1 2111/2009 12:16 PM

ES-401, REV 9 T3 PWR EXAMINATION OUTLINE FORM ES-401-* 3 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO G2.1.41 Conduct of operations 2.8 3.7 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Knowledge of the refueling processes G2.1.42 Conduct of operations 2.5 3.4 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Knowledge of new and spent fuel movement procedures G2.2.23 Equipment Control 3.1 4.6 0 0 0 DOD 0 0 DOli'] 0 0 ~ Ability to track Technical Specification limiting conditions for operations.

G2.2.44 Equipment Control 4.2 4.4 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Ability to interpret control room indications to verify the status and operation of a system.

system, and understand how operator actions and directives affect plant and system conditions G2.3.11 Radiation Control 3.8 4.3 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Ability to control radiation releases.

G2.3.5 Radiation Control 2.9 2.9 0 0 0 0 0 0 0 0 0 0 ~ Ability to use radiation monitoring systems

-=-=--=-=:------c=--::--:--=-----c---------------------------------~--.,.._-_:___-.---------

G2.3.7 Radiation Control 3.5 3.5 3.6 3.6 0 0 0 0 0 0 0 0 0 0 0 0 0 DOli']

0 0 ~ Ability to comply with radiation work permit requirements during normal or abnormal conditions

~------c=---------=--__,__-=_:_----~-____=____==___==___::=___=::_::=___==__=___=::_:::=___ ---

G2.4.11 Emergency Procedures/Plans 4.0 4.0 4.2 4.2 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Knowledge of abnormal condition procedures.

G2.4.16 Emergency Procedures/Plans 3.5 4.4 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Knowledge of EOP implementation hierarchy and coordination with other support procedures or guidelines.

G2.4.37 Emergency Procedures/Plans 3.0 4.1 0 0 0 0 0 0 0 0 DOli'] 0 0 ~ Knowledge of the lines of authority during implamentation of an emergency plan.

Page 1 of 1 2111/2009 12:16 PM 2I11/200912:16PM

ES-401, REV 9 SRO T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 009EA2.11 Small Break LOCA I 3 3.8 4.1 0D 0D D0 D0 D0 0D 0D ~ 0 0D 0D D Containment temperature, pressure, and humidity 015AA2.11 Mal/unctions I 4 RCP Malfunctions 3.4 3.8 0 0D D D 0 D0 0D D 0 D 0 ~ 0D 0D 0D When to jog RCPs during ICC 038EG2.4.20 Steam Gen. Tube Rupture 13 I3 3.8 3.8 4.3 4.3 0 D D 0 D0 D0 D0 0D D 0 D 0 0D 0D ~~ Knowledge of operational implications of EOP warnings, cautions and notes.

040AA2.02 Steam Line Rupture - Excessive Heat 4.6 4.7 D 0 D 0 D0 D0 D0 D 0 D 0 ~ 0D 0D 0D Conditions requiring a reactor trip Transfer 14 057AG2.2.44 057 AG2.2.44 Ins!. Bus 16 Loss of Vital AC Ins1. I6 4.2 4.4 0D 0D 0D 0D 0D 0D 0D 0D 0D 0D ~ Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions 062AG2.1.7 Loss of Nuclear Svc Water I 4 4.4 4.7 0D 0D 0D D 0 D 0 0D 0D 0D 0D 0D ~ Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

Page 1 of 1 2111/2009 12:16 PM

ES-401, REV 9 SRO T1 T1G2 G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 060AA2.05 Accidental Gaseous Radwaste ReI. / 9 3.7 4.2 0 0 0 0 0 0 0 ~ 0 0 0 That the automatic safety actions have occurred as a result of a high ARM system signal

---

~~---~--------------------___,____----___,____---,__-__:_c____:_---

061AG2.4.46 ARM System Alarms / 7 4.2 4.2 0 0 0 0 0 0 0 0 0 0 ~

~ Ability to verify that the alarms alarnis are consistent with the plant conditions.

WE13EA2.1 Steam Generator Over-pressure / 4 2.9 3.4 0 0 0 0 0 0 0 ~ 0 0 0 Facility conditions and selection of appropriate procedures during abnormal and emergency operations.

we15EG2.4.30 Containment Flooding / 5 2.7 4.1 0 0 0 0 0 0 0 0 0 0 ~ Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.

Page 1 of 1 2111/2009 12:16 PM 2I11/200912:16PM

ES-401, REV 9 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME /I SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 004G2.2.44 Chemical and Volume Control 4.2 4.2 4.4 4.4 0 0 0 0 0 0 0 0 0 0 ~

OOOOOOOOOO~ Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions 005A2.04 Residual Heat Removal 2.9 2.9 2.9 2.9 0 0 0 0 0 0 0 ~ 0 0 0 OOOOOOO~OOO RHR valve malfunction 012A2.05 Reactor Protection 3.1 3.1 3.2 3.2 DODD OOOOOOO~DOO 0 0 0 ~ 0 0 0 Faulty or erratic operation of detectors and function generators 059A2.06 Main Feedwater 2.7 2.7 2.9 2.9 0 0 0 0 0 0 0 ~ 0 0 0 OOOOOOO~OOO Loss of steam flow to MFW system 064G2.4.8 Emergency Diesel Generator 3.8 4.5 0 0 0 0 0 0 0 0 0 0 ~ Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

Page 1 of 1 2111/2009 12:16 PM 2I11/200912:16PM

ES-401, REV 9 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I/ SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 028G2.1.23 Hydrogen Recombiner and Purge 4.3 4.4 0 0 0 0 0 0 0 0 0 0 ~ Ability to perform specific system and integrated plant Control procedures during all modes of plant operation.

068A2.04 Liquid Radwaste 3.3 3.3 0 0 0 0 0 0 0 ~ 0 0 0 Failure of automatic isolation

~~1:*.:

071A2.0S 002A2.02

~~~te Vvaste 6as Disposal RCS eas Disposal  !:; !.!

2.7 4.2 S.S 4.4 00 00 00 00 00 00 00 ~~ 00 00 00 RuptUie AtiptUi e disk !ai/tires failures Loss of coolant pressure Page 1 of 1 2/11/2009 12:16 PM

ES-401, REV 9 SRO T3 PWR EXAMINATION OUTLINE ES-401-~ 3 FORM ES-401-t KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A 1 A2 A3 A4 G TOPIC:

RO SRO G2.1.9 Conduct of operations 2.9 4.5 0D 0D 0D 0D D0 0D 0D 0D 0D 0D ~ Ability to direct personnel activities inside the control room.

G2.2.12 Equipment Control 3.7 4.1 0D D 0 D0 0D 0D D 0 D 0 0D 0D 0D ~ Knowledge of surveillance procedures.

o.

G2.2.17 Equipment Control 2.6 3.8 0D 0D D 0 0D 0D 0D D 0 0D 0D D 0 ~ Knowledge of the process for managing maintenance activities during power operations.

G2.3.11 Radiation Control 3.8 4.3 0 0D 0D 0D D D 0 D 0 0D 0D 0D 0D ~

~ Ability to control radiation releases G2.3.14 Radiation Control 3.4 3.8 D 0 0D 0D 0D D 0 D 0 0D 0D 0D 0D ~ Knowledge of radiation or contamination hazards that may arise during normal, normal. abnormal, abnormal. or emergency conditions or activities G2.4.16 Emergency Procedures/Plans 3.5 4.4 0D 0D 0D 0D D 0 0D 0D D 0 0D 0D ~ Knowledge of EOP implementation hierarchy and coordination with other support procedures or guidelines.

~~~----------------------------------------------------------------------------------------

D 0 D 0 0D D0 0D 0D D D D D o ___

G2.4.38 Emergency Procedures/Plans 2.4 2.4 4.4 4.4 DOD 0 ~

~ Ability to take actions called for in the facility emergency plan, plan. including supporting or acting as emergency coordinator.

Page 1 of 1 2111/2009 12:16 PM 211112009

ES-401 Record of Rejected KI KlAs As Form EES-401-4 S-40 1-4 Sequoyah 2009 RO Retake Exam Tier 1 Randomly Reason for Rejection Group Selected KIA -

1/2 059 AK2.02 Unable to write question relating the interrelations between an accidental liquid Radwaste Release and a radioactive-gas monitor.

Replaced by Edwin Lea on 4/06/09 with KA 059 AK2.01 2/1 012 K6.09 Question on Reactor Protection system related to CEAC which is a Combustion Engineering vendor application.

Replaced by Edwin Lea on 4/06/09 with KA 012 K6.03 026 K3.01 2/1 Anything that initiates Containment Spray System also trips and isolates the Containment Cooling System components.

Therefore have been unable to write a question that meets the KIA addressing the effect that a loss or malfunction of the Containment Spray System would have on the containment cooling system.

Replaced by Edwin Lea on 4/06/09 with KA 026 K3.02

ES-401 Record of Rejected KlAs KIAs Form ES-401-4 Sequoyah 2009 SRO Retake Exam Tier 1 Randomly Reason for Rejection Group Selected KIA 2/2 071 A2.03 There is no rupture disc in the Waste Gas System and the KIA addresses predicting the impacts of and using procedures to address the failure of the rupture disc. There is a separate KIA on stuck open relief valves.

Replaced by Edwin Lea on 04/06/09 with KA 002 A2.02

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Sequoyah 1 & 2 Date of Exam: 9/2009 Exam Level: RO ~

1&1 SRO~

SRO ~

Initial Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. frl.- O ~

2. a.

b.

NRC KlAs are referenced for all questions.

"h"",..ti",,,: are referenced as available.

Facility learning objectives ~ J fJjL

3. SRO questions are appropriate nnr'f'lnri;::,t,,, in accordance with Section D.2.d of ES-401 l~ Dt. ~/'-

Ij~~:.;;* .*.*. if* :,:",

4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). .~. ~

~jL

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_ the audit exam was systematically and randomly developed; or

_ the audit exam was completed before the license exam was started; or 2L the examinations were developed independently; or

~

_ the licensee certifies that there is no duplication; or

{ilL IJ! I~}L

_ other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New

~ I~JL from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right.

23/24 37/32 40/44 j/tl

7. Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right.

40 /32 60 / 68

/It ~ fJJ"-

8. References/handouts provided do not give away answers or aid in the elimination of distractors. ~ (j ~

9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;

. ed.

deviations are justified.

pt 9J f#-

10. Question psychometric nC:'/I"h,Nr,oh*i,. quality . and format meet the guidelines nes in ES Appendix AnI'On,n,v B. /1& ,f;jJ  !~)L

< \

11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. Wt I!I I~r-m-:-

\

Printed NAnature Date a~'hv a.

b.

c.

d.

Author Facility Reviewer (*)

NRC Chief Examiner (#)

NRC Regional Supervisor John B. Roden B",dlev D. P;"";OIl';O

~!J).. ". VlI~JJIJ,I\V

/

i>\-,;.'\-,~ 6- . C"'-bek-A I I

f I, . Q.... k

,ru.uy~

¥Ii

'1 . l- "

dft~th Note:

• The facility reviewer's initials/signature are not applicable for NRC-developed examinations.

I

1. Independent ent NRC reviewer initial items in Column "c"; "c'" chief examiner concurrence required.

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 SEQUOYAH INITIAL REVIEW Instructions

[Refer to Section 0 D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. (F)undamental or (H}igher Enter the level of knowledge (LOK) of each question as either (F}undamental (H)igher cognitive level.

2. (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

Enter the level of difficulty (LOO)

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too milch much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

truelfalse statements.

The answer choices are a collection of unrelated true/false

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

14. Check the appropriate box if a job content error is identified:

• (Le., the question has a valid KIA The question is not linked to the job requirements (i.e., KiA but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., (Le., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA (KiA and license level mismatches are unacceptable).

6. (U)nsatisfactory (requiring repair or replacement), in need of (E}ditorial Based on the reviewer's judgment, is the question as written (U}nsatisfactory (E)ditorial enhancement, or (S}atisfactory?

(S)atisfactory?

7. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD LOO (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S U/E/S Explanation Focus Dist.

Oist. Link units ward KiA Only KIA st Reexamine use of 15{ 1 part of each distractor to see if necessary. Change e E-O in distractor A to E-O.

76 H 2 Correct typo in distractor A. Added bullet to the stem to define RWST level S

and trend make 0 D distractor more plausible.

Distractor B & 0 Oistractor D imply that there is train relationship for CETs. If there is e not, then B & 0 D are not valid distractors. CETs are train related. Change 77 H 2 X nd 2 nd part to change choices to 0 and 4 for incorrect answer.

S Changed distractor B & 0 D to "2 thermocouples in each train" Distractor B & 0 Oistractor D imply that an entry into a FRP is lJlausible plausible even if there is e no condition to do so. B & 0 D do not appear to be valid distractors. Change 78 H 2 X nd 2nd part to change choices B & 0 D more plausible.

S Reworded the question to eliminate concern concem with 2 distractors.

A is not plausible. The only uncontrolled Boron change that would increase Rx power would be caused by a significant dilution event and e corresponding MWe increase. This is generic fundamental there is no correspondingMWe 79 H 2 X knowledge and is not SRO only. AOP entry conditions are RO knowledge S level. SRO level criteria is based on knowing the specific guidance from the AOP. Reviewed wI wi license. OK. Make editorial corrections. Replaced nd 2 nd layer dashes in the stem w/bullets to improve appearance.

Uy What makes this SRO? Appears that both parts of the answer can be 80 H 2 X X deduced using system knowledge. In the stem, "SI not actuated". This S appears to be leading the candidate to part of the answer. Why not

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOO LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dis!.

Dist. Link units ward KIA Only instead say that "SI is not injecting". SI not actuated implies that no signal has been received therefore, it is NOT required to be initiated and this is one part of the answer. Eliminated the "SI not actuated" information and nd changed 2nd part of the question to address T.S. entry to meet the SRO Only portion. Changed stem conditions to support the T.S. entry criteria.

What makes this SRO? The NOTE for non EOP entry is in the body of the 1Nhat

~OP.

AOP. Does this make it RO criteria? If so, A& C are not plausible. B & D 0 e are not symmetrical. Reword B to match D. O. "Acknowledge the Orange 81 H 3 X X path and continue... Is the first part of D 0 plausible? Why not change to S say Orange path also? The last part is incorrect anyway. Reviewed wI wi license. Made editorial corrections so that B & D 0 are symmetrical and simplified wording in the distractors.

1Jy What make this SRO? Appears question is derived based only on system 82 H 3 X knowledge. Changed 2nd part of question to be SRO Only.

S The stem contains a cue: "The CRO reports that the fuel pool rad monitors are blocked". If they're blocked then only the Aux Bldg alarm is 1Jy meaningful. It also implies that there is no concern with ABGTS being 83 F 3 X X INOP. This makes B & D 0 not plausible. Rewrite to remove cue and ask S

about ABGTS operability. Will revise to remove cue. Reworded stem to remove cue.

A & C do not appear to be plausible. No procedure direction to fill S/G to 100% anywhere. FR-H.3 is not a RED or ORANGE path EOP. Is this an entry level knowledge criteria for a RO. If so C & D 0 are also UNSAT for 1Jy this condition. Revise C & D 0 to change 100% to a procedure related 84 H 2 X number or guidance. Removed SG level in distractors C & D 0 and S

changed SG #2 level in stem of question from 86% to 79%. This changed the correct answer from the original question and made the other distractors more plausible.

e Are FR entry conditions required RO knowledge? Is 1 hr NRC notification 85 H 2 X X required RO knowledge? Is not just RO knowledge.

S 1Jy Incorrect KA.

KA Not lAW sample plan. 2.4.44 vs. vS. 2.2.44. New question 86 H X written to match KA.KA S

st nd 1st half of answer "event in progress is RO knowledge". 2nd part of "B" &

"D" "0" distractors is not plausible. Water level is stated as increasing in stem e of question. Therefore, can deduce answer with RO knowledge alone.

87 H 2 X X Reviewed wI wi license. Question is detailed procedure knowledge and is S therefore at SRO Only level. Procedure title corrected in stem of question.

e Does not appear that the "lAW" statements are needed in 2nd part of nd 88 F 2 X distractors. Licensee put hard return in stem, eliminated wording "in S --

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q#

0# LOK LOD I (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO U/E/S 0= u/E/S Explanation Focus Dist. Link units ward KIA Only accordance with" in all choices.

Can deduce answers from RO knowledge only. Reviewed w/ wi license.

89 H 3 X S Licensee verified this is SRO level knowledge.

E B& &D 0 do not appear plausible. When would the procedure reader perform 90 H 2 X an AOP and handoff an EOP? Reviewed wi license. OK This is aa past S event. Simplified distractor wording E Distractor B & &D C/O &

0 not plausible. Vessel venting is not part of C/D &

91 F 2 X Depress strategy. Why would you vent the vessel in ES-1.2? Modified S stem wording to improve clarity of question.

92 H 2 S Reformatted to be consistent with other 2 part questions.

st nd y

1J 1st half of distractors is AOP entry (RO Knowledge). Appears 2nd half may 93 H 2 X also be RO Knowledge. Licensee wrote a new 2" part to be SRO Only S (T.S. operability).

94 F 3 S 95 F 3 S 96 F 3 S Can deduce answer from system knowledge only. Backfill goes back to nd RX, blowdown goes to environment. 2nd part is EOP entry (RO y

1J Knowledge) Also this question is a potential repeat of question 76.

97 H 2 X Completely re-wrote question to remove reference to ECA*3.1 ECA-3.1 to avoid S conflict with 076. Q76. The revised question centers around the selection of recovery actions in the preferred procedure that will be used as the mitigating strategy and the basis of why the action was chosen.

98 F 2 S 99 H 3 S 100 F 2 S - - - _ ... _ - - - - - - _.. _-- ---_._-- -- -

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LaD LOO (F/H) (1-5) UlE/S utE/S Explanation

~

E Enhance the question by rewording distractors to start with "The Reactor 1 H 3 will remain at ... " or "The Reactor will trip due to a ... " ~ Rew0rded S distractors, dlstractors.

~

E Could you change to have Th included as in the bank question to 2 H 3 X (Subcooling margin eliminate the use of 2 part answers? Also, why is (Subcoollng =0)

=

S given Inin the stem? Is this cueing? Removed ~ suj,)co~ling fir<Oll1l1l fr~ ~ $!er;m..

~

E Is C plausible? Is it possible to have reflux boiling wI w/ RCPs running?

3 H 3 X distractor to Improve Changed C dlstractor improve plausibility.

plausibility, II 3 S

! nd in high flow across the #2 seal". Appears to be 2 nd bullet: "results In E

~ unnecessary cueing. The ARP only states that there is an increase in I

4 H 3 X ROT flow. The ARP does not contain a section for #2 seal failure S concerning low flow as this is not possible, i.e. not needed. Eliminated

!I "results Inin high flow across the No.2 No, 2 seal" from 2 00 bullet in stem.

2nd

!I 69 & & 70 close @ <17% PZR Ivl. This information was not contained in the

~

E enclosed reference material. Change the bullet in the stem so that PZR Ivl I 5 H 2 is at 27% and decreasing vs 59% to raise Ivl of difficulty. Changed PZR Ivl I

S to 54% as we operate within 10% of program to keep the question

1 operational valid.

~

E Change wording in stem to "ESF equipment" vs. "ESF component".

1 6 H 2 Changed wording in stem as noted above.

S 7 F 2 S

~

E Rearrange so that they go in numerical sequence: None of the loops, 8 F 2 distractors as noted.

Loop 2 only, 3 loops, etc. Rearranged dlstractors S

9 H 2 S

~

E Instead of telling them the SG is dry, provide indications in the stem to 10 F 2 X sS reflect this. Modified stem to give indications of a dry SG. sa.

J\dd Add the words "in accordance with EPM-3" after the word "basis" in the stem of the question. Is basis the right word? Should it be "reason"?

E

~ Distractor "8" does not appear plausible. Voids will go up during rapid Oistractor I 11 F 2 X S C/O. Not fundamentally sound. Reworded stem to add procedure name distractor 0 and changed dlstractor D wording "to Jlmit limit amount of voiding" to improve improve.

plausibility.

12 H 3 S Simplify question: Change stem to Unit 1 @ 93% vs. both units and

~

E nd change choice selections to only unit 1. Reword 2 nd column in distractors 13 H 3 S to be complete sentences. Changed stem of question to be. be ill a ~Ie single IIllIliIt unit question and changed distractor selection to be only Unit 1 b0ard$. ~

ES-401, Rev. 9 ES*401, Written Examination Review Worksheet Form ES*401*9ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

0# LOK LOD (F/H) (1-5) U/E/S utE/S Explanation Remove "and dropping" from stem. This appears to be unnecessary E cueing. The applicant should know this. Add the word "current" prior to 14 H 2 X X

status, i.e. "current status" of 125V DC Battery. Removed "and dropping" S

from the stem, reformatted the question to simplify.

E Distractor A does not appear plausible. How much ERCW would it take to 15 H 2 XX cause a rise in containment pressure? A & & C distractors changed to ask S about flooding vs. increasing containment pressure.

How did you acquire 44% and 54% for distractor choices B & & C? If E program level is 69% should choice B & & C be 64% & & 74% for < 5% or or>

16 H 3 S 5% of program level? PZR program level at 69% power is 49%.

Reworded question to simplify.

17 H 3 S E Is this level of knowledge above RO knowledge? Do you need to tell them 18 H 4 X X they're in an orange path? Removed "orange path" from question stem.

S 19 F 3 S lYj This is a plant specific exam. This question reflects generic fundamentals 20 H 3 and as is has a LOD of 1. Moved 0#57 to 0#20. Wrote a new question S for 0#57.

st 1st bullet appears to be a cue and is not needed to arrive at the proper lyj & B do not appear answer. It also contains a portion of the answer. A &

21 H 3 X X XX plausible. How could a high rad alarm setpoint be the cause of an S

excessive release (it would prevent it). New question written.

Verify this is RO knowledge with licensee. SO confirms that this meets 22 F 2 S their criteria for RO knowledge.

Not sure if LOK is an F, looks more like an H. Change B to be symmetrical with A, A. i.e. "The development of an RCS leak inside E containment". Make D start with "An", i.e. "An oscillating ........" Also, do we 23 H 3 S need to say lAW SGTR in stem? If we omit, SGTR could be added as a distractor if needed. NOTE: Reference not provided for distractor D (AOP R.02). Changed LOD to H. Other changes from above incorporated.

rd E 3 bullet in stem to specify what press 1125# correlates to:

Add qualifier to 3rd 24 H 2 - i.e. RCS press or PZR press. Confirm A & & B plausible. Pressure bullet S now states RCS press. Confirmed A & & B plausibility with licensee.

E 4th bullet, change "in" to "is". Is RCS subcooling =0 unnecessary cueing?

=

25 H 3 3* Changes made as noted above.

S Verify this meets the KA. Change D to match wording in procedure. Also E verify that D can NOT be considered as also correct or partially correct. D 26 F 3 X X

S wording changed as noted above. D distractor verified to be incorrect wI fNording wi licensee.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD LOO (F/H) (1-5) U/E/S Explanation This appears to be a memory question, F. This seems very difficult if it is st nd a memory question. Also, the 1st half is in the SO procedure. Is the 2nd st half also there? If so, the 1st 3 bullets are not needed to answer the 27 F 4 E question. Also, the EA procedure only states that the annulus dp must be more negative than -0.5"

-0.5" H20. This is the procedure in effect, not the SO

~hich which states -.02" to -1.2" H20, i.e. C could also be construed as correct.

Changed LOD LOO as noted.

~

A picture of RCP Seal dp is needed to verify max range is 500 psid. Why

~oes does RCP Op Parameters Table (SO-68-2 Table 1) give a max value of 28 F 3 S 2300 psid & a normal of 2250psid if this value can not be read? Does the question need to specify where the indication is? Verified during in office visit that question is SAT as is.

~ppears Appears to be cueing in stem. Why do we say CVCS mix bed "being used st or deborating"? Is this necessary? Is C & D for 0 1st half plausible? How would lowering letdown flow increase IB]

/Nould [B] removal? Also, do we need to E add the word BOTH to the question prior to "Letdown Flow & Temp."?

29 F 2 X X Agreed wI licensee's logic for C & D 0 plausibility. If flow is lowered through S

IX, applicant could misconstrue this to mean a better IX process would occur. Question was also reworded to simplify choices to a "combination of letdown flow & temp."

Distractor Oistractor A & C implies an outward inadvertent control rod motion due to an inadvertent boration from CCS. Is this plausible? How would a leak in lyj the CCS HX cause boron level to increase in the RCS? Question was 30 H 2 X reworded with distractors modified to improve plausibility. Question now S st asks for when the 1st operator action is required vs. procedure section entry.

Not sure of LOD.

LOO. I'think I think this is a H. B is missing "in" after the word E available. Reword as a fill in the blank statement to simplify. With U1 @

31 F 4 100%, the RHR Xtie Isolation Valves ... are required to be maintained in S the open position to ensure in the event an RHR pump fails during response to a LOCA. LOD LOO is OK. Reworded question to simplify.

A&D SOC mode. THE CLA would be valved 0 not plausible if the Rx is in SDC U

out of service. You only need to know the highest and lowest press 32 F 2 X E component to answer the question. Question modified to add 100%

power level to stem of question so that all modes would apply.

S Rearranged component selection.

E Is 360 degrees F the right distractor? Changed the distractors to a 33 H 3 correlating temp. band vs. < or > 360 degrees.

S E

Does the PRT have an auto pump down feature? No auto pump down 34 H 2 feature. Clarified the stem question to say "Iong "long term effects".

S ---

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD II (F/H) (1-5) U/E/S utE/S Explanation II The stem states there is an auto isolation. An auto isolation of what? The I eE question itself asks about whether or not there is an isolation. Question 35 H 2 X S was rewritten to clarify &

fNas & simplify.

36 H 2 S 37 H 3 S 38 H 3 S 39 H 3 S eE The LOK appears to be incorrect. Should be an H. LOK changed.

40 H 3 S

eE ~ is not plausible and is not symmetrical with choice C & & D. Change to a 41 F 3 X "stored ice w/boron concentration of 2400 ppm sodium tetraborate".

S Comments incorporated as noted.

S Simplified question stem by removing unnecessary assumption statements.

42 H 2 eE S

Verify that B is plausible, i.e. only 1 CCP is running based on given 43 H 2 S conditions. Verified plausibility during in office review.

44 F 2 S \A.ppears LOK is incorrect, this is a F. Changed LOK to F.

IAppears eE "during" in the question stem needs to be changed to "and". Changes 45 H 2 made as noted.

S eE ~here There is an extra space at the end of the question in the stem and the 46 H 3 question mark. Changes made as noted.

S eE LOK should be H. Changes made as noted.

47 H 3 S

48 F 3 S 49 F 2 S 50 H *. 3 S Typo "restated" should be "restarted". Is ODCM actions RO knowledge?

eE This is an H not an F LOK. Changed LOK to H and corrected typo.

51 H 4 S Verified that ODCM action for this particular event is ODCM expected knowledge for RO during in office visit.

52 H 2 -_ .. _ ...

S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H)

(FtH) (1-5) U/E/S utEtS Explanation eE No correct answer in the analysis section. Corrected analysis section to 53 F 3 identify correct answer and changed LOK.

S eE Are you saying this TS INOP? Or is CA "unavailable". Reworded to state IAre 54 F 2 that "equipment supported by aux. air" becomes inoperable.

S 55 F 2 S 56 H S 57 H S lUj Question as written does not meet KA. Question was modified to meet KA KJ!

58 H X criteria.

S 59 H S 60 H S eE LOK incorrect. Changed LOK from H to F.

61 H S

eE Changed distractor statements to add "110% of .. ...;"" based on design basis 62 F statement.

S eE Modified question and distractors to simplify.

63 H S

eE Changed LOK from H to F.

64 H S

eE Changed the 2nd nd 2 half on distractor B && D from "verify fire exist" to "confirm 65 H alarm is valid" to better match the wording from the ARP ARP..

.S I

I 66 H 4 S Verified with licensee during in office visit that the LOD is not too high.

67 F S 68 F S 69 H S Question was unsat as written. Only one distractor was related to RCS lUj activity (Primary Plant). All other distractors were related to the secondary 70 F XX I

S plant. Question was reworded to just ask about activity in the secondary

! plant & & only have choices related to secondary plant.

,I 4

-'\. lUj Question was unsat as written. LOD was a 1 based on General Employee 71 F level of knowledge. New question written that is operational valid. Noted

'I 71 2 E misspelled..

during final review that there is a Typo. "Control" is misspelled

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 I

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD LOO (F/H) (1-5) U/E/S Explanation 4~ lyj Question was unsat as written. LODLOO was a 1 based on General Employee 72 F level of knowledge. New question written that is operational valid 2 S E Changed B & D 0 distractors to "The step number is circled" to reflect an 73 F option given by the admin procedure but not used in the AOI procedures.

S nd lyj The 2 nd case in the stem of the question as written overlapped with Q#81.

74 H ~he 2 nd IThe nd case was modified so as to not overlap with any existing S questions.

75 F S 16 Unsat: 7 SRO, 9 RO ES-401, Rev. 9 2 Form ES-401-9

ES-403 Written Examination, Examination Grading Form ES-403*1 ({

Checklist Quality Checklist 5EQUJ'J/ Ali Facility: 5EQu...r'J'jM1 Date of Exam: o91091~

69/ 0 9 /;?aJ9 Exam Level: R@ SROiK] SRO~ II Initials Item Description a b c

1. Clean answer sheets copied before grading grading  !?$ tJA "JA fJrv--

2. Answer key changes and question, Answer and documented question deletions justified /rfP 1)1

3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations)

'rffP +A-c

4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, nfP applicable, +/-4% on the SRO-only) reviewed in detail NJ/I as applicabl.e, N//1 \ JJ1L-1.1

5. All other failing examinations checked to ensure that grades are justified grade~

11/1.4 11l/f}

(}1f3 I ~Jj}'L

6. Performance on missed questions checked for training deficiencies and deficiencies. and wording problems; evaluate validity IJfP t ifJL of questions missed by half or more of the applicants (

Printed Name/Signature Date a.

a.. Grader MARK A T!>/trt:1/ IRj{! ~~

A.1SAT~/r!lJ()~ o~*fl

b. Facility Reviewer(*) N/A N/A M/A

c. NRC Chief Examiner (*) fh.)\i1 b-. ~e"<;..:t i>\-x."i~ &, !of~J. r-

~~"o-t"t I~~ ,r-- t\l-2-} 20(>1 1.\l-1..h.oo1

d. NRC Supervisor Supervisor(*)(*) ~(J.hT.WU)AU.AJ~

~(MT.Wl/)}'u'~ / ~~U1, L-#'Ul/ -- tJ9/zZI6~

09('22/6'1 I/ l'--)

'-)

(*) reviewer'S Signature The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6