ML12074A059
| ML12074A059 | |
| Person / Time | |
|---|---|
| Site: | Watts Bar  |
| Issue date: | 04/29/2011 |
| From: | Operator Licensing and Human Performance Branch |
| To: | Tennessee Valley Authority |
| References | |
| 50-390/11-302 | |
| Download: ML12074A059 (71) | |
Text
ES-201 Examination Preparation Checklist Form ES-201-1 Facility:
Watts Bar Date of Examination:
12119111 Developed by: Written
- Facility NRC II Operating
- Facility NRC Target Chief Date*
Task Description (Reference)
Examiners Initials
-180 1.
Examination administration date confirmed (Cia; C.2.a and b) rfa
-120 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e) rfa
-120 3.
Facility contact briefed on security and other requirements (C.2.c) rfa
-120 4.
Corporate notification letter sent (C.2.d) rfa
[-90]
[5.
Reference material due (C.1.e; C.3.c; Attachment 3)]
rfa
{-75}
6.
Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, rfa ES-301 -1, ES-301 -2, ES-301 -5, ES-D-i s, ES-401 -1/2, ES-401 -3, and ES-401-4, as applicable (C.1.e and f; C.3.d)
{-70}
{7.
Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)}
{-45}
8.
Proposed examinations (including written, walk-through JPMs, and rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 9.
Preliminary license applications (NRC Form 398s) due (C.1.1; C.2.g; rfa ES-202)
-14 10.
Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; rfa ES-202)
-14 11.
Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f)
-14 12.
Examinations reviewed with facility licensee (C.i.j; C.2.f and h; C.3.g) rfa
-7 13.
Written examinations and operating tests approved by NRC supervisor rfa (C.2.i; C.3.h)
-7 14.
Final applications reviewed; 1 or2 (if>10) applications audited to confirm rfa qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)
-7 15.
Proctoring/written exam administration guidelines reviewed rfa with facility licensee (C.3.k)
-7 16.
Approved scenarios, job performance measures, and questions rfa distributed to NRC examiners (C.3.i)
WP,TrEAJ 6w1 rnflPLE ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:
WATTS BAR Date of Examination:
OCTOBER 2011 Initials Item Task Description
1.
a.
Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
R b.
Assess whether the outline was systematically and randomly prepared in accordance with I
Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
Hf ff1 r T
7Jt,
T c.
Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
711 in
/YX._
d.
Assess whether the justifications for deselected or rejected K/A statements are appropriate.
- 7 2.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S
and major transients.
b.
Assess whether there are enough scenario sets (and spares) to test the projected number u
and mix of applicants in accordance with the expected crew composition and rotation schedule L
without compromising exam integrity, and ensure that each applicant can be tested using A
at least one new or significantly modified scenario, that no scenarios are duplicated T
from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3.
a.
Verify that the systems walk-through outline meets the criteria specified on Form ES-301 -2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form I
(2) task repetition from the last two NRC examinations is within the limits specified on the form T
(3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301 -1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
c.
Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
7/7 14 b.
Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
c.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
R d.
Check for duplication and overlap among exam sections.
4 4
4 A
flj L
e.
Check the entire exam for balance of coverage.
t?j
Aif f.
Assess whether the exam fits the appropriate job level (P0 or SRO).
ff, 1/9
- a. Author L/4Z
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
13g. kj c3AL
/
- d. NRC Supervisor Note:
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Watts Bar Date of Examination:
10/17/1 1 Initials Item Task Description
1.
a.
Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
44 /
R b.
Assess whether the outline was systematically and randomiy prepared in accordance with Al/A iJ.,I I
Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
i4 i4 c.
Assess whether the outline over-emphasizes any systems, evolutions, or generic toPics.
- 7;;?;:
N d.
Assess whether the justifications for deselected or rejected K/A statements are appropriate.
pil/,q N7 2.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, tecfnical specifications, S
and major transients.
r M
b.
Assess whether there are enough scenario sets (and spares) to test the projected number U
and mix of applicants in accordance with the expected crew composition and rotation schedule L
without compromising exam integrity, and ensure that each applicant can be tested using r
A at least one new or significantly modified scenario, that no scenarios are duplicated r
T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
0 c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative R
and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3.
a.
Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form I
(2) task repetition from the last two NRC examinations is within the limits specified on the form 4.
T (3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301 -1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
c.
Determine if there are enough different outlines to test the projected number and mix
,j 5
of applicants and ensure that no items are duplicated on subsequent days.
4.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered
\\j in the appropriate exam sections.
G b.
Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
N c.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
d.
Check for duplication and overlap among exam sections.
AJ c czr A
e.
Check the entire exam for balance of coverage.
f t.
L f.
Assess whether the exam fits the appropriate job level (RO or SRO).
ii Pr 1
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Supervisor ure I
Note:
- Independent NRC reviewer initial items in Co Not applicable for NRC-prepared examination outlines I
xaminer concurrence required.
ES-201, Page 26 of 28
EP cTOgcQ 2i)
ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of //)/ %/ as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ofg From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide erformance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME
- 1. Jfl
- 2. t/e A Fkf4-vvi 3.
It,itHo.i(
biiI,L1&
4.
c$A I
- 5. k.AJ Bcc.L
- 6..frv.iv 7.
- 8. :);1-.-- (.
9.
iD
- 10. Am 11.
12.L/,
13.jc
- 14. 6 q.i-15.
ffl-ntc i t
QLL NOTES:
1z JOB TITLE / RESPONSIBILITY i1w.
I&t41 7v{1i E-xn 1 IWd 1 Ictni ErJ(
4 b.
)L
/11
D4,f oP57ku&.
jLi.t4,
,,. L- -V,L-5 5
fat ctr gj*.it-.
ç 4_7( _
4 e)
SLo czo
-7)/J,,
(-3-- I.
79/IL iZI771(1 IGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE iQ4/9...
j 3fZSflO
_Jo ii f23/ii
_G /7/i, 7/ i3/i 7/IAhi
- N I
v v
St ES-201
, Page 27 of 28 I L
ES-2()1 Exarrnnation Security Agreement
Form ES 201-3 1.
PreEtcarninatJen I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of4 JH %/ as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations toy persons who have not been authored by the NRC chief exa minor.
I understand that I am not to insimet, evaluate, or provide perrn1ance feedback to those apptcants scheduled to be administered these licensing examinations from this date untH completion of examination administration, except as specifically noted below and authorized by the NRC (ea. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and!or an enforcement action agaInst moor the faitty lnx.nsee I wit irnmediatet. rpo1 to taciIiL management or the NRC cleef examiner any irthca1ons o suggestions that examination secLnty may havd been compromised.
2.
Post-Examination To the best of my knvtedge, I did not divulge to any unauthodzed persons any information concerning the NRC licensing examinations administered during the week(s)of4 From the date that 1 ente ed into this security agree meet until the completion of examination administration I ti d not irmstnjct evaluate or rovic1e performance feedback to those dpphcanls who were adrsrnstered these hcensmng examinalion except as specifically noted betow arid authorized by the NRC.
FRI hUED NAME 1.
2.j)ic. /t
- 5. frA.t
- 6. Wv. ?4 7.
9i Ki 10.t v
4 L_*.f,.L__
12.Zk
/:
I3 i
- 74. iL 52, 1
.rnr 15.
NOTES:
JOB TITLE! RESPONSIBILITY
- 4rn,
_E iii bP5 73! 215 fac s-(/a-5 DiJr IGNATURE (1)
(
DAT E SlGhLAl URE (2)
DATE NOTE 1-3-ta I
ES-201, Page 27 of 28
1,
z
,,1Lo c_-J.
7n3fi o
,)LJ I Ltf (
Examination Security Agreement Form ES-201-3 1.
Pre.Examiriation I acknowledge that [have acqufred specialized knowleda about the NRC Ucensin exaniinalion s scheduled for the week{s) of as otthe dale of my signature, I ag roe that I will net knowingfy divuhje any information about these eaminalions to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to irrsImcI evaluate, or provide peifomianco feedback to those applicants scheduled to be adrninistemd these licensing examinations from this date until completion of examination administmtkrn, exce1 as specilfoally noted below and authorized by the NRC (e.g.,ac]Jng as a siniulalorboofl operator or communicator is acceptabi if the individual does not select the training content or provide direct or indirect feedback). Fuilhennore, I am aware orthe physical security measures and reculremenls {as docinnented in the facility censaes procedures) and understand that violation ofthe conditions of this agreement may result in cancel [affon of Ihe exarninatiuns andloran enfoicenieni action against me or the facility licensea.
I wil immediately report to facityrnansgernenI or The NRC chief examiner any indications orsueslions that examination security may have been compremised 2.
Post-ExaminaIIon PRINTED NAME 1.
Jl 1
fl.
foth?AI/
2?rik 4 1 4
DJMn 3.
11iint 4dt&
- 4. It$SL1 5, i4
- 6. Avt 7/oV
.1.
Phi *+ f_
8.
,),It.V% G.
- 9. ft wrf.b i<a, iom 3 5*t4iq.J 12.1-6J 13.ç cL.i 1
- 14. !7i
- £4i,yNt.r 15.
NOTES:
JOB TITLE! RESPON$1BILITY
>rqei, &kf Tv
!Xi2W aThj.ti EcI%
£W4 ti4.
19I%
oP5T cc-Ssn. LsLr iflu f6$fLtir(4f 1%hI,i..
5f lS-Cit 4
Lc ES-201,Page 27 of 28 U
-D
-J ciI C.,
To the best of ray knowledge, I did notdivulge to any unauthorized persons any infonnaliun concerning the NfC licensing examinations administered during Iheweek(s) ofc4 From the dale that I entered into this security agreement until the completion of examinalion administiaUcn, I did riot inslnic!. evaluate, or piovide er1armancc feedback to those applicants who were administered these licensing examirtations, except as specifically noted below and atrtlionzéd by the NRC.
IGNATURE (1)
DATE SIGNATIJRE(2)
DATE NOTE
_iq 1
- 1/&ta 4t t),
1 M7I1/iz
_Øp _&1_..
I2f?1J1 iiijjJ /; z 7
Lt;
=
E /n
_? i3ffl I k (
LAJft11) (3rs
ç2. O\\
E,M-jv\\
1.
Pre-Examination Iv! I I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of f7ii as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowlpdge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s)
From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
1.
- 2. çi \\Ntt 3.
]ies
- 4. Iei Qd(.ger
- 5. to7 6.
- 7. (p
- 8. L 9.
JThcJ 10.
11.
12.
13.
I JOB TITLE /.RESPONSIBILITY SIGNfFURE (1)
C
.sk, v
DATE SIGNATURE (2)
DATE NOTE i1jii7 7/z/t(
L 1..
7/zz/i, lfzq t hi
( Z/ Zi/t (
I. u J/Y4f(i 7/S/,
(
I, ic 1 7
/CIi /J 13vI1L 3
i/
I c/iI ES-201, Page 27 of 28 ES-201 Examination Security Agreement Form ES-201-3 PRINTED NAME
. 1!),
jthi
.)
C
ES-201 (j(J,r7f5 3 A1L &7&t 2o1(
Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 1 f%as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowldge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinans administered during the week(s) of 2
M I 4/i From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME
- 1. JLLdas &aCvi 2.Li.r
- j).\\.
?
3.
4.
J -tJha).-
5.
,%Sd 6.
7.
t((dvd (vc.L 8.
A 9.
SeM.I31rhkJ 1O.VJt1LA-, 3-:+4.J 11.
ct5@?
- 12. J 13.
14.
i,a.. 14, 15.Sc$1Sd\\ec<
NOTES:
JOB TITLE /RESPONSIBILITY c -° NJO/K j9f4.:-ii-eps isr/& i..
- 44-
,Fs 2-st cfc )Jsr SIGNATURE (1)
?-
DATE SIGNATURE (2)
_/y/ :j
_/rIi_
I.
_hjLi L..t._/Z_
t1.I-,/,,,r-)
z
- .\\!i
->22,2a2__.
if -a-r / /. / /.
/
_!E1 DATE NOTE OL/OSi2.o1.
//3//L
/7/IL It
/z--/,
/ - :- I -z js
/2 /?/i r3!7j9f ES-201, Page 27 of 28 z
- ci
ES-201 M TQf52 Examination Security Agreement 2b11 Form ES-201-3 1.
Pre-Examination acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination DATE PRINTED NAM__dOB TITLE / RESPONSlBl/
- 2. CLJ4 hlcey taWu 3.
4.
5.
6.
7.
8.
9.
10.
ES-201, Page 27 of 28 To the best of my knowIede, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ofI41 YiØ. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
SIGNATURE (2)
DATE NOTE 11.
12.
13.
14.
15.
NOTES:
c) 5fC Lj, (4
ES-201 Ai Examination Security Aqreement Form ES-2014 1.
Pre-Examination acknowledge that I have acquired speciaHzeci knowledge about the NRC licensing examinations scheduled for the week(s) of.A of the date of my signature.
agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner, understand that am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these lióensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in Oancelabon of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
To the best of my knowfede, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ofI&4 From the date that I entered into this security agreement until the cmpletion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensingexaminations, except as specifically noted below and authorized by the NRC.
PRlNTED NAME 8 TITLE 1 RESPONSIBILITY UR )
SIGN TURE
)
DATE NOTE
/%
A//
ES-201, Page 27 of 28
{ (I DATE t2t1q1I ?
9 10.
- 11.
12.
13.
14, 15.
NOTES:
ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar FINAL SUBMITTAL Date of Examination: December2011 Examination Level: RO SRO LI Operating Test Number:
2 Administrative Topic Tvne Describe activity to be performed (See Note)
Code A.1-1 Determine License Status.
2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as Conduct of Operations M R medical requirements, no-solo operation, maintenance of active license status, IOCFR55, etc. 3.3/3.8 41.10/43.2 A.1-2 RCS Deboration Calculation.
2.1.25 Ability to interpret reference materials such as Conduct of Operations M,R graphs, curves, tables, etc. 3.9/4.241.10/45.12 I 43.5 A.2 Perform a Manual Clearance.
Equipment Control N, R 2.1.13 Knowledge of tagging and clearance procedures.
4.2/4.3 41.10/45.13 A.3 Determine Potential Dose During Valve Alignment.
Radiation Control M,R 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions. 3.2/3.741.12 /
43.4 /45.10 Emergency Procedures!
N/A N/A Plan NOTE:
All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (< 3 for ROs; <4 for SROs & RO retakes)
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1; randomly selected)
ES 301, Page 22 of 27
ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar FINAL SUBMITTAL Date of Examination: December 2011 Examination Level: RO El SRO Operating Test Number:
2 Administrative Topic Tvne Describe activity to be performed (See Note)
Code A.1-1 Determine License Status 2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as Conduct of Operations M,R medical requirements, no-solo operation, maintenance of active license status, IOCFR55, etc. 3.3/3.8 41.10/43.2 A.1-2 RCS Deboration Calculation.
2.1.25 Ability to interpret reference materials such as Conduct of Operations M,R graphs, curves, tables, etc. 3.9 / 4.2 41.10 / 45.12 I 43.5 A.2 Perform a Manual Clearance.
Equipment Control N,R 2.1.13 Knowledge of tagging and clearance procedures.
4.2/4.3 41.10/45.13 A.3 Determine Potential Dose During Valve Alignment.
Radiation Control M,R 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions. 3.2/3. 741.12 /
43.4/45.10 A.4 Evaluate Changing Plant Conditions and Determine if REP Classification Upgrade is Emergency Procedures M R Required.
Plan
2.4.40 Knowledge of SRO responsibilities in emergency plan implementation. 2. 7/4.5 41.10 / 43.5 / 45.11 NOTE:
All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (< 3 for ROs; <4 for SROs & RO retakes)
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1; randomly selected)
ES 301, Page 22 of 27
ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar FINAL SUBMITTAL Date of Examination: December2011 Exam Level: RO SRO-l SRO-U EJ Operating Test Number: 2 Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)
System I JPM Title Type Code*
a.
Retrieve a Dropped Rod.
A, D 001 A2.03, 3514.2 CFR 41.5143.5I45.3I45.13 b.
Place Letdown in Service per AOl-6.
A, M 2
004 A4.06 3613.1 CFR 41.7! 45.5 to 45.8 c.
Align an RHR train for Hot Leg Recirculation.
A, D 3
006 A4.04 3.71 3.6 CFR 41.7145.5 to 45.8 d.
Start RCP 1.
A, M, L 4P 003 A1.02 2.9/2.9 CFR 41.5 I 45.5 e.
Align Control Rod Drive Mechanism Coolers.
C or S, D 5
022 A4.01 3.61 3.6 CFR f.
Reinstate Source Range following a Reactor Trip.
A, D 7
015 A4.01, 3.61 3.6 CFR 41.71 45.5 to 45.8 g.
Purge Lower Containment.
C or S, M 8
029 A2.03 2.713.1 CFR 41.5143.5145.3145.13 CFR h.
Place SBMFP in service (RO ONLY).
D, M 4S 059 A4.03 2.9 / 2.9 41.7 /45.5 to 45.8 In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U) i.
Bypass 1-FCV-62-89 Charging Flow for Local Control (Aux Bldg).
D, E, R 2
004 A4.08 3.8/3.4 CFR 41.7145.5 to 45.8 j.
Perform restoration actions after Checking for water in Cylinders per S0l-82.02 for Train B or D, EN 6
SOl-82.01 for Train A (DG Bldg).
064 A2.15 2.613.1 CFR 41.5143.5145.3145.13 k.
Swap Seal Injection Filters (Aux Bldg).
0, R 4P 003 A4.01 3313.2 41.7! 45.5 to 45.8 All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for RO / SRO-l / SRO-U (A)lternate path 4-6 I
4-6
/
2-3 (C)ontrol room (D)irect from bank
< 9
/
< 8 I
< 4 (E)mergency or abnormal in-plant
? 1 I
? 1 I ? I (EN)gineeredsafetyfeature I
/ 1 (L)ow-Power / Shutdown
> I
/
> 1
/
> 1 (N)ew or (M)odified from bank including 1 (A)
? 2
/
? 2 I ? 1 (P)revious 2 exams
< 3
< 3 /
< 2 (randomly selected)
(R)CA i
I i
/ >i (S)imulator
ES-301 Operating Test Quality Checklist Form ES-301-3 FJ4L Facility:
t/J L T Date of Examination:
\\
Operating Test Number:
Initials
- 1. General Criteria a
b*
a.
The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b.
There is no day-to-day repetition between this and other operating tests to be administered during this examination.
c.
The operating test shall not duplicate items from the applicants audit test(s). (see Section Di.a.)
d.
Overlap with the written examination and between different parts of the operating test is within acceptable limits.
i3
e.
It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
- 2. Walk-Through Criteria
a.
Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature
system response and other examiner cues
statements describing important observations to be made by the applicant
criteria for successful completion of the task
identification of critical steps and their associated performance standards
restrictions on the sequence of steps, if applicable b.
Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance j,
criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified J
on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
j
=
Printed Name I Sign ur Date a.
Author
/
b.
Facility Reviewer(*)
-:,k.Y)hU c.
NRCChiefExaminer(#)
///6///
d.
NRC Supervisor ZU-0
. i2Z&
II NOTE:
The facility signature is not applicable for NRC-developed tests.
Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301, Page 24 of 27
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 FINAL SUBMITTAL Facility: Watts Bar Date of Exam:12I19/11 Scenario Numbers: 112141516 Operating Test No.:2 QUALITATIVE ATTRIBUTES Initials
a b*
f 1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out c
of service, but it does not cue the operators into expected events.
2.
The scenarios consist mostly of related events.
3.
Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event k0
the symptoms/cues that will be visible to the crew P
the expected operator actions (by shift position) the event termination point (if applicable) 4.
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
K 5.
The events are valid with regard to physics and thermodynamics.
6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain f) complete evaluation results commensurate with the scenario objectives.
7.
If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given.
8.
The simulator modeling is not altered.
9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated O
to ensure that functional fidelity is maintained while running the planned scenarios.
10.
Every operator will be evaluated using at least one new or significantly modified scenario.
-()
s-,,
All other scenarios have been altered in accordance with Section D.5 of ES-301.
11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
JL.......
12.
Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
13.
The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)
Actual Attributes 1.
Total malfunctions (58) 817151817 2.
Malfunctions after EOP entry (12) 212/21212 3.
Abnormal events (24) 414/4/414 4.
Major transients (12) 1/1 Il/Ill
- s.
5.
EOPs entered/requiring substantive actions (12) 2/211/2/2 6.
EOP contingencies requiring substantive actions (02) 111I111I0 7.
Critical tasks (23) 2/2131312 U
ES-301 Transient and Event Checklist Form ES-301-5 L, /V IJ.
Facility: Watts Bar Date of Exam:
12119111 Operating Test No.: 2 A
E Scenarios P
V
E Scenario I T
M L
N FINAL I
T CREW CREW CREW CREW A
I A
T POSITION POSITION POSITION POSITION L
M N
Y S
A B
S A
B 5
A B
5 A
B U
T p
R T
0 R
T 0
R T
0 R
T o
Mr E
0 C
P 0
C P
0 C
P 0
C P
RO 0
1 1
SRO-I NOR i
i i
I/C 12,3,4 4
4 4
SRO-U MAJ TS 1,2 2
02 RO R)(
iii NOR IT SRO-I
I/C 2,3 2
4 4
SRO-U MAJ 6
2 22 TS oo2 RO RX 011 NOR 5
1 ii SRO-I
I/C 1,4,5 3
4 4
SRO-U MAJ 6
222 TS oo2 RO RX 110 NOR 111 SRO-I
I/C 442 SRO-U MAJ 2
2 1
TS 022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-i event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 -for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Transient and Event Checklist Form ES-301-5 ffr/J Facility: Watts Bar Date of Exam:
12119111 Operating Test No.: 2 A
E Scenarios P
V
E Scenario 2 T
M L
N FINAL I
T CREW CREW CREW CREW A
I A
T POSITION POSITION POSITION POSITION L
M N
Y S
A B
S A
B S
A B
S A
B U
T p
R T
0 R
T 0
R T
0 R
T 0
Mj)
E 0
C P
0 C
P 0
C P
0 C
p R
IU RO RX 0110 SROI NOR 1
111 I/C 234 3
442 SRO U MAJ 1
2 2
1 TS 24 2
022 RO RX 1
110 NOR 0111 SROI
I/C 24 2
442 SROU MAJ 1
221 TS 0
022 RO RX 0110 NOR 1
1 111 SROI
I/C 35 2
442 SROU MAJ 1
221 TS 0
022 RO RX 110 NOR 111 SRO-l
I/C 442 SRO-U MAJ 2
2 1
TS 022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Transient and Event Checklist Form ES-301-5
-,AW Facility: Watts Bar Date of Exam:
12119111 Operating Test No.: 2 A
E Scenarios P
V
E Scenario 4 T
M L
N FINAL I
T CREW CREW CREW CREW A
I A
T POSITION POSITION POSITION POSITION L
M N
Y S
A B
S A
B S
A B
5 A
B U
T p
R T
0 R
T 0
R T
0 R
T 0
E 0
C P
0 C
P 0
C P
0 C
P RIU RO RX 0
1 1
SRO-I NOR 1
11 I/C 1,2,4 3
4 4
SRO-U MAJ 6
1 22 TS 1,4 2
02 RO RX 3
111 NOR 0
ii SRO-l
I/C 1,2 2
4 4
SRO-U MAJ 6
1 22 TS 002 RO RX 011 NOR 3
111 SRO-I
I/C 4,5 2
4 4
SRO-U MAJ 6
1 22 TS 0
022 RO RX
110 NOR 111 SRO-l
I/C 442 SRO-U MAJ 2
2 1
TS 022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Transient and Event Checklist Form ES-301-5
/-,,VL Facility: Watts Bar Date of Exam:
12119111 Operating Test No.: 2 A
E Scenarios P
V
E Scenario5 T
M L
N FINAL I
T CREW CREW CREW CREW A
I A
T POSITION POSITION POSITION POSITION L
M N
Y S
A B
S A
B S
A B
S A
B U
T p
R T
0 R
T 0
R T
0 R
T 0
M E
0 C
P 0
C P
0 C
P 0
C P
R IU RO RX 0110 SRO-l NOR 1
1 1
1 I/C 23456 5
4 4
2 SRO U MAJ 1
2 2
1 TS 2,4 2
022 RO RX 1110 NOR 0111 SRO-l I/C 5,6 2
442 SRO-U MAJ 1
2 2
1 TS 0
022 RO RX 0110 NOR 1
1 lii SRO-l
I/C 3,4 2
442 SRO-U MAJ 7
1 221 TS 0
022 RO RX 110 NOR 111 SRO-l
I/C 442 SRO-U MAJ 2
2 1
TS 022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOPy positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a I -for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Transient and Event Checklist Form ES-301-5
-, tVA),
Facility: Watts Bar Date of Exam:
12/19111 Operating Test No.: 2 A
E Scenarios Scenario 6 T
M L
N FINAL I
T CREW CREW CREW CREW A
I A
T POSITION POSITION POSITION POSITION L
M N
Y S
A B
S A
B S
A B
S A
B U
T p
R T
0 R
T 0
R T
0 R
T 0
Mj)
E 0
C P
0 C
P 0
C P
0 C
P R
IU RO RX 0110 SROI NOR 1111 I/C 23456 5
4 4
2 SROU MAJ 1
221 TS 235 3
022 RO RX 3
1110 NOR 0111 SRO-I
I/C 4,6 2
4 4
2 SRO-U MAJ 1
2 2
1 TS 0
022 RO RX 0110 NOR 1
111 SROI I/C 35 2
442 SROU MAJ 7
TTi TS 0
022 RO RX 110 NOR 111 SRO-I
I/C 442 SRO-U MAJ 2
2 1
TS 022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Competencies Checklist Form ES-301-6 FINAL SUBMITTAL Facility: Watts Bar Date of Examination: 1211912011 Operating Test No.: 2 APPLICANTS RO X
RO X
RO RO SRO-l SRO-I SRO-I X
SRO-I X
SRO-U SROU SRO-U SRO-U Competencies CAlO_
SCENARIO 12456 1
2456 I
+
+irv 1,2,3, 1,2,3, 1,2,3, 2,3,4, 1,2,3, 12,3, 1,2, 1,2, 1,2, 1,2, nLerpreu1 iagnose 4,5 4,5 4,5,6 5,6,7 4,5,6, 4,5 3,4, 3,4, 3,4, 3,4, Events and Conditions 7
5 5
5,6 5,6, Comply With and ALL All All All All All All All All All Use Procedures (1)
Operate Control 1 1 Boards (2) 7 Communicate All All All All All All All All All All and Interact Demonstrate 1,5 3,4, : :
Supervisory Ability (3) 6,7 7
Comply With and 1,2 2,4 1,3, 2,4 2,3, Use Tech. Specs. (3)
Notes:
(1)
Includes Technical Specification compliance for an RD.
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant
ES-401, Rev. 9 PWR Examination Outline Form ES-401-2 Facility: t4,4T13 A/
Date of Exam:
oeri t1i RO K/A Category Points SRO-Only Points Tier Group
KKKKKKAAAAG A2 G* 1 Total 1
2 3
4 5
6 1
2 3
4 Total I
1.
i 333 33 3
18 3
3 6
Emergency &
2 I
2 2
1 9
2 2
4 Abnormal Plant
N/A N/A
Evolutions TierTotals 4
5 5
5 4
27 5
5 10 Pnt
++++++-
Systems Tier Totals 3
3 3
3 4
3 4
4 4
4 3
38 5
8
- 3. Generic Knowledge and Abilities 1
2 3
4 10 1
2 3
4 7
Categories 3
3 2
2 2
2 1
2 1.
Ensure that at least two topics from every applicable KIA category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each KIA category shall not be less than two).
2.
The point total for each group and tier in the proposed outline must match that specified in the table.
The final point total for each group and tier may deviate by +/- I from that specified in the table based on NRC revisions.
The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3.
Systemslevolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to section 0.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
4.
Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5.
Absent a plant-specific priority, only those KIAs having an importance rating (IR) of 2.5 or higher shall be selected.
Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6.
Select SRO topics for Tiers I and 2 from the shaded systems and K/A categories.
7.
- The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to section 0.1.b of ES-401 for the applicable KAs.
8.
On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note # I does not apply).
Use duplicate pages for RO and SRO-only exams.
9.
For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401 -3. Limit SRO selections to K/As that are linked to 10 CFR 55.43..
2cII T1G1 PWR EXAMINATION OUTLINE TOPIC:
3.4 3.8 Shutdown margin 4.2 4.2 Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.
3.7 4
El-Sequence of events for manually tripping reactor and RCP as a result of an RCP malfunction 2.6 2.9 The valve lineups necessary to restart the CCWS while bypassing the portion of the system causing the abnormal condition 2.9 3
El El El El El El El El Verification of alternate transmitter and/or plant computer prior to shifting flow chart transmitters 2.9 3.1 El El El El El El El El El El Breakers, relays, and disconnects.
4.2 4.4
]
C.
[J El Pressure at which to maintain RCS during S/G cooldown 4.14.4 1 El El El El El
[ [] [
Reactivity effects of cooldown 4.4 4.4 El El
[
Manual startup of electric and steam-driven AFW pumps 3.7 3.9
[] El El El El j El ] El In-core thermocouple temperatures 3.5 3.9 El El El El Order and time to initiation of power for the load I
ES-401, REV 9 KA NAME / SAFETY FUNCTION:
IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G RO SRO FORM ES-401-2 007 EK1.02 008AG2.4.47 015AK3.03 026AA2.03 027AK3.02 029EK2.06 038EA2.15 040AK1.05 054AA1.02 055EA1.01 Reactor Trip
- Stabilization
- Recovery
/1 Pressurizer Vapor Space Accident / 3 RCP Malfunctions /4 Loss of Component Cooling Water / 8 Pressurizer Pressure Control System Malfunction / 3 ATWS/1 Steam Gen. Tube Rupture / 3 Steam Line Rupture
- Excessive Heat Transfer / 4 Loss of Main Feedwater /4 Station Blackout / 6 056AK3.01 Loss of Off-site Power / 6 sequencer Page 1 of 2 9/13/2010 9:27 AM
ES-401, REV 9 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 058AG2.l.30 Loss of DC Power / 6 4.4 4.0 LI LI LI LI LI E] LI LI LI LI Ability to locate and operate components, including local controls.
062AA1.06 Loss of Nuclear Svc Water /4 2.9 2.9 LI LI LI LI LI LI } fl Control of flow rates to components cooled by the SWS 065AG2.2.44 Loss of Instrument Air / 8 4.2 4.4 LI LI LI fl LI LI LI LI LI LI ]
Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions 077AA2.l0 Generator Voltage and Electric Grid 3.6 3.8 LI LI LI LI LI LI LI LI LI LI Generator overheating and required actions Disturbances I 6 WEO4EK1.1 LOCA Outside Containment! 3 3.5 3.9 LI LI H LI LI LI H LI LI LI Components, capacity, and function of emergency systems.
WEO5EK2.2 Inadequate Heat Transfer
- Loss of 3.9 4.2 LI LI H LI LI LI LI H LI LI Facilitys heat removal systems, including primary Secondary Heat Sink! 4
coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.
WE11EK2.2 Loss of Emergency Coolant Recirc. /4 3.9 4.3 LI LI LI LI LI LI LI LI LI LI Facilitys heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.
Page 2 of 2 9/13/2010 9:27AM
ES-401, REV 9 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
AC SAC OO1AA1.07 Continuous Rod Withdrawal! 1 3.3 3.1 API 036AK3.03 Fuel Handling Accident! 8 3.7 4.1 D
Guidance contained in EOP for fuel handling incident 037AK1.01 Steam Generator Tube Leak / 3 2.9 3.3 Use of steam tables 051 AA2.02 Loss of Condenser Vacuum /4 3.9 4.1 LI Conditions requiring reactor and/or turbine flIp 068AA2.03 Control Room Evac. / 8 4
4.2 T-hot, T-cold and in-core temperatures 074EA1.06 lnad.CoreCooling!4 3.6 3.9 RCP5 WEO3EK2.2 LOCA Cooldown
- Depress. / 4 3.7 4.0 Facilitys heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.
WEO8EK3.3 RCS Overcooling
- PTS / 4 3.7 3.8 LI LI LI r. LI LI ri LI LI Manipulation of controls required to obtain desired operating results during abnormal and emergency situations.
wel5EG2.4.6 Containment Flooding /5 3.7 4.7 LI LI LI LI LI LI LI LI LI LI Knowledge symptom based EOP mitigation strategies.
Page 1 of 1 9/13/2010 9:27 AM
ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2
TOPIC:
Ability to execute procedure steps.
RCP seals and seal water supply Inadvertent boration/dilution Excessive letdown flow, pressure and temperatures on ion exchange resins (also causes)
Heatup/cooldown rates Expected temperature levels in various locations of the RCS due to various plant conditions Method of forming a steam bubble in the PZR Operation of the CCW pumps, including interlocks and the CCW booster pump Tail pipe temperature and acoustic monitors PRT RPS channels, components and interconnections KA NAME / SAFETY FUNCTION:
IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G RO SRO 003G2.l.20 Reactor Coolant Pump 4.6 4.6 ElElElElElElElElElEl 003K62 Reactor Coolant Pump 2.7 3.1 El El El El 004A2.06 Chemical and Volume Control 4.2 4.3
[]
El El El El 004A2.21 Chemical and Volume Control 2.7 2.7 El El El El El El El El El El 005A1.0l Redual Heat Removal 3.5 3.6 El ElEl El El El El El El El 006K5.07 Emergency Core Cooling 2.7 3.0 El El El El El El El El El El 007K5.02 Pressurizer Relief/Quench Tank 3.1 3.4 El El El El El El El El El El 008A3.02 Component Cooling Water 3.2 3.2 El El El El El El El El ] El El 01 OA1.09 Pressurizer Pressure Control 3.4 3.7 El El El El El El El El El El 010K6.04 Pressurizer Pressure Control 2.9 3.2 El El El El El El El El El El 012K2.01 Reactor Protection 3.3 3.7 ElElElElElElElElElEl Page 1 of 3 9/13/2010 9:27AM
3R 2011 FORM ES-401-2 TOPIC:
Reason for opening breaker on high-head injection pump Containment cooling after LOCA destroys ventilation ducts Ice condenser isolation valves Containment spray pump cooling Containment spray reset switches Effect of steam removal on reactivity Feedwater pump suction flow pressure Automatic AFW isolation AFW automatic start upon loss of MFW pump, SIG level, blackout or safety injection Types of loads that, if de-energized, would degrade or hinder plant operation AbHity to interpret reference materials such as graphs, monographs and tables which contain performance data.
T2G1 PWR EXAMINATION OUTLINE KA NAME / SAFETY FUNCTION:
IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G RO SRO ES-401, REV 9
013K4.l9 Engineered Safety Features Actuation 3.0 3.4 LI LI LI LI LI LI LI LI LI LI 022K4.05 Containment Cooling 2.6 2.7 LI LI LI 1 LI LI LI LI LI LI LI 025A4.Ol Ice Condenser 3.0 2.7 LI LI LI LI LI LI LI LI LI LI 026A1.06 Containment Spray 2.7 3.0 LI LI LI LI LI LI 1 LI LI LI LI 026A4.05 Containment Spray 3.5 3.5 fl LI LI LI LI LI LI LI LI LI 039K508 MainandReheatSteam 3.6 3.6 LI LI LI LI [] LI LI LI LI LILI 059A3.03 Main Feedwater 2.5 2.6 LI LI LI LI LI LI LI LI LI LI 061 A3.04 Auxiliary/Emergency Feedwater 4.1 4.2 LI LI LI LI LI LI LI LI LI LI 061 K4.02 Auxiliary/Emergency Feedwater 4.5 4.6 LI LI LI LI LI LI LI LI LI LI 062A2.Ol AC Electrical Distribution 3.4 3.9 LI LI LI LI LI LI LI [1 LI LI LI 063G2.l.25 DC Electrical Distribution 3.9 4.2 LILILILILILILILILILI Page 2of 3 9/13/2010 9:27AM
7bk3L/ C>,I ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 063K3.02 DC Electrical Distribution 3.5 3.7
[J Components using DC control power 064K3.Ol Emergency Diesel Generator 3.8 4.1 Systems controlled by automatic loader 073K1.01 Process Radiation Monitoring 3.6 3.9 Those systems served by PRMs 076A4.01 Service Water 2.9 2.9 El ]
SWS pumps 078K2.02 Instrument Air El El El El El El El El El El Emergency air compressor 103K1.03 Containment 3.1 3.5 El El El El El El El El El El Shieldbuildingventsystem Page3of3 9/13/2010 9:27AM
T2G2 PWR EXAMINATION OUTLINE oc3i FORM ES-401-2 ES-401, REV 9 KA NAME / SAFETY FUNCTION:
IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 001 K2.01 Control Rod Drive 3.5 3.6 El El El El El El El El El El One-line diagram of power supply to MIG sets.
01 5A1.08 Nuclear Instrumentation 3.3 3.4 El El El El El El El E] El El Changes in RCS temperature 016A3.02 Non-nuclear Instrumentation 2.9 2.9 El fl fl Relationship between meter readings and actual parameter value 028K5.04 Hydrogen Recombiner and Purge 2.6 3.2 fl The selective removal of hydrogen Control
034K6.02 Fuel Handling Equipment 2.6 3.3 El El El H: fl El El El El El Radiation monitoring systems 041 A2.02 Steam Dump/Turbine Bypass Control 3.6 3.9 ElEl El El El El El El El El Steam valve stuck open 071 K3.05 Waste Gas Disposal 3.2 3.2
- El El El El El El El El El El ARM and PRM systems
072A4.0i Area Radiation Monitoring 3.0 3.3 El El El El El El El El El El Alarm and interlock setpoint checks and adjustments -
075G2.1.31 Circulating Water 4.64.3 El El El El El El El El El El Ability to locate control room switches, controls and indications and to determine that they are correctly reflecting the desired plant lineup.
086K1.02 Fire Protection 2.7 3.2 El El El El El El El El El El Raw service water Page 1 of 1 9/13/2010 9:27AM
T3 PWR EXAMINATION OUTLINE FORM ES-401-2 TOPIC:
3.1 3.1 Knowledge of criteria or conditions that require plant-wide announcements, such as pump starts, reactor trip, mode changes, etc.
3.93.8 fl E El El Ability to use plant computer to evaluate system or
component status.
2.8 3.9 El El El El fj Knowledge of refueling administrative requirements 2.6 3.8 Knowledge of the process for managing maintenance activities during power operations.
2.6 3.8 Knowledge of the process for managing maintenance
activities during shutdown operations.
3.4 4.7 fl
[] El El El El El El El AbHity to apply technical specifications for a system.
3.4 3.8 El El El El El El El El El El Knowledge of radiological safety procedures pertaining to licensed operator duties 3.2 3.7 El El El El El [] El fl El El Knowledge of radiation exposure limits under normal and emergency conditions 4.0 4.2 j El Knowledge of abnormal condition procedures.
4.2 4.1
[
Knowledge of annunciators alarms, indications or response procedures ES-401, REV 9 KA NAME I SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G RO SRO c:7zjii 21/(
G2.1.14 G2.1.19 G2.l.40 G2.2.1 7 G2.2.1 8 G2.2.40 G2.3.13 G2.3.4 G2.4.1 1 G2.431 Conduct of operations Conduct of operations Conduct of operations Equipment Control Equipment Control Equipment Control Radiation Control Radiation Control Emergency Procedures/Plans Emergency Procedures/Plans Page 1 of 1 9/13/2010 9:27AM
cTL/-/ 2Ci 1
ES-401, REV 9 SRO T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 011 EG2.4.41 Large Break LOCA /3 2.9 4.6 LI El Knowledge of the emergency action level thresholds and classifications.
025AG2.4.21 Loss of RHR System / 4 4.0 4.6 El Knowledge of the parameters and logic used to assess the status of safety functions 026AA2.06 Loss of Component Cooling Water / 8 2.8 3.1 fl The length of time after the loss of CCW flow to a component before that component may be damaged 038EG2.4.18 Steam Gen. Tube Rupture / 3 3.3 4.0 El El El El LI El fl El El Li []
Knowledge of the specific bases for EOPs.
056AA2.74 Loss of Oft-site Power / 6 3.6 3.7 El El El El El El El [] El El El PORV position WEO4EA2.l LOCA Outside Containment / 3 3.4 4.3 El El El LI LI El El LI LI LI Facility conditions and selection of appropriate procedures during abnormal and emergency operations.
Page 1 of 1 9/13/2010 9:27AM
TZ5iZ t it Knowledge of how abnormal operating procedures are used in conjunction with EOPs.
ES-401, REV 9 Sf0 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 003AA2.02 Dropped Control Rod / 1 2.7 2.8 H H
[
Signal inputs to rod control system 028AA2.14 Pressurizer Level Malfunction! 2 26 2.8 Fl The effect on indicated PZR levels, given a change in ambient pressure and temperature of reflux boiling 068AG2.l.7 Control Room Evac.18 4.4 4.7 H H El H El El El H H H Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior and instrument interpretation.
welOEG2.4.8 Natural Circ. With Seam Void! 4 3.8 4.5 HHHEHHHHHH Page 1 of 1 9/13/2010 9:27AM
I /
Ability to determine operability and/or availability of safety related equipment ES-401, REV 9 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
P0 SRO 00302.2.25 Reactor Coolant Pump 3.2 4.2 Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.
006A2.12 Emergency Core Cooling 4.5 4.8 J fl Conditions requiring actuation of ECCS 010A2.0l Pressurizer Pressure Control 3.3 3.6 fl.
Heater failures 02502.1.28 Ice Condenser 4.1 4.1 Knowledge of the purpose and function of major system components and controls.
026G2.2.37 Contnment Spray 36 4.6 Page 1 of 1 9/13/2010 9:27AM
ES-401, REV 9 KA NAME / SAFETY FUNCTION:
034G2.4.30 Fuel Handling Equipment 072A2.02 Area Radiation Monitoring 086G2.2.22 Fire Protection SRO T2G2 PWR EXAMINATION OUTLINE IR K1K2K3K4K5K6A1A2A3A4G RO SRO 2.7 4.1 2.8 2.9 4.0 4.7 C7Z// 2/
FORM ES-401-2 TOPIC:
Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.
Detector failure Knowledge of limiting conditions for operations and safety limits.
Page 1 of 1 9/13/2010 9:27AM
C7ZLL 2j)//
ES-401, REV 9 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME/SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO G2.l.18 Conduct of operations 3.6 3.8 Ability to make accurate, clear and concise logs, records, status boards and reports.
G2.l.29 Conduct of operations 4.1 4.0 j
Knowledge of how to conduct system lineups, such as valves, breakers, switches, etc.
G2.2.l Equipment Control 4.5 4.4 fl Ability to perform pre-startup procedures forthe facility, including operating those controls associated with plant equipment that could affect reactivity.
G2.2.7 Equipment Control 2.9 3.6 Knowledge of the process for conducting special or infrequent tests G2.3.l1 Radiation Control 3.8 4.3 El El El El El El El El [J AbWtyto control radiation releases G2.4.27 Emergency Procedures/Plans 3.4 3.9 El El El El El El El El El El Knowledge of fire in the plant procedures.
G2.4.42 Emergency Procedures/Plans 2.6 3.8 El El El El El El El El El El Knowledge of emergency response facilities.
Page 1 of 1 9/13/2010 9:27 AM
Written Examination Sample Plan Guidance 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward K/A Only Gen Do not develop test items that can be answered solely using generic fundamentals knowledge. For example, if the K/A statement is associated with a system controller, dont write a question to solely test the applicants knowledge of how a proportional, integral, or derivative controller operates. Instead, write the question to test the plant specific lights, indications, and/or power supplies to the controller.
This is the plant-specific portion of the NRC written exam. The applicants have already been tested on the generic fundamentals. Test items that can be answered solely using generic fundamentals knowledge will not be used on the plant specific written exam.
Page 1 of 6
1 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LCD
(F/H)
(1-5)
Stem Cues 1/F Cred.
Partial Job-Minutia
- 1 Back-0=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward K/A Only Gen For SRO-only Questions: [ES-401 Section D.1 ci 1.
There are seven 1 OCFR55.43 topics to choose from for each of the 25 questions. Most often, the 55.43 b(2) [Tech Specs] OR 55.43 b(5) [Procedure Selection] topics are chosen for SRO test items.
Each SRO question must target one of the seven 1 OCFR55.43 topics.
IF 1 OCFR55.43b(5)
[Procedure Selection] is the targeted topic for an SRO K/A statement, THEN ensure that the SRO level knowledge (with respect to prescribing or selecting procedures) is knowledge of the content of the procedure (SRO knowledge) versus knowledge of the overall mitigative strategy of the procedure (RO knowledge).
It sometimes helps to limit each choice to a procedure title/number without the procedure action listed because this minimizes the possibility of deducing the correct answer using RO procedure and/or systems knowledge.
In your exam submittal, include a short sentence for each SRO question that identifies which one of the seven topics the proposed question targets.
2.
For SRO K/A statements, the question must be developed such that the SRO knowledge being tested is contained in the wording of the K/A statement.
3.
Refer to the Clarification Guidance for SRO-only Questions. Ensure the correct answer cannot be solely deduced using RO procedure (overall
mitigative strategy) and/or systems knowledge.
Page 2 of 6
2.
3, Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD
(F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-0=
SRO BJM/N U/E/S Explanation Focus Dist.
Link units ward K/A 10n1y Gen Make an attempt to write a question to the K/A topic.
However, if a K/A is not applicable to your plant, or if the K/A overlaps another K/A to the extent that two different questions cant be developed, then discuss the K/A w/ the Chief Examiner before wasting a lot of time/energy. Refer to ES-401, Section D.2.a (page 6 of 33) for an allowance on writing a test item that targets a difficult A2 K/A statement.
The Sample Plan provided has been reviewed, but you may identify K/A problems also. The Chief Examiner will select all replacement K/As.
Gen Limit the amount of references provided to the candidates to the maximum extent possible by developing the question assuming that the applicant wont have a reference.
IF the question requires knowledge of Tech Spec action statements beyond 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, then we (NRC) usually provide a reference because this limits the number of appeals after the exam is administered. The best strategy is to write the question to a level that a reference is not needed.
If its necessary to provide a reference, then place a bracketed statement [REFERENCE PROVIDED]
between the stem and the first possible answer choice.
The reference must not make the question a direct lookup. These items will be evaluated on a case-by case basis by the Chief Examiner.
Page 3 of 6
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward K/A Only Gen If an annunciator(s) is referred to in any part of the question, use the EXACT wording engraved on Alarm Window (also specified in ARP) followed by parentheses containing the shortest possible abbreviated window location designation that the applicants are familiar with. This ensures no misunderstanding as to the alarm being referenced.
Gen Each question should be constructed in such a way to elicit all parts of the choices provided.
If the question includes a fill-in-the-blank statement, utilize the following question that precedes the fill-in-the-blank statements: Which one of the following completes the following statement(s)?
Each test item must contain a stem question that elicits the choices provided.
Gen In a two-part question format with more than one element contained in each choice, limit the number of elements to two (for each choice).
Gen Whenever applicable, ensure the phrase in accordance with Is pasted after the stem question.
This ensures that there is only one correct answer.
In all procedure related questions, ensure that the stem question includes in accordance with...[procedure name]
Page 4 of 6
1 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cuesi T/F Cred.
Partial Job-Minutia
- 1 Back-Q SRO B/M/N U/E/S ExplanatiOn Focus Dist.
Link units ward K/A Only Gen Distractor plausibility should be explained (for each incorrect choice) in your exam submittal.
Implausible distractors are discussed in NUREG 1021, Appendix B, Attachment 2, Section D.
If its difficult to develop 3 separate plausible distractors for the question, then the easiest way to remedy is to convert the question choices into a 2-part format, i.e., test the applicants knowledge of two distinct pieces of RELEVANT information related to the K/A. For example:
a.
4 psig; The injection rate will remain the same b.
4 psig; The injection rate will lower c.
2 psig; The injection rate will remain the same d.
2 psig; The injection rate will lower Avoid using the word should in any test questions because this can often be argued as correct by an applicant.
Page 5 of 6
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 6 of 6
Watts Bar October 2011 RO Exam NRC Exam 2 ES-401 Record of Rejected K/As Form ES-401-4 Tier I Randomly Reason for Rejection Grouo Selected K/A None
Watts Bar October 2011 SRO ES-401 Record of Rejected KIAs Exam NRC Exam 2 Form ES-401-4 Tier I Randomly Reason for Rejection Group Selected KIA 1/2 028 AA2.14 Appears to be an error in the wording of the KA relating to the inclusion of of reflux boiling in the KA statement.
K/A replaced by the Chief Examiner on 07/11/11 with KIA#028AA2.07
ES-401 Written Examination Form ES-401-9 Review Worksheet Watts Bar 2011-302 1
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q SRO UIEIS Explanation Focus Dist.
units ward K/A Only Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1
- 5 (easy - difficult) rating scale (questions in the 2
- 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues TIF Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/EIS Explanation Focus Dist.
units ward K/A Only Generic:
NP = Not Plausible NPD: Non Plausible Distractor DLU = Direct Lookup WOOTF = Which One of the Following CAF = Check at Facility NDV= No discriminatory Value FIB = Fill in the Blank NRT = With Respect To Generic 1: All Questions formatted like Q 76 are difficult to read and must me reformatted as suggested on the Q 76 explanation.
LL QUESTIONS WERE APPROVED FOR THE EXAM DURING FINAL REVIEW
997EK1.02 1
C 3
X Y
N IJ E It is common knowledge that the reactor is protected with one CR stuck out..However, ES-0.1, Step 6, states if two or more rods are NOT fully inserted then borate Allow one (1) CR to almost fully insert but hang it up 10 inches from the bottom. The boration criterion is met and B would be the correct answer. The Q becomes more discriminatory and the KA is still satisfied.
Currently, distractors C and D are NP. Therefore the Q is U.
Stem: Make this Q a FIB.
08/31/11 RFA Question changed to a FIB format per Generic 1.
Original distractor D determined to be plausible, question upgraded from U to E.
09/22/11 RFA Approved 008AG2.4.47 2
C 3
X Y
N2 E
Reformat the stem per Generic I Is this TS required knowledge for an RO?
If not, replace the Q.
08/31/11 RFA Per Operations, this T/S knowledge is required for ROs.
Question changed to a FIB format per Generic 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
units ward K/A Only
=
Added words to the second bullet to clarify leak size.
Remains E.
09/22/1 1 RFA Approved
015AK3.03 C
3 X
Y N2 U S If there is a TS limitation on 3 loop operation then B is also a correct answer.
s Q is U because of two correct answers and ecause of a psychometric subset issue between listractors A and B.
this TS required knowledge for an RO?
.. not, replace the Q.
08/31/11 RFA uestion determined to be satisfactory because 3 loop eration is allowed for up to 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />, which makes
)r B incorrect.
)perations, this T/S knowledge is required for ROs.
/11 RFA Approved
2.03 C
3 X
Y N
E Reformat the stem per Generic I 08/31/11 RFA Question changed to a FIB format per Generic 1 09/22/11 RFA Approved.
027AK3.02 M
2 X
X Y
N U E Subset issue: If C was Correct, A and B would be also.
This Q is U because of two NPD due to psychometric subset issues.
08/31/11 RFA Question changed to a FIB format per Generic 1 (105).
Modified distractor B for clarity. Determined that A and B were not a subset of C. Distractor B modified for clarity.
09/22/1 1 RFA Approved
029EK2.06 6
C X
X Y
N U
Reformat the stem per Generic I J
It is common knowledge that shunt coils energize to trip.
Therefore distractors C and D are NP.
Also Part two has NDV.
It is common knowledge that either the RT OR Bypass breaker needs to be opened.
08/31/11 RFA Accepted replacement question.
10/04/11 RFA Approved 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD
i (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
I SRO UIEIS Explanation Focus Dist.
units ward K/A Only
- 038EA2.15 C
3 X
Y N
S No comments 08/31/11 RFA
O4OAKI.05 8
C 3
X X
Y N
E Reformat the stem per Generic I 9/01/11 RFA Question changed to a FIB format per Generic 1.
Changed distractors B and D to 4° 09/22/11 RFA Approved 054AA1.02 M
2 X
Y N
E Reformat the stem per Generic I 9/01/11 RFA Question changed to a FIB format per Generic 1.
Distractors A and C changed to more plausible distractors (turbine trip instead of failure of turbine to trip).
09/22/1 1 RFA Approved
-T-;----
uestion changed to a FIB format per Generic 1.
z:;:i stem to make D correct.
09/22/11 RFA Approved
056AK3.01 M
2 Y
N S
No comment 9/03/11 RFA 055EA1.ol Reformat the stem per Generic I Plasma displays have been around as safety related ismically qualified for years. Therefore C and D
,.?. Increase the time where ICS batteries would dead. Change Cl and Dl to Plasma displays and change the Correct answer to D.
This Q is U because of two NPD.
/01/11 RFA I
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD
r r
r (C/A)
(1-5)
Stem Cues T/F Cred. I Partial Job-Link Minutia
- 1 Back-0=
SRO U/E/S Explanation Focus Dist.
units ward K)A Only
=
=
058G2.1.30 12 M
2 X
X Y
N U E Reformat the stem per Generic I If there is no power on the 125 volt battery board 3 then there is no equipment on it to trip. Therefore to prevent inadvertent equipment tripping is NP This Q is U because Al and BI are NP.
9/03/Il RFA Question changed to a FIB format per Generic 1.
Modified from U to E. Determined distractors are plausible.
09/22/11 RFA Approved
062AA1.06 13 C
3 X
X Y
N U E Reformat the stem per Generic I Remove the second bullet.
It is superficial information (window dressing) that is not needed.
Remove if needed from (1).
The distractor analysis did not explain why Remain Constant is plausible. Why would anything in any system remain constant if a throttle valve was manipulated?
Either change the parameters of part B or replace remain constant in C and D.
This Q is U because of 2 NPD.
9/03/il RFA Question changed to a FIB format per Generic 1.
Second bullet retained. Added explanation to the distractor analysis. Question modified from U to E.
09/22/11 RFA Approved
065G2.2.44 14 C
4 X
X 14Y N
U E Reformat the stem per Generic I What does stopping RCPs and its effect on pressurizer level got to do with instrument air? The distractor analysis did not explain nor did the reference.
Furthermore, how does the stopping of the RCPs restore control of pressurizer spray?
This Q is U because it does not meet the KA on the second part and is also U because B2 and D2 have no DV.
9/03/il RFA
WIlzU4hKl.1 U
B is NP because they are told that the leak is outside
- Containment. Therefore containment spray pumps are iot needed. This is common sense.
) is NP because the plant was at 100% power and wessure is way beyond the shutoff head for RHR. This s also common sense.
Fhis Q is U because of two NPD.
J/03/11 RFA J replacement question. Pressure lowered to J psig and validation requested.
10/04/11 RFA Approved W/EutK2.2 No comment 9/03/11 RFA W/E1 I EK2.2 part of B and D are NP because of its ing. Change the second part of all choices for the ant to determine whether I pump can be stopped
- t. That way they have to know the pump capacity.
sQ is U because of 2 NPD 9/03/11 RFA Stem modified and distractors modified to improve plausibility.
1.
2.
- 3. Psychometric Flaws
- 4. Job content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
i
(C/A)
(1-5)
Stem cues T/F Cred.
Partial Job-Linki Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
units ward K/A Only
Question changed to a FIB format per Generic 1.
Question determined to meet K/A and B2 and D2 determined to be credible. Re-Wrote distractor analysis.
09/22/11 RFA Approved
077AA2.10 15 C
3 X
X Y
N E
Reformat the stem per Generic I Change Al and Bi to: Under the current conditions, the timer has tripped Change Cl andDl to: Under the current conditions, the timer has NOT tripped 9/03/11 RFA Question changed to a FIB format per Generic 1. Also added the requested phrase.
09/22/11 RFA Approved 16 C
3 x
Y N
-4 T
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
(C/A)
(1-5)
Stem Cues TIF Cred.
Partial Job-Link Minutia
- 1 Back-Q=
I SRO U/E/S Explanation Focus Dist.
units ward K/A Only
09/22/1 1 RFA Approved
OO1AA1.07 19 C
3 X
X X
Y N
U E B is NP because of the Tave/Tref erro Put bullet 5 subpart 1 a little Closer to the limit (1.4 F)
C is NP plausible because no information has been provided for the apphcant to determine if rod speed had decayed. Provide info for them to determine that.
D is NP for same reason as B.
This Q is U because of NPDs.
9/03/11 RFA Tave/Tref mismatch increased as requested. Distractor C and D determined to be plausible. Only B determined implausible, so question modified from U to E.
09/22/1 1 RFA Approved
036AK3.03 20 M
2 X
Y N
U A and C are NP because the fuel is NOT irradiated.
Replace A and C.
This Q is U because of two NP distractors.
9/03/11 RFA Re-wrote question to make it a 2-Part, FIB question.
09/22/11 RFA Approved
037AK1.01 21 C
3 Y
N S
No comment 9/03/11 RFA
051AA2.02 22 C
3 X
Y N
E Reformat the stem per Generic I (1 )and (2) are very confusing. Write as follows in the Generic I format as follows:
Which one of the following completes the statements below?
(1) The Turbine Low Vacuum trip_1_ failed.
(2) Zone 2
is currently at a condenser pressure that requires a reactor trip.
A. (1)has
Wnuiis2.2 and B are NP. What would be the point of having 2 I SI pump running if subcooling didnt change some.
-gest incorporating an RCS pressure factor and
...thisatwopartQ.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#l LOK LOD
(C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only
(2)B B.
(1)hasNOT (2) B C. (1)has (2) C D. (1)hasNOT (2) C 9/03/11 RFA Question changed to a FIB format per Generic 1, using suggested wording.
09/22/11 RFA Approved
068AA2.03 23 C
2 X
Y N
E Change the WOOTF statement as follows:
WOOTF completes the statements below with respect to Aux Control room indications?
9/03/11 RFA WOOTF statement re-written as requested.
09/22/11 RFA Approved
074EA1.06 24 C
3 X
X Y
N E
Distractor A is NP for this condition. Suggest changing
- 4 SG level to 52% in the stem and Change distractor A to read RCP#4 ONLY.
9/03/11 RFA Changes made as requested.
09/22/11 RFA 25 M
2 X
Y N
Ui This Q is U because A and B distractors are NP.
1/04/11 RFA ccepted new question 0/03/11 RFA 08EK3.3
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD i
(CIA)
(1-5)
Stem Cues TIE Cred.
Partial Job-Linki Minutia
- 1 Back-Q=
SRO UIEIS Explanation Focus
- Dist.
units ward K/A Only Zb U
A Y
N tnat tne opposite Ot tne actual reason IS not ar accepta e reason to justify a distractor. It is NP to believe that FR-P.1 would be more restrictive at reducing RCS pressure when an eminent PTS condition exists.
This Q is a U because distractors B and D are NP.
9/04/11 RFA 1
Accepted new question 10/03/11 RFA Approved
...E15EG2.4.6 27 C
3 X
X Y
N Reformat the stem per Generic I For non-borated water to be a concern, during a LOCA, There has to be a secondary reactivity issue.
I suggest sticking a couple of rods out in the stem to give SDM some credibility. Right now A2 and B2 have no DV compared to C2 and D2.
This Q is U because of two Q having NDV.
9/04/11 RFA Question changed to a FIB format per Generic 1.
Distractors slightly modified. Question upgraded from U to E.
10/03/11 RFA Approved OO#G2.1.20 No comment 9/04/11 RFA 003K6. 02 Reformat the stem per Generic I Stem: the stem need simplified as follows:
An RCP seal leak off temperature is slowly rising.
WOOTF completes the statements below?
(1) The #2 seal will transition to a _1........ mode of operation as the #1 seal fails.
UE C
3 X
Y N
E (2) RCP criteria _2 met.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD r-(C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only
=
A. 1. Film riding
- 2. is 9/04/11 RFA Question changed to a FIB format per Generic 1.
Stem slightly modified.
10/03/11 RFA Approved
004A2.06 30 c
3 X
Y N
E Reformat the stem per Generic I (2) Corrective action lAW what procedure?
9/04/11 RFA Question changed to a FIB format per Generic 1.
10/03/11 RFA Approved
004A2.21 31 M
2 X
X Y
N U E Reformat the stem per Generic I The second part of the question gives the first part away. Replace one or the other.
This 0 is U because there are two NPD.
9/07/11 RFA Question changed to a FIB format per Generic 1. Stem slightly modified (full changed to 120 gpm). Question upgraded from U to E.
10/03/11 RFA Approved
005A1.01 32 M
2 X
Y N
E Stem: The WOOTF statement makes no sense without the verbs and other words.
I am surprised that validation didnt pick this up.
Restate as follows: WOOTF identifies how the RCS temperature and the RHR flow rate will trend on the 1-M-6?
9/07/11 RFA Changes made as requested. Additionally changed per Generic 1.
10/03/11 RFA Approved 006K5.07 C
3
X Y
N E
B is NP because Pzr level is at 68%. Change to....
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD i
(CIA)
(1-5)
Stem I Cues TIE Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO UIEIS Explanation Focus Dist.
units ward KIA Only
result in an undesirable positive reactivity addition. This shouldnt happen because of the mixing due to NC.
9/07/11 RFA Chan9es made as requested. A and B distractors modified.
10/03/11 RFA Approved.
007K5.02 M
2 Y
N S
This Q is formatted properly lAW Generic I 9/07/11 RFA
008A3.02 C
3 X
Y N
E D is NP under these conditions.
Suggestion: Since this is a higher order Q, make this a two part Q, use A and B as the first parts. Replace C and D.
9/07/11 RFA Changes made as requested, question changed.
10/03/11 RFA Approved.
O1OAI.09 36 M
2 X
Y N
E Reformat the stem per Generic I 9/07/11 RFA Question changed to a FIB format per Generic 1.
10/03/11 RFA Approved
010K6.04 M
2 X
Y N
U 2 PSIG is NP in A and B. Change each to 6.5 PSIG per ie reference on page 7 of 50. Para 8.2.
. z Q is U because of 2 NPD.
9/07/11 RFA 38 M
2 Y
NS 1
13K4.19 C
3
- .comment 10/03, i changed to a FIB format per Generic 1. Use 3 inAand B.
11 RFA Approved L01 mment
,1 RFA
7/11 RFA 1
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
(C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q I SRO U/E/S Explanation Focus Dist.
units ward K/A Only 40 M
2 X
Y N
U E With a design basis LOCA, it is common knowledge ice condensers will be involved immediately.
Distractors B and D are NP because ice condensers arc only mentioned in A and C. Suggest wording the stem to state besides ice condensers... and leave them out of the equation.
This Q is U because of two NPD.
9/07/11 RFA Changed stem and distractors. Ice condensers listed with other distractors as not necessarily a correct answer. Question upgraded from U to E.
10/03/11 RFA Approved
025A4.01 41 c
3 Y
N S
Please reconfirm that an ABI will NOT close 1-FCV 110. This would yield two correct answers.
s Q is E until resolved.
If it will not close 1-FCV -
10, then the Q is Sat.
i/07/11 RFA 42 M
2 X
Y N
E D is NP. Why would a room cooler not start on a high room temperature? Nothing in the reference indicates any other room coolers operate any differently.
Replace this distractor.
9/07/11 RFA Modified stem and choices for clarity.
10/03/11 RFA Approved
026A4.05 43 M
2 Y
N S
Nocomment 9/07/11 RFA J39K5.08 L4 C
3 X
Y N
U Distractors A and B are NP. Since this is a higher order Q,
I suggest making this a two part Q involving C and D ABI will NOT close 1-FCV-61-110. No changes made.
10/03/1 1 RFA Approved 1.06
S
.idumpAand 13.
This Q is U because of two NPD.
9107/11 RFA Changed as identified. Question reformatted per 3eneric 1 0/04/11 RFA Approved
)A3.03 3 comment D7111 RFA U
1A3.04 Only I -LCV-3-1 56A bypass closing and not the 1 -LCV 3-156 is NP. The distractor analysis did not justify plausibility.
- her 1-LCV-3-156 nor 1-LCV-3-1 56A with the SG ress as low as it is, is NP.
urthermore, distractor D states 1-LCV-3-156 TWICE.
u forgot the A in one of them. This is indicative of Ity validation. As many people who validated this, error should have been picked up.
he Q is U because of two NPDs.
uggestion: Since this is a higher order Q, make it a wo part Q.
/08/11 RFA
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/EIS Explanation Focus Dist.
units ward K/A Only C
3 Y
N S
46 C
3 X
Y N
U 48 C
C 3
Y N
3 x
ianged to a two-part question.
RFA 4.02 i comment 1/11 RFA Y
N E
J2A2.O1 Stem: Reformat the stem per Generic I (2) State the procedure where the action is applicable.
The distractor analysis is right on the mark. This distractor analysis explains why each distractor is plausible. This is the way they ALL should be written.
GOOD JOB on this one.
9/08/11 RFA Question changed to a FIB format per Generic 1.
063G2.1.25
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD r
(C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only 49 3
V W
Good Q, No Comment 9/08/11 RFA
063K3.02 50 C
3 Y
N S
No comment
_ 9/08/11 RFA
064K3.01 51 C
3 X
Y N
U E Wfthout power, B and D are NP.
It is common knowledge that the sequencer is NOT going to function properly if there is no power on the board.
This Q is U because of two NPDs.
9/08/11 RFA Stated cases of breakers that will stay connected to a de-energized board. Question upgraded to E from U.
New question used with more plausible distractors.
New question modified from AFW to RHR.
10/03/11 RFA Approved
073K1.01 52 M
2 X
Y N
U It is common knowledge that MCR are kept at a positive I pressure to keep it habitable in case of rad I contamination. Therefore a negative pressure, as
. stated in distractors B and D, are NP. The plausibility statement that relates a negative pressure WRT the Aux Building is not relative to the MCR.
s question is U because of two NPDs.
8/11 RFA 53 C
3 X
Y N
E Stem: Reformat the stem per Generic I 9/08/11 RFA Question changed to a FIB format per Generic 1.
Clarified stem terminology.
10/03/11 RFA Approved
078K2.02 C
3 X
Y N
U-? E Stem: Reformat the stem per Generic I Are there any air compressors that start automatically?
If not A(1) and B(1) are NP and need to be replace.
This Q is U until resolved.
Aeplaced question.
10/03/1 1 RFA Approved rA,1
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK L0D (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
units ward K/A Only
=
9/08/11 RFA Question changed to a FIB format per Generic 1.
Verified A(1) and B(1) are plausible because Aux Air Compressors start automatically. Question updated from U to E.
10/03/11 RFA Approved
103K1.03 M
2 Y
N S
Nocomment 9/08/11 RFA
001K2.01 M
2 Y
N S
Nocomment 9/08/11 RFA
015A1.08 M
2 Y
N S
No comment 9/08/11 RFA
016A3.02 58 C
3 X
Y N
E Stem: Reformat the stem per Generic I 9/09/11 RFA Question changed to a FIB format per Generic 1.
10/03/11 RFA Approved
028K5.04 C
3 X
Y N
E S I could not find in the procedure an H2 value where the H2 igniters would NOT be placed in service. Therefore D (neither) is NP 1
Replace this distractor
/09/11 RFA
60 C
3 X
X Y
N U E Stem: Reformat the stem per Generic I It is NP for an isolation to occur with just one train being mop. Nuclear power is all about redundancy. You have
not shown in the distractor analysis anything to prove changes made. Distractor shown to be plausible
,cause there were cases where neither would be I in service for certain circumstances. Upgrade rrom E to S.
110/03/11 RFA Approved 5.02
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD
(C/A)
(1-5)
Stem Cues TIE Cred.
Partial Job-Link Minutia I
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward KIA Only otherwise.
Therefore, A2 and C2 are NPDs This Q is U because of tow NPDs 9/09/11 RFA Question changed to a FIB format per Generic 1.
Upgraded from U to E based on explanation of no separation relays which make this isolation unique.
10/03/11 RFA Approved.
041A2.02 61 C
3 X
X Y
N U E Stem: Reformat the stem per Generic I The re-opening of the steam dump cooldown valves is one thing but staying open without a malfunction after initiating a manual closure is NP especially with Tavg as lowas it is.
Distractors Cl and Dl are NP This Q is U because two distractors are NP.
9/09/11 RFA Question changed to a FIB format per Generic 1.
Explained relationship of cooldown valves and P-12 interlock, lending plausibility to Cl and Dl. Question upgraded from U to E.
10/03/11 RFA Approved
071K3.05 62 M
2 X
Y N
E Since the Rad monitors are defined in the stem, distractor C (Neither) is NP. The distractor analysis does NOT prove plausibility Replace C.
9/09/11 RFA Changed question to add in the 1-RE-90-400 monitor.
10/03/11 RFA Approved 072A4.01 63 M?
2 X
X Y
N U E Stem: Reformat the stem per Generic I If the function switch being in the ALARM ADJ position could cause all the criteria in C as well as A then both answers could be correct. There is inadequate information in the stem to make A bullet proof without C being correct also.
This Q is U because of two possible correct answers.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-0=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only This Q will remain U until proven otherwise.
This Q is also meets the criteria for classification as a higher order Q (analysis).
9/09/11 RFA Correct format per Generic 1. Explained that being in the ALARM ADJ position will not light all three lights.
Question upgraded from U to E.
10/03/11 RFA Approved.
ulb(i2.1.31 3
X Y
N E
Cap the word must in the stem. A is a gray area and could be construed as correct. Since the procedure states should not must.
I would recommend replacing A but cap MUST at the very least.
9/09/11 RFA Changed as requested. Modified power in the stem (34%) and deleted 35% from distractor A.
10/03/11 RFA
086K1.02 X
Y N
I dont think there is adequate information in the stem to answer this Q. The reference states that FCV-26-320 will close on an auto signal from an electric fire pump start.
It further states that if RSW/DI process water n MU Water Treatment Building is not desired hen place 0320 to off. There is an ambiguity between he Question and the reference.
This Q is U until resolved.
/11 RFA INo changes made. Explained how the procedure irects the switch to off to prevent the valve closure on electric fire pump start ONLY. Question upgraded from U to S.
10/03/11 RFA Approved 66 M
2 X
Y N
reactor trip at most sites requires a PA ment. Distractors B and D are NP. Change
-n to WOOTF does NOT require a PA announcement. Do NOT include reactor trip.
IThis Q is U because of two NPDs.
]I11 RFA 2.
LOD (1-5) 2 x
us I
sQisaUbecauseA1 andBl are NP 11 RFA No changes made. Additional reference material rovided that supported A(1) and B(1). Question ipgraded from U to S.
L0103/1 1 RFA Approved.
.1.40 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD r
(C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-SRO U/E/S Explanation Focusi Dist.
units ward K/A Only Used a new question.
10/03/11 RFA Approved.
67 M
2 X
Y N
U S
(-5) as a high AFD limit makes no sense. The distractor analysis does not support it and neither does the reference. Even a graph miss read does not support (-
68 C
3 X
Y N
E NC cannot exist or even be established with nozzle dams installed. Distractor A is NP.
9/09/11 RFA Changed distractor A as requested.
10/03/1 1 RFA Approved.
G2.2.17 M
2 X
Y N
E Stem: Reformat the stem per Generic I 9/09/11 RFA Question changed to a FIB format per Generic 1.
Reordered stem to put lAW statement at the end.
10/03/11 RFA Approved.
G2.2.18 70 M
2 Y
N S
No comment 9/08/11 RFA
G2.2.40 71 C
=
X T
N Its common knowledge that AFW isolation will t.WAYS involve a TS. Therefore, this will always be a answer. A, B, and D are all dwarfed because of it.
place C (the correct answer) because with it, A, B, d D have no DV.
his Q is U because the question has no DV.
11 RFA
.Vlade changes as requested.
10/03/11 RFA Approved.
2.3.4 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD (CIA)
(1-5)
Stem Cues TIE Cred.
Partial Job-Link Minutia
- 1 Back-0=
SRO UIEIS Explanation Focus Dist.
units ward K/A Only
..stionfromUtoSduetobothTurbine in A. d supply valves have to be operable for the ump to be operable.
0/03/1 1 RFA Approved.
.13 72 C
3 X
Y N
U r evacuating containment is NOT an action. A good hometrics evaluator will readily eliminate C and D use of that.
If you are going to ask for an action n C and D NELD to be actions not inactions.
thermore ALL choices state to stop fuel movement.
this to the stem.
Q is U because of two NP distractors.
/11 RFA M
2 X
Y N
E The stem is non-qualifying.
If someone selected D, it would also be correct because he has to authorize anything if over 5 Rem. The stem needs a qualifier like at leas,t minimally, etc.
9/08/11 RFA Changed distractor A to add ONLY and distractor D added Radcon Manager to improve plausibility 10/03/11 RFA Approved
G2.4.11 C
3 Y
N S
No comment 9/08/11 RFA
G2.4.31 M
2 X
Y N
E Reformat the stem per Generic 1.
9/08/11 RFA Question changed to a FIB format per Generic 1.
Improved grammar on B(1) and D(1).
10/03/11 RFA Approved.
SRO ONLY
O11EG2.4.41 76 M
2 X
Y Y
E Stem: The first part of the question is ambiguous and L
difficult to read. This change will be defined as Generic
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only
=
=
= = 1.
Change as follows:
Which one of the foNowing Completes the statement below?
EPIP-1 Emergency Plan Classification Logic, Fission Product Barrier Matrix contain a decision point based directly on RVLIS? The RVLIS threshold level that first requires a that a classification declaration be made is 2
1 2
A.
B.
C.
D, 08/22/11 RFA Changes made as requested. Qualifier (only) added to A(1) and C(1).
10/04/11 RFA Approved
025AG2.4.21 77 C
3 X
Y Y
E Reformat the stem per Generic 1.
Change C.2 and B.2 as follows:
Failure to establish RHR within 15 minutes.
08/22/11 RFA Changed to FIB per Generic 1. Changed C(2) and B(2) as requested. Corrected grammar on all distractors.
Made stem statement into 2 sentences from I sentence.
10/04/1 1 RFA Approved 026AA2.06 78 C
3 X
X Y
Y E
Rewrite the stem: Unit I is operating...with the following components out of service and tagged for maintenance:
Reformat the stem per Generic 1.
Note; the way part 2 is written; only a yes or a no is
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Dist.
units ward KIA Only
=
solicited. The stem is poorly written and does NOT ask for an attachment. Rewrite 1 and 2 to Generic 1.
08/22/1 1 RFA Stem re-written as requested. Question reformatted pei Generic 1. Part 2 rewritten to not just solicit a yes or no.
10/04/11 RFA Approved
038EG2.4.18 79 C
3 X
Y Y
E Reformat the stem per Generic 1.
Second bullet Has initiated a rapid RCS cooldown Bullet 2: Some of the choices have multiple actions.
Therefore change action to action(s).
08/22/11 RFA Question reformatted per Generic 1. Simplified distractors for both halves of the question and modified the stem to shorten second half distractors.
10/04/1 1 RFA Approved
056AA2.74 80 C
3 X
X Y
Y U E Reformat the stem per Generic 1.
(1) Change are dark to were dark.
Are the lights lit when the valve is open or closed during the LOSP? If so then distractor B is also correct. The reference did NOT discuss this.
This Q is U until resolved due to two potentially correct answers.
08/22/11 RFA Question reformatted per Generic 1. Stem changed to 2 statements instead of 1. Upgraded from U to E because it was demonstrated that the lights would not be off during a LOOP if the PORV was in the open or closed position.
10/04/11 RFA Approved.
W/EO4EA2.1 81 C
3 Y
Y S
No comment 08/22/11 RFA
003AA2.02 82 C
3 X
X Y
Y E
Reformat the stem per Generic 1.
Stem:
I do not believe that the first 3 bullets are needed.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD
(C/A)
(1-5)
Stem Cues TIE Cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO UIEIS Explanation Focus Dist.
units ward K/A Only
Consider deleting them.
C2 and B2:
I think you can delete due to the misaligned rod A2 and D2:I think you can delete to prevent
... hot channel factors 08/24/11 RFA Question changed as requested. Removed an additional bullet. Removed additional, un-necessary, information regarding the initial conditions.
10/04/1 1 RFA Approved
028AA2.07 83 C
3 X
Y Y
E Reformat the stem per Generic 1.
08/24/11 RFA Question reformatted per Generic 1.
1 0/04/ 1 1 RFA Approved
068AG2,1,7 84 C
3 X
U Y Y
U E Reformat the stem per Generic 1.
This Q has nothing to do with CR abandonment. The 0900 and the 0902 bullets can be eliminated and the Q can still be answered.
This Q is U because the KA is NOT met.
08/24/11 RFA Question reformatted per Generic 1. Question upgraded from U to E, because it was determined that the question does meet the K/A since determining cooldown rate by using S/G pressures is a CR abandonment task.
10/04/11 RFA Approved
W/EIOEG2.4.8 85 M
2 X
Y Y
E Reformat the stem per Generic 1.
The stem solicits which procedure the crew should be in, NOT transitioning to. Correct the tense when the format is corrected.
08/24/11 RFA Question reformatted per Generic 1. Once rewritten, solicitation issue in the stem was corrected.
10/04/11 RFA Approved
Q is U because of psychometric flaws that could i more than one correct answer.
i4/11 RFA 2.
- 3. Psychometric Flaws
- 4. Job content Flaws
- 5. Other 6.
7.
Q#I LOK LOD (CIA)
(1-5)
Stem Cues TIF cred.
Partial Job-Link Minutia
- 1 Back-Q=
SRO UIE/S Explanation Focus Dist.
units ward K/A Only
= = =
=
r l003G2.2.25 86 C
3 X
X Y
Y U
,i needs a qualifier. Otherwise, if B was correct, 1 be also (subset issue). Similarly, If A was ect, D would be also.
, minimum added, along with adding per Tech pec 3.4.5 RCS Loops
- MODE 3 to the stem. First julIet removed once the T/S title added.
10/04/11 RFA Approved.
A212 87 C
3 X
X 4 Y Y
U E B and D: restate: Leave the charging pump The Q requires a malfunction of the ECCS system.
There is not one identified in the stem.
The WOOTF statement solicits ECA-3. 1. C and D are NP.
If C was correct, A would be also.
If D was correct, B would be also.
This Q is U because The Q does not meet the KA and distractors are NP.
08/25/11 RFA Question determined to meet the K/A because the K/A refers to Operations OR Malfunctions. Question reformatted per Generic 1. Question upgraded from U to E due to misread of ECA-3.2 in distractor C and D.
Bullets 1 and 3 removed from the stem.
10/04/1 1 RFA Approved
010A2.01 88 C
3 X
X Y
Y U
Reformat the stem per Generic 1.
Stem: State the TS LCO number.
B2 and D2 are too broad and would be true even if A2 1 C2 were correct. Either be more specific with D2 or sight another safety limit for A2 and C2.
....sQisUbecauseof2NPD.
08/25/11 RFA
)uestion reformatted per Generic 1. Changed A(2) and (2) to maintain RCS subcooling following a loss of power for an extended period of time which
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD (C/A)
(1-5)
Stem Cues T/F Cred.
Partial Job-Link Minutia
- 1 Back-Q=
I SRO U/E/S Explanation Focus Dist.
units ward K/A Only
=
corrected the subsetlbroadness issue.
10/04/11 RFA Approved
89 C
3 X
X Y
Y E
Reformat the stem per Generic 1.
Al and Bi: How much time are the ice condensers designed to condense steam?
Suggest replacing Al and BI with limit the radiation at the lower door to 5 rad/hr. Even though this is a true statement, it is not the reason for the proportional springs.
08/25/11 RFA Question reformatted per Generic 1. A(l) and B(1) replaced with limit the radiation at the inlet door to 5 rad/hr during normal operation. Split stem statement into 2 sentences.
10/04/11 RFA Approved
026G2.2.37 90 C
3 X
Y Y
E Reformat the stem per Generic 1.
08/25/11 RFA Question reformatted per Generic 1. Changed 3.0.4 to 3.0.4.a and changed LCD entry to ask whether the LCD is met.
10/04/11 RFA Approved
034G2.4.30 91 M
2 X
Y Y
E Stem:
Bullet 3. Dont tell them that fuel pellets have been released. Give them a radiation level and let them figure it out.
Bullet 5. Give them a level and let them figure out that it is below TS.
08/29/11 RFA Changed indications to a gas bubble release (bullet 5) and gave a level one foot above the siphon breaker (bullet 3) to meet comments.
10/04/11 RFA Approved 072A2.02 92 C
3 X
Y Y
E Reformat the stem per Generic 1.
08/29/11 RFA
the stem per Generic 1.
oncurrent verification is common knowledge for wottle valves.
Q is U because there are 2 NPDs.
_._D/11 RFA 110/04/11 RFA Approved G2.2.1 Stem: Which one of the following completes the statement below?
Put the procedure reference in statement 1.
If B was correct, A would be also 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
i
(C/A)
(1-5)
Stem Cues T!F Cred.
Partial Job-Linki Minutia
- 1 Back-0=
SRO U/E/S Explanation Focus Dist.
units ward K/A Only Question reformatted per Generic 1. Removed lAW statement from the stem.
10/04/11 RFA Approved
086G2.2.22 93 M
2 X
Y Y
E To many WOOTF statements.
It should be Given the following plant conditions. How did this get past your reviews and/or validations?
Reformat the stem per Generic 1.
08/29/11 RFA Removed extra WOOTF statement and question reformatted per Generic 1.
10/04/11 RFA Approved
G2.1.18 9
C 3
X Y
Y E
Reformat the stem per Generic 1.
Bullet 1 is not a complete sentences and make it difficul to read.
08/29/11 RFA Question reformatted per Generic 1.
10/04/1 1 RFA Approved C
3 X
X Y
Y U
on reformatted per Generic 1. Part 2 cation) replaced with a question on the checklist to
- ablish status control following relaxation of status
f D was correct, C would be also E;.;s Q is U because of 2 NPD due to psychometric laws.
Ehe Stem needs a qualifier like minimum or maximum, tc.
/29/11 RFA 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
(C/A)
(1-5)
Stem Cues TIF Cred.
Partial Job-Link Minutia
- 1 Back-Q=
I SRO U/E/S Explanation Focusi Dist.
units ward K/A Only Question rewritten to include a qualifier of minimum vice required.
10/04/11 RFA Approved
2.7 7
M 2
X X
Y Y
U E Reformat the stem per Generic 1.
The stem has no qualifier so distractor A could be a correct answer.
If D was correct, C could be a correct answer.
B2 and D2 are too vague. The plant managers designee needs to be more specific or change out part two to the question.
This Q is U because of 2 NPD due to psychometric flaws.
08/30/11 RFA Because the PM designee cannot be the test director, there is not a psychometric problem: the question is changed from U to E. Question reformatted per Generic 1.
10/04/1 1 RFA Approved
G2.3.11 98 M
2 X
X Y
Y U
There is NO qualifier in the stem which leads to a t issue.
C is also a correct answer because no limits were i
placed in the stem.
If A was correct, B would be also.
This Q is U because the potential of two correct answers and 2 NPD due to psychometric flaws.
i/30/11 RFA I
uestion reformatted per Generic 1. 1st half of the stion changed to ask for time vs. temperature for the S required action in order to remove the pyschometric w.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD (CIA)
(1-5)
Stem Cues TIE Cred.
Partial Job-Link Minutia
- 1 Back-Q SRO UIEIS Explanation Focus Dist.
units ward KIA Only
10/04/11 RFAApproved
G2.4.27 C
3 X
X Y
Y U E Reformat the stem per Generic 1.
The stem contains NO limiting qualifiers. There is a significant subset issue here. A is also a correct answer because if the operator did both actions, it would be OK.
lfD was correct, B would be also.
This Q is U because the potential of two correct answers and 2 NPD due to psychometric flaws.
08/30/1 1 RFA This is a psychometrically borderline question.
Question upgraded from U to E, due to the insertion of one word. Question reformatted per Generic 1.
10/04/11 RFA Approved.
100 G2.4.42 M
2 X
Y Y
E Reformat the stem per Generic 1.
08/30/11 RFA Reformatted per Generic 1.
10/04/11 RFA Approved.
13/05/18 Us 38/19/57 Es 24/01/25 Ss
ES-403, Rev. 9 Written Examination Grading Quality Checklist Form ES-403-1
(*)
The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
Facility: Watts Bar Date of Exam: December 29, 2011 Exam LevelO/SRO Initials a
b c
Item_Description 1.
Clean answer sheets copied before grading RFA DMB RFA 2.
Answer key changes and question deletions justified and RFA DMB RFA documented 3.
Applicants scores checked for addition errors RFA DM8 RFA (reviewers_spot_check_>_25%_of_examinations) 4.
Grading for all borderline cases (80 +/-2% overall and 70 or NA NA NA 80, as_applicable,_+/-4%_on_the_SRO-only)_reviewed_in_detail 5.
All other failing examinations checked to ensure that grades NA NA NA are_justified 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of RFA DM8 RFA questions_missed_by_half_or more of_the_applicants Printed Name/Signature Date
- a. Grader
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
- d. NRC Supervisor (*)
Bruno L. Caballero/
i;i/Jii 7_/3D)H
/?J?i/
-Ti