ML101620403
| ML101620403 | |
| Person / Time | |
|---|---|
| Site: | Summer  |
| Issue date: | 03/28/2010 |
| From: | NRC/RGN-II |
| To: | South Carolina Electric & Gas Co |
| References | |
| 50-395/05-301, ES-201-1 50-395/05-301 | |
| Download: ML101620403 (47) | |
Text
ES-201, Rev. 9E Examination Preparation Checklist Form ES-201-1 Facility: 1c_ Date of Examination: Ji a II
/ia 1< /o Examination Prepared By (Circle): Facility (N~
()
j;) c.,trrfllt,,~~
rfti vV 0",""",,;-
Written / Operating Test Written / Operating Test Target Chief Date*
Date* Task Description (Reference) Examiners Examiner's Initials
-180 1. Examination administration date confirmed (C.1.a; (C.1 .a; C.2.a and b) .c$1) i/uJoS'
-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) ~- ?/n.I,,~
-120 3. Facility contact briefed on security and other requirements (C.2.c)
(~ 7/n/"'J-
-120 4. Corporate notification letter sent (C.2.d) di!2 7/1a/o£
[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 2)] 6f2 8/,;:/of
{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-O-1 ES-401-4, as applicable (C.1.e and ES-D-ls,'s, ES-401-1/2, ES-401-3, and andf;f; C.3.d)
N/A
{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}
licensee
{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference (C.1 .e, f, g materials due (C.1.e, g and h; C.3.d)
-30 9. Preliminary license applications (NRC Form 398's) 398s) due (C.1.1; (C.1.l; C.2.g; @ II/Ii/or ES-202)
-14 10. Final license applications due and Form ES-201-4 prepared (C.1.1; (C.1.l; C.2.i; @ IIj"L4p/o.>
-14 11. Examination approved by NRC supervisor for facility licensee review t!fj;) lI/t1../££ (C.2.h; C.3.f)
-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) &;> /~t;!::F Il.
e;,.
-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)
It./"~
-7 14. Final applications reviewed; 1 (if >10) 1 or 2 (if> 10) applications audited to confirm Il./.f/o~
diJ i/sz qualifications I/ eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204)
-7 Proctoringlwntten exam administration guidelines reviewed
- 15. Proctoring/written
&9 w//%
II/Jl:>/O$'"
with facility licensee (C.3.k)
-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
JJ j ~/(//)~
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by- case-by case basis in coordination with the facility licensee.
(Does not apply} to examinations prepared by the NRC.
[Applies only] {Does
O()P/aAT-
.T7$
F ,,/A Form Form ES-201-2 L ES-201 ES-201 Examination Outline Examination Outline Quality QualityChecklist Checklist DateofofExamination Date :
ES-201-2 Facility: Examination:
IZ/I2.//
/2/12 c.s-Initials Initials Item Item TaskDescnpt!on Task Description a b* c#
1.1. Verifythat a.a. Verify thatthe theoutline(s) outline(s)fit(s)fit(s) the the appropriate appropriatemodel, accordancewith model, ininaccordance with ES-401.
ES-401. sv/
wWR a-Assess whetherwhetherthe the outline outline was was systematicall systematically y and and randomly accordancewith prepared inin accordance randomly prepared with // ,yj R b.b. Assess C iA II Section Section D.1 Di of of ES-401 ES-401 and and whether whether all all KiA K/A categories categories are are appropriately appropriately sampled.
sampled.
T Assess whether whether the the outline outline over-emphas over-emphasizes evolutions, or systems, evolutions, any systems, generic topics.
orgeneric topics.
T c.c. Assess izes any E statements are KiA statements rejected K/A are appropriate.
N Assess whether
- d. Assess
- d. whether the the justifications justifications for deselected or for deselected or rejected appropriate. / VA
- 2. a. Using
- a. Using FormForm ES-301-5, ES-301-5, verify verify that that thethe proposed scenario sets proposed scenario sets cover cover the required number the required number
- 2. s, ,.
ii,i of normal of normal evolutions, evolutions, instrument instrument and component failures, and component technical specification failures, technical specifications,
(
SS major transients.
and major and transients.
I M b. Assess
- b. Assess whether whether there there areare enough enough scenario scenario sets sets (and spares) to (and spares) test the to test projected number the projected number M and mixmix of of applicants applicants in in accordance accordance with with the expected crew the expected composition and crew composition rotation schedule and rotation schedule uU and I/f without compromisin compromising exam integrity, g exam integrity, and and ensure ensure that applicant can each applicant that each can bebe tested tested using using LL without at least least one one new new or or significantly significantly modified scenario, that modified scenario, that no scenarios are no scenarios are duplicated duplicated AA at T from the from the applicants applicants' audit audit test(s),
test(s), and and that scenarios will that scenarios will not not be repeated on be repeated subsequent days.
on subsequent days.
T o
0 c.
- c. To To the the extent extent possible, possible, assess assess whether the outline(s) outline(s) conform(s) with the qualitative R and quantitative quantitative criteria specified on on Form ES-301-4 and Form ES-301-4 described in and described Appendix D.
in Appendix D.
R and 4
- 3. a. Verify
- a. Verify that that the systems walk-through outline meets the criteria specified on Form ES-301-2:
the systems 3.
(1)
(1) the the outline(s) outline(s) contain(s) contain(s) the required number of control room and in-plant tasks W distributed among distributed among the safety functions as specified on the form f/f W
II (2)
(2) task task repetition repetition from from thethe last two NRC examinations is within the limits specified on the form ,-
T (3)
(3) no no tasks tasks are are duplicated duplicated from the applicants' applicants audit test(s)
T fr,rm (4)
(4) thethe number number of of new new or or modified tasks meets or exceeds the minimums specified on the form (5)
(5) thethe number number of of altemate alternate path, low-power, emergency, and RCA tasks meet the criteria on on thethe form.
form.
- b. Verify Verify that that the the administrative administrative outline outline meets meets the the criteria specified on criteria specified on Form ES-301-1:
Form ES-301-1:
b.
(1)
(1) thethe tasks tasks are are distributed distributed among among the the topics topics as specified on as specified form the form on the 2 (2) 1> A (2) at at least least one one task task isis new new or or significantly significantly modified modified (3)
(3) no no more more than than oneone task task is is repeated repeated from from the the last two NRC last two examinations licensing examinations NRC IicensinQ Determine ifif there there are are enough enough different different outlines outlines to to test test the number and projected number the projected mix and mix
- c. Determine c.
of of ap[llicants applicants and and ensure ensure thatthat no no items items are are duplicated duplicated on subsequent days.
on subsequent days. L-- /4 4.
- 4. a.a. Assess Assess whether whether plant-specific plant-specific priorities priorities (including (including PRA PRA and insights) are IPE insights) and IPE covered are covered ,
in in the the appropriate appropriate exam exam sections.
sections.
t- ,4 G CFR 55.41/43 appropriate.
sampling isis appropriate.
E G b. Assess
- b. Assess whether whether the the 1010 CFR 55.41/43 and and 55.45 55.45 sampling NN Ensure that KJA c.c. Ensure that K/A importance importance ratings ratings (except (except for for plant-specific plant-specific priorities) at least are at priorities) are 2.5.
least 2.5.
E R
d.d. Check Check for for duplication duplication and and overlap overiap amongamong exam exam sections.
sections.
AA e.e. Check Check the the entire entire examexam for balance of for balance ofcoverage.
coverage.
- f. Assess Assess whether whetherthe the exam exam fits fits the the appropriate appropriatejob job level (RO or level (RO SRO).
orSRO). -
///4 a.a. Author Author d2tJr'vt .~ c;ll/j~!~,me/~j;r~~
b.b. Facility Reviewer(*)
FacilityReviewer
(*) A//Jt!
c.c. NRC (#) S -rd£l6-¥ 1::>. R.o.s&- '/.. ~
NRCChief ChiefExaminer Examiner(#)
d.d. NRC Supervisor NRC Supervisor
, 'l /'
Note: ## Independent IndependentNRC NRCreviewer reviewerinitialinitialitems Column"c";
itemsininColumn chiefexaminer c; chief required.
concurrencerequired.
examinerconcurrence Note:
ES-201, ES-201, Page Page25 25of of2727
vJA 7 F --
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:
Facility: VC Summer Date of Date of Examination:
Examination: 01/10/2006 Initials Item Task Description a b* C#
W
- 1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. &-
/_ N/A f£ R b. Assess whether the outline was systematically and randomly prepared prepared in accordance with
~.
Ii Section 0.1D.1 of ES-401 and whether all KIA K/A categories are appropriately sampled. ( N/A 6l T
T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. & N/A N/A til E
N
- d. Assess whether the justifications for deselected or rejected KIA K/A statements are appropriate.
if N/A N/A ~
- 2. a. ES-301-5, verify that the proposed scenario sets cover the required number of Using Form ES-301-5, S
normal evolutions, instrument and component failures, technical specifications, and major transients. C
/7 C
N/A N/A
~
I M b. Assess whether there are enough scenario sets (and spares) to test the projected number and Uu mix of applicants in accordance with the expected crew composition and rotation schedule A
L without compromising exam integrity, and ensure that each applicant can be tested using at least one newnewer or significantly modified scenario, that no scenarios are duplicated from the v N/A tj)
T applicants audit test(s), and that scenarios will not be repeated on subsequent days.
applicants' 0
- c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and R
quantitative criteria specified on Form ES-301-4 and described in Appendix D. it N/A t&J
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W among the safety functions as specified on the form 1I (2) task repetition from the last two NRC examinations is within the limits specified on the form T applicants audit test(s)
(3) no tasks are duplicated from the applicants' N/A
~
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on t-the form.
- b. Verifythatthe Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified t-C N/A @
(3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
(2.-
2_ N/A rill
- 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections. ~.
N/A $;
G G
E b. Assess whether the 10 10 CFR 55.41/43 and 55.45 sampling is appropriate. t- N/A tift N
E
- c. Ensure that K/AKIA importance ratings (except for plant-specific priorities) are at least 2.5. L-~ N/A 181-R d. Check for duplication and overlap among exam sections. L/ N/A N/A 'IiJ A
LL e. Check the entire exam for balance of coverage. t/ N/A N/A 1e8Y
- ?'a Printed Name/Signature / Date
/7/%J/
~
7/%/
- a. Author
- a. Mark Chilly Chitty /I -
all:)6#6'
(*)
v J 7
- b. Facility Reviewer (*)
- b. N/A N/A /I N/A N/A
- c. NRC
- c. NRC Chief Examiner (#)
Chief Examiner Steven Rose I ~A /II ,/oro
~ ~ /--1, (}1,p-~
- d. NRC NRC Supervisor James James H. Moorman, III I /-:!14 / . t, -lJ (,
\
Note:
Note: # Independent Independent NRC reviewer initial items Col'UQ1~ "c";
items in Coiui c; chief examiner concurrence required.
ES-201 ES-201 Examination Security Examination SecuritLAgreement Agreement Form ES-201-3 Form ES*201*3 1.
- 1. Pre-Examination Pre-Examination I I acknowledge acknowledge that that I I have acquired specialized have acquired knowledge about specialized knowledge about the the NRC NRC licensing licensing examinations scheduled for examinations scheduled for the the week(s) week(s) of of iüiiJc r:!J"/t1S*' as of as of the the date of date of mymy signature.
signature. II agree agree that that II will will not knowingly divulge not knowingly divulge anyany information information about these examinations about these examinations to to any persons who any persons who have have not not been been authorized authorized by the by the NRC NRC chief chief examiner.
examiner. II understand understand that that II am am not not to instruct, evaluate, to instruct, evaluate, or or provide performance feedback provide performance feedback to to those those applicants applicants scheduled scheduled to to be be administered administered these licensing examinations these licensing examinations from from this date until this date until completion completion of of examination examination administration, administration, except except as as specifically specifically noted noted below below and and authorized authorized by the NRC by the (e.g., acting NRC (e.g., acting asas aa simulator simulator booth operator or booth operator or communicator communicator is acceptable ifif the is acceptable individual does the individual does notnot select select the the training training content content oror provide direct provide direct oror indirect indirect feedback). Furthermore, II am feedback). Furthermore, am aware aware of of the the physical physical security security measures measures and and requirements requirements (as documented in (as documented in the the facility facility procedures) and licensee's procedures) licensees and understand understand that that violation violation ofof the conditions of the conditions of this this agreement agreement may result in may result in cancellation cancellation of of the the examinations examinations and/or and/or an an enforcement action enforcement action against against me me oror the facility licensee.
the facility licensee. II will immediately report will immediately report to to facility management or facility management or the the NRC NRC chief chief examiner examiner any any indications indications or or suggestions that suggestions that examination examination security security may may have have been been compromised.
compromised. .
2.
- 2. Post-Examination Post-Examination ToTo the the best best of of mymy knowledge, knowledge, II did did not not divulge divulge to to any unauthorized persons any unauthorized persons any any information concerning the information concerning the NRC NRC licensing licensing examinations examinations administered administered during the during the week(s) week(s) of fn.fr of '~fl'&{6 . From. From the date that the date that II entered entered into this security into this security agreement agreement until until the the completion completion of of examination examination administration, administration, II did did not not instruct, evaluate, instruct, evaluate, or or provide provide performance performance feedback feedback to those applicants to those applicants who were administered who were administered thesethese licensing licenSing examinations, examinations, except except as as specifically specifically noted below noted below andand authorized authorized by by the the NRC.
NRC.
PRINTED NAME PRINTED NAME JOB TITLE I/ RESPONSIBILITY JOB TITLE RESPONSIBILITY SIGNATURE SIGNATURE (1) (1) DATE DATE SIGNATURE (2) DATE NOTE 1 . .-Dl1JA)_~W_~+_~..M
- 1. ____ ~MJPr__.r'#-it~~.r~~l~
- 2. ilJ..l!;bM?:. ~:;r;, a..i0:1___ Y.Ldr.d .M<!!:LJ_ _.Y :~~~-:- ___ _ --LL
. c..
l=f'~_~r;;~~ zz::::::: =-~~~~~
- 2. j . .#.LLf
- 3. _LLW L_ /
4.
5.5. ~L!..~~~~~_ -~------------------- -~~7-1 4
<t
-. {..
P. !Iw L-k 6, _-=-_fL __ f!f.!L~ _______
- 6. -----------
4-.-"--~~~ fi
- It3Lto(.
~~l5tiff:
_j"I.J1~~~ri:c<=~~~=-==-~~-
- 7. jLi?
_S::,,---L'~,,-~~ --Ji!~ -4&L~' -~-'-I-k.
8.
- - ._J./ 1/ ¥,
- ~=~f~~== ~~::Ei5~~~1J.~~==-~:~=*~.='!4. -----=== !i~-:Pi=
9.9, fL7iJ7Z 4SUV. j 4 h4ta t.e4 1
- JJtli'tt};~~= ~lm£
- ~~=::=~~'::::_ ~------ ----===~C~.
13.
14 ui/L/l7 14.G~~_~~~ ____Al
/s_i 4
..Si 15*-(i~:!1-f'!J..{l.1-l..~f-t---
15.6 VT 11 4f (i.
0
&Iv$
,q~t?L~1.yS. ________ --
__I3S.L'__ jJlJ,I.4f.§....~_kk~L~
Al.... ,,?I..aA 7 ___ ---
- --_-----~~~::: '
f.w_J&..
_________ lJ..!'-..~".Pr_ .
--- ~::::;1.:~::::
',kPJ1U --~1?:.1t-~
_ ~ ___ i.r. L:.l.P.::.rL~_
c_L__
r I"<<:.
NOTES: / .Y:..
7 V-f/
- ' iVII V'-h./I
<-.1-.
ES-201, Page 26 of 27 J
) ) ))
ES-201 ES-201 Examination Security Examination Security Agreemen.t Agreement Form Form ES-201-3 ES-201-3 1.
- 1. Pre-Examination Pre-Examination II acknowledge acknowledge that that II have have acquired specialized knowledge acquired specialized knowledge about about the the NRCNRC licensing licensing examinations examinations scheduled scheduled for for the the week(s) week(s) of of Ilh~~
I26f ~ as as of of the the date date of of my my signature.
signature. II agreeagree that that II will will not not knowingly divulge any knowingly divulge information about any information about thesethese examinations examinations to any persons to any persons who have Aot who have een authorized ot been authorized by by thethe NRC NRC chief examiner. II understand chief examiner. understand that that II am am not not to to instruct, evaluate, or instruct, evaluate, or provide provide performance performance feedback feedback to to those applicants scheduled those applicants scheduled to to be be administered administered these these licensing examinations from licensing examinations from this date until this date completion of until completion of examination administration, except examination administration, except as specifically noted as specifically noted below below andand authorized authorized by by thethe NRC NRC (e.g., acting as (e.g., acting simulator booth as aa simulator operator or booth operator communicator isis acceptable or communicator the individual acceptable ifif the individual doesdoes not select the not seleCt the training training content content or or provide provide direct direct or or indirect Furthermore, II am feedback). Furthermore, indirect feedback). aware of am aware of the physical security the physical security measures measures and and requirements requirements (as documented in (as documented in the the facility facility licensee's licensees procedures) procedures) and and understand understand that violation of that violation of the conditions of the conditions of this this agreement agreement may may result result in in cancellation cancellation of of the the examinations examinations and/or andlor an an enforcement enforcement action against me action against me oror the the facility licensee. II will facility licensee. immediately report will immediately report to to facility management or facility management or the the NRC NRC chiefchief examiner examiner anyany indications indications or or suggestions that suggestions that examination security may examination security have been may have compromised.
been compromised.
2.
- 2. Post-Examination Post-Examination To To the the best best ofof my knowledge, II did my knowledge, not divulge did not divulge to to any any unauthorized unauthorized persons persons any any information information concerning concerning the the NRC NRC licensing licensing examinations examinations administered administered during the during week(s) of the week(s) of tJ.(I~Q'S' laflifOc . FromFrom the the date that II entered date that entered intointo this this security security agreement agreement until until the the completion completion of of examination examination administration, administration, II diddid not not e
instruct, evaluate, or instruct, evaluate, or provi performance feedback provide performance feedback to to those applicants who those applicants who werewere administered administered these these licensing licensing examinations, examinations, except except asas specifically specifically noted below noted below and and authorized authorized by by the the NRC.
NRC.
PRINTED NAME PRINTED NAME JOB TITLE /I RESPONSIBILITY JOB TITLE RESPONSIBILITY SIGNAT~
SIGNATURE (1) DATE DATE SIGNATURE SIGNATURE (2) (2) DATE DATE NOTENOTE 1.1. ~dJ~_~ _JJ-Id.f._J:~_~o__________ _~_ ~_:_-;.____________ - ~~-~-~ _~4___!6~~~ ~
JiJjc 2.
- 2. t. 4:/;fi~0::..~/£-.L~1LCr--L:L!:!...::?1'------------ --~ -
fl_ -~ A " Zfji{~-d.&. ~$l. {
~:4. -~
t-6-- ~ -,e-K--~--~-~--
4 ----r~k-~-t:.------------
k5t ---' t ----11-¥r - - ---- - l-~ff '
iiI;:
-v/ ---
Z7(--I1---nA.-;.rl.LC ______I-r.~ rrEVJJ__fJ _____________ --- - _____ '-~ ij,T__ ___~~~
!-9
__~!~_g/!-I-r:_-:.-_12E._________ -
- 5. _, . --~ft~-----
hLLrrJ -
--~----------- ~j-SLQ --~--- -- -Z:,#-'((~-
- 6. -j~/~r:.f----f-1-----
- 6. _Ji4 ---~~---?::!-f-!.:!!:='!!.~---------- --- , ------------ -1.. -!it~f.2____ ________ _..J-L:}~./.flC.
m
- o=~=~_~~_~_ =_~~_~_~~~~=~~_~_~~~_ _ _~_~~_~--=~~~=~~~~~~~~
77 .. f<../t'l/?R'df!?dc:.. ~ .. --
' i.-4-tP~ ;l*:2.,;?*6 8
9.
JL2 % 242i ill 1n vi I 11 11.'_____________________ _____________________________ ___________________________ ______ ____________________ _ ________ _
12._____________________
- 12. _____________________________ ___________________________ ______ ____________________ _ ________ _
13._____________________
13.. _____________________________ ___________________________ ______ ___________________ __________
14 14...__________ ~---------- _______________________________________________________________:..__________________ _ ________ _
15._____________________
15.. _____________________________ __________________________ ______ ___________________ _________ _
NOTES:
NOTES:
,..,J ES-201, ES-201, Page Page 26 of of 27 27
..\
\.f V
,-/
ES-301 Administrative Topics Outline Form ES-301-1 Facility: V.C. Summer Date of Examination: 12/12/05 12112105 Examination Level (circle one): @-sA&
(Crio Operating Test Number: 2005-301 Administrative Topic Type Describe activity to be performed (see Note) Code*
Code*
Conduct of Operations (N) RO Only - Perform RCS leak rate calculation with plant in Mode 4 per STP-STP (K/AG2.1.7; 114.002 (KIA G2.1.7; 3.7/4.4)
Conduct of Operations (N) Calculate the Maximum allowable head venting time per EOP-18.2 Step 17 and (K/A G2.1 .25; 2.8/3.1)
Attachment 2. (KIA Equipment Control (N) RO Only - Construct a tagout for SFP SEP HEX 'A'A (Construct without the use of pre-written tagouts or computerized tagging system) (KIA (K/A G2.2.13; 2.8/3.1)
Radiation Control (N) (K/A G2.3.2; 2.5/2.9)
Perform a Shielding Calculation (KIA Emergency Plan N/A NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
(N)ew or (M)odified from bank (~ ( 1)
(P)revious 2 exams ( (~ 1; randomly selected)
(S)imulator
ES-301 ES-301 Administrative Topics Topics Outline Outline Form Form ES-301-1 ES-301-1 Facility:
Facility: V.C. Summer V.C. Summer Date of Date of Examination:
Examination: 12/12/05 12112105 Examination Level Examination Level (circle (circle one):
one): -R&@ Operating Test Operating Test Number:
Number: 2005-301 2005-301 Administrative Topic Type Describe activity to be performed Note)
(see Note) Code*
Code*
Conduct of Operations (N) SRO Only - Determine Overtime Availability. (KIA (K/A G2.1.4; G2.1 .4; 3.4)
Conduct of Operations (N) Calculate the Maximum allowable head venting time per EOP-18.2 Step and Attachment 2. (KIA (K/A G2.1.25; G2.1 .25; 2.8/3.1)
Equipment Control (D) SRO Only - Review work package for SFP HEX 'A';
A; JPA-001 JPA-OO1 (K/A G2.2.13; 3.6/3.8)
(KIA Radiation Control (N) Perform a Shielding Calculation (KIA (K/A G2.3.2; 2.5/2.9)
Emergency Plan (D) SRO Only - Classification of an Emergency Event NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room (D)irect from bank ((:<;; 3 for ROs; :<; 4 for SROs & RO retakes)
(N)ew or (M)odified from bank ( (~ 1) 1)
(P)revious 2 exams ( (:<;; 1; 1; randomly selected)
(S)imulator
ES-301 ES-301 Control Room/In-Plant Control Room/In-Plant Systems Systems Outline Outline Form ES-301-2 Form ES-301 -2 Facility:
Facility: V.C. Summer Summer Date of Date of Examination:
Examination: 12/12-12/15/05 Exam Level (circle one): (!39)t 5I~O Exam Level (circle one): SRO-l! 1,£ 5I~O SRO-UU Operating Test Operating Test No.:
No.: 2005-301 2005-301 Systems (8 for RO; 7 for SRO-I; Control Room Systems@ SRO-l; 2 or 3 for SRO-U)
System I/ JPM Title Type Safety Code*
Code* Function
- a. Start and load Diesel Generator "A" A from the control room in (N) (S) (A) 6 SOP-306.1 6A. (The DIG the test start mode per SOP-306.16A. D/G will uncontrollably pickup load requiring an emergency STOP.)
(K/A 062A1.01; (KIA 062A1 .01; 3.4/3.8)
- b. JPSF-059, Alternate Isolation of Rutured S/G ('C' (C MSIV) (KIA(K/A (D) (S)
(5) (A) 3 038 EA1 .32; 038EA 1.32; 4.6/4.7)
- c. JPSF-012, Dropped Rod Recovery. When Rod F2 is withdrawn (M) (S) (A) 11 to - 30 step position, the rod stops moving (stuck). When the ROD CNTRL BANK SEL switch is taken to manual per AOP- AOP 403.5, another rod within the same group drops requiring a (K/A 003AA1.02; manual trip. (KIA OO3AA1 .02; 3.6/3.4)
- d. Secure Normal letdown per SOP-1 SOP-i 02 Section IV Part Nand N and (N) (S)
(5) 2 place Excess Letdown in service to the RCDT per SOP-1 SOP-i 02 Section IV Part C. (KIA (K/A 004A2.07; 3.4/3.7)
- e. JPS-068, Shift Component Cooling Water Trains. (KIA (K/A (D) (S) 8 008A4.01; 3.3/3.1 3.3/3.1))
- f. JPSF-083, Respond to Loss of Secondary Heat Sink. (KIA (K/A (D) (S)
(5) (A) 4S W/EO5EA1 W/E05EA1.1; .1; 4.1/4.0)
- g. JPSF-062, Respond to RHR Pump Vortexing during midloop (N) (S) (A) 4P x.
operation. (K/A (KIA 025AA2.07; 3.4/3.7) (L)
- h. Respond to a Source Range Nuclear Instrument Malfunction (S) (L)
(N) (5) 7 (MODE 6 refueling activities in progress)
In-Plant Systems@
Systems@ (3 for RO; 3 for SRO-I; SRO-J; 3 or 2 for SRO-U)
- i. JPP-055, Locally Start the Turbine Driven Emergency (M) (E) (L) 4S Feedwater Pump per FEP-4.0 Enclosure FF and manually adjust flow. (K/A (KIA 061 A2.04; 3.4/3.8) 061A2.04;
- j. JPPF-1 66B, Establish Chilled Water Alternate Cooling to JPPF-166B, (R)
(D) (E) (A) 88 Charging Charging Pumps.
Pumps. (K/A (KIA 026AA1 .07; 2.9/3.0) 026AA 1.07;
- k. JPP-052, JPP-052, Startup Startup aa Battery Charger per per SOP-31 SOP-311.1. (K/A (KIA (D) 66 //
063A4.Oi; 063A4.01; 2.8/3.1)
I I
ES-301 Control Room/ln-Plant Control Room/In-Plant Systems Outline Form ES-301-2 Facility: V.0. Summer V.C. Date of Examination:
Examination: J/12-12/15/05_
12/12-12/15/05 Exam Level (circle one): ~O RO!,£ 5I~O SRO-lI ,(§~o-ID Operating Test No.: 2005-301 Systems@ (8 for RO; 7 for SRO-I; Control Room Systems@ SRO-l; 2 or 3 for SRO-U)
System I/ JPM Title Type Safety Code*
Code* Function
- a. Start and load Diesel Generator "A" A from the control room in (N) (S) (A) 6 SOP-306.1 6A. (The DIG the test start mode per SOP-306.16A. D/G will uncontrollably pickup load requiring an emergency STOP.)
(K/A 062A1.01; (KIA 062A1 .01; 3.4/3.8)
- b. JPSF-059, Alternate Isolation of Rutured S/G SIG ('C' (C MSIV) (KIA (K/A (D) (S) (A) 3 038 EA1 .32; 038EA1.32; 4.6/4.7)
- c. JPSF-012, Dropped Rod Recovery. When Rod F2 is withdrawn (M) (S) (A) 1 1
to - 30 step position, the rod stops moving (stuck). When the ROD CNTRL BANK SEL switch is taken to manual per AOP- AOP 403.5, another rod within the same group drops requiring a manual trip. (KIA OO3AA1 .02; 3.6/3.4)
(K/A 003AA1.02; d.
e.
f.
g.
h.
Systems@ (3 for RO; 3 for SRO-l; In-Plant Systems© SRO-I; 3 or 2 for SRO-U)
- i. JPP-055, Locally Start the Turbine Driven Emergency (M) (E) (L) 4S Feedwater Pump per FEP-4.0 Enclosure F and manually adjust flow. (K/A (KIA 061A2.04; 3.4/3.8)
- j. JPPF-1 JPPF-166B,66B, Establish Chilled Water Alternate Cooling to (D) (E) (R) 8 Charging Pumps. (KIA (K/A 026AA1 .07; 2.9/3.0) 026AA 1.07; k.
@ All control room (and in-plant) systems must be different and serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for RO I/ SRO-l SRO-I / SRO-U
ES-301 Operating Test Quality Checklist Form ES-301-3 Form ES-301 -3
.t<>(';1::;"- 30 I Facility:
Facility: Vi2 VC ScJMMf1~
SiMMER Date of Date of Examination: (Z./Il./
Examination: I&ilZJO oS' Operating Test Operating Test Number:
Number:
Initials
- 1. General Criteria a b* c#
- a. The operating test test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., (e.g., 10 CFR 55.45, 55.45, operational importance, importance, safety function distribution).
- b. There isis no during this examination.
repetition between no day-to-day repetition between this and other operating tests to be be administered 49 N/A
- c. applicants audit testis).
The operating test shall not duplicate items from the applicants' test(s). (see Section D.1.a.)
D.1 .a.)
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
- e. It appears that the operating test will differentiate between competent and less-than-competent ,tj/
applicants at the designated license level. IA
- 2. Walk-Through Criteria -- --
- a. Each JPM includes the following, as applicable:
- initial conditions initiating cues
- references and tools, including associated procedures
- reasonable and validated time limits (average time allowed for completion) and specific p4/
designation if deemed to be time-critical by the facility licensee ,.,,
- operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through ,-
outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance 9 IA criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria -- --
iV4 The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached. c Printed Name I/ Signature Date a.a. Author Author ~Tl$I/&"" b.
v j(tI.j~ /.----_
D. Ros ~ IZ/B/oS"'
- b. Facility Reviewer(*)
Reviewer(*)
- c. NRC Chief Examiner (#) (4) AV 4/e/i/ Z_
- d. NRC Supervisor /zJ-L.)
y NOTE: The facility signature is not signature is not applicable for NRC-developed NRC-developed tests.
- Independent Independent NRC NRC reviewer initial initial items in Column "c";
items in c; chief examiner concurrence required.
ES-301, Page 24 of 27
ES-301 Simulator Simula tor Scenar Scenario io Qualit Quality y Check Checklist list FormES-30 Form ES-301-4 1-4 ES-301
\-..J 11/1'4/tII.:i
,2/n../o .r e4 .3 I I Facility:
Facility: VIt< C. .rvé SVr'\M4i! Z DateofofExam:
Date Exam: Numbers: I I I /22./ /3 ScenarioNumbers:
Scenario 3 Operating OperatinQTest No.: 1-<>o.J~".30 TestNo.:
~
QUALITATIVE ATTRIBUTES IVE ATIRIBUTE S Initials Initials QUALITAT a b* C#
1.1. Theinitial The of initialconditions ofservice, service, but conditionsare butit'itdoes doesnot arerealistic, realistic,ininthat notcuecuethe thatsome theoperators someequipment operatorsinto and/orinstrumentati equipmentand/or expectedevents.
intoexpected events.
instrumentationon may maybe beoutout
~ 1A The scenarios scenarios consist consistmostly mostlvof ofrelated relatedevents.
events. (!, 4i I'IIA @..
2.2.
The 3.3. Each eventevent description description consists consists of of N tJ ~4 &J Each
- the point the point inin the the scenario scenariowhen when ititisis to to be be initiated initiated (1
- the malfunction(
the malfunction(s) that are s) that are entered entered to to initiate initiatethe the event event
- the symptoms/cu the symptoms/cues that will es that will be be visible visible to to the the crew crew
- the expected the expected operator operatoractions actions (by (byshift shift position) position)
- the event the event termination termination point point (if (if applicable) applicable)
. N,4 4.
- 4. NoNo more without more than without a a than one one non-mechani credible credible non-mechanistic preceding preceding incident incident failure (e.g.,
stic failure such such (e.g., pipe as as a a
pipe break) seismic seismic event.
event.
incorporated into break) isis incorporated the scenario into the scenario f~ 14 11I fli) 5.
- 5. The events The events are are valid valid with with regard regard to to physics physics and and thermodynam thermodynamics. ics. V riM ~
t Ii/;! rfj) 7 examination teamteam to to obtain //
- 6. Sequencing and Sequencing and timing timing of of events events is is reasonable, reasonable, and and allows the examination allows the obtain 6.
complete evaluation complete evaluation results commensura commensurate with the te with scenario objectives.
the scenario objectives.
~
7.
- 7. IfIf time time compression compression techniques are used, the scenario summary clearly are used, clearly soso indicates.
indicates.
Operators have Operators sufficient time to carry have sufficient expected activities without carry out expected undue time constraints.
without undue V
£? /,.4 Cues are are given.
given.
Cues 7;
(~I (ffj}
S.
- 8. The The simulator simulator modeling modeling is not altered. "'fA t(. rz; &5
- g. The The scenarios scenarios have have been validated. Pursuant to 10 CFR 55.46(d), any open simulator 9.
performance performance deficiencies to to ensure ensure that deficiencies or deviations from the referenced plant have been evaluated that functional functional fidelity is maintained while running the planned scenarios.
Fl @
,/.,
- 10. Every Every operator operator willwill be evaluated using using at least least one new new or significantly scenario.
significantly modified scenario.
G 'i;
- 10. ES-301.
D.5 of ES-301.
All All other other scenarios scenarios have have been been altered altered in in accordance accordance with Section Section D.5 11.
- 11. All All individual individual operator operator competencies competencies can can be be evaluated, evaluated, as verified using as verified ES-301-6 Form ES-301-6 using Fonm V "'4 ~
/)
IT (submit (submit the the fonm form along along with with the the simulator simulator scenarios).
scenarios).
7 /Vii.
It!
Each number of transients and of transients events and events 12.
- 12. Each applicant applicant willwill be be significantly significantly involved involved in in the the minimum minimum number E specified specified on on Form Form ES-301-5 ES-301-5 (submit (submit the the form form withwith the the simulator scenarios).
simulator scenarios).
13.
- 13. The level of The level of difficulty difficulty isis appropriate appropriate to to support support IicensinQ decisions for licensing decisions for each position.
crew position.
each crew t!.- fiI/,4 i eJlI F Target Target Quantitative Quantitative Attributes Attributes (Per (Per Scenario; Scenario; See See Section D.5.d)
Section D.5.d) Attributes Actual Attributes Actual - - -
1.1. Total Total malfunctions malfunctions (5-S) (58) r:; / r;' / b
/
/ , ,
I / -Z "'fA i@1l 2.2. Malfunctions Malfunctions after afterEOPEOP entry entry(1-2)
(12) ?- 2.. / JJ 2.. // 1).../ t!/ 111M I~
3.3. Abnonmal Abnormalevents events (2-4)
(24) c-
// 3// Lf Lj
? /'Ij,l4 tfIJ 4.4. Major Majortransients transients(1-2) (12) I/ / / II I , // t/ "'Øi /11 I~ jV W
5.5. EOPs EOP5entered/requiring entered/requiringsubstantive substantiveactions actions(1-2) (12) '/-.- // 7-.2.I 'I A 7 t/ nAl f&!
6.6. EOPEOPcontingencies contingenciesrequiring requiringsubstantive substantiveactions actions(0-2) (02) 0 O /0 O/D/ Z ('It? tJY 7.7. Critical Criticaltasks tasks(2-3)
(23)
?
_/ / / '2- /:J,,",3 (,2 1'1/,1 (j3?
ES-301, ES-301,Page Page25 25ofof27 27
ES-301, Rev. 9 Transient and Event Checklist Form ES-301-5 Facility: VC Summer Exam:12/12/0S Date of Exam:12/12/05 Operating Test No.:200S-301 No. :2005-301 A E E Scenarios P V P E 1 2 3 4 T M C
A A
L I
Ii N
N T
T t--~C::::-:R::::-:E:::-W:-:---+:::C-=R-=EW:-:-:-:P::-:O::-:S::-::IT=:I-=O"""'N+-:::CC::RC::E::-:W"""P::-'O::-'S::::-:I=TI:":::O"'-N'-!-':C:":::R:":::E""'W-=-=-PO=-S=I=T:-::IO:-:""N-:-i CREW POSITION CREW POSITION CREW POSITION CREW POSITION r o
0 A
T L
L N
M I
I M
N N Y S A B B S A A B S A B S A A B B UU T P R R T 00 R R T o 0 R R T o0 A R T 0 0 M(*)
M(*)
E o0 C P o0 C P o 0 C P P o 0 C. PP A IiI R luU
~ AX RX I 1 1110 1 0 NOR 2 1111 1 1 SRO-I I/C S 5 4 4 2 SRO-U 2 2 1 1
MAJ 2 TS o o0 2 2 AX
~
RX I 0* 1 1 11 0 SAO-l SRO-I NOR ii 1 1 1ii1 I/C 7 4 4 2 SAO-U SRO-U MAJ 2 2 2 11 TS o 0 2 2 RO RO RX AX S\/<.' ;'/:'\1< .......**.\. 1 1 1110 1 0
~~~~--;----+~rlr~-+~-+~~~---+--~----r---;----+---;~;-~~r.-~I SRO-I SAO-I NOR S ....***. 1i,';; i ....* ...... . 1_11 2 1 1 1
~~I~/C~-4~1~,2~,~-~-~2~,3-,~~.)-**~,~~.~
I/C *. *..~-+--~-~-~-~-~~12~~4~4~2~1 12 4 42
~ 3,6, .. \ 4,S, *... ..*.. .
7,9 8,9 .::.
MAJ 2 221211 2 1 TS 1,2, ......... : 2,4,'.' ..' 7 0022 2 2 3,4i Slt.>.i .....
AO RO AX RX 11 1 0 NOR 1111 1 1 SAO-I SRO-I I/C IIC 4442 4 2 SAO-U SRO-U 2 2 11 MAJ TS o 0 22122 Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO AO applicants. ROs AOs must serve in both the "at-the-controls at-the-controls (ATC)" (ATC) balance-of-plant (BOP)"
and "balance-of-plant (BOP) positions; Instant SROs SAOs must do one scenario, including at least two instrument or component (I/G) (I/C) malfunctions and one major transient, in the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to D.5.d) but must be significant per Section C.2.a of Appendix D. (*)
Section D.S.d) (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 1 -for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's applicants competence count toward the minimum requirements specified for the applicant's applicants license level in the right-hand columns.
ES-301, Rev. 9 Transient and Event Checklist Form ES-301-5 Facility: VC Summer Date of Exam:12/12/05 Operating Test No.:2005-301 A E Scenarios P V P E 1 1 2 3 4 T M L N 0O II IiI T T N C CREW CREW POSITION CREW POSITION CREW POSITION POSITION A II A T L M N Y S A B S A B S A B S A B U T P R T 00 R T 00 R T 00 R T 0 0 M(*)
M(*)
E 00 C P 00 C P 00 C P 0 0 C P R I U R
II
~ RX ";,:,;. 5 I I.
'.,. :, r?' 1:':/' I;:**,:,***
'.: Ie;.,':!;,!: 1 1 110 1 'r 0 SRO-I NOR ;.
- \;. 3 I
- ' '.' ,e 1 :' .. ;" .. '. "/. <.*.***.i ., .. ' .."': "', I.J': 2 111 1 :.J 1, SRO-U I/C IIC ,~;;i;~ 1,3 , .. 2,3,9 ': ij*. ,.:.\. I.: *. :. *. ,. .: I:,,' , .....*. ,. 'yX 5 442 4 .:~ 2 MAJ ~~~'Jd 8 . ,',
7 " ,.',/ ,; ,,': .'.~ I';: ; I 'i.;: 1:>,\' 2 2221 ,,2 1
":a~i~i ;.,:,. .t;;
,/> 0022 TS ';'.'., .' i'.; ':/< I/};'.', .. ': .'.
IY; 0 .:'i.~ .*. 2 Ii' '.'
1~;~0~(;~.; .'ij~':. ;*
RX .", . *. , *******.i*. "
@ **,ii ii;:: '.,j *... ;. I,,":"'". J .',
I':.'{*
/;;
Q*
0* 1 1
T 1 ',00 SRO-l SRO-I NOR [f::rC:~):i ,~,:; 5 .' ;,t ;',:;'?:.' .~*,?~i;; It~';::J" ;;,:' '."
I~.il>; 1
,.;: 7 1 ;1' :1 SRO-U I/C I:::;Y{': CX'" 2,6, 7,9 4,5, 8 ;
,*.;;Y ..<:, I;:* I' ; .:.
,': l,.,. I~;
4 4. 2,
.\
MAJ 1",*,\:;1 (('(f. 8 ". 7 iii [,.\: **:*.****i*:*:**
I;',:: I." ". " ;: 1','( 2 2 2 1 TS [;~;;.y;,:
..: I J , r i"i,,'" ; ii,'
I .'
('
.. ' .. , , .'i: 0 0 2 2
.***.ii. I~:::, ::'f')i: " .'., I*," 1110 .". 1 0 RO RX 5 ,i'.', i I. I.": 1 1
SRO-l SRO-I NOR 5 ~l.
I .' '," Ii' * .,","" " ; I'
. I *. , i 2 111 1 1 1 I/C 1,2, ..... ;
I: :',1, 12 4 4 2
~~Y) .:/
3,6, 7,9 ;./ .., '.: .,: '
MAJ 8 :, .' . '., I .. ',:, :. '*.**'.....*.i "" ..' ; ' :',','" 2 221 2 2 1 TS 1,2, " '::','" :'
i, 7 0022 2 2 3,4 .i *.:*... '." ), I"," ) ,;,/ .......... .; '. i.
RO RX i;>*< .::',." .:t I:""'. ;",' ;.,' ,i. ' . ii, 0 1 110 1 0 i.<'.;: I.' *. ' . .':. ........**..*... . .,' .. ,.
1,(. .
NOR 1 :,' 1 . '.1.111 SRO-l SRO-I I/C 2,3, ',. :, '.j!
1 1 1 4442 4 2 9 i**.:.:;./ 1:;.< * . '.
4,5, 8,9 ';i'!
... I.*;,
II
"'X'.
I!':'~
)
'i>
,;i',.
6 MAJ :i!! 7 . ;
.', 'i'* " .' ".,;' 1 1 221 2 2 1 TS :' 2,4, ' ~~
- ";; i. ,;
- ; "
". 3 0022 2 2 Ji;.***.*** I:; ..... I. ,
. ; 5 .Ii :.'
Ii .... ;:
Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls at-the-controls (ATC)" (ATC) balance-of-plant (BOP)"
and "balance-of-plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be Significant significant per Section C.2.a of Appendix D. (*) (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 1-for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's applicants competence count toward the minimum requirements specified for the applicant's applicants license level in the right-hand columns.
ES-301, Rev. 9 Transient and Event Checklist Form ES-301-5 Facility: VC Summer Date of Exam: Exam:12112105 12/12/05 Operating Test No.:2005-301 A
A E Scenarios P V V
P E 1 2 3 4 T M C
A A
L FI N
N T
T
/-----c~R~E;:::;-W-;-;--+:::::C:;::::R:;:::E;-;-W;-;P:::-:O:::-:S:::-;IT::;:;I:;::::O~N+-C:-;:::R:-;:::E:;-:W-;-;:::-PO:::-S~I:::=T:-:::IO:7N*C::-::R::-::E::"":W:-:--="PO=S:=IT::-::IO::-:"N-:-l CREW POSITION CREW POSITION CREW POSITION CREW POSITION r o
0 T
A L
L N
M II N
II N
N Y S A B S A B S A A B S A B U U
T P R T 0 0 R T o0 R T o0 R A T o0 M(*)
M(*)
E o0 C P P o 0 C P o 0 C P o 0 C P R R I U
@) RX 1 0 NOR 1 1 1 SRO-I I/C 4 4 2 SRO-U 2 2 1 MAJ TS o 2 2 RX RO MAJ TS 1,2, I 3,4 RO RX 1 1 0 NOR 1 1 1 SRO-I IIC '.'; .. ... 4 4 2 SRO-U ...... ..... '
MAJ I****.* . . 2 2 1 TS ..... ......* i o 2 2 I, .' .
RO RX 1 1 0 NOR 1 1 1 SRO-I I/C 442 SRO-U 2 2 1 MAJ TS . ,., o 2 2 Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls at-the-controls (ATC)" (ATC) balance-of-plant (BOP)"
and "balance-of-plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component (IIC) (I/C) malfunctions and one major transient, in the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal
(*)
evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 1 -for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's applicants competence count toward the minimum requirements specified for the applicant's applicants license level in the right-hand columns.
ES-301, Rev. 99 ES-301, Rev. Competencies Checklist Competencies Checklist Form Form ES-301-S E5-301-6 Facility: VC Summer Facility: Summer Date of Date of Examination:
Examination: 12/12/05 12/12/05 Operating Operating Test No.: No.: 2005-301 APPLICANTS fRO (1 lZT"'RO )(3)(5) )Zf (1)(3)(5) Ø RO (2)(4) Li RO Li RO D
Li SRO-I Li SRO-I D D Li SRO-l SRO-I Li SRO-I D
D Li SRO-U D Li SRO-U J2J SRO-U (2)(3) .0" SRO-U (4)
Competencies SCENARIO SCENARIO SCENARIO SCENARIO SCENARK 11 2 3344 11 2 3344 11 2 3344 11 2 4 334 IInterpret/Diagnose nterpretlDiagnose 1,3, 2,3, 2,6, 4,5, 1,2, 2,3, 2,6, 2,3, Events and Conditions 7,8 6,7, 7,8, 6,7, 3,4, 4,5, 7,8, 4,5, 9 9 8,10 6,7, 6,7, 9 6,7, 8 8,9, 8,9, 10 10 Comply With and 1,3, 1,2, 2,5, 4,5, 1,2, 1,2, 2,5, 1,2, Use Procedures (1) 5,7, 5,6, 6,7, 6,7, 3,6, 4,5, 6,7, 4,5, 8 7,9 8 8* 8 7,8 6,7, 8 6,7, 5
S- I 8,9 8,9 Operate Control 1,3, 1,2, 2,5, 4,5, 2,5, Boards (2) 4,5, 3,5, 6,7, 6,7, 6,7, 7,8 6,7, 8,9 8 7,8, 9 9 Communicate 1,3, 1,2, 2,5, 4,5, 1,2, 1,2, 2,5, 1,2, and Interact 4,5, 3,6, 6,7, 6,7, 3,4, 3,4, 6,7, 3,4, 7,8 7,9 8,9 8,10 6,7, 5,6, 8,9 5,6, 8,9 7,8, 7,8, s;j 9,10 9,10 Demonstrate 1,2, 1,2, 1,2, 1,2, 1,2, 1,2, Supervisory Ability (3) 3,5, 3,4, 3,4, 6,7, 5,6, 5,6, 8,9 7,8, 7,8, 9,10 9,10 Comply With and 11,2,
,2, 2,4, 2,4, Use Tech. Specs. (3) 3,4 5 5 Notes:
(1)
(1 ) Includes Technical Specification compliance foran Includes for an RO.
(2) Optional for an SRO-U.
(3) Only Only applicable to to SROs.
SROs.
Instructions:
Check the applicants applicants' license type and and enter enter one oror more event event numbers that will allow allow the examiners examiners to evaluate evaluate every every applicable competency competency for every every applicant.
ES-301, Rev. 9 Competencies Checklist Form ES-301-G ES-301-6 Facility: VC Summer Date of Examination: 12/12/05 Operating Test No.: 2005-301 APPLICANTS EIRO RO 0DRO RO 0DRO RO 0DRO RO o SRO-I 0 SRO-I SRO-l SRO-I 0 SRO-I JZI' SRO-U (1) 0El SRO-U 0i SRO-U 0zi SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO 1
1 2 3 344 1 1 2 3 34 4 1 1 2 3 34 4 1 1 2 3 344 Interpret/Diagnose 1,2, 1 ,2, 4,5, Events and Conditions 3,4, 6,7, 6,7, 8,10 8
Comply With and 11,~
,2 4,5, Use Procedures (1) 3,6, 6,7, 7,8 8 Operate Control 4,5, Boards (2) 6,7, 8
Communicate 1,7, 1 ,z! 4,5, and Interact 3,4, 6,7, 6,7, 8,10 8,9 Demonstrate 1,2, 1 ,2, Supervisory Ability (3) 3,5, 6,7, 8,9 Comply With and 1,2, 1 ,2, Use Tech. Specs. (3) 3,4 Notes:
(1))
(1 Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
applicants license type and enter one or more event numbers that will allow the examiners Check the applicants' to evaluate every applicable competency for every evenj applicant.
ES-401 ES-401 Written Written Examination Examination Quality Quality Checklist Checklist Form Form ES-401-6 ES-401-6 I IFacility:
"lilly: £/,;1 1...- 5U/?1fYlt5'l 5f// Date of Date of Exam:
Exam: 0 IftcyO C Exam Level:
Exam Level: RO SRO 0 RO /kfSRO El Initial Initial Item Description Item Description aa b*
b* c#
1.
- 1. Questions and answers are technically accurate accurate and applicable applicable to the facility. 1',v//l 1111 ~
? tilfJ @
2.
- 2. a.
- a. NRC KlAs NRC K/As are referenced referenced for all all questions.
b.
- b. Facility learning Facility learning objectives are referenced referenced as as available.
available. N
- 3. SRO questions are are appropriate appropriate in in accordance with Section D.2.d D.2.d of ES-401 ES-401 /11/1 i4 1II1fl-sn//fr IV/A /4
- 4. process was random The sampling process random and systematic were repeated from the last 2 NRC licensina systematic (If (If more more than 4 RO RO or 2 SRO questions licensing exams, consult the NRR OL proQram program office).
I>}> !;.C>:;~~ (j) ~ I
- 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ the audit exam was systematically and randomly developed; or
_ the audit exam was completed before the license exam was started; or
.the examinations were developed independently; or
......-the
( 1'1j/, (jj.l G
_ the licensee certifies that there is no duplication; or
_ other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only a c--. 111IA ~
i /
fh 22/').11 question distribution(s) at right.
C/
1--1Wll ,. J.. tfl.lJ.f.,
- 7. Between 50 and 60 percent of the questions on the RO Memory C/A CIA exam are written at the comprehension/
comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly ,2 IVII @
selected KlAsK/As support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at riQht. right.
3/// / V/AZL/I,% 'It.( // 5"1~
y.y C" C
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors. G "'IA As/, ~
Question content conforms with specific KIA K/A statements in the previously approved 9.
examination outline and is appropriate for the tier to which they are assigned; t. "IA/,4 3,1/
fjJ deviations are justified.
iustified.
10.
- 10. Question psychometric quality and format meet the guidelines in ES Appendix Aooendix B. e 1 dIIM (jJ 11.
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees aQrees with the value on the cover sheet.
L i/A t t4JA @
c::
Printed Printed Name / Signature , l' .~ Date
- a. Author ml1A"l- A c,/f/ 7/7 / ~f::;!£~ oy£>~P6*
- b. Facility Reviewer ((*)) #/A H/A
- c. NRC Chief Examiner (#)
NRC (#) .:5Tt.!I/t.I,,,; 7.
Tdt,V "P. io,t K.c~~ / / Jff§-'
d.
- d. NRC NRC Regional Supervisor Supervisor J.ie.s /1.
.jtl/Me'S 1-1. /1 jVt",,,~
o 4 cf .. :rr,.......,~I--l (f it-r ........
i_[ /1Ltr ~
\
V The facility reviewers reviewer's initials/signature are Note:
Note:
- The are not not applicable applicable forfor NRC-developed NRC-developed examinations.
- Independent Independent NRCNRC reviewer reviewer initial initial items items inin Column c; chief Column "c"; chief examiner examiner concurrence concurrence required.
reauired.
+ PM 1 c h I aw774cr ceW'TJ4c.rif 11>'" i/c/ou I .:; 0" N. 1/1 . /1 tJfocc.
ES-401, ES-401, Page Page 29 29 ofof 33 33
wCl)
ES-401 0 4-4-
Iii C
a) x 0 E 0 4-,
Written Examination Quality Checklist 0 a 0 C) a) 0 LL Form ES-401-6 0 I E w U)
Facility: t/?C Date of Exam: {);j/o/O{ Exam Level: RoDsRO~
Initial Item Description a b* c'
- 1. Questions and answers are technically accurate and applicable to the facility. e /'1M t1i!
- 2. a.
b.
NRC KlAs are referenced for all questions.
Facility leaming objectives are referenced as available. ~ ~/A di
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). ~~'1i~~'; 1~~~">~~" fiJ
- 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ the audit exam was systematically and randomly developed; or
_ the audit exam was completed before the license exam was started; or C-.. "'/A- (j)
...£...-the examinations were developed independently; or
_ the licensee certifies that there is no duplication; or
_ other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest (fjj new or modified); enter the actual RO / SRO-only question distribution(s) at right.
'-j /jc,j, oC-
-) / /.()~" 16/ bY;
~ "'/11
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly C-- 1'1/,4 ~
selected KlAs support the higher cognitive levels; enter /1 / "NJ, /'1 /'56/.
the actual RO / SRO question distribution(s) at riQht.
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors.
e.- N/A (/j]
- 9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; N/A deviations are justified. ~.
- 10. Question psychometric quality and format meet the Quidelines in ES Appendix B. t!-- "'/A ~
t!.. ft}
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. "lit Printed Name / Signature _ Date
- a. Author /J1I9Rk A. C!-IITry /
- IA
~/d'~
. v o;/o,;0x:
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#) S-nEvtl'll 1:::.. i<.q.sl! / .J" r;IriTM/~ ... ih7o~
- d. NRC Regional Supervisor .1 "WI!'!;. [{. fi\ 00 r iMa.I(, <tl::> f- ~ {-t. frf.--- ,,., I-b-Ob Note: '"
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
C/) C a 0 uJ ES-401, Page 29 of 33Cu 0) c.J ci) 0, C)
D x-i ES-401, Rev. 9 ES-401, Examination Review Written Examination Review Worksheet Form ES-401-9 ES-401-9 1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws Job Content
- 4. Job Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q# LOK Q# LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues TIE T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1 #1 Back-Back- Q= SRO U/E/S Q= SRO U/EIS Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units K/A Only KIA Only Instructions Instructions
[Refer to Section D D of ES-401 ES-401 and Appendix B B for additional information regarding regarding each of the following concepts.]
1.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
E*nter
- 2. Enter the level of difficulty (LOD) of each question using a 11 - 5 (easy - difficult) rating scale (questions in the 224
- 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (Le.,(i.e., clues, specific determiners, phrasing, length, etc).
- . The answer choices are a collection of unrelated true/false statements.
- . The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (Le., (i.e., the question has a valid KIA K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., (i.e., it is not required to be known from memory).
- . The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- . The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved KIA K/A and those that are designated SRO-only (KIA (K/A and license level mismatches are unacceptable).).
unacceptable
- 6. Based on the reviewers reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7. At a minimum, minimum, explain explain any "U" ratings (e.g.,
any U how the Appendix (e.g., how Appendix BB psychometric_attribute psychometric attributes are not being met).
met).
11 FF 1 x X U U 001A2.03: Question does not test the K/A. KIA. The question question does does not have aa malfunction that has to be mitigated. LOD too low for this K/A KIA in that there is no malfunction and the operator just needs to know that this condition is expected and no action is required.
H H 2 S Question replaced. The new new question question is satisfactory. The question question test CIA level with aa LOD=2.
at the C/A at LOD=2.
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q# LOK Q# LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F T/F Credo Partial Job-Cred. Partial Minutia #1 Job- Minutia #1 Back-Back- Q=
Q SRO U/E/S SRO U/E/S Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units K/A Only ward KIA Only 22 H H 2 X X X XX U U 002A4.08: Distractors Distractors A and B not credible in that with a break B are not break of the the high pressure high pressure tap (Le.(i.e. an SBLOCA) that continued plant operation would not be affected. The stem does not need to state state that all RCPs RCP5 are running atat 90% power, that is is aa given given for this power level.
level. Suggest Suggest changing the changing stem to have the stem have the the high high pressure pressure tap tap become become clogged clogged or modify the question to have modify have a lowlow pressure tap become become clogged clogged and ask what the indications would be. The question does not test the KIA K/A in that the question asks what will happen with the plant vs the ability to operate and/or monitor the safety parameter display.
HH 3 S Question replaced. The The new question is satisfactory. The question test C/A level with a LOD=3.
at the CIA 3
3 H H 3 X X X
~
E 003A4.01: Distractors A and B are essentially the same since a decrease in #1 seal DIP D/P can only be caused by low RCS pressure or #1 seal failure. The stem should only state what is available to the operators, to state that the standpipe is verified high, how is this done? In the stem seal return flow" change "seal flovl to "sealleakoff flow"," at VC Summer seal seal leakoff fIo, return flow is called seal leak off flow. In the stem state which annunciators have alarmed, this adds operational validity.
S Question has been corrected. SA SAT T 4
4 F F 4 X E OO3AK1.17: This question is testing the GFE knowledge of Rx Physics 003AK1.17:
but is dead on the K/A. KIA. Suggest Suggest changing distractor B B to be the opposite of answer A.
S Question has been corrected. SAT SA T 55 HH 2 X UU 004G2.4.49: The conditions established in this question do not REQUIRE immediate irnmediate operator action which is required to be tested by the K/A.
KIA. The question question test what the system system will dodo without operator action vice the required operator action.
F 22 S Question hashas been been replaced. New question question is satisfactory.
satisfactory. The newnew question question tests at at the memory memory level with a L.OD=2.
LOD=2. SAT SAT 66 HH 33 X X EE 005AA2.03: Stem Stem needs to be changed to state that the rods did did not move move when bank D when bank D vs vs any "any Rod Rod Bank.
Bank". The The AOP AOP forfor stuck stuck rods rods does does not not allow allow going going toto any any other other banks banks other other than than the the one one the the stuck stuck rod rod is is in.
in.
S Question has Question has been been corrected.
{ 1 R\... I.
2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Content Flaws Job Content Flaws \ -3r 6.
- 6. 7.
7.
I OK
,-OK LOD LOD '
(F/H)
(FtH) (1-5)
(1-5) Stem ICues Stem Cues T/F TtF Cred. Partial Credo Partial Job- Minutia #t Job- Minutia #/ Back-Back- Q= SRO UtEtS Q= \SRO U/EIS Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units ward KiA K/A Only Only 77 FF 22 SS 005K6.03: No 005K6.03: reference material No reference material provided provided for verification of for verification of the the correct correct answer.
answer.
88 HH 33 X X XX EE 006K4.11: The 006K4.11: wording in The wording in the the stem, stem, "Which Which ONE ONE of of the the following following is is correct? needs correct?" needs to be be changed.
changed. Having Having the wording this way makes makes distractor B correct, since the distractor B B also correct, B statement is is true. "Which Which one of the following explains why the the SI signal could not be reset?"
reset?
S Question Question has been corrected. SA SATT 99 HH 33 X EE 007A2.05: Distractor 007A2.05: Distractor A A is correct in is partially correct in that, the alarm alarm is is expected expected for the PRT conditions.
S Question has been corrected. SA SAT T 10 10 FF 2 X EE OO7EK1 .05: Change distractors so all cover the same amount of time.
007EK1.05:
Supporting information found states that SR should not energize until at least 15 minutes after a trip, therefore, change answer C to 15-17 minutes, and distractor D to 20-22 minutes.
S Question has been corrected. SA SAT T 11 11 H H 2 X UU 007K1 .01: There are two correct answers. Both Band 007K1.01: B and C can be considered correct based on the facility reference material. The reference material states that the PRT rupture disc is set to release at 86-100 psig with a nominal release of 91 psig. This information makes two of the answer choices arguably correct with B B being the best answer vice C as marked.
S Question has been corrected. The stem has been modified to state the maximum pressure that could be reached in the PRT.
12 12 H H 33 X X EE 008A3.06: Suggest modifying the question to get aa better K/A KiA match. In the stem the CCW dicharge pressure to 40 psig and the amps are increasing (pump impeller binding). This will make distractordistractor A correct and ensure that the question question tests the automatic actions as required by the K/A.
KiA.
S Question has been corrected. SAT SA T 13 13 H H 22 X X UU 008AG2.4.49:
008AG2.4.49: Question Question does does not not test the K/A.
KiA. The The question question doesdoes notnot test test any aspects of any aspects of operation of of system system components components or or controls.
controls.
H H 2 5S UUBAG2.4.4:
008AG2.4.4: K/AKIA was changed. New question question was developed developed for this K/A.
KIA. The newnew question is Satisfactory. The question tests at the C/A CIA level with a L0D2.
LOD=2.
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOO (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem T/F Cues T/F Credo Partial Job-Cred. Partial Job- Minutia #1 Back-Minutia #1 Back- Q= SRO Q SRO U/E/S U/E/S Explanation Explanation Focus Focus Dist.
Oist. Link Link units ward units K/A Only ward KIA Only 14 14 H H 2 X X U U Distractors C and 0D are not 010G2.4.4: Oistractors not credible. The detailed instrument readings instrument readings provided provided in the stem (i.e. all pressure pressure instruments instruments reading and trending the same) makes C and 0D distractors implausible.
Suggest changing the Suggest changing the stem stem to state state that that one one of of the PZR PZR pressure instruments is instruments is indicating indicating aa failed high high channel.
channel. Adding Adding this this information information tot stem adds the stem adds credibility to distractors C C and 0D and makes the question C/A vs Mem.
a CIA H
H 2 S Question has been replaced. The new question is Satisfactory. The question tests at the CIA C/A level with a LOD=2.
LOD2.
15 15 F F 2 X X E OI1EK2.02:
011 EK2.02: Stem provides teaching. Reword the stem to read that EOP 1 0 is in progress.
EOP-1.0 progress "WOOFWOOF is the reason for RCP trip criteria under the above conditions?"
9 With a Large Break LOCA, conditions LOCA the RCS will depressurize to less than 1400 psig which is RCP trip criteria for the distractor 0 D reason. Change the stem to state that a MS line break has occurred.
S Question has been corrected. SA SATT 16 16 H H 2 X X U U 012A4.03: Question does not match the KIA. K/A. The question does not address any aspects associated with RPS channels being blocked or bypassed.
FF 2 S Question has been replaced. New question from a previous NRC exam (year 2000). The new question is Satisfactory. The question tests at the memory level with a LOD=2.
17 17 FF 22 X X EE 01 2K2.0i: Distractor 012K2.01: Oistractor D 0 is not credible in that the loss of one power supply would result in the loss of P-6. Suggest changing distractor D 0 to read A low power rod block, C-i, "A low C-1, signal with no no change in reactor power." Could not find supporting power. supporting reference material to verify the answer as as correct.
S Question Question has has been been corrected. SAT SA T 18 18 FF 11 X X UU 01 3K1 .06: Question does 013K1.06: not test the does not the K/A. The question KIA. The question tests tests the operation characteristics of an MDV. MOV. The question LOD LOO is too low low to be included included on aa license license operator operator exam, this is is more more of an NLO NLO fundamentals question.
question.
FF 22 S Question has Question been replaced. The new has been new question question isis satisfactory.
satisfactory. The question question tests tests at at the the memory memory level with aa LOD=2.
level with LOD=2.
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Content Flaws Job Content Flaws Other
- 5. Other
- 5. 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job-Job- Minutia #1 Back-Minutia #1 Back- Q=
Q= SROSRO UIEIS utE/S Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units ward K/A Only KIA Only 19 19 H H 22 X X EE 015AK1.02:
01 5AK1 .02: Conflicting information in Conflicting information in the stem.
stem. The The stem states thatthat power power is is at 35% which makesmakes distractor distractor B B correct.
correct. The stem stem also also states states that P-8 P-8 isis not not lit, indicating that power power is is above 38%, which makes A the correct answer. The applicant is make a decision that one of is forced to make these two pieces pieces of information is incorrect. NothingNothing else in the stem indicates that which piece of information is correct, therefore, either can indicates be argued as correct.
S Question has been corrected. SA SAT T 20 F F 2 X E 017K1.01: Distractor C is not credible. Remove the word "second" second from distractor C. II believe this question is at the memory level, not CIA C/A as labeled.
S Question has been corrected. SA SAT T 21 21 F F 2 S 022A1.04 22 22 HH 3 X E 022AA 022AA11.08:
.08: Distractor C is not plausible. Suggest changing to read "VCT VCT rate of level decrease would remain unchanged from preevent." preevent.
S Question has been corrected. SA SAT T 23 F F 2 X E 022K3.02: Add to the stem to solicit the reason why the parameter changes.
S Question has been corrected. SAT SA T 24 24 F F 2 X E E 024AG2.4.6: Stem lacks credibility, in that, why are the PORV block valves shut? How How would they have been shut under these conditions?
Need to provide reference material Need material that supports the correct answer.
H H 2 S Question has been modified. The question now tests at the C/A Question CIA level with a LOD=2. The question is Satisfactory.
25 25 FF 22 X EE 025AG2.1.32:
025AG2.1 .32: Distractor D 0 is not credible. The loss of CCW CCW flow flow to to the the HX would never HX never affect the SI flow path.
the SI path. Suggest Suggest replacing this this distractor distractor with with something aboutabout heat heat added added to to the the system system from from the the RHR RHR pump pump could cause boiling on the CCW CCW side of the RHR HX.
S Question has been corrected. SAT SA T
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws Other
- 5. Other
- 5. 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem T/F Cues T/F Cred. Partial Credo Partial Job-Job- Minutia #1 Back-Minutia #1 Back- Q=
Q SRO U/E/S SRO U/E/S Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units K/A Only ward KIA Only 26 26 H H 2 X X U U 026AA1.01: The question stem is is confusing. Has the RCP A CCW TEMP HI HI annunciator been in for 5 days days without thethe plant plant fixing the problem? Not Not sure it can be said that that the CCW HX HX outlet temperature decrease due will decrease due to lower flow. The lower flow through the cooled cooled components would cause components cause the CCW CCW HX HX inlet inlet temp temp toto be be higher.
higher. Suggest Suggest this question be this replaced.
be replaced.
F F 3 S Question replaced. Question now tests at the memory memoty level with a LOD=3. SAT SAT 27 27 HH 3 X E 026K2.02: Stem needs to state "UnderUnder the above conditions when the RWST LO-LO level annunciator is received which one of the following correctly describes the affect on valves MVG-3004?"
MVG-3004?
S Question has been corrected. SA SAT T 28 28 F F 2 X U 026K3.02: Question does not match the KIA. K/A. Question asks about loss of the RWST suction source to the SI pumps. KIA K/A requires testing for the loss of the Containment Spray System affect on the recirculation SPRAY system.
H 2 S 026K3.O1: KIA 026K3.01: K/A was changed. Question was developed for this KIA. K/A. The Question is Satisfactory.
Satisfactoiy. The Question tests at the CIA C/A level with a LOD=2.
29 29 HH 3 X E 027AK1.02:
027 AK1.02: Add to the stem "associated associated with the above events?"events?
S Question has been corrected. SAT SA T 30 30 H H 33 X EE 064K6.08: Distractor D 0 can be considered partially correct. The EDG will run for an additional 30 at full load (per the reference material),
however, 60 minutes of run time may may be possible ifif the EDG EDG is not fully loaded. A better distractor would be to have the crew immediately secure the EDGEDG oror perform actions actions to reduce the EDG load load to increase the run time.
S been corrected. SAT Question has been SA T 31 31 FF 33 X EE 034A1 034A 1.02:
.02: No reference provided for verification of correct answer or plausibility of distractors.
distractors. T.S. basis basis has aa different different reason for minimum level level in the refueling canal.
S Question has Question has been been corrected. SAT SA T
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws Other
- 5. Other
- 5. 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem T/F Cues T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
Dist. Link Link units ward units ward K/A Only KIA Only 32 32 H H 3 X X UU question does not 035K6.02: The question not test the KIA.
K/A. The KIAK/A is is the effect of a loss or malfunction malfunction OF A PORV PORV on on the Steam Generating System. This question has no malfunction of a PORV PORV but but rather rather an an instrument that fails and fails and has has no effect effect on on the PORV. NO correctcorrect answer answer is annotated.
annotated.
HH 2 S Conditions in Conditions in the the stem have have been changed changed toto establish establish aa KIA K/A match.
The LOD of the question has decreased to a LOD=2. LOD2. Question is now SAT.
33 33 H H 2 X X E 038EK3.08: Distractor A is not credible. RCPs RCPs are never secured due to subcooling decreasing below 50F. Subcooling has not even decreased below 50F, the lowest it will go is 52F even when the target temperature is reached. Suggest changing the reason for distractors A and B.
S Question has been corrected. SA SATT 34 34 H H 2 X X X X X X UU 039A1.10:
039A 1.10: Procedure transition knowledge may be argued as SRO only.
II think the crew will enter AOP-112.2 AOP-1 12.2 first without going to AOP-1 01.1.
However, this transition aspect of the question is not needed to match the KIA.
K/A. There are some partially correct answers depending on the time frame. Eventually the plant will be shut down per the AOP and activity level will decrease. With continued operation eventually activity equilibrium will be reached and activity level will stabilize. These assumptions that need to be made, make other distractors partially correct.
HH 2 5S Question has been replaced. The new question is satisfactoiy.satisfactory. The question tests at the C/A CIA level with aa LOD=2.
35 35 FF 11 U U 040AK2.02: Level of difficulty is too low low to provide any discriminatory discriminatory value.
H H 2 5S Question replaced.
replaced. The new question tests at the C/A CIA level with aa LOD=2.
LOD=2. SAT 36 H 36 H 33 X X EE 045K5.17: ThisThis is is primarily primarily GFE GFE knowledge.
knowledge. Stem Stem modification modification necessary necessary to to ensure ensure that power change change isis significant enough enough to to cause the desired desired effect.
S Question has been corrected. SAT SA T 37 37 HH 33 XX EE O51AA1.04:
051AA1.04: Reference Reference material material contradicts contradicts the the answer. Rewording of answer. Rewording of the the distractors distractors may may bebe helpful.
helpful.
SS Question has Question has been corrected. SAT been corrected. SA T
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem T/F Cues T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
- 1 Back-Back- Q=
Q SRO SRO U/E/S U/E/S Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units K/A Only ward KIA Only 38 38 H H 2 X E E rewording one of the distractor to have the trip 054AK3.01: Suggest rewording breakers open so that the answer is breakers is not not the only one that has has this.
S Question Question has been corrected. SA SATT 39 39 H H 22 X X U U 055EA2.05: Stem 055EA2.05: Stem is is not not credible.
credible. The The facility facility would notnot take take aa battery battery OOS for maintenance OOS maintenance at 100%
100% power, this is is aa 22 hour2.546296e-4 days <br />0.00611 hours <br />3.637566e-5 weeks <br />8.371e-6 months <br /> hour T.S. Material Material reference is a total loss of all AC power, however the B EDG is not addressed therefore, you have to assume it started. Are the DC trains cross connectable? II do not not think that the loss of one of the batteries makes the other battery discharge twice as fast.
FF 2 5 S Question has been replaced. New question is satisfactory. The new question tests at the memory level with a LOD=2. SA SATT 40 40 H H 3 X E 056G2.1.28: Wording of distractor C should be changed to state "starts starts A. Currently it is a subset of distractor D. This is not a memory only A."
level question as stated, since it requires multiple pieces of information to answer.
S Question has been corrected. SAT 41 41 H H 3 X E E 057AG2.4.4:
057 AG2.4.4: Currently this question provides information that aids in the answering of Question #39, KIA K/A 055EA2.05. Suggest removing the voltage values from the distractors BandB and C.
S Question has been corrected. SA SATT 42 42 H H 33 X U U 058AA2.01: There are two correct answers. Both A and B B are correct for the conditions in the stem.
2 S Question has been corrected. Question now test at a LOD=2. SAT 43 43 FF 22 SS 059G2.1 .23: Question is marked as C/A 059G2.1.23: CIA but question question test at the memory memory level.
44 44 HH 33 X EE 061 061 K5.03:
K5.03: Suggest changing changing distractors distractors C C and and D 0 to add add more more credibility.
Mark Mark this question question as CIA, currently itit is as C/A, is not not marked.
marked.
S has been Question has been corrected. SATSA T 45 45 HH 33 SS 062A2.06: Misspelling in distractor B. B.
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F TIF Credo Partial Job-Cred. Partial Job- Minutia Minutia #1
Dist. Unk Link wd KIA units ward K/A Only 46 46 F F 3 X EE 062A3.04: Distractor Distractor AA does not not seem plausible, change distractor A A the read "It read It should light immediately and and indicates charged capacitors."
capacitors.
Could not definitively identify from the reference material provided that C correct answer.
is the correct answer. Need the facility facility to determine.
determine.
S S* Question has been Question been corrected.
corrected. Still Still need the the facility facility to to verify answer.
47 47 F F 2 2 S 062AA11.07:
062AA .07: If If need this question can be modified by changing the answer to be a low CST level within 60 second of an ESFAS ESFAS actuation.
48 48 F F 2 X X E 063K4.01: Distractor A is not credible since the physical connection does not exist. Suggest changing "1 1 DA2X" DA2X to "11 DB2Y."
DB2Y. Add to the stem assume no operator action.
S Question has been corrected. SA SAT T 49 49 HH I 1 UU 064K6.07: The LOD of this question is too low and therefore, provides no discriminating value. This is due mostly to the wording of the correct answer. The answer needs to be reworded to be not so obvious. obvious, It would also help to change at least one of the distractors to include another air related choice.
H H 2 S Question has been corrected. LOD=2. SAT SA T 50 50 H H 2 2 X UU 065AK3.04: The question does not match the KIA. K/A. The KIA K/A tests the reason the question only tests what happens.
F F 2 S Question has been corrected. The question stem was changed to include the reason. Question now tests at the memoiy memory level with aa LOD=2. SAT 51 51 FF 2 SS 071 K3.05: Distractors should be reworded to be more consistent with each other.
other.
52 52 HH 33 X EE 072K4.03:
072K4.03: Some work work needed needed to to increase increase plausibility of of the distractors distractors and and to to make make the distractors distractors more more uniform uniform and and balanced.
balanced.
S Question has been corrected. SAT SA T
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD--
LOD (F/H)
(F/H) (1-5) Stem Cues (1-5) Stem Cues T/F T/F Credo Cred. Partial Partial Job- Minutia #1 Job- Minutia #1 Back-Back- Q= SRO Q= SRO U/E/S U/E/S Explanation Explanation Focus Focus Dt.
Dist. Unk Link units ward KIA Only 53 53 FF 33 X X X EE 073K5.03: Need Need correct correct annunciator annunciator nomenclature nomenclature in in the stem. Change Change to the stem to to read read "primary primary reason."
reason. Distractor Distractor CC is is not not credible.
credible.
Change Change distractor C to read: read: "Surveys Surveys are used used to determine determine the extent of the failed fuel."
fuel. This is is actually done through RCS RCS sampling. The question is marked as CIA is currently marked C/A but but tests at the memory level.
level. This question can be considered modified vs bank.
S Question has been corrected. SA SATT 54 HH 3 X X U 075K2.03: Question does not match the KIA. K/A. The question test Component Cooling Water power supplies, the KIA K/A requires testing Circ Water System Service Water Pump power supplies.
F F 3 S Question has been replaced with a satisfactory question that meets the K/A. This question now test at the memory level with a LOO=3.
KIA. LOD=3. SAT.
55 55 HH 3 X X U 076A 076A11.02:
.02: Question stem does not follow the procedures and plant functions. There is no procedure guidance that directs having to establish flow through the idle RBCU in the A train only training guidance. At step 4 of EOP-17.0, EOP-1 7.0, as long as there is flow in at least one train, which the stem states there is, no additional action is needed by the crew in this area.
S Question has been corrected. SA SATT 56 56 H H 3 X X X X U U 076A3.02: Question does not really meet the K/A KIA in that the KIAK/A requires testing the ability to monitor monitor automatic actions actions and and there are no no automatic automatic actions actions that occur. Currently the stem provides too definate of a cue to the correct answer in stating that A train SW is inoperable. This information is not pertinent therefore, remove it and state that the train maintenance.
has been returned to service following maintenance.
S Question has Question has been been corrected. SATSA T 57 57 HH 22 X X X X EE 078K4.01:
078K4.01: The The question question does does not not test test the K/A in that the questions KIA in questions tests tests automatic function but not the automatic not the interlock interlock that which provides for for the manual/automatic transfer of of control. This This question question can be be easily easily corrected by modifying the stem stem to state that the operator has has taken the A
'A' IA Comp switch IA Comp switch to NORMAL-AFTER-STOP NORMAL-AFTER-STOP when when the breaker trips.
This will This defeat the will defeat the auto auto start start function function and and the the compressors compressors must must bebe manually started.
manually started. The The stem stem should should have have the the switch switch positions positions in in all all caps.
caps.
S Question has Question has been been corrected.
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
Dist. Link Link units ward units ward K/A Only KIA Only 58 58 FF 22 X E E I 03K3.02: The answer 103K3.02: answer isis not not credible credible in in that with the plant plant in in Mode Mode 4 thethe facility would notnot allow removing removing thethe equipment equipment hatchhatch to to inspect the 0-inspect the ring. Removing ring. Removing the equipment equipment hatch hatch alone alone is is aa loss loss of containment integrity.
integrity.
S S Question Question has been corrected. SA SAT T 59 59 F F 3 X X E G2.1.1: The stem should state that the plant has stabilized at 200F. The question is marked as a C? But tests at the Memory level.
S Question has been corrected. SA SAT T 60 60 F F 11 X X X X U G2.1.17: The question difficulty level is too low. Stem focus is needed to ensure that the communications required are lAW facility procedures.
The distractors are not credible, A is the only distractor that lists the S/G pressures and trends.
FF 2 S G2. 1.3: KIA G2.1.3: K/A was changed. New question was developed for this KIA. K/A.
The new question is Satisfactory. The question tests at the memory level with a LOD=2.
61 F F 2 X X X X U U G2.1.29: The stem should state that this is being performed as part of a Routine system lineup verification.
"Routine verification." Currently there are two correct answers, distractor B is correct in that this is an acceptable way per SAP-i SAP-153. 53.
H H 2 5 S Question has been corrected. The question now tests at the CIA C/A level with aa LOD=2. SAT SA T 62 62 FF 3 X X X X EE G2.2.11: Stem should be modified to state lAW SAP-139. Distractor B ii~
G2.2.i1:
partially correct since the 30 day approval is within 90 days. Add to "to occur anytime anytime" to each of the distractors. This question question can be easily modified to create better distractors.
S Question has Question has been corrected.
corrected. SAT SA T 63 63 HH 33 X X EE G2.2.25: Distractors need G2.2.25: need toto be be changed changed to to be be more more consistent consistent with with the the wording in in the TS bases bases and and avoid avoid being being partially partially correct. Question Question is currently marked as a Memory Memory level level question question but tests at the C/A CIA level.
level.
S Question has has been corrected. SAT SA T 64 64 FF 22 SS G2.2.28 G2.2.28 65 65 H H 33 XX EE G2.3.i:
G2.3.1: AddAdd toto the the stem stem approval/notification "approval/notification" vicevice approval.
"approval."
SS Question has Question has been been corrected.
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LCD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F T/F Credo Partial Job-Cred. Partial Minutia #1 Job- Minutia #1 Back-Back- Q= SRO Q= SRO U/EIS U/E/S Explanation Explanation Focus Focus Dist.
Dist. Link Link units ward units ward K/A Only KIA Only 66 66 H H 4 S G2310 G2.3.10 67 67 H H 2 X X E E G2.4.15: Distractor Distractor C is partially correct in that the reference material does not does not state state to to not not to to cool down at cool down at the the maxmax rate rate if communications communications are are not available.
not available. The The reference reference material material states states that that aa slower slower rate rate is is acceptable based acceptable based on available communications therefore, since the stem does not provide amplifying information, C can be considered considered as correct.
S Question has been corrected. SA SATT 68 68 F F 22 X X U U G2.4.32: This question requires a knowledge level beyond that of the RO RO with the determination that EAL thresholds have been exceeded.
H 2 S G2.4.2: KIA K/A was changed. The new question is Satisfactory. The question tests at the CIAC/A level with a LOD=2.
69 69 H H 2 X X X X U U W/EO4EA2.1:
W IE04EA2.1: The stem does not represent a logical sequence of the progression through EOP-1.0.
EOP-1 .0. Why would the crew be positioning valves in Attachment 3 when the transition is made to EOP-15. EOP-15 EOP-1 .0 is completed. If this is a LOCA outside can not be entered until EOP-1.0 containment the crew would most likely have transitioned to EOP-2.5 at EOP-1 .0 (I would think the crew would have transitioned to step 23 of EOP-1.0 EOP-2.5 at this step answer D). Why are only one Charging pump and one RHR pump running? Was there a problem with the SI actuation?
K/A statement wording is incorrect.
KIA H 2 5S Question replaced. The new question is satisfactory. The question test at the C/A CIA level with a LOD=2.
70 70 FF 33 X X EE W/EO7EK3.2:
W/E07EK3.2: Redundant information in the stem, remove assuming "assuming the crew made the correct decision decision" from the stem. In answer B, change verifying "verifying" to verifying/establishing.
"verifying/establishing." K/AKIA statement wording is incorrect.
incorrect.
S Question has been been corrected. SAT SA T 71 71 FF 22 XX UU W/EO9EG2.4.49:
W/E09EG2.4.49: Distractors Distractors C and and D D are are notnot plausible. Distractor Distractor C Cis is not aa reference page action for EOP-1 EOP-1.3 .3 or any other EOP,EOP, therefore it is not not plausible. The The is is no information in the stemstem that would indicate indicate distractor D as aa reasonable choice, D as choice, therefore distractor distractor D D is is not not plausible.
plausible.
S Question hashas been been corrected.
corrected. SAT SA T 72 72 H H 22 SS W/EIOEK2.2:
W/E10EK2.2: K/A KIA statement statement wording wording is is incorrect.
incorrect.
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOKLOD LOK LOD (F/H) (1-5)
(F/H) (1-5) Stem Cues Cues T/F T/F Cred. Partial Credo Partial Job- Minutia Minutia #1 Back-Back- Q=
Q SRO SRO utE/S U/E/S Explanation Explanation Focus Focus Dt.
Dist. Unk Link wd units ward A Only KIA Oy__
73 H H 3 X E W/E12EK2.1: Distractors A, BandB and C lack some credibility in verifying adequate core flow and wide range S/G SIG level. Modify these distractors to include SI termination criteria from EOP-1.
S Question has been corrected. SA SAT T 74 H 4 S W/E13EK2.2 75 75 H 3 X E W/E15EK3.3: Not enough information in the stem to definitively state that there is a leak vs a pump trip. Need to provide a time line for increase sump level rise or provide RBCU flow readings.
S Corrections have been made to the stem. The information added to the stem allows the applicant to figure out that the RB sump should not be increasing. Question is SASAT.
T.
ES-401. Rev.
ES-401, Rev. 99 22 Form Form ES-401-9 ES-401-9 1.
- 1. 2.
- 2. Psychometric Flaws
- 3. Psychometric Flaws Content Flaws
- 4. Job Content Flaws 5. Other 6. 7.
7.
Off Q# LOK LOK LOD (F/H)
(F/H) (1-5) TIF Stem Cues T/F Cred. Partial Credo Partial Job- Minutia Minutia #1
- / Back- Q= SRO Q= U/E/S U/E/S Explanation Focus Focus Dist. Link Link units ward K/A Only KIA 1 H H 22 X X X E E 002A2.04: Change 002A2.04: Change the stem stem to to state state that that RWST RWST level level has has decreased below 18%
below 18% to ensure ensure the transition is is required.
required. Currently Currently with the RCS RCS
@ 18%, at this moment in time, a procedure transition is not required so distractor A could be argued as correct.
S Question has been corrected. SA Question SATT 22 H H 2 X X X E 003A2.03: In the stem add lAW AOP-117.1. Stronger tie to the KIA K/A (use procedures to correct/control/mitigate) if add "Initiate Initiate a reactor plant shut GOP-4.
down per GOP-4."
H H 3 S Question replaced. New question is Satisfactory. The question tests at C/A level with a LOD=3.
the CIA 33 H H 3 X X X U U 005G2.1 .27: Distractor B is correct, per reference material page 22. In 005G2.1.27:
order for C to be the correct answer the time needs to be changed to 0400 hrs the next day (RHRS designed to cool the RCS to less than 140F 24hrs after the RCS is at 350F, not from post trip). In the stem the 140F crew would not perform a controlled SID S/D with a LOCA, should also state that the RHRS is in service.
F F 2 S 5 Question replaced. New question is Satisfactory. The question tests at the memory level with a LOD=2.
44 H H 22 SS 007A2.03:
007 A2.03: Minor wording changes to the distractors distractors to include procedure and and titles.
55 H H 22 X X X EE 007EA2.01: Currently question marks B 007EA2.01: B as correct, II believe that D D is correct. The stem needsneeds to provide provide information information asas to to which procedure procedure isis in in effect effect in in order order to to make distractors A andand CC credible. Re-word Re-word distractor distractor C C to to be be consistent with distractor A.A.
i S S Question has been SA T.
been corrected. SAT.
1.
- 1. 2. Psychometric Flaws
- 3. Psychometric Flaws Content Flaws
- 4. Job Content 5. Other 6. 7.
Q# LOK LOD LOD (F/H)
(F/H) (1-5) Stem Cues T/FT/F Credo Cred. Partial Partial Job- Minutia #1 Back- Q= SRO UlE/S U/E/S Explanation Focus Dist. Link Link ward units ward K/A Only KIA 6 H 2 X X U 008A2.04: Currently not SRO in that only system knowledge is required to answer the question. Need to add some procedures to go to so the question has some SRO value. Distractors C and D are not plausible in that excessive RCP seal leakoff would be the cause of the CCW radiation problems.
H 2 S Question replaced. New question is Satisfactory. The question tests at C/A level with a LOO=2.
the CIA LOD=2.
7 F 3 X E 009EG2.4.30: Stem need to be changed in order to have a correct answer. Currently there is no correct answer. Distractor A is a 11 hour1.273148e-4 days <br />0.00306 hours <br />1.818783e-5 weeks <br />4.1855e-6 months <br /> notification per 11 OCFR50.
OCFR5O.72(a)(3) 72(a)(3) not 11 OCFR50. 72(b)(1). None of the OCFR50.72(b)(1).
events listed require a 11 hour1.273148e-4 days <br />0.00306 hours <br />1.818783e-5 weeks <br />4.1855e-6 months <br /> notification per 10CFR50.72(b)(1).
10CFR5O.72(b)(1).
Suggest the stem be changed to state per EPP-002 vice per 10CFR5O.72(b)(1).
2 S Question has been corrected LOO=2.
L0D2. SAT 8 H H 3 X X X U 022AG2.4.49: Stem needs to be consistent with procedures. With an ATWT in progress the crew would be driving rods in therefore, power would not maintain at pre-event values. An RCS leak in excess charging is a SBLOCA. The answer B is not lAW AOP-106, per AOP 106 the crew would borate through the bender unless they can not get the BA XFER PP running due to not resetting the lock outs. The question can K/A if actions are listed in the distractors.
better address the KIA H 2 S 5 Question replaced. New question is Satisfactory. The question tests at C/A level with a LOO=2.
the CIA LOD=2.
9 F F 2 S S 032AA2.08 10 10 H H 2 S S 035G2.4.31: Could not write a question at the SRO level for this KIA. K/A.
K/A randomly reselected.
KIA 11 H H 2 S 054AA2.03 12 H H 22 X U U 068G2.1 .30: Question does not test at the SRO level. This KIA 068G2.1.30: K/A is not conducive to testing the SRO knowledge level.
H 2 S New K/A KIA was randomly selected 068G2. 1.20. New question was 068G2.1.20.
generated and is Satisfactory. The new question tests at the C/A CIA level with aa L0D2.
LOO=2.
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem T/F Cues T/F Credo Partial Job-Cred. Partial Job- Minutia Minutia #1
- 1 Back-Back- Q=
Q= SRO SRO U/E/S U/E/S Explanation Explanation Focus Focus Dt.Lk Dist. Link units ward KIA Only 13 13 FF 33 S S 103G2.1.30 103G2.1.30 14 14 FF 2 S G2.1.13 G2.1.13 15 15 HH 11 X U U G2.1.34: Question does not not test at the SRO level.
level. LOD LOD isis too low.
low.
H 3 S Question has been corrected. The question noe tests at the CIA C/A level with a LOD=3.
L0D3. SA SATT 16 F F 3 S G2.2.20: Question taken from Licensee exam bank. Insufficient references provided by the Licensee for question verification. Licensee will verify answer and distractors.
17 17 F F 2 S G2.2.7 18 18 F F 3 S G2.3.2 19 19 FF 2 S5 G2.4.33: Question taken from Licensee exam bank. Insufficient references provided by the Licensee for question verification. Licensee will verify answer and distractors.
20 20 F F 2 X X E E G2.4.38: Distractors A and C are not plausible. Procedures do not reference the Fairfield Pump Facility as an evacuation assembly area.
S Question has been corrected. SA SAT T 21 21 HH 2 SS W/EO2EG2.4.6 W/E02EG2.4.6 22 HH 33 X X EE W/EO5EA2.1:
W IE05EA2.1: Distractor D is not plausible. EOP-16 does not direct transitions and EOP-15 is only entered from the Safety Function Status tree.
Question hashas been been correct.
correct. SAT SA T 23 HH 33 SS W/EO9EA2.2:
W/E09EA2.2: Minor Minor wording changes to make make distractors similar in appearance.
24 24 HH 33 5S W/E12EG2.4.4: Minor W/E12EG2.4.4: Minor wording wording changes to make distractors in distractors similar in appearance.
appearance.
25 FF 25 22 S_____
S W/E13EG2.2.25 W/E13EG2.2.25
T ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 1.
- 1. 2. Psychometric Flaws
- 3. Psychometric Flaws Flaws
- 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF T/F Cred. Partial Job- Minutia #/ Back-Credo Q Q= U/E/S SRO utE/S Explanation Focus Dist. Link units ward K/A Only KIA Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] concepts.)
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 11 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- (i.e., clues, specific determiners, phrasing, length, etc).
The stem or distractors contain cues (Le.,
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (Le.,(i.e., the question has a valid KIA K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved KIA K/A and those that are designated SRO-only (KIA (K/A and license level mismatches are unacceptable).
- 6. reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
Based on the reviewer's
- 7. At a minimum, explain any ay e.g., how the Appendix "U" ratings (how s 2 vchometric Appendix B psychometric attributes are not being met).
1 1 H H 2 001A2.03:
2 H 3 002A4.08: Need to add additional annunciator (XCP-621 Point 1-5) 1-5) to the stem. Need to add that generator MW are not changing to the stem.
This is required to ensure only one correct answer.
Comment Incorporated.
Need to add that one bistable light is lit and that no other bistable lights are illuminated. This is required to ensure only one correct answer.
Comment Incorporated.
33 H H 33 003A4.O1:
003A4.01:
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#LOK Q# LOK LOD LOO (F/H)
(F/H) (1-5) Stem Cues (1-5) Stem Cues T/F T/F Credo Partial Job-Cred. Partial Minutia #1 Job- Minutia #1 Back-Back- Q Q= SRO UlE/S SRO UIE/S Explanation Explanation Focus Focus Dt.k Dist. Link units ward KIA Only 44 FF 44 OO3AK1.17: Need 003AK1.17: Need to to indicate indicate inin the the stem stem that that the the effect effect required required toto be be evaluated is evaluated is in in the the area area ofof the the dropped dropped rod.
rod. Too Too difficult difficult to to determine determine the the effect on effect on the entire core.
the entire core.
Comment Incorporated.
Comment Incorporated.
55 F F 2 004G2.4.49: Need to add wording to the stem that the TCV-144 valve is in 100% power position to ensure the in its normal 100% the applicants know that the conditions in the stem stem are not due to to this valve being being mispositioned.
mispositioned.
Also need need toto add add toto distractors distractors C and 0D that TCV-144 C and TCV-144 needsneeds to be be manually open manually open to to provide provide moremore cooling.
cooling.
Comments Incorporated.
66 H H 3 005AA2.03: Requested changing Answer 0D to the action that is taken to ensure that the shutdown margin is maintained.
Comment Incorporated. Changed answer D to state that a 30 gpm boration is initiated until the plant is in MODE 3.
Requested that the stem annotate that Rods B8 and K6 are in Control Bank D.
Comment Incorporated.
7 7 F F 2 005K6.03: Incorrect nomenclature for valve in distractor B.
Corrected the valve nomenclature.
8 8 H H 3 006K4.ii:
006K4.11:
9 9 H H 3 007A2.05: Corrections needed to the stem to ensure that the conditions present would unmistakenly cause water to go to the PRT. Crew should be in GOP-6 instead of SOP-il SOP-115. 5. Requested RCS temperature in the stem to be increased to 305.
Comment Incorporated. Stem was modified to state that the GOP-6 was in progress .vs. .vs. SOP-i SOP-115 protected train. Removed 15 to swap to the protected unneeded information from the stem that supported sop-i sop-115. 15. Changed RCS temperature to 305 .vs. . vS. 300.
10 10 FF 22 OO7EKi 007EK1.05: distractor time frames
.05: Requested distractor frames be be changed changed to to better reflect when SR SR comes comes on on scale, scale, since since SrSr may may come on on scale scale earlier earlier that 1515 minutes.
Comment Incorporated. Distractor time frames changed.
Comment ii 11 HH 22 007K1.0i:
007K1.01:
12 12 H H 33 008A3.06: Requested 00SA3.06: Requested changing changing the the CCW CCW pump pump discharge discharge pressure pressure from from 40 psig 40 psig toto 45 45 psig psig to to show show that that the the auto auto start start of of the the standby standby pump pump has has yet to occur yet to occur .vs.
.vs. has has failed failed to to occur.
occur. Requested Requested adding adding "subsequent subsequent and/or current and/or status to current status" to the stem.
the stem.
Comment Incorporated.
Comment Incorporated. Changed Changed thethe stem to to reflect that that CCW CCW pump discharge pressure is 45 psig and decreasing added "subsequent discharge subsequent and/or current status" status to the stem.
Requested removing bulleted statement from the stem about CCW low flow on flow on the the essential essential load. ThisThis is not not aa pertinant pertinant condition condition needed needed in thethe stem and stem and indicates indicates that thethe essential essential and non-essential CCW and non-essential CCW headers headers are/were cross-connected.
arelwere Comment Incorporated.
13 13 H H 2 008AG2.4.49:
00SAG2.4.49:
14 14 H H 2 010G2.4.4: Requested rearranging the bulleted information to show more of a time line of the events other than just the status.
Comment Incorporated.
15 15 F F 2 2 O11EK2.02:
011EK2.02:
16 16 F F 2 012A4.03: Nomenclature in the answer needs to be corrected.
Comment Incorporated. Changed "MSIV MSIV isolation signa/"to signal to "Main Main Steam Isolation signal."
signal.
17 17 F F 2 2 012K2.01:
is 18 F F 2 013K1.06:
19 19 HH 2 2 01 5AK1 .02: Nomenclature for P-S 015AK1.02: P-8 is not correct. Suggested changing the wording of distractor C to be consistent with answer A.
Comment Incorporated.
20 20 FF 22 017K1.01:
017K1.01 :
21 21 FF 22 022A1 022A1.04:.04: Need to change change.that that sump was pumped to the waste "waste holup holup tank vs. floor tank" .vs. "floor drain tank in the stem.
Comment Incorporated Comment 22 22 HH 33 022AA1 022AA 1.0S:.08: Requested changing changing VCT VCT level level in in the stem stem from 50%50% toto 38%
3S% to be be consistent with normal makeup levels. levels.
Comment Incorporated.
23 23 FF 22 022K3.02:
022K3.02: Nomenclature Nomenclature changechange required required inin the the stem.
stem.
Comment Comment Incorporated.
Incorporated. Changed Containment "Containment Fan Cooler Cooler Unit Unit" to to Reactor "Reactor Building Building Cooling Cooling Unit Unit" Y
24 24 I-I H 22 024AG2.4.6: Stated 024AG2.4.6: Stated that that the the stem stem isis hard hard to to read.
read.
Comment Incorporated.
Comment Incorporated. The The stem stem was was split split into sections for for easier easier reading.
reading.
Under the current conditions, Under conditions, the breaker breaker for the PORV PORV would not not need need to be opened to satisfy TS. RequestedRequested removing the reference to the PORV beaker in the stem.
PORV Comment Incorporated.
25 25 F 2 025AG2.1.32:
26 F 3 026AA 026AA11.01:
.01: LOD LCD too high for knowing the tem perature for the charging temperature pump oil cooler is above the limit, this value is usually checked in the field. Suggest changing to the Spent Fuel Pool limit has been exceeded.
Comment incorporated. Stem was changed to have the SFP limit being exceeded.
27 27 H 3 026K2.02: Answer A is correct answer for power loss on A train .vs. D as annotated.
Comment Incorporated. Question corrected to annotate A as the correct answer.
28 28 H 2 026K3.02: Events in the stem should be sequenced to show a time line.
Requested that "actually cooling be stressed in the stem actually providing cooling" Comment Incorporated.
29 H H 33 X X 027AK1 027AK1.02:.02: Requested that distractors indicate indicate that the parameter change is from its initial steady sate value.
Comment Incorporated. Added "from from its steady state valuevalue" to each distractor.
30 30 H H 33 064K6.08: There are two possible possible answers to this question. Distractors Distractors need to be modified in order order for there to to be only one correct answer.
Comment Incorporated. Added time estimates to distractors C C and D 0 for credibility and ensuring only one one correct answer.
31 FF 33 034A1 .02: Distractor A could 034A 1.02: could also also be be considered considered correct due due to to procedure specification of of limit of of 461 461' 66" and trying trying not to to exceed this this value.
value.
Comment Incorporated.
Comment Incorporated. Changed Changed limit limit in in distractor distractor AA to 461' 3.5, to 461 3.5", which is the is the low low level alarm alarm setpoinf.
setpoint.
32 32 HH 22 Distractor A is 035K6.02: Distractor is the correct answer. Distractor Distractor BB is is not not correct since since the the reactor reactor trip trip will will not not cause cause the B/S to the B/S to reset to to allow allow shutting shutting the the PORV.
PORV. The The reactor reactor trips trips and and P-12 P-12 isis received received in in conjunction conjunction toto causing causing to PORV to PORV closing.
closing.
Comment Comment Incorporated.
Incorporated. Distractor Distractor AA has has been been annotated annotated as the correct as the correct answer.
answer.
,p:4C/ti TY Cc,,r ,;-i -V ?3
33 33 H H 22 038EK3.08:
038EK3.08: VC VC Summer Summer station station does does notnot perform depressurization of perform depressurization of RCS RCS at at the the same same timetime as as performing performing the the cooldown cooldown associated associated with with the the mitigation of mitigation of aa SGTR.
SGTR.
Comment Comment Incorporated.
Incorporated. Removed Removed the the information information in in the the stem stem and and distractors distractors that that stated stated that that an an RCS RCS depressurization depressurization was was also also in in progress.
progress.
34 34 H H 22 039A 1.10: Requested 039A1.10: Requested format format change change to to aa fill fill in in the the blank blank type type question question due due amount amount of of repeat repeat material material inin each distractor.
Comment Incorporated.
Comment Incorporated.
35 35 H H 22 040AK2.02:
040AK2.02:
36 36 H H 33 045K5.17:
37 37 H H 33 051AA1.04:
051 AA1 .04: Requested information be added in the stem stem to eliminated eliminated the complication due to feedwater preheating affects.
Comment Incorporated. Added in the stem that feedwater temperature temperature is unaffected.
38 38 H H 22 054AK3.01:
39 39 H H 2 2 055EA2.05: Typo in the answer.
Comment Incorporated. Changed 'VCO" VCD to to 'VOC".
VDC.
40 40 H H 33 056G2.1.28:
056G2.1 .28: Nomenclature change needed, "DST" DST should be "DAST".
be DAST.
Remove 11' 0" level to sate 11 0 sate HI-HI "HI-HI"level level alarm. This This is is more more recognizable to the Control Room then actual level.
Comment Incorporated.
41 41 HH 33 057AG2.4.4: Needs 057AG2.4.4: Needs Minor Minor word changes.
Minor word changes made to the stem. Changed are "are" to to s "is':' and and "meet" to mitigate meet "mitigate" 42 42 HH 22 058AA2.01: Need 058AA2.01: Need to add add additional additional annunciator annunciator that that isis received under under the conditions the conditions specified specified inin the the stem stem due due toto where where voltage voltage is is sensed.
sensed.
Comment Incorporated.
Comment Incorporated. AddedAdded INV"INV 1/2112 AC AC INPUT INPUT LOSS LOSS" to to the the stem.
stem.
43 43 FF 22 059G2.1.23: Need 059G2.1.23: Need to to add add wording wording to to the the stem stem to to specify specify thethe question question is is soliciting the soliciting the MINIMUM MINIMUM actions actions required.
required.
Comment Incorporated.
Comment Incorporated.
44 44 HH 33 061 K5.03:
061 K5.03: Requested Requested adding adding the the noun noun name name for for IFV-3536 I FV-3536 to to the the stem.
stem.
Comment Comment Incorporated.
Incorporated.
F4ctry d, i
7 ,.-i-eY3
45 45 H H 33 062A2.06:
062A2.06: Stem Stem is is too too wordy.
wordy. Requested Requested splitting splitting the the stem stem inin to to sections for easier sections for easier reading.
reading.
Comment Incorporated. Stem Comment Incorporated. Stem wording wording rearranged rearranged forfor easier easier reading, reading, adding clarity to adding clarity to the the stem.
stem.
46 46 F F 33 062A3.04:
062A3.04: Requested Requested that "Step Step 2.1" 2.1 be be changed changed to to "Step Step III.N.2.1" lll.N.2.1 inin stem. Distractors Distractors should should state state "within within 10 10 seconds" seconds .vs..vs. "within within 5 to 10 10 seconds" seconds since since light light will light light within 10 10 seconds, seconds, butbut not not immediately.
immediately.
Comment Incorporated.
Comment 47 47 F F 2 062AA .07: Requested wording change to the stem to be consistent with 062AA11.07:
the wording that the applicants are use to seeing for this type of question.
Comment Incorporated.
48 48 F 2 063K4.01:
49 49 H H 2 064K6.07:
50 50 FF 2 065AK3.04:
51 51 F F 2 071K3.05:
071 K3.05: Requested format change to fill in the blank since many of the same words were in each distractor.
Comment incorporated. Changed the stem to ref/ect reflect fill in the blank format. Moved distractor wording into the stem and shorted the distractors appropriately.
52 52 H H 3 072K4.03: Request adding the nomenclature for RM-G17A annunciator to the stem.
Comment Incorporated.
53 53 FF 33 073K5.03: Requested changing Radiation "Radiation Protection Protection" to Health "Health Physics Physics" in the stem.
Comment Incorporated.
54 54 FF 33 075K2.03:
55 55 HH 33 076A 1.02:
076A1 This question
.02: This question addresses addresses aa situation in the situation in the plant plant that that isis not not in in plant plant procedures procedures to to mitigate.
mitigate. Request Request thethe question question be be re-written.
Question was replaced. The facility lesson plans addressed this as as a possibility with the suggested mitigation mitigation strategy. The facility was unclear asas to why this was addressed addressed in the lesson plans.
56 56 HH 33 076A3.02: Need 076A3.02: Need to to state state inin the the stem stem that that aa procedure procedure violation violation has has occurred to occurred to support support the the initial initial conditions conditions ofof having having both both A A and and C C SW SW
. pumps racked pumps racked upup at at the the same same time time on on the the same same train.
train.
Comment Incorporated.
Comment f4C-i-i ry
57 H H 2 078K4.01:
078K4.01:
58 F 2 103K3.02:
103K3.02:
59 F F 3 G2.1 .1: Remove "ACA" G2.1.1: ACA from the stem since this is not normally used as Area of Continuous Attention."
a designation for "Area Attention.
Comment Incoporated.
60 F 2 G2.1.3: Requested change 30 minutes to 15 minutes in the stem.
Comment Incorporated.
61 H 2 G2.1 .29: Requested that "Routine G2.1.29: Routine System Lineup Verification" Verification not be capitalized.
. Comment Incorporated.
62 F F 3 G2.2.1 1: Need to annotate in distractor Band G2.2.11: B and D the qualified reviewer is a member of the plant management staff.
Comment Incorporated.
63 H H 3 G2.2.25:
64 F F 2 G2.2.28 65 H H 3 G2.3.1:
66 H H 4 G2.3.10: The applicants are not required to know the DAC-hour airborn DAC-hourairborn exposure equvalents.
Agreed to provide the applicants with a conversion on the formula sheet reference.
Need to state in the stem that the shielding will remain installed.
Comment Incorporated.
67 H H 2 G2.4.1 G2.4.15:5: Requested distractor A be changed to state that max ccoldown has to be stopped if head voiding occurs. Requested stopping criteria be added to Answer B. Requested that distractor D be changed since it is not credible.
Comment Incorporated. Stopping criteria added to answer B. Distractor A reworded to state that cooldown coo/down must be stopped if head voiding occurs. Distractor D changed to state the TS limit of 100 Flhr F/hr cooldown coo/down limit must not be exceeded until local communications are established.
68 H 2 G2.4.32:
69 HH 22 W/EO4EA2.1:
WIE04EA2.1: Need to annotate that Pressurizer pressure is decreasing vs. stable to ensure proper procedural path through EOP-1
.vs. EOP-1.0..0.
Comment Incorporated.
70 FF 33 W/EO7EK3.2:
W/E07EK3.2:
71 71 FF 22 SS WIEO9EG2.4.49: LOD W/E09EG2.4.49: LOD tootoo high.
high. Applicants Applicants are are not not required required to to know know the the procedure reference procedure reference pages pages from from memory.
memory. TheThe applicants applicants are are unlikely unlikely to to know that know that the loss of the loss of RCS RCS subcooling subcooling in in EOP-1.3 EOP-1 .3 isis SI SI initiation initiation criteria.
criteria.
Compromised with Compromised with the the facility facility to to change change thethe SI SI initiating initiating parameter parameter of of Pressurizer level being below the the limit limit also be added added to the the stem.
this change since Facility agreed to this since the the PZR level is is a parameter that is more recognizable for SI SI initiation.
72 72 I-i H 22 S S WIE1DEK2.2:
W/E10EK2.2:
73 73 H H 33 Facility comment W/E12EK2.1: Facility W/E12EK2.1: comment that the applicant will not distinguish between SI termination criteria under under normal LOCA conditions and that of an Uncontrolled Depressurization of ALL Steam Generators. Facility requested that the question be changed.
Comment NOT Incorporated. The The NRC believes that the applicants appilcants should know that with an uncontrolled depressurization of ALL Steam
. Generators that the existence of a "secondary seconda,y heat sink"sink is NOT requireo requirec for SI flow reduction. Facility stated that they will verify this with operations management.
Facility had no further comments to dispute having this question on the test.
74 74 H H 4 W/E13EK2.2 75 75 H H 3 3 W/E15EK3.3:
- 71C-/ Lf , ' (
L{ ~ rn t11 (.~ P ES-401, Rev.
ES-401, Rev. 9 2 Form Form ES-401-9 ES-401-9 1.
- 1. 2. 3. Psychometric Flaws
- 3. Psychometric Flaws Flaws
- 4. Job Content Flaws Other
- 5. Other 6. 7.
7.
Q# LOK LOK L0D LOD (F/H)
(F/H) (1-5) Stem Cues T/FTIF Cred. Partial Job- Minutia Credo Minutia #1 Sack-Back- Q SRO Q= U/EIS U/E/S Explanation Explanation Focus Focus Dt.Lk Dist. Link units ward KIA Only 1 H H 22 002A2.04:
002A2.04:
22 H 3 003A2.03: Stem should solicit that the sequence of events is required.
need to reflect more of the sequence of events needed The distractors need from AOP-17.1.
AOP-1 7.1. Currently distractor C can also be considered correct in that stopping 2 RCPs RCP5 is not prohibited.
Comment Incorporated. The stem was reworded to solicit the sequence of events. The distractors were modified to contain more of the events from AOP-17.1.
3 3 F 22 005G2.1.27:
4 4 H H 2 007A2.03: In the stem, RCS temperature should be lower than 180F with a solid PZR, suggest 140F. Stem should state that ALL PORV's PORVs are in AUTO. Distractor A should state that the controlling channel has failed instead of just stating the SIS B/S has failed.
Comments Incorporated.
5 5 H H 2 2 007EA2.01: Stem needs to be clarified to state that both MFWPs MFWP5 were running when they tripped. State in the stem that one of the trip breakers failed to open to add credibility to the power level still being above 5%. Distractors C and D D should state that the transition is from EOP-1 EOP-1.0..0. Stem should also state that the crew is performing the EOP-1.0.
immediate actions of EOP-1 .0.
Comments Incorporated. Discussions with the facility resulted in also changed the stem to a higher higher power level to ensure a more warranted transition to EOP-13.O.
66 HH 22 008A2.04: The annunciator listed 008A2.04: listed as as bullet #1 would not bullet #1 not be received under these conditions and under and annunciator LTDN/SL LTDN/SL WTR WTR HXHX FLO FLO LO LO TEMP HI TEMP HI would.
would. Stem Stem should statestate that that all all associated associated automatic automatic actions actions this will have occurred, this will ensure that that distractor distractor A is incorrect. Requested that the distractors be rearranged to to be consistant with the sequence sequence of events events in the SOP.
SOP.
Comments Comments Incorporated.
77 FF 22 009EG2.4.30:
009EG2.4.30:
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Flaws Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws Other
- 5. Other
- 5. 6.
- 6. 7.
7.
Q#
Q# LOK LOK LOD LOD (F/H)
(F/H) (1-5)
(1-5) Stem Cues Stem Cues T/F TIF Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
- 1 Back-Back- Q=
Q= SROSRO U/EIS u/E/S Explanation Explanation Focus Focus Dt.
Dist. Unk Link wa KIA units ward A OnlyOnly 8 H H 2 022AG2.4.49: Request 022AG2.4.49: Request words to be be added to the stem to indicate indicate that that problem is the problem is definitely definitely with the CCP.
CCP.
Comment Comment Incorporated. Added to the stem that that the the CCP CCP amps amps and flowflow fluctuating and the pressure is "oscillating."
are "fluctuating" oscillating.
99 F F 2 032AA2.08: Distractors C and 0D should should state "detector" detector .vs. "monitor."
monitor.
Comment Incorporated.
Stem needs to state that SR monitor N33 is out-of-service, this ensures that action must be taken.
Comment Incorporated.
10 10 H 2 035G2.4.20: In the stem" stem actions" actions should be changed to "sets sets of actions (not all inclusive)."
inclusive).
Comment Incorporated.
11 H H 2 054AA2.03: Stem should state that SG levels are decreasing. The stem does not need to designate the ARP, this adds confusion. Request that distractor be worded to indicate that the pumps should have a start signal .vs. should have started. This will prevent confusion in thinking that there may be a problem with the pumps.
Comments Incorporated.
12 12 H H 2 068G2.1.30: Distractors Band B and C should reference RM-L5 ..vs. vs. RM-L9.
Request that the word second"second" be emphasized in the stem.
Comments Incorporated. The word "second" second in the stem was underlined.
13 13 FF 33 103G2.1.30:
103G2.1 .30: Corrections needed to the air lock door nomenclature.
Comment Incorporated. Nomenclature for the doors corrected.
14 14 FF 22 G2.1.13:
15 15 H 33 G2.1.34: LOD G2.1.34: LOD isis too too high.
high.
Stem and and distractors distractors were were reworded to to decrease the level of of difficulty to to aa level that that was acceptable to the facility. RCS temperature decreased to 200F in the stem so so aa mode mode change has not not occurred. Distractor worded to to stop the heatup heatup to prevent non-compliance.
non-compliance.
16 16 FF 33 G2.2.20: LOD G2.2.20: LOD isis too too high.
high.
Discussions with with the the facility on on the the LOD LOD resulted resulted inin changing changing distractor distractor C C to make itit less to make less attractive.
attractive. This This resulted resulted inin an an acceptable acceptable LOD LOD for for the the facility.
facility.
f62 C- (1- ( T ,V
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7.
Q#
Q# LOK LOK L0D LOD (F/H) (1-5)
(1-5) Stem Cues T/F Cues T/F Cred. Partial Credo Partial Job- Minutia #1 Back-Job- Minutia Back- Q=
Q= SRO u/E/S U/E/S Explanation Explanation Focus Focus Dt.
Dist. Unk Link units ward KIA Only 17 17 F 2 G2.2.7:
18 F 3 G2.3.2: The wind directions in distractors Band B and D are too close to the correct direction. Request that they be changed from "South-Southeast."
correct South-Southeast.
Comment Incorporated. The wind direction in distractors Band B and D changed to 'West-Southwest."
West-Southwest.
19 F 2 G2.4.33: Requested that 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br /> be added to the stem to place to correct frame of reference for the applicants.
Comment Incorporated.
20 F 2 G2.4.38:
21 21 1-1 H 2 W/E02EG2.4.6:
W/EO2EG2.4.6: Facility not content with the wording of the distractors.
Discussions lead to rewording the distractors for clarification.
22 22 H H 3 W/E05EA2.1 W/E05EA2.1::
23 23 H H 3 3 W/E09EA2.2:
W/EO9EA2.2:
24 H H 33 W/E12EG2.4.4:
25 F F 22 W/E13EG2.2.25:
I 7
ES-403 ES-403 Written Examination Written Examination Grading Grading Form ES-403-1 Form ES-403-1 Quality Checklist Quality Checklist Facility: Yc £-nftt.?\ Date of Exam: Exam Level Exam Levek Initials Initials Description Item Descri Item tion a b c 1.
- 1. Clean answer sheets copied before before grading /4. g(4
- 2. Answer key changes and question deletions justified and y/ IJJ.b documented 1,4 Applicants scores checked for addition errors
- 3. Applicants' (reviewers_s reviewers spot pot_check>_
check> 25%_of_exa 25% of examinations minations)
Y/ ~
- 4. Grading for all borderline cases (80 +/-
80, as applicable, +/- +1- 4% on the SRO-onl
+1- 2% overall and 70 or SRO-only) reviewed in detail C£ g A//
/4J
- 5. All other failing examinations checked to ensure that grades are justified
'ustified /1 ~
- 6. Performance on missed questions checked for training ) #7 deficiencies and wording problems; evaluate validity of (j_- i1 ~
questions_m questions b halff or more of the applicants issed_by_hal missed Printed Name /I Signature Date
- a. Grader -siif."
Reviewer(*)
- b. Facility Reviewer(*)
(*)
- c. NRC Chief Examiner (*) S j
- d. NRC Supervisor (*) (*) ~ .. 'l~/l1~J OO1MaI
(*) The facility reviewers
(*) reviewer's signature is not applicable for examinations graded by the NRC; two independent independent NRC reviews are required.
55 of of 55 NUREG-1 NUREG-1 021, 021, Revision 99
ES-501, Rev.
ES-501, Rev. 99 Post-Examination Check Post-Examination Check Sheet Sheet Form Form ES-501-1 ES-501-1 Post-Examination Check Post-Examination Check Sheet Sheet Facility: V.C. Summer Facility: Date of Date Examination:
of Examination: 12/12-12/16/05 12112-12116105 && 1110/06 1110106 Description Task Description Date Date Complete 1.
- 1. Facility written exam comments or graded exams received 1/26/06 1/26/06 and verified complete
- 2. comments reviewed Facility written exam comments reviewed and incorporated incorporated 5/08/06 NRC grading completed, ifif necessary and NRC necessary
- 3. Operating tests graded by NRC examiners 5/11/06
- 4. NRC chief examiner review of operating test and written exam 5/11/06 5/1 1/06 grading completed
- 5. Responsible supervisor review completed 5/12/06
- 6. Management (licensing official) review completed S/JzjD(...
- 7. License and denial letters mailed S j2./l)~
- 8. Facility notified of results S-/I"L/VC,
- 9. Examination report issued (refer to NRC MC 0612) c/i
~/)~/OCo
- 10. Reference material returned after final resolution of any appeals rlfA-