ML101650156
| ML101650156 | |
| Person / Time | |
|---|---|
| Site: | Turkey Point  |
| Issue date: | 03/28/2010 |
| From: | NRC/RGN-II |
| To: | Florida Power & Light Co |
| References | |
| 50-250/07-301, 50-251/07-301 50-250/07-301, 50-251/07-301 | |
| Download: ML101650156 (26) | |
Text
{{#Wiki_filter:ADMINISTRATIVE DOCUMENTS (Yellow Paper)
- 1. Exam Preparation Checklist ................... . ES-201-1
- 2. Exam Outline Quality Checklist ................. . ES-201-2
- 3. Exam Security Agreement(s) ................... \~S~2**ID~~ ES-201-3
- 4. Administrative Topics Outline (Final) .............. ES-301-1 ~:$~3~@!~1;::;~~:.'~
- 5. Control Room Systems & Facility Walk-through Test Outline (F 'rnal) * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * ;~~S*lli!~'i;:\;1;::n (Final) ES-301-2
.l:::: ..*. {:.~~ .. ~~
- 6. Operating Test Quality Check Sheet .............. ~~~3~;t~~' ES-301-3
- 7. Simulator Scenario Quality Check Sheet ES-301-4
- 8. Transient and Event Checklist ................... :I~S~@~~~I§'~ ES-301-5
- 9. Competencies Checklist ...................... . ES-301-6
- 10. Written Exam Quality Check Sheet ............... cB"Il¢01:;;.6)1 ES-401-6 II.
- 11. Written Exam Review Worksheet ................ ES-401-9 ~f4f@:~~:£gj
- 12. Written Exam Grading Quality Checklist ............~~;~4~~tS~:1*:~ ES-403-1
- 13. Post-Exam Check Sheet . . . . . . . . . . . . . . . . . . . . .. ::E!S~§:0~:;f{:1 ES-501-1
- 14. Facility Submittal Letter ((1]
ES-201, Rev. ES-201, Rev. 9E 9E Examination Preparation Examination Preparation Checklist Checklist Form Form ES-201-1 ES-201-1 Facility: /ur/(ey Facility: 7iA? /1;/-'7/ Date of Date of Examination: Examination: A,e
/
7
,qr 01 3LJ 31 .---,44,q
/YII?/ f:I 26.D7 Examination Prepared Examination Prepared By By (Circle):
(Circle): ~acE9 lit NRC NRC Written /I Operating Written Operating Test Written /I Operating Operating Test Target Target Chief Chief Date* Date* Task Description Task Description (Reference) (Reference) Examiner's Examiners Initials Initials
-180 -180 1.
- 1. Examination administration Examination administration date confirmed (C.1.a; date confirmed (C.1.a; C.2.a C.2.a and and b)b) 4,/
, /
-120
-120 2.
- 2. NRC examiners and NRC facility contact assigned and facility assigned (C.1.d; (C.1 .d; C.2.e)
C.2.e) ~;}'
-120 3. Facility contact briefed on security and other requirements (C.2.c)
Facility A';~
-120 4. Corporate notification Jetter letter sent (C.2.d) sent (C.2.d) ~;I
[-90] [5. Reference material Reference material due (C.1.e; C.3.c; Attachment 2)] L~ {-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-112, ES-401-3, and ES-D-ls, ES-401-1/2, ES-401-4, as applicable (C.1.e and f; C.3.d) £;/ {7. {-70} Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)} Lei {-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms
~c1 ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference (C.1 .e, f, g and h; C.3.d) materials due (C.1.e,
-30 9. Preliminary license applications (NRC Form 398's) 398s) due (C.1.1; (C.1 .1; C.2.g; ES-202) ~J
~~
-14 10. Final license applications due and Form ES-201-4 prepared (C.1.1;
- 10. (C.1.l; C.2.i; ES-202)
-14 11. Examination approved by NRC supervisor for facility licensee review 11.
(C.2.h; C.3.f) 4c!
-14 12. Examinations reviewed with facility licensee (C.1
- 12. .j; C.2.f and h; C.3.g)
(C.1.j; ,£C/
~J
-7 13. Written examinations and
- 13. and operating operating tests approved by NRC supervisor by NRC supervisor (C.2.i; C.3.h)
-7 14.
- 14. Final applications reviewed; 11 or2 or 2 (if >10)
>10) applications applications audited to confirm
~/
qualifications I/ eligibility; and examination examination approval and and waiver letters sent sent (C.2.i; Attachment (C.2.i; Attachment 4; 4; ES-202, ES-202, C.2.e; C.2.e; ES-204) ES-204)
-7
-7 15. Proctoring/written exam 15.
with facility with facility licensee exam administration licensee (C.3.k) administration guidelines reviewed (C.3.k) reviewed
~J
-7
-7 16. Approved scenarios,
- 16. Approved distributed distributed to scenarios, job job performance NRC examiners to NRC performance measures, examiners (C.3.i)
(C.3.i) measures, andand questions questions A:ci
- Target dates are Target dates generally based are generally based on facility-prepared examinations on facility-prepared examinations and are keyed and are keyed to the examination to the examination date date identified identified in the corporate in the notification letter.
corporate notification letter. They are for They are for planning planning purposes purposes andand may be adjusted may be adjusted onon aa case-by case-by-case basis case in coordination basis in coordination withwith the facility licensee. the facility licensee. [Applies only] [Applies only] {Does {Does not not apply} apply} to to examinations examinations prepared prepared by the NRC. by the NRC.
ES-201 Examination Outline Quality Checklist Form ES-201-2 L Facility: r IUI'I<.e'1 0 P POH'\t Date of Examination: y Ie, 1 OJ 19 10'1 Initials Item Task Description a b* c# w w 1
- 1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
~ /9f- /:V):.
R II
- b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KIA K/A categories are appropriately sampled.
b\J }J- /t:j T T
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. vJ jJ .1;-1 E
N
- d. Assess whether the justifications for deselected or rejected KIA K/A statements are appropriate.
tJ )J. Lj
- 2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number S
S of normal evolutions, instrument and component failures, technical specifications, and major transients.
~l5 k !)
I MM b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation schedule
~ );}
L A without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated L:J T from the applicants' applicants audit test(s), and that scenarios will not be repeated on subsequent subseqi days. 00 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D. ~ "J} ).;j
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
W I/ (1)) the outline(s) contain(s) the required number of control room and in-plant tasks (1 distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (/?f If rtJ T applicants audit test(s) (3) no tasks are duplicated from the applicants' (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1)) the tasks are distributed among the topics as specified on the form (1 (2) at least one task is new or significantly modified m (3) no more than one task is repeated from the last two NRC licensing examinations "6 JJ tJ.
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. ~ kf i;j
- 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered {;Jl5 j;J. ~lJ in the appropriate exam sections.
G b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ~? };f- 2J E N N E
- c. Ensure that KIAK/A importance ratings (except for plant-specific priorities) are at least 2.5. ;{Jf J:I.- /;;;;
- d. Check for duplication and overlap among exam sections. ~l> JJ- ~:J-R A e. Check the entire exam for balance of coverage. GIl} f;f .,c,/
L
- f. Assess whether the exam fits the appropriate job level (RO (RD or SRO). ;"to .~ A:,L
~ . "" /j{"1{C:trinte~ame~:rature \ <:l \' I,I&C We ~ Date
- a. Author FacilityReviewer(*)
- b. Facility Reviewer (*)
G, f;.Cr:>,- O * .i'l>t:., klj 9 Lcti
- b. A. Lc.H.l'lh &.4ct___
2 Jc C. . h~ I/ 'lctct..:;1jf.A.J.s¥..l L~~n~IQ;<f LIILOIQ7 Li)
- c. NRC Chief Examiner (#)
- d. NRC Supervisor
(#) ed<p'r? be;/. I(.\"-~~ I Zca. d:-. /.-.l:d",}J.>, . -~ ~ {h 1~,AA-1 P 4 r(..... 1 I4 I( M<4* I~/ 47 V' rtfi]u- >7 Note: # Independent NRC reviewer initial items in Column "c"; c; chief examiner concurrence required. ES2O1, Page 25 of 27 ES-201,
, ~Rr
~5 ~RC. E"'I\~
r .......... ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination II acknowledge that II have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 4/30/0'1- 4f3O/o? as of the date of my signature. II agree that II will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. II understand that II am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, II am aware of the physical security measures and requirements (as documented in the facility licensee's licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. II will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my knowledge, II did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that II entered into this security agreement until the completion of examination administration, II did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
f ' ~RINTED PRINTED NAME NAM~. JOB TITLE JOB RESPO~S,IBILITY TITLE // RESPONSIBILITY I . f~NAT~R NA DATE DATE SIGNATURE (2) SIGNATURE (2) DATE NOTE DATE NOTE 1.1~W\. C~ \llQ(' 1-1.tk1jir_L_Lc JKc-W<..- ~ ~ w-,\~~ ~o S \ rc.. r ~'. _ Olt2D*D.h.. _______ _____
- 2. GlLE"COf..'l A A L4r-~~LW~~\..kLL'j fAi-r- Kej)"ese.",k~h"e. _ _~("
Lw4 _____ ~:.r~~1)~- sU~~a 3.
--- - :;;;ijJ~ ___
_Zo.3&o&.
- 5. ~l-'ll:::'f JI1oyS5..l.P-!L ~/.J'1~'tt2fL v L.41pL !hW44 H-A-I?!~A-M fY~ _ _ __ 9.=lf-(JL.
f ALJ , 6.r-LIZbN
- 6. J 4 /fL4 ~t:,,26il..
SI/l1. - _ _ rjL ~
- 7. L. ~. ~£ V _~(.1Vl 5(f- eNG.
t-), y= _ 9 I' !if, 8.
- 8. ,d.f-vf ~ ~G "A-")'\~___ ___ -.~~~=-----
- 9. A 7Vu ~Ab<..H""""7 i2!Zs.-
S 1 O.J\ES SilEIC.tt.;:o'L. 10.-1AMO
~o
__ ~
\/k!-~
*_*-
- _ _ _ -+~.,.."", ~~~~=___
.J/.,,-,\;>>).'f1)(L -.---=~,?->JA.~~?------ (
11.~_ ll.___ZVl_ I(~
? It<{
&,,(
_~E~~~__
/V-______
12.Jk~~\U&. ___ J~ IlA ..... il).~'--_____ 1 2-_
====
.--r _ _ __
=.
C
~3. TbeL!~
13. __--= _~tt>_~~~ __ 1~~;:b- ~~~~"-- -~" v&_ N~tt~:~
ø>_ L.._-L --__
ES-201, Page 26 of 27
.....-.... v ..
C aP Z3 ~.C£)(A~ ('~2S 4R ES-201 ES-201 Examination Security Examination Security.L\.greement Agreement Form Form ES-201-3 ES-201-3 1.
- 1. Pre-Examination Pre-Examination II acknowledge acknowledge that of my that II have signature. II agree mysignature.
have acquired agree that acquired specialized that II will will not specialized knowledge knowledgeabout knowingly divulge not knowingly divulge any aboutthe NRC licensing the NRC information about any information licensing examinations examinations scheduled scheduled for forthe the week(s) week(s) of of 44r~()( 0'" I31° as as of ofthe the date date of these examinations about these examinations to to any any persons persons who who have have not not been been authorized authorized by the by the NRC chief NRC chiefexaminer. examiner. II understand understand that that II am not to am not instruct, evaluate, to instruct, evaluate, or provide performance or provide performance feedback feedbackto to those those applicants applicants scheduled scheduled to to be be administered administered these licensing examinations these licensing examinations from from this this date until completion date until completion of of examination examination administration, administration, except except asas specifically specifically noted noted below below and and authorized authorized by bythe the NRCNRC (e.g., acting (e.g., acting as simulator booth as aa simulator operator or booth operator or communicator communicator isis acceptable acceptable ififthe individual does the individual does not not select select thethe training training content content or or provide provide direct direct or or indirect indirect feedback). Furthermore, feedback). Furthermore, II am aware of am aware of the physical security the physical security measures measures and requirements (as and requirements (as documented documented inin the the facility facility licensee's licensees procedures) procedures) and and understand that understand violation of that violation of the conditions of the conditions of this agreement may this agreement may result result inin cancellation cancellation of the examinations of the examinations and/or and/or anan enforcement enforcement action action against against meme or or the facility licensee. the facility will immediately licensee. II will immediately report report to facility management to facility management or the NRC or the NRC chief examiner any chief examiner any indications indications or or suggestions suggestions thatthat examination examination security security may have may have been compromised. been compromised. 2.
- 2. Post-Examination Post-Examination To the To the best best ofof my knowledge, II did my knowledge, did not not divulge divulge to to any unauthorized persons any unauthorized persons any information concerning any information concerning the the NRC NRC licensing licensing examinations examinations administered administered during the during week(s) of the week(s) of From the
. From the date date that that II entered entered into into this this security security agreement agreement until until the the completion completion of of examination examination administration, administration, II diddid notnot instruct, evaluate, instruct, evaluate, or provide performance or provide performance feedback feedback to to those those applicants applicants who who were administered these were administered these licensing licensing examinations, examinations, except except as as specifically specifically noted noted below and below authorized by and authorized the NRC.
by the NRC. PRINTED NAME PRINTED NAME JOB TITLE /I RESPONSIBILITY JOB TITLE RESPONSIBILITY SIGNATURE (1) SIGNATURE (1) DATE DATE SIGNATURE SIGNATURE (2) (2) DATE DATE NOTENOTE
~.2j 1.
~~~ ~1~~
.f(p~~_~~
----:~-"~~i-O~--- - ~__
4 ____2e.________.B__________ __
- -------- 90.tfi~--------------------
9-15--i _______________ ~~~.-------------------- ________ _
- 3. ~_f.naj[L-l3nf1c'jS--__:_-
~. Dns --:]t1.$~11~;;' _!~L_______ ---- - - - -~--J- 2/).P/~l _________________ ----- -----
5.. ~%~~!I~~'*'-- -~.clmLa-;2[L<.J:.MJ.~------'--- - ---- -fll::~~1------------------- ----- ----- 4.
~:~~-~=== ====~=~r a~~====~ -========~~~~-===--=======================
_\_~i::i -lQfd~ ----"::7-4-u...J..flJj)£q ~~)--- ~- - - k ____ - '-{).2 tlL___________________ ----- -----
- 5. < -
6. 7. _c4!LL-- ]L4 :r
]c
~.8....J~-i-Jif~i ~fo7[lTtA~- -~1?~~~.ii*~k~spfL---- ur 44 Vc
~ {;1~J:;2------------------- ----------
_____ L____________ _________________________ __~------- ______ J"'___________________________________ _
~ ~:!l~~=-t'iJ1l~~~==== ==fr~==fJJf;'lfi~~======= =_=~__~~=~~~==~~i((r===================
1 OQ_____ i,(A,1 VI,PAP4IZ ii[IOi i%SJg(L...
~;.m~~£~------
1 2._77____ --1"tfL~~~.A~l~k£l~L
- SI,., .cJt
_xr Ii ~-;_ ~ ______________ ':t;M~; --_______________________ ===== ===== 1 .____C1LL_-:J_________ ____.£~-----V~----kc----- ____ ___ _ __ _____ 'iL'LL____________________________ _ 14._~.i.~l) I 4.gjZ__ __cr_---- _____ AQ.___-=-_Vp_~~~L---- It -
--- ------- o/L*?- -------------------- ----_ -----
1 5jthE 15 ..Jdm.J.J~-I'J£'tLn-f __ fl12_Iam:lL~--~~lL-'----- 1COIrrI+/-TIO 5 C,Lbj/. ___ ---'_ __________ fl~-1!Z------------------- __________ NOTES: T ES-201, Page 26 of 27
~p C p Z3 £.5 N1( NRC, EXRm 1Xfi1V) i ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination II acknowledge acknowledge that that II have have acquired acquired specialized specialized knowledge knowledge about about thethe NRC NRC licensing examinations scheduled for for the week(s) week(s) of as of the the date of date of my my signature.
signature. II agree agree that that II will will not not knowingly knowingly divulge divulge anyany information information about about these examinations to any any persons who have persons who have not not been been authorized authorized by by the NRC chief the NRC chief examiner. examiner. II understand understand that that II am am not not toto instruct, instruct, evaluate, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing administered these licensing examinations examinations from from this this date date until until completion completion of examination administration, except as specifically noted below and authorized authorized by by the the NRC NRC (e.g., (e.g., acting acting as as a a simulator simulator booth booth operator operator or or communicator communicator is acceptable if the individual does not select the training content or provide direct or provide direct or indirect indirect feedback). feedback). Furthermore, Furthermore, II am am aware aware of of the the physical security measures and requirements (as documented in the facility licensee's licensees procedures) procedures) and and understand understand that violation of that violation of the the conditions conditions of of this agreement may result in cancellation of the examinations and/or an enforcement enforcement action action against against me me or or the the facility facility licensee. licensee. II will will immediately immediately report to to facility management or the NRC chief examiner any indications or suggestions suggestions that that examination examination security security maymay have have been been compromised. compromised. 2.
- 2. Post-Examination Post-Examination To To the the best best ofof my my knowledge, knowledge, II did did not not divulge divulge toto any any unauthorized unauthorized persons persons anyany information information concerning the NRC licensing examinations administered during during the week(s) of the week(s) of . From From the the date date that that II entered entered intointo this this security security agreement until until the completion of examination administration, II did not not
- instruct, instruct, evaluate, evaluate, or or provide provide performance performance feedback feedback to to those those applicants applicants who were administered these licensing licensing examinations, except as specifically specifically noted noted below below and and authorized authorized by by the the NRC.
NRC. PRINTED PRINTED NAME NAME JOB JOB TITLE TITLE /I RESPONSIBILITY RESPONSIBILITY SIGNATURE SIGNATURE (1) (1) DATE SIGNATURE (2) DATE NOTE NOTE
\~-:{ \.)t.)\~ S,.9~s>,IIS<A... ~ "\I~\, ________
1. 2. 1.
- 2. 1).5.
3. 3. 4.
\\:6S.
b.S. ~4"" 80m ccs AOO1 ItMt\"'cl.s*e:"",~,,'\. Ke"lC=...Je.( e 5v.tet Re~'Ne~ eser cA ~ ==== 4. 5.
- 5. _ _ __
6.
- 6. _ _ __
7.
- 7. _ _ __
8.
- 8. _ _ __
- 9. _________________________________
- 9. ._----------'-- ---- - - - - - - ' - - - - - - ---- -_.-
10. 10.________________---'______--'-_______________________-..,...___________-'--___ 11.
- 11. _ _ __
12.
- 12. _ _ __
13._______________________________
- 13. ------
14.
- 14. _ _ __
15.
- 15. _ _ __
NOTES: NOTES: ES-201, ES-201, Page Page 2626 of of 27 27
ES-301 Administrative Topics Outline Form ES-301-l ES-301-1 1:/NA t:/#ALl Ii Facility: Turkey Point Units 33 & & 4 Date of Examination: 04/2007 Exam Level: RO 2007-3011 Operating Test Number: 2007-30 Administrative Topic Type Code Describe Activity to be performed (See Note) (See Note) A. l.a RO A.l.a-RO - 1/M Plot During Reactor Startup Perform 11M CR CR,N N Conduct of Operations - - & 015 K5.05 - 4.1/4.4) (G2.2.34 - 2.8/3.2, 001 K5.75 - 2.9/3.5 & - 4.114.4) A. 1 .b A.l.b Conduct of Operations A.2 - RO
- Prepare an ECO for 3C Charging Pump CR CR,P Equipment Control - 3,6/3.8)
(G2.2.13 - 3.6/3.8) A.3 Read a Survey Map and Apply RWP Requirements CR M CR,M Radiation Control (G2.3.10 - 2.9/3.3) (G2.3.1O - A.4 - RO Complete NRCOC Notification Form as Communicator CM C,M Emergency Plan (G2.4.43 - 2.8/3.5) NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.
- Types and Codes (C) Control Room (S) (5) Simulator (CR) Classroom 4 for SROs)
(3 for ROs, ::;4 (D)irect from bank (::;3 (N)ew or (M)odified from bank (2: (l)1) (l Randomly selected) (P)revious 2 Exams (::;1
ES-301 ES-301 Administrative Topics Administrative Topics Outline Outline Form ES-301-1 ES-301-1
,C/W,41j I lVi'll.
Facility: Turkey Facility: Turkey Point Point Units Units 33 && 44 Date of Date of Examination: Examination: 0412007 04/2 007 Exam Level: Exam Level: SRO (1) SRO (I) Operating Test Operating Test Number: 2007-301 2007-301 Administrative Topic Administrative Topic Type Code Type Code Describe Activity Describe Activity to to be performed performed (See Note) (See (See Note) A. l.a - SRO A.1.a - SRO Verify Adequate Shutdown Margin CR N CR,N Conduct of Operations 11 (G2.1.7 - 3.7/4.4 &
- & 001 A4.11 A4. 11 - 3.5/4.1)
A. I .b - SRO A.1.b - Evaluate Overtime Requirements CR N CR,N Conduct of Operations 2 (G2.l.l - 3.7/3.8) (G2.1.1 - A.2 - SRO Review ECO for 3C Charging Pump CR N CR,N Equipment Control (G2.2.13 - 3.6/3.8) A.3 Read a Survey Map and Apply RWP requirements CR CR,M M Radiation Control (G2.3.10 - 2.9/3.3) A.4 - SRO
- Review NRCOC Notification Form CR CR,N N Emergency PlanPlan (G2.4.43 (G2.4.43 - 2.8/3.5)
- 2.8/3.5)
NOTE: NOTE: All items (5 (5 total) are required for SROs. SROs. RO applicants require only only 44 items items unless they they are retaking retaking only only the administrative topics, when 5 are required. the administrative topics, when 5 are required.
- Types Types and and Codes Codes (C) Control (C) Control Room Room (S) (S) Simulator (CR) Classroom Simulator (CR) Classroom (D)irect from (D)irect from bank ::;3 for ROs, bank (( S3 ROs, E4::;4 for SROs)
SROs) (N)ew or (N)ew or (M)odified (M)odified from from bank bank (1) (2:1) (P)revious (P)revious 22 Exams Exams (l Randomly selected) (::;1 Randomly selected)
ES-301 Control Room/In-Plant Roomlln-Plant Systems Outline Form ES-301-2 Jt1 b P14/Jib rIAl Facility: Turkey Point Date of Examination: 04/2007 Exam Level (circle one): RO 1 I SRO-I SRO-l Operating Test No.: 2007-301 Control Room Systems@ (8 for RO; 7 for SRO-I; SRO-l; 2 or 3 for SRO-U) System 1/ JPM Title Code* Type Code* Safety Function
- a. Respond to Pressurizer Pressure Control Malfunction (01041013102) MAS 3 (010 A2.02 - 3.9/3.9)
- b. Respond to Loss of RHR Inventory (01050003302) DSL**
DSL** 4p 4P (002 A2.01 - 4.3/4.4)
- c. Adjust Rod Position for Tavg Control (01028025301) MAS 1 1
(001 A2.1 A2.111 - 4.4/4.7 & 001 A2.14 3.7/3.9)
- d. Test the Source Range NIS Channel (Shutdown) (01059017200) DSL 7 (015 A4.02 - 3.9/3.9 & 015 A4.03 - 3.8/3.9)
- e. Respond to Component Cooling Water System Malfunctions (01030008303) DSL 8 (008 A2.01 - 3.3/3.6)
- f. Emergency Borate the RCS (01046008303) DASL 2 (004 A2.06 - 4.2/4.3 & 004 A2.14 - 3.8/3.9)
- g. Respond to Loss of 3C Transformer (01005021300) MS 6 (062 A2.05 - 2.9/3.3)
- h. Reduce PRT Liquid Temperature (01041012100) DS 5 (010 Al .03 - 2.9/3.2)
A 1.03 - Systems@ (3 for RO; 3 for SRO-I; In-Plant Systems@ SRO-l; 3 or 2 for SRO-U)
- i. Respond to Control Room Evacuation as Third Licensed RO (01200013301) DAE 4S (068AA11.02 (068AA .02 - 4.3/4.5)
- j. (0-OP-06l .14 sect 7.1 - SNPO)
Perform Gaseous Radwaste Release (0-OP-061.14 - NR 9 (071 A4.26 - 3.1/3.9)
- k. Recover from a a Unit 4 EDG Auto Start Failure (04023030500) DAE 6 (064 A4.01 - 4.0/4.3) (RO only)
@@ All control room (and in-plant) systems must be different and serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for RO 1 SRO-l / SRO-U
/ SRO-II (A)lternate path 4-6 / 4-6 / 2-3 4-6/4-6/2-3 (C)ontrol room (D)irectfrom (D)irect from bank 918/4
- 9/::::8/::::4 (E)mergency or abnormal in-plant ~1/~1/~1 1 / 1 / 1 (L)ow-Power ~1/~1/~1 (M)oditied from bank including 11(A)
(N)ew or (M)odified (A) ~2/~2/~1 2/ 2/ 1 (P)revious 2 exams :::: 31:::: 3 / 31:::: 3/ 2 2 (randomly selected) (R)CA ~1/~1/~1 (S)imulator
- - May be performed in the Control Room as aa simulate JPM rather than on simulator.
ES-301 Operating Test Quality Checklist Form Form ES-301-3ES-301-3 I Facility: IH kx ...':poif'\\- 4l3o(o Date of Examination: 04/30/01- Operating Test Number: Initials
- 1. General Criteria a b* c#
- a. The operating test conforms with the previously sampling requirements (e.g., 10 previously approved approved outline; changes are 10 CFR 55.45, operational importance, are consistent consistent with importance, safety function distribution). ~'7 JJ- ~;J
- b. There is is no no day-to-day repetition during this examination.
durin!=) repetition between this and other operating tests to be be administered ~ry fI >>- ~;j
- c. applicants audit test(s). (see The operating test shall not duplicate items from the applicants' D.1 .a.)
(see Section D.1.a.) ~6 1% JW ~J
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits. ~?f f~
-c:i
- e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level. WO45 J~ 1;;}
4
- 2. Walk-Through Criteria --
a. Each JPM includes the following, as applicable:
- initial conditions ~.% )q )_- 1;1 .,tJ initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
- operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance
;/6 /3 ,L_JJ- 1/.4J.i criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria --
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and aa copy is attached. ':A5
)J} .jj )1 Printed Name /I Signature Date
- a. Author G~II":"T:>E-ld((]
(,ti(g STE /) o4kIi 04/C:lu/d'1-
- b. Facility Reviewer(*)
Reviewer(*) 6. G.A. A. LouLClU.Ct~h" l /1*~~~,J(t I I
- 1i-z.oJ07 07
- c. NRC Chief Examiner (#) (#) .
EdI.-V'rJ "~a, *ifr'./~d~;j)k, (h 1/.2S/.J.:>D 17 .7
'7
- d. NRC Supervisor /'?).<'.('T M (i frA/r i(i./N- ~
AI\ (,-' /i4 -2 V {/
'13 rot.
1I I 7 NOTE: NOTE:
- The facility signature is is not not applicable for NRC-developed NRC-developed tests.
tests.
# Independent Independent NRC NRC reviewer initial initial items items in in Column c; chief examiner concurrence required.
Column "c"; ES-301, Page 24 of 27
ES-301 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 ES-301-4 j.: iNAJ Facility)Pcw+ Examt Date of Exam(Y'tt?£J/d/- Scenario Numbers: i/ i. I 2.. // 3.
'2. , Operating Test No.:
QUALITATIVE ATTRIBUTES frtials Initials a b* b* c# 1.
- 1. initial conditions are The initial are realistic, realistic, in in that some equipment equipment and/or and/or instrumentation instrumentation may may be out be out of service, but it does not cue the operators into expected events.
- 2. The scenarios consist mostly of relatedrelated events. -At ,47/
- 3. Each event description consists of Each the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event 4J W
Oj_. ,,7 Jil
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position)
- the event termination point (if applicable)
- 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
)
- 5. The events are valid with regard to physics and thermodynamics. em- Jr £j
- 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
,9L..
ci If
- 7. indicates.--[p If time compression techniques are used, the scenario summary clearly so indicates.e-... ,,,,
Operators have sufficient time to carry out expected activities without undue time constraints. - Cues are given.
- 8. The simulator modeling is not altered.
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
- 10. Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section 0.5 D.5 of ES-301. p$j i-f
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
j 1 A.
- 12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
13.
- 13. The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d) D.S.d) Actual Attributes -- -- -- 1.
- 1. Total malfunctions malfunctions (58)
(5-8) 6 //0/"1-G2 /
~ ) Jr A"J
- 2. Malfunctions after EOP entry (12)
Malfunctions (1-2) i //2../2.
.. 2.. / 2 ;{& j;} d:J
- 3. Abnormal events (2-4) (24) 3 /. /.?' // 4 4 r;{:/j 1r,j ~/ fi
- 4. Major transients (1-2)
(12) 2 // i1.. // i1. ;]i) Li-
- 2. JJ" b ._.t/
- 5. EOP5 entered/requiring substantive actions (12)
EOPs (1-2) t- //2
- 2. I/ 2.- Z. (~~ .j}
J.. ..1;1. 6.
- 6. EOP contingencies EOP contingencies requiring substantive substantive actions actions (02)
(0-2) ji // lI / L.. L. r;{~ {j iY J.r £.1
..?J 7.
- 7. Critical Critical tasks (23)
(2-3) 4 // S // (;,1 ~O Jy ~ ES-301, Page 25 of 27
ES-301 ES-301 Transient and Event Event Checklist Form Form ES-301-5 ES-301-5 JAn4 FaciIity:1rl FacilitY:'T ur \:.e,,( 'Yo',{\';-
?c,.-ir Date of Date of Exam: C,41c/ZCCY7 Exam: 04/3<.)/2(.)(Y7- Operating Test Operatinq Test No.:
No.: A E Scenarios P VV P E 11 2 3 4 T M M L N 00 I I T T N CREW CREW CREW CREW C A I POSITION POSITION POSITION POSITION POSITION A T L M N Y S A B B S A B S A B S A B U T P R T 00 R T 00 R T 00 R T 00 M(*) M(*) E 00 C P 00 C P 00 C P 00 C P R I U Ej RX ij i - 1 i
- 1Lj_ i - 1110 1 0
~O-I jj NOR I/C IIC ijQiO 214 2-0 2- -
- .:l 0
*4- 3:-
LO
.l 554 0
A.
-- 1iii 4442 1 1 4 2 Ef-O-U U MAJ z Z
.~
zZ t l l.-221 .L - 2 2 1 TS 2 Z ~ 2Z -
, - 0022 2 2 RX - 0 rj. i j
- 1j j 1 1110 1 0 00 EJO-I NOR l
Qj_ 0 .i
- 0 ij --ojiii 0 i 1 1 1
.- 2. .-
aLI O-Uou - I/C IIC MAJ TS - 2 2-2 Z ..- 3 J 4-4 ii
- 44 3
-Li 221 i
i 4 2 2 1 0022 4 2 2 2 RO RX 11 11 0 D NOR 1 1 15 0 1 1 a U o-u I/C MAJ TS 4 2 2 1 221 0 4 2 2 2 aq EjO-1 RX NOR 11 11 11 1111 0 a [J OU ou - I/C MAJ TS z:zz 4 2 0 4 2 22 2 1 22 Instructions: Instructions: 1.
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls "at-the-controls (ATC)
(ATC)" and balance-of-plant "balance-of-plant (BOP) (BOP)" positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) (I/G) malfunctions and one major transient, in the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but mustmust be significant per Section C.2.a of Appendix D. (*) (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on aa 1-for-1 1-for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight insight to the applicants applicant's competence count toward the minimum requirements specified for the applicants applicant's license levellevel in the right-hand columns.
ES-301, Page 26 of 27
ES-301 ES-301 Competencies Checklist Competencies Checklist Form Form ES-301-6 ES-301-6
/V42 Facility:
Facility: Tur"e'1 POII')t. Date Date of Examination: Oy of Examination: 10-1 Oi Operating Operating Test No.: No.: APPLICANTS RO RO 0D RoO\\c)~ ROt2 RO(a'P) RO(& t&I RO RO 0D SRO-l ~ SRO-I I SRO-l 0 SRO-I E1 SRO-l 0 SRO-I D SRO-I 0D SRO-U 0 D SRO-U 0 I SRO-U 0 D SRO-U 0D Competencies SCENARIO SCENARIO SCENARIO SCENARIO 11 223412341234 3 4 1 2 3 4 1 2 3 4 1234 1 2 3 4 2,3 2,3 .l,Z. .LZ zZ ~.44 2..3 3,4 .2.3-2j :1, ~33 4.4... \ ~3.'5 ~4' Interpret/Diagnose } . '5 5:6 'i>,fo 5,f;, 40,S' 4 4,0 1, 5, 4 It.> to,f&:" ~i7 G>i.,.C:::b ~ Events and Conditions fi,l(:,
.1..,2.
jZ li,l. j,Zj I '2. 2,3 i. ,3 2,4.*2.3, 2/4~ 3 i,ZL,L 1/Z 1,2- 1:3 Comply With and 34
~4 ~{J ~L~~
34 4
~>t 15,~ 4.44 4,4" --ta,S :~'1 ~4.. 4,4u.
4' Use Procedures (1) s:
*t 2 ~b63 b .. (;;, ~,:? e.,~ Co, Col->
G=>
'" !:,~
~r zA* 2~
Z..422,3 2 '3 ,(,'2. ,,3 Operate Control Boards (2) 5,0 4.Jb ~); 5,<<:' <=-,~ s <Ob
- 4,4;, 4,4",
15;~* SC to, . S,\c. 3.4 I!}t l~
'iZ i,. !~
i~ It~lt.>d ~l i,Z. i,2 ~ Z% Z. 2.':3- L3
..(,~
'Z 1,2 tt,21,z t,~
Communicate I annteract f~ p ~, 3/L -
,,-,:;> ç C;,
5,
,(, ,
4 4 3,4-j,4 4,
~/S 44 by~b and Interact r:;"k,tl> 1.,
?' ib
,z .ZL,z
(,2 t\ I l.. Demonstrate SupervisoryAbility(3) 34.
~4- ,5 ~t-34.
(;,,-~:1~ Supervisory Ability (3) (~, 0' Comply With and Use Tech. Specs. (3) 2 4 ,4 2A 2,4- (,3 3 Notes: (1) (1 ) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. Instructions: applicants' license type and Check the applicants and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. applicant. ES-301, Page ES-301, Page 27 27 of of 27 27
ES-401, Rev. 9 Written Examination Quality ChecklistForm ES-401-6 Facility: Turkey Point Units 3 3&4 Date of Exam: May 2007 Exam Level: RORD SRO Initial a b* b* c#
- 1. Questions and answers are technically accurate and applicable to the facility. IAJ 1,u) )
hr ~d
- 2. a. NRC KIAs are referenced for all questions.
- b. Facility learning objectives are referenced as available. IAJ LA-i )J-Jt ~;f ,41
- 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 LJ i) J_
};t- I~;t
- 4. The sampling process was random and systematic (If more than 4 RO RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). fij
- 5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_X the audit exam was systematically and randomly developed, or _ the audit exam was completed before the license exam was started, or _ the examinations were developed independently, or t,J % ,4,t
.-lJ-
_ the licensee certifies that there is no duplication, or _ other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO distribution(s) at right.
RD I SRO-only question IN tAJ lJ-J,:r ~./ 311 3/1 010 0/0 72124 72/24
- 7. Between 50 and 60 percent of the questions on the RO RD exam Memory CIA are written at the comprehensionl comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly selected KIAs support the higher cognitive levels; enter the actual RO RD I jJJ )}
vJ J3.. c "cL SRO question distribution(s) at right. 3116 31/6 44119 44/19
- 8. Referenceslhandouts provided do not give away answers or aid in the elimination of distractors.
References/handouts W LA)
~ LJ
- 9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. LJ )f ~/
- 10. Question psychometric quality and format meet the guidelines in ES Appendix B. \) j tV }J- fi.;L
,J
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct v"J }J ~,/
0_1 and agrees with the value on the cover sheet. Printed NameName!I Signature Date
- a. Author JC. t\~\\~r tJ,C. k) ~
// [.J.(
- b. (*)
Facility Reviewer (*) (f.1 iLctujkl 6j.\. ip C(çw
<:'1 uQ \",,1 Vr. ]I .l:/((/:Z<P-.u.(...tf A ~J
- c. NRC Chief Examiner (#) £~ -", rl L-d:? -Trrirt..4
/.~,.l _J ~ /.,t. '67
/<.:.> \' .... 'r 14 AA t;.. I ;~"....1-J)vv~
- d. NRC Regional Supervisor -/\ik6--
/
f I/ 4fz4f"? Note:
- reviewers initialslsignature are not applicable for NRC-developed examinations.
- The facility reviewer's
# Independent NRC reviewer initial items in Column HC"; c; chief examiner concurrence required.
1
Rev. 9 ES-401, Rev. Examination Review Written Examination Review Worksheet Form Form ES-401-9 ES-401-9 1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# LOK Q# LOK LOD ~--~--~--~--~--~~~----~--~--~--~~ LOD (F/H) (F/H) (1-5) Stem Cues (1-5) Cues T/FT/F Credo Cred. Partial Partial Job- Minutia Minutia #/ #1 Back-Back- Q= Q SRO utE/S SRO U/E/S Explanation Explanation Focus Focus Dist. Dist. Link Link units ward KIA units K/A Only Instructions Instructions fRefer to [Refer to Section Section DD of of ES-401 andand Appendix Appendix B forfor additional additional information regarding regarding each each ofof the the following following concepts.] concepts.] 1.
- 1. Enter level of Enter the level knowledge (LOK) of knowledge (LOK) of question as of each question either (F)undamental as either (F)undamental or (H)igher (H)igher cognitive cognitive level.
level. 2.
- 2. Enter the level of difficulty (LOD) of each question using a 11 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box Check box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (Le., (i.e., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
- 4. Check the Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (Le., (i.e., the question has a valid KIA K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved KIA K/A and those that are designated SRO-only (KIA (K/A and license level mismatches are unacceptable).
- 6. reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
Based on the reviewer's
- 7. At a minimum, explain exLn any "U" U ratings (e.how Appendixsychometdc e.g., how the Appendix B psychometric attributes are not being met).
1 1 xx xx Stem not well written. Distractors 1, 1, 2 and 33 are not plausible. One failed LT LT and aa second failed LT LT should result in an automatic trip. For the H H U/S given conditions the reactor should have tripped. (ATWAS) IfIf an automatic action failed to occur, why would anyone wait 77 hours to make it happen. Contradicts expected operator actions when automatic actions failed to occur. MADE MADE CHANGES CHANGES TO STEM STEM AND DISTRACTOR. 22 22 Xx Xx U/S U/S Additional information Additional information needed needed in in stem. stem. For For the conditions given given why why expect there to be aa delay would we expect delay inin injection injection of of RHR. There is is no no H H indication of what pressure is. indication is. RHR RHR could be be injecting, injecting, therefore, subcooling should not subcooling not be affected. affected. Distractor Distractor C C can can also also be be correct for for aa short short time. time. Distractor Distractor D D indicates indicates that that the the RHR RHR pump pump isis presently presently running. running. MADE MADE CHANGES CHANGES TO TO STEM STEM AND AND DISTRACTORS. DISTRACTORS.
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# LOK Q# LOK LCD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job- Minutia #1 Job- Minutia Back-
#1 8ack- Q=
Q SRO utE/S SRO U/E/S Explanation Explanation Focus Focus Dt. Dis!. Lnk__ts Link w&d units ward A Only KIA 33 X U/S Distractor A not plausible. Distractor plausible. II do not know know of any interlocks that would wnning. IfIf I manually stop a pump, why would II not be able keep a pump running. able to restart that pump (Distractor 8). B). WILL MAKE CHANGES TO DISTRACTORS. 44 H 2 S MADE CHANGES TO DISTRACTORS MADE DISTRACTORS AFTER REVIEW REVIEW (4/4) 5 H 2 S OK 6 H H 3 X E/S Stem should identify procedure. CHANGED STEM AND DISTRACTORS 7 H H 2 S MADE CHANGES IN THE STEM AND DISTRACTORS I I
ES-401, Rev. 9 2 Form ES-401-9 1.
- 1. 2. Psychometric Flaws
- 3. Psychometric Flaws Flaws
- 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD i (F/H) (1-5) Stem Cues T/F Cred. Partial Credo Partial Job- Minutia #1 Back- Q Q= SRO U/E/S Explanation Focus Dt. Dist. Unk_unftsw&d Link units ward A_________ KIA Only ______ 2 X X U/S Too much given in the stem and lead in to distractor. We tell the H H applicant that a turbine runback will occur. We ask what will initially occur. Distractor A is given as correct. Distractor B is also correct based on question asked. Distroctor B is supported by distractor analysis MADE CHANGES TO STEM AND DISTRACTORS H 2 X X U/E/S Out of the blue we give them two valve numbers. Why is this considered comprhension? It appears that we are only asking the applicant to remember which valve is normally open or close in this step. Question is poorley written. CONVINCED US THAT WHAT THEY SUPPliED SUPPLIED WAS OK. 0 F F 1/2 S OK 1 1 H H 2 X X U/S Distractors A and B B are not plausible. CHANGED DISTRACTORS 2 H H 2 X U/S Distractors are not plausible. II have a sheared header and no depressurization?????????? MADE CHANGES TO DISTRACTORS 3 F I 1 X U/S B and C are not plausible CHANGED DISTRACTORS AND Distractors Band STEM (DISCUSSED THIS QUESTION FOR A PERIOD OF TIME) 4 F 1 1 X X U/S T/F The only information needed in the stem is Unit 3 annunciators go dark. What procedures should be entered if all CR annunciators go dark. Check to see what automatic actions would occur if loss of dc bus would occur. Some of the automatic actions identified in section3.0 of procedure do not appear to be auto actions. Many appear to be facts...CHANGES facts ... CHANGES MADE TO STEM. 5 H H 33 X S/E/S S/EIS Could there be more than one correct answer? As IA pressure continues to decrease and the reactor is tripped, would the components not go to their failed safe position??????? CHANGED STEM AND DISTRACTORS DIS TRACTORS 6 H/F 22 U/S **** Distractors A & B not plausible **** CHANGED DISTRACTORS BUT WF WE STILL NEED TO LOOK AT THIS ONE NOT TOTALLY ACCEPTABLE*WROTE ACCEPTABLE*WROTE A NEW QUESTIONS .. EXCEPTED THE NEW NEW QUESTIONS.. NEW QUESTION** QUESTION" 77 H H 22 S S OK
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# Q# LOK LOK LCD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem T/F Cues T/F Cred. Partial Credo Partial Job-Job- Minutia #1 Back-Minutia #/ Back- Q= Q= SROSRO utE/S U/E/S Explanation Explanation Focus Focus Dt. Dist. Unk Link wd KIA units ward A Only 88 H H 3 S/S SIS expect to start bleed Would you expect bleed and and feed with the RCPs RCPs running? running? AGREED WITH COMMENTS. MADE CHANGES TO DISTRACTOR. DISTRACTOR. 99 F F 11 X X S?/S Need to explain the the relationships between (connection (connection that might allow air/radiation flow) air/radiation flow) the the various buildings buildings during during Mode Mode 6.
- 6. In In this this mode mode would itit not not be possible, depending be possible, depending on on what doors/hatches doors/hatches are are open for for increased radiation levels to be seen in different areas? If so, there could be multiple answers. WILL REVISE QUESTION OR SELECT A A NEW KIA KJA AND WRITE A NEW QUESTION ***** WROTE NEW -----
QUESTION - ACCEPTABLE 00 H H 3 X X X U/S Missing word in stem. Distractors A and 0D are not plausible ADDED WORD TO STEM AND CHANGED DISTRACTORS ~11 F F 2 X X E/S What is there in the stem that would be a direct indication that Tavg dropped to the low Tavg set point. Distractors C & 0 D ***CHANGED STEM AND DISTRACTORS 2 2 F F 11 X X U/S II do not know of any cases where turning a transfer switch would automatically align a train (Distractor C). Is local control not the same as transfer of control to the ASP? To just say local control could mean to take local control of the valves operation at the ASP ...... CHANGED THE STEM AND DISTRACTORS 3 3 H H 2 X X X X E/S Reword stem and distractors (grammar). Containment pressure is 25 psig ... Is this something the RO is required to know.... psig... know.... CSF entry and transition point, then what to do once the transition is made? CHANGED THE STEM AND DISTRACTORS. 44 FF 11 U/S uts At what pressure will the accumulators accumulators inject (example of no lesson lesson plan or SDSO identified typical throughout). Distractors A & B B are not plausible. Make no sense - decrease pressure to 180, 180, isolate at 350 MADE CHANGES CHANGES TO STEM STEM ANDAND DISTRACTORS DISTRACTORS 55 FF 11 X X XX E/S E/S Stem Stem could could bebe re worded. worded. Is 0 not Is distractor D not correct? correct? Define Define "reinitiate" reinitiate
- define seal return is define "seal is restored.
restored." CHANGED STEM AND AND DISTRACTORS 66 FF 11 X X E/S Reword stem. Order of stem. "Order of methods methods" ??? CHANGED CHANGED STEMSTEM AND AND DISTRACTORS DISTRACTORS
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# Q# LOK LOK LOD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job- Minutia Minutia #/
#1 Back-Back- Q=Q SRO utE/S SRO U/E/S Explanation Explanation Focus Focus Dt.
Dist. Unk_t Link swaAO units ward KIA Only n______________ ~7 7 F 11 X EIS E/S Stem should ask what are the bases? As written, could some of the other answer not identify something that is accomplished by starting the the an RCP? CHANGED THE STEM P88 H 22 X X E Reword stem. Put all plant conditions in one section ..... 3B RCP ... RCP... 9 F 11 S OK ~D0 F 11 XX U?/S Explain how kla k/a match CHANGED THE STEM AND DISTRACTORS ~11 F 11 X X X X E/S Why would you operate HCV-4-758? CHANGED STEM 2 F 11 X X E/S Re-write stem. Unnecessary information in stem - RCS pressure - pressure... Question is testing knowledge of 2 minute time delay associated with resetting SI. Justification for level 2 as you identified is not correct per the note on drawing. CHANGED STEM AND DISTRACTOR .13 3 F F 11 X X U/S utS What does the applicant have to predict and/or monitor. It appears that we are asking the applicant what actions must be taken to reduce PRT procedure.... Please explain! CHANGED THE pressure per applicable procedure.... STEM AND THE DISTRACTOR 44 F F 1 1 S?/S What occurs if there is no LOMC LOAAC and the switch is taken to stop position CHANGED THE STEM 55 FF 11 X X U? Two answers..., answers .... Is D 0 not true? Explain OFF less than 2210; ON greater than 2210 .......... IfIf the heaters cycle off & on what would be off & be the effect of taking manual control? NEW NEW QUESTION PROVIDED OK -OK 66 FF 11 X X S/E/S How many How many transmitters failures/signals are requires to generate generate aa reacto trip? (Logic). trip?. (Logic). Per Per the information information given given in in the stem, will will aa reactor trip trip occur? CHANGED occur? CHANGED THE STEM STEM ANDAND THETHE DISTRACTORS DISTRACTORS 77 HH 22 ?/S
?/S Please explain Please explain how how logic logic is is not not affected affected once once the the N-42 N-42 failure failure occurs?
occurs? CHANGED THE CHANGED THE STEM STEM AND AND THETHE DISTRACTORS DISTRACTORS 88 HH 22 XX XX UU Cue in Cue in the the stem. stem. How How can can you say say that that H H 5/2 5/2 is is not not in in alarm alarm ifif the the annunciator is annunciator is lit. lit. Distractors Distractors CC& & D0 therefore therefore not not plausible. plausible. 99 HH 22 5S OK OK
1.
- 1. 2.
- 2. 3. Psychometric
- 3. Psychometric Flaws Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# Q# LOK LOK LOD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem TIE Cues T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1#1 Back-Back- Q= Q= ISRO SRO utE/S UIE/S Explanation Explanation Focus Focus Dt. Dist. Unk Link wa KIA units ward KJA Only 00 H H X X X E/S K/A does not KIA match. II do not not match. not see how how the question is is tied to interlocks. interlocks. Please explain. Is Please Is this question asking asking the applicant to answer the question based on information embedded deep in the procedure? procedure? II dodo ties to lessons plans to prevent the applicant from not see any ties challenging this challenging this question. question. Rewrite Rewrite stem stem ---- Based
---- Based on on the the aa *** RE-RE WORDED STEM STEM - OUESTION
- OUESTION IS IS OK OK -LOTS LOTS OF OF DISCUSSION DISCUSSION 11 H H 2 5 S REMOVED SOME OF THE INFORMATION FROM THE STEM 22 F F 11 X X U/E From the information provided I do not see how distractors are plausible CHANGED WORDS IN THE STEM AND REWORDED DISTRACTOR "A"
A 33 H H E MADE A COMPLETE SENTENCE FROM THE STEM 4 4 H H 11 X X E DistractorA Distractor A is not plausible DELETED WORDS FROM THE STEM - - CHANGED DISTRACTORS 5 5 F F 11 XX . U/S utS Distractors C & & D are not plausible CHANGED THE STEM AND THE DISTRACTORS 66 H H 3 ?/S Not able to find supporting documentation to support expected flow rate PROVIDED DOCUMENTATION TO SUPPORT ANSWER. 77 F F 1 1 5 S OK ~88 H H 22 5 S OK ~99 FF 11 5S OK 0 150 F F 11 SS OK 511 FF 1 1 X X E/?S EI?S Is Is the terminology correct: R19 R19" warming and and high high alarm alarm lamps? lamps"? Non Non of the information information given given in in the stem stem would indicate indicate that blowdown blowdown should have have automatically automatically isolated. isolated. Are distractors C C& & DD really plausible? CHANGED CHANGED TERMINOLOGY TERMINOLOGY TO TO MATCH MATCH PLANTWILL PLANT - WILL BRING BACKBACK NEW NEW DISTRACTORS FOR C C&& D. LOOKED AT AT REVISED QUESTION - CHANGES CHANGES ARE ACCEPTABLE ...... 2 152 FF 11 X X S/S SIS Where Where is is supporting supporting documents documents for for distractors distractors AA and and D? D? PROVIDED PROVIDED SUPPORTING SUPPORTING DOCUMENTATION
1.
- 1. 2. 3. Psychometric Flaws
- 3. Psychometric Flaws Content Flaws
- 4. Job Content Flaws Other
- 5. Other
- 5. 6.
- 6. 7.
Q# Q# LOK LOK LOD LOD (F/H) (F/H) (1-5) Stem Cues T/F Stem Cred. Partial Credo Partial Job- Minutia Minutia #1 Back-Back- Q= SRO Q SRO U/E/S U/E/S Explanation Explanation Focus Focus Dt. Dist. Unk Link wd KIA units ward A Only 3 F X X X X X X U/S As written II think th question has several answers. The stem does not ask per what procedure. II do not know of any interlocks that would prevent you from opening the Service Air valves because you failed to start the other compressors. It there a low pressure interlock? MADE A FEW CHANGES TO DISTRACTORS AND UNDERLINED WORDS IN THE STEM. THERE IS A CONCERN ABOUT PROCEDURE
. COMPLIANCE AS SUPPORTING MEANS FOR ANSWERING THE QUESTIONS.
p44 H 2 X X X X U/E/S Look at the grammar in the stem. Based on the information you provided in the stem, you violated your procedure (E-O). Per your procedure Phase A should have been manually actuated. actuated Also, based on the information given and the question asked, C could also be correct. PROVIDED A NEW QUESTION 5 F 1 1 X X S/E/S Stem should be reworded. Information concerning the S/G tube rupture appears to be "By By the way". way. Are we just asking "Given Given a Phase A Containment Isolation" Isolation what systems are affected and how should the operators respond? PROVIDED A NEW QUESTION p66 H H 2 X X E/S It looks as if there could be more than one answer to this question. There are no operator actions taken. We need to look at system overall system response (initially and after the system stabilizes). Need to look at how PCV-3-145 will respond during the transient. PROVIDED A NEW QUESTION 7 157 H H 22 S S FOLLOWING LICENSEES LICENSEE'S REVIEW THEY WANTED TO CHANGED THE QUESTION - AGREED WITH THE CHANGE p88 HH 22 5S OK J99 HH 22 5S OK jO0 FF 11 X X XX E/S Insufficient information provided in the stem. Based on the lack lack of information given and assumptions that can be made there can be more more than one correct answer. There are no no indications indications of levels of radiation or rad monitors monitors inin alarm. No alarms ..... ADDED INFORMATION INFORMATION TO DISTRACTORS THE STEM AN DISTRACTORS j11 HH 22 X X XX U/S U/S Consider rewording the stem. Consider stem. Distractors Distractors A & &D 0 are are not not plausible. plausible. Unable Unable to to locate locate supporting supporting documentation documentation to to show show that that D 0 is is plausible plausible PROVIDED PROVIDED SUPPORTING DOCUMENTATION DOCUMENTATION TO SHOW THAT TO SHOW THAT DISTRACTOR D DISTRACTOR 0 WAS WAS PLAUSIBLE PLAUSIBLE
1.
- 1. 2. Psychometric Flaws
- 3. Psychometric Flaws Flaws
- 4. Job Content Flaws Other
- 5. Other 6. 7.
7. Q# LOK LOK LOD LOD (F/H) (1-5) Stem Cues T/FT/F Cred. Partial Credo Minutia #1 Back-Partial Job- Minutia Q SRO Q= UlE/S UIEIS Explanation Explanation Focus Focus . Dist. Unk Link wa unitsS ward K KlA Only ~22 H 2 X U/S II do not see how A & & B could be plausible. If a switch is in Auto, how can an operator initiate an action. PROVIDED INFORMATION TO SUPPORT THE PLAUSIBILITY OF THE DISTRACTORS - CHANGED DISTRACTOR 0 D - OK 1333 F 11 X U/S UlS Distractors C & & 0D are not plausible WROTE A NEW QUESTION -OK p44 H H 2 X E/S Distractor 0D is not plausible CHANGED THE STEM AND DISTRACTORS 1355 F 11 X U/S UlS Does the question address relationship between f1ammability.- flammability.- ADDED INFORMATION TO DISTRACTORS SEE TS 3.7.8 REFERS TO FLAMMABILITY LIMITS 6 136 H H 2 X X U/S As written there are more than one correct answer. If actions are taken that would return the unit to within an acceptable operating range, before the one hour, then the operator would not have to take any other actions. THEIR PROCEDURE REQUIRE THAT THEY TAKE THE ACTIONS ONCE A SAFETY LIMIT IS EXCEEDED. TAKING ACTIONS TO RETURN THE PLANT TO WITHIN AN ACCEPTABLE RANGE IS NOT ACCEPTABLE ACCORDING TO THEIR PROCEDURE. 377 F 1 1 S OK j88 F 1 1 S OK 599 F F 1 1 S OK 0 F F 1 1 S OK 1 1 H H 22 5 S OK 2 H H 2 S OK 3 H H 2 S OK 4 H H 1 1 X U/S Distractors are not plausible CHANGED THE WORDING IN THE STEM 5 H H X U/S As written the question is not written at an SRO level REPLACED THE QUESTION
1.
- 1. 2. Psychometric Flaws
- 3. Psychometric Flaws Flaws
- 4. Job Content Flaws Other
- 5. Other 6. 7.
Q# LOK LOK LOD LOD (F/H) (1-5) Stem Cues T/F T/F Cred. Partial Job- Minutia Credo Minutia #1 Back- Q=Q SRO utE/S UIEIS Explanation Focus Focus Dist. Link units ward KIA Only 6 6 H 2 X X S/E Reword stem such that it ask what actions the an SRO should direct or take. Remember these are SRO questions, therefore, they should be Dont make them appear to be a system question. worded as such. Don't REWORDED STEM 7 H 2 S OK 8 H 12 X X E/S As written the question appears to more systems related. Reword question to address SRO responsibility. CHANGED STEM 9 H 2 X X X X E/S Stem and distractors do not match. Distractors give reason because. REWORDED THE DESTRICTORS AS SUGGESTED SUGGESTED.... .... ~O0 H H 2 S OK pi1 F 1 1 5 S NEED TO GIVE TWO REFERENCES ~2 2 F 1 1 X X X X U/S Reword stem. There are unnecessary words (I&C (l&C ....
....)) Distractors are not plausible - REWORDED STEM EASY QUESTION-
- \33 F F 1 1 S 4 H H 2 S Borderline SRO - CHANGED THE STEM QUESTION IS SOMEWHAT HARDER, BUT NOT MUCH 5
- \5 H H 3 5 S CHANGED THE STEM AND THE DISTRACTORS 6 H H 2 S S WILL REWORD THE DISTRACTORS AND STEM**** STEM"" WILL REWRITE
-REVIEWED THE NEW QUESTION - QUESTION IS OK QUESTION REVIEWED 77 H H 33 5 S CHANGED THE WORDING OF THE STEM 8 H H 2 2 5 S WILL LOOK AT CHANGING THE STEM AND ASK QUESTIONS AS TO WHAT DIRECTIONS THE CREW SHOULD PERFORM"""" PERFORM CHANGED INFORMATION IN THE DISTRACTOR D. STEM AND THE DISTRACTORS ---- MADE A CHANGE TO DISTRACTORS -
QUESTION IS OK ....... ~99 H H 22 XX U/S Distractor BB not plausible. How How can aa pump be inoperable and returned to service. Inoperable, II think, means that it can not perform its function. Is there an LCO associated whh Is with the performance of OSP-75.1 OSP-75.111 CHANGED THE STEM DISTRACTORS - OK. STEM AND DISTRACTORS
1.
- 1. 2.
- 2. 3. Psychometric Flaws
- 3. Psychometric Flaws 4. Job
- 4. Content Flaws Job Content Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# Q# LOK LOK LOD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
#1 Back-Back- Q=
z 15R0 SRO U/E/S U/E/5 Explanation Explanation Focus Focus Dt. Link Dist. Unk wa KIA Only units ward ~O0 F F 11 X X X U/S Week stem. Temperature switch identified identified as PRMS-11/12 PRMS-11/12 (both) (both) IfIf a instrument/switch fails how how can itit not not affect the way the system operates unless itit is bypassed? unless bypassed? This is is not the case!!!! Distractors Distractors not plausible. plausible. CHANGED STEM AND DESTRICTOR. ~11 F F 1I X E E appear to ask the applicant We appear applicant to pick pick the the most most correct correct answer. answer. The The may could mean can or will not.. word "may" not .... "MAY" MAY COMES DIRECTLY FROM THE PROCEDUREPROCEDURE.... .... CHANGED WORDING IN THE DISTRACTORS ~22 H H 11 X U/S UlS Distractors A & 0D not plausible. There is no reason to think the alarm is not valid based on the information provided in the stem. The alarm came in and an increase was noted. There is no indication that it was a failed component. What does the ARP state? CHANGED THE QUESTIONS ~33 H H 3 S OKMADEACHANGETOTHESTEM OK - MADE A CHANGE TO THE STEM 4 ~4 H H 2 5 S X U/S UlS As written this appears to be a RO question. Distractor 0D is not plausible. 0 D states "outside outside the operational space." space. Given this one would expect that a limit would be exceeded in operations continued. REPLACED QUESTION 5 95 F F 1 1 X X X U U As written there could be two correct answers. II could not locate documentation concerning temperature difference and plant configuration. CHANGED THE STEM TO INCLUDE FOR THE ABOVE CONDITION 6 96 HH 22 S S OK 7 97 FF 1 1 S OK 8 98 FF 11 X E/S Reword stem. As the SRO SRO ..... whatwhat action should the refueling floor floor operator operator be directed directed to to ....... CHANGED THE THE DISTRACTOR. DISTRACTOR. 9 99 HH 22 X EE What are are we we testing here? here? II do do not not see see why why 6060 degrees degrees and and 80 80 degrees degrees are plausible. Please Please explain explain..... NeedNeed to review reference for the bases. CHANGE 60 TO TO 100, 100, WHICH IS IS THE NORMAL COOL COOL DOWNDOWN RATE. RATE. CHANGED WORDING IN IN THE STEM STEM
1.
- 1. 2.
- 2. Psychometric Flaws 3.3. Psychometric Flaws 4. Job
- 4. Job Content Content Flaws Flaws 5. Other
- 5. Other 6.
- 6. 7.
7. Q# Q# LOK LOK LOD LOD (F/H) (F/H) (1-5) (1-5) Stem Cues Stem Cues T/F T/F Cred. Partial Credo Partial Job-Job- Minutia Minutia #1
#1 Back-Back- Q=
Q SRO SRO U/E/S U/E/S Explanation Explanation Focus Focus Dist. Link units ward KIA Only 00 H H 11 X E/S E/S The stem The stem is is cuing cuing the the applicant. applicant. Consider Consider rewording rewording the the stem 00 X stem to: to: Unit Unit 4 has experienced has experienced aa large break LOCA. large break LOCA. The The unit unit RO RO reports reports the the following following plant conditions: Containment plant conditions: Containment Pressure Pressure ..... Which Which reference reference dodo you you want want toto provide? provide? Need Need toto evaluate evaluate decision decision made made atat box box 2.
- 2. MADE MADE CHANGES TO CHANGES TO THE THE STEM.
STEM. EXPLAINED EXPLAINED TO TO DETAILS DETAILS ABOUT ABOUT BOX. BOX. WANT WANT TO TO GIVE GIVE FLOW FLOW BOX.BOX.
ES-501, Rev. ES-501, Rev. 99 Post-Examination Check Post-Examination Check Sheet Sheet Form Form ES-501-1 ES-501-1 Post-Examination Check Sheet Facility: Turkey Point Point Date of Examination: Date Examination: 4/30 - 5/4/2007 Task Description Date Complete
- 1. Facility written exam comments or graded exams received 5/1 1/2007 5/11/2007 and verified complete
- 2. Facility written exam comments reviewed and incorporated N/A and NRC grading completed, if necessary
- 3. Operating tests graded by NRC examiners 5/30/2007
- 4. NRC chief examiner review of operating test and written exam 6/412007 6/4/2007 grading completed
- 5. Responsible supervisor review completed 6/8/2007
- 6. Management (licensing official) review completed 6/8/2007
- 7. License and denial letters mailed /2007 6/8/2007 6/8 8.
- 8. Facility notified notified of results 6/8/2007 9.
- 9. Examination Examination report issued issued (refer (refer to to NRC NRC MC MC 0612) 0612) 6/13/2007 6/13/2007 10.
- 10. Reference Reference material returned after after final resolution of any appeals of any appeals N/A}}