ML101650281
| ML101650281 | |
| Person / Time | |
|---|---|
| Site: | Farley  |
| Issue date: | 06/07/2010 |
| From: | NRC/RGN-II |
| To: | Southern Nuclear Operating Co |
| References | |
| 50-348/10-301, 50-364/10-301 | |
| Download: ML101650281 (38) | |
Text
{{#Wiki_filter:ES-201 ES*201 Examination Preparation Checklist Examination ES-201-1 Form ES*201*1 Facility: Facility: rAAl,td Date of Date Examination: of Examination: I1r I1pNl D\/ 6010ID Developed by: Written - Facility
- G2l NRC 0 /III Operating - Facility [2] NRCD
- NRC D Target Chief Date*
Date* Task Description (Reference) Examiners Examiner's Initials Initials
-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) ,q3 mf3
-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)
Iff2 2
,t)
-120 3,
- 3. Facility contact briefed on security and other requirements (C.2.c) fJ1f2
-120 4. Corporate notification letter sent (C.2.d) /fl!)
!Y/J!J
[-90] [5. [S. Reference material due (C.1.e; C.3.c; Attachment 3)] f(/f; {-75} {-7S} 6. ES-201-2, ES-201-3, Integrated examination outline(s) due, including Forms E5-201-2, ES-D-ls, ES-401-1/2, ES-401-3, and ES-301-5, ES-D-1's, ES-301-1, ES-301-2, ES-301-S, ES-401-4, as applicable (C.1.e(C.1 .e and f; C.3.d) mf2
/7l24
{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility faility (C.2h; C.3.e)} licensee (C.2.h; IfIj {-45} {-4S} 8. Proposed examinations (including written, walk-through JPMs, JPM5, and scenarios, as applicable), supporting documentation (including Forms ES-301-5, ES-301-6, and ES-401-6, and any Form ES-301-3, ES-301-4, ES-301-S, ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d) mb I
-30 9. Preliminary license applications (NRC Form 398's) 398s) due (C.1.1; (C.1,l; C.2.g; ES-202) ;r$
-14 10. Final license applications due and Form ES-201-4 prepared (C.1.1: (CII; C.2.i; ES-202) ffI8
-14 11. Examination approved by NRC supervisor for facility licensee review 11.
(C.2.h; C.3.f)
!YfD
-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) 12.
~
-7 13. Written examinations and operating tests approved by NRC supervisor 13.
(C.2.i; C.3.h) fJ1!i fn
-7 14. Final applications reviewed; 11 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; S; ES-202, C.2.e; ES-204) mJ3
-7 15.
1S. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k) IrtE
-7 16.
- 16. Approved scenarios, job performance performance measures, and questions distributed distributed to NRC examiners (C.3.i)
~
- Target dates are generally based on facility-prepared examinations examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on aa case-by case-by-case basis in coordination with the facility licensee.
[Applies only] {Does notnot apply} to examinations prepared by the NRC. ES-201, Page 25 of 28
ES-201 -2 ES-201-2 Examination Outline Examination Outline Quality Quality ChecklistChecklist OUTLINE SUBMITTAL OUTLINE SUBMITTAL Facility: Facility: Farley Nuclear Farley Nuclear PlantPlant Date of Date Examination: of Examination: April 5,2010 April 5, 2010 Operating Operating Test Test Number: Number: FA2010-301 FA2O1O-301 Initials initials Item Item Task Description Task Description aa b* b* C# w 1.1. a.a. Verify Verify that that the outline(s) fit(s) the outline(s) fit(s) the the appropriate appropriate model, model, inin accordance accordance with with ES-401. ES-401. t<R Pto ~ W R R b. whether the Assess whether
- b. Assess outline was the outline was systematically systematically and randomly prepared and randomly prepared in in accordance accordance withwith II Section 0.1 Section D.1 ofof ES-401 ES-401 and and whether whether all all KIA categories are K/A categories appropriately sampled.
are appropriately sampled. tJZ pe. jc. rib TT TT c. Assess
- c. whether the Assess whether outline over-emphasizes the outline over-emphasizes any any systems, systems, evolutions, evolutions, or or generic generic topics.
topics. C4( J'Ju Ito . rm? E ni N
- d. Assess
- d. Assess whether whether the justifications for the justifications for deselected deselected or or rejected K/A statements rejected KIA statements are are appropriate.
appropriate. (4. (>L. f4\ pr.. IWf:> 2.2. a. Using Form
- a. USing ES-301 -5, verify Form ES-301-5, verify that that the the proposed proposed scenario scenario sets sets cover cover the the required required number number S
of normal normal evolutions, and major evolutions, instrument transients. major transients. instrument and component failures, and component failures, technical technical specifications, specifications, CcJ< ~ JW(.O tfib S and I MM b. Assess whether
- b. Assess whether there there are are enough enough scenario scenario setssets (and (and spares) spares) to to test the projected test the projected number number and mix mix of of applicants applicants in in accordance accordance with with the U U and the expected expected crew composition and crew composition and rotation rotation schedule schedule
()- WI fM'
~rtP without compromising compromising exam integrity, and and ensure that each applicantapplicant can be tested using L
at least one new or significantly modified modified scenario, that no scenarios are duplicated P AA TT applicants audit from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days.
~ r£>
0
~
- c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1)) the outline(s) contain(s) the required number of control room and in-plant tasks (1 W distributed among the safety functions as specified on the form T I 1 (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' applicants audit test(s) 14fr ~
/
LfJc () ~ (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verify Verify that the administrative administrative outline meets the criteria specified on Form ES-301 ES-301-1:
-1:
(1)) the tasks are distributed distributed among the topics as specified on the form (1 (2) at least one task is new or significantly Significantly modified CtR.
.I ~ {Yt$
(3) nono more more than one one task is repeated from the last last two NRC licensing examinations -
- c. Determine if there are enough of applicants and enough different and ensure that no items different outlines to to test the projected number and mix items are duplicated on subsequent days. UR c.tA nfP
~
4.
- 4. a. Assess whether
- a. whether plant-specific priorities (including PRA and priorities (including and IPE IPE insights) inSights) are covered in in the appropriate exam exam sections. f4C- ~
G E b.
- b. Assess whether whether the the 10 10 CFR CFR 55.41/43 55.41/43 and and 55.45 55.45 sampling sampling is is appropriate.
appropriate. 4A JjCtf>
,QCQ fls N
E
- c. Ensure
- c. Ensure thatthat K/A KIA importance importance ratings ratings (except (except for for plant-specific plant-specific priorities) priorities) are are at at least least 2.5.
2.5. 4<< 6.R ~
~
R R A d.
- d. Check Check forfor duplication duplication and and overlap overlap among among examexam sections.
sections. t4< (J 4R. ~ !&. <<f1S LL e. Check
- e. Check thethe entire entire exam exam for for balance balance of of coverage.
coverage. 'td2- f.. {kIJ m$ 4& f.f. Assess Assess whether whether the the exam exam fits fits the the appropriate appropriate job job level level (RO (RO oror SRO). SRO). ltf=- 6 i - O rn15 p t,d
- a. Author Lr_~~~ignature ISignature Date Date
- a. Author C. Vince C. Vince Richter/
Richter 1 03/24/10 b.
- b. Facility Facility Reviewer Reviewer (*)
(*) Gary Garv Ohmstede Ohmstede /1 DM ____ v 03/24/10 03/24/10 03/24/10 c.c. NRC Chief Examiner (#) NRC Chief Examiner (#) l'I\A?\I. ,"'. B415 / tr J.,J<.U..I,,d;;;;:""-=---::'
"BA fe-5 / /74I27 - tJ'3L.7.sL;'I.()ID d.d. NRC NRC Supervisor Supervisor UAUDIJr1.
JJLlJlJtll-:f. W1AL1! WIOAlMJAf / (",r;-..... Nc_... J p¥1fI/11J
/29/ic
// (i WlJ:tfJ 11ft I Note:
Note: ## Independent Independent NRC NRC reviewer reviewer initial items inin Column initial items Column c;"c"; chief chief examiner examiner concurrence concurrence required. required.
- Not Not applicable applicable for for NRC-prepare NRC-prepared d examination examination outlines outlines
ES-201-3 Examination Security Agreement I .2 2..
- 1. Pre-Examination
\.f-S
$.2OL
_Zo<o tt.AtI" Uto (t4ViJ.C( II acknowledge that II have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of -86 8294El- 8 as of the date of my signature. II agree that II will not knowingly divulge any information about these examinations to any persons who have not beef bee'ft~i1fliorized ut1orized by the NRC chief examiner. II understand that II am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, administration, except as specifically noted below and authorized by the NRC (e.g., acting as aa simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, II am aware of the physical security measures and requirements (as documented in the facility licensees licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. II will immediately report to facility management or the NRC NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. PnctFxmirtinn Post-Examination tL.-.J 7
$T- .. -t
*'2.111" ?w 7c..-W t{...yJ -2610 To the best of my my knowledge, II did nO~iVUlge did noivulge to any any unauthorized unauthorized persons persons any any information concerning the NRC NRC licensing examinations administered during during the week(s) of of ~ 8 :2o/O~ s-*W!g. $-l..ztJfo. From From the date date that that II entered into into this security security agreement untiluntil the completion completion of of examination examination administraion, administration, II did did not instruct, evaluate, not instruct, evaluate, or or provide provide performance feedback to to those applicants applicants who were were administered these licensing examinations, except as as specifically notednoted below below andand authorized authorized by by the NRC. NRC.
PRINTED PRINTED NAME NAME JOB TITLE I/ RESPONSIBILITY JOB RESPONSIBILITY SIGNATURE SIGNATURE (1) (1) DATE DATE SIGNATURE (2) SIGNATURE (2) DATE NOTE DATE NOTE 1. 2.
- 1. C. Vince Richter Howard Howard Fitzwater Nuclear OPS Nuclear OPS OPS TRNG INST OPS TRNG INST INST INST 7-27-09 ~4I?-j~re~;~-;-;
ij-/2A 7-27-09 L%4( - 7-27-09 ,..-~..Jh:.~~=~--- 3.
- 3. Gary Ohmstede Gary Ohmstede Lead Instructor-Exam Instructor-Exam DeveloDment Development 'l{oA...J3~-1~7-:;-0~9~~T:~Z;;::Z::::::::=::::::::3 4.
- 4. DarI Darryl Stevenson Stevenson Control Control Technician 8-24-09 ~ ..!..L-5.5. Michael Michael Galle Galle Simulator Simulator Coordinator Coordinator 8-24-09 A4-8-24-09 444.'/;/
6.
- 6. Kevin Kevin Riley Riley Nuclear Nuclear Soecialist Specialist II ( 8 - 2 4 - 0 9 . 1 ' f -I e_ _
8-24-09 7.
- 7. /..I? t..J1l..I.,.IF"~D iPoD S-:'S "tWIO_ _
qwio r. 8.
- 8. m , L4 W)ZHDlT rv- WILHo I I 0 . 'f-Zl-(O_ _
- 9. -;i'tloc:losefb
- 9. ~s S S ~ () _ _
fF~L£~
- 10. /.47T -Y -SSs ~.
g: i;.~;'/,:F,J~iLe {I~; {'~~P5?- ({}~f. 7~/'1~/~z,() 10. ii. KizoMe$
- 12. gp,/ PtJ) S "
*jP.<)
"11',.0 f(i I 1I 1 --
- 13. IL?r
- 13. B:I~y -rkcf'"~
Tfor Nucjtar N!4lea... nCS o(>s Trr.j Tor,.,!! 4S(1#>strc.tG.n.r ~/_O __
- 14. )QS"'- ?c: ... ~*
- 14. 3Ev_ ?o
- p. * '111111..0__
g/2)ID
- 15. J'.. /'", 4Ad,--ç
- 15. Jk.
1 A;aelrL .....$ S.>.>. I 4L-. '1-;'b-{D _ _ NOTES: NOTES: / /
ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination
.f"1JL 2ei L
'I-S-).% -'1~13 -201l:>
II acknowledge that II have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of J g t=~ as of the date of my signature. II agree that II will not knowingly divulge any information about these examinations to any persons who have not been aulfib"rized üflib°Hzed by the NRC chief examiner. II understand that II am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this gat~until administration except as specifically noted below and authorized by the NRC dateuntiI completion of examination administration, (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, II am aware of the physical security measures and requirements (as documented documented in the facility iicensee's licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. II will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination 1I~5'k'o
"'-11."1(-1 'Y z.o 4
(.j.-2 toi° to To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~. From the date that II entered into this security agreement until the completion of examination administration, II did not instruct, evaluate, or pr~rformance insiruct, providbformance feedback to those applicants who were administered these licensing examinations, except as specifically noted belovi and authorized by the NRC. below PRINTED NAME JOB TITLE I/ RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1 1.. :3"os ~ Co.. rr6 1\ SLCO,-/-OU SS-OPS. .c <:. h.:e> cl, ",I E' ..--
£kje "tAo);0 2.
- 2. 'izc.b Sz,-J!o,t 7Z 1 2,P7/
7
/--?1 ~1}.
LI /7I/er,
- 3. ~ot'\-,.,.~ io& ç çrc ~ '1)
- 4. ~\"':A--: '~~\..Jl- 5:sS 2f&1to ~'Z1-Jl_ _
- 5. ~r~t&~t:
- 5. &rv. ii. IA.) C\,v Sw GJfj "aeer-r J41Ai1*-/ /I2Jo
'1//'11/0 s uliW ~
4L1 .!#.p~rtrF 7i7M~
/lV1
- 6. I4J4 4 4c---
f..'- 4 O, tJ,4s 7.~Th~(
- 7. if?
8.-pr<~-n..~ill~
- 8. WTE '.£?.J.' ~ -Ii =¥(~ Uf11-~:~'~
ae5 qj/jo ., ~~-
- 9. tJt.JU;x. I1~DUZ-, ~ l.j~"
-w vPS 7J1d 9Pç 'fA /G - -
10.~v.+*c> ' 1 L . < s l { D _ : '/f~ io..r (.(-I4. DlJ. MGf.... CJ9£> ~i: I.e. J)o',,..erS:n<N ~<L:..:z,. ...._-Y'-?ijtJ ta::~2pt 'I,
- 13. - ----
14.
- 14. ----
15.
- 15. ----
NOTES: ES-201, Page 27 of 28
ES-301 ES-301 Administrative Topics Administrative Topics Outline Outline Form Form ES-301-1 ES-301-1 OPERATING OUTLINE OPERATING SUBMITTAL OUTLINE SUBMITTAL Facility: Farley Facility: Farley Nuclear Plant Nuclear Plant Date of Date of Examination: Examination: April April 5, 5, 2010 2010 Examination Level: Examination Level: SRO+RO SRO + RO Operating Test Operating Test Number: Number: FA2010301 FA2010301 Administrative Topic TYJ!e Describe activity to be Describe be performed performed Coo e* e (see Note) (see Note) Verification of Initial Verification Initial Conditions Conditions Prior to Core Alterations. Given a set of plant conditions with fuel movement in Given A1.1.A Conduct of Operations progress, determine if all Core Alterations initial Conduct Operations NIR N/R RO portion portion conditions are satisfied using conditions using UOP-4.1. UOP-4. 1. RO G2.1.40 (2.8/3.9) G2.1.36 (3.0/4.1) G2.1.32 (3.814.0) (3.8/4.0) Verification of Initial Conditions Prior to Core Alterations. Given a set of plant conditions with fuel movement in Al 1 A progress, determine if all Core Alterations initial A1.1.A
. conditions are satisfied using UOP-4.1, UOP-4.1 and then list all Conduct of Operations NIR N/R SRO portion
. conditions REQUIRED ACTIONS and Tech Spec conditions, COMPLETION TIMES for LCOs not met.
G2.l.40 (2.8/3.9) G2.1.40 G2.l.36 (3.0/4.1) G2.1.36 (3.0/41) G2.2.1.35 (2.2/3.9) G2.1.32 (3.8/4.0) Al .2.S A1.2.S DIR D/R Conduct A Safety Shutdown Assessment and Determine Conduct of Operations Time to Saturation. SRO ONLY SROONLY G2.l.25 (3.9/4.2) G2.1.25 A2.i.A A2.1.A Perform a Shutdown Margin Calculation in modes 1 1 &2 Equipment Control DIR D/R for a stuck rod (STP-29.5) SRO + RO SRO+RO OOlA4.1 1 (3.5/4.1) APE005 001A4.11 APEOO5 AK1.05 AK1 .05 (3.3/4.1) A3.1 .R A3.1.R M/R M/R Calculate the Maximum Permissible Stay Time within A3.1 A3.1.S.S Emergency Dose Limits. Radiation Control G2.3.4 (3.2/3.7) SRO+RO A4. 1 .A A4.1.A D IR D/R Make Initial Notifications As Required for an Emergency Emergency Plan - G2.4.43 02.4.43 RO-3.2 SRO-3.8 SRO+RO
- Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( ~ 3 for ROs; ~< 4 for SROs & RO retakes) [213] [2/3]
(N)ew or (M)odified from bank ( 1) e 1) [212] [2/2] (P)revious 22 exams ( << 1; 1; randomly selected) [010] [0/0] Farley Farley April April 2010 2010 NRC NRC ADMIN ADMIN examexam outline outline Page Page 11 of of 11
ES-301 ES-301 Control Room/In-Plant Control Room/In-Plant Systems Systems Outline Outline Form Form ES-301-2 ES-301-2 OPERATING OUTLINE OPERATING OUTLINE SUBMITTALSUBMITTAL Facility: Farley Facility: Farley Nuclear Nuclear Plant Plant Date of Date of Examination: Examination: April April 5, 5, 2010 2010 Exam Level Exam Level (both): (both): RO SRO-l RO SRO-I Operating Test Operating Test No.: No.: FA2010301 FA2O1 0301 Control Room Control Room Systems Systems (8 for RO; (8 for RO; 77 for for SRO-i) SRO-i) System /I JPM System Title JPM Title Type Code* Type Code* Safety Safety Function Function
- a. Perform an
- a. Perform an emergency emergency boration.
boration. CRO-065C CRO-065C mod. mod. 024AA2.02 3.9/4.4 024AA2.02 3.9/4.4 024AA2.01 024AA2.01 3.8/4.1 3.8/4.1 S,D,A,L S, D, A, L 11
- b. CRO-327A Align
- b. CRO-327A Align PRF System For PRF System For AA Large Large Break Break LOCALOCA S,D,L S, D, L 77 073G2.3.11 RO-3.8 073G2.3.11 RO-3.8 SRO-4.3 SRO-4.3
- c. CRO-
- c. CR0- 333E333E Perform Perform Required Required Actions Actions for for transfer transfer to simultaneous to simultaneous S,M,A,L S, M, A, L 33 hot and cold leg recirculation 006 A4.07 hot and cold leg recirculation 006 A4.07 RO 4.4 SRO RO 4.4 SRO 4.44.4
- d. Perform
- d. Perform required required actions actions inin response response to to RCP RCP Seal Seal Failures. CRO-047A Failures. CRO-047A KIA APEO1 5AA11.22 K/A APE015AA .22 4.0/4.2 4.0/4.2 S,D,A S, D, A 4p 4p 003A2.02 3.7/3.9 003A2.023.7/3.9
- e. CRO-133A Start Up The Containment Cooling System S,D,P,L 5, D, P, L 55 022A4.01 022A4.01 3.6/3.6 3.6/3.6 022A4.03 3.2/3.2 022A4.03 3.2/3.2 On On the the 2007 2007 NRC NRC examexam
- f. CRO-359E Start 1C 1 C DG From The EPB And Align To Supply 1F 1F S,M,A S, M, A 6 4160V Bus 055EA1.02 4.3/4.4 055EA1.06 4.1/4.6 055EA2.03 3.9/4.7 CR0-NEW Perform Corrective Actions In Response To a CCW
- g. CRO-NEW 8 pump trip S,D,L S, D, L 008A2.01_3.
008A2.01 3/3.6 3.3/3.6 026AA1.02 3.2/3.3
- h. CRO-406A Verify CTMT Isolation Phase '"A" A Is Actuated And S,A,D,L S, A, D, L 2 Aligned RO 013A4.01 4.5/4.8 ONLY In-Plant Systems (3 for RO; 3 for SRO-i; 3 or 2 for SRO-U)
System 1/ JPM Title Type Code* Safety Function
- i. SO - 386 Conduct aa Waste Gas release 071A4.26 (3.1/3.9)
D,R D, R 9
- j. SO-314A Operate the TDAFW pump locally without control power D,L,E D, L, E 4s 061A2.03 3.1/3.4
- k. SO-347A Place The Swing Battery Charger In In Service 058AA1 058AA1.02 .02 3.1/3.1 All control room (and 058AA1 .03 3.1/3.3 058AA1.033.1/3.3 ° D 6 (and in-plant) systems systems must must bebe different different and and serve serve different different safety safety functions; inin plant systems and functions may overlap those tested in in the control control room.
*Type
""Type Codes Codes Criteria Criteria for ROI SRO-i SRO-i [ACTUAL]
[ACTUAL] (A)lternate (A)lternate path path 4-6/4-6 4-6 [514] I 4-6 [514] (C)ontrol room (C)ontrol room [0/0] [010] (D)irect (D)irect from bank bank ~ 99/~8
< [9/8]
/ < 8 [918]
(E)mergency (E)mergency or or abnormal abnormal in-plant in-plant >~ 111/>~ 11 [111] [1/1] (L)ow-Powe (L)ow-Powerr I/ Shutdown Shutdown >~ i11
/> ~ 11 [7/6]
[716] (N)ew (N)ew oror (M)odified (M)odified from from bank bank including including 11(A) (A) >~2/~2 2 I> 2 [212] [2/2] (P)previous (P)previous 22 exams exams <~ 331/ <~ 33 (randomly (randomly selected) [1/1] selected) [Ill] (R)CA (R)CA ~ 1/ ~ 1
>1/>1 [1/1]
[Ill] (S)imulator (S)imulator [8/7] [817] Farley Farley April April 2010 NRC JPM 2010 NRC JPM examexam Page 11 of Page of 11
ES-301-3 ES-301-3 Operating Test Operating Test Quality Quality Checklist Checklist I Facility: Facility: Farley Nuclear Farley Nuclear Plant Plant Date of Date Examination: of Examination: April 5, April 2010 5, 2010 Operating Operating Test Test Number: Number: FA2010-301 FA2O1O-301 Initials Initials
- 1. General Criteria
- 1. General Criteria aa b*
b* C# cf
- a. The operating operating test conforms with test conforms with the previously approved the previously approved outline;
~
- a. The outline; changes changes are are consistent consistent with with Jjl1 sampling requirements sampling requirements (e.g., 10 CFR (e.g., 10 CFR 55.45, 55.45, operational operational importance, importance, safety safety function function distribution).
distribution). t4<- b.
- b. There is There is no no day-to-day day-to-day repetition repetition between between thisthis and and other other operating operating tests tests toto be be administered administered during this during this examination.
examination. Cd<-
~
t$ c.
- c. The operating test The test shall not duplicate shall not duplicate items applicants audit items from the applicants' audit testes).
test(s). (see (see Section Section D.1.a.) D.1 a.) 4. l<R. .t"Zb rr£ d.
- d. Overlap with Overlap with the acceptable limits.
acceptable the written limits. written examination examination and and between between different different parts parts of of the the operating operating test test is is within within uR. ~
~
I(rR
/Q I me I
- e. appears that the operating test will differentiate between competent and less-than-competent It appears ,j, applicants at the designated license level. )\0
- 2. Walk-Through Criteria --
- a. Each JPM includes the following, as applicable:
Each initial conditions initial initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important speCificspecific performance criteria that include: ltjZ I<<> nt$ detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
kR ~ rn13
- 3. Simulator Criteria -
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached. lJC- m Mf> s~nature Printed Name /1S,nature Date Date a.
- a. Author C. Vince Richter /1 C. ~;:'j/~ 3/24/2010
- b. Facility Reviewer(*)
Reviewer(*) Garv Ohmstede 1 Gary / 1At-t~ 3/24/2010 c.
- c. NRC NRC Chief Chief Examiner(#)
Examiner (#) 1't\M-",- A. I\ti. ~1'tfS /i?ZJ A. i-res I rrJ~r,~ I ,--ft..~ v
,. i.
')
o3L:J.5Llll/() o3/2S/a.w d.
- d. NRC NRC Supervisor Supervisor At w,ai/
l.L4Wktl"f. WIDM.MJ.N / uvy
,*"1#/~lJ.AI'r - ()f,IB,/J, 7
NOTE: NOTE:
- The The facility signature
## Independent signature is is not
/
not applicable for NRC-developed (( NRC-developed tests. tests. 1/ Independent NRC NRC reviewer initial items reviewer initial items inin Column Column "c"; chief examiner c; chief examiner concurrence concurrence required. required.
ES-301 -4 ES-301-4 Simulator Scenario Simulator Scenario Quality Quality Checklist Checklist Facilty: Farley Date of Exam: April 5, xam: April 2010 5, 2010 r>. Scenario Numbers: -I.. 1/3/4/5
/3/4/5 n, Operating 'T. .:~
Test No.: FA2OI 0-301 QUALITATIVE ATTRIBUTES QUALITATIVE ATTRIBUTES Initials Initials aa b* b* C#
- 1. The initial conditions are initial conditions realistic, in are realistic, in that that some equipment and/or some equipment and/or instrumentation instrumentation may
- 1. The of service, but of service, does not but itit does not cue cue the the operators operators into into expected expected events.
events. may be be out out Qj( p rW 2.
- 2. The scenarios consist The scenarios consist mostly mostly of related events.
of related events. WL tffL ~
< ~
3.
- 3. Each event Each event description description consists consists of of
*. the the point point in in the the scenario scenario when when itit is is to to be initiated be initiated (tV>
~
(-
*. the the malfunction(s) malfunction(s) that that are entered to are entered initiate the to initiate the event event
*. the the symptoms/cues symptoms/cues that that will will be be visible visible to the crew to the crew ~
*. the the expected expected operator actions (by operator actions (by shift position) shift position)
*. the event termination point point (if(if applicable) applicable) 4.
- 4. No more than No than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario incorporated into scenario 4(2
~ ()t.o
~
without aa credible preceding incident credible preceding incident suchsuch as as aa seismic seismic event. event.
- 5. The events are are valid with regard regard to to physics physics and and thermodynamics. U/l 2
(d pa p 1>>17 6.
- 6. Sequencing and timing of events is is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. ~
()t.#
\YfJ
- 7. If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given. 4/<. 44Q tJtI6
~
- 8. The simulator modeling is not altered. ~
4- fi..::> ~ g_ Q1
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
41<- c/Q {)cJO me
- 10. Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section 0.5 D.5 of ES-301. ~ fI...O mf$
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). ccA .,MA
~
- 12. Each applicant will be Significantly significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
/
4f<..- tM> {)(fo 13.
- 13. The level of difficulty is appropriate to support licensing decisions decisions for each crew position. f4<-
(qZ. ~ ,~ O Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes Scenario Numbers: 1/3/4/5 1 13/415 1.
- 1. Total malfunctions (5-8) (58) 6617/8/6
/ 7 /8 / 6 t42.. J.D ifY'{p
- 2. Malfunctions Malfunctions after after EOP entry (12)
EOP entry (1-2) 22/2/4/1
/2/4II Cyfd ~ irYX~
- 3. Abnormal events events (24)(2-4) 33/4/4/6
/ 4 / 4/6 ~ Q\A >>~~
4.
- 4. Major Major transients transients (12)(1-2) 33/1/3/3
/1 /3/3 ftP- 6\A) m~
5.
- 5. EOPs entered/requiring EOPs entered/requiring substantive substantive actions actions (12) (1-2) 11/1/1/1 I 1 /I I1 4?-
2 ~ I~V 6.
- 6. EOP EOP contingencies contingencies requiring requiring substantive substantive actions actions (02)
(0-2) 11/0/1/1
/0/1 /1 (,e.
f4: .IJI.A> 1mb 7.
- 7. Critical Critical tasks tasks (23)
(2-3) 55/4/4/3
/4/4/3 14<-
41_ ~ I~ Page Page 11 ofof 11
ES-301-5 ES-301-5 Transient and Transient Event Checklist and Event Checklist Facili~: Facility: Farley Nuclear Farley Nuclear Plant Plant Date Date of of Exam: Exam: AprilApril 5,5, 2010 2010 Operating Test o~erating Test No.:No.: FAZ010-301 FA2O1O-301 AA EE Scenarios Scenarios P P V (2not TT 1 (2 not 3 4 MM P P E E submitted 00 II submitted) L N TT N II TT CREW CREW CREW CREW CREW CREW CREW CREW A II A POSmON POSmON_9 POSITION I M CC T POSITION POSITION 9TN POSITION LL U U A T S A B B S A B S A B S A B M(*) M{*) N N Y RR T 00 R T 00 R T 00 RR T 00 00 C C P P 00 C C PP 00 CC PP 0o Cc P RR IlU U T T P P E RX 11 11 11 3 1110 1 0 SROl SRO-I OR NOR 11111 1 1 1 SRO-U I/C 234 234 234 19 4 4 2 578 567 579 8 MAJ 678 7 678 7 2221 2 1 TS 245 456 35 8 0 2 2 RX 11 - 11 113110 3 1 1 0 RO NOR - 00111 1 1 1 I/C 24 246 359 8 4 4 2 MAJ 678 7 678 7 2 2 11 TS 0 0 2222 ROl ROI RX 11 11 1110 1 0 BOP NOR 22 11111 1 1 1 I/C 357 356 247 13 4 4 2 8 78 9 MAJ 678 77 67877 678 2 2 1 21 TS 0 0 2 2 022 Instructions: 1.
- 1. Check Check the applicant level level and enter the operating test number number and Form Form ES-D-i ES-D-1 event numbers numbers for each each event type; TS are not applicable applicable for RO applicants. ROs must serve in in both both the at-the-controls "at-the-controls (ATC) (ATC)" and and balance-of-plant "balance-of-plant (BOP) (BOP)"
positions; positions; Instant SROs must serve in in both the SRO and the ATC positions, including at least two instrument or or component (I/C)(IIC) malfunctions and and one one major major transient, in the ATC position. transient, in position. IfIf anan Instant SRO additionally serves Instant SRO serves in in the BOP BOP position, position, oneone I/C IIC malfunction malfunction can be credited toward can be toward the twotwo I/CIIC malfunctions malfunctions requiredrequired for for the ATC ATC position. position. 2.
- 2. Reactivity Reactivity manipulations manipulations may may be be conducted underunder normal normal or controlled abnormal conditions or controlled conditions (refer (refer toto Section Section D.5.d) D.5.d) but must be significant per per Section C.2.a of of Appendix D. D. (*)
(*) Reactivity Reactivity andand normal normal evolutions evolutions may may be replaced with with additional additional instrument instrument or or component malfunctions malfunctions on on aa 1-for-i 1-for-1 basis. 3.
- 3. Whenever Whenever practical, practical, bothboth instrument instrument and and component component malfunctions malfunctions should should be be included; included; only only those those that that require require verifiable verifiable actions actions thatthat provide provide insight to the insight to the applicants applicant's competence competence count count toward toward thethe minimum minimum requirements requirements specifiedspecified forfor the applicants the applicant's license license level level in the right-hand in the right-hand columns.
columns. Page 11 of2 Page of2
ES-301-5 Transient and Transient and EventEvent Checklist Checklist Date of Exam: April 5, 2010 O~erating Test No.: FA2010-301 A E Scenarios Scenarios P V 5 T M P E 0 I L N CREW T N POSITION I I T A M C S A B L U A T R T 0 M(*) N Y 0 C P R I U T P E RX 14 2 1 1 0 SRO-I NOR 1 1 1 x I/C 123 6 4 4 2 568 MAJ 79 3 2 2 1 10 TS 456 3 0 2 2 RX 14 2 1 1 0 RO NOR 1 1 1 x SRO-I IIC 358 3 4 4 2 x MAJ 79 3 2 2 1 10 TS 0 0 2 2 RO RX 1 1 0 x NOR 4 1 1 1 1 SRO-I x I/C 126 3 4 4 2 MAJ 79 3 2 2 1 10 TS 0 0 2 2 Instructions: Instructions: 1.
- 1. Check Check the the applicant applicant level level and and enter enter the the operating operating test test number number and and Form Form ES-D-1 ES-D-1 event event numbers numbers for for each each event event type; type; TS TS are are not not applicable applicable for for RO RO applicants.
applicants. ROs must serve ROs must serve inin both the Uatthecontrols both the "at-the-controls (ATC) (ATC)" and and "balance-of-plant (BOP)" balance-of-plant (BOP) positions; positions; Instant Instant SROs SROs mustmust serve serve in in both the SRO both the SRO andand thethe ATC ATC positions, pOSitions, including including atat least least two two instrument instrument oror component (IIC) malfunctions component (I/C) malfunctions and and one one major major transient, transient, inin the the ATC ATC position. position. IfIf an an Instant Instant SRO additionally serves SRO additionally serves in in the the BOP BOP position, one I/C position, one IIC malfunction malfunction can can bebe credited credited toward toward the the two two I/C IIC malfunctions malfunctions required required for for the the ATC ATC position. position.
- 2. Reactivity Reactivity manipulations manipulations may may be be conducted conducted underunder normal normal or or controlled controlled abnormal abnormal conditions conditions (refer (refer to to Section Section D.5.d)
D.5.d) but must but must bebe significant Significant per per Section Section C.2.a C.2.a ofof Appendix Appendix D.D. (*) (*) Reactivity and normal Reactivity and normal evolutions evolutions may may be be replaced replaced with with additional additional instrument instrument or or component component malfunctions malfunctions on on aa 1-for-I 1-for-1 basis. basis.
- 3. Whenever Whenever practical, practical, both both instrument instrument and and component component malfunctions malfunctions should should bebe included; inctuded; only only those those that that require require verifiable actions that verifiable actions that provide provide insight insight toto the the applicants applicant's competence competence count count toward toward thethe minimum minimum requirements requirements specified specified forfor the the applicants applicant's license license level level in in the the right-hand right-hand columns.
columns. Page Page 22 of of2 2
ES-301-6 Competencies Competencies Checklist Checklist Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Operating Test No.: FA201O-30l Ol!erating FA20 10-30 1 APPLICANTS Competencies Competencies SRO-I SRO-I X X RO X X BOP X X SCENARIO SCENARIO SCENARIO 11234 2 3 4 11 22 33 4 11 2 33 4 (4) (4) (4) Interpret/Diagnose Events 23 23 1 2 12 23 23 24 24 24 24 34 34 3 56 356 11 33 2 4 24 and Conditions Conditions 45 4 5 34 34 45 45 56 5 6 67 67 56 56 78 78 56 56 67 67 67 56 67 77 78 78 89 88 78 89 89 911 10 10 11 ComplyWithand Comply With and 12 12 12 12 12 13 135 1155 12 Use Procedures (1) 3 4 34 3 4 34 34 34 47 47 46 46 5 6 56 67 8 678 67 67 46 46 56 56 5656 56 7 8 78 78 7 78 910 Operate Control 11 2 1 2 12 1 3 13 135 1 3 5 11 33 1 2 12 Boards (2) 46 46 46 46 56 56 7 8 78 5 6 56 46 46 7 77 89 78 78 11 910 Communicate 12 1122 12 12 12 1133 135 1133 12 andliteract and Interact 34 34 34 46 46 56 678 56 46 56 56567 56 56 7 7 89 7878 78 78 78 78 78 11 910 9 10 11 Demonstrate Supervisory 23 23 1 2 12 11 2 Ability(3) Ability (3) 45 34 34 67 56 56 8 7 78 Comply With and 24 24 4 5 3 55 45 Tech Specs. Use Tech. Specs (3) 5 6 INotes: (1) Includes Technical Specification compliance compliance for for an an RO. RO. (2) (2) Optional Optional for an SRO-U. (3) Only applicable toto SROs. (4) Scenario #2 was not submitted. instructions: Instructions: applicants license type and enter one or more event numbers that will allow Check the applicants' the examiners to evaluate every applicable competency for every applicant.
ES-301-6 ES-301-6 Competencies Checklist Competencies Checklist Facility: Fancy Nuclear Facility: Farley Plant Nuclear Plant Date of Examination: Date of Examination: AprilS, April 5, 2010 2010 Ol!erating Operating Test Test No.: No.: FA2010-3OI FA2OIO-301 APP LI CANTS APPLICANTS Competencies Competencies SRO-I SRO-I X X RO RO X X BOP BOP XX SCENARIO SCENARIO SCENARIO SCENARIO 5 55 55 IInterpret/Dia nterpret/Diagnosegnose 123 1 23 13 1 3 124 1 24 Events and Conditions 456 456 45 45 678 67 8 789 78 991010 10 10 910 Comply With and 1 23 123 11 33 124 1 24 Use Procedures (1) 456 45 678 789 89 910 10 10 Operate Control 13 1 3 124 1 24 Boards(2) Boards (2) 45 689 89 10 Communicate Communicate 123 13 124 and Interact 456 45 678 789 89 910 9 10 10 10 Demonstrate 123 Supervisory Ability (3) 456 789 10 Comply With and 4455 Use Tech. Specs. (3) Notes: (1) (1 ) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. Instructions: Check the applicants applicants' license type and and enter one oror more more event event numbers that will allow the examiners to evaluate every evef)l applicable competency for every evef)l applicant. applicant.
s-c ~e~ ~ -H~ ~~ 4(')1 - O1 \ '" U;v1Jt\)J\ J~ CN\ w~ ~ \'J~ ~+ '~f~ p\()uA,
ES-401 -4 ES-401-4 Record of Record Rejected KlAs of Rejected KIAs Page Page 11 of of 22 K/A listed KJA listed inin column column 22 isis the the rejected rejected KJA K/A Tier II Tier Randomly Randomly Reason for Reason for Rejection Rejection Group Group Selected KIA Selected K/A T1G2 TlG2 059AK2.02 059AK2.02 The original The original k/a was one k/a was of 77 KI one of K/As As related related to to radiological radiological releases releases to the to the environment. environment. This This is is #1 of 44 that
#1 of that was was replaced replaced and and 33 were were RO RO retained to retained avoid excessive to avoid excessive overlap overlap in in the the different different questions.
questions. Examiner (NRC) Examiner randomly selected (NRC) randomly selected W/E I 6EK2 11 as as the the replacement KIA. replacement K/A. T1G2 TlG2 060AA2.02. k/a was one of 77 KI The original k/a K/As As related to radiological releases environment. This is #2 of 4 that was replaced and to the environment. and 33 were RO retained to avoid excessive overlap in the different questions. questions. Examiner (NRC) randomly selected 03 7AA2. 0$ as the replacement KIA. K/A. T3 G2.3 .1 1 G2.3.l1 The original k/a was one of 7 KI As related to radiological releases K/As to the environment. This is #3 of 4 that was replaced and 3 were RO retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected G2.3J . 55 as the replacement K/A. KIA. T1G2 TIG2 060AA2.03 The original KIA K/A was one of 7 KI As related to radiological K/As releases to the environment. This is #4 of 4 that was replaced and SRO 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected W/E I 5EA2.2 as the KIA. replacement K/A. Ti G2 TlG2 W/EO W 1 EG2.2.42 lEO lEG2.2.42 The original KIA K/A combined recognizing parameters that required Tech Spec application during Rediagnosis in the ERG network. RO No parameters require Tech Spec Application until after exiting the ERG network, so a question could not be written to this combination of KIA.K/A. Examiner (NRC) randomly selected W/E0IiG22. 2 as the KIA. replacement K/A. T2G1 T2Gl 007K5.02 The original KIA combined the normal method of drawing a pzr original K/A bubble and the effect on the Pressurizer Relief tank. At Farley RO there is no effect on the PRT during the procedure for drawing a bubble, thus no discriminatory question could be written to this combination of K/A.KIA. Examiner Examiner (NRC) (NRC) randomly randomly selected selected 007A3 .01 .01 as the the replacement KIA. K/A.
ES-401 -4 ES-401-4 Record of Record of Rejected Rejected KlAs KIM Page Page 2of2 2 of 2 Tier // Tier Randomly Randomly Reason for Reason for Rejection Rejection Group Group Seected KIA Selected K/A TIG1 TlGl 026AA1.04 026AAl.04 The original KIA The original required testing K/A required testing ofofaa system system that that FNP FNP does does not not have. It have. It combined combined CCWCCW and temperature moinitoring and aa temperature moinitoring system system for for RO RO the CRDMs. The the CRDMs. The CRDMs CRDMs at at FNP FNP are air cooled, and have are air cooled, and have no no temperature monitoring temperature monitoring system. They also system. They also have have nono alarms alarms on on high high temperature. temperature. Examiner (NRC) Examiner (NRC) randomly randomly selected selected 026AA II .() I1 asas the the replacement KIA. replacement K/A. ~ T1GI 027AA2.17 027AA2.17 Could not Could write aa discriminating not write discriminating SROSRO level level question question to to KIA. K/A. SRO SRO Examiner (NRC) Examiner (NRC) randomly randomly selected selected 027AA2.04 as as the the replacement K/A. replacement KIA. II :~ T2G2 SRO 015G2.4.9 I015G249 Could not write aa discriminating Could discriminating SROSRO level Examiner (NRC) randomly selected 001j 5G2.4. 11 level question question to I I to KIA. K/A. ~ T1G2 WEO3EG2.4.5 WE03EG2.4;5 discriminating SRO level question to KIA. Could not write a discriminating K/A. SRO " Examiner (NRC) randomly selected WEO3G2.4.6 as the replacement KIAK/A T1G2 TlG2 I 024G2.4.20 024G24.20 discriminating SRO level question to KIA. Could not write a discriminating K/A. SRO Examiner (NRC) randomly selected 076G2.4 076G2.4, 11II TIG1 TlGl 008AA2.15 Could not write a discriminatin discriminating g SRO level question to KIA. K/A. SRO Examiner (NRC) randomly selected OOSG2.4.4 1I as the replacement KIA. K/A. T1G2 TlG2 00502.4.18 005G2.4.18 Could not write a discriminatin discriminating g SRO level question to KIA. K/A. SRO Examiner (NRC) randomly selected 005G2.23$ as the replacement K/A. KIA. T1GI TlGl 027AA2.04 027AA2.04 Could not write a discriminatin discriminating g SRO level question to K/A. KIA. SRO SRO Examiner Examiner (NRC) randomly randomly selected selected 027AA2. 15 J 5 as the replacement K/A. KIA.
ES-401-6 ES-401-6 Written Examination Written Examination Quality Quality Checklist Checklist Facility: Facility: FA2O1O-301 FA2010-301 Date of Date of Exam: Exam: April April 5, 2010 5, 2010 Exam Level: Exam Level: RORO xx SROx SRO x Initial Initial Item Description Item Description aa b* b* c# c# 1.
- 1. Questions and Questions and answers answers are are technically technically accurate accurate and and applicable applicable to to the facility.
the facility. 4f2 ,.,.;> I'\1fJ f4<.- pW 2.
- 2. a.
- a. NRC KlAs NRC K/As are are referenced referenced for for all all questions.
questions. b.
- b. Facility learning Facility learning objectives objectives are are referenced referenced as as available.
available. fY'IB 3.
- 3. SRO questions SRO questions are are appropriate appropriate in in accordance accordance with with Section Section D.2.d D.2.d ofof ES-401 ES-401 Ltf<--
L4.j_ ~P ffl1?; 4.
- 4. The sampling The sampling process were repeated were process was repeated from was random the last from the random and last 22 NRC and systematic systematic (If licensing exams, NRC licensing more than (If more than 44 RO consult the exams, consult the NRR RO or NRR OL or 22 SRO SRO questions DL program questions program office).
office).
~
~
~
5.
- 5. Question duplication Question duplication from the the license license screening/audit screening/audit exam exam was was controlled controlled as indicated as indicated below below (check (check the the item item that that applies) applies) and appears appropriate:
and appears appropriate:
~X the the audit exam exam was systematically and and randomly randomly developed; developed; or or
~X _ the audit audit exam was completed before before the license license exam exam was started; started; or ~ {l$
examinations were _ the examinations were developed developed independently; independently; or /M licensee certifies that there is no _ the licensee no duplication; or _ other (explain) 6.
- 6. Bank use meets limits {no (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO /I SRO-only 13/4 13 / 4 1217 12 /7 50/14 50 / 14
'4Z ~
(1 (lfb distribution(s) question distribution{ s) at right. 7.
- 7. Between 50 and 60 percent ofthe of the questions on the RO Memory CIA C/A
~
exam are written at the comprehension/ comprehensionl analysis level; the SRO exam may exceed 60 percent if the randomly 30/5 30 / 5 45/20 45 / 20 UR- ft-o selected KlAsK/As support the higher cognitive levels; enter the actual RO) RO / SRO question distribution(s) distribution{s) at right.
- 8. References/handouts provided do not give away answers t4<-
4j2 {h;::> ~ p, or aid in the elimination of distractors. 9.
- 9. Question content conforms with specific K/A KIA statements in in the previously approved examination outline and is is appropriate for the tier to which they are assigned; assigned; ~ jrto M1?
deviations are justified. justified. 10.
- 10. Question psychometric psychometric qualityquality and format meet meet the guidelines in ES Appendix B.
in ES B. 4ft. <@ 61k- (N) mc:rYlJ313 11.
- 11. The The exam the exam contains the total total is contains the is correct correct and the required required number and agrees agrees with number of with the the value one-point, multiple of one-point, value on on the multiple choice the cover sheet.
sheet. choice items; items; t.,p... ~ yy)j3 M13 Printed Printed Name Name I/ Signature Signature Date Date a.
- a. Author Author C. Vince C. Vince Richter/
Richter / kR... :. ~ ___ . 03/24/2010 03/24/2010
- b. Facility (*) fl1v)t ~
- b. Facility Reviewer Reviewer (*) Garv Ohmstede Gary Ohmstede // 03/24/2010 03/24/2010 c.c. NRC NRC Chief Chief Examiner(#)
Examiner (#) I'llAAAA. f>A-rtS1J'Y7-1l~:'1".~ MMA.6A16S/47 lH.I..I'IJU.t-r.WtTWN.JII.l/ JfJ':\ AAt(L&1 t;7
~. 0Jf(/;;;;
d.
- d. NRC NRC Regional Regional Supervisor Supervisor L ~.u.C(M -
Note: Note:
- The The facility facility reviewers reviewer's initials/signature initials/signature are are not not applicable applicable forfor NRC-developed NRC-developed examinations.
examinations.
## Independent Independent NRC NRC reviewer initial items reviewer initial items in in Column Column c;"c"; chief chief examiner examiner concurrence concurrence required.
required.
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# KlA# B L L L Psychometric Flaws Content Flaws V U Comment M 00 00 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q~ Q SRO E Explanation N KK D D Focus Cred Cred K/A KIA Only S Dist Dis! Dist B/W
GENERAL COMMENT
S M=Modifled I/ N~New B= Bank I/ M=Modified N=New I/ F=Fundamental Level (I.E. Memory) I/ H=Higher HHigher Cognitive Level (I.E. CIA) C/A) For All BANK questions: swap the order of the answer choices so that applicants cannot rely on recall of the correct answer location. Incorporated on all but three Qs, but those have stems with slightly different format and are thereby acceptable. acceptable, MAB This worksheet was used by the CE to ensure the written exam met the requirements of NUREG-102 NUREG-I02 I. 1. The worksheet was not used in a manner that would allow the total number of un sat questions to be unsat calculated by comparing the draft exam and the final exam in conjunction with this worksheet. The SRO portion of the examination contained 77 questions that did not fully meet the requirements of NUREG-102l. NUREG-I021. Three of these questions not meeting the standard was due to interim guidance that was slightly different than the guidance used to evaluate those questions. Therefore, it was determined that only 4 questions would be counted as unsat. un sat. Therefore, the exam was determined to be within the quality standards as defined in NUREG-lO2l. NUREG-1021. BC notified program office of documenting exam as a satisfactory submittal. RO EXAM ROEXAM I OO1AK2.06 00IAK2.06 B B H H 2 S S Q Q is sat. 22 0011(2.02 001K2.02 M M F 22 S S Q Q is sat. 33 003A2.03 N H 33 S S Q is sat. Q II do not agree that reactor trip criteria is SRO-only knowledge unless it appears as a < 1I hour TS also. Licensee noted. MAB 4 004G2.4.2l 004G2.4.21 NN H 2 :g N II believe this to be a good RO question. How does the second part of this question compare to some of the SRO questions that were justified as SS SRO-only based on detailed procedure knowledge, or strategically how to address the plant conditions? Licensee noted. MAB "required to be Word the question statement to ask for the actions that are required performed," as opposed to the actions the will performed, "will be performed. perfOlmed." Incorporated. MAB Incorporated. Page 11 of2I of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 ES-401-9 Farley 2010-301 Q# KJA# KlA# B B LL LL Psychometric_Flaws Psychometric Flaws Content Flaws Content Flaws U U Comment Comment M 00 00 Stem Stem Cues T/F T/F I Non >1
>1 Non Partial Min Mm Q-Q= SRO SRO EE Explanation N KK D Focus Focus Cred Cred K/A KIA Only Only SS Dist Dist B/W B/W What conditions could occur in the plant that would cause the severe difference in the magnitude of the five highest CETs? Is this an operationally valid condition?
CET Failures. Failures MAB Second bullet: "have" have should be "has". has. Corrected. MAB S5 004K1 .04 004Kl.04 N H 2 S Q Q is sat. 6 005A1.07 OOSAl.07 N H 2 E N Why does A and C simply state the status of the valve, I.E. OPERABLE, yet Band B and D state that they need to "declare declare the valve INOPERABLE?" INOPERABLE? S Why not make all answer choices simply state OPERABLE or INOPERABLE? Incorporated. MAB Question statements should be written to test the requirements, as opposed to what a CR WILL contain. Suggest the following wording for the Q Q statement: Which one of the following describes the OPERABILITY ofMOV-8889of MOV8889 lAW TS and STP-l1.6 STP-ll.6 and the actions that are required to be placed in a CR lAW STP-ll.6? STP-l 1.6? Incorporated. Incorporated MAB 7 005K4.03 OOSK4.03 N H1-1 2 E N Are there any check valves in the air supply line that would trap air in the valve for a time period, thus allowing the valve to hold its position for a S short time period? In other words, is only stating that IA is lost enough to ensure the valve has failed closed due to losing air pressure within the valve operator? Incorporated. MAB 88 006K6.13 B FF 33 S 5 Q Q is sat. 99 007A3.Ol 007A3.01 B B F F 22 5S QQ is sat. Why do two answer choices contain actions to vent? Can the answer choices be more simply stated as "pumppump down with RCDT pump pump" vs.
"gravity gravity drain"?
drain? If the level rise is the cause of the pressure increase, then venting should not be needed. Four unique answers would still exist if the venting portion of A and D D was deleted. Discuss with licensee. Incorporated. MARMAB Is the Q memory or higher cog? (When does rupture disk blow & how do level in PRT) you lower water level Noted. MAB MAB Page 22 of2l Page of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Qj Q# KJA# KlA# B L L Pometric Psychometric Flaws C.itentFlws Content Flaws U Comment M 00 00 Stem Cues T/F 11 Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N N K D D Focus Cred Cred K/A KIA Only S Dist Dist B/W 10 007Ek2.02 N H 2 S Q Q is sat. 11 II 008AA2.26 00SAA2.26 N H 2 S Last Bullet in First Set of Conditions: Are your applicants trained to memorize the component identifications for R-2, 7, II, 11, and 12? Incorporated. MAB 12 00SK3.01 008K3 .01 B H 2 x x tJ: U Is there any risk that there may be two correct answers (both A and B)? My concern is that there may be an argument that either set of actions M S would mitigate the problem and could be argued as a correct mitigating strategy? Discuss with licensee. II need to have a better understanding to ensure that there is not a possible way for someone to place Ex UD LID in service and be considered correct? Q Q modified. MAB Placing UDL/D in service may not be plausible. Most of the time when you can take manual control of a function, you would certainly attempt this before you would take more involved action to mitigate. Q Q modified. MAB Possible solution to address both of above concerns: Consider changing the second part of each answer choice to test whether the failure will add positive reactivity or negative reactivity. Incorporated MAB Incorporated. 13 00SK4.09 008K4.09 M H 2 x .g F What is the status of the 'c' C CCW pump? The stem states that it is aligned. A running pump maybemay be aligned, as well as a non-running pump. S Is it important to be explicit with the status of the pump? Licensee stated that with given plant conditions, conditions "C"C CCW Pp would not be permitted to be running except during a pump swap. MAB 14 009EG2.I.23 009EG2.1.23 N H 2 S applicants required to know the component identification for FK-122? Are applicant's FK-l22? [Note: QQ 15 provides the name] My basic requirement is that if your procedures also provide noun names for components, then it is pelmissible permissible on exams. If your procedures are constructed to require the operators to know the components by id number alone, then that is the limit of what should be stated in an exam question. This is a generic comment that would apply to all questions. Incorporated. MAB 15 oOIOKI .03 10K 1.03 N H 2 x tJ: U When a bubble is being compressed, II am not convinced that spray valves closing is credible. II understand the justification provided for their S plausibility, but I do not completely agree with the plausibility. Second opinion was obtained from an independent chief examiner. Incorporated. MAB of 21 Page 33 of21
ES-401, Rev. ES-401, Rev. 9 Exam Review Worksheet Written Exam Form ES-401-9 Farley 2010-301 Q# Q# KJA# KlA# B B LL LL Psychometric Flaws Psychometric Flaws Content Flaws Content Flaws U U Comment Comment M M 00 00 Stem Stem Cues Cues TIF T/F 1I Nou Non >1 Nou
>1 Non Partial Partial Mm Min Q=
Q= SRO SRO E E Explanation Explanation N KK DD Focus Cred Cred Cred Cred K/A KIA Only Only SS Dist Dist B/W B/W Possible solution solution to the above concern: Consider replacing the second part of each answer choice with the spray valve demand. Then the applicant must know how the controller is designed to work when pressure needs to be lowered. Incorporated. Incorporated MAB 16 011 K5.05 011K5.05 N H 3 BE I need to have the licensee walk me through the diagnosis of the failed channel. I think the question wi11likely will likely be sat after I have a better S understanding of the indications and how they relate to channel 459 failing. Done. OK MAB 17 012K2.0l 012K2.01 B F 2 B Q Q is sat. S Does the question need to state that the RTB and RTBYP bkrs are in their normal configuration for at power operations? No. Discussed with licensee. No licensee MAB Can question be answered at the memory level? Potential to be classified either way? Noted. MAB 18 0 l2K6.03 012K6.03 B F 1I x Y U The question statement is written as Rx Trip "OR" OR ESF - but is testing both Rx Trip "AND" AND ESF logic. Does the Q Q statement need an "AND"AND S instead of an "OR"? OR? Incorporated. MAB What is meant by the "minimum minimum additional channels required to meet the actuation? Is an applicant to predict what would happen if a RPS and ESF actuation"? minimum number of additional pzr press channels failed high? - if so, what impact would this have on the ESF? Maybe a more explicit question needs to be asked? Incorporated. MAB LOD= I. Q LOD=l. Q does not discriminate at appropriate level. Credibility of distractors also is related to LOD. QQ modified. OK MAB 19 19 0l3K2.OI 013K2.01 N FF 33 5S QQ is sat. sat. 20 20 0l3K5.0l 013K5.01 N H 22 SS QQ is sat. sat. 21 21 015AK2.l0 015AK2.10 N N HH 22 xx B Looking at Looking at the the inter-relation inter-relation between between thethe first part part and and second second part of part of answer choice answer choice C: C: IfIf the the unaffected unaffected loops loops are are still still going going to to indicate indicate 100%, 100%, SS then how then how could could anan applicant applicant have have aa misconception misconception that that the the affected affected loop loop would indicate would indicate 10%? IO%? The The mismatch mismatch in in loop loop flows would would need need to to make make sense when_compared_to_each_other._Answer_choice_A_could_make_sense_if sense when compared to each other. Answer choice A could make sense if Page 44 of2l Page of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B L I. L Pgpmetric Flaws Psychometric Flaws_____ Content Flaws V U Comment M 00 00 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q~ Q SRO E Explanation N K D D Focus Cred Cred K/A KIA Only S Dist Dist BIW B/W reverse flow was indicated as zero zero- which II think is a credible misconception. But, if the affected loop is picking up flow from a good loop, then the good loop should show this on its flow indicator. Discuss with licensee. Q modified. Q modified OK MAE MAB 22 022AI.OI 022Al .01 N F 22 x B Is there enough info in the stem for the applicant to detennine determine that the fans are required to be operated in fast speed? The stem does not state that the S Hi Temp Alarm has annunciated. The stem also does not state the value of containment temperature. Incorporated. MAB Would the question be better stated if a containment ave air temp ofoft115F l5F was provided, then the two pieces of the answer choices could be: (I) Is a TS 3.6.5 action statement required to be performed, AND (1) (2) What is the required fan speed lAWJAW SOP-12.1? SOP-l2.1? (The above wording is not exactly how II am suggesting it be worded, but the idea could be the same.) Incorporated. Incorporated MAE MAB 23 022AK3.06 N F 33 S S Q is sat. Q 24 026AAAI.01 O26AAAI.0I N H 2 x Y U II would rather see the word ONLY defined in each answer choices. For example the first answer choice would be better worded as: S A. AOP-lO.0 AOP-lO.O entry required (AOP-9.0 entry not required) 1015 Q replaced. MAB Q Doing it this way ensures unique answer choices, but reduces the likelihood that an argument exists for "no no correct answer". answer. In other words, if any other procedure would require entry based on the above conditions, then technically there is no correct answer (applicants could find an ARP or SOP that the exam writers were not considering). Past experience in the post exam environment requires that we judiciously use the word ONLY in answer choices. It worked OK in a few other questions, but we should be careful here when ONLY excludes any other procedure. Q replaced. MAB Qreplaced. Q does not appear to match KIA. Q K/A. KIA K/A requires testing knowledge of CCW Temps. This question appears to test RCP bearing temps versus CCW temps. Q Q replaced. MAB 25 026KI.OI 026K1.Ol N F 2 S 5 Q Q is sat. 26 027AK1.02 027AKI.02 N F 2 S 5 Q Q is sat. PageS5 of21 Page of2t
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# KlA# B L L Psychometric Flaws Flaws_____ Content Flaws U Comment M M 00 00 Stem Cues T/F 11 Non >1 Non Partial Mm Min Q= SRO £ E Explanation N N K D D Focus Creil Cred Cred K/A KIA Only S Dist Dist B/W Q Q could also be answered at the higher cog level. Noted. MAB 27 027K1.Ol 027Kl.01 N F 2 S S Q Q is sat. 28 029EAl.06 M H 2 E B ONLYneedstobedefined. ONLY Iftheoperatorneedstodoanyaction,even needs to be defined. If the operator needs to do any action, even something trivial, then A and D could be eliminated. If ONLY is intended S to mean that demand does not need to be raised, then the extra words are needed to precisely state that. The word minimum may be unnecessary if ONLY is defined. I.E.: A. (1) (I) same (2) Place FK-122 FK-l22 in MAN (raising demand not required) Incorporated. MAB 29 032AK3.02 N H 2 E B All the reasons in the second part of each answer choices can be deleted because they do not help make the answer choices unique. II presume that S the authors were thinking that the reasons were helping to meet the KIA,K/A, but the only way a KIA K/A is met is if knowledge required of the KIAK/A is needed to arrive at the correct answer. Discuss with licensee. Incorporated. MAB Can the timing of the automatic energization of the SR after trip be verified on the simulator? Or would it be OK to have the second part of the answer choices state that SR indications are required to be manually energized when IRJR (the good instrument) reads a certain value (5xlO-")? (5x10)? Verified on Simulator. OK MAB I will allow the KIA K/A match because the reason SR Nis are manually energized at 15 minutes is that they do not auto energize. Noted. MAB 30 035K3.02 N H 2 E B Discuss deleting all the information behind the comma in each answer choice unless there is a good reason to retain it. Discuss with the licensee. S Typically, unnecessary information should not be included. as is to ensure one and only Discussed with licensee and decided to leave as-is one correct answer. MAB 31 037AA2.08 N H 2 x 8U KIA K/A does not appear to be met. The KIA K/A requires knowledge of determining or interpreting the failure of the air ejector rad monitor. The S stem tells the applicant that the monitor is failed, so this knowledge does not appear to be tested. A possible solution may be to provide a condition in the stem that would render the R-15A inoperable, such as a loss of its power supply or some indicating lights that would suggest it was failed, or even different color writing on a computer screen that would suggest that the value is invalid. The R-15A could then replace one of the answer choices. Essentially the same question could then be asked, but the Page 60f21 6 of 21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B L L Flaws_____ Psychometric Flaws Content Flaws U Comment M 00 00 Stem Cues T/F II Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N N K D D Focus Cred Cred K/A KIA Only S Dist Dist B/W applicant would need to know that the R-15A would not provide the earliest indication because it was failed. Discuss with licensee. Q modified. OK MAB Q 32 038EA2.07 N H I-1- :g LOD is borderline. A minor suggestion that would make this question 2 acceptable is as follows: S Consider displaying the parameters at two different points in time so that the applicant must determine which parameters are stable, decreasing, and increasing. Also vary the parameters in such a way to make them realistic
- run on simulator if needed. For instance, all SO SG pressures will not be 980 psig. Maybe make C SO SG pressure a little lower than the rest, but still a value that would preclude a steam leak. Discuss with licensee.
Incorporated. MAB 33 039K4.05 B F 2 S Q is sat. Q 34 041 K4.l4 041K4.14 N H 2 S Q is sat. Q 35 045A1 .05 045Al.05 N H I-I - x .(J U B may not be plausible for the same reason as a previous question. 2 Anytime temp goes up and compresses a bubble in the pzr, pressure will S initially rise. II have trouble finding credibility in pressure going down. I understand the explanation provided in the justification. II have similar concerns with C. With temp lowering, it may not be credible for the concems rise. LOD=l is a result of this. pressure response to lise. Q modified. Q modified OK MAB 36 O5lAAl.04 051AAl.04 B F 2 :g B Would the question be more precise and better able to withstand scrutiny if the second part of the question only asked whether or not Em Borationl3oration is S required? II see the supporting material (FEl) (FEI) not requiring Em Boration, but I do not see where it prohibits it. Discuss the possibility of having the alternate between: "Emergency second part of each answer choices altemate Emergency Boration Required" Required and "Emergency Emergency Boration NOT Required. Required". Incorporated. MAB 37 054AG2.I.7 054A02.1.7 N F 2 S Q is sat. Q 38 055EK3.02 M F I- x .(J U D does not appear to be credible because you have a procedure that is 2 specifically designed to be used for cooldown with head voids. S Q modified. OK MAB Q A does not appear to be plausible because the SO SG tubes are obviously designed to hold RCS pressure at power. Also, it is the only answer choice that only minimizes a "potential". potential. Q modified. OK MAR Q MAB of 21 Page 7 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B LL L Pgometric Flaws Psychometric Flaws______ Content Flaws U Comment M 00 00 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q= SRO E Explanation N N K K D Focus Cred Cred K/A KIA Only S Dist Dist 8/W B/W One suggestion would be to use some info from the original question and also test why the cool down is stopped at 200 psig. cooldown I.E. A. Minimize Inventory Loss / Prevent N2 injection B. Maximize AFW / Prevent N2 injection C. Minimize Inventory Loss / Prevent losing pzr level D. Maximize AFW / Prevent losing pzr level Incorporated. MAB 39 057AG2.4.49 057 AG2.4.49 N H 2 S Q Q is sat. Allowed leniency with KIA K/A match. The original intent of the KIAK/A is believed to be met. Noted. MAB 40 059A2.04 M H 1- ? E II am not convinced that MFRVs is a credible choice. Would it be possible 2 to change the answer choices to: S A. Feed ALL / No Limit B. Feed one at a time / No Limit C. Feed ALL / 20 - 100 gpm ALL/20 D. Feed one at a time /20/ 20- 100 gpm rpm Incorporated. MAB 41 059G2.I .19 059G2.1.19 N H 2 S The first bullet prompts the question: "In what?" Would it be better to In what? state that the computer alarm has annunciated? Incorporated. MAB Q is essentially sat. Q Noted. MAB 42 061G2.2.37 B H 3 x E B The question statement may not read con-ectly. correctly. It is asking for the purpose, yet it appears to be asking for actions and locations of those "purpose", S actions. If this is con-ect, correct, then the wording of the question should be modified to solicit the answers being provided. I.E.: Given the above conditions, which one of the following con*ectly correctly describes the actions for establishing AFW IA lAWW SOP-22.0? Discuss with licensee. Incorporated. MAB 43 062A1.Ol 062Al.01 N H 3 S Q is sat. Q 44 063A3.0l B B H 33 S 5 Q is sat. Q 45 064A4.03 N F 2 x U lJ C may not be plausible. If the EDG is the faster of the two and the govemor is part of the EDG controls, then why would it be credible to raise governor Page 8 of2l
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B LL LL Pietric Flaws Psychometric Flaws_____ Content Flaws U U Comment M 00 00 Stem Cues T/F T/F 11 Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N KK D Focus Cred Cred K/A KIA Only S Dist Dist B/W BIW S frequency, which would make it go even faster as compared to the bus? Q Q modified. OK MAB Similar argument exists for B. If the bus speed is already higher, then why would an operator lower the EDG speed, widening the margin? Q modified. OK MAB Q One suggestion would be to test which switch is used to make the adjustment. One of the applicants (I think on the last Farley Exam) made an error on the In-Plant EDG JPM and tried to adjust speed using the voltage adjust knob. Consider: A. 1IG Frequency!I Adjust using Gov Motor Speed/MW switch G Bus Frequency B. IGlG Bus Frequency I/ Adjust using Voltage Control Etc. Incorporated. MAB 46 065AK3.04 B H 22 x tI Why is the location of the valves given in C, when the location is not provided for other answer choices? S Corrected. MAB Q Q statement should test required actions lAW a certain procedure. Incorporated. Incorporated MAB Only relevant info that is needed to make the answer choices unique should be included in the answer choices. All of the info wrt reasons should be eliminated because this information is not being tested due to all of the actions being unique. In in this case, because the applicant does not need to possess the knowledge required by tile KIA to arrive at the correct answer, the K/A KIA is not met. then the K/A Incorporated. MAB Consider the following as a possible solution: Align EACs to AFW components JAW lAW SOP-62 within ___ hours in order to A. 1 1 hour /I ensure adequate heat sink. B. 22 hours / prevent exceeding exceeding TS cooldown limits Etc. Incorporated. MAB 47 068K6.lO 068K6.10 M M H 1I xx tI U The third bullet does not specify that the red lights are lit on a specific equipment. On piece of equipment. piece On R-18? SS On drawer - added. added. OKOK MAB bullet states The last bullet states that the control control power power fuse is is lit. lit. Is Is the actual fuse lit? lit? Clarified. MAB Clarified. Page of21 Page 99 of 21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B LI. LU Psychometric Flaws______ Flaws Content Flaws U Comment M 00 00 Stem Cues T/F I Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N N K D Focus Cred Cred K/A KIA Only S Dist Dist B/W D is not plausible. It would not be reasonable to think that it would be a requirement to continue a voluntary release with the given failure. Q modified. OK MAB Q C does not appear to be plausible when compared to A because nothing is wrong with RCV-IS, RCV-18, so you would surely try to close that prior to locally closing a manual valve. Q Q modified. OK MAB 4S 48 069AA2.01 069AA2.0l B F 22 S Q is sat. Q 49 071A4.01 071A4.Ol N F 2 S II would prefer C and D state WHITE LIGHT NOT LIT, vice ONLY. Incorporated. MAB MAE Q Q is sat. 50 072G2.1.27 072G2.l.27 N F I1 t1 U Bow is the first and second part of How A different from each other? Are these ofA not essentially stating the same thing? S Q modified. OK MAB Q Also, the reasons are very general in A. It requires only a very basic knowledge to understand that a rad monitor will provide warning of a radiation hazard, which could be a result of plant damage and could lead to a health hazard. Q Q modified. OK MAB Thoughts:
- Are area rad monitors used to provide the SRO with readings to make E-
- E Plan classifications?
- Are area rad monitors used to determine whether adverse numbers are required to be used?
- Are area rad monitors used to determine if adverse numbers may be exited, or must you remain in adverse numbers once you are using them (does cont pressure impact adverse numbers differently than radiation)?
Incorporated. MAB Distractors could include:
- CR HV
- HVACAC to recirc mode.
- Containment isolation.
- Isolates liquid/gaseous release.
Incorporated. MAR MAB The above are just some ideas to help write a question. II have not researched Farley lesson plans to see which ideas may apply. Incorporated. MAE Incorporated MAB of2l Page 10 of21
ES-401, Rev. 9 Exam Review Worksheet Written Exam Form ES-401-9 Farley 2010-301 Q# Q# K/A# KlA# BB LL LL ometric Flaws Psychometric Flaws Content Flaws Content Flaws U U Comment Comment M 00 00 Stem Stem Cues Cues T/F T/F 11 Non >1 Non
>1 Partial Mm Min Q=
Q= SRO SRO EE Explanation Explanation N KK DD Focus Focus Cred Crcd Cred Crcd KJA KIA Only Only SS Dist Dist Dist Dist BIW B/W Discuss with licensee. Alternatives will need to be found for this question. Some of the distractors are OK, but the correct answer is way too general, which causes this question to not discriminate at the appropriate level. Incorporated. Incorporated MAB 51 073K3.0l M H 2 B It sounds like the A train damper is already aligned, therefore not requiring any operator action. What is the initial status of the B train supply S damper? Does the B train supply damper require any manual action? Yes-Open-No. Yes Open No. OK MAB 52 O74EA1 .28 074EA1.28 N H 3 ? '7+ The second to last bullet states that the accum discharge iso valves are in the closed position. Is this accurate? Or should the bullet state that the S handswitches have been placed in the closed position? Incorporated. MAB How is ReS RCS pressure being too high a credible misconception when Sgs have been steamed to 100 psig? Discuss with licensee. Stem changed slightly. MAB 53 075A2.03 N H 2 S5 Q Q is sat. 54 076A3.02 N F 2 S Q Q is sat. 55 077AAl .02 077AA1.02 B F 2 B Double check with the licensee to see if there is a chance, based on info in the stem (or lack of info), that the controls are not in the auto voltage adjust S mode of operation. The caution is based on restricting manual voltage adjust while the controls are in auto voltage control. If this comment is resolved, then the Q Q will be sat. Verified. Aligned normally stated stated in stem OK MAB 56 56 078K2.02 N FF 22 SS QQ is sat. 57 103A4.03 M FF 22 5S QQ is sat. 58 58 103K3.03 N N HH 22 SS QQ is sat. 59 59 02.1 .17 G2.1.17 N FF 22 xx B licensee discuss plausibility Have licensee be credible plausibility of D. ItIt does not appear to be credible to take action prior to aa 3-way 3-way communication. communication. If this distractor cancan be be SS enhanced or enhanced or replaced, II can likely likely live live with the plausibility of the other other distractors. distractors. QQmodified. modified. OK OK MAB MAB 60 60 02.1.45 02.1.45 N N FF 22 5S QQ isis sat. sat. II of2I Page II Page of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KIA# KlA# B L B L Psychometric Pygnnietric Flaws Flaws_____ Content Flaws U Comment M 00 00 Stem Cues TIF T/F 11 Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N N K K D Focus Cred Cred K/A KIA Only S Dist Dist B/W Licensee marked for increased attention. Not sure how to improve the Q. Q. The Q Q appears to be OK. Noted. MAB 61 G2.1.9 02.1.9 N F 2 S Replace "MUST" MUST with "REQUIRED REQUIRED TO".TO. Incorporated. MAB 62 G2.2.3 B F 2 S 5 Q is sat. Q 63 G2.2.36 02.2.36 N H 2 gB Should "refueling refueling in progress" progress be changed to "core core alterations in progress"? progress? It may not make a difference, but I want to ensure that the S water level is established for core alts. Discuss with licensee. Incorporated. Incorporated MAB 64 G2.3.13 B H 2 S S Q is sat. Qissat. 65 G2.3.l5 G2.3.15 N F 2 S 5 Q Q is sat. 66 G2.3.4 N F 2 gB Q Q is sat as long as Farley confirms that this knowledge is required of their ROs. This is a typical SRO-only question at most plants because S S approving of EDLs is a responsibility og the SED. Q Q modified. OK MAB Is there an RO learning objective? No. QQ modified. OK MAB 67 G2.4.13 M F 22 g B Q is sat as long as Farley confirms that this knowledge is required of their Q ROs. This is a typical SRO-only question at most plants because S approving of EDLs is a responsibility og the SED. Q modified. OK MAB Q Is there an RO learning objective? No. QQ modified. OK MAB The question asks for the MINIMUM authority: How is this supposed to tenllS "either" be applied to the answer choices when the terms "or" are either and or being used? This potential confusion impacts the plausibility of distractors. II would imagine that validation has not picked up on this because it is very well known that the SED alone has this duty. Q Q modified. OK MAB 68 02.4. 16 G2.4.16 M M H H 2 g B This question would usually be regarded as SRO-only material. A procedure transition to SAMGs would be an SRO-only question at most SS plants. Q modified. OK MAB 12 of2l Page 12 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# Q# KIA# KlA# B B LL LU Psychometric Flaws Content Flaws U Comment M 00 00 Stem Cues TIF T/F 1I Non >1 Non Partial Mm Min Q= SRO E Explanation N KK D Focus Cred Cred K/A KIA Only S Dist Dist 81W B/W Is there an RO learning objective? No. Q Q modified. OK MAB Q Q may be sat pending discussion with licensee. QQ modified. OK MAB 69 WEO1 EG2.2.2 WEOIEG2.2.2 M F 2 .g ESP-0.0 is only to be entered if SI is in progress or required. The stem ESP-O.O states that SI termination is in progress. Does this lead the applicants to S guess how far the operators progressed through the termination steps? If SI had been terminated, then ESP-O.O ESP-0.0 may not be correct. Discuss with licensee. OK Q OK. Q states that SI is required. required MAB Is question analysis up to date? OK. MAB Walk though supporting material with the licensee to ensure that EEP-O EEP-0 is not correct and that it is fully supported with references. Licensee explained. OK MAB 70 WE04EA2.2 M F F 2 ?7 .g E II do not think subcooling is plausible because it is a calculated value value.. When determining if a leak is isolated, it makes sense to look at a S parameter that is directly measured (when given the choice between one that is directly measured and one that is not). II would suggest using pressurizer level instead of subcooling. Discussed. OK MAB II would prefer the first part of the question statement to read, 1)
"I) an ECP-1.2" injection path that is isolated lAW ECP-l .2 Incorporated. MAB 71 WEO5EK1.I WE05EKI.I N N FF 22 .g TI1e question asks for the MINIMUM: Howdoesatesttakerapplythis ThequestionasksfortheMlNlMUM: How does a test taker apply this when trying to determine between A A and B? Is opening a PORV more SS minimum than opening reactor vessel head vents? - the ambiguity detracts from the plausibility of both of these answer choices since only one item is listed in each choice. Would it be more precise to list each head vent so that there is a clear delineation that A A is more minimum than B?
Incorporated. MAB The question asks for the minimum actions required to ensure adequate core cooling: core Are there any other cooling: Are other actions actions at any given given time other other than than opening one PORV opening PORV and headhead vents vents that would be be required? IfIfso, so, the of the question may wording of wording may need need to to be be tightened to to ensure ensure that there there is is one technically correct answer. one answer. Incorporated. MAB Page 13 Page 13 of2I of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KlA# K/A# B B LL LL Psychometric Ppnetric Flaws Flaws_____ Content Flaws U U Comment Comment M M 00 00 Stem Stem Cues Cues T/F T/E 11 Non Non >1 Non
>1 Non Partial Partial Min Mm Q-Q SRO SRO E E Explanation Explanation N
N K K D D Focus Focus Cred Creil Cred Cresi K/A KIA Only Only S S Dist Dist Dist Dist 8/W B/W 72 WEO8EKI.l WE08EKl.l N H 2 X x g E Discuss plausibility of A. Discuss Question will be sat if A is replaced. Incorporated. MAB S 73 WEI 1 EK1 .3 WElIEK1.3 N H 33 '!-7 I am not following the explanations for correctness and plausibility. The analysis states that we know that B train is lost due to the combination of S CF3 and CF5, but II do not see in the stem where CF5 is in alarm. alarm, Is CF5 in alarm as a result of another condition in the stem? Licensee explained. OK MAB 74 WEI2EK2.l N H 2 ? '!-2 Will steam flow and the weight of the disk close the MSIVs the rest of the way with the given plant conditions? If so, does the question have one and S only one correct answer? Do we need to be more specific and state that they will move to the test position with air, or that air will move the valve off of its backseat? Discuss some wording enhancements. modified OK MAB Q modified. Q 75 WEI6EKI.2 WE16EKl.2 N H 2 S Qissat. Q is sat. SRO )nlYOi,;;liti,{n.F i!JSRO:c( fly Questions :': ,~;; ~;fJJ;/>:i;:;; \Ct:i~; ;;;~'": 2;;,';3;,;' i<~;;"s,,;~;<ii~; ;'.-~2'i:';;; ;~;~~i!;~;~J; :.-;;;;;;, ,.,.;>.;: :i;;~;":<; .;:T:;;;::;.:;~j i" '; ;;:~;;~'; c;y; 'S;:/;~;<f<;;::;;:2i ~.. ;;*:;E;:i: . ;*..*. ,< ':". ..* >"-;;. ;i,./ii.S,C; 76 005G2.4.18 005G2.4.l 8 N H 2 x x x tI U Do you use RHR and LHSI terms interchangeably? Should the wording be 9 consistent consistent? S RHR and LHSI terms are the same at Farley. Farley MAB Is the second part of A the same as the second part of C? If so, then why are they stated differently? Corrected. MAB Second Part of A: "Prevents Prevents overheating" overheating of what? Should this state Prevents overheating of the RHR pump components? Corrected. MAB Second part ofB: of B: which pump? RHR? Corrected. MAB How is second part of D plausible? How is a HX ever needed when injecting? Q modified. MAB Q If stopping RHR pumps is done to prevent overheating, then preventing overheating would ensure future operability of the pumps. This may cause the second part of A and B to not be plausible because the second part of A is a subset ofB. of B. Discuss with licensee. Q Q modified. MAB of2l Page 14 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KlA# B L L Psychometric Flaws Psyclwietric Flas Content Flaws U U Comment M 00 00 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q-Q= SRO E Explanation N N KK DD Focus Cred Cred K/A KIA Only S Dist Dist B/W SRO-only: Discuss how this question is SRO-only. Is there a procedure selection aspect to the question? To elevate a question to SRO-only based on detailed procedure knowledge, the procedure knowledge must be used 10CFR55.43 to make a procedure selection, which then links it to the IOCFR55.43 requirement for SROs to have procedure selection knowledge. The question appears to be testing whether or not to stop RHR pumps (( or to align CCW) and why an operator would perform the action. An RO is required to know why he would either stop an RHR pump or align CCW to the RHR HX. II could not link this question to 10 CFR 55.43. Q modified. MAB Q 77 007EA2.02 M H 22 xx x lUj ESP-O.2 ESP-0.2 appears to be contingent on a coolcooldown down being required when step 19 is being performed. If a cooldown is not required, then UOP-2.3 would S be the correct transition. Tech Specs require them to be < < 325F within 12 hours, so when step 19 is performed, could the applicant make the decision that it is not necessary to perform the cooldown, or continue to perform the cooldown, at that time? Could the applicant assume that the plant was already less than 325F 32SF due to the cooldown that was in progress? Is it necessary to include RCS Cold Leg Temps in the stem? Yes - addressed in revision. MAB Offsite Power will not be restored for 18 hours and Tech Specs require that RCS temp be less than 325F32SF within 12 hours. How is anything except a Cooldown Natural Circ Cool down (ESP-0.2) credible? Is there potential to change the UOP-2.3 option to ESP-0.3? Yes - addressed in revision revision. MAB 78 007G2.4.2 N H 4 x lUj How is knowledge of EOP entry conditions being tested? Licensee successfully explained how knowledge of the KIA K/A was required S to arrive at the correct answer. MAB Do you expect and require your operators to know that the rupture disk will not blow for the first hour of this malfunction? If the licensee believes this knowledge to be operationally valid and a necessary knowledge item for their operators, then this aspect of the question will be OK. Discuss with the licensee. Licensee agreed that shorter term plant and operator response would be more operationally valid. Q Q revised accordingly. MAB Be specific in the QQ statement that the leakage into the PRT is from the PORV. If it were from a makeup water source, such as CCW, then the leakage spec would not apply. Incorporated MAB Incorporated. 79 008AA2.15 008AA2.l5 B L 3 x lUj How is knowledge of a vapor space accident being tested? The Howisknowledgeofavaporspaceaccidentbeingtested? question Thequestion contains PORV malfunctions requiring the PORVs to be isolated, but there Page 15 of21 of 21
ES-401, Rev. 9 Review Worksheet Written Exam Review Form Form ES-401-9 Farley 2010-301 Farley Q# Q# K/A# KlA# B B LB LU Psychometric Flaws_____ Psychometric Flaws Content Flaws Content Flaws U U Comment Comment M M 00 00 Stem Stem Cues Cues T/F T/F 11 Non >1 Non
>1 Partial Partial Mm Min Q=
Q= SRO SRO EE Explanation Explanation N KK D D Focus Focus Cred Cred Cred Cred K/A KIA Only Only SS fist Dist fist Dist B/W BIW SS is no vapor space accident; therefore, no knowledge of a vapor space space accident is required to answer the question. The analysis of this question was verified by other CEs. (I do understand that this same question and KIA K/A was allowed for the 2007 Vogtle NRC exam, but this question must be evaluated against the requirements ofNUREO-1021. of NUREG-l021. Currently this question does not meet the requirements ofNUREO-102l) 0fNUREG-l02l) Q Q modified. MAB Does the question need to explicitly state that the components do not get fixed? This may tighten the question slightly so that a shutdown is required by TS. It may be that no PORV maintenance can likely be performed while hot, but ifit if it is at all possible, then some words may need to be added. Q Q modifiedlreplaced. modified/replaced. MAB 80 0l4A2.04 014A2.04 N H 2 xx Y U How is this question SRO-only? The second part of each answer choice is being relied upon to meet the KIA K/A at the SRO level. The second part does S not require any procedure selection knowledge. An operator only needs to know basic reactor trip criteria or an action that is required when a rod is misaligned. Discuss with licensee. Q Q replaced. MAB Q Q may be backward logic - which II will allow as long as the licensee agrees that the Q Q is presented in a clear manner. Q Q replaced. MAB 81 015G2.4.ll 01502.4.11 N H 2 S S Q Q is sat. 82 022A2.Ol 022A2.01 N N H H 22 xx B N Suggest adding AUG AUO to each of the days in the distractors. Incorporated. MAB Incorporated SS plausibility of Discuss plausibility ofBB with licensee. It It may not be credible for an containment cooling applicant to apply a containment cooling condition to the required action containment spray condition. One solution for a containment solution would be to change the stem so that the 1010 days from entry into the LCO applies, thus proving an extra distractor. Incorporated. MAB 83 83 022AG2.4.50 022AG2.4.50 M H H 22 B E TIle ARP does not state The state an order or sequence for pump pump start start and stop. SOP-2.1I direct the operator to start the standby pump prior Does SOP-2. prior to SS securing the running securing running pump? Yes - SOP Yes SOP states states the the order. order. MAB MAB Is racking Is racking out out DFO6 DF06 required required by by TS TS 3.5.2? Have the 3.5.2? Have the licensee licensee walk walk meme through this. through this. Yes - mop Yes inop pump pump needs needs toto be be racked racked outout to to make make auto auto start start operable. operable. MAB MAB Page 16 Page 16 of2l of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KlA# K/A# B L L Psychometric Flaws_____ Ppmetric Flaws Content Flaws U Comment M 0 0 0 0 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q-Q SRO E Explanation N N K DD Focus Cred Cred K/A KIA Only SS Dist Dist B/W BIW Generally we do not require applicants to know> 1 I hour TS from memory. This question requires that the applicants know a 72 hour action without a reference provided. One solution would be to state, for the second part of each answer choice, that TS 3.0.3 actions either ARE required or ARE NOT required. Therefore, the specific 72 hours would not appear in the answer choices. Corrected. MAE 84 026A2.04 M M H 22 x tJ U Question is SRO-only because of the TS basis knowledge, but there is no procedure selection tie to 10 CFR 55.43. S Licensee noted. MAB Licenseerioted. With the B containment spray pump operating with stable flow, how would an applicant have a credible misconception that the sump had blockage? Why would an operator stop a spray pump with stable flow and conditions met to go to recirc? Discuss plausibility with licensee. Second part of A and B may need to be replaced. Stem revised to address concern. concern MAB 85 027AA2.04 N H 2 x x tJ U The Conduct ofOps procedure does not appear to REQUIRE that the SM provides the direction to place the controller back to AUTO. The Conduct S of Ops procedure only states that the SS will consult with the SM after the plant is stable. Placing a repaired controller back to auto may not be viewed as an action that would need SM approval. TI1e The controller was failed in a mid position whether the controller was in auto or manual. It is also likely that the pressure will be restored to NOP with the controller in manual, then placed in auto. Placing the controller in auto may not even be viewed as a recovery action since the failure did not appear to be related to controllers behavior as it related to auto control. My concern is that the controller's the supporting documentation does not appear to thoroughly support the cOlTect correct answer. Discuss with licensee. I think this question would require more definitive supporting documentation to support the answer. Q modified to address concerns. MAB Q correct answer? No cOlTect Have licensee explain how TS 3.4.1 requires the plant to be stabilized at the cUlTent cunent power level. It appears to me that TS 3.4.1 requires that pressure be restored above 2209 psig within 2 hours - this is not the same current power level. Furthermore, the plant is as stabilizing the plant at the cUlTent already stable at 2205 psig yet conditions of TS 3.4.1 are not met. Q modified to address concerns. MAE Q How is immediately beginning a d0W11 down power plausible? The down power will not improve pressure - it could even lower pressure which would make the situation worse. of2l Page 17 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# KlA# B L L Psychometric Flaws Content Flaws U Comment M M 00 00 Stem Cues T/F 1I Non >1 Non Partial Mm Min Q= Q SRO E Explanation N N K D Focus Cred Cred K/A KIA Only S Dist Dist BIW Q modified to address concerns. MAB Q 86 027G2.2.42 N H 2 g earmarked for higher scrutiny at licensee's Question eannarked licensees request. Licensee is concerned that question presentation may be confusing or flawed in some S manner. One observation: The question statement asks about the operability of the sump, yet the fill in the blank is asking about the operability of the pH control system. This results in a lot of confusion because the test taker does not know whether he is to evaluate the sump for operability of the pH control system. The fill in the blank needs to mirror the question that is being asked. Consider: Which one of the following states the operability status of the ECCS Recirc Fluid pH control system per TS 3.5.6, ECCS Recirculation Fluid pH Control System and the reason? Discuss with licensee. Q modified to address concerns. Q concerns MAB 87 065AG2.4.47 N H 2 5 S Q is sat. Q 88 076G2.4.l I 076G2.4.ll N H 2 5 S Q is sat. Q 89 078G2.2.42 N H 2 S Q is sat. Q 90 1.311 G2. 1.3 N H 2 S Q is sat. Q 91 G2.2.36 B F 2 x tJ U I can discard A and B because the reasons given are too similar, thus making these two distractors to not be credible. The reasons are not S completely independent of one another. For instance: Because no internal valve work was performed, the valve should automatically open when an SIS is received. The reasons must be independent in order to show a clear uniqueness to each choice. Q modified to address concerns. MAB Q The question statement needs to be tied directly to SOP-O.O. TIle SOP-0.0. The question statement and answer choices must mimic the exact wording in the procedure because the wording in the procedure does not state requirements by virtue of the word SHOULD. Therefore, the exact wording of the procedure must be tested. Q modified to address concerns. MAB Q Consider the following: Which_one_of Which the_following_correctly_states_the_OPERABILITY_status one of the following correctly states the OPERABILITY status of2l Page 18 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws______ Flaws Content Flaws U Comment M 00 00 Stem Cues T/F 11 Non >1 Non Partial Mm Min Q= SRO E Explanation N K D Focus Cred Cred K/A KJA Only S S Dist Dist B/W of the MOY MOV after the tagout has restored power and if INOPERABLE, the actions that are suggested prior to return to service, as stated in the guidance in FNP-O-SOP-O.O? A. The MOV MOY should be declared OPERABLE. B. The MOY MOV should be declared INOPERABLE. The valve is required to be time stroked using an SI signal induced by I&C to demonstrate operability prior to return to service. C. The MOY MOV should be declared INOPERABLE. The MOY MOV should to be time stroked in the open direction to demonstrate operability prior to return to service (No SI signal is required to be used). D. The MOV MOY should be declared INOPERABLE. The MOV MOY should be stroked one full cycle to demonstrate operability prior to return to service (time stroke in open direction is not required and No SI signal is required to be used). There may be a better, more efficient way to word the above suggestion - II was just trying to convey the idea. Q Q modified to address concerns. concerns MABMAE The stem states that the valve must be manually closed due to power being removed. Could the control room operator close this valve manually from the MCB prior to power being removed? Is the intent of the question to have the valve locally closed? Q Q modified to address concerns. concerns MAB Your procedure states that manual operation of an MOY MOV that performs a safety function should be electrically stroked prior to return to service. II think that the procedure words may not reflect the intent of the requirement. I think the procedure step is intended to refer to MOYs MOVs that are locally operated mechanically. Licensee noted. noted MAB 92 02.3.37 N H 2 S Q is sat. Q 93 02.3.11 G2.3.l 1 B F 2 5 S Q is sat. Q 94 02.3.12 M F 2 S Q is sat. Q 95 02.4.2 M H 2 x x Y U KIA K/A Match:
- How is Knowledge of system set points, interlocks, and automatic actions S associated with EOP entry conditions being tested? II do not see any entry condition knowledge being required.
- The KIA
- K/A is not met at the SRO level.
level, It is true that the operability portion of this question is SRO, but this knowledge is not required by the KIA. K/A. SRO-Only questions are required to match the KIA K/A with SRO-only required knowledge. This is necessary to preserve the random sample of the SRO Page 19 of21 of2I
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# KJA# B L L Psychometric yçometric Flaws Content Flaws U U Comment M M 00 00 Stem Cues T/F 1I Non >1 Non Partial Min Mm Q; Q= SRO E E Explanation N N K D 0 Focus Cred Cred K/A KJA Only S S Dist Dist B/W material being tested on the exam. Q Qreplaced replaced. MAB MAE Precautions and Limitations are considered to be RO knowledge and the EDO operability is addressed by the P/L in the procedure. EDG Q Qreplaced. replaced. MAB Distractor analysis has a typo on which answer is correct. Corrected. MAB MAE 96 02.4.20 G2.4.20 N H 2 S Q Q is sat. 97 WEO3EG2.4.6 WE03EG2.4.6 N H 2 x tI U Q Q does not require SRO-only knowledge to arrive at the correct answer. ROs are required to understand and be able to perform SDM calcs. The S RO can easily calculate that they do not meet SDM requirements to facilitate further cooldown. Furthermore, ROs are required to know how to calculate cooldown rate and maintain the plant within the cool cooldown down rates as specified in TS. Q Q replaced. MAEMAI3 98 WEIOEA2.2 N H 2 x tI U Step-wise a defined term at Farley? If not, then use a few more words Is "Step-wise" to explicitly state that the cooldown is to be completed prior to the depress. S Addressed. MAB What 10 CFR 55.43 tie exists to make this an SRO-only level question? Addressed. MABMAE Does the question force the applicant to make an assumption on the value subcooling? of sub cooling? This affects the plausibility ofC of C and D. Ifan If an applicant has no way of knowing how much subcooling exists, then he has no way of figuring out whether or not dumping steam even makes sense. Addressed. MABMAS Can we be assured that the second part of C and D is not correct? II have concerns that it could be argued as correct. TIle concems The cooldown will continue, so maybe the wording can be enhanced to ensure that the choice is incorrect. Discuss with licensee. Addressed. MABMAS 99 WE1 WEllI N H 2 5 S Q Q is sat. EG2.1 .28 EG2.1.28 100 WE15 WEl5 M H 2 5 S Are the applicants expected to know what step 7 is intended to do, or does EA2.2 choices! this step need to be described for the applicants in the answer choicesl Addressed. MABMAS of2l Page 20 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Page 21 of21 of2l
ES-403 Written Examination Grading Quality Checklist Form ES-403-1 () Facility: r:AALl~'" qtt-( Date of Exam: 1:3 (3 Af'RIL i1RL zjt
;;{o1D Exam Level: Rq-il RO[j SRO[:>C]
SRO[xJ Initials Item Description a b c
- 1. Clean answer sheets copied before grading 411 ~
1 M8
- 2. Answer key changes and question deletions justified and documented -f!/
rfJ3
- 3. Applicants scores checked for addition errors Applicants' (reviewers spot check> 25% of examinations) -fit iWJ7
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 111 fYj5?
- 5. All other failing examinations checked to ensure that grades are justified ?tI V'NP
- 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity yW9 of questions missed by half or more of the applicants of 11/ V Printed Name/Signature Date
- a. Grader rn/cf/Aft (11lcllIJEL K'. /YI££K5/~~ /
()~~/Zol" Reviewer(*)
- b. Facility Reviewer(*) NIp, N/11
- c. NRC Chief Examiner (*) (*) j.
N\I\R'l A. i-rj.c BAT! S / ,YZJ(c
/ JIYlJC'. J~ OS~w/RO/O dd. NRC Supeisor Supervisor (*) (*) ~I..U L.~LDN.lMJAl ~tC1 ~ 65(~/tt>
'(
(*) (*) The facility reviewers reviewer's signature is not applicable for examinations graded by the NRC;
-- "")
two independent NRC reviews are required. ES-403, Page 66 of 66 ()}}