ML101650281
| ML101650281 | |
| Person / Time | |
|---|---|
| Site: | Farley |
| Issue date: | 06/07/2010 |
| From: | NRC/RGN-II |
| To: | Southern Nuclear Operating Co |
| References | |
| 50-348/10-301, 50-364/10-301 | |
| Download: ML101650281 (38) | |
Text
{{#Wiki_filter:ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Date of Examination: I1pNl ID Developed by: Written - Facility NRC II Operating - Facility NRC D Target Chief Date* Task Description (Reference) Examiners Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) ,q3 -120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) ,t) 2 -120 3, Facility contact briefed on security and other requirements (C.2.c) -120 4. Corporate notification letter sent (C.2.d) /fl!) [-90] [5. Reference material due (C.1.e; C.3.c; Attachment 3)] {-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d) /7l24 {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to faility licensee (C.2h; C.3.e)} {-45} 8. Proposed examinations (including written, walk-through JPM5, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d) I -30 9. Preliminary license applications (NRC Form 398s) due (C.1,l; C.2.g; ES-202) -14 10. Final license applications due and Form ES-201-4 prepared (CII; C.2.i; ES-202) -14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) -7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h) fn -7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204) -7 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prepared by the NRC. ES-201, Page 25 of 28 ES*201 Examination Preparation Checklist Form ES*201*1 Facility: rAAl,td Date of Examination: I1rD\\/ 6010 Developed by: Written - Facility G2l NRC 0 /I Operating - Facility [2] NRCD Target Chief Date* Task Description (Reference) Examiner's Initials -180
- 1.
Examination administration date confirmed (C.1.a; C.2.a and b) mf3 -120
- 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e) Iff2 -120
- 3.
Facility contact briefed on security and other requirements (C.2.c) fJ1f2 -120
- 4.
Corporate notification letter sent (C.2.d) !Y/J!J [-90] [S. Reference material due (C.1.e; C.3.c; Attachment 3)] f(/f; {-7S}
- 6.
Integrated examination outline(s) due, including Forms E5-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-1's, ES-401-1/2, ES-401-3, and mf2 ES-401-4, as applicable (C.1.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility IfIj licensee (C.2.h; C.3.e)} {-4S}
- 8.
Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-S, ES-301-6, and ES-401-6, and any Form mb ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d) -30
- 9.
Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g;
- r$
ES-202) -14
- 10. Final license applications due and Form ES-201-4 prepared (C.1.1: C.2.i; ffI8 ES-202)
-14
- 11. Examination approved by NRC supervisor for facility licensee review
!YfD (C.2.h; C.3.f) -14
- 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
~ -7
- 13. Written examinations and operating tests approved by NRC supervisor fJ1!i (C.2.i; C.3.h)
-7
- 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent mJ3 (C.2.i; Attachment S; ES-202, C.2.e; ES-204)
-7 1S. Proctoring/written exam administration guidelines reviewed IrtE with facility licensee (C.3.k) -7
- 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
~
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prepared by the NRC. ES-201, Page 25 of 28
ES-201 -2 Examination Outline Quality Checklist OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Operating Test Number: FA2O1O-301 initials Item Task Description a b* 1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. w R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
jc. T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. Ito ni d. Assess whether the justifications for deselected or rejected K/A statements are appropriate. (4. pr.. 2. a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, JW(.O S and major transients. M b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using WI P A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D. 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2: (1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form / I (2) task repetition from the last two NRC examinations is within the limits specified on the form LfJc () T (3) no tasks are duplicated from the applicants audit test(s) (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301 -1: (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified .I - (3) no more than one task is repeated from the last two NRC licensing examinations c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections. b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ,QCQ fls c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. 6.R R d. Check for duplication and overlap among exam sections. 4R. (J !&. L e. Check the entire exam for balance of coverage. 4& f.. f. Assess whether the exam fits the appropriate job level (RO or SRO). 6 i-O p t,d ISignature Date
- a. Author C. Vince Richter/
03/24/10
- b. Facility Reviewer (*)
Gary Ohmstede / 03/24/10
- c. NRC Chief Examiner (#)
, B415 / /74I27-
- d. NRC Supervisor UAUDIJr1. W1AL1!
Nc_... /29/ic / Note:
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines ES-201-2 Examination Outline Quality Checklist OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5,2010 Operating Test Number: FA2010-301 Initials Item Task Description a b* C#
- 1.
- a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
W t<R Pto ~ R
- b. Assess whether the outline was systematically and randomly prepared in accordance with tJZ I
Section 0.1 of ES-401 and whether all KIA categories are appropriately sampled. pe. rib T T
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
C4( J'Ju.. rm? E
- d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.
N f4\\ (>L. IWf:>
- 2.
- a.
USing Form ES-301-5, verify that the proposed scenario sets cover the required number CcJ< of normal evolutions, instrument and component failures, technical specifications, ~ tfib S and major transients. I M
- b. Assess whether there are enough scenario sets (and spares) to test the projected number U
and mix of applicants in accordance with the expected crew composition and rotation schedule ()- fM' ~rtP L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. 0
- c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative ~ ~ R and quantitative criteria specified on Form ES-301-4 and described in Appendix D. r£>
- 3.
- a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1 ) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form 14fr ~ 1 (2) task repetition from the last two NRC examinations is within the limits specified on the form ~ T (3) no tasks are duplicated from the applicants' audit test(s) (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1 ) the tasks are distributed among the topics as specified on the form CtR. ~ {Yt$ (2) at least one task is new or Significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
- c.
Determine if there are enough different outlines to test the projected number and mix UR c.tA nfP of applicants and ensure that no items are duplicated on subsequent days.
- 4.
- a. Assess whether plant-specific priorities (including PRA and IPE inSights) are covered f4C- ~ ~
in the appropriate exam sections. G 4A JjCtf> E
- b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
N Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5. 4<< ~ ~ E
- c.
R
- d. Check for duplication and overlap among exam sections.
t4< ~ <<f1S A 'td2-m$ L
- e. Check the entire exam for balance of coverage.
{kIJ
- f.
Assess whether the exam fits the appropriate job level (RO or SRO). ltf=- ""'" rn15 Lr_~~~ignature Date
- a. Author C. Vince Richter 1 03/24/10
- b. Facility Reviewer (*)
Garv Ohmstede 1 DM ____ v 03/24/10
- c. NRC Chief Examiner (#)
l'I\\A?\\I. "'. "BA fe-5 / tr J.,J<.U..I,,d;;;;:""-=---::' tJ'3L.7.sL;'I.()ID
- d. NRC Supervisor JJLlJlJtll-:f. WIOAlMJAf / (",r;-..... J p¥1fI/11J
/ (i WlJ:tfJ 11ft I Note:
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
- Not applicable for NRC-prepared examination outlines
ES-201-3 Examination Security Agreement I 2.. 1. Pre-Examination $.2OL (t4ViJ.C( I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of -8 8 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not beef ut1orized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. 2. PnctFxmirtinn 7 $-t ?w To the best of my knowledge, I did noivulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of s-*W!g. From the date that I entered into this security agreement until the completion of examination administraion, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME 1. C. Vince Richter 2. Howard Fitzwater 3. Gary Ohmstede 4. DarI Stevenson 5. Michael Galle 6. Kevin Riley 7. iPoD 8. rv-W)ZHDlT 9. 10. /.47T -Y ii. KizoMe$
- 12. gp,/
PtJ) 13. IL?r Tfor
- 14. 3Ev_
15. Jk. 1 4Ad,--ç NOTES: JOB TITLE I RESPONSIBILITY Nuclear OPS TRNG INST Nuclear OPS TRNG INST Lead Instructor-Exam DeveloDment Control Technician Simulator Coordinator Nuclear Soecialist I SIGNATURE (1) ( I 4L-. DATE SIGNATURE (2) ij-/2A 7-27-09 L%4( 7-27-09 8-24-09 A4-8-24-09 DATE NOTE - qwio () g/2)ID S
?- *jP.<) f(i Nucjtar nCS Trr.j 4S(1 p.
/ 1 1I -- / ES-201-3 Examination Security Agreement .2
- 1.
Pre-Examination \\.f-S _Zo<o tt.AtI" Uto I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6 8294El-as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not bee'ft~i1fliorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination tL.-.J T-.. *'2.111" 7c..-W t{... yJ -2610 To the best of my knowledge, I did nO~iVUlge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~ 8 :2o/O~ $-l.. ztJfo. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE
- 1.
C. Vince Richter Nuclear OPS TRNG INST 7-27-09 ~4I?-j~re~;~-;-; __ _
- 2.
Howard Fitzwater Nuclear OPS TRNG INST 7-27-09,..-~..Jh:.~~=~---
- 3.
Gary Ohmstede Lead Instructor-Exam Development 'l{oA... J3~-1~7-:;-0~9~~T:~Z;;::Z::::::::=::::::::3
- 4.
Darryl Stevenson Control Technician 8-24-09 ~..!..L-
- 5.
Michael Galle Simulator Coordinator 8-24-09 444.'/;/
- 6.
Kevin Riley Nuclear Specialist I 8-24-09.1'f -I e __
- 7.
/..I? t..J1l..I.,.IF"~D S-:'S "tWIO __
- 8.
m, L4 WILHo II
- r. 0.
'f-Zl-(O __
- 9. -;i'tloc:losefb
~s S ~
- 10. fF~L£~
-SSs ~. g: i;.~;'/,:F,J~iLe S {I~; " {'~~P5 "11',.0 ({}~f. I 7~/'1~/~z,()
- 13.
B:I~y -rkcf'"~ N!4lea... o(>s Tor,.,!! #>strc.tG.n.r ~/_O __
- 14.
)QS"'- ?c:... ~* ?o '111111..0 __
- 15. J'.. /'", A;aelrL..... $
S.>.>. '1-;'b-{D __ NOTES:
ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been üflib°Hzed by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this dateuntiI completion of examination administration except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or providbformance feedback to those applicants who were administered these licensing examinations, except as specifically noted belovi and authorized by the NRC. PRINTED NAME 1. SLCO,-/-OU 2. 7Z 3. io& 4.
- 5. &rv. ii.
IA.) C\\,v
- 6. I4J4 4 4c---
- 7. if?
- 8. WTE 9.io..r (.(-I4.
14. 15. NOTES: JOB TITLE I RESPONSIBILITY SS-OPS. £kje ç çrc
O, 4s 4L1 J41Ai1*-/ -w 9Pç 1 2,P7/ 7 2f&1to /I2Jo qj/jo 2. Post-Examination (.j.-2 4
toi° SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE /--?1 LI /7I/er, ES-201, Page 27 of 28 ES-201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination .f"1JL 2ei L 'I-S-).% -'1~13 -201l:> I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of J g t=~ as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been aulfib"rized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this gat~until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility iicensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination 1I~5'k'o "'-11."1(-1 'Y z.o to To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~. From the date that I entered into this security agreement until the completion of examination administration, I did not insiruct, evaluate, or pr~rformance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1. :3"os ~ Co.. rr6 1\\ .c <:. h.:e> cl, ",I E'..-- "tAo );0
- 2. 'izc.b Sz,-J!o,t
~1}.
- 3. ~ot'\\-,.,.~
~ '1)
- 4.
~\\"':A--: '~~\\..Jl-5:sS ~'Z1-Jl __
- 5. ~r~t&~t:
Sw uliW r GJfj "aeer- '1//'11/0
- 6.
/lV1 f..'- tJ,4s ~ .!#.p~rtrF 7i7M~ 7.~Th~( '.£?.J.' ~ =¥(~ Uf11-~:~'~ ~~ 8.-pr<~-n..~ill~ -Ii ae5
- 9. tJt.JU;x. I1~DUZ-,
7J1d vPS 'fA /G ~ l.j~" - 10.~v.+*c> DlJ. MGf.... CJ9£> '1L.<sl{D_: '/f~ ~i: I.e. J)o',,..erS:n<N ~<L:..:z,..... _-Y'-?ijtJ ta::~2pt 'I,
- 13.
- 14.
- 15.
NOTES: ES-201, Page 27 of 28
Farley April 2010 NRC ADMIN exam outline Page 1 of 1 Verification of Initial Conditions Prior to Core Alterations. Given a set of plant conditions with fuel movement in progress, determine if all Core Alterations initial conditions are satisfied using UOP-4. 1. G2.1.40 (2.8/3.9) G2.1.36 (3.0/4.1) G2.1.32 (3.8/4.0) ES-301 Administrative Topics Outline Form ES-301-1 OPERATING OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Examination Level: SRO + RO Operating Test Number: FA2010301 Administrative Topic Describe activity to be performed (see Note) o e A1.1.A Conduct of Operations RO portion NIR Verification of Initial Conditions Prior to Core Alterations. Given a set of plant conditions with fuel movement in Al 1 A progress, determine if all Core Alterations initial conditions are satisfied using UOP-4.1 and then list all Conduct of Operations N I R Tech Spec conditions REQUIRED ACTIONS and SRO portion COMPLETION TIMES for LCOs not met. G2.l.40 (2.8/3.9) G2.l.36 (3.0/41) G2.2.1.35 (2.2/3.9) G2.1.32 (3.8/4.0) Al.2.S D I R Conduct A Safety Shutdown Assessment and Determine Conduct of Operations Time to Saturation. SRO ONLY G2.l.25 (3.9/4.2) A2.i.A Perform a Shutdown Margin Calculation in modes 1 & 2 Equipment Control D I R for a stuck rod (STP-29.5) SRO + RO OOlA4.1 1 (3.5/4.1) APEOO5 AK1.05 (3.3/4.1) A3.1.R M / R Calculate the Maximum Permissible Stay Time within A3.1.S Emergency Dose Limits. Radiation Control G2.3.4 (3.2/3.7) SRO+RO A4. 1.A D I R Make Initial Notifications As Required for an Emergency Emergency Plan
G2.4.43 RO-3.2 SRO-3.8 SRO+RO Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; < 4 for SROs & RO retakes) [213] (N)ew or (M)odified from bank ( 1) [212] (P)revious 2 exams ( 1; randomly selected) [010] ES-301 Administrative Topics Outline Form ES-301-1 OPERATING OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Examination Level: SRO+RO Operating Test Number: FA2010301 Administrative Topic TYJ!e Describe activity to be performed (see Note) Co e* Verification of Initial Conditions Prior to Core Alterations. A1.1.A Given a set of plant conditions with fuel movement in Conduct of Operations N/R progress, determine if all Core Alterations initial RO portion conditions are satisfied using UOP-4.1. G2.1.40 (2.8/3.9) G2.1.36 (3.0/4.1) G2.1.32 (3.814.0) Verification of Initial Conditions Prior to Core Alterations. Given a set of plant conditions with fuel movement in A1.1.A progress, determine if all Core Alterations initial Conduct of Operations N/R conditions are satisfied using UOP-4.1, and then list all SRO portion Tech Spec conditions, REQUIRED ACTIONS and COMPLETION TIMES for LCOs not met. G2.1.40 (2.8/3.9) G2.1.36 (3.0/4.1) G2.2.1.35 (2.2/3.9) G2.1.32 (3.8/4.0) A1.2.S D/R Conduct A Safety Shutdown Assessment and Determine Conduct of Operations Time to Saturation. SROONLY G2.1.25 (3.9/4.2) A2.1.A Perform a Shutdown Margin Calculation in modes 1 & 2 Equipment Control D/R for a stuck rod (STP-29.5) SRO+RO 001A4.11 (3.5/4.1) APE005 AK1.05 (3.3/4.1) A3.1.R M/R Calculate the Maximum Permissible Stay Time within A3.1.S Emergency Dose Limits. Radiation Control G2.3.4 (3.2/3.7) SRO+RO A4.1.A D/R Make Initial Notifications As Required for an Emergency Emergency Plan - 02.4.43 RO-3.2 SRO-3.8 SRO+RO
- Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ~ 3 for ROs; ~ 4 for SROs & RO retakes) [2/3]
(N)ew or (M)odified from bank e 1) [2/2] (P)revious 2 exams << 1; randomly selected) [0/0] Farley April 2010 NRC ADMIN exam outline Page 1 of 1
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 OPERATING OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Exam Level (both): RO SRO-l Operating Test No.: FA2O1 0301 Control Room Systems (8 for RO; 7 for SRO-i) System I JPM Title Type Code* Safety Function
- a. Perform an emergency boration. CRO-065C mod.
024AA2.02 3.9/4.4 024AA2.01 3.8/4.1 S, D, A, L 1
- b. CRO-327A Align PRF System For A Large Break LOCA S, D, L 7
073G2.3.11 RO-3.8 SRO-4.3
- c. CR0- 333E Perform Required Actions for transfer to simultaneous S, M, A, L 3
hot and cold leg recirculation 006 A4.07 RO 4.4 SRO 4.4
- d. Perform required actions in response to RCP Seal Failures. CRO-047A K/A APEO1 5AA1.22 4.0/4.2 S, D, A 4p 003A2.02 3.7/3.9
- e. CRO-133A Start Up The Containment Cooling System 5, D, P, L 5
022A4.01 3.6/3.6 022A4.03 3.2/3.2 On the 2007 NRC exam
- f. CRO-359E Start 1 C DG From The EPB And Align To Supply 1 F S, M, A 6
4160V Bus 055EA1.02 4.3/4.4 055EA1.06 4.1/4.6 055EA2.03 3.9/4.7
- g. CR0-NEW Perform Corrective Actions In Response To a CCW 8
pump trip S, D, L 008A2.01_3.3/3.6 026AA1.02 3.2/3.3
- h. CRO-406A Verify CTMT Isolation Phase A Is Actuated And S, A, D, L 2
Aligned 013A4.01 4.5/4.8 ONLY In-Plant Systems (3 for RO; 3 for SRO-i; 3 or 2 for SRO-U) System / JPM Title Type Code* Safety Function
- i. SO 386 Conduct a Waste Gas release 071A4.26 (3.1/3.9)
D, R 9
- j. SO-314A Operate the TDAFW pump locally without control power D, L, E 4s 061A2.03 3.1/3.4
- k. SO-347A Place The Swing Battery Charger In Service D
058AA1.02 3.1/3.1 058AA1.03 3.1/3.3 All control room (and in-plant) systems must be different and serve different safety functions; in plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for ROI SRO-i [ACTUAL]
(A)lternate path 4-6 I 4-6 [514] (C)ontrol room [010] (D)irect from bank < 9 / < 8 [918] (E)mergency or abnormal in-plant > 1 /> 1 [111] (L)ow-Power I Shutdown > i /> 1 [716] (N)ew or (M)odified from bank including 1 (A) > 2 I> 2 [212] (P)previous 2 exams < 3 / < 3 (randomly selected) [Ill] (R)CA >1/>1 [Ill] (S)imulator [817] 6 Farley April 2010 NRC JPM exam Page 1 of 1 ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 OPERATING OUTLINE SUBMITTAL Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Exam Level (both): RO SRO-I Operating Test No.: FA2010301 Control Room Systems (8 for RO; 7 for SRO-i) System / JPM Title Type Code* Safety Function
- a. Perform an emergency boration. CRO-065C mod.
024AA2.02 3.9/4.4 024AA2.01 3.8/4.1 S,D,A,L 1
- b. CRO-327A Align PRF System For A Large Break LOCA S,D,L 7
073G2.3.11 RO-3.8 SRO-4.3
- c. CRO-333E Perform Required Actions for transfer to simultaneous S,M,A,L 3
hot and cold leg recirculation 006 A4.07 RO 4.4 SRO 4.4
- d. Perform required actions in response to RCP Seal Failures. CRO-047A KIA APE015AA 1.22 4.0/4.2 S,D,A 4p 003A2.023.7/3.9
- e. CRO-133A Start Up The Containment Cooling System S,D,P,L 5
022A4.01 3.6/3.6 022A4.03 3.2/3.2 On the 2007 NRC exam
- f. CRO-359E Start 1C DG From The EPB And Align To Supply 1F S,M,A 6
4160V Bus 055EA1.02 4.3/4.4 055EA1.06 4.1/4.6 055EA2.03 3.9/4.7
- g. CRO-NEW Perform Corrective Actions In Response To a CCW 8
pump trip S,D,L 008A2.01 3.3/3.6 026AA1.02 3.2/3.3
- h. CRO-406A Verify CTMT Isolation Phase '"A" Is Actuated And S,A,D,L 2
Aligned RO 013A4.01 4.5/4.8 ONLY In-Plant Systems (3 for RO; 3 for SRO-i; 3 or 2 for SRO-U) System 1 JPM Title Type Code* Safety Function
- i. SO - 386 Conduct a Waste Gas release 071A4.26 (3.1/3.9)
D,R 9
- j. SO-314A Operate the TDAFW pump locally without control power D,L,E 4s 061A2.03 3.1/3.4
- k. SO-347A Place The Swing Battery Charger In Service
° 6 058AA1.02 3.1/3.1 058AA1.033.1/3.3 All control room (and in-plant) systems must be different and serve different safety functions; in plant systems and functions may overlap those tested in the control room. ""Type Codes Criteria for ROI SRO-i [ACTUAL] (A)lternate path 4-6/4-6 [514] (C)ontrol room [0/0] (D)irect from bank ~ 9/~8 [9/8] (E)mergency or abnormal in-plant ~ 11 ~ 1 [1/1] (L)ow-Power / Shutdown ~ 11 ~ 1 [7/6] (N)ew or (M)odified from bank including 1 (A) ~2/~2 [2/2] (P)previous 2 exams ~ 31 ~ 3 (randomly selected) [1/1] (R)CA ~ 1/ ~ 1 [1/1] (S)imulator [8/7] Farley April 2010 NRC JPM exam Page 1 of 1
ES-301-3 Operating Test Quality Checklist Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Operating Test Number: FA2O1O-301 Initials
- 1. General Criteria a
b* cf a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 a.)
- 4.
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent /Q ,j, applicants at the designated license level.
- 2. Walk-Through Criteria
a. Each JPM includes the following, as applicable: initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature
system response and other examiner cues
statements describing important observations to be made by the applicant
criteria for successful completion of the task
identification of critical steps and their associated performance standards
restrictions on the sequence of steps, if applicable b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
Printed Name / S,nature Date a. Author C. Vince Richter / 3/24/2010 b. Facility Reviewer(*) Gary Ohmstede / 3/24/2010 c. NRC Chief Examiner(#) I\\ti. A. i-res /i?ZJ I i. o3/2S/a.w d. NRC Supervisor At w,ai/ uvy NOTE: The facility signature is not applicable for NRC-developed tests. Independent NRC reviewer initial items in Column c; chief examiner concurrence required. ES-301-3 Operating Test Quality Checklist I Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Operating Test Number: FA2010-301 Initials
- 1. General Criteria a
b* C#
- a.
The operating test conforms with the previously approved outline; changes are consistent with t4<- Jjl1 ~ sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
- b.
There is no day-to-day repetition between this and other operating tests to be administered Cd<- ~ t$ during this examination.
- c.
The operating test shall not duplicate items from the applicants' audit testes). (see Section D.1.a.) l<R..t"Zb rr£
- d.
Overlap with the written examination and between different parts of the operating test is within uR. ~ ~ acceptable limits.
- e.
It appears that the operating test will differentiate between competent and less-than-competent I(rR )\\0 I me II applicants at the designated license level.
- 2. Walk-Through Criteria
- a.
Each JPM includes the following, as applicable:
- initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee ltjZ I<<> nt$
operationally important speCific performance criteria that include: detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
- b.
Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance kR ~ rn13 criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with lJC-m Mf>
Form ES-301-4 and a copy is attached. Printed Name 1 s~nature Date
- a.
Author C. Vince Richter 1 ~;:'j/~ 3/24/2010
- b.
Facility Reviewer(*) Garv Ohmstede 1 1At-t~ 3/24/2010
- c.
NRC Chief Examiner (#) 1't\\M-",- A. ~1'tfS I rrJ~r,~ ,--ft..~ o3L:J.5Llll/() v ') NRC Supervisor l.L4Wktl"f. WIDM.MJ.N / ,*"1#/~lJ.AI'r - ()f,IB,/J,
- d.
/ (( 7 1/ NOTE: The facility signature is not applicable for NRC-developed tests. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-301 -4 Simulator Scenario Quality Checklist Facilty: Farley Date of Exam: April 5, 2010 Scenario Numbers: 1/3/4/5 Operating Test No.: FA2OI 0-301 QUALITATIVE ATTRIBUTES Initials
a b* 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
2. The scenarios consist mostly of related events. tffL < 3. Each event description consists of the point in the scenario when it is to be initiated (- the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable) 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario 4(2 without a credible preceding incident such as a seismic event.
5. The events are valid with regard to physics and thermodynamics. (d 2-p 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. 44Q Cues are given. 8. The simulator modeling is not altered. 4-g_ Q1 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated c/Q to ensure that functional fidelity is maintained while running the planned scenarios.
10. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). 12. Each applicant will be significantly involved in the minimum number of transients and events /, specified on Form ES-301-5 (submit the form with the simulator scenarios).
13. The level of difficulty is appropriate to support licensing decisions for each crew position. (qZ. O Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes
Scenario Numbers: 1 13/415 1. Total malfunctions (58) 6 / 7 /8 / 6 2. Malfunctions after EOP entry (12) 2 / 2 / 4 I I 3. Abnormal events (24) 3 / 4 / 4/6 4. Major transients (12) 3 / 1 / 3 / 3
5. EOPs entered/requiring substantive actions (12) 1 I 1 / I I 1 2
6. EOP contingencies requiring substantive actions (02) 1 / 0 / 1 / 1 (,e. 7. Critical tasks (23) 5 / 4 / 4 / 3 41_ Page 1 of 1 ES-301-4 Simulator Scenario Quality Checklist xam: April 5, 2010 r>. -I.. /3/4/5 n, 'T. .:~ QUALITATIVE ATTRIBUTES Initials a b* C#
- 1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out Qj( p rW of service, but it does not cue the operators into expected events.
- 2.
The scenarios consist mostly of related events. WL ~ ~
- 3.
Each event description consists of the point in the scenario when it is to be initiated (tV> ~ the malfunction(s) that are entered to initiate the event ~ the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
- 4.
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario ~ ()t.o ~ without a credible preceding incident such as a seismic event.
- 5.
The events are valid with regard to physics and thermodynamics. U/l pa 1>>17
- 6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain ~ ()t.# \\YfJ complete evaluation results commensurate with the scenario objectives.
- 7.
If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. 4/<. tJtI6 ~ Cues are given.
- 8.
The simulator modeling is not altered. ~ fi..::> ~
- 9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated 41<- {)cJO me to ensure that functional fidelity is maintained while running the planned scenarios.
- 10.
Every operator will be evaluated using at least one new or significantly modified scenario. ~ fI...O mf$ All other scenarios have been altered in accordance with Section 0.5 of ES-301.
- 11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6 ccA.,MA ~ (submit the form along with the simulator scenarios).
- 12.
Each applicant will be Significantly involved in the minimum number of transients and events 4f<..- tM> {)(fo specified on Form ES-301-5 (submit the form with the simulator scenarios).
- 13.
The level of difficulty is appropriate to support licensing decisions for each crew position. f4<- ~,~ Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes Scenario Numbers: 1/3/4/5
- 1.
Total malfunctions (5-8) 617/8/6 t42.. J.D ifY'{p
- 2.
Malfunctions after EOP entry (1-2) 2/2/4/1 Cyfd ~ irYX~
- 3.
Abnormal events (2-4) 3/4/4/6 ~ Q\\A >>~~
- 4.
Major transients (1-2) 3/1/3/3 ftP-6\\A) m~
- 5.
EOPs entered/requiring substantive actions (1-2) 1/1/1/1 4?- ~ I~ V
- 6.
EOP contingencies requiring substantive actions (0-2) 1/0/1/1 f4: .IJI.A> 1mb
- 7.
Critical tasks (2-3) 5/4/4/3 14<- ~ I~ Page 1 of 1
ES-301-5 Transient and Event Checklist Facility: Farley Nuclear Plant Date of Exam: April 5, 2010 Operating Test No.: FA2O1O-301 A E Scenarios
P V (2not 3 4 T M P E submitted 0 I T I T CREW CREW CREW CREW A I C POSmON POSmON_9I 9TN L U A T S A B S A B S A B S A B M(*) N Y R T 0 R T 0 R T 0 R T 0 T P 0 C P 0 C P 0 C P o c R lU E RX 1 1 1 3 110 SROl NOR 1111 SRO-U I/C 234 234 234 19 4 4 2 578 567 579 8 MAJ 678 7 678 7 221 TS 245 456 35 8 0 2 2 RX 1
1 13110 RO NOR 0111 I/C 24 246 359 8 4 4 2 MAJ 678 7 678 7 2 2 1 TS
0 0 22 ROl RX 1 1 110 BOP NOR 2 1111 I/C 357 356 247 13 4 4 2 8 78 9 MAJ 678 7 6787 2 21 TS
0 022 Instructions: 1. Check the applicant level and enter the operating test number and Form ES-D-i event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position. 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis. 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns. Page 1 of2 ES-301-5 Transient and Event Checklist Facili~: Farley Nuclear Plant Date of Exam: April 5, 2010 o~erating Test No.: FAZ010-301 A E Scenarios P V 1 (2 not 3 4 T M P E submitted) 0 I L N T N I T CREW CREW CREW CREW A I C POSITION POSITION POSITION POSITION M L U A T S A B S A B S A B S A B M{*) N Y R T 0 R T 0 R T 0 R T 0 T P 0 C P 0 C P 0 C P 0 C P R I U E RX 1 1 1 3 1 1 0 SRO-I NOR 1 1 1 1 OR SRO-U I/C 234 234 234 19 4 4 2 578 567 579 8 MAJ 678 7 678 7 2 2 1 TS 245 456 35 8 0 2 2 RX 1 1 1 3 1 1 0 RO NOR 0 1 1 1 I/C 24 246 359 8 4 4 2 MAJ 678 7 678 7 2 2 1 TS 0 0 2 2 ROI RX 1 1 1 1 0 BOP NOR 2 1 1 1 1 I/C 357 356 247 13 4 4 2 8 78 9 MAJ 678 7 678 7 2 2 1 TS 0 0 2 2 Instructions:
- 1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IIC) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one IIC malfunction can be credited toward the two IIC malfunctions required for the ATC position.
- 2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.
- 3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns. Page 1 of2
Transient and Event Checklist Scenarios Instructions: 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the Uatthecontrols (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns. Page 2 of 2 ES-301-5 Transient and Event Checklist Date of Exam: April 5, 2010 O~erating Test No.: FA2010-301 A E Scenarios P V 5 T M P E 0 I L N CREW T N I T POSITION A I C M S A B L U A T R T 0 M(*) N Y 0 C P R I U T P E RX 1 4 2 1 1 0 SRO-I NOR x 1 1 1 I/C 123 6 4 4 2 568 MAJ 79 3 2 2 1 10 TS 456 3 0 2 2 RX 1 4 2 1 1 0 RO NOR 1 1 1 x IIC 358 3 4 4 2 SRO-I x MAJ 79 3 2 2 1 10 TS 0 0 2 2 RO RX 1 1 0 x NOR 4 1 1 1 1 SRO-I x I/C 126 3 4 4 2 MAJ 79 3 2 2 1 10 TS 0 0 2 2 Instructions:
- 1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC pOSitions, including at least two instrument or component (IIC) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one IIC malfunction can be credited toward the two IIC malfunctions required for the ATC position.
- 2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be Significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.
- 3.
Whenever practical, both instrument and component malfunctions should be inctuded; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns. Page 2 of2
ES-301-6 Competencies Checklist Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Operating Test No.: FA20 10-30 1 APPLICANTS SRO-I X RO X BOP X SCENARIO SCENARIO 1234 1 2 3 4 1 2 3 4 (4) (4) (4) Interpret/Diagnose Events 2 3 1 2 2 3 2 4 2 4 3 4 3 5 6 1 3 2 4 and Conditions 4 5 3 4 4 5 5 6 6 7 5 6 7 8 5 6 6 7 67 56 67 7 78 78 89 8 78 89 911 10 10 11 ComplyWithand 12 12 12 12 12 13 135 15 12 Use Procedures (1) 3 4 3 4 3 4 4 7 4 6 5 6 6 7 8 6 7 4 6 56 5656 7 8 78 78 7 78 910 Operate Control 1 2 1 2 1 3 1 3 5 1 3 1 2 Boards (2) 4 6 4 6 5 6 7 8 5 6 4 6 7 7 89 78 78 11 910 Communicate 12 12 12 12 12 13 135 13 12 andliteract 34 34 34 46 46 56 678 56 46 56 56567 7 89 7878 78 78 78 11 910 9 10 11 Demonstrate Supervisory 2 3 1 2 1 2 Ability(3) 45 34 34 67 56 56 8 7 78 Comply With and 2 4 4 5 3 5 Use Tech Specs (3) 5
6
Notes: (1) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. (4) Scenario #2 was not submitted. instructions: Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competencyfor every applicant. Competencies ES-301-6 Competencies Checklist Facility: Farley Nuclear Plant Date of Examination: April 5, 2010 Ol!erating Test No.: FA201O-30l APPLICANTS Competencies SRO-I X RO X BOP X SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 1 2 3 4 (4) (4) (4) Interpret/Diagnose Events 23 12 23 24 24 34 356 1 3 24 and Conditions 45 34 45 56 67 56 78 56 67 67 56 67 7 78 78 89 8 78 89 911 10 10 11 Comply With and 12 12 12 12 12 13 135 1 5 12 Use Procedures (1) 34 34 34 47 46 56 678 67 46 56 56 56 7 8 78 78 7 78 910 Operate Control 1 2 12 13 135 1 3 12 Boards (2) 46 46 56 78 56 46 7 7 89 78 78 11 910 Communicate 12 1 2 12 12 12 1 3 135 1 3 12 and Interact 34 34 34 46 46 56 678 56 46 56 56 56 7 7 89 78 78 78 78 78 11 910 9 10 11 Demonstrate Supervisory 23 12 1 2 Ability (3) 45 34 34 67 56 56 8 7 78 Comply With and 24 45 3 5 Use Tech. Specs. (3) 5 6 I Notes: (1) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. (4) Scenario #2 was not submitted. Instructions: Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-301-6 Competencies Checklist Facility: Fancy Nuclear Plant Date of Examination: April 5, 2010 Operating Test No.: FA2OIO-301 APPLICANTS SRO-I X RO X BOP X SCENARIO SCENARIO SCENARIO 5 5 Interpret/Diagnose 1 2 3 1 3 1 2 4 Events and Conditions 4 5 6 4 5 6 7 8 789 78 910 10 910 Comply With and 1 2 3 1 3 1 2 4 Use Procedures (1) 456 45 678 789 89 910 10 10 Operate Control 1 3 1 2 4 Boards(2) 45 689 89 10 Demonstrate Supervisory Ability (3) Comply With and 4 5 Use Tech. Specs. (3) Notes: (1) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. Instructions: Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. Competencies Communicate and Interact 123 456 789 10 13 45 89 10 124 678 9 10 123 456 789 10 ES-301-6 Competencies Checklist Facility: Farley Nuclear Plant Date of Examination: AprilS, 2010 Ol!erating Test No.: FA2010-3OI APPLICANTS Competencies SRO-I X RO X BOP X SCENARIO SCENARIO SCENARIO 5 5 5 I nterpret/Diagnose 123 13 124 Events and Conditions 456 45 678 789 78 9 10 10 910 Comply With and 123 1 3 124 Use Procedures (1) 456 45 678 789 89 910 10 10 Operate Control 13 124 Boards (2) 45 689 89 10 Communicate 123 13 124 and Interact 456 45 678 789 89 910 10 10 Demonstrate 123 Supervisory Ability (3) 456 789 10 Comply With and 45 Use Tech. Specs. (3) Notes: (1 ) Includes Technical Specification compliance for an RO. (2) Optional for an SRO-U. (3) Only applicable to SROs. Instructions: Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate evef)l applicable competency for evef)l applicant.
s-c O1 -H ~e~ ~ 4(')1 - ~ ~~ \\ '" U;v1 J t\\)J\\ J~ CN\\ w ~ ~ \\'J~ ~+ '~f~ p\\()uA,
ES-401 -4 Record of Rejected KIAs Page 1 of 2 K/A listed in column 2 is the rejected K/A Tier I Randomly Reason for Rejection Group Selected K/A T1G2 059AK2.02 The original k/a was one of 7 K/As related to radiological releases RO to the environment. This is #1 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected W/E I 6EK2 1 as the replacement K/A. T1G2 060AA2.02. The original k/a was one of 7 K/As related to radiological releases RO to the environment. This is #2 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected 03 7AA2.0$ as the replacement K/A. T3 G2.3.1 1 The original k/a was one of 7 K/As related to radiological releases RO to the environment. This is #3 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected G2.3J 5 as the replacement K/A. T1G2 060AA2.03 The original K/A was one of 7 K/As related to radiological SRO releases to the environment. This is #4 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected W/E I 5EA2.2 as the replacement K/A. Ti G2 W/EO 1 EG2.2.42 The original K/A combined recognizing parameters that required RO Tech Spec application during Rediagnosis in the ERG network. No parameters require Tech Spec Application until after exiting the ERG network, so a question could not be written to this combination of K/A. Examiner (NRC) randomly selected W/E0IiG22. 2 as the replacement K/A. T2G1 007K5.02 The original K/A combined the normal method of drawing a pzr RO bubble and the effect on the Pressurizer Relief tank. At Farley there is no effect on the PRT during the procedure for drawing a bubble, thus no discriminatory question could be written to this combination of K/A. Examiner (NRC) randomly selected 007A3.01 as the replacement K/A. ES-401-4 Record of Rejected KlAs Page 1 of 2 KJA listed in column 2 is the rejected KJA Tier I Randomly Reason for Rejection Group Selected KIA TlG2 059AK2.02 The original k/a was one of 7 KI As related to radiological releases RO to the environment. This is #1 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected 1 as the replacement KIA. TlG2 060AA2.02. The original k/a was one of 7 KI As related to radiological releases RO to the environment. This is #2 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected as the replacement KIA. T3 G2.3.l1 The original k/a was one of 7 KI As related to radiological releases RO to the environment. This is #3 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected . 5 as the replacement KIA. TIG2 060AA2.03 The original KIA was one of 7 KI As related to radiological SRO releases to the environment. This is #4 of 4 that was replaced and 3 were retained to avoid excessive overlap in the different questions. Examiner (NRC) randomly selected as the replacement KIA. TlG2 W lEO lEG2.2.42 The original KIA combined recognizing parameters that required RO Tech Spec application during Rediagnosis in the ERG network. No parameters require Tech Spec Application until after exiting the ERG network, so a question could not be written to this combination of KIA. Examiner (NRC) randomly selected as the replacement KIA. T2Gl 007K5.02 The original KIA combined the normal method of drawing a pzr RO bubble and the effect on the Pressurizer Relief tank. At Farley there is no effect on the PRT during the procedure for drawing a bubble, thus no discriminatory question could be written to this combination of KIA. Examiner (NRC) randomly selected .01 as the replacement KIA.
ES-401 -4 Record of Rejected KIM Page 2 of 2 Tier / Randomly Reason for Rejection Group Seected K/A TIG1 026AA1.04 The original K/A required testing of a system that FNP does not RO have. It combined CCW and a temperature moinitoring system for the CRDMs. The CRDMs at FNP are air cooled, and have no temperature monitoring system. They also have no alarms on high temperature. Examiner (NRC) randomly selected 026AA I.() 1 as the replacement K/A. T1GI 027AA2.17 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected 027AA2.04 as the replacement K/A. T2G2 015G2.4.9 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected 01 5G2.4. I I T1G2 WEO3EG2.4.5 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected WEO3G2.4.6 as the replacement K/A T1G2 024G2.4.20 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected 076G2.4, I I TIG1 008AA2.15 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected OOSG2.4.4 I as the replacement K/A. T1G2 00502.4.18 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected 005G2.23$ as the replacement K/A. T1GI 027AA2.04 Could not write a discriminating SRO level question to K/A. SRO Examiner (NRC) randomly selected 027AA2. 15 as the replacement K/A. ES-401-4 Record of Rejected KlAs Page 2of2 Tier / Randomly Reason for Rejection Group Selected KIA TlGl 026AAl.04 The original KIA required testing of a system that FNP does not RO have. It combined CCW and a temperature moinitoring system for the CRDMs. The CRDMs at FNP are air cooled, and have no temperature monitoring system. They also have no alarms on high temperature. Examiner (NRC) randomly selected I I as the replacement KIA. ~ 027AA2.17 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected as the replacement KIA. II :~ I015G249 Could not write a discriminating SRO level question to KIA. Examiner (NRC) randomly selected 0 j 5G2.4. 11 ~ WE03EG2.4;5 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected as the replacement KIA TlG2 I 024G24.20 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected 076G2.4 11 TlGl 008AA2.15 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected 1 as the replacement KIA. TlG2 005G2.4.18 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected as the replacement KIA. TlGl 027AA2.04 Could not write a discriminating SRO level question to KIA. SRO Examiner (NRC) randomly selected J 5 as the replacement KIA.
ES-401-6 Written Examination Quality Checklist Facility: FA2O1O-301 Date of Exam: April 5, 2010 Exam Level: RO x SRO x Initial Item Description a b* c# 1. Questions and answers are technically accurate and applicable to the facility. 2. a. NRC K/As are referenced for all questions. b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 L4.j_ P 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).
5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: X the audit exam was systematically and randomly developed; or X the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 13 / 4 12 /7 50 / 14 (1 question distribution(s) at right.
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehensionl analysis level; the SRO exam may exceed 60 percent if the randomly 30 / 5 45 / 20 selected K/As support the higher cognitive levels; enter the actual RO) SRO question distribution(s) at right.
8. References/handouts provided do not give away answers 4j2 p, or aid in the elimination of distractors. 9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B. 61k-mc:13 11. The exam contains the required number of one-point, multiple choice items; yy)j3 the total is correct and agrees with the value on the cover sheet. Printed Name I Signature Date
- a. Author C. Vince Richter/
03/24/2010
- b. Facility Reviewer (*)
Gary Ohmstede / 03/24/2010
- c. NRC Chief Examiner(#)
MMA.6A16S/47 t;7
- d. NRC Regional Supervisor AAt(L&1 Note:
- The facility reviewers initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-401-6 Written Examination Quality Checklist Facility: FA2010-301 Date of Exam: April 5, 2010 Exam Level: RO x SROx Initial Item Description a b* c#
- 1.
Questions and answers are technically accurate and applicable to the facility. 4f2 ,.,.;> I'\\1fJ
- 2.
- a.
NRC KlAs are referenced for all questions. f4<.- pW fY'IB
- b.
Facility learning objectives are referenced as available.
- 3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 Ltf<-- ~ ffl1?;
- 4.
The sampling process was random and systematic (If more than 4 RO or 2 SRO questions ~ ~ ~ were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).
- 5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: ~ the audit exam was systematically and randomly developed; or ~ {l$ ~ _ the audit exam was completed before the license exam was started; or /M _ the examinations were developed independently; or _ the licensee certifies that there is no duplication; or _ other (explain)
- 6.
Bank use meets limits {no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest '4Z ~ (lfb new or modified); enter the actual RO / SRO-only 13/4 1217 50/14 question distribution{ s) at right.
- 7.
Between 50 and 60 percent ofthe questions on the RO Memory CIA exam are written at the comprehension/ analysis level; ~ the SRO exam may exceed 60 percent if the randomly 30/5 45/20 UR-ft-o selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution{s) at right.
- 8.
References/handouts provided do not give away answers or aid in the elimination of distractors. t4<- {h;::> ~
- 9.
Question content conforms with specific KIA statements in the previously approved ~ M1? examination outline and is appropriate for the tier to which they are assigned; jrto deviations are justified.
- 10.
Question psychometric quality and format meet the guidelines in ES Appendix B. 4ft. (N) rYlJ3
- 11.
The exam contains the required number of one-point, multiple choice items; t.,p... ~ M13 the total is correct and agrees with the value on the cover sheet. Printed Name / Signature Date
- a. Author C. Vince Richter /
kR... :. ~ 03/24/2010
- b. Facility Reviewer (*)
Garv Ohmstede / fl1v)t ~ 03/24/2010
- c. NRC Chief Examiner (#)
I'llAAAA. f>A-rtS1J'Y7-1l~:'1".~ 0Jf(/;;;;
- d. NRC Regional Supervisor lH.I..I'IJU.t-r.WtTWN.JII.l/ JfJ':\\
~. L ~.u.C(M - Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W
GENERAL COMMENT
S B= Bank / M=Modifled / N=New / F=Fundamental Level (I.E. Memory) / HHigher Cognitive Level (I.E. C/A) For All BANK questions: swap the order of the answer choices so that applicants cannot rely on recall of the correct answer location. Incorporated on all but three Qs, but those have stems with slightly different format and are thereby acceptable, MAB This worksheet was used by the CE to ensure the written exam met the requirements of NUREG-102 1. The worksheet was not used in a manner that would allow the total number of unsat questions to be calculated by comparing the draft exam and the final exam in conjunction with this worksheet. The SRO portion of the examination contained 7 questions that did not fully meet the requirements of NUREG-102l. Three of these questions not meeting the standard was due to interim guidance that was slightly different than the guidance used to evaluate those questions. Therefore, it was determined that only 4 questions would be counted as unsat. Therefore, the exam was determined to be within the quality standards as defined in NUREG-lO2l. BC notified program office of documenting exam as a satisfactory submittal. RO EXAM I OO1AK2.06 B H 2 S Q is sat. 2 0011(2.02 M F 2 S Q is sat. 3 003A2.03 N H 3 S Q is sat. I do not agree that reactor trip criteria is SRO-only knowledge unless it appears as a < 1 hour TS also. Licensee noted. MAB 4 004G2.4.2l N H 2 N I believe this to be a good RO question. How does the second part of this question compare to some of the SRO questions that were justified as S SRO-only based on detailed procedure knowledge, or strategically how to address the plant conditions? Licensee noted. MAB Word the question statement to ask for the actions that are required to be performed, as opposed to the actions the will be performed. Incorporated. MAB Page 1 of2I ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dis! Written Exam Review Worksheet Farley 2010-301 Content Flaws V >1 Non Partial Min Q~ SRO E Cred KIA Only S Dist B/W
GENERAL COMMENT
S B= Bank I M=Modified I N~New I F=Fundamental Level (I.E. Memory) I H=Higher Cognitive Level (I.E. CIA) Form ES-401-9 Comment Explanation For All BANK questions: swap the order of the answer choices so that applicants cannot rely on recall of the correct answer location. Incorporated on all but three Qs, but those have stems with slightly different format and are thereby acceptable. MAB This worksheet was used by the CE to ensure the written exam met the requirements of NUREG-I02 I. The worksheet was not used in a manner that would allow the total number of un sat questions to be calculated by comparing the draft exam and the final exam in conjunction with this worksheet. The SRO portion of the examination contained 7 questions that did not fully meet the requirements of NUREG-I021. Three of these questions not meeting the standard was due to interim guidance that was slightly different than the guidance used to evaluate those questions. Therefore, it was determined that only 4 questions would be counted as un sat. Therefore, the exam was determined to be within the quality standards as defined in NUREG-1021. BC notified program office of documenting exam as a satisfactory submittal. ROEXAM I 00IAK2.06 B H 2 S Q is sat. 2 001K2.02 M F 2 S Q is sat. 3 003A2.03 N H 3 S Q is sat. I do not agree that reactor trip criteria is SRO-only knowledge unless it appears as a < I hour TS also. Licensee noted. MAB 4 004G2.4.21 N H 2
- g I believe this to be a good RO question. How does the second part of this question compare to some of the SRO questions that were justified as S
SRO-only based on detailed procedure knowledge, or strategically how to address the plant conditions? Licensee noted. MAB Word the question statement to ask for the actions that are "required to be performed," as opposed to the actions the "will be perfOlmed." Incorporated. MAB Page 1 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric_Flaws Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W What conditions could occur in the plant that would cause the severe difference in the magnitude of the five highest CETs? Is this an operationally valid condition? CET Failures MAB Second bullet: have should be has. Corrected. MAB 5 004K1.04 N H 2 S Q is sat. 6 005A1.07 N H 2 N Why does A and C simply state the status of the valve, I.E. OPERABLE, yet B and D state that they need to declare the valve INOPERABLE? S Why not make all answer choices simply state OPERABLE or INOPERABLE? Incorporated. MAB Question statements should be written to test the requirements, as opposed to what a CR WILL contain. Suggest the following wording for the Q statement: Which one of the following describes the OPERABILITY of MOV8889 lAW TS and STP-ll.6 and the actions that are required to be placed in a CR lAW STP-l 1.6? Incorporated MAB 7 005K4.03 N 1-1 2 N Are there any check valves in the air supply line that would trap air in the valve for a time period, thus allowing the valve to hold its position for a S short time period? In other words, is only stating that IA is lost enough to ensure the valve has failed closed due to losing air pressure within the valve operator? Incorporated. MAB 8 006K6.13 B F 3 5 Q is sat. 9 007A3.Ol B F 2 5 Q is sat. Why do two answer choices contain actions to vent? Can the answer choices be more simply stated as pump down with RCDT pump vs. gravity drain? If the level rise is the cause of the pressure increase, then venting should not be needed. Four unique answers would still exist if the venting portion of A and D was deleted. Discuss with licensee. Incorporated. MAR Is the Q memory or higher cog? (When does rupture disk blow & how do you lower water level in PRT) Noted. MAB Page 2 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F I Non N K D Focus Cred Dist S 004Kl.04 N H 2 6 OOSAl.07 N H 2 7 OOSK4.03 N H 2 8 006K6.13 B F 3 9 007A3.01 B F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W S E S E S S S Form ES-401-9 Comment Explanation What conditions could occur in the plant that would cause the severe difference in the magnitude of the five highest CETs? Is this an operationally valid condition? CET Failures. MAB Second bullet: "have" should be "has". Corrected. MAB Q is sat. Why does A and C simply state the status of the valve, I.E. OPERABLE, yet Band D state that they need to "declare the valve INOPERABLE?" Why not make all answer choices simply state OPERABLE or INOPERABLE? Incorporated. MAB Question statements should be written to test the requirements, as opposed to what a CR WILL contain. Suggest the following wording for the Q statement: Which one of the following describes the OPERABILITY ofMOV-8889 lAW TS and STP-l1.6 and the actions that are required to be placed in a CR lAW STP-ll.6? Incorporated. MAB Are there any check valves in the air supply line that would trap air in the valve for a time period, thus allowing the valve to hold its position for a short time period? In other words, is only stating that IA is lost enough to ensure the valve has failed closed due to losing air pressure within the valve operator? Incorporated. MAB Q is sat. Q is sat. Why do two answer choices contain actions to vent? Can the answer choices be more simply stated as "pump down with RCDT pump" vs. "gravity drain"? If the level rise is the cause of the pressure increase, then venting should not be needed. Four unique answers would still exist if the venting portion of A and D was deleted. Discuss with licensee. Incorporated. MAB Is the Q memory or higher cog? (When does rupture disk blow & how do you lower water level in PRT) Noted. MAB Page 2 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Qj KJA# B L L Pometric Flaws C.itentFlws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W 10 007Ek2.02 N H 2 S Q is sat. 11 008AA2.26 N H 2 S Last Bullet in First Set of Conditions: Are your applicants trained to memorize the component identifications for R-2, 7, 11, and 12? Incorporated. MAB 12 008K3.01 B H 2 x x U Is there any risk that there may be two correct answers (both A and B)? My concern is that there may be an argument that either set of actions M S would mitigate the problem and could be argued as a correct mitigating strategy? Discuss with licensee. I need to have a better understanding to ensure that there is not a possible way for someone to place Ex LID in service and be considered correct? Q modified. MAB Placing L/D in service may not be plausible. Most of the time when you can take manual control of a function, you would certainly attempt this before you would take more involved action to mitigate. Q modified. MAB Possible solution to address both of above concerns: Consider changing the second part of each answer choice to test whether the failure will add positive reactivity or negative reactivity. Incorporated MAB 13 008K4.09 M H 2 x F What is the status of the C CCW pump? The stem states that it is aligned. A running pump maybe aligned, as well as a non-running pump. S Is it important to be explicit with the status of the pump? Licensee stated that with given plant conditions C CCW Pp would not be permitted to be running except during a pump swap. MAB 14 009EG2.I.23 N H 2 S Are applicants required to know the component identification for FK-l22? [Note: Q 15 provides the name] My basic requirement is that if your procedures also provide noun names for components, then it is permissible on exams. If your procedures are constructed to require the operators to know the components by id number alone, then that is the limit of what should be stated in an exam question. This is a generic comment that would apply to all questions. Incorporated. MAB 15 OIOKI.03 N H 2 x U When a bubble is being compressed, I am not convinced that spray valves closing is credible. I understand the justification provided for their S plausibility, but I do not completely agree with the plausibility. Second opinion was obtained from an independent chief examiner. Incorporated. MAB Page 3 of 21 ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 10 007Ek2.02 N H 2 II 00SAA2.26 N H 2 12 00SK3.01 B H 2 M 13 00SK4.09 M H 2 x 14 009EG2.1.23 N H 2 15 o 10K 1.03 N H 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W S S x x tJ: S .g S S x tJ: S Form ES-401-9 Comment Explanation Q is sat. Last Bullet in First Set of Conditions: Are your applicants trained to memorize the component identifications for R-2, 7, II, and 12? Incorporated. MAB Is there any risk that there may be two correct answers (both A and B)? My concern is that there may be an argument that either set of actions would mitigate the problem and could be argued as a correct mitigating strategy? Discuss with licensee. I need to have a better understanding to ensure that there is not a possible way for someone to place Ex UD in service and be considered correct? Q modified. MAB Placing UD in service may not be plausible. Most of the time when you can take manual control of a function, you would certainly attempt this before you would take more involved action to mitigate. Q modified. MAB Possible solution to address both of above concerns: Consider changing the second part of each answer choice to test whether the failure will add positive reactivity or negative reactivity. Incorporated. MAB What is the status of the 'c' CCW pump? The stem states that it is aligned. A running pump may be aligned, as well as a non-running pump. Is it important to be explicit with the status of the pump? Licensee stated that with given plant conditions, "C" CCW Pp would not be permitted to be running except during a pump swap. MAB Are applicant's required to know the component identification for FK-122? [Note: Q 15 provides the name] My basic requirement is that if your procedures also provide noun names for components, then it is pelmissible on exams. If your procedures are constructed to require the operators to know the components by id number alone, then that is the limit of what should be stated in an exam question. This is a generic comment that would apply to all questions. Incorporated. MAB When a bubble is being compressed, I am not convinced that spray valves closing is credible. I understand the justification provided for their plausibility, but I do not completely agree with the plausibility. Second opinion was obtained from an independent chief examiner. Incorporated. MAB Page 3 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws Content Flaws U Comment M 0 0 Stem Cues TIF I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W Possible solution to the above concern: Consider replacing the second part of each answer choice with the spray valve demand. Then the applicant must know how the controller is designed to work when pressure needs to be lowered. Incorporated MAB 16 011 K5.05 N H 3 E I need to have the licensee walk me through the diagnosis of the failed channel. I think the question will likely be sat after I have a better S understanding of the indications and how they relate to channel 459 failing. Done. OK MAB 17 012K2.0l B F 2 Q is sat. S Does the question need to state that the RTB and RTBYP bkrs are in their normal configuration for at power operations? No Discussed with licensee MAB Can question be answered at the memory level? Potential to be classified either way? Noted. MAB 18 0 l2K6.03 B F I x U The question statement is written as Rx Trip OR ESF but is testing both Rx Trip AND ESF logic. Does the Q statement need an AND S instead of an OR? Incorporated. MAB What is meant by the minimum additional channels required to meet the RPS and ESF actuation? Is an applicant to predict what would happen if a minimum number of additional pzr press channels failed high? if so, what impact would this have on the ESF? Maybe a more explicit question needs to be asked? Incorporated. MAB LOD=l. Q does not discriminate at appropriate level. Credibility of distractors also is related to LOD. Q modified. OK MAB 19 0l3K2.OI N F 3 5 Q is sat. 20 0l3K5.0l N H 2 S Q is sat. 21 015AK2.l0 N H 2 x Looking at the inter-relation between the first part and second part of answer choice C: If the unaffected loops are still going to indicate 100%, S then how could an applicant have a misconception that the affected loop would indicate 10%? The mismatch in loop flows would need to make sense when_compared_to_each_other._Answer_choice_A_could_make_sense_if Page 4 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Nou N K D Focus Cred Dist 16 011K5.05 N H 3 17 012K2.01 B F 2 18 012K6.03 B F 1 19 013K2.01 N F 3 20 013K5.01 N H 2 21 015AK2.10 N H 2 x Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Nou Partial Min Q= SRO E Cred KIA Only S Dist B/W B S B S x Y S S S B S Form ES-401-9 Comment Explanation Possible solution to the above concern: Consider replacing the second part of each answer choice with the spray valve demand. Then the applicant must know how the controller is designed to work when pressure needs to be lowered. Incorporated. MAB I need to have the licensee walk me through the diagnosis of the failed channel. I think the question wi11likely be sat after I have a better understanding of the indications and how they relate to channel 459 failing. Done. OK MAB Q is sat. Does the question need to state that the RTB and RTBYP bkrs are in their normal configuration for at power operations? No. Discussed with licensee. MAB Can question be answered at the memory level? Potential to be classified either way? Noted. MAB The question statement is written as Rx Trip "OR" ESF - but is testing both Rx Trip "AND" ESF logic. Does the Q statement need an "AND" instead of an "OR"? Incorporated. MAB What is meant by the "minimum additional channels required to meet the RPS and ESF actuation"? Is an applicant to predict what would happen if a minimum number of additional pzr press channels failed high? - if so, what impact would this have on the ESF? Maybe a more explicit question needs to be asked? Incorporated. MAB LOD= I. Q does not discriminate at appropriate level. Credibility of distractors also is related to LOD. Q modified. OK MAB Q is sat. Q is sat. Looking at the inter-relation between the first part and second part of answer choice C: If the unaffected loops are still going to indicate 100%, then how could an applicant have a misconception that the affected loop would indicate IO%? The mismatch in loop flows would need to make sense when compared to each other. Answer choice A could make sense if Page 4 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L I. Pgpmetric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W reverse flow was indicated as zero which I think is a credible misconception. But, if the affected loop is picking up flow from a good loop, then the good loop should show this on its flow indicator. Discuss with licensee. Q modified OK MAB 22 022Al.01 N F 2 x Is there enough info in the stem for the applicant to determine that the fans are required to be operated in fast speed? The stem does not state that the S Hi Temp Alarm has annunciated. The stem also does not state the value of containment temperature. Incorporated. MAB Would the question be better stated if a containment ave air temp oft l5F was provided, then the two pieces of the answer choices could be: (I) Is a TS 3.6.5 action statement required to be performed, AND (2) What is the required fan speed JAW SOP-l2.1? (The above wording is not exactly how I am suggesting it be worded, but the idea could be the same.) Incorporated MAB 23 022AK3.06 N F 3 S Q is sat. 24 O26AAAI.0I N H 2 x U I would rather see the word ONLY defined in each answer choices. For example the first answer choice would be better worded as: S A. AOP-lO.0 entry required (AOP-9.0 entry not required) 1015 Q replaced. MAB Doing it this way ensures unique answer choices, but reduces the likelihood that an argument exists for no correct answer. In other words, if any other procedure would require entry based on the above conditions, then technically there is no correct answer (applicants could find an ARP or SOP that the exam writers were not considering). Past experience in the post exam environment requires that we judiciously use the word ONLY in answer choices. It worked OK in a few other questions, but we should be careful here when ONLY excludes any other procedure. Qreplaced. MAB Q does not appear to match K/A. K/A requires testing knowledge of CCW Temps. This question appears to test RCP bearing temps versus CCW temps. Q replaced. MAB 25 026K1.Ol N F 2 5 Q is sat. 26 027AK1.02 N F 2 5 Q is sat. PageS of2t ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 22 022AI.OI N F 2 x 23 022AK3.06 N F 3 24 026AAAI.01 N H 2 25 026KI.OI N F 2 26 027AKI.02 N F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws V >1 Non Partial Min Q~ SRO E Cred KIA Only S Dist BIW B S S x Y S S S Form ES-401-9 Comment Explanation reverse flow was indicated as zero - which I think is a credible misconception. But, if the affected loop is picking up flow from a good loop, then the good loop should show this on its flow indicator. Discuss with licensee. Q modified. OK MAE Is there enough info in the stem for the applicant to detennine that the fans are required to be operated in fast speed? The stem does not state that the Hi Temp Alarm has annunciated. The stem also does not state the value of containment temperature. Incorporated. MAB Would the question be better stated if a containment ave air temp of 115F was provided, then the two pieces of the answer choices could be: (1) Is a TS 3.6.5 action statement required to be performed, AND (2) What is the required fan speed lAW SOP-12.1? (The above wording is not exactly how I am suggesting it be worded, but the idea could be the same.) Incorporated. MAE Q is sat. I would rather see the word ONLY defined in each answer choices. For example the first answer choice would be better worded as: A. AOP-lO.O entry required (AOP-9.0 entry not required) 1015 Q replaced. MAB Doing it this way ensures unique answer choices, but reduces the likelihood that an argument exists for "no correct answer". In other words, if any other procedure would require entry based on the above conditions, then technically there is no correct answer (applicants could find an ARP or SOP that the exam writers were not considering). Past experience in the post exam environment requires that we judiciously use the word ONLY in answer choices. It worked OK in a few other questions, but we should be careful here when ONLY excludes any other procedure. Q replaced. MAB Q does not appear to match KIA. KIA requires testing knowledge of CCW Temps. This question appears to test RCP bearing temps versus CCW temps. Q replaced. MAB Q is sat. Q is sat. Page 5 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO £ Explanation N K D Focus Creil Cred K/A Only S Dist Dist B/W Q could also be answered at the higher cog level. Noted. MAB 27 027K1.Ol N F 2 S Q is sat. 28 029EAl.06 M H 2 B ONLYneedstobedefined. Iftheoperatorneedstodoanyaction,even something trivial, then A and D could be eliminated. If ONLY is intended S to mean that demand does not need to be raised, then the extra words are needed to precisely state that. The word minimum may be unnecessary if ONLY is defined. I.E.: A. (I) same (2) Place FK-l22 in MAN (raising demand not required) Incorporated. MAB 29 032AK3.02 N H 2 B All the reasons in the second part of each answer choices can be deleted because they do not help make the answer choices unique. I presume that S the authors were thinking that the reasons were helping to meet the K/A, but the only way a K/A is met is if knowledge required of the K/A is needed to arrive at the correct answer. Discuss with licensee. Incorporated. MAB Can the timing of the automatic energization of the SR after trip be verified on the simulator? Or would it be OK to have the second part of the answer choices state that SR indications are required to be manually energized when JR (the good instrument) reads a certain value (5x10)? Verified on Simulator. OK MAB I will allow the K/A match because the reason SR Nis are manually energized at 15 minutes is that they do not auto energize. Noted. MAB 30 035K3.02 N H 2 B Discuss deleting all the information behind the comma in each answer choice unless there is a good reason to retain it. Discuss with the licensee. S Typically, unnecessary information should not be included. Discussed with licensee and decided to leave as is to ensure one and only one correct answer. MAB 31 037AA2.08 N H 2 x U K/A does not appear to be met. The K/A requires knowledge of determining or interpreting the failure of the air ejector rad monitor. The S stem tells the applicant that the monitor is failed, so this knowledge does not appear to be tested. A possible solution may be to provide a condition in the stem that would render the R-15A inoperable, such as a loss of its power supply or some indicating lights that would suggest it was failed, or even different color writing on a computer screen that would suggest that the value is invalid. The R-15A could then replace one of the answer choices. Essentially the same question could then be asked, but the Page 6 of 21 ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 27 027Kl.01 N F 2 28 029EAl.06 M H 2 29 032AK3.02 N H 2 30 035K3.02 N H 2 31 037AA2.08 N H 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KIA Only S Dist B/W S E S E S E S x 8 S Form ES-401-9 Comment Explanation Q could also be answered at the higher cog level. Noted. MAB Q is sat. ONLY needs to be defined. If the operator needs to do any action, even something trivial, then A and D could be eliminated. If ONLY is intended to mean that demand does not need to be raised, then the extra words are needed to precisely state that. The word minimum may be unnecessary if ONLY is defined. I.E.: A. (1) same (2) Place FK-122 in MAN (raising demand not required) Incorporated. MAB All the reasons in the second part of each answer choices can be deleted because they do not help make the answer choices unique. I presume that the authors were thinking that the reasons were helping to meet the KIA, but the only way a KIA is met is if knowledge required of the KIA is needed to arrive at the correct answer. Discuss with licensee. Incorporated. MAB Can the timing of the automatic energization of the SR after trip be verified on the simulator? Or would it be OK to have the second part of the answer choices state that SR indications are required to be manually energized when IR (the good instrument) reads a certain value (5xlO-")? Verified on Simulator. OK MAB I will allow the KIA match because the reason SR Nis are manually energized at 15 minutes is that they do not auto energize. Noted. MAB Discuss deleting all the information behind the comma in each answer choice unless there is a good reason to retain it. Discuss with the licensee. Typically, unnecessary information should not be included. Discussed with licensee and decided to leave as-is to ensure one and only one correct answer. MAB KIA does not appear to be met. The KIA requires knowledge of determining or interpreting the failure of the air ejector rad monitor. The stem tells the applicant that the monitor is failed, so this knowledge does not appear to be tested. A possible solution may be to provide a condition in the stem that would render the R-15A inoperable, such as a loss of its power supply or some indicating lights that would suggest it was failed, or even different color writing on a computer screen that would suggest that the value is invalid. The R-15A could then replace one of the answer choices. Essentially the same question could then be asked, but the Page 60f21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Psychometric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W applicant would need to know that the R-15A would not provide the earliest indication because it was failed. Discuss with licensee. Q modified. OK MAB 32 038EA2.07 N H I-LOD is borderline. A minor suggestion that would make this question 2 acceptable is as follows: S Consider displaying the parameters at two different points in time so that the applicant must determine which parameters are stable, decreasing, and increasing. Also vary the parameters in such a way to make them realistic run on simulator if needed. For instance, all SG pressures will not be 980 psig. Maybe make C SG pressure a little lower than the rest, but still a value that would preclude a steam leak. Discuss with licensee. Incorporated. MAB 33 039K4.05 B F 2 S Q is sat. 34 041 K4.l4 N H 2 S Q is sat. 35 045A1.05 N H I - x U B may not be plausible for the same reason as a previous question. 2 Anytime temp goes up and compresses a bubble in the pzr, pressure will S initially rise. I have trouble finding credibility in pressure going down. I understand the explanation provided in the justification. I have similar concerns with C. With temp lowering, it may not be credible for the pressure response to rise. LOD=l is a result of this. Q modified OK MAB 36 O5lAAl.04 B F 2 B Would the question be more precise and better able to withstand scrutiny if the second part of the question only asked whether or not Em l3oration is S required? I see the supporting material (FEI) not requiring Em Boration, but I do not see where it prohibits it. Discuss the possibility of having the second part of each answer choices alternate between: Emergency Boration Required and Emergency Boration NOT Required. Incorporated. MAB 37 054AG2.I.7 N F 2 S Q is sat. 38 055EK3.02 M F I-x U D does not appear to be credible because you have a procedure that is 2 specifically designed to be used for cooldown with head voids. S Q modified. OK MAB A does not appear to be plausible because the SG tubes are obviously designed to hold RCS pressure at power. Also, it is the only answer choice that only minimizes a potential. Q modified. OK MAR Page 7 of 21 ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F I Non N K D Focus Cred Dist 32 038EA2.07 N H 1-2 33 039K4.05 B F 2 34 041K4.14 N H 2 35 045Al.05 N H I-2 36 051AAl.04 B F 2 37 054A02.1.7 N F 2 38 055EK3.02 M F I-2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W
- g S
S S x .(J S
- g S
S x .(J S Form ES-401-9 Comment Explanation applicant would need to know that the R-15A would not provide the earliest indication because it was failed. Discuss with licensee. Q modified. OK MAB LOD is borderline. A minor suggestion that would make this question acceptable is as follows: Consider displaying the parameters at two different points in time so that the applicant must determine which parameters are stable, decreasing, and increasing. Also vary the parameters in such a way to make them realistic - run on simulator if needed. For instance, all SO pressures will not be 980 psig. Maybe make C SO pressure a little lower than the rest, but still a value that would preclude a steam leak. Discuss with licensee. Incorporated. MAB Q is sat. Q is sat. B may not be plausible for the same reason as a previous question. Anytime temp goes up and compresses a bubble in the pzr, pressure will initially rise. I have trouble finding credibility in pressure going down. I understand the explanation provided in the justification. I have similar concems with C. With temp lowering, it may not be credible for the pressure response to lise. LOD=l is a result of this. Q modified. OK MAB Would the question be more precise and better able to withstand scrutiny if the second part of the question only asked whether or not Em Boration is required? I see the supporting material (FEl) not requiring Em Boration, but I do not see where it prohibits it. Discuss the possibility of having the second part of each answer choices altemate between: "Emergency Boration Required" and "Emergency Boration NOT Required". Incorporated. MAB Q is sat. D does not appear to be credible because you have a procedure that is specifically designed to be used for cooldown with head voids. Q modified. OK MAB A does not appear to be plausible because the SO tubes are obviously designed to hold RCS pressure at power. Also, it is the only answer choice that only minimizes a "potential". Q modified. OK MAB Page 7 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Pgometric Flaws______ Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist 8/W One suggestion would be to use some info from the original question and also test why the cooldown is stopped at 200 psig. I.E. A. Minimize Inventory Loss / Prevent N2 injection B. Maximize AFW / Prevent N2 injection C. Minimize Inventory Loss / Prevent losing pzr level D. Maximize AFW / Prevent losing pzr level Incorporated. MAB 39 057AG2.4.49 N H 2 S Q is sat. Allowed leniency with K/A match. The original intent of the K/A is believed to be met. Noted. MAB 40 059A2.04 M H 1- ? E I am not convinced that MFRVs is a credible choice. Would it be possible 2 to change the answer choices to: S A. Feed ALL / No Limit B. Feed one at a time / No Limit C. Feed ALL/20 100 gpm D. Feed one at a time / 20 100 rpm Incorporated. MAB 41 059G2.I.19 N H 2 S The first bullet prompts the question: In what? Would it be better to state that the computer alarm has annunciated? Incorporated. MAB Q is essentially sat. Noted. MAB 42 061G2.2.37 B H 3 x B The question statement may not read correctly. It is asking for the purpose, yet it appears to be asking for actions and locations of those S actions. If this is correct, then the wording of the question should be modified to solicit the answers being provided. I.E.: Given the above conditions, which one of the following correctly describes the actions for establishing AFW lAW SOP-22.0? Discuss with licensee. Incorporated. MAB 43 062A1.Ol N H 3 S Q is sat. 44 063A3.0l B H 3 5 Q is sat. 45 064A4.03 N F 2 x U C may not be plausible. If the EDG is the faster of the two and the govemor is part of the EDG controls, then why would it be credible to raise Page 8 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 39 057 AG2.4.49 N H 2 40 059A2.04 M H 1-2 41 059G2.1.19 N H 2 42 061G2.2.37 B H 3 x 43 062Al.01 N H 3 44 063A3.0l B H 3 45 064A4.03 N F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KIA Only S Dist B/W S ? E S S E S S S x lJ Form ES-401-9 Comment Explanation One suggestion would be to use some info from the original question and also test why the cool down is stopped at 200 psig. I.E. A. Minimize Inventory Loss / Prevent N2 injection B. Maximize AFW / Prevent N2 injection C. Minimize Inventory Loss / Prevent losing pzr level D. Maximize AFW / Prevent losing pzr level Incorporated. MAB Q is sat. Allowed leniency with KIA match. The original intent of the KIA is believed to be met. Noted. MAB I am not convinced that MFRVs is a credible choice. Would it be possible to change the answer choices to: A. Feed ALL / No Limit B. Feed one at a time / No Limit C. Feed ALL / 20 - 100 gpm D. Feed one at a time /20 - 100 gpm Incorporated. MAB The first bullet prompts the question: "In what?" Would it be better to state that the computer alarm has annunciated? Incorporated. MAB Q is essentially sat. Noted. MAB The question statement may not read con-ectly. It is asking for the "purpose", yet it appears to be asking for actions and locations of those actions. If this is con-ect, then the wording of the question should be modified to solicit the answers being provided. I.E.: Given the above conditions, which one of the following con*ectly describes the actions for establishing AFW IA W SOP-22.0? Discuss with licensee. Incorporated. MAB Q is sat. Q is sat. C may not be plausible. If the EDG is the faster of the two and the governor is part of the EDG controls, then why would it be credible to raise Page 8 of2l
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Pietric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W S frequency, which would make it go even faster as compared to the bus? Q modified. OK MAB Similar argument exists for B. If the bus speed is already higher, then why would an operator lower the EDG speed, widening the margin? Q modified. OK MAB One suggestion would be to test which switch is used to make the adjustment. One of the applicants (I think on the last Farley Exam) made an error on the In-Plant EDG JPM and tried to adjust speed using the voltage adjust knob. Consider: A. IG Bus Frequency! Adjust using Gov Motor Speed/MW switch B. lG Bus Frequency / Adjust using Voltage Control Etc. Incorporated. MAB 46 065AK3.04 B H 2 x Why is the location of the valves given in C, when the location is not provided for other answer choices? S Corrected. MAB Q statement should test required actions lAW a certain procedure. Incorporated MAB Only relevant info that is needed to make the answer choices unique should be included in the answer choices. All of the info wrt reasons should be eliminated because this information is not being tested due to all of the actions being unique. in this case, because the applicant does not need to possess the knowledge required by tile K/A to arrive at the correct answer, then the K/A is not met. Incorporated. MAB Consider the following as a possible solution: Align EACs to AFW components JAW SOP-62 within hours in order to A. 1 hour / ensure adequate heat sink. B. 2 hours / prevent exceeding TS cooldown limits Etc. Incorporated. MAB 47 068K6.lO M H I x U The third bullet does not specify that the red lights are lit on a specific piece of equipment. On R-18? S On drawer added. OK MAB The last bullet states that the control power fuse is lit. Is the actual fuse lit? Clarified. MAB Page 9 of 21 ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 46 065AK3.04 B H 2 47 068K6.10 M H 1 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist BIW S x tI S x tI S Form ES-401-9 Comment Explanation frequency, which would make it go even faster as compared to the bus? Q modified. OK MAB Similar argument exists for B. If the bus speed is already higher, then why would an operator lower the EDG speed, widening the margin? Q modified. OK MAB One suggestion would be to test which switch is used to make the adjustment. One of the applicants (I think on the last Farley Exam) made an error on the In-Plant EDG JPM and tried to adjust speed using the voltage adjust knob. Consider: A. 1 G Bus Frequency I Adjust using Gov Motor Speed/MW switch B. IG Bus Frequency I Adjust using Voltage Control Etc. Incorporated. MAB Why is the location of the valves given in C, when the location is not provided for other answer choices? Corrected. MAB Q statement should test required actions lAW a certain procedure. Incorporated. MAB Only relevant info that is needed to make the answer choices unique should be included in the answer choices. All of the info wrt reasons should be eliminated because this information is not being tested due to all of the actions being unique. In this case, because the applicant does not need to possess the knowledge required by the KIA to arrive at the correct answer, then the KIA is not met. Incorporated. MAB Consider the following as a possible solution: Align EACs to AFW components lAW SOP-62 within ___ hours in order to A. 1 hour I ensure adequate heat sink. B. 2 hours / prevent exceeding TS cooldown limits Etc. Incorporated. MAB The third bullet does not specify that the red lights are lit on a specific piece of equipment. On R-18? On drawer - added. OK MAB The last bullet states that the control power fuse is lit. Is the actual fuse lit? Clarified. MAB Page 9 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B I. U Psychometric Flaws______ Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W D is not plausible. It would not be reasonable to think that it would be a requirement to continue a voluntary release with the given failure. Q modified. OK MAB C does not appear to be plausible when compared to A because nothing is wrong with RCV-18, so you would surely try to close that prior to locally closing a manual valve. Q modified. OK MAB 48 069AA2.0l B F 2 S Q is sat. 49 071A4.Ol N F 2 S I would prefer C and D state WHITE LIGHT NOT LIT, vice ONLY. Incorporated. MAB Q is sat. 50 072G2.l.27 N F 1 U Bow is the first and second part ofA different from each other? Are these not essentially stating the same thing? S Q modified. OK MAB Also, the reasons are very general in A. It requires only a very basic knowledge to understand that a rad monitor will provide warning of a radiation hazard, which could be a result of plant damage and could lead to a health hazard. Q modified. OK MAB Thoughts: - Are area rad monitors used to provide the SRO with readings to make E Plan classifications? - Are area rad monitors used to determine whether adverse numbers are required to be used? - Are area rad monitors used to determine if adverse numbers may be exited, or must you remain in adverse numbers once you are using them (does cont pressure impact adverse numbers differently than radiation)? Incorporated. MAB Distractors could include: - CR HVAC to recirc mode. .- Containment isolation. - Isolates liquid/gaseous release. Incorporated. MAR The above are just some ideas to help write a question. I have not researched Farley lesson plans to see which ideas may apply. Incorporated MAB Page 10 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F I Non N K D Focus Cred Dist 4S 069AA2.01 B F 2 49 071A4.01 N F 2 50 072G2.1.27 N F I Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W S S t1 S Form ES-401-9 Comment Explanation D is not plausible. It would not be reasonable to think that it would be a requirement to continue a voluntary release with the given failure. Q modified. OK MAB C does not appear to be plausible when compared to A because nothing is wrong with RCV-IS, so you would surely try to close that prior to locally closing a manual valve. Q modified. OK MAB Q is sat. I would prefer C and D state WHITE LIGHT NOT LIT, vice ONLY. Incorporated. MAE Q is sat. How is the first and second part of A different from each other? Are these not essentially stating the same thing? Q modified. OK MAB Also, the reasons are very general in A. It requires only a very basic knowledge to understand that a rad monitor will provide warning of a radiation hazard, which could be a result of plant damage and could lead to a health hazard. Q modified. OK MAB Thoughts: - Are area rad monitors used to provide the SRO with readings to make E-Plan classifications? - Are area rad monitors used to determine whether adverse numbers are required to be used? - Are area rad monitors used to determine if adverse numbers may be exited, or must you remain in adverse numbers once you are using them (does cont pressure impact adverse numbers differently than radiation)? Incorporated. MAB Distractors could include: - CR HV AC to recirc mode. - Containment isolation. - Isolates liquid/gaseous release. Incorporated. MAB The above are just some ideas to help write a question. I have not researched Farley lesson plans to see which ideas may apply. Incorporated. MAE Page 10 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L ometric Flaws Content Flaws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred KJA Only S Dist Dist B/W Discuss with licensee. Alternatives will need to be found for this question. Some of the distractors are OK, but the correct answer is way too general, which causes this question to not discriminate at the appropriate level. Incorporated MAB 51 073K3.0l M H 2 B It sounds like the A train damper is already aligned, therefore not requiring any operator action. What is the initial status of the B train supply S damper? Does the B train supply damper require any manual action? Yes - Open - No. OK MAB 52 O74EA1.28 N H 3 ? 7 The second to last bullet states that the accum discharge iso valves are in the closed position. Is this accurate? Or should the bullet state that the S handswitches have been placed in the closed position? Incorporated. MAB How is RCS pressure being too high a credible misconception when Sgs have been steamed to 100 psig? Discuss with licensee. Stem changed slightly. MAB 53 075A2.03 N H 2 5 Q is sat. 54 076A3.02 N F 2 S Q is sat. 55 077AAl.02 B F 2 B Double check with the licensee to see if there is a chance, based on info in the stem (or lack of info), that the controls are not in the auto voltage adjust S mode of operation. The caution is based on restricting manual voltage adjust while the controls are in auto voltage control. If this comment is resolved, then the Q will be sat. Verified. Aligned normally stated in stem OK MAB 56 078K2.02 N F 2 S Q is sat. 57 103A4.03 M F 2 5 Q is sat. 58 103K3.03 N H 2 S Q is sat. 59 02.1.17 N F 2 x Have licensee discuss plausibility of D. It does not appear to be credible to take action prior to a 3-way communication. If this distractor can be S enhanced or replaced, I can likely live with the plausibility of the other distractors. Q modified. OK MAB 60 02.1.45 N F 2 5 Q is sat. Page II of2I ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Crcd Dist 51 073K3.0l M H 2 52 074EA1.28 N H 3 53 075A2.03 N H 2 54 076A3.02 N F 2 55 077AA1.02 B F 2 56 078K2.02 N F 2 57 103A4.03 M F 2 58 103K3.03 N H 2 59 G2.1.17 N F 2 x 60 02.1.45 N F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Crcd KIA Only S Dist BIW B S ? '+ S S S B S S S S B S S Form ES-401-9 Comment Explanation Discuss with licensee. Alternatives will need to be found for this question. Some of the distractors are OK, but the correct answer is way too general, which causes this question to not discriminate at the appropriate level. Incorporated. MAB It sounds like the A train damper is already aligned, therefore not requiring any operator action. What is the initial status of the B train supply damper? Does the B train supply damper require any manual action? Yes-Open-No. OK MAB The second to last bullet states that the accum discharge iso valves are in the closed position. Is this accurate? Or should the bullet state that the handswitches have been placed in the closed position? Incorporated. MAB How is ReS pressure being too high a credible misconception when Sgs have been steamed to 100 psig? Discuss with licensee. Stem changed slightly. MAB Q is sat. Q is sat. Double check with the licensee to see if there is a chance, based on info in the stem (or lack of info), that the controls are not in the auto voltage adjust mode of operation. The caution is based on restricting manual voltage adjust while the controls are in auto voltage control. If this comment is resolved, then the Q will be sat. Verified. Aligned normally stated in stem OK MAB Q is sat. Q is sat. Q is sat. Have licensee discuss plausibility of D. It does not appear to be credible to take action prior to a 3-way communication. If this distractor can be enhanced or replaced, I can likely live with the plausibility of the other distractors. Qmodified. OK MAB Q is sat. Page II of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KIA# B L B Pygnnietric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues TIF 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W Licensee marked for increased attention. Not sure how to improve the Q. The Q appears to be OK. Noted. MAB 61 G2.1.9 N F 2 S Replace MUST with REQUIRED TO. Incorporated. MAB 62 G2.2.3 B F 2 5 Q is sat. 63 G2.2.36 N H 2 B Should refueling in progress be changed to core alterations in progress? It may not make a difference, but I want to ensure that the S water level is established for core alts. Discuss with licensee. Incorporated MAB 64 G2.3.13 B H 2 S Qissat. 65 G2.3.l5 N F 2 5 Q is sat. 66 G2.3.4 N F 2 B Q is sat as long as Farley confirms that this knowledge is required of their ROs. This is a typical SRO-only question at most plants because S approving of EDLs is a responsibility og the SED. Q modified. OK MAB Is there an RO learning objective? No. Q modified. OK MAB 67 G2.4.13 M F 2 B Q is sat as long as Farley confirms that this knowledge is required of their ROs. This is a typical SRO-only question at most plants because S approving of EDLs is a responsibility og the SED. Q modified. OK MAB Is there an RO learning objective? No. Q modified. OK MAB The question asks for the MINIMUM authority: How is this supposed to be applied to the answer choices when the terms either and or are being used? This potential confusion impacts the plausibility of distractors. I would imagine that validation has not picked up on this because it is very well known that the SED alone has this duty. Q modified. OK MAB 68 02.4. 16 M H 2 B This question would usually be regarded as SRO-only material. A procedure transition to SAMGs would be an SRO-only question at most S plants. Q modified. OK MAB Page 12 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 61 02.1.9 N F 2 62 G2.2.3 B F 2 63 02.2.36 N H 2 64 G2.3.13 B H 2 65 G2.3.15 N F 2 66 G2.3.4 N F 2 67 G2.4.13 M F 2 68 G2.4.16 M H 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W S S g S S S g S g S g S Form ES-401-9 Comment Explanation Licensee marked for increased attention. Not sure how to improve the Q. The Q appears to be OK. Noted. MAB Replace "MUST" with "REQUIRED TO". Incorporated. MAB Q is sat. Should "refueling in progress" be changed to "core alterations in progress"? It may not make a difference, but I want to ensure that the water level is established for core alts. Discuss with licensee. Incorporated. MAB Q is sat. Q is sat. Q is sat as long as Farley confirms that this knowledge is required of their ROs. This is a typical SRO-only question at most plants because approving of EDLs is a responsibility og the SED. Q modified. OK MAB Is there an RO learning objective? No. Q modified. OK MAB Q is sat as long as Farley confirms that this knowledge is required of their ROs. This is a typical SRO-only question at most plants because approving of EDLs is a responsibility og the SED. Q modified. OK MAB Is there an RO learning objective? No. Q modified. OK MAB The question asks for the MINIMUM authority: How is this supposed to be applied to the answer choices when the tenllS "either" and "or" are being used? This potential confusion impacts the plausibility of distractors. I would imagine that validation has not picked up on this because it is very well known that the SED alone has this duty. Q modified. OK MAB This question would usually be regarded as SRO-only material. A procedure transition to SAMGs would be an SRO-only question at most plants. Q modified. OK MAB Page 12 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KIA# B L U Psychometric Flaws Content Flaws U Comment M 0 0 Stem Cues TIF I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist 81W Is there an RO learning objective? No. Q modified. OK MAB Q may be sat pending discussion with licensee. Q modified. OK MAB 69 WEO1 EG2.2.2 M F 2 ESP-0.0 is only to be entered if SI is in progress or required. The stem states that SI termination is in progress. Does this lead the applicants to S guess how far the operators progressed through the termination steps? If SI had been terminated, then ESP-0.0 may not be correct. Discuss with licensee. OK Q states that SI is required MAB Is question analysis up to date? OK. MAB Walk though supporting material with the licensee to ensure that EEP-0 is not correct and that it is fully supported with references. Licensee explained. OK MAB 70 WE04EA2.2 M F 2 7 E I do not think subcooling is plausible because it is a calculated value. When determining if a leak is isolated, it makes sense to look at a S parameter that is directly measured (when given the choice between one that is directly measured and one that is not). I would suggest using pressurizer level instead of subcooling. Discussed. OK MAB I would prefer the first part of the question statement to read, 1) an injection path that is isolated lAW ECP-l.2 Incorporated. MAB 71 WEO5EK1.I N F 2 ThequestionasksfortheMlNlMUM: Howdoesatesttakerapplythis when trying to determine between A and B? Is opening a PORV more S minimum than opening reactor vessel head vents? the ambiguity detracts from the plausibility of both of these answer choices since only one item is listed in each choice. Would it be more precise to list each head vent so that there is a clear delineation that A is more minimum than B? Incorporated. MAB The question asks for the minimum actions required to ensure adequate core cooling: Are there any other actions at any given time other than opening one PORV and head vents that would be required? If so, the wording of the question may need to be tightened to ensure that there is one technically correct answer. Incorporated. MAB Page 13 of2I ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 69 WEOIEG2.2.2 M F 2 70 WE04EA2.2 M F 2 71 WE05EKI.I N F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KIA Only S Dist B/W .g S ? .g S .g S Form ES-401-9 Comment Explanation Is there an RO learning objective? No. Q modified. OK MAB Q may be sat pending discussion with licensee. Q modified. OK MAB ESP-O.O is only to be entered if SI is in progress or required. The stem states that SI termination is in progress. Does this lead the applicants to guess how far the operators progressed through the termination steps? If SI had been terminated, then ESP-O.O may not be correct. Discuss with licensee. OK. Q states that SI is required. MAB Is question analysis up to date? OK. MAB Walk though supporting material with the licensee to ensure that EEP-O is not correct and that it is fully supported with references. Licensee explained. OK MAB I do not think subcooling is plausible because it is a calculated value. When determining if a leak is isolated, it makes sense to look at a parameter that is directly measured (when given the choice between one that is directly measured and one that is not). I would suggest using pressurizer level instead of subcooling. Discussed. OK MAB I would prefer the first part of the question statement to read, "I) an injection path that is isolated lAW ECP-1.2" Incorporated. MAB TI1e question asks for the MINIMUM: How does a test taker apply this when trying to determine between A and B? Is opening a PORV more minimum than opening reactor vessel head vents? - the ambiguity detracts from the plausibility of both of these answer choices since only one item is listed in each choice. Would it be more precise to list each head vent so that there is a clear delineation that A is more minimum than B? Incorporated. MAB The question asks for the minimum actions required to ensure adequate core cooling: Are there any other actions at any given time other than opening one PORV and head vents that would be required? Ifso, the wording of the question may need to be tightened to ensure that there is one technically correct answer. Incorporated. MAB Page 13 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Ppnetric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/E 1 Non >1 Non Partial Mm Q SRO E Explanation N K D Focus Creil Cresi K/A Only S Dist Dist 8/W 72 WEO8EKI.l N H 2 x E Discuss plausibility of A. Question will be sat if A is replaced. Incorporated. MAB S 73 WEI 1 EK1.3 N H 3 7 I am not following the explanations for correctness and plausibility. The analysis states that we know that B train is lost due to the combination of S CF3 and CF5, but I do not see in the stem where CF5 is in alarm, Is CF5 in alarm as a result of another condition in the stem? Licensee explained. OK MAB 74 WEI2EK2.l N H 2 ? 2 Will steam flow and the weight of the disk close the MSIVs the rest of the way with the given plant conditions? If so, does the question have one and S only one correct answer? Do we need to be more specific and state that they will move to the test position with air, or that air will move the valve off of its backseat? Discuss some wording enhancements. Q modified OK MAB 75 WEI6EKI.2 N H 2 S Qissat. SRO fly Questions 76 005G2.4.l 8 N H 2 x x x U Do you use RHR and LHSI terms interchangeably? Should the wording be consistent 9 S RHR and LHSI terms are the same at Farley MAB Is the second part of A the same as the second part of C? If so, then why are they stated differently? Corrected. MAB Second Part of A: Prevents overheating of what? Should this state Prevents overheating of the RHR pump components? Corrected. MAB Second part of B: which pump? RHR? Corrected. MAB How is second part of D plausible? How is a HX ever needed when injecting? Q modified. MAB If stopping RHR pumps is done to prevent overheating, then preventing overheating would ensure future operability of the pumps. This may cause the second part of A and B to not be plausible because the second part of A is a subset of B. Discuss with licensee. Q modified. MAB Page 14 of2l ES-401, Rev. 9 Q# KlA# B L L M 0 0 Stem Cues N K D Focus 72 WE08EKl.l N H 2 73 WElIEK1.3 N H 3 74 WEI2EK2.l N H 2 75 WE16EKl.2 N H 2 )nlYOi,;;liti,{n.F :': i!JSRO:c( ,~;; ~;fJJ;/>:i;:;; \\Ct:i~; ;;;~'": 2;;,';3;,;' 76 005G2.4.18 N H 2 Psychometric Flaws T/F 1 Non Cred Dist X Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W g S S ? S S i<~;;"s,,;~;<ii~; ;'.-~2'i:';;; ;~;~~i!;~;~J; :.-;;;;;;,
- i;;~;":<;
x x x tI S Form ES-401-9 Comment Explanation Discuss plausibility of A. Question will be sat if A is replaced. Incorporated. MAB I am not following the explanations for correctness and plausibility. The analysis states that we know that B train is lost due to the combination of CF3 and CF5, but I do not see in the stem where CF5 is in alarm. Is CF5 in alarm as a result of another condition in the stem? Licensee explained. OK MAB Will steam flow and the weight of the disk close the MSIVs the rest of the way with the given plant conditions? If so, does the question have one and only one correct answer? Do we need to be more specific and state that they will move to the test position with air, or that air will move the valve off of its backseat? Discuss some wording enhancements. Q modified. OK MAB Q is sat. .;:T:;;;::;.:;~j i" '; ;;:~;;~'; c;y; 'S;:/;~;<f<;;::;;:2i ~ .. ;;*:;E;:i:.. ; *..*.,< ':"...* >"-;;. ;i,./ii.S,C; Do you use RHR and LHSI terms interchangeably? Should the wording be consistent? RHR and LHSI terms are the same at Farley. MAB Is the second part of A the same as the second part of C? If so, then why are they stated differently? Corrected. MAB Second Part of A: "Prevents overheating" of what? Should this state Prevents overheating of the RHR pump components? Corrected. MAB Second part ofB: which pump? RHR? Corrected. MAB How is second part of D plausible? How is a HX ever needed when injecting? Q modified. MAB If stopping RHR pumps is done to prevent overheating, then preventing overheating would ensure future operability of the pumps. This may cause the second part of A and B to not be plausible because the second part of A is a subset ofB. Discuss with licensee. Q modified. MAB Page 14 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Psyclwietric Flas Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W SRO-only: Discuss how this question is SRO-only. Is there a procedure selection aspect to the question? To elevate a question to SRO-only based on detailed procedure knowledge, the procedure knowledge must be used to make a procedure selection, which then links it to the 10CFR55.43 requirement for SROs to have procedure selection knowledge. The question appears to be testing whether or not to stop RHR pumps ( or to align CCW) and why an operator would perform the action. An RO is required to know why he would either stop an RHR pump or align CCW to the RHR HX. I could not link this question to 10 CFR 55.43. Q modified. MAB 77 007EA2.02 M H 2 x x U ESP-0.2 appears to be contingent on a cooldown being required when step 19 is being performed. If a cooldown is not required, then UOP-2.3 would S be the correct transition. Tech Specs require them to be < 325F within 12 hours, so when step 19 is performed, could the applicant make the decision that it is not necessary to perform the cooldown, or continue to perform the cooldown, at that time? Could the applicant assume that the plant was already less than 32SF due to the cooldown that was in progress? Is it necessary to include RCS Cold Leg Temps in the stem? Yes addressed in revision. MAB Offsite Power will not be restored for 18 hours and Tech Specs require that RCS temp be less than 32SF within 12 hours. How is anything except a Natural Circ Cooldown (ESP-0.2) credible? Is there potential to change the UOP-2.3 option to ESP-0.3? Yes addressed in revision MAB 78 007G2.4.2 N H 4 x U How is knowledge of EOP entry conditions being tested? Licensee successfully explained how knowledge of the K/A was required S to arrive at the correct answer. MAB Do you expect and require your operators to know that the rupture disk will not blow for the first hour of this malfunction? If the licensee believes this knowledge to be operationally valid and a necessary knowledge item for their operators, then this aspect of the question will be OK. Discuss with the licensee. Licensee agreed that shorter term plant and operator response would be more operationally valid. Q revised accordingly. MAB Be specific in the Q statement that the leakage into the PRT is from the PORV. If it were from a makeup water source, such as CCW, then the leakage spec would not apply. Incorporated MAB 79 008AA2.l5 B L 3 x U Howisknowledgeofavaporspaceaccidentbeingtested? Thequestion contains PORV malfunctions requiring the PORVs to be isolated, but there Page 15 of 21 ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 77 007EA2.02 M H 2 x 78 007G2.4.2 N H 4 79 008AA2.15 B L 3 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist B/W x lj S x lj S x lj Form ES-401-9 Comment Explanation SRO-only: Discuss how this question is SRO-only. Is there a procedure selection aspect to the question? To elevate a question to SRO-only based on detailed procedure knowledge, the procedure knowledge must be used to make a procedure selection, which then links it to the IOCFR55.43 requirement for SROs to have procedure selection knowledge. The question appears to be testing whether or not to stop RHR pumps ( or to align CCW) and why an operator would perform the action. An RO is required to know why he would either stop an RHR pump or align CCW to the RHR HX. I could not link this question to 10 CFR 55.43. Q modified. MAB ESP-O.2 appears to be contingent on a cool down being required when step 19 is being performed. If a cooldown is not required, then UOP-2.3 would be the correct transition. Tech Specs require them to be < 325F within 12 hours, so when step 19 is performed, could the applicant make the decision that it is not necessary to perform the cooldown, or continue to perform the cooldown, at that time? Could the applicant assume that the plant was already less than 325F due to the cooldown that was in progress? Is it necessary to include RCS Cold Leg Temps in the stem? Yes - addressed in revision. MAB Offsite Power will not be restored for 18 hours and Tech Specs require that RCS temp be less than 325F within 12 hours. How is anything except a Natural Circ Cool down (ESP-0.2) credible? Is there potential to change the UOP-2.3 option to ESP-0.3? Yes - addressed in revision. MAB How is knowledge of EOP entry conditions being tested? Licensee successfully explained how knowledge of the KIA was required to arrive at the correct answer. MAB Do you expect and require your operators to know that the rupture disk will not blow for the first hour of this malfunction? If the licensee believes this knowledge to be operationally valid and a necessary knowledge item for their operators, then this aspect of the question will be OK. Discuss with the licensee. Licensee agreed that shorter term plant and operator response would be more operationally valid. Q revised accordingly. MAB Be specific in the Q statement that the leakage into the PRT is from the PORV. If it were from a makeup water source, such as CCW, then the leakage spec would not apply. Incorporated. MAB How is knowledge of a vapor space accident being tested? The question contains PORV malfunctions requiring the PORVs to be isolated, but there Page 15 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B B U Psychometric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S fist fist B/W S is no vapor space accident; therefore, no knowledge of a vapor space accident is required to answer the question. The analysis of this question was verified by other CEs. (I do understand that this same question and K/A was allowed for the 2007 Vogtle NRC exam, but this question must be evaluated against the requirements of NUREG-l021. Currently this question does not meet the requirements 0fNUREG-l02l) Q modified. MAB Does the question need to explicitly state that the components do not get fixed? This may tighten the question slightly so that a shutdown is required by TS. It may be that no PORV maintenance can likely be performed while hot, but if it is at all possible, then some words may need to be added. Q modified/replaced. MAB 80 0l4A2.04 N H 2 x U How is this question SRO-only? The second part of each answer choice is being relied upon to meet the K/A at the SRO level. The second part does S not require any procedure selection knowledge. An operator only needs to know basic reactor trip criteria or an action that is required when a rod is misaligned. Discuss with licensee. Q replaced. MAB Q may be backward logic which I will allow as long as the licensee agrees that the Q is presented in a clear manner. Q replaced. MAB 81 015G2.4.ll N H 2 S Q is sat. 82 022A2.Ol N H 2 x N Suggest adding AUG to each of the days in the distractors. Incorporated MAB S Discuss plausibility of B with licensee. It may not be credible for an applicant to apply a containment cooling condition to the required action for a containment spray condition. One solution would be to change the stem so that the 10 days from entry into the LCO applies, thus proving an extra distractor. Incorporated. MAB 83 022AG2.4.50 M H 2 E The ARP does not state an order or sequence for pump start and stop. Does SOP-2. I direct the operator to start the standby pump prior to S securing the running pump? Yes SOP states the order. MAB Is racking out DFO6 required by TS 3.5.2? Have the licensee walk me through this. Yes mop pump needs to be racked out to make auto start operable. MAB Page 16 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 80 014A2.04 N H 2 81 01502.4.11 N H 2 82 022A2.01 N H 2 x 83 022AG2.4.50 M H 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KIA Only S Dist BIW S x Y S S B S B S Form ES-401-9 Comment Explanation is no vapor space accident; therefore, no knowledge of a vapor space accident is required to answer the question. The analysis of this question was verified by other CEs. (I do understand that this same question and KIA was allowed for the 2007 Vogtle NRC exam, but this question must be evaluated against the requirements ofNUREO-1021. Currently this question does not meet the requirements ofNUREO-102l) Q modified. MAB Does the question need to explicitly state that the components do not get fixed? This may tighten the question slightly so that a shutdown is required by TS. It may be that no PORV maintenance can likely be performed while hot, but ifit is at all possible, then some words may need to be added. Q modifiedlreplaced. MAB How is this question SRO-only? The second part of each answer choice is being relied upon to meet the KIA at the SRO level. The second part does not require any procedure selection knowledge. An operator only needs to know basic reactor trip criteria or an action that is required when a rod is misaligned. Discuss with licensee. Q replaced. MAB Q may be backward logic - which I will allow as long as the licensee agrees that the Q is presented in a clear manner. Q replaced. MAB Q is sat. Suggest adding AUO to each of the days in the distractors. Incorporated. MAB Discuss plausibility ofB with licensee. It may not be credible for an applicant to apply a containment cooling condition to the required action for a containment spray condition. One solution would be to change the stem so that the 10 days from entry into the LCO applies, thus proving an extra distractor. Incorporated. MAB TIle ARP does not state an order or sequence for pump start and stop. Does SOP-2.1 direct the operator to start the standby pump prior to securing the running pump? Yes - SOP states the order. MAB Is racking out DF06 required by TS 3.5.2? Have the licensee walk me through this. Yes - inop pump needs to be racked out to make auto start operable. MAB Page 16 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L Ppmetric Flaws_____ Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W Generally we do not require applicants to know> I hour TS from memory. This question requires that the applicants know a 72 hour action without a reference provided. One solution would be to state, for the second part of each answer choice, that TS 3.0.3 actions either ARE required or ARE NOT required. Therefore, the specific 72 hours would not appear in the answer choices. Corrected. MAE 84 026A2.04 M H 2 x U Question is SRO-only because of the TS basis knowledge, but there is no procedure selection tie to 10 CFR 55.43. S Licenseerioted. MAB With the B containment spray pump operating with stable flow, how would an applicant have a credible misconception that the sump had blockage? Why would an operator stop a spray pump with stable flow and conditions met to go to recirc? Discuss plausibility with licensee. Second part of A and B may need to be replaced. Stem revised to address concern MAB 85 027AA2.04 N H 2 x x U The Conduct ofOps procedure does not appear to REQUIRE that the SM provides the direction to place the controller back to AUTO. The Conduct S of Ops procedure only states that the SS will consult with the SM after the plant is stable. Placing a repaired controller back to auto may not be viewed as an action that would need SM approval. The controller was failed in a mid position whether the controller was in auto or manual. It is also likely that the pressure will be restored to NOP with the controller in manual, then placed in auto. Placing the controller in auto may not even be viewed as a recovery action since the failure did not appear to be related to the controllers behavior as it related to auto control. My concern is that the supporting documentation does not appear to thoroughly support the correct answer. Discuss with licensee. I think this question would require more definitive supporting documentation to support the answer. Q modified to address concerns. MAB No correct answer? Have licensee explain how TS 3.4.1 requires the plant to be stabilized at the cunent power level. It appears to me that TS 3.4.1 requires that pressure be restored above 2209 psig within 2 hours this is not the same as stabilizing the plant at the current power level. Furthermore, the plant is already stable at 2205 psig yet conditions of TS 3.4.1 are not met. Q modified to address concerns. MAE How is immediately beginning a down power plausible? The down power will not improve pressure it could even lower pressure which would make the situation worse. Page 17 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 84 026A2.04 M H 2 85 027AA2.04 N H 2 x Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q-SRO E Cred KIA Only S Dist BIW x tJ S x tJ S Form ES-401-9 Comment Explanation Generally we do not require applicants to know> 1 hour TS from memory. This question requires that the applicants know a 72 hour action without a reference provided. One solution would be to state, for the second part of each answer choice, that TS 3.0.3 actions either ARE required or ARE NOT required. Therefore, the specific 72 hours would not appear in the answer choices. Corrected. MAE Question is SRO-only because of the TS basis knowledge, but there is no procedure selection tie to 10 CFR 55.43. Licensee noted. MAB With the B containment spray pump operating with stable flow, how would an applicant have a credible misconception that the sump had blockage? Why would an operator stop a spray pump with stable flow and conditions met to go to recirc? Discuss plausibility with licensee. Second part of A and B may need to be replaced. Stem revised to address concern. MAB The Conduct ofOps procedure does not appear to REQUIRE that the SM provides the direction to place the controller back to AUTO. The Conduct of Ops procedure only states that the SS will consult with the SM after the plant is stable. Placing a repaired controller back to auto may not be viewed as an action that would need SM approval. TI1e controller was failed in a mid position whether the controller was in auto or manual. It is also likely that the pressure will be restored to NOP with the controller in manual, then placed in auto. Placing the controller in auto may not even be viewed as a recovery action since the failure did not appear to be related to the controller's behavior as it related to auto control. My concern is that the supporting documentation does not appear to thoroughly support the cOlTect answer. Discuss with licensee. I think this question would require more definitive supporting documentation to support the answer. Q modified to address concerns. MAB No cOlTect answer? Have licensee explain how TS 3.4.1 requires the plant to be stabilized at the cUlTent power level. It appears to me that TS 3.4.1 requires that pressure be restored above 2209 psig within 2 hours - this is not the same as stabilizing the plant at the cUlTent power level. Furthermore, the plant is already stable at 2205 psig yet conditions of TS 3.4.1 are not met. Q modified to address concerns. MAE How is immediately beginning a d0W11 power plausible? The down power will not improve pressure - it could even lower pressure which would make the situation worse. Page 17 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist BIW Q modified to address concerns. MAB 86 027G2.2.42 N H 2 Question earmarked for higher scrutiny at licensees request. Licensee is concerned that question presentation may be confusing or flawed in some S manner. One observation: The question statement asks about the operability of the sump, yet the fill in the blank is asking about the operability of the pH control system. This results in a lot of confusion because the test taker does not know whether he is to evaluate the sump for operability of the pH control system. The fill in the blank needs to mirror the question that is being asked. Consider: Which one of the following states the operability status of the ECCS Recirc Fluid pH control system per TS 3.5.6, ECCS Recirculation Fluid pH Control System and the reason? Discuss with licensee. Q modified to address concerns MAB 87 065AG2.4.47 N H 2 5 Q is sat. 88 076G2.4.l I N H 2 5 Q is sat. 89 078G2.2.42 N H 2 S Q is sat. 90 G2. 1.31 N H 2 S Q is sat. 91 G2.2.36 B F 2 x U I can discard A and B because the reasons given are too similar, thus making these two distractors to not be credible. The reasons are not S completely independent of one another. For instance: Because no internal valve work was performed, the valve should automatically open when an SIS is received. The reasons must be independent in order to show a clear uniqueness to each choice. Q modified to address concerns. MAB The question statement needs to be tied directly to SOP-0.0. The question statement and answer choices must mimic the exact wording in the procedure because the wording in the procedure does not state requirements by virtue of the word SHOULD. Therefore, the exact wording of the procedure must be tested. Q modified to address concerns. MAB Consider the following: Which_one_of the_following_correctly_states_the_OPERABILITY_status Page 18 of2l ES-401, Rev. 9 Q# KlA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 86 027G2.2.42 N H 2 87 065AG2.4.47 N H 2 88 076G2.4.ll N H 2 89 078G2.2.42 N H 2 90 G2. 1.3 1 N H 2 91 G2.2.36 B F 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KIA Only S Dist BIW g S S S S S x tJ S Form ES-401-9 Comment Explanation Q modified to address concerns. MAB Question eannarked for higher scrutiny at licensee's request. Licensee is concerned that question presentation may be confusing or flawed in some manner. One observation: The question statement asks about the operability of the sump, yet the fill in the blank is asking about the operability of the pH control system. This results in a lot of confusion because the test taker does not know whether he is to evaluate the sump for operability of the pH control system. The fill in the blank needs to mirror the question that is being asked. Consider: Which one of the following states the operability status of the ECCS Recirc Fluid pH control system per TS 3.5.6, ECCS Recirculation Fluid pH Control System and the reason? Discuss with licensee. Q modified to address concerns. MAB Q is sat. Q is sat. Q is sat. Q is sat. I can discard A and B because the reasons given are too similar, thus making these two distractors to not be credible. The reasons are not completely independent of one another. For instance: Because no internal valve work was performed, the valve should automatically open when an SIS is received. The reasons must be independent in order to show a clear uniqueness to each choice. Q modified to address concerns. MAB TIle question statement needs to be tied directly to SOP-O.O. The question statement and answer choices must mimic the exact wording in the procedure because the wording in the procedure does not state requirements by virtue of the word SHOULD. Therefore, the exact wording of the procedure must be tested. Q modified to address concerns. MAB Consider the following: Which one of the following correctly states the OPERABILITY status Page 18 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# KJA# B L L Psychometric Flaws______ Content Flaws U Comment M 0 0 Stem Cues T/F 1 Non >1 Non Partial Mm Q= SRO E Explanation N K D Focus Cred Cred K/A Only S Dist Dist B/W of the MOV after the tagout has restored power and if INOPERABLE, the actions that are suggested prior to return to service, as stated in the guidance in FNP-O-SOP-O.O? A. The MOV should be declared OPERABLE. B. The MOV should be declared INOPERABLE. The valve is required to be time stroked using an SI signal induced by I&C to demonstrate operability prior to return to service. C. The MOV should be declared INOPERABLE. The MOV should to be time stroked in the open direction to demonstrate operability prior to return to service (No SI signal is required to be used). D. The MOV should be declared INOPERABLE. The MOV should be stroked one full cycle to demonstrate operability prior to return to service (time stroke in open direction is not required and No SI signal is required to be used). There may be a better, more efficient way to word the above suggestion I was just trying to convey the idea. Q modified to address concerns MAE The stem states that the valve must be manually closed due to power being removed. Could the control room operator close this valve manually from the MCB prior to power being removed? Is the intent of the question to have the valve locally closed? Q modified to address concerns MAB Your procedure states that manual operation of an MOV that performs a safety function should be electrically stroked prior to return to service. I think that the procedure words may not reflect the intent of the requirement. I think the procedure step is intended to refer to MOVs that are locally operated mechanically. Licensee noted MAB 92 02.3.37 N H 2 S Q is sat. 93 G2.3.l 1 B F 2 5 Q is sat. 94 02.3.12 M F 2 S Q is sat. 95 02.4.2 M H 2 x x U K/A Match: - How is Knowledge of system set points, interlocks, and automatic actions S associated with EOP entry conditions being tested? I do not see any entry condition knowledge being required. - The K/A is not met at the SRO level, It is true that the operability portion of this question is SRO, but this knowledge is not required by the K/A. SRO-Only questions are required to match the K/A with SRO-only required knowledge. This is necessary to preserve the random sample of the SRO Page 19 of2I ES-401, Rev. 9 Q# KJA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 92 02.3.37 N H 2 93 02.3.11 B F 2 94 02.3.12 M F 2 95 02.4.2 M H 2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q= SRO E Cred KJA Only S Dist B/W S S S x x Y S Form ES-401-9 Comment Explanation of the MOY after the tagout has restored power and if INOPERABLE, the actions that are suggested prior to return to service, as stated in the guidance in FNP-O-SOP-O.O? A. The MOY should be declared OPERABLE. B. The MOY should be declared INOPERABLE. The valve is required to be time stroked using an SI signal induced by I&C to demonstrate operability prior to return to service. C. The MOY should be declared INOPERABLE. The MOY should to be time stroked in the open direction to demonstrate operability prior to return to service (No SI signal is required to be used). D. The MOY should be declared INOPERABLE. The MOY should be stroked one full cycle to demonstrate operability prior to return to service (time stroke in open direction is not required and No SI signal is required to be used). There may be a better, more efficient way to word the above suggestion - I was just trying to convey the idea. Q modified to address concerns. MAB The stem states that the valve must be manually closed due to power being removed. Could the control room operator close this valve manually from the MCB prior to power being removed? Is the intent of the question to have the valve locally closed? Q modified to address concerns. MAB Your procedure states that manual operation of an MOY that performs a safety function should be electrically stroked prior to return to service. I think that the procedure words may not reflect the intent of the requirement. I think the procedure step is intended to refer to MOYs that are locally operated mechanically. Licensee noted. MAB Q is sat. Q is sat. Q is sat. KIA Match: - How is Knowledge of system set points, interlocks, and automatic actions associated with EOP entry conditions being tested? I do not see any entry condition knowledge being required. - The KIA is not met at the SRO level. It is true that the operability portion of this question is SRO, but this knowledge is not required by the KIA. SRO-Only questions are required to match the KIA with SRO-only required knowledge. This is necessary to preserve the random sample of the SRO Page 19 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Q# K/A# B L L yçometric Flaws Content Flaws U Comment M 0 0 Stem Cues T/F I Non >1 Non Partial Mm Q= SRO E Explanation N K 0 Focus Cred Cred K/A Only S Dist Dist B/W material being tested on the exam. Qreplaced MAB Precautions and Limitations are considered to be RO knowledge and the EDO operability is addressed by the P/L in the procedure. Qreplaced. MAB Distractor analysis has a typo on which answer is correct. Corrected. MAB 96 02.4.20 N H 2 S Q is sat. 97 WEO3EG2.4.6 N H 2 x U Q does not require SRO-only knowledge to arrive at the correct answer. ROs are required to understand and be able to perform SDM calcs. The S RO can easily calculate that they do not meet SDM requirements to facilitate further cooldown. Furthermore, ROs are required to know how to calculate cooldown rate and maintain the plant within the cooldown rates as specified in TS. Q replaced. MAI3 98 WEIOEA2.2 N H 2 x U Is Step-wise a defined term at Farley? If not, then use a few more words to explicitly state that the cooldown is to be completed prior to the depress. S Addressed. MAB What 10 CFR 55.43 tie exists to make this an SRO-only level question? Addressed. MAB Does the question force the applicant to make an assumption on the value of subcooling? This affects the plausibility of C and D. If an applicant has no way of knowing how much subcooling exists, then he has no way of figuring out whether or not dumping steam even makes sense. Addressed. MAB Can we be assured that the second part of C and D is not correct? I have concerns that it could be argued as correct. The cooldown will continue, so maybe the wording can be enhanced to ensure that the choice is incorrect. Discuss with licensee. Addressed. MAB 99 WE1 I N H 2 5 Q is sat. EG2.1.28 100 WE15 M H 2 5 Are the applicants expected to know what step 7 is intended to do, or does EA2.2 this step need to be described for the applicants in the answer choices! Addressed. MAB Page 20 of2l ES-401, Rev. 9 Q# KJA# B L L Psychometric Flaws M 0 0 Stem Cues T/F 1 Non N K D Focus Cred Dist 96 G2.4.20 N H 2 97 WE03EG2.4.6 N H 2 98 WEIOEA2.2 N H 2 99 WEll N H 2 EG2.1.28 100 WEl5 M H 2 EA2.2 Written Exam Review Worksheet Farley 2010-301 Content Flaws U >1 Non Partial Min Q; SRO E Cred KJA Only S Dist B/W S x tI S x tI S S S Form ES-401-9 Comment Explanation material being tested on the exam. Q replaced. MAE Precautions and Limitations are considered to be RO knowledge and the EDG operability is addressed by the P/L in the procedure. Q replaced. MAB Distractor analysis has a typo on which answer is correct. Corrected. MAE Q is sat. Q does not require SRO-only knowledge to arrive at the correct answer. ROs are required to understand and be able to perform SDM calcs. The RO can easily calculate that they do not meet SDM requirements to facilitate further cooldown. Furthermore, ROs are required to know how to calculate cooldown rate and maintain the plant within the cool down rates as specified in TS. Q replaced. MAE Is "Step-wise" a defined term at Farley? If not, then use a few more words to explicitly state that the cooldown is to be completed prior to the depress. Addressed. MAB What 10 CFR 55.43 tie exists to make this an SRO-only level question? Addressed. MAE Does the question force the applicant to make an assumption on the value of sub cooling? This affects the plausibility ofC and D. Ifan applicant has no way of knowing how much subcooling exists, then he has no way of figuring out whether or not dumping steam even makes sense. Addressed. MAS Can we be assured that the second part of C and D is not correct? I have concems that it could be argued as correct. TIle cooldown will continue, so maybe the wording can be enhanced to ensure that the choice is incorrect. Discuss with licensee. Addressed. MAS Q is sat. Are the applicants expected to know what step 7 is intended to do, or does this step need to be described for the applicants in the answer choicesl Addressed. MAS Page 20 of21
ES-401, Rev. 9 Written Exam Review Worksheet Form ES-401-9 Farley 2010-301 Page 21 of2l ES-401, Rev. 9 Written Exam Review Worksheet Farley 2010-301 Form ES-401-9 Page 21 of21
() () ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: qtt-( Date of Exam: (3 i1RL zjt Exam Level: RO[j SRO[xJ Initials Item Description a b c 1. Clean answer sheets copied before grading 1 2. Answer key changes and question deletions justified and documented
3. Applicants scores checked for addition errors (reviewers spot check> 25% of examinations)
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail
5. All other failing examinations checked to ensure that grades are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature Date
- a. Grader rn/cf/Aft
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
- j. i-rj.c /,YZJ(c d
NRC Supeisor (*) (*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. ES-403, Page 6 of 6 ES-403 Written Examination Grading Quality Checklist Form ES-403-1 Facility: r:AALl~'" Date of Exam: 1:3 Af'RIL ;;{o1D Exam Level: Rq-il SRO[:>C] Initials Item Description a b c
- 1.
Clean answer sheets copied before grading 411 ~ M8
- 2.
Answer key changes and question deletions justified -f!/ rfJ3 and documented
- 3.
Applicants' scores checked for addition errors -fit iWJ7 (reviewers spot check> 25% of examinations)
- 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, 111 fYj5? as applicable, +/-4% on the SRO-only) reviewed in detail
- 5.
All other failing examinations checked to ensure that grades ?tI V'NP are justified
- 6.
Performance on missed questions checked for training yW9 deficiencies and wording problems; evaluate validity 11/ V of questions missed by half or more of the applicants Printed Name/Signature Date
- a. Grader (11lcllIJEL K'. /YI££K5/~~
()~~/Zol"
- NIp,
/
- b. Facility Reviewer(*)
N/11
- c. NRC Chief Examiner (*)
N\\I\\R'l A. BAT! S / JIYlJC'. J~ OS~w/RO/O
- d. NRC Supervisor (*)
~I..U L.~LDN.lMJAl ~tC1 ~ 65(~/tt> '( "") (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. ES-403, Page 6 of 6}}