IR 05000360/2008301: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
(2 intermediate revisions by the same user not shown)
Line 2: Line 2:
| number = ML082950046
| number = ML082950046
| issue date = 10/21/2008
| issue date = 10/21/2008
| title = 05000360-08-301, 05000370-08-301 May 12-23, 2008 Exam Administrative Documents
| title = 08-301, 05000370-08-301 May 12-23, 2008 Exam Administrative Documents
| author name =  
| author name =  
| author affiliation = NRC/RGN-II
| author affiliation = NRC/RGN-II
Line 18: Line 18:


=Text=
=Text=
{{#Wiki_filter:ADMINISTRATIVE DOCUMENTS (Yellow Paper)1.Exam Preparation Checklist ES-201-1 2.Exam Outline Quality Checklist ES-201-2 3.Exam Security Agreement(s)
{{#Wiki_filter:ADMINISTRATIVE DOCUMENTS (Yellow Paper)
ES-201-3 4.Administrative Topics Outline (Final)ES-301-1 5.Control Room Systems&Facility Walk-through Test Outline (Final)ES-301-2 6.Operating Test Quality Check Sheet ES-301-3 7.Simulator Scenario Quality Check Sheet ES-301-4 8.Transient and Event Checklist ES-301-5 9.Competencies Checklist ES-301-6 10.Written Exam Quality Check Sheet ES-401-6 11.Written Exam Review Worksheet ES-401-9 12.Written Exam Grading Quality Checklist ES-403-1 13.Post-Exam Check Sheet....................
1. Exam Preparation Checklist   ES-201-1 Exam Outline Quality Checklist   ES-201-2 Exam Security Agreement(s)   ES-201-3 Administrative Topics Outline (Final) ES-301-1 Control Room Systems & Facility Walk-through Test Outline (Final)   ES-301-2 Operating Test Quality Check Sheet   ES-301-3 Simulator Scenario Quality Check Sheet ES-301-4 Transient and Event Checklist   ES-301-5 Competencies Checklist   ES-301-6 10. Written Exam Quality Check Sheet   ES-401-6 11. Written Exam Review Worksheet   ES-401-9 12. Written Exam Grading Quality Checklist ES-403-1 13. Post-Exam Check Sheet . . . . . . . . . . . . . . . . . . . . .. ES-501-1 14. Facility Submittal Letter   [ ]
..ES-501-1 14.Facility Submittal Letter[]
ES-201 Examination Preparation Checklist Form ES-201-1 Facility: McGuire Date of Examination:
_May 12-23, 2008_Developed by: Written-Facility X NRCD II Operating-Facility X NRCD Target Chief Date*Task Description (Reference)
Examiner's Initials-180 1.Examination administration date confirmed(C.1.a;C.2.a and b)rfa-120 2.NRC examiners and facility contact assigned (C.1.d;C.2.e)rfa-120 3.Facility contact briefed on security and other requirements (C.2.c)rfa-120 4.Corporate notification letter sent (C.2.d)rfa[-90][5.Reference material due (C.1.e;C.3.c;Attachment 3)]rfa{-75}6.Integrated examination outline(s)due, including Forms ES-201-2, ES-201-3, rfa ES-301-1,ES-301-2,ES-301-5, ES-D-1's, ES-401-1/2, and ES-401-4, as applicable (C.1.e and f;C.3.d){-70}{7.Examination outline(s)
reviewed by NRC and feedback provided to facility rfa licensee (C.2.h;C.3.e)}{-45}8.Proposed examinations (including written, walk-through JPMs, and rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h;C.3.d)-30 9.Preliminary license applications (NRC Form 398's)due (C.1.1;C.2.g;rfa ES-202)-14 10.Final license applications due and Form ES-201-4 prepared (C.1.1;C.2.i;rfa ES-202)-14 11.Examination approved by NRC supervisor for facility licensee review rfa (C.2.h;C.3.f)-14 12.Examinations reviewed with facility licensee (C.1.j;C.2.f and h;C.3.g)rfa-7 13.Written examinations and operating tests approved by NRC supervisor rfa (C.2.i;C.3.h)-7 14.Final applications reviewed;1 or 2 (if>10)applications audited to confirm rfa qualifications
/eligibility; and examination approval and waiver letters sent (C.2.i;Attachment 5;ES-202, C.2.e;ES-204)-7 15.Proctoring/written examadministrationguidelines reviewed rfa with facility licensee (C.3.k)-7 16.Approved scenarios, job performance measures, and questions rfa distributed to NRC'examiners (C.3.i)*Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter.They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.[Applies only]{Does not apply}to examinations prepared by the NR ES-201 Examination Outline Quality Checklist Form ES-201-2 Facilit: McGuire Date of Examination:
5/12/08 Item Task Description Initials a b*c#1.W R I T T E N 2.S I M U L A T o R 3.W/T a.Verify that the outline(s)
fit(s)the appropriate model per ES-401.b.Assess whether the outline was systematically and randomly prepared in accordance with Section 0.1 of ES-401 and whether all KIA categories are appropriately sampled.c.Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.d.Assess whether the justifications for deselected or rejected KIA statements are appropriate.


a.Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.
ES-201  Examination Preparation Checklist  Form ES-201-1 Facility: McGuire  Date of Examination: _May 12-23, 2008_
Developed by: Written - Facility X NRCD II Operating - Facility X NRCD Target      Chief Date*  Task Description (Reference)  Examiner's Initials-180 Examination administration date confirmed (C.1.a; C.2.a and b)  rfa-120 NRC examiners and facility contact assigned (C.1.d; C.2.e)  rfa-120 Facility contact briefed on security and other requirements (C.2.c) rfa-120 Corporate notification letter sent (C.2.d)  rfa
[-90] [ Reference material due (C.1.e; C.3.c; Attachment 3)]  rfa
{-75} Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, rfa ES-301-1, ES-301-2, ES-301-5, ES-D-1 's, ES-401-1/2, ES-401-3~ and ES-401-4, as applicable (C.1.e and f; C.3.d)
{-70} { Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)}
{-45} Proposed examinations (including written, walk-through JPMs, and  rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; rfa ES-202)
-14 1 Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; rfa ES-202)
-14 1 Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f)
-14 1 Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa-7 1 Written examinations and operating tests approved by NRC supervisor rfa (C.2.i; C.3.h)
-7 1 Final applications reviewed; 1 or 2 (if >10) applications audited to confirm rfa qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)
-7 1 Proctoring/written exam administration guidelines reviewed  rfa with facility licensee (C.3.k)
-7 1 Approved scenarios, job performance measures, and questions  rfa distributed to NRC 'examiners (C.3.i)
* Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility license [Applies only] {Does not apply} to examinations prepared by the NR ES-201  Examination Outline Quality Checklist  Form ES-201-2 Facilit: McGuire    Date of Examination: 5/12/08 Initials Item    Task Description a b* c# a. Verify that the outline(s) fit(s) the appropriate model per ES-40 b. Assess whether the outline was systematically and randomly prepared in accordance W with Section 0.1 of ES-401 and whether all KIA categories are appropriately sample R c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topic I T d. Assess whether the justifications for deselected or rejected KIA statements are T appropriat E N a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transient S I b. Assess whether there are enough scenario sets (and spares) to test the projected M number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; and ensure that each applicant U can be tested using at least one new or significantly modified scenario, that no L scenarios are duplicated from the applicants' audit testes), and scenarios will not be A repeated on subsequent day T To the extent possible assess whether the outline(s) conform(s) with the qualitative and J
o quantitative criteria specified on Form ES-301-4 and described in Appendix R a. Verify that systems walk-through outline meets the criteria specified on Form ES-301-2:
  (1) the outline(s) contain(s) the required number of control room and in-plant tasks, W  distributed among the safety functions as specified on the form
/
  (2) task repetition from the last two NRC examinations is within the limits specified on T
the form, (3)* no tasks are duplicated from the applicants' audit testes)
  (4) the number of alternate path, low-power, emergency and RCA tasks meet the criteria on the for b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
  (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent day . a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sectio G b. Assess whether the 1OCFR 55.41/43 and 55.45 sampling is appropriat E N
c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least E d. Check for duplication and overlap among exam section R e. Check the entire exam for balance of coverag A L Assess whether the exam fits the appropriate job level (RO or SRO Printed N Author  David LazaronylWestern Technical Se . 3/14/08 Facility Reviewer (*) NRC Chief Examiner (#) NRC Supervisor NOTE: # Independent NRC reviewer initial items in Column "c", chief examiner concurrence require * Not applicable for NRC-prepared examination outlines NUREG-1021 , Revision 9


b.Assess whether there are enough scenario sets (and spares)to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants'
ES-201, Rev. 9    Examination Security Agreement    Form ES-201-3 Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 5/tt-/Ol
audit testes), and scenarios will not be repeated on subsequent days.c.To the extent possible J assess whether the outline(s)
          .'
conform(s)
5h1/P'g as ~ tht date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination .5 ) 1'2.~ r>,JI sll ') JI!) S To the best of my knoWled~did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~ . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR PRINTED NAME JOB TITLE / RESPONSIBILITY  SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1.V\Lt,~aL\ ().K~,(~        S:~2.()~ \"'; T1WLOtl..-        ~;~.~}
with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.a.Verify that systems walk-through outline meets the criteria specified on Form ES-301-2: (1)the outline(s)
-=A I'/'j t.., tl:        J P ~~ NPto (.~        . g 5. EriC e W'J*Z7C*~s.--        (;It>>P? ~~        5"-z:r-oB" l.lL 'J=az=        ~.~
contain(s)
t.p~f/ifti 11. 61JTH-A-$1+ KLlMAR..... $-t,~ ..$:vPF'C~I
the required number of control room and in-plant tasks, distributed among the safety functions as specified on the form (2)task repetition from the last two NRC examinations is within the limits specified on the form, (3)*no tasks are duplicated from the applicants'
          !E~~
audit testes)(4)the number of alternate path, low-power, emergency and RCA tasks meet the criteria on the form.b.Verify that the administrative outline meets the criteria specified on Form ES-301-1: (1)the tasks are distributed among the topics as specified on the form (2)at least one task is new or significantly modified (3)no more than one task is repeated from the last two NRC licensing examinations 3/14/08 Assess whether the exam fits the appropriate job level (RO or SRO Check for duplication and overlap among exam sections.Check theentireexam for balance of coverage.Ensure that KIA importance ratings (except for plant-specific priorities)
          ~r oi-12. NA.~AA) ~ ~,fo,J tt ,,(,.tj'CL =:LA'}'. t...fo co      ~--2M$-
are at least 2.5.Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.Assess whether the 1 OCFR 55.41/43 and 55.45 sampling is appropriate.
13. ~NfS f}j,cue~o  OPS({HP    3 ~ 12-0'8  , c D -()~
Fit DQ."fL-04:(    Zi-(g--o~ Sec ... ~.,..,/..~.3 14. - - titcJ:.'S -Of:>
15. CUt/JeUf:S NOTES:
f\111~ \)o,'1nI. ~ :1l 6AJS 51\91l41S[  <f- IS'IJT C!..ha.4- GI1l&#xa5;<JLf!, /t2./'O-Dj'
          ~~
G'"
__
          \
ofl.J- L 1,,\ J.r; * -I,. be" 1-dJ*PJ;P


Assess whether plant-specific priorities (including PRA and IPE insights)are covered in the appropriate exam section.c.4.a.G b.E N c.E d.R A e.L f.Printed N a.Author David LazaronylWestern Technical Se.b.Facility Reviewer (*)c.NRC Chief Examiner (#)d.NRC Supervisor NOTE:#Independent NRC reviewer initial items in Column"c", chief examiner concurrence required.*Not applicable for NRC-prepared examination outlines NUREG-1021
00 ~ (he ~'l1&#xa3;jc ES-20~t    Examination* v~~urjty Agreement   Form ES-&#xa3;u 1-3 Pre-Examination       S/, 2./0;> Q ..... J I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of 5/19'/03 as .of the date of my signature. I agree that I will not knowingly divulge any information about these exami"nations to any persons who have not been authorized. by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management 'or the NRC chief examiner any indications or suggestions that examination security may have been compromised. Post-Examination  .5 )12 \e?J 0,,1-. 5 h91 Db" To the best of my knowledge, I did not a!1vulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of { . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR DATE NOTE NOTES:
, Revision 9 ES-201, Rev.9 Examination Security Agreement Form ES-201-3 1.Pre-Examination 5/tt-/Ol 5h1/P'g I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s)of..'astht date of my signature.
dP~ ~ L;',.,J, c; .. b6l".I,l O<J.P~..wf      NUREG-1021, Revision 9


I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).
Ad~\. . <tf&#xa3; ~o~
ES-201      Examination Security Agreement  Form ES-201-3
,,'\
t** Pre-Examination          <) hz/oP at"').
I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of    <1tQ,lo1 as of the date of my signature. I agree that I will not knowingly divulge any information about these'examTnations to any.persons~ot been authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security"measures aild requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately re'port to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination    5112..)0 eo,.} :s II 910'd To the best of my knowledge, I did not ivulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of    . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically not~d below and authorized by the NR PRINTED NAME  JOB TITLE I RESPONSIBILITY    DATE  DATE NOTE 1. ~H Gt Ae3;JtN&#xa3;.,1  . De\JeLo ~      5 . r;.7"o?
2. ~ \\). lJVl:fj/!:o~  ~t~ ~LD,,"C?'~      S~27 . Dg 3. L :I'\J~ G-\:'\,t'rT me GWt~t\. -:::fi,.1t(\Ac.-\--o'"      S-23-0'6 4. f"FEo l<< l< K  \"1\( ~~  _:r;"\~ fu<'
5. $~1Y HMJ/atlJ,J S'>IV\IL "cNQD(L 6. JtltfNU-.SA~Uk  Sit. 6f*H+~ SPlt;"T,j1 7*~c..v..le. L. lVl\ G'I\I~\ s 4cl t\'\ (' VI, "S 1)"'<: . *
8. /4;.., .,~rH JlrLfNoJ . Eo P * \D~$
9. "~/?eSl+ '&In~ , !VlCG(.l*I"~~ nD 1O. L'uf2Jflt It) l-Jo/t ,n ~ ft.,."u2~ I Sf? 0./PSt!'}
11. DAAAyt Bt4cHtiJ"r'  /'It ~ ~ I Ao  *
12. Cll.tle.ri"M Ji,flwtaf\  OPS !Sk-O 1 ~6 /?'/I//1fs (Y1c Gv; (Ie .:r,.vsfrt.l~loy 14. !\)V~~J 9,m t i H _~0Pt;:""";;::''-I-L-:...;;R:..3I _
15. Robert Be:> Ie..- __ tJ-Ps-+--II<.---'--o-----
NOTES: cXp.~ - Li~J~ G~b\,e/").
dPJ;J4'        NUREG-1021, Revision 9


Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures)
ES-301  Administrative Topics Outline  Form ES-301-1 Final Facility: McGuire  Date of Examination: 5/12/08 Examination Level:  SRO  Operating Test Number: N08-1 Administrative Topic Type Code*  Describe activity to be performed (see Note)
and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.1.25 (4.2) Ability to interpret reference materials, such Conduct of Operations    as graphs, curves, tables, et M,R JPM:  Calculate Dilution Needed for a Specified 111  Rod Change 2.1.20 (4.6) Ability to interpret and execute procedure Conduct of Operations    steps N,R
  /JL,  JPM:  Approve a Completed Procedure 2.2.13 (4.3) Knowledge of Tagging and Clearance Equipment Control    Procedures N,R JPM:  Review Mechanical and Electrical Isolation
  ~    Boundaries to Isolate 1B NI Pump 2.3.4 (3.7) Knowledge of radiation exposure under Radiation Control    normal or emergency condition N,R JPM:  Take On-Site Protective Actions During a 1':1-  General Emergency 2.4.44 (4.4) Knowledge of Emergency Plan Protective Emergency    Action Recommendations Procedures/Plan  N,R JPM:  Make Protective Action Recommendations
  ~ r l
and Perform Initial Notification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.


.2.Post-Examination
*Type Codes & Criteria:  (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S; 3 for ROs; S; 4 for SROs & RO retakes)
.5)
  (N)ew or (M)odified from bank (~ 1)
r>,JI sll')J I!)S To the best of my not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s)of.From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1)DATE SIGNATURE (2)DATE NOTE 2.1\"';T1WLOtl..-
  (P)revious 2 exams (s; 1; randomly selected)
3.I'/'j t.., tl: J P 4.NPto.g 5.EriC e (;It>>P?6.-=A5"-z:r-oB" l.lL'J=az=11.61JTH-A-$1+
NUREG-1021, Revision 9
KLlMAR..... oi-12.


tt ,,(,.tj'CL
ES-301  Administrative Topics Outline  Form ES-301-1 Final Facility: McGuire  Date of Examination: 5/12/08 Examination Level:  RO  Operating Test Number: N08-1 Administrative Topic Type Code*  Describe activity to be performed (see Note)
=:LA'}'.t...fo co--2M$-13.
2.1.25 (3.9) Ability to interpret reference materials, such Conduct of Operations    as graphs, curves, tables, et M,R JPM: Calculate Dilution Needed for a Specified AI  Rod Change 2.1.19 (3.9) Ability to use plant computers to evaluate Conduct of Operations    system or component status N,S JPM: Monitor Critical Safety Function Status
  /I~  Trees 2.2.13 (4.1) Knowledge of Tagging and Clearance Equipment Control    Procedures N,R JPM: Identify Mechanical and Electrical Isolation IlJ  Boundaries to Isolate 1B NI Pump 2.4.13 (4.0) Knowledge of Crew Roles and Emergency    Responsibilities During EOP Usage Procedures/Plan  M,R JPM: Calculate Reactor Vessel Head Venting J/S-  Time NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.


OPS({HP 312-0'8 ,cD14.--titcJ:.'S-Of:>Fit DQ."fL-04:(
*Type Codes & Criteria:  (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (s 3 for ROs; s 4 for SROs & RO retakes)
Sec...
  (N)ew or (M)odified from bank (~ 1)
<JLf!,/t2./'O-Dj'
  (P)revious 2 exams (s 1; randomly selected)
__15.CUt/JeUf:S
NUREG-1021, Revision 9
\)o,'1nI.:1l 6AJS 51\91l41S[
<f-IS'IJT C!..ha.4-GI1l&#xa5;NOTES: G'"\ofl.J-L 1 ,,\J.r;*-I,.be" 1-dJ*PJ;P


00(he Examination*
ES-301  Control Room/In-Plant Systems Outline  Form ES-301-2 Final Facility: McGuire  Date of Examination: 5/12/08 Exam Level (circle one): RO (only) / SRO(I) I SRO (U) Operating Test No.: N08-1 Control Room Systems@ (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U, including 1 ESF)
Agreement Form ES-&#xa3;u 1-3 1.Pre-Examination S/, 2./0;>Q.....J I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s)of 5/19'/03 as.of the date of my signature.
Type Code* Safety System / JPM Title Function Control Rod Drive System 8,D Retrieve a Dropped Control Rod EPE 038 Steam Generator Tube Rupture S,N,A 3 NC Cooldown During SGTR Reactor Coolant Pump System 8,M,A 4P Start "1 B" Reactor Coolant Pump Auxiliary/Emergency Feedwater System 8,M 48 Operate the Turbine Driven CA Pump from the Control Room Containment Spray System S,N,A,EN 5 Manually Actuate Containment Spray System APE 036 Fuel Handling Incidents Start Outside Air Pressure Filter Fan Following Damage of Spent Fuel 8,M 8 Assembly Nuclear Instrumentation System S,D,A,L 7 Respond to a Source Range Nuclear Instrumentation Failure AC Electrical Distribution System 8,M 6 Restoration of Power to Unit 1 6900V Buses using Offsite Power In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U) Chemical and Volume Control System D,R,E 1 Emergency Borate the Reactor Coolant System Locally Using 2NV-269 APE 065 Loss of Instrument Air D,A,E 8 Ensure Proper Response of Diesel VI Compressors on Loss of VI EPE 055 Station Blackout D,E 6 Establish NC Pump Seal Injection from the SSF NUREG-1 021, Revision 9


I agree that I will not knowingly divulge any information about these exami"nations to any persons who have not been authorized.
ES-301  Control Room/In-Plant Systems Outline  Form ES-301-2 Final
@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control roo * Type Codes  Criteria for RO 1 SRO-I 1 SRO-U (A)lternate path    4-6 (5) /4-6 (5) / 2-3 (3)
(C)ontrol room (D)irect from bank    8 (5) /:.~ 8 (5) / 4 (3)
(E)mergency or abnormal in-plant    1 (3) I~?: 1 (3) / ;2. 1 (2)
(EN)gineered Safety Feature    - 1 1 1 (1) (Control Room System)
(L)ow-Power / Shutdown    ;~:~ 1 (1) l~:~: 1 (1) 1 1 (1)
(N)ew or (M)odified from bank including 1(A)  >: 2 (6) / 2 (5) / > 1 (2)
(P)revious 2 exams    :.~;; 3 (0) / 3 (0)1 2 (0) (Randomly Selected)
(R)CA      1 (1 )t?~ 1 (1) 1 1 (1)
(S)imulator NUREG-1 021, Revision 9


by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures)
ES-301  Operating Test Quality Checklist  Form ES-301-3 Facility: McGuire Date of 5/12/08 Operating Test Number: N08-1 Examination:
and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.I will immediately report to facility management
Initials 1. GENERAL CRITERIA a b* c# The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution). There is no day-to-day repetition between this and other operating tests to be administered during this examination. The operating test shall not duplicate items from the applicants' audit test(s) (see Section D.1.a). Overlap with the written examination and between different parts of the operating test is within acceptable limits. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license leve . WALK-THROUGH CRITERIA Each JPM includes the following, as applicable:
'or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
* initial conditions
* initiating cues
* references and tools, including associated procedures
* reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
* operationally important specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards  &#xa5;
- restrictions on the sequence of steps, if applicable  D ~~ Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of "-
        \)~ ~ ~
the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201- . SIMULATOR CRITERIA    - - -
        ~" ~
The associated simulator operating tests (scenario sets) have been reviewed in accordance with  ~
Form ES-301-4 and a copy is attache DL Printed Name / Signature 1 v)\e;&#xa5; Date
      ~)t{O" Author  David Lazarony, Western Technical Services / t> l r;7\.PL> 5/1/08 Facility Reviewer (*) ~eD ~ \(\~ / i'7fldti1Ad1 \Jew- ,/-&-~ S-J-05 NRC Chief Examiner (#) IldJV AJellb / ~-; ~  I  ~J-/t7 t? NRC Supervisor      o~I/z/tJ9 NOTE: The facility signature is not applicable for NRC-developed test # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.


2.Post-Examination
NUREG-1 021, Revision 9
.5)12\e?J 0,,1-.5 h 91 Db" To the best of my knowledge, I did not a!1vulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s)of{.From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who wereadministeredthese licensing examinations, except as specifically noted below and authorized by the NRC.DATE NOTE NOTES:L;',.,J, c;..b6l".I,l NUREG-1021, Revision 9  
...<tf&#xa3;ES-201 ,,'\Examination Security Agreement t**Form ES-201-3 1.Pre-Examination
<)hz/oP at"').I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s)of<1tQ,l o 1 as of the date of my signature.


I agree that I will not knowingly divulge any information about these'examTnations to been authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback.Furthermore, I am aware of the physical security"measures aild requirements (as documented in the facility licensee's procedures)
ES-301  Simulator Scenario Quality Checklist  Form ES-301-4
and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.I will immediately re'port to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
    ~I 'VA L Facility: McGuire  Date of Exam: 5/12/08 Scenario Numbers: 45 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES    Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of
        \J~ ~
service, but it does not cue the operators into expected event &#xa3; c*K Dt"
        " The scenarios consist mostly pf related events. Each event description consists of
* the point in the scenario when it is to be initiated
* the malfunction(s) that are entered to initiate the event
* the symptoms/cues that will be visible to the crew
* the expected operator actions (by shift position)
        ,~
          ~
* the event termination point (if applicable)    l)L Jt No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without -&#xa5; a credible preceding incident such as a seismic even b\- d<K ~ The events are valid with regard to physics and thermodynamic D\'~ ~ ~ Sequencing and timing of events is reasonable, and allows the examination team to obtain complete ~
evaluation results commensurate with the scenario objective \) I~ ~ If time compression techniques are used, the scenario summary clearly so indicates. Operators  &#xa5; have sufficient time to carry out expected activities without undue time constraint DL ~ ~ The simulator modeling is not altere at 6Jd( ~ The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenario *
DL at( ~
1 Every operator will be evaluated using at least one new or significantly modified scenario. All other -&#xa5;
        ~
scenarios have been altered in accordance with Section 0.5 of ES-30 \) ~
1 All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the -&#xa5; form along with the simulator scenarios). DL I~ ~
        ~
1 Each applicant will be significantly involved in the minimum number of transients and events
        ~
specified on Form ES-301-5 (submit the form with the simulator scenarios).   \)L
        ~
pL ~ ~
        "'f" 1 The level of difficulty is appropriate to support licensing decisions for each crew positio Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes - - -
4 5
--
        ~
        ,~ Total malfunctions (5-8)    7 7
        ~ Malfunctions after EOP entry (1-2)    1 1  ~ Abnormal events (2-4)    4 3  -. Major transients (1-2)    1 1 D  '~
        ~t EOPs entered/requiring substantive actions (1-2)  1 1
        ~ EOP contingencies requiring substantive actions (0-2)  1 0
        ~ Critical tasks (2-3)    3 2 NUREG-1 021, Revision 9


2.Post-Examination 5112..)0 eo,.}:s II 910'd To the best of my knowledge, I did not ivulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s)of.From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically below and authorized by the NRC.PRINTED NAME JOB TITLE I RESPONSIBILITY 1. Gt Ae3;JtN&#xa3;.,1
ES-301  Simulator Scenario Quality Checklist  Form ES-301-4 Facility: McGuire  Date of Exam: 5/12/08 Scenario Numbers: 123 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES    Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected event . The scenarios consist mostly of related event . Each event description consists of
.De\JeLo2.\\).
* the point in the scenario when it is to be initiated
3.L G-\:'\,t'rT me
* the malfunction(s) that are entered to initiate the event
-:::fi,.1t(\Ac.-\--o'" 4.f"FEo l<<l<K\"1\(_:r;"\fu<'5. HMJ/atlJ,J S'>IV\IL"cNQD(L 6.
* the symptoms/cues that will be visible to the crew
* the expected operator actions (by shift position)
* the event termination point (if applicable) No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic even . The events are valid with regard to physics and thermodynamic . Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objective . If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraint . The simulator modeling is not altere . The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional ~ ~J '-. fidelity is maintained while running the planned scenario D \.. ocJ.:'\ ~
1 Every operator will be evaluated using' at least one new or significantly modified scenario. All other '" \...&#xa5; '\\. ~
scenarios have been altered in accordance with Section 0.5 of ES-30 \J ~
11 . All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the  ruJ ~
form along with the simulator scenarios).     ~,
1 Each applicant will be significantly involved in the minimum number of transients and events  ~
specified on Form ES-301-5 (submit the form with the simulator scenarios).


Sit.
I I - - - - - - - - - - - - _ _ + _ _ _ _ _ + . _ _      ~
1 The level of difficulty is appropriate to support licensing decisions for each crew positio D" Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes 1 2 3 dt 1. Total malfunctions (5-8)
Malfunctions after EOP entry (1-2)


SPlt;"T,j1 7
2
L.lVl\
s 4 cl t\'\('VI,"S 1)"'<:.*8./4;..,
JlrLfNoJ.Eo P*\9.


,
2
nD 1 O.L'uf2Jflt It)l-Jo/t ,n I Sf?0./PSt!'}11.DAAAyt Bt4cHtiJ"r'
/'ItI Ao*12.Cll.tle.ri"M Ji,flwtaf\
OPS!Sk-O 13./?'/I//1fs (Y1c Gv;(Ie 14.


9,m t i H
2
_15.Robert Be:>Ie..-__tJ-Ps-+--II<.---'--o-----
        ~L p ~ ~" Abnormal events (2-4)    3 3 4 D ~ ~ Major transients (1-2)    1 1 1 l)L 8J< ~ EOPs entered/requiring substantive actions (1-2)  1 1 1 l)'\' '91< ~ EOP contingencies requiring substantive actions (0-2)  1 1 1 DL 8&#xa5; ~ Critical tasks (2-3)     2 2 2 \)\.... ~ ~
DATE DATE 5..r;.7"o?..Dg S-23-0'6 NOTE NOTES:
NUREG-1 021, Revision 9
-
dPJ;J4'NUREG-1021, Revision 9 ES-301 Facility: McGuire Administrative Topics Outline Final Date of Examination:
Form ES-301-1 5/12/08 Examination Level: SRO Operating Test Number: N08-1 Administrative Topic Type Code*Describe activity to be performed (see Note)2.1.25 (4.2)Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, etc.M,R JPM: Calculate Dilution Needed for a Specified 111 Rod Change 2.1.20 (4.6)Ability to interpret and execute procedure Conduct of Operations N,R steps/JL, JPM: Approve a Completed Procedure 2.2.13 (4.3)Knowledge of Tagging and Clearance Equipment Control Procedures N,RJPM: Review Mechanical and Electrical Isolation Boundaries to Isolate1B NI Pump 2.3.4 (3.7)Knowledge of radiation exposure under Radiation Control normal or emergency conditions.


N,R 1':1-JPM: Take On-Site Protective Actions During a General Emergency 2.4.44 (4.4)Knowledge of Emergency Plan Protective Emergency Action Recommendations Procedures/Plan N,Rr l JPM: Make Protective Action Recommendations and Perform Initial Notification NOTE: All items (5 total)are required for SROs.RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.*Type Codes&Criteria: NUREG-1021, Revision 9 (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S;3 for ROs;S;4 for SROs&RO retakes)(N)ew or (M)odified from bank1)(P)revious 2 exams (s;1;randomly selected)
ES-301    Transient and Event Checklist    Form ES.-301-5 FINAL Facility: McGuire  Date of Exam: 5/12/08 Operating Test No.: N08-1 A E    Scenarios I
ES-301 Facility: McGuireAdministrativeTopics Outline Final Date of Examination:
P V  1 2 3 4 T  M P E        0 I I I L N       T
Form ES-301-1 5/12/08 Examination Level: RO Operating Test Number: N08-1 Administrative TopicTypeCode*Describe activity to be performed (see Note)2.1.25 (3.9)Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, etc.M,R JPM: Calculate Dilution Needed for a Specified AI Rod Change 2.1.19 (3.9)Ability to use plant computers to evaluate Conduct of Operations system or component status N,S JPM: Monitor Critical Safety Function StatusTrees 2.2.13 (4.1)Knowledge of Tagging and Clearance Equipment Control Procedures N,R JPM: Identify Mechanical and Electrical Isolation IlJ Boundaries to Isolate1B NI Pump 2.4.13 (4.0)Knowledge of Crew Roles and Emergency Responsibilities During EOP Usage Procedures/Plan M,R JPM: Calculate Reactor Vessel Head Venting J/S-Time NOTE: All items (5 total)are required for SROs.RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.*Type Codes&Criteria: NUREG-1021, Revision 9 (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (s 3 for ROs;s 4 for SROs&RO retakes)(N)ew or (M)odified from bank1)(P)revious 2 exams (s 1;randomly selected)
          !
ES-301 Facility: McGuire Control Room/In-Plant Systems Outline Final Date of Examination:
N CREW  CREW  CREW  CREW I T POSITION  POSITION  POSITION  POSITION  A  I
Form ES-301-2 5/12/08 Exam Level (circle one): RO (only)/SRO(I)I SRO (U)Operating Test No.: N08-1 Control Room Systems@(8 for RO;7 for SRO-I;2 or 3 for SRO-U, including 1 ESF)System/JPM Title a.001 Control Rod Drive System Retrieve a Dropped Control Rod b.EPE 038 Steam Generator Tube Rupture NC Cooldown During SGTR C.003 Reactor Coolant Pump System Start"1 B" Reactor Coolant Pump d.061 Auxiliary/Emergency Feedwater System Operate the Turbine Driven CA Pump from the Control Room Type Code*8,D S,N,A 8,M,A 8,M Safety Function 3 4P 48 e.026 Containment Spray System Manually Actuate Containment Spray System S,N,A,EN 5 f.APE 036 Fuel Handling Incidents Start Outside Air Pressure Filter Fan Following Damage of Spent Fuel Assembly g.015 Nuclear Instrumentation System Respond to a Source Range Nuclear Instrumentation Failure h.062 AC Electrical Distribution System Restoration of Power to Unit 1 6900V Buses using Offsite Power In-Plant Systems@(3 for RO;3 for SRO-I;3 or 2 for SRO-U)8,M S,D,A,L 8,M 8 7 6 i.004 Chemical and Volume Control System D,R,E 1 Emergency Borate the Reactor Coolant System Locally Using 2NV-269 j.APE 065 Loss of Instrument Air D,A,E 8 Ensure Proper Response of Diesel VI Compressors on Loss of VI k.EPE 055 Station Blackout D,E 6 Establish NC Pump Seal Injection from the SSF NUREG-1 021, Revision 9 ES-301 Control Room/In-Plant Systems Outline Final Form ES-301-2@All RO and SRO-I control room (and in-plant)systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.*Type Codes (A)lternate path (C)ontrol room (D)irect from bank (E)mergency or abnormal in-plant (EN)gineered Safety Feature (L)ow-Power
          :
/Shutdown (N)ew or (M)odified from bank including 1 (A)(P)revious 2 exams (R)CA (S)imulator NUREG-1 021, Revision 9 Criteria for RO 1 SRO-I 1 SRO-U 4-6 (5)/4-6 (5)/2-3 (3)8 (5)8 (5)/4 (3)1(3)1(3)/;2.1 (2)-11 1 (1)(Control Room System)1 (1)
C        L  M A T        U N Y        M(*)
1 (1)1 1 (1)>: 2 (6)/2 (5)/>1 (2)
T P S A B S A B S A B S A B  ,R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P  i RX    1  1 : 1 1 0
3 (0)/3 (0)1 2 (0)(Randomly Selected)1 (11 (1)1 1 (1)
          ~
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: McGuire Date of Examination:
NOR 1      1 1 1 1 2,3,    4,5 6 4 4 2 SRQU-1 I/C        :
5/12/08 Operating Test Number: N08-1 1.GENERAL CRITERIA a Initials b*c#a.b.c.d.e.The operating test conforms with the previously approved outline;changes are consistent with sampling requirements (e.g.10 CFR 55.45, operational importance, safety function distribution).
4,5
          :
MAJ 6    6  2 2 2 1 TS 3,4      2 0 2 2 RX        0 1 1 0 NOR  3,7  1   3 !1 1 1 1,2,  2,3,    :4 4 2 SRQU-2 IIC        9 4,5, 4,5    I


There is no day-to-day repetition between this and other operating tests to be administered during this examination.
MAJ  8  6    2 2 2 1
          :
TS  1,5  2,3    4 iO 2 2 IfH"
        -
RX        0 1 1 0 NOR    3 1    2 1 1 1 2,5 2,3, 4 4 2 SRQU-3 IIC        6 4,5 MAJ    8 6    2 :2 2 1
          :
TS    2,3    2 '0 2 2 RX        0 1 1 0 NOR  3,7    2 1 1 1
          ,4 4 2 SRQU-4 IIC  1,2,    5 4,5,


The operating test shall not duplicate items from the applicants'
MAJ  8    1 2 2 1 1,5      i TS        2 O 2 2 I
audit test(s)(see Section D.1.a).Overlap with the written examination and between different parts of the operating test is within acceptable limits.It appears that the operating test will differentiate between competent and competent applicants at the designated license level.2.WALK-THROUGH CRITERIA 3.SIMULATOR CRITERIA The associated simulator operating tests (scenario sets)have been reviewed in accordance with Form ES-301-4 and a copy is attached.b.Ensure that any changes from the previously approved systems and administrativethroughoutlines(Forms ES-301-1 and 2)have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations)
Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IIC) malfunctions and one major transient, in the ATC position:. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the A:TC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.S.d) but must be significant per Section C.2.a of Appendix D. (*) ReactiVity and normal evolutions may be replaced with additional instrument or component malfuncti,ons on a 1-for-1 basi . Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actio~s that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.
specified on those forms and Form ES-201-2.&#xa5;DL."----DL Date 5/1/08 S-J-05 t?
Printed Name/Signature/1 v)\e;&#xa5; David Lazarony, Western Technical Services t>l r;7\.PL>/i'7fld ti1Ad1\Jew-
IldJV AJellb/I Author Facility Reviewer (*)NRC Chief Examiner (#)NRC Supervisor b.d.c.a.a.Each JPM includes the following, as applicable:
*initial conditions
*initiating cues*references and tools, including associated procedures
*reasonable and validated time limits (average time allowed for completion)
and specific designation if deemed to be time-critical by the facility licensee*operationally important specific performance criteria that include:-detailed expected actions with exact criteria and nomenclature
-system response and other examiner cues-statements describing important observations to be made by the applicant-criteria for successful completion of the task-identification of critical steps and their associated performance standards-restrictions on the sequence of steps, if applicable NOTE: The facility signature is not applicable for NRC-developed tests.#Independent NRC reviewer initial items in Column"c";chief examiner concurrence required.NUREG-1 021, Revision 9 ES-301 Simulator Scenario Quality Checklist Form ES-301-4'VA L Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers: 45 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES Initials a b*c#1.The initial conditions are realistic, in that some equipment and/or instrumentation may be out of&#xa3;service, but it does not cue the operators into expected events.2.The scenarios consist mostly pf related events.Dt" c*K" 3.Each event description consists of*the point in the scenario when it is to be initiated*the malfunction(s)
that are entered to initiate the event*the symptoms/cues that will be visible to the crew*the expected operator actions (by shift position)*the event termination point (if applicable)
l)L Jt4.No more than one non-mechanistic failure (e.g., pipe break)is incorporated into the scenario without-&#xa5;d<Ka credible preceding incident such as a seismic event.b\-5.The events are valid with regard to physics and thermodynamics.6.Sequencing and timing of events is reasonable, and allows the examination team to obtain completeevaluation results commensurate with the scenario objectives.


\)L.7.If time compression techniques are used, the scenario summary clearly so indicates.
NUREG 1021 Revision 9


Operators&#xa5;have sufficient time to carry out expected activities withoutunduetime constraints.
ES-301    Transient and Event Checklist    Form ES-301-5 FINAL Facility: McGuire  Date of Exam: 5/12/08  Operating Test No.:  N08-1
          :
A E    Scenarios
          !
P V  1  2  3  4  T  M P E        0 : I L N        T  N CREW  CREW  CREW  CREW I T POSITION  POSITION  POSITION  POSITION  A  I C        L  M A T        U N Y        I M(*)
T P S A B S A B S A B S A B  R I U
          :
E R T 0 R T 0 R T 0 R T 0  I 0 C P 0 C P 0 C P 0 C P RX        0 I 1 1 0
          :
NOR    3 1    2 1 1 1 2,5 2,3, 6 '4 4 2 SROU-5 I/C 4,5 MAJ    8 6    2 '2 2 1 TS    2,3    2 0 2 2


DL 8.The simulator modeling is not altered.at 6Jd(9.The scenarios have been validated.
RX  7    1 :1 1 0 6  :
NOR 1      2 1 1 1 2,3,  1,4,  1,4 4 4 2 SROI-1 IIC        9 :
4,5  6 MAJ 6  8   8  3 2 2 1 TS 3,4      2 0 2 2 RX  4      1 1 1 0 NOR      6  1 i 1 I
1 1 2,5    1,2,  ;4 4 2 SROI-2 IIC        7 3,4,  I


Pursuant to 10 CFR 55.46(d), any open simulator performance
MAJ  6    8  2 2 2 1
*deficiencies or deviations from the referenced plant have been evaluated to ensure that functional DL at(fidelity is maintained while running the planned scenarios.
          :
1,2,~    2 TS        3 iO  2


10.Every operator will be evaluated using at least one new or significantly modified scenario.All other-&#xa5;scenarios have been altered in accordance with Section 0.5 of ES-301.\)L.11.All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the-&#xa5;form along with the simulator scenarios).
RX  7  1  2 1 1 0 NOR 1      1 1 1 1 2,3,  1,4,  4,5
          ,4 4 2 SROI-3 IIC        9 !
4,5  6 MAJ 6  8  6  3 ;2 2 1 TS 3,4      2 0 2 2 Instructions:        : Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must ~erve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must pe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi : Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable action's that provide insight to the applicant's competence count toward the minimum requirements specified forthe applicant's license level in the right-hand columns.


DL12.Each applicant will be significantly involved in the minimum number of transients and eventsspecified on Form ES-301-5 (submit the form with the simulator scenarios).
NUREG 1021 Revision 9


\)L 13.The level of difficulty is appropriate to support licensing decisions for each crew position."'f"pL Target Quantitative Attributes (Per Scenario;See Section D.5.d)Actual Attributes
ES-301   Transient and Event Checklist   Form ES-301-5 FINAL Facility: McGuire   Date of Exam: 5/12/08 Operating Te~t No.: N08-1 A E    Scenarios P V  1  2 3 4  T : M P E        0  I L N        T  N CREW  CREW  CREW  CREW I T POSITION  POSITION  POSITION  POSITION  A  I C        L  M A T        ! U N Y        I I M(*)
---45--1.Total malfunctions (5-8)77 2.Malfunctionsafter EOP entry (1-2)113.Abnormal events (2-4)4 3-.4.Major transients (1-2)1 1 D5.EOPs entered/requiring substantive actions (1-2)1 1 6.EOP contingencies requiring substantive actions (0-2)1 07.Critical tasks (2-3)3 2NUREG-1 021, Revision 9 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers:123 Operating Test No.: N08-11.2.QUALITATIVE ATTRIBUTES The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.The scenarios consist mostly of related events.Initials a b*c#3.Each event description consists of**the point in the scenario when it is to be initiated the malfunction(s)
T P S A B S A B S A B $ A B  !R I U E R T 0 R T 6 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P  :
that are entered to initiate the event 4.5.6.7.8.*the symptoms/cues that will be visible to the crew*the expected operator actions (by shift position)*the event termination point (if applicable)
RX  4     1 1 1 0 1-  ' 1 NOR  3,7    3  1 1 2,5 1,2,  2,3 9 4 4 2 SROI-4 IIC 4,5, 6      I MAJ  6 8   6  3 2 2 1 TS  1,5    2 10 2 2 RX  4      1 1 1 0 NOR      1  1 :1 1 1 2,5    2,3 4 4 2 RO-1 I/C        4 MAJ  6    6  2 2 2 1 TS        0 0 2 2 RX  7    1 !1 1 0 NOR      1  1 ;1 1 1 I
No more than one non-mechanistic failure (e.g., pipe break)is incorporated into the scenario without a credible preceding incident such as a seismic event.The events are validwithregard to physics and thermodynamics.
1,4,  2,3 4 4 2 RO-2 IIC        5


Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
MAJ  8  6  2 ;2 2 1 TS        0 ,0 2 2 RX    1  1 1 1 0 NOR    3    1 1 1 1 2,5 4,5    !4 4 2 RO-3 IIC        4 MAJ    8 6  2 ;2 2 1 TS        0 0 2 2
          :
Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must oe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi ; Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.


If time compression techniques are used,thescenario summary clearly so indicates.
NUREG 1021 Revision 9


Operators have sufficient time to carry out expected activities without undue time constraints.
ES-301  Competencies Checklist  Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test ~o.: N08-1 APPLICANTS SRO (U/I)  ROIATC  BOP Competencies  SCENARIO  SCENARIO  SOENARIO 1 2 3 4 1 2 3 4 1 2 3 4 Interpret/Diagnose    1,4,5  2,q,5 2,4,5 1,4,6 1,4,5 1,3,4 1,2,3 2,3,5 Events and  2-8 1-10 1-8 1-9 6,7,8 7,8 6,
6,8,9 6,7,8 7,8, 6,7,8 6,8,9 7,8  10 Conditions Comply With and Use      2,3,5 1-6, 2,4,5 1,4,6 1,4,5 1,4,5 1,3,4 1,2,3 2,3,5 1-8 1-10 1-8  7,8, Procedures (1)  8-9 6,8 7,8 6,7 6,8 6,7 1p 6,8 6,8,9 Operate Control    2,4,5 1,4,6 j,4,5 1,4,5 1,3,4 2,]5 1,2,3 2,3,5 NA NA NA NA  7'1 ,
Boards (2)    6,8 7,8 6,7 6,8 6,7


The simulator modeling is not altered.9.10.11.The scenarios have been validated.
6,8 6,8,9 Communicate and  1-8 1-10 1-8 1-9 1-8 1-10 1-8 1-9 1-8 1-~ 0 1-8 1-9 Interact Demonstrate Supervisory Ability 1-8 1-10 1-8 1-9 NA NA NA NA NA NA NA NA (3)      i Comply With and Use 3-4 1,5 2-3 1-3 NA NA NA NA NA N~ NA NA Tech. Specs. (3)
Notes:      :
(1 ) Includes Technical Specification compliance for RO.


Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional'-.t.fidelity is maintained while running the planned scenarios.
(2) Optional for an SRO-U.


D\..ocJ.:'\Every operator will be evaluated using'at least one new or significantly modified scenario.All other'"\...&#xa5;'\\.scenarios have been altered in accordance with Section 0.5 of ES-301.\JAll individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the ruJform along with the simulator scenarios). 12.Each applicant will be significantly involved in the minimum number of transients and eventsspecified on Form ES-301-5 (submit the form with the simulator scenarios).
(3) Only applicable to SROs.


II------------__+_____+.__13.The level of difficulty is appropriate to support licensing decisions for each crew position.D" Target Quantitative Attributes (Per Scenario;See Section D.5.d)Actual Attributes 1 2 31.Total malfunctions (5-8)7 8 7 dt" 2.Malfunctions after EOP entry (1-2)222 pL.3.Abnormal events (2-4)33 4 DL.4.Major transients (1-2)11 1 l)L 8J<5.EOPs entered/requiring substantive actions (1-2)111 l)'\''91<6.EOP contingencies requiring substantive actions (0-2)1 1 1 DL 8&#xa5;7.Critical tasks (2-3)222\)\....NUREG-1 021, Revision 9 ES-301 Transient and Event Checklist FINAL Form ES.-301-5 Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1 A E ScenariosPV 1 3 I 2 4 T MPE 0 I I ILN T!N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C: L M A T U N Y M(*)T P S A B S A B S A B S A B ,R I U E R T 0 R T 0 R T 0RT 0 0 C P 0 C P 0 C P 0 C P i RX 1 1: 1 1 0 NOR 1 111 1 SRQU-1 I/C 2,3, 4,5 644 2: 4,5: MAJ 6 6 2 2 2 1 TS 3,4 2 0 2 2 RX 011 0 NOR 3,7 1 3!11 1 SRQU-2 IIC 1,2, 2,3, 9:4 4 2 4,5, 4,5 I 6 MAJ 8 6 2 2 2 1: TS 1,5 2,3 IfH" 4 iO 2 2 RX-0 1 1 0 NOR 3 1 211 1 SRQU-3 IIC 2,5 2,3, 6 4 4 2 4,5 MAJ86 2:2 2 1 TS 2,3 2: 2'0 2 RX 0 1 1 0 NOR 3,7 2 1 1 1 SRQU-4 IIC 1,2, 5 ,4 4 2 4,5, 6 MAJ 8 122 1 TS 1,5 2 i O 2 2 Instructions:
Instructions:
I 1.Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type;TS are not applicable for RO applicants.
Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable- competency for every applican i NUREG-1 021, Revision 9


ROs must service in both the"at-the-controls (ATC)" and"balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IIC)malfunctions and one major transient, in the ATC position:.
ES-301   Competencies Checklist Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test No.: N08-1 APPLICANTS SRO (U/I) RO/ATC  ISOp Competencies  SCENARIO  SCENARIO SCENARIO 5  5  5 Interpret/Diagnose 1,3,5 2,4,6 Events and  2-8 7,8 7,8 Conditions Comply With and Use 1-8 1,3,5  2,4,6 Procedures (1)    7,8 7 Operate Control  NA  1,3,5  2,4,6 Boards (2)    7,8 7 Communicate and 1-8  1-8  1-8 Interact Demonstrate Supervisory Ability 1-8  NA  NA (3)
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the A: TC position.2.Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.S.d)but must be significant per Section C.2.a of Appendix D.(*)ReactiVity and normal evolutions may be replaced with additional instrument or component malfuncti,ons on a 1-for-1 basis.3.Whenever practical, both instrument and component malfunctions should be included;only those that require verifiable that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.NUREG 1021 Revision 9 ES-301 Transient and Event Checklist FINAL Form ES-301-5 Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1 A E Scenarios:!P V 1 2 3 4 T MPE 0: ILN CREW CREW CREW CREW T NIT POSITION POSITION POSITION POSITION A I C L M A T U N Y I M(*)TP S A B S A B S A B S A B R I URT 0RT 0 R T 0 R T 0: E I 0 C P 0 C P 0 C P 0CP RX 0 I 1 1 0: NOR31 211 1 SROU-5 I/C 2,5 2,3, 6'4 4 2 4,5 MAJ 8 6 2'2 2 1 TS 2,3 2 1 0 2 2 RX 7 1: 1 1 0 NOR 1 6 2: 1 1 1 SROI-1 IIC 2,3, 1,4, 1,4 9 4 4 2: 4,5 6 MAJ 6 8 8 3 2 2 1 TS 3,4 2 0 2 2 RX 4 1 1 1 0 NOR 6 1 I 1 1 1 i SROI-2 IIC 2,5 1,2, 7;4 4 2 3,4, I 5 MAJ 6 8 2 2 2 1: TS 3 iO 2 2 3 RX 7 1 2 1 1 0 NOR 1 1 1 1 1 SROI-3 IIC 2,3, 1,4, 4,5 9 ,4 4 2 4,5 6!MAJ 6 8 6 3;2 2 1 TS 3,4 2 0 2 2 Instructions:
Comply With and Use  NA 2,5   NA Tech. Specs. (3)
: 1.Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type;TS are riot applicable for RO applicants.
Notes:
(1) Includes Technical Specification compliance for RO.


ROs must service in both the"at-the-controls (ATC)" and"balance-of-plant (BOP)" positions; Instant SROs must in both the SRO and the ATC positions, including at least two instrument or component (I/C)malfunctions and one major transient, in the ATC position.If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the ATC position.2.Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d)but must pe significant per Section C.2.a of Appendix D.(*)Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.: 3.Whenever practical, both instrument and component malfunctions should be included;only those that require verifiable action's that provide insight to the applicant's competence count toward the minimum requirements specified forthe applicant's license level in the right-hand columns.NUREG 1021 Revision 9 ES-301 Transient and Event Checklist FINAL Form ES-301-5 Facility: McGuire Date of Exam: 5/12/08 Operating No.: N08-1 A E ScenariosPV 1 2 3 4 T: MPE 0 I L N CREW CREW CREW CREW T NIT POSITION POSITION POSITION POSITION A I C L M A T!UNY I M(*)ITP S A B S A B S A B$A B!R I U ERT 0RT 6 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P: RX 4 1 1 1 0 NOR 3,7 1-3'1 1 1 SROI-4 IIC 2,5 1,2, 2,3 9 4 4 2 4,5, 6 I MAJ 6 8 6 3 2 2 1 TS 1,5 2 10 2 2 RX 4 1 1 1 0 NOR 1 1: 1 1 1 RO-1 I/C 2,5 2,3 4 4 4 2 MAJ 6 6 2 2 2 1 TS 0 0 2 2 RX 7 1!1 1 0 NOR 1 1;1 1 1 I RO-2 IIC 1,4, 2,3 5 4 4 2 6 MAJ 8 6 2;2 2 1 TS 0 ,0 2 2 RX 1 1 1 1 0 NOR 3 1 1 1 1 RO-3 IIC 2,5 4,5 4!4 4 2 MAJ 8 6 2;2 2 1 TS 0 0 2 2 Instructions:
(2) Optional for an SRO-U.
: 1.Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type;TS are riot applicable for RO applicants.


ROs must service in both the"at-the-controls (ATC)" and"balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C)malfunctions and one major transient, in the ATC position.If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.2.Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d)but must oe significant per Section C.2.a of Appendix D.(*)Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.;3.Whenever practical, both instrument and component malfunctions should be included;only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.NUREG 1021 Revision 9 ES-301 Competencies Checklist FINAL Form ES-301-6 Facility: McGuire Date of Examination:
(3) Only applicable to SROs.
5/12/08 Operating Test N08-1 APPLICANTS SRO (U/I)ROIATC BOP Competencies SCENARIO SCENARIO SOENARIO123 4 1 2 3 4 1 2 3 4 Interpret/Diagnose 2,4,5 1,4,6 1,4,5 1,4,5 1,3,4 2,q,5 1,2,3 2,3,5 Events and 2-8 1-10 1-8 1-9 6, 7,8, 6,7,8 7,8 7,8 6,8,9 6,7,8 10 6,7,8 6,8,9 Conditions Comply With and Use 1-6, 2,4,51,4,61,4,51,4,5 1,3,4 2,3,5 1,2,3 2,3,5 Procedures (1)1-8 1-10 1-8 8-9 6,8 7,8 6,7 6,8 6,7 7,8, 6,8 6,8,9 1p Operate Control 2,4,5 1,4,6 j,4,5 1,4,5 1,3,4 2,]5 1,2,3 2,3,5 Boards (2)NANANANA 6,8 7,8 6,7 6,8 6,7 7'1 , 6,8 6,8,9 10 Communicate and 1-8 1-10 1-8 1-9 1-8 1-101-81-91-80 1-8 1-9 Interact Demonstrate Supervisory Ability 1-8 1-101-81-9 NA NA NA NANANA NA NA (3)i Comply With and Use 3-4 1,5 2-3 1-3 NA NA NA NA NANA NA Tech.Specs.(3)Notes:: (1)Includes Technical Specification compliance for RO.(2)Optional for an SRO-U.(3)Only applicable to SROs.Instructions:
Circle the applicants'
license type and enter one or more event numbers that will allow the examiners to evaluate every applicable-
competency for every applicant.


i NUREG-1 021, Revision 9 ES-301 Competencies Checklist FINAL Form ES-301-6 Facility: McGuire Date of Examination:
Instructions:
SRO (U/I)5/12/08 Operating Test No.: N08-1 APPLICANTS RO/ATC ISOp Competencies Interpret/Diagnose Events and Conditions Comply With and Use Procedures (1)Operate Control Boards (2)Communicate and Interact Demonstrate Supervisory Ability (3)Comply With and Use Tech.Specs.(3)SCENARIO 5 2-8 1-8 NA 1-8 1-8 2,5 5 1,3,5 7,8 1,3,5 7,8 1,3,5 7,8 1-8 NA NA SCENARIO 5 2,4,6 7,8 2,4,6 7 2,4,6 7 1-8 NA NA SCENARIO Notes: (1)Includes Technical Specification compliance for RO.(2)Optional for an SRO-U.(3)Only applicable to SROs.Instructions:
Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
Circle the applicants'
license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.


NUREG-1 021, Revision 9 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: McGuire Date of Exam: 5/12/2008 Exam Level: RO/SRO Initial 1.2.3.4.Item Descri tion Questions and answers technicalf accurate and a licable to facilit , a.NRC KJAs referenced for all questions.
NUREG-1 021, Revision 9


b.FaciHt learnin ob'ectives referenced as avaifable.
ES-401  Written Examination Quality Checklist  Form ES-401-6 Facility: McGuire  Date of Exam:  5/12/2008 Exam RO/SRO Level:
Initial Item Descri tion Questions and answers technicalf accurate and a licable to facilit , NRC KJAs referenced for all question FaciHt learnin ob'ectives referenced as avaifabl . SRO uestions are a ro riate in accordance with Section D,2.d of ES..401 The sampling process was random and systematic. (If more than 4 RO and 2 SRO questions were repeated from the last 2 NRC licensing exams) consult the NRR OL Pro ram Office Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ _ the audit exam was systematically and randomly developed, or
_ _ the audit exam was completed before the license exam was started. or
_ _ the examinations were developed independently, or
~ the licensee certifies that there is no duplication, or other ex lain 6, Bank use meets limits (no more than 75 percent  Bank Modified New
        ~,
from the bank at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only uesUon distribution s at ri h I 7 13/5 53/13 ~ X Between 50 and 60 percent of the question on the Memo  CIA RO exam are written at the comprehension/
analysis level; the SRO exam may exceed 60  31/ 6 44/19 (JM cl( \"
        ,
percent if the randomly selected KJAs support the higher cognitive levels; enter the actual RO I SRO uesUon distribution s at ri ht Referenceslhandouts provided do not give away answers or aid in the elimination of distractors~
        ~ X- Question content conforms with specific KIA statements in the previously approved Q#4 examination outline and is appropriate for the tier to which they are assigned; deviations are ustifle X '\
v, 1 Question psychometric quality and format meet the guidelines in ES Appendfx ~
1 The exam contains the required number of one-point, multiple choice items; the  ~
total is correct and a rees with value on cover shee Printep Name I Signa r  Date Author  Joseph G. Arsenault  ~f"""""'. __
    ....J.(.L.A#  3/15/2008 Facility. Reviewer (*) NRC Chief Examiner (#) NRC Regional Supervisor Note: * The facility reviewers initials/signature are not applicable for NRC-developed examination # Inde endent NRC reviewer initial items in Column get'; chief examiner concurrence re uired.


SRO uestions are a ro riate in accordance with Section D,2.d of ES..401 The sampling process was random and systematic.(If more than 4 RO and 2 SRO questions were repeated from the last 2 NRC licensing exams)consult the NRR OL Pro ram Office 5.Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies)and appears appropriate:
NUREG-1021 f Revision 9
__the audit exam was systematically and randomly developed, or__the audit exam was completed before the license exam was started.or__the examinations were developed independently, orthe licensee certifies that there is no duplication, or other ex lain Question psychometric quality and format meet the guidelines in ES Appendfx B.The exam contains the required number of one-point, multiple choice items;the total is correct and a rees with value on cover sheet.X (JM cl(\"X-, Q#4 X'\v,Date 3/15/2008 New 53/13 CIA 44/19 13/5 Modified Bank 31/6 Memo The facility reviewers initials/signature are not applicable for NRC-developed examinations.


Inde endent NRC reviewer initial items in Column get';chief examiner concurrence re uired.*#Bank use meets limits (no more than 75 percent from the bank at least 10 percent new, and the rest new or modified);
(\            ~
enter the actual RO I SRO-only 9I7 uesUon distribution s at ri ht.Between 50 and 60 percent of the question on the RO exam are written at the comprehension/
ES-401     Written Examination     Form ES-401-9 Review Worksheet McGuire 2008-301 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
analysis level;the SRO exam may exceed 60 percent if the randomly selected KJAs support the higher cognitive levels;enter the actual RO I SRO uesUon distribution s at ri ht Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;deviations are ustifled.Referenceslhandouts provided do not give away answers or aid in the elimination of Printep Name I Signa r Author Joseph G.Arsenault....J.(.L.A#
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S   Explanation Focus Dis Link units ward KIA Only Instructions
__6, 8.9.10.11.7.a.b.Facility.Reviewer (*)c.NRC Chief Examiner (#)d.NRC Regional Supervisor Note: NUREG-1021 f Revision 9 ES-401 (\Written Examination Review Worksheet McGuire 2008-301Form ES-401-9 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO UlE/S Explanation Focus Dist.Link units ward KIA Only Instructions
    [Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.) Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOO) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the afPropriate box if a~SYChometric flaw is identified:
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.)
* he stem lacks su Icient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).


1.Enter the level of knowledge (LOK)of each question as either (F)undamental or (H)igher cognitive level.2.Enter the level of difficulty (LOO)of each question usinga1-5 (easy-difficult)
* The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
rating scale (questions in the2-4 range are acceptable).


3.Check the afPropriate box if a flaw is identified:
* The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the af~ropriate box if a job content error is identified:
*he stem lacks su Icient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
* e question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).


*The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).*The answer choices are a collection of unrelated true/false statements.
* The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).


One or more distractors is not credible.One or more distractors is (are)partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).4.Check the box if a job content error is identified:
* The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
*e question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).*The question requires the recall of knowledge that is too specific for the closed referencetestmode (i.e., it is not required to be known from memory).*The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).*The questionrequiresreverse logic or application compared to the job requirements.


5.Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
* The question requires reverse logic or application compared to the job requirement . Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).


6.Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
RO/SRO Combined Question
7.At a minimum, explain any"U" ratings (e.g., how the Appendix B psychometric attributes are not being met).RO/SRO Combined Question For system generic KA's, state the system then the generic part (Le.)026G2.2.22 (0 15).Containment Spray/Knowledge of LCD's and Safety Limits.Many of the U's were attributed to non-plausible distractors that could not be supported.
~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (0 15). Containment Spray/Knowledge of LCD's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."


Many of the stems are inconsistent with the use of verbs such as"is and are."
/V(JrfY
        ~)f'/'~ ;Us C4trJ ON &#xa3;~
1 C 3 X  X  X  Y N E 003K1.08 Stem: b> after powe A and make absolutel no sense. What about RN and KC flow to and from the CPs? N Repair distractors A and 0 or explai RFA 03/25/08


;Us C4trJ ON1 C 3 X X X YNE 003K1.08 Stem: b>after power.A and make absolutel N no sense.What about RN and KC flow to and from the CPs?Repair distractors A and 0 or explain.RFA 03/25/08/V(JrfY r-"'.1.12.I 3.P"""omebic FI.ws I 4.Job Co,tent Flews I 5.Oth,,-TS:-I 7.II 0#/1 LOK LOD (CIA)(1-5)I Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO I utE/S I Explanation Focus Dis!.Link units ward KIA Onl 2 I M I 2 I XYN I E 1004K5.46 Distractor B is NOT plausible because ALL know that RCPs operate when the plant is N solid and DP is maintained.
~    r-"'.     ,~
1. 12. I 3. P"""omebic FI.ws I 4. Job Co,tent Flews I Oth,,-TS:-I II 0#/1 LOK LOD I
(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis!.
Job-Link Minutia #1 units Back-ward 0=
KIA SRO I utE/S Onl I Explanation 2 I M I 2 I X  Y N I E 1004K5.46 Distractor B is NOT plausible because ALL a8~licants know that RCPs operate when the plant is N solid and DP is maintained. Replace distractor B RFA 03/25/08 3 I M I 2 I X I I I I I I X I I I Y  005K2.03 Third bullet, need a ver Make this Q a fill in the blank with choices as follows:
A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D. 600V Essential Load Centers 1 CLOSED RFA 03/25/08 4 I C I 3 I I I I I I I X I I I Y I~ The emphasis is on the wrong wor Bold the words
      "increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 I C I 3 I I I I I X I I I I I ~  C is NOT plausible. Change C to "the reactor coolant drain tank." If the\,do figure out that the #1 seal discharges to the CT, the~ will realize that VCT level will not increase if the filter is c 0B~ed. However, thee may NOT realize that reliefs do N dumcR into the R DT, which makes the RCDT a plausible istracto RFA 03/25/08 6 I M I 2 I I I I X I I I I I I Y I N _008K2.02 If B was correct, D would be also If A was correct, C would be als Distractors C and D need the word "ONLY"
-
This Q is U because of two NP distractor RFA 03/25/08 7 I C  I I I I I I I I I Y I~ Verbs missing in bullet This Q has low discriminatory value. Here is a suggested change:
A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU&#xa3;ply breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08


Replace distractor B RFA 03/25/08 3 I M I 2 I X I I I III X III Y 005K2.03 Third bullet, need a verb.Make thisQa fill in the blank with choices as follows: A.600V Unit Load Centers 1 OPEN B.600V Unit Load Centers 1 CLOSED C.600V Essential Load Centers 1 OPEN D.600V Essential Load Centers 1 CLOSED RFA 03/25/08 4 I C I 3 IIIIIII X III YThe emphasis is on the wrong word.Bold the words"increase" and"decrease" and"4-7" and"7-10" RFA 03/25/08 5 I C I 3 III I I X I I I I IC is NOT plausible.
~          ~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S  Explanation Focus Dis Link units ward KIA Only 8 C 3 X   Y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h
with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor RFA 03/25/08 9 C 3     Y N 5 012A3.03 RFA 03/25/08 10 C 2    Y N 5 012K6.03 RFA 03/25/08 11 M 2 X   Y N E 012K4.08 The stem does not read well. There is eather a run on sentence or punctuation is missing. I get lost in i Please re-writ RFA 03/25/08 12 C 3 X   Y N 022A2.03 -
It would appear to be common knowledge from an applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a
      &#xa5;Iausible distracto his Q is U because Band D distractors are not plausibl Show calculation in distractor analysi RFA 03/25/08 13 C 3    Y N 5 025K6.01 RFA 03/25/08 14 M 2  X  Y N 025K5.01 Distractors Band D say the same thing. Replace one of the two distractors. As a result, Band D are NOT
      &#xa5;Iausible. D could ~otential be a subset of herefore this Q is .
RFA 03/25/08


Change C to"the reactor coolant drain tank." If the\, do figure out that the#1 seal discharges to the CT,will realize that VCT level will not increase if the filter is c However, thee may NOT realize that reliefs do N dumcR into the R DT, which makes the RCDT a plausible istractor.
~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S  Explanation Focus Dis Link units ward KIA Onlv 15 C 3  X  Y Y? E 026G2.2.22 o says that the LCO is not applicable,C says the TS will not be entered. What is the difference between 0 and C?
Is this required knowledge for RO applicants since this is NOT a 1 hour TS LCO?
RFA 03/25/08 16 M 2  X  Y N 026K3.02 Because the FWST Lo-Lo level alarm has occurred, distractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FWST leve T IS Q is U because there are two NP distractor RFA 03/25/08 17 C 3 X  X  Y N E 039A4.04 Second Bullet: Normal what supply??
Choices are not complete sentences (generic comment)
RFA 03/25/08 18 C? 2 X  X  Y N E 039K4.07 I think this Q can be answered even if you delete everything above the WOOTF statement. If so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 19 C 2 X  X  Y N E 059A1.03 I think this Q also can be answered even if rou delete
  . ,    everything above the WOOTF statement. I so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 20 C 2  X  Y N 061K3.01 CF and NCPs are not safety related which renders these two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X  X  Y N E 062A3.05 Move "The BO sequencer actuated Train A status light on SI-14" to the stem. Unbold the words "and" and "then."


RFA 03/25/08 6 I M I 2 III I X III I I I Y I N_008K2.02 If B was correct, D would be also If A was correct, C would be also.Distractors C and D need the word"ONL Y" This Q is U because of two NP distractors.
This will un-complicate the choice RFA 03/25/08


RFA 03/25/08 7 I C-II I III III YVerbs missing in bullets.This Q has low discriminatory value.Here is a suggested change: A.The 1 B2 trips on over current OR an event causing containment pressure to increase to 1.5 psig.B.An event causing containment pressure to increase to 1.5 psig ONL Y.C.The normal SU&#xa3;ply breaker to 1 ETB opens OR a leak on the shell si e of the1B KC heat exchanger occurs.D.The normal supply breaker to 1 ETB opens ONL Y.This Q is U because of low discriminatory value.RFA 03/25/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO UlE/S Explanation Focus Dist.Link units ward KIA Only8C3 X Y N 010K1.07 Since Channel 3 high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C combined with choice 1 is plausible.
~
Q#I I LOK I . Psychometric Flaws 4. Job Content Flaws LaD t---,----,;---,--,----t--.,------r----,;------ir--.------I 5. Other I .
(CIA) (1-5)  Partial Job-Link Back-ward Q:= ISRO I UlE/S KIA ani Explanation 22 I C 2 x  x  y N E 1063A1.01 Create a fill in the blank as follows:
Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour B. 2 6 RFA 03/25/08 23 I M 2  x  y N E 1064K6.08 Stem needs verbs and complete sentences RFA 03/25/08 24 I M 2    y N 5 1073A2.01 RFA 03/25/08 25 I M 2      076G2.4.30 The KA is not met. The KA must involve the SW system
      ~ireltl~. In the first bullet, it could be any system NOT Just . The RN system has to have a direct impact on the In fact, you could delete all but the last bullet and still answer the Q This Q is a U because KA not me RFA 03/19/08 '
26 I C      076K3.07 To low discriminatory value. Change answer as follows:
A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV Pump Gear oil will overhea B. ONLY the 2A NV Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat. Additionally, all makeup capability is lost to the 2A DG KD surge tan This Q is a U because the discriminatory value is to lo RFA 03/26/08 27 I C      078G2.4.35 RFA 03/26/08


By itself it will be readil h eliminated.
~          /\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S  Explanation Focus Dis Link units ward KIA Onlv 28 M 2  X  Y N E 103A4.01 Do NOT teach in the stem. Start of with WOOTF...
Then list the valve RFA 03/26/08 29 C 3  X  Y N E 014K4.03 Put "Rod F-2 displayed as" in the ste RFA 03/26/08 30 C 3    Y N 5 017K6.01 RFA 03/26/08 31 C 3    Y N 5 015K2.01 RFA 03/26/08 32 M 2  ?  X  Y N 5? 028K1.01 Why is "decrease" plausible in distractors C and D?
Prove plausibility and Q will be Sa RFA 03/26/08 33 M  X  Y N 029A4.04 Stem: Change "has" to "have" Add Excore SR monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and D to increase discriminatory valu Q is a U because of low D RFA 03/26/08 34 M 2    Y N 5 033K3.01 RFA 03/26/08* .
35 C 3  X  Y N 035A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not
      ~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q is a U because of two NP distractor RFA 03/26/08 36 C 3  X  Y N 041A3.03 If Tave is decreasing, what else would cause it, if there was no steam flow? SU~1gest ~iving them a rod shim because inward rod motion wi! cause a drop in Tav Ri!ilht now distractors A and C are NOT plausible (NP).


They might consider it if it is coupled with cannel 1 failing low.Since the switch is in position 1-4, channel 2 failing high is NOT plausible.
This Q is U because of two NP distractor RFA 03/26/08 37 M 2  X  Y N E 071A1.06 Remove "in" from the ste RFA 03/26/08


A.Channel 1 failing low OR channel 3 failing high B.Channel 1 low ONL Y C.Channel 1 OR cannel 4 failing low.D.channel 4 failing low ONL Y This Q is U because the are two potentially NP distractors.
~          /"\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S  Explanation Focus Dis Link units ward KIA Onlv 38 M 2    Y N S 086K5.03 RFA 03/26/08 39 M  X  Y N 007G2.4.46 Place 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08 40 C 3 X    Y N 008M1.03 I believe that "A" can be a potentially correct answer because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."
As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3    Y N S 009EK2.03 Much better. Now they have to calc Tste RFA 03/26/08 42 M 2  X X  Y N E 011EK3.06 j    Distractor "8" does not read correctly. I think "are isolated" sholild be remove If "0" was correct, "C" would be correct als Need the word "only" in RFA 03/26/08 43 C 3  X  Y N E 015/017M1.16 Move "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 C 3    Y N S 022M2.04 RFA 03/26/08 45 C 3 X  X X  Y N E 025AK2.03 The stem does NOT solicit the effect on the KC syste Re-write the stem to do s Regarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a
      ~osslble correct answe acility please re-evaluat RFA 03/26/08


RFA 03/25/08 9C3 Y N 5 012A3.03 RFA 03/25/08 10C2 Y N 5 012K6.03 RFA 03/25/08 11M2 XYNE 012K4.08 The stem does not read well.There is eather a run on sentence or punctuation is missing.I get lost in it.Please re-write.RFA 03/25/08 12 C 3 XYN 022A2.03-It would appear to be common knowledge from an applicant In training that AP-44 is for flooding in the TB and ASB.I do not believe that this qualifies as a&#xa5;Iausible distractor.
/'.          (\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S  Explanation Focus Dis Link units ward KIA Only 46 C 3  X  y N 51 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy? .
RFA 03/26/08 47 C 3    Y N 5 029EK2.06 RFA 03/26/08 48 M 2  X  Y N E 055EK3.02 The stem has to much fru fru. Re-write the stem as follows:
Which one of the following is the bases for NOT depressuriZin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?
To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level RFA 03/26/08 49 M 2    Y N 5 056AA1.12 RFA 03/26/08 50 C 3   X  Y N E 057AK3.01
  ;1    To be consistent, why not say in D that turbine impulse pressure channel 1 has failed high (just the opposite of
      "C")?
RFA 03/26/08 51 M <2 X  X X  y N E 058AK1.01 Stem: Underline and bold the word minimum Distractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA 03/26/08 52 M 2  X  Y N 062AA2.06
      "D" is also a correct answer the way the Q is written. If
      "A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so other choices cannot be psychometricall eliminate b This Q is U because two distractors can e eliminated by the wa~ the Q is writte RFA 0 126/08


his Q is U because Band D distractors are not plausible.
/'
:.. . 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other I 6. I  7.


Show calculation in distractor analysis.RFA 03/25/08 13C3YN 5 025K6.01 RFA 03/25/08 14M2 XYN 025K5.01 Distractors Band D say the same thing.Replace one of the two distractors.
Q#/I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S  Explanation Focus Dis Link units ward KIA Onlv 53 I C I 3 I    X  Y N E 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08 54 I C I 3 I X I I I ?    E04EK Stem: BrinB containment feressure up to 8.5 psig to make B, C, and more plausib Why has the PRT ruptured? What is dumping into it to cause that?
RFA 03/26/08 55 I C I 3 I I I I X I I I I I I y  E11G2.1.23 ECA-1.1, Step 21 b. RNO states to stop one or more SI
      ~umps while maintaining >1= to flow required by nclosure 9. Therefore, distractor "Au is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 56 I M I 2 I I I I X I I I I I I y I N _E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no
      ~rocedure guidance anywhere that directs thi _i' I I I I I I I I _ his Q is U because all three distractors are flawe RFA'03/26/08 II ;1 57 I C I 3 I I I I I I I I I I y I N I S 1005AA1.02 RFA 03/26/08 58 I M I 2 I I I I X I I I I I I y I N _024AA2.03 Stem: Why all the fru fru? Why not just say:
WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm boration flow rate?
Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is a U RFA 03/26/08


As a result, Band D are NOT&#xa5;Iausible.
~
f\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS  Explanation Focus Dis Link units ward KIA Onlv 59 C <2 X  ?  y N E 032AK1.01 Distractors A and B are week by themselve Change Stem to say:
WOOTF describes the minimum cause of SR N-31 indication?
A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X  X X  Y N E 033M1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "C" and "D" are NOT solicite Re-work distractors A, C, and RFA 03/26/08 61 C 3  X  y N 036AK2.01 Last bullet: This is why verbs an complete sentences are necessaz. Are you saying "a KF pump is operating" or
      "the "A" F pump is operating?"
Whay would the ag~licant think that level is to low when they are told that P level is +0.4 feet? Distractor B is s*    not plausible. No SFP level trend is provided. Therefore,
  \ <    a cavity seal failure is not plausibl Why is "C" correct?
Replace distractors Band D. This Q is U because of two NP distractor RFA 03/26/08 62 M 2  X  Y N E 067M2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the CPo Replace distractor "A."


D could be a subset of B.herefore this Q is.RFA 03/25/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO utE/S Explanation Focus Dist.Link units ward KIA Onlv 15C3 X Y Y?E 026G2.2.22 o says that the LCO is not applicable,C says the TS will not be entered.What is the difference between 0 and C?Is this required knowledge for RO applicants since this is NOTa1 hour TS LCO?RFA 03/25/08 16 M 2 X Y N 026K3.02 Because the FWST Lo-Lo level alarm has occurred, distractors A and B are not plausible.
RFA 03/26/08 63 M 2 X   y N E 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08


For distractors A and B to be plausible, provide information for the to calculate FWST level.T IS Q is U because there are two NP distractors.
~    r---....    ~
1. I Q#/I LOK LOD . Psychometric Flaws I 4. Job Content Flaws ~Othe;-~I II (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q=  Explanation Focus Dis Link units ward KIA 64 I C I 3 I  X  Y N 076AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 65 I C I 3 I I I I I I I I I I y I N E02G2. RFA 03/27/08 66 I M I 2 I I I I I I I I I y N G2.1.18 RFA 03/27/08 67 I M I 2 I I I I X I I I I I ~:
y N G2.1.13 Page 7 of 15 of the attached reference states in part:
Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badeed person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is obviously not true and not plausibl This Q is U until these issues on both these distractors are resolve RFA 03/27/08 68 I C I 3 I X I I I X I I I I I I y G2. There are three actions that could work (B,C, and D).


RFA 03/25/08 17 C 3 X X Y N E 039A4.04 Second Bullet: Normal what supply??Choices are not complete sentences (generic comment)RFA 03/25/08 18 C?2 X X Y N E 039K4.07 I think this Q can be answered even if you delete everything above the WOOTF statement.
The stem needs to be written to isolate one of the j I I I I I I I I _ Currently there are potentially three correct answer This Q is U until resolve RFA 03/27/08 69 I C X I I I X I I I I I I y 1 N _G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27/08 70 I M I 2 I I I I I I I I I I y N G2.2.2.13 RFA 03/27/08 71 I M I 2 I I I I X I I I X I I I y N G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".


If so, delete it.This Q meets the criteria to be an (M)question.RFA 03/25/08 19 C 2 X X Y N E 059A1.03 I think this Q also can be answered even if rou delete., everything above the WOOTF statement.
"c" is also a correct answer. "c" is a subset of "D."


I so, delete it.This Q meets the criteria to be an (M)question.RFA 03/25/08 20 C 2 X Y N 061K3.01 CF and NCPs are not safety related which renders these two distractors NP.Replace these 2 distractors.
This Q is U because of multiple correct answer RFA 03/27/08


This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E 062A3.05 Move"The BO sequencer actuated Train A status light on SI-14" to the stem.Unbold the words"and" and"then." This will un-complicate the choices.RFA 03/25/08 5.Other I 6.Q:=I SRO I UlE/S KIA ani1.I 2.3.Psychometric Flaws 4.Job Content Flaws Q#I I LOK LaD t---,----,;---,--,----t--.,------r----,;------ir--.------I (CIA)(1-5)Partial Job-Back-Link ward 7.Explanation 22IC 23 I M 24IM 2 2 2 x x x y y y N N N E 1063A1.01 Create a fill in the blank as follows: Battery CXA will be lost in_1_hours.Battery CXB will be lost in_2_hours.2 A.2 4 B.26 C.3 4 D.3 6 RFA 03/25/08 E 1064K6.08 Stem needs verbs and complete sentences RFA 03/25/08 5 1073A2.01 RFA 03/25/08 25IM 26IC 27IC 2 076G2.4.30 The KA is not met.The KA must involve the SW system In the first bullet, it could be any system NOT Just.The RN system has to have a direct impact on theQ.In fact, you could delete all but the last bullet and still answer the Q This Q isaU because KA not met.RFA 03/19/08'076K3.07 To low discriminatory value.Change answer as follows: A.ONLY the 2A 1 and 2A2 DG VG Air Compressors AND the 2A NV Pump Gear oil will overheat.B.ONLY the 2A NV Pump Gear oil will overheat.C.ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat.D.The 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat.Additionally, all makeup capability is lost to the 2A DG KD surge tank.This Q is a U because the discriminatory value is to low.RFA 03/26/08 078G2.4.35 RFA 03/26/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO U/E/S Explanation Focus Dist.Link units ward KIA Onlv 28M2 XYN E 103A4.01 Do NOT teach in the stem.Start of with WOOTF...Then list the valves.RFA 03/26/08 29 C 3 XYN E 014K4.03 Put"Rod F-2 displayed as" in the stem.RFA 03/26/08 30C3YN 5 017K6.01 RFA 03/26/08 31 C 3YN 5 015K2.01 RFA 03/26/08 32 M 2?X Y N 5?028K1.01 Why is"decrease" plausible in distractors C and D?Prove plausibility and Q will be Sat.RFA 03/26/08 33 M XYN 029A4.04 Stem: Change"has" to"have" Add Excore SR monitors to choice Bandadd Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and D to increase discriminatory value.Q isaU because of low DV.RFA 03/26/08 34 M 2YN 5 033K3.01 RFA 03/26/08*.35 C 3 XYN 035A2.05 Without giving the applicant a misleading lead in that might a steam leak, Distractors A and B are not urthermore no indication was provided that a ORV was or wasNOTopen that would potentially steer them to AP-001.Q isaU because of two NP distractors.
~
          ~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 72 C <2 X  ?  y N E G2. th bullet: Drop "return via the same ~ath." This is implied and will add to the discriminatory va u Stem: Underline and bold maximu Choices: Delete "no longer than."


RFA 03/26/08 36 C 3 XYN 041A3.03 If Tave is decreasing, what else would cause it, if there was no steam flow?
Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa RFA 03/27108 73 C 3     Y N S G2.3.11 RFA 03/27108 74 M 2  X  Y N G2.4.17 Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27108 75 C <2 X  ?  y N E G2.4.14 Change heat sink to an orange path too. As is, the
them a rod shim because inward rod motion wi!cause a drop in Tave.Ri!ilht now distractors A and C are NOT plausible (NP).This Q is U because of two NP distractors.
      ~uesbon has marginal discriminatory valu FA 03/27108 SROONLY X
  .. X  Y Y E 009G2.1.27
          /
76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....
RFA 03/19/08 77 C 3 X  X  Y Y E 026G2.1.25 Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....
A. 1.50 GPM 2. Isolate KC ...
Which references will be provided?
RFA 03/19/08


RFA 03/26/08 37 M 2 XYN E 071A1.06 Remove"in" from the stem.RFA 03/26/08/\
~
1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO U/E/S Explanation Focus Dist.Link units ward KIA Onlv 38M2YN S 086K5.03 RFA 03/26/08 39 M XYN 007G2.4.46 Place 1 of the channels that require 2/4 to trip the reactor below the limit.Set it up so 2 reactor trips are in.Add a second annunciator to each choice such that the correct answer has two valid two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are in.This Q isaU because of low Discriminatory Value.RFA 03/19/08 40 C 3 XYN 008M1.03 I believe that"A" can be a potentially correct answer because one can manually stabilize or maintain a CD rate by adjusting the pot
:. . 3. Psychometric Flaws 4. Job Content Flaws 5.0the~. I  7.
..To ensure that"A" is not an option state in the WOOT statement".....describes the action, as stated in ES-1.2, that will..." As is, this Q is U because there are potentially two correct answers.RFA 03/26/08 41C3YN S 009EK2.03 Much better.Now they have to calc Tstem.RFA 03/26/08 42M2 X XYN E 011EK3.06 j Distractor
"8" does not read correctly.


I think"are isolated" sholild be removed.If"0" was correct,"C" would be correct also.Need the word"only" in C.RFA 03/26/08 43 C 3 X Y N E 015/017M1.16 Move"Initial reactor power was" to the stem.It will read easier.RFA 03/26/08 44C3 Y N S 022M2.04 RFA 03/26/08 45C3 X X XYN E 025AK2.03 The stem does NOT solicit the effect on the KC system.Re-write the stem to do so.Regarding"C": If the KC system continues to HU, will the NC system eventually start to HU?If so, this may be a correct answer.acility please re-evaluate.
0#/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0=  Explanation Focus Dis!. Link units ward KIA 78 I C I 3 I X    Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete "when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 791 C I 3 I I I I I I I X I I I Y 055EA2.03 The reference document provided does NOT sUfPort the use of Enclosure 9, energizing Unit 1 from Unit .
However, the use of AP-7 is (see step 4 RNa of E-O.)


RFA 03/26/08/"\
Please re-evaluat RFA 03/20108 80 I C I 3 I I I I I I I X I I I Y I~ Remove (;) from all choices and align C and D wmer3enc7c is to far to the left)
/'.1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO UlE/S Explanation Focus Dist.Link units ward KIA Only 46C3 X y N 51 027AK1.03 FAC demonstrate how you arrived at this.Did you factor in constant enthalpy?.RFA 03/26/08 47 C 3YN 5 029EK2.06 RFA 03/26/08 48 M 2 XYN E 055EK3.02 The stem has to much fru fru.Re-write the stem as follows: Which one of the following is the bases for NOT the SG's to<110 psig as stated in ECA-0.0, Loss ofaI AC Power?To avoid A.voiding in the head B.an inadvertent criticalit h accident C.nitrogen injection intote RCS D.the loss of SG narrow range level RFA 03/26/08 49 M 2YN 5 056AA1.12 RFA 03/26/08 50C3 X Y N E 057AK3.01;1 To be consistent, why not say in D that turbine impulse pressure channel 1 has failed high (just the opposite of"C")?RFA 03/26/08 51 M<2 X X X y N E 058AK1.01 Stem: Underline and bold the word minimum Distractors:
FA 0 12008 81 I C I 3 I I I I X I I I I I I Y IY _ 058G2.2.37 If D was correct, B would be also. Therefore D is NOT r.lausible
Bold 1 and 4 and automatically and manually.The level of difficulty is marginal.Therefore, incorporate auxiliary battery criteria into the choices too.RFA 03/26/08 52 M 2 X Y N 062AA2.06"D" is also a correct answer the way the Q is written.If"A" was correct,"C" would also be correct.Add words to the stem to isolate the correct answer so other choices cannot be psychometricall b eliminated.
  /1'1 I I 1 1 I I I I _ f C was correct, A would be also. Therefore C is NOT plausibl Stem: Need to rewrite stem to include the word
      'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 82 I C I 3 I I I I X I I I I I I Y I Y _003M2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is cleari that you could have a significant delta between turbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not
      ~ausibl edesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 11 RFA 03/20108


This Q is U because two distractors can e eliminated by thethe Q is written.RFA 0 126/08 (\  
*.
/':..I 5.Other 1.12.3.Psychometric Flaws I 4.Job Content Flaws I 6.I 7.Q#/I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO UlE/S Explanation Focus Dist.Link units ward KIA Onlv 53 I C I 3 I XYN E 065AA2.08 The reason for the trip is NOT solicited.
~
          /\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S Explanation Focus Dis Link units ward KIA Only 83 C 3  X  Y Y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated and the second part to reflect the sam This Q is a U because twodistractors are N RFA 03/21/08 84 M    y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include </= to 3 rem WB and </= 10 rem orga This Q is a U because the discriminatory value is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 85 C 3    Y Y 5 E06G2.1.20 RFA 03/21/08 86 C 3     y y 5 010A2.01 RFA 03/21/08 87 C 3  X  Y Y 026A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of
  ,    the wording "... Do NOT perform ..."Use the "if' statement in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto II


Remove the reasons form all choices.C is still the correct answer because the word FIRST I used in the stem.RFA 03/26/08 54 I C I 3 I XIII?E04EK1.2 Stem: BrinB containment feressure up to 8.5 psig to make B, C, and more plausib e.Why has the PRT ruptured?What is dumping into it to cause that?RFA 03/26/08 55 I C I 3 III I X IIII I I y E11G2.1.23 ECA-1.1, Step 21 b.RNO states to stop one or more SI while maintaining
All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 88 C 3 X  X  Y Y E 061G2. Stem: Change WR level to 30% ACC. This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are of RFA 03/41/08 89 M 2  X Y Y E 073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?
>1=to flow required by nclosure 9.Therefore, distractor"Au is also a correct answer.Replace distractor A.Distractor D is NOT an action.Additionally, D has a reason where the other choices do not.Replace distractor D.This Q is U because two choices are flawed.RFA 03/26/08 56 I M I 2III I X I IIIII y I N_E12G2.1.20 Even though Band C are incomplete, they are still correct as it stands.I do not believe that D is plausible because there is no guidance anywhere that directs this._i'IIIIIIII_his Q is U because all three distractors are flawed.II;1 RFA'03/26/08 57 I C I 3 IIIIIIIIII y I N I S 1005AA1.02 RFA 03/26/08 58 I M I 2III I X IIII I I y I N_024AA2.03 Stem: Why all the fru fru?Why not just say: WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm boration flow rate?Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gpm.As is, B,C, and Dare NP.Therefore this Q isaU RFA 03/26/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utEIS Explanation Focus Dist.Link units ward KIA Onlv 59 C<2 X?y N E 032AK1.01 Distractors A and B are week by themselves.
RF 03/21/08 90 C 3 X  X  Y Y E 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108


Change Stem to say: WOOTF describes the minimum cause of SR N-31 indication?
~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
A.Control Power fuse failure OR Instrument Power Fuse failure.B.Control Power fuse failure AND Instrument Power Fuse failure.C.As is D.As is RFA 03/26/08 60M2 X X XYN E 033M1.02 Distractor"A" in and of itself, is also a correct answer as written.The"ensure" statement in"C" and"D" are NOT solicited.
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S  Explanation Focus Dis Link units ward KIA Only 91 C 3    Y Y S 015G2. RFA 03/24/08 92 C 3  X  Y Y 028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:
A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen flamma ilit D. Similar but change to hydrogen recombine This Q is a U because of 2 NP distractor RFA 03/24/08 93 C 3  X  Y Y E 079A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2  X X Y Y E G2.1.35 Distractor D is not plausible because it is common knowledge that RE's are a technical oversite position with no "permissive" authorit Change choices as follows (example): Shift manager OR Fuel handling SRO Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY RFA 03/24/08 95 M 2  X  Y Y E G2. Stem: Change "who is" to Which one of the following is responsible...
Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08


Re-work distractors A, C, and D.RFA 03/26/08 61C3 X y N 036AK2.01 Last bullet: This is why verbs an complete sentences are necessaz.Are you saying"a KF pump is operating" or"the"A" F pump is operating?" Whay would the think that level is to low when they are told that P level is+0.4 feet?Distractor B is s*not plausible.
*. ~. . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UtEIS  Explanation Focus Dis Link units ward KIA Only 96 C 3  X  Y Y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3  X  Y Y E G2.3.14 There is no mention of gross specificity in the stem. Why is shutdown and cooldown to < 500 F plausible?
CAF RFA 03/24/08 98 M 2  X   Y Y E G2. The Q is NOT balanced and renders D not plausible. Re-write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to afcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3  X  Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or acquire Tave by some other means. Otherwise, distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X  X  Y Y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewrite distractors to reflect thi RFA 03/24/08


No SFP level trend is provided.Therefore,\<a cavity seal failure is not plausible.
*.
* Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA


Why is"C" correct?Replace distractors Band D.This Q is U because of two NP distractors.
ES-401      Written Examination    Form ES-401-9 Review Worksheet McGuire 2008-301 0#1 I LOK LOD . Psychometric Flaws  4. Job Content Flaws  5. Other I .
(CIA) (1-5)  Partial Job-Link Minutia I #1 units Back-ward 0=
KIA I SRO Only I UlE/S  Explanation Instructions
    [Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.] Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the appropriate box if a psychometric flaw is identified:
  * The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).


RFA 03/26/08 62M2 X Y N E 067M2.12 Why is distractor"A" plausible?
* The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
in the stem remotely indicates a problem with the CPo Replace distractor"A." RFA 03/26/08 63 M 2 X y N E 069AK3.01 Distractor D has nothing to do with a rad release offsite.Replace distractor D.RFA 03/26/08 f\
r---....1.I 2.3.Psychometric Flaws I 4.Job Content Flaws 7.II Q#/I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=Explanation Focus Dist.Link units ward KIA 64 I C I 3 I X Y N 076AK2.01 If"B" was correct,"A" would be also.If ECCS was actuated, would it cause a crud burst?If so, replace this distractor.


This Q isaU due to multiple distractor issues.RFA 03/26/08 65 I C I 3 IIII IIIII I y I N E02G2.4.8 RFA 03/27/08 66 I M I 2IIIIIIIII y N G2.1.18 RFA 03/27/08 67 IMI2IIIIX IIII I y N G2.1.13 Page 7 of 15 of theattachedreference states in part: Visitors needing to enter a vital area must be escorted by an authorized individual.
* The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
  * The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).


This leads me to believe that a badeed person in a protected area could be"escorted" Into a vital area.If this IS true then"B" is also a correct answer.Please re-verify this."D" is obviously not true and not plausible.
* The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).


This Q is U until these issues on both these distractors are resolved.RFA 03/27/08 68 I C I 3 I X I IIX III I I I y G2.1.8 There are three actions that could work (B,C, and D).The stem needs to be written to isolate one of them.j III IIII I_Currently there are potentially three correct answere.This Q is U until resolved.RFA 03/27/08 69 I C-X I I I X I I I III y1N_G2.2.40 100 F is more common then 200 F.Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answer.Currently, this Q is U because it has no discriminatory value.RFA 03/27/08 70 IMI2II IIIII III y N G2.2.2.13 RFA 03/27/08 71 I M I 2 I I I I X III XII I y N G2.2.6 If"B" was correct,"A" would be correct also."A" is a subset of"B"."c" is also a correct answer."c" is a subset of"D." This Q is U because of multiple correct answers.RFA 03/27/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utE/S Explanation Focus Dist.Link units ward KIA Only 72 C<2 X?y N E G2.3.4 4 th bullet: Drop"return via the same This is implied and will add to the discriminatory va ue.Stem: Underline and bold maximum.Choices: Delete"no longer than." Currently this Q is just a number cruncher and has low discriminatory value.Modify the 4 th bullet as suggested for an S rating.FACILITY make sure this is not on Admin exam.RFA 03/27108 73C3YN S G2.3.11 RFA 03/27108 74 M 2 XYN G2.4.17 Increase the discriminatory value of distractors Band C.They are to obvious that they are just instrument failures.Possibly add some coincidence logic to them.Q is U because of 2 NP distractors RFA 03/27108 75 C<2 X?y N E G2.4.14 Change heat sink to an orange path too.As is, the has marginal discriminatory value.FA 03/27108 SROONLY 76C3 X..XYY E 009G2.1.27 Stem: Describes (1)the next procedure...and (2)the TS basis for FWST minimum volume for this event.Stem:
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
FWST level to 220 inches to make the transition to S-1.3 more plausible.


A.1.ES-1.2, Post LOCA Cooldown and Depressurization 2.Ensures.....RFA 03/19/08 77C3 X XYY E 026G2.1.25 Stem;WOOTF describes (1)...and (2)the required action per AP121,....A.1.50 GPM 2.Isolate KC...Which references will be provided?RFA 03/19/08/  
The question requires reverse logic or application compared to the job requirement ca Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
:.
II At. m'o'm,m, ...moo", 'U" m'o" (*., .. how ~""""'" B "><h~- otbi',""re o~ "'0' ""'). tAJ4) .r1J  C RO/SRO Combined Question
1.12.3.Psychometric Flaws 4.Job Content Flaws I 7.0#/1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=Explanation Focus Dis!.Link units ward KIA 78 I C I 3 I XYY 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 thenyouwould NOT transition to E-O.Rewrite A and B to eliminate ambiguity.
~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (Q 15). Containment Spray/Knowledge of LCO's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."


C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directed.Delete"when directed, exit FR-S.1" C.State"continue performance of Enclosure 2" D.State"terminate performance of Enclosure 2" This Q is U because of 2 NP distractors.
I
          ,
          /    ._- -.."--
C 3 x  x  x  y N  003K1.08 Stem: (,) after powe A and D make absolutely no sense. What about RN and KC flow to and from the NCPs?
Repair distractors A and D or explai RFA 03/25/08
" . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS  Explanation Focus  Dis Link units ward KIA Onlv /
      [/
2 M 2  X  Y N Ey' 004K5.46 Distractor B is NOT plausible because ALL a8Plicants know that RCPs operate when the plant is N T solid and DP is maintained. Replace distractor B RFA 03/25/08 3 M 2 X  X  Y N E k5b5K2.03 V Third bullet, need a ver Make this Q a fill in the blank with choices as follows:
  .      A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D':f;~8:V Essential Load Centers 1 CLOSED RF 3/25/08 4 C 3    X  Y N E y klO6A4.01 The emphasis is on the wrong word. Bold the words
      "increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 C 3  X  Y N E K>07A3.01
      .; C is NOT plausibl Change C to "the reactor coolant drain tank." If the'Vdo fi~re out that the #1 seal discharges to the. CT, t e~ will realize that VCT level will not increase if the filter is c 0g~ed. However, thee may NOT realize that reliefs do N dumcft into the R DT, which makes the RCDT a plausible istracto RFA 93/25/08 6 M 2 X  Y N 8K2.02 If B was correct, D would be also E If A was correct, C would be als Distractors C and D need the word "ONLY" This Q is U because of two NP distractor RFA 03/25/08 (1 C    Y N 8K4.01 erbs missing in bullet This Q has low discriminatory value. Here is a suggested
      -_.- - ~hang~:____ .~ .. ..-  .... - .. ~ . .- _._ .. --  ._-    ___... *
A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU~PIY breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08
~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LaD (CIA) (1-5) Stem Cues TIF Credo Partial Job- Minutia #1 Back- 0= SRO utEIS  Explanation Focus Dis Link units ward KIA Only  /
<D c 3  X  y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C
.      combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h
with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor R~A 03/25/08 9 C 3    Y N SJI 012A3.03 RF~3/25/08 10 C 2    Y N SJ..- ~2K6.03 RFA 03/25/08 11 M 2 X    Y N EV ~2K4.08 The stem does not read wel There is eather a run on sentence or punctuation is missing. I get lost in i Please re-wnt RFA 03/25/08 12 cl 3  X  Y -~  A2.03 t would appear to be common knowledge from an
            .r
      &#xa3; applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a
      &#xa5;Iausible distracto his Q is U because Band D distractors are not plausibl ~w calculation in distractor analysi FA 03/25/08 13 C 3    Y N 025K6.01
-- ~ . ~--
  - -_ . .  - -....  ~- -~ ---- RFA 03/25/08 --  _.- ~ .. ,.
14 M 2  X  Y N 0 K5.01 istractors Band D say the same thing. Replace one of ( the two distractors. As a result, Band D are NOT
      &#xa5;Iausible. D could ~otential be a subset of herefore this Q is .
RFA 03/25/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO U/E/S  Explanation Focus  Dist. Link units ward KIA Onlv 15 C 3    X  Y II Y? 17 E le26G2.2.22
      ,.
      'a .~ d'
      ~'
      ~
Iv D says that the LCO is not applicable,C says the T5 will not be entered. What is the difference between D and C?
      ~ ~
      ~
Is this required knowledge NOT a 1 hourT RFA 03..&#xa3;25/08 -[};;::7 RO applicants since this is
~ M 2  X  Y N le o02 cause the FW5T Lo-Lo level alarm has occurred, istractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FW5T leve T IS~? U because there are two NP distractor RFA 0 /25/08 t ~~4.04 17 C 3 X  X  Y N E P    . econd Bullet: Normal what supply??
  "( ./      c~~s are not complete sentences (generic comment)
  ,/ :1115
  ,
RF 3/25/08  A


RFA 03/19/08 791 C I 3IIIIIII XII I Y 055EA2.03 The reference document provided does NOT sUfPort the use of Enclosure 9, energizing Unit 1 from Unit.However, the use of AP-7 is (see step 4 RNa of E-O.)Please re-evaluate.
./
;; V? X  X  Y N ' EJ/ '-&39K4.07  ,.JP-J ~ It I think this Q can be answered even if you delete RFAO 5/08 ,~ 7 ~aJ W
everything above the WOOTF statement. If so, delete i This ~ets thejteria to be an questio Y~
      ~
19 C 2 X  X  Y 59A1.03
          , even if II I ink this Q also can be answered e rything above the WOOTF statemen ,r Th Q meets the criteria to be an (M) questio ou delete so, delete i RFA 93/25/08 20 C 2  X  Y N  61K3.01 CF and NCPs are not safety related which renders these E  two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X  X  Y N E ~3.05
- .... ~-
_.. - " ... ._-- .~. -  - -- _....
p
        'The.OO seqllencer 8cb !8ted.Irain A .,t",...., I;nht nn 51-14" to the stem. Unbold the words "and" and "then."


RFA 03/20108 80 I C I 3IIIIIII X I I I YRemove (;)from all choices and align C and D wmer3enc7c is to far to the left)FA 0 12008 81 I C I 3III I X IIIII I Y IY_058G2.2.37 If D was correct, B would be also.Therefore D is NOT r.lausible
This will un-complicate the choice RFA 03/25/08
/1'1II11IIII_fC was correct, A would be also.Therefore C is NOT plausible.
    ..


Stem: Need to rewrite stem to include the word'minimum" This Q is rated U because of 2 non plausible distractors.
1. I . Job Content Flaws 5. Other I .
0#/1 LOK LOD (CIA) (1-5) Partial Job-Link Back-ward 0=
KIA I SRO I UlE/S Onl Explanation 22 I C 2 x  X  y N 63A1.01 Create a fill in the blank as follows:
Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour A. 2 4 B. 2 6 RFA 03/25/08 23 M 2  X  y N 24 M 2    Y N RFA 03/25/08
,r M 2  -L(  ~  076~~,~.1/
The A is not met. The KA must involve the SW ~stem
      ~ire~I~. In the first bullet, it could be any system Just
      ~eQ    t:=
      . The RN system has to have a direct impact on In fact, you could delete all but the last bullet and answer the Q This Q is a U because KA not me RFA 03/19/08 D
OT Ii I ~ ~
fFI
          *
t1/ f .~
    ~07~;
Change answer as follows:
A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV pume Gear oil will overhea B. ONLY the 2A N Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear
  ....__ .... _ * - _ _ _ *1 _____
    , ,
oil will overheat. Additionally, all makeup capability is-1ost1u tile 2A DG KD--surge Lall ...- - -
_ '~w'_' __
This Q is a U because the discriminatory value is to lo ~08 Y I N . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S  Explanation Focus Dis Link units ward KIA Onlv  -'
28 M 2  X  Y N V ~3A4.01 D~T teach in the stem. Start of with WOOTF ...
The 'st the valve RE 03/26/08 29 C 3  X  Y N E}' 014K4.03 Put "Rod F-2 displayed as" in the ste R~ 03/26/08 30 C 3    y N ~~ /017K ~~I RFA 0 126/08 t;
        /'
l-
      ~l- RFA 031
      ,7 31 C 3    Y N ,o'15K2~
I- ~  708 32 M 2 7  X  y N 57 l ~.01 hy is "decrease" plausible in distractors C and D?
Prove Plausibility~Q will be Sa RFA 03/26/08
~ M  X  Y N 0 1\4.04 tem: Chan~e "has" to "have" Add Excore R monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and 0 to increase discriminatory valu ~ U because of low D R 03/26/08 34 Y N ~/ 033K3.01 I      RFA 03/26/08 35 C 3  X  Y N  5A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not
      ~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q iS9~ because of two NP distractor RFA 3/26/08
~ \.J
  . ---,._ ..
A
  ---_ .. -_._- ~- . --y-  A3:03---  ..* _-_ .....
~ "      If Tave is decreasing, what else would cause it, if there was no)'team flow? SUli1gest fiiving them a rod shim becalJse inward rod motion wil cause a drop in Tav Ri99t now distractors A and C are NOT plausible (NP).


A stem correction will validate distractors C and D.RFA 03/20108 82 I C I 3III I X I III I I Y I Y_003M2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input.It does have an affect on the magnitude but the reference is cleari that you could have a significant delta between turbine and nuclear power and NOT have a mismatch.The mismatch is clearly a function of Tave vs Tref.Therefore, This Q is U because distractors Band C are not edesign the Qaskwhat provides the anticipatory signal and that would be the power mismatch input.Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 11 RFA 03/20108
This Q is U because of two NP distractor RFA 03/26/08 37 M 2  X  Y N I/, 071A1.06 Remove "in" from the ste RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. other .
*.1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO utE/S Explanation Focus Dist.Link units ward KIA Only 83C3 XYY 033AA2.05 N-35 being"under-compensated" is not plausible compared to N-36.If N-35 were over-compensated, the indicated power level would read lower than actual power level.Change distractors Band D to read N-35 is over-compensated and the second part to reflect the same.This Q isaU because twodistractors are NP.RFA 03/21/08 84 M y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include</=to 3 rem WB and</=10 rem organ.This Q isaU because the discriminatory value is to low.Additionally, without both parts this is NOT SRO only.RFA 03/21/08 85 C 3YY 5 E06G2.1.20 RF A 03/21/08 86C3 y y 5 010A2.01 RFA 03/21/08 87 C 3 XYY 026A2.03 Change Cntmt pressure to 13 psig.This makes the path more plausible.
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S  Explanation Focus Dis Link units ward KIA Only  /
38 M 2    Y N sf,-- V086K5.03
      ..-- RFA 03/26/08 39 M  X   Y G2.4.46 lace 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08  I
            ..1. - A
            ~ b t 40 C 3 X    Y
      ;:  008AA1.03  ~ile., ~
I believe that "A" can be a pot tially corr. ct answer
      -  because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."
As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3    Y N jY ~9EK2.03Much bette Now they have to calc Tste RFA 03/26/08 42 M 2  X X  Y N E 011EK3.06 L ~:actor "S" does not read correctly. I think "are
        . olated" should be remove If "0" was correct, "C" would be correct als Need the word "only" in ,
RFA 03/26/08
        ~17AA1.16
      ~
43 C 3  X  Y N ove "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 r. .. _ 3.._ .  -~._--  --- ~_.-
      ----- y 1\1. +~V' Q22AA204  .-- ._ .. _-- ---- _.... -
f,/ RFA 03/26/08 45 C 3 X  X X  Y N E i$03 Th tern does NOT solicit the effect on the KC syste t -write the stem to do s egarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a
        ~ossible correct answe acility please re-evaluat RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S   Explanation Focus Dis Link units ward KIA Only I,.;
46 C 3    X  Y Nt lA1 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy?
IRFA 03/26/08 47 C 3      Y N tJI' 029EK2.06 RF~ 03/26/08 X  Y N k555EK3.02 V
48 M 2 The stem has to much fru fru. Re-write the stem as follows:
Which one of the following is the bases for NOT depressurizin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?
To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level Rij\ 03/26/08 49 M 2      Y N
      !Y' 056AA1.12 RFA 03/26/08
      ~
50 C 3    X  Y N -057AK3.01
,      , I To be consistent, why not say in 0 that turbine impulse p,ressure channel 1 has failed high Oust the opposite of
        ~.>? FA 03/26/08 51 M <2 X  X  X  Y N
      ,/ 058AK1.01 Stem; Underline and bold the word minimum Oistractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA033P108
~    ~
/
  -- - .--- .. --- ._. --  "I
      - . ---  .. .. _--  -_ .. -- --
~
M 2  X JL ~  Y N 2AA2.06 (Ii.. ~;r
        "0" is also a correct answer the way the Q is written. If
~  I~  )l f IT ..
      ~
        "A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so I~
other choices cannot be psychometricall eliminate b t CtJ tIP This Q is U because two distractors can e eliminated by the wa~ the Q is writte ,~
      "
or  RFA 0 126/08
    - ., ywv
    ,-,
    ,,J


The actions in"A" are a subset of th"All" the actions in B and D.If B or D was correct, A could be also.The second part of Band D are not plausible because of , the wording"...Do NOT perform..."Use the"if'statement 1 in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distractor.
    * .... .
I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws r-;Qther I .
Q#I LOD I
(CIA) (1-5) Stem Cues T/F Credo Partial Focus  Dis Job- Minutia Link
    #1 units Back-ward Q= I SRO I U/E/S KIA Explanation 53 I C I 3 I    X  Y 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08  .
54 I C 3 X  ?    y E04EK Stem: Bring containment pressure up to 8.5 psig to make B, C, and D more plausibl Why has the PRT ruptured? What is dumping into it to cause that?
RFA 03/26/08 55 I C 3  X    E11G2.1.23 ECA-1.1 ,Step 21 b. RNO states to stop one or more SI pumps while maintaining >1= to flow required by Enclosure 9. Therefore, distractor "A" is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 5611 M 2  X    y E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no procedure guidance anywhere that directs thi This Q is U because all three distractors are flawe *. I    RFA 03/26/08 57 I C I 3 5 M 2  X    ~<tAA2.03 Stem: Why all the fru fru? Why not just say:
WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm
  ... _.- *. _- I I I _ul'_" +-- I I***u ... -~----+----1
        ~9.r~tiQn flow rate?  _
Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is aU RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LaD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S  Explanation Focus Dis Link units ward KIA Only 59 C <2 X  ?  y N l/ 032AK1.01 Distractors A and B are week by themselve Change Stem to say:
WOOTF describes the minimum cause of SR N-31 indication?
A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X  X X  Y N l, / 033AA1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "c" and "D" are NOT solicite Re-work distractors A, C, and R~03/26/08 61 C 3  X  Y N 036AK2.01 Last bullet: This is why verbs an complete sentences are
      /" necessaz. Are you saying "a KF pump is op~rating" or
      "the "A" F pump is operating?"
      ~
Whay would the ag~licant think that level is to low when C-(
C  they are told that P level is +0.4 feet? Distractor B is n0j. plausible. No SFP level trend is provided. Therefore, a avity seal failure is not plausibl Why is "c" correct?
Replace distractors Band D. This Q is U because of two
          ,y NP distractor RFA 03/26/08 62 M 2  X  y ~ E 067AA2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the C Replace distractor "A."


All the distractors need to be re-written.
RFA 03/26/08
...  - .- -  ..  -. ..
63 M 2  X  Y Nt- / 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08


This Q isaU because of two or more NP distractors.
....  ... ... .. .. -  .... .. ..  .......  ... .. .. . ....  . ..... . 3. Psychometric Flaws  4. Job Content Flaws I  7.


RFA 03/21/08 88 C 3 X XYY E 061G2.4.4 Stem: Change WR level to 30%ACC.This will make B more plausible.
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial  Job- Minutia #1 Back" Q=    Explanation Focus Dis Link  units ward KIA B~~II C I 3 I  X    y AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 1 15 i 65 C 3     Y 66 M 2      Y 67 M 2  X   y  G2.1.13 Pa!ile 7 of 15 of the attached reference states in part:
Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badged person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is ObviouSlil not true and not plausibl This Q is U un II these issues on both these distractors are resolve RFA 03/27108 08'-' C I 3 I X I I I X I I I I I I y IIbl _G2. There are three actions that could work (B,C, and D).


Stem: Have CA pumps running but not able to generate flow>450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are off.RFA 03/41/08 89M2 XYY E 073G2.2.22 75 GPD leakage is NOT supported by the attached ref material.WhX is 30 GPD plausible?
The stem needs to be written to isolate one of the :,      Currently there are potentially three correct answer \I .. I I I I I I I I I V" _
RF 03/21/08 90 C 3 X XYY E 076A2.02 Stem: Only train"B" SI actuated.Delete bullet#5.Explain Why<the A EDG does NOT overheat.RFA 03/2108/\II 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utE/S Explanation Focus Dist.Link units ward KIA Only 91 C 3YY S 015G2.1.7 RFA 03/24/08 92 C 3 X Y Y 028A2.03 The step requires an action.In this case,"do NOT" statements are NOT plausible.
This Q is U until resolve RFA 03/27108 69 I C  X I I I X I I I I I I y I t'i _ G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27108
- M __ . .. . '--'  --- ._- --~ . _. __ . -  --_. .... _~.-
II -~- .... __ ..-
70 M 2      Y
.71) M 2  X  X Y G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".


Change distractors A and D to"only" statements as follows: A.Placehydrogenignitor in service ONL Y, because recomblner operating temperatures may cause a to containment Integrity due to hydrogen flamma ility.D.Similar but change to hydrogen recombines.
"c" is also a correct answer. "c" is a subset of "D."


This Q isaU because of 2 NP distractors.
This Q is U because of multiple correct answer RFA 03/27108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS  Explanation Focus Dis Link units ward KIA Only ,/
72 C <2 X  ?  y Nil
      /E G2. th bullet: Drop "return via the same path." This is implied and will add to the discriminatory valu Stem: Underline and bold maximu Choices: Delete "no longer than."


RFA 03/24/08 93 C 3 X Y Y E 079A2.01 Do NOT teach in distractors.
Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa .... RFA 03/27/08 73 C 3     Y N ~ G2.3.11 RFA 03/27/08 II M 2  X   Y N  G2.4.17 .
Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27/08 75 C <2 X  ?  y N E G2.4.14 Change heat sink to an orange path too. As is, the
        ~uestlon has marginal discriminatory valu FA 03/27/08 SRO ONLY I'    ,I X,  X  y y E l- 009G2.1.27 76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....
RFA 03/19/08
. 7f v .:> -x---- ..... .-.. - _.-. - J\ ---- "'y T t: J,
        ~6(32:t:25  -- - - - - - - - - - - - - . ,
Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....
A. 1.50 GPM 2. Isolate KC ...
Which references will be provided?
RFA 03/19/08


State that 1 VI-820 is either open or closed and delete the reason from all 4 choices.Furthermore, the stem does NOT solicit the reason just the position.RFA 03/24/08 94M2 X XYY E G2.1.35 Distractor D is not plausible because it is common knowledge that RE's are a technical oversite position with no"permissive" authority.
  * "1" ._  - .. , .- -- - . -- I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other 1 .
Q#I LOD I
(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis Job-Link Minutia #1 units Back-ward Q=
KIA SRO I U/E/S Onl Explanation 8" C I 3 I  X   Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete ''when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 79 I C 3    X  y y 055EA2.03 The reference document provided does NOT support the use of Enclosure 9, energizing Unit 1 from Unit However, the use of AP-7 is (see step 4 RNO of E-O.)


Change choices as follows (example):
Please re-evaluat RFA 03/20108 80 I C 3    X  y y 056AA2.18 Remove (;) from all choices and align C and D (Emergency is to far to the left)
A.Shift manager OR Fuel handling SRO B.Fuel handling SRO ONLY C.Refueling Supervisor OR Fuel handling SRO D.Refueling Supervisor ONLY RFA 03/24/08 95 M 2 X Y Y E G2.2.7 Stem: Change"who is" to Which one of the following is responsible
RFA 03/20108 81 I C 3  X   y y 058G2.2.37 If D was correct, B would be also. Therefore D is NOT plausible
...Reason: The original Q does not read well.I had to read it 3 times before I could figure out what was being asked.RFA 03/24/08
  ,J      If C was correct, A would be also. Therefore C is NOT plausibl .T Stem: Need to rewrite stem to include the word
*.1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO UtEIS Explanation Focus Dist.Link units ward KIA Only 96 C 3 XYY G2.2.22 It is common knowledge that PORVs are not credited in accident analysis.Replace distractors C and D.This Q is U because of two NP distractors.
      'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 8~~~ C I 3 X    y y 003AA2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is clear-I 1 * - ----I--+- I  'ltlat you comet have a significant deltcrl:mtweeniurbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not plausibl Redesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 111--7 RFA 03/20108  L-/


RFA 03/24/08 97C3 XYY E G2.3.14 There is no mention of gross specificity in the stem.Why is shutdown and cooldown to<500 F plausible?
I 0 *** 0. . . Psychometric Flaws I 4. Job Content Flaws I 5. Other 16:1 #/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0=  Explanation Focus Dis Link  units ward KIA  //
CAF RFA 03/24/08 98 M 2 XYY E G2.3.6 The Q is NOT balanced and renders D not plausible.
  ;a'3~1 C I 3 I  X    y y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated a ' r n d part to reflect the sam This Q is aU bec us odistractors are N RFA 03/21/08 y  059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include <1= to 3 rem WB and </= 10 rem or~a This Q is a U because the discriminatory va ue is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 I I    y 851 C 3 I I I I I I I I I  E06G2.1.20 RFA 03/21/08 C 3    y


Re-write Q to incorporate another"release may be approved" but for a different reason.Since the KA is the ability to afcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the release.RFA 03/24/08 99C3 XYY G2.4.46 Change stem so applicants need to calc Tave via Tstm or acquire Tave by some other means.Otherwise, distractors C and D are not This Q is U because of two P distractors.
  ~ C 3  X    y  26A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of the wording "... Do NOT perform ..."Use the "if' statement
  ,JI I I I  1 I I I I I _ in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 881 C I 3 I X I I I I X I I I I I y I Y I E~1G2. Stem: Change WR level to 30% AC This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are off.


RFA 03/24/08 100C3 X XYY E G2.4.8 Since there is no direct transition to FR-S.1 ever, distractor A is not plausible.
_ _ _,. _0* _ _ '        BE .__ 3 / 2 1 / 0 8 _ _.00- 00  ... -.....-
89      073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?
        ~F: 03/21/08 90 I C I 3 I X I I I I I I X I I I Y I Y I E "., 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS  Explanation Focus Dis Link units ward KIA Only 1./
91 C 3    Y Y St:. 0~~:.7 RF 124/08 e? )C
~
3  X  Y Y  028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:
A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen f1amma i1it D. Similar but change to hydrogen recombine ThJ..;.? is a U because of 2 NP distractor RF 03/24/08 93 C 3  X  Y Y E J,o Q;9A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2  X X  Y Y E ~~.35 Istractor D is not plausible because it is common t- knowledge that RE's are a technical oversite position with no "permissive" authorit )1 Change choices as follows (example): Shift manager OR Fuel handling SRO B. Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY R~03/24/08
      /
95 . _....-.M 2
  ~ .. .
  ~ .....
X_
    ... .....
Y .. ,
Y .
_.... _ EI/ 1"""'"G2. . vllonge'''who is" lU WI,icll Olle ottheiollowir 19 is responsible...  .
Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .
Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q:: SRO U/E/S  Explanation Focus Dis Link units ward KIA Only
~ C 3  X  y y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3  X y y E G2.3.14 j / fhere is no mention of gross specificity in the ste is shutdown and cooldown to < 500 F plausible?
Why CAF RFA 03/24/08 98 M 2  X  Y y E Q2:3:6 The Q is NOT balanced and renders D not plausibl Re-f'9-'
      ~' write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to aPcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3  X  Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or E acquire Tave by some other means. Otherwise,
        ,..,
distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X  X  y y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewri~actors to reflect thi RFA 03/24/08
          -_ _------


Give the applicant entrance into E-O and rewrite distractors to reflect this.RFA 03/24/08
* Independent of whether or not it met the KA, mis-classified WRT RO/SRO,. or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA
*.*Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancement.
_.- _._----  -------_.. - - ... -


Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E*I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat-editorial elsewhere Partially met KA ES-401 Written Examination Review Worksheet Form ES-401-9 McGuire 2008-301 4.Job Content Flaws 0#1 1.I 2.3.Psychometric Flaws LOK LOD (CIA)(1-5)PartialLink Minutia I#1 unitsward 5.Other I 6.0=I SRO I UlE/S KIA Only 7.Explanation 4.1.2.3.5.6.7.Instructions
ES-403  Written Examination Grading  Form ES-403-1 Quality Checklist Facility: McGuire Date of Exam: May 23,2008 Exam Level: RO X SROX Initials Item Description  a b c Clean answer sheets copied before grading  hIe rfa Answer key changes and question deletions justified  hIe rfa and documented Applicants' scores checked for addition errors  hIe rfa (reviewers spot check> 25% of examinations)
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.]
      'NjA Grading for all borderline cases (80 +/-2% overall and 70 or 80, hie rfa as applicable, +/-4% on the SRO-only) reviewed in detail All other failing examinations checked to ensure that grades "'N/A N/A are justified    ~  ,
Enter the level of knowledge (LOK)of each question as either (F)undamental or (H)igher cognitive level.Enter the level of difficulty (LOD)of each question usinga1-5 (easy-difficult)
      , Performance on missed questions checked for training  hIe rfa deficiencies and wording problems; evaluate validity  I~~
rating scale (questions in the2-4 range are acceptable).
of questions missed by half or more of the applicants Printed Name/Signature  Date a. Grader  Bruno L. Caballero $~  06/30/08 b. Facility Reviewer(*) N/A  J  N/A c. NRC Chief Examiner (*)
d. NRC Supervisor (*)
Ronald F. Aiello Malcolm T. Widdmann
    '-,Y
    ~
    ~,1i
    -- IHy 07/01108 07/01108 l / iJ
    -
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are require ES*501  Post-Examination Check Sheet  Form ES-SQ1-1 Post-Examination Check Sheet Facility: McGuire  Date of Examination: May 12*23, 2008 Task Description  Date Complete Facility written exam comments or graded exams received and verified complete Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary Operating tests graded by NRC examiners I v, NRC chief examiner review of operating test and written exam grading completed I . Responsible supervisor review completed I . Management (licensing official) review completed . License and denial letters mailed I v, Facility notified of results I . Examination report issued (refer to NRC MC 0612)
I N/A 1 Reference material retumed after final resolution of any appeals


Check the appropriate box if a psychometric flaw is identified:
Final Submittal (Blue Paper)
*The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
FINAL OUTLINES


*The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).*Theanswer choices are a collection of unrelated true/false statements.
ES-401  PWR Examination Outline  IForm ES-401-2 ( Facility:
McGuire 2008 NRC FINAL Date of Exam: 5/1212008 Exam RO KIA Category Points  SRO~Ohly Points Tier Group K K K K K K A A A A G
      * Total A2 G* Total 1 2 3 4 5 6 1 2 3 4 Emergency
& 2 1 2 1  2 2  1 9 2 2 4 Plant Tier Evolutions  4 5 4  5 5  4 27 5 5 10 Totals 1 2 2 3 3 2 3 2 2 3 3 3 26 3 2 5 Plant 2 1 1 1 1 1 1 1 1 1 1 0 10 0 2 1 3 Systems Tier 3 3 4 4 3 4 3 3 4 4 3 38 5 3 8 Totals 1 2 3 4  1 2 3 4 3. Generic Knowledge & Abilities 10  7 Categories 3 3 2 2  1 2 2 2 Note: Ensure that at least two topics from every applicable KiA category are sampled within each tier of the RO and SRQ-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the "Tier Totals* in each KIA category shall not be less than two).  , The point total for each group and tier in the proposed outline must match that specified in the tabl The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRC-only exam must tota125 point . Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site*specmc systems that are not included on the outline should be added. Refer to section D.1.b of ES-401, for guidance regarding elimination of inappropriate KIA statement . Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolutio . Absent a plant specific priority, only those KAs having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO an"CSRC-only portions, respB;ctivel , Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categorie .- The generic (G) KlAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable KIA's On the following pages, enter the KIA numbers, a brief description of each ~opic, the'topics' importance ratings (IR) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. If fuel handling equipment is sampled in other than Category A2 or G" on the SRQ-only exam, enter it on the left side of CohJmn A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRQ-only exam . For Tier 3, select topics from Section 2 of the KiA Catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to KlAs that are linked to 10CFR55.43
        ,


One or more distractors is not credible.One or more distractors is (are)partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).Check the appropriate box if a job content error is identified:
ES-401    2    Form ES-401-2 (  McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 2.1.27 - Conduct of Operations: KnoWledge 009/ Small Break LOCA /3  X of sYStem puroose and J or functio .0 .1.25* Conduct of Operations: Ability 10 0261 Loss of Component Cooling  X interpret reference materials, such as Water /8 Qraohs. curves, tables. et EA2.01 - Ability to determine or intel1lret 029 { Anticipated Transient Without X the follOWIng as they apply to a ATWS: Scram (ATWS) 11 Reactor nuclear instrumentation EA2.05 - Ability to detennine or interpret the following as they apply to a Station 0551 Station Blackout /6  X Blackout When battery is approadling fully .
*The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).*The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).The question requires reverse logic or application compared to the job requirements.
discharoed  :
AA2.18 - Ability to determine and interpret the following as they apply to the Loss of 056/ Loss of Off*site Power /8  X Offsite Power: Reactor coolant temperature, pressure, and PZR level recorders 2.4.21 - Emergency Procedures 1 Plan:
Knowledge of the parameters and logic used to assess the status of safety 0581 Loss of DC Power 16  X functions, such as reactivity control, core 4.* 81 cooling and heat removal, reactor coolant system integrity, containment conditions, radioactivitY release control, et :
2.4.46 - Emergency Procedures / PI~n:
( 007 I Reactor Trip 11  X Ability to verify that the alarms are consistent with the olant condition AA1.03 - Ability to operate and I or monitor .
the following as they apply to the 008/ Pressurizer Vapor Space X Pressurizer Vapor Space Accident Turbine Accident 1 3 bypass in manual contralto maintain header pressure EK2.03* Knowledge of the interrelations oog / Small Break LOCA /3 X  between the small break LOCA and (he followino: SlGs EK3.06 - Knowledge of the reasons for the following responses as the apply to the 011 / Large Break LOCA 13  X  Large Break LOCA: Acl\Jatioo of Phase A and B durino LOCA initiation AA1.16 - Ability to operate and 1 or monilor the following as they apply to the Re.aetor 015/17 I Reactor Coolant Pump X Coolant Pump Malfunctions (Loss of RC Malfunctions 14 Flow): Low power reactor trip block status linhts AA2.04 - Ability to determine and interpret 022 / Loss of Reactor Coolant  the following as they apply to the Loss of X    2.' 44 Makeup 12    Reactor Coolant Pump Makeup: How long PZR level can be maintained within limits AK2.03 - Knowledge of the interrelations between the Loss of Residual Heat 0251 Loss of Residual Heat X  Removal System and the following: Removal System 14 Service water or dosed cooling water I numns  ~
AK1.03 - Knowledge of the operational implications of the following concepts as 0271 Pressurizer Pressure Control System Malfunction 13 X  they apply to Pressurizer Pressure Control 2.* Malfunctions: Latent heat of ( 0291 Anticipated Transient Without X
vaoorizatiorucondensation EK2.06 - Knowledge of the interrelations between the and the following an ATWS: 2.' 47 Saam (ATWS) /1 Breakers, relays, and disconnects


Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
ES-401    2  Form ES-401-2 (  McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 EK3.02 - Kno'NIedg8 of the reasons for the following responses as the apply to the 0551 Station Blackout /6  X Station Blackout Actions oontafned in EOP for loss of offsile and onsite DOWer AA1.12 - Ability to operate and / or monitor 0581 Loss of Off-site Power 16  X the following as they apply to the Loss of Offsite Power: Reactor buildino coolino unit AK3.0t - KnO'Ntedge of the reasons for the followiog.responses as they apply to: the 057 I Loss of Vital AC Elecbical X  Loss of Vital AC Instrument Bus: Actions 4.' 50 Instrument Bus f 6 contained in EOP for loss of vital ae electrical instrument bus AK1.01 * Knowledge of the operational Implications of the following concepts as 0581 Loss of DC Power /6 X they apply to Loss of DC Power: Battery charoer eouioment and instrumentation AA2.06 - Ability to determine and interpret the following as they apply to the Loss of 062/ Loss of Nuclear Servic X Nuclear Service Water: The length of time Water / 4 after the loss of CON flow to a component before that comoonent may be damaoed AA2.08 - Ability to determine and interpret the following as they apply to the Loss of 0651 Loss of Instrument Air / 8  X Instrument Air: Failure modes of air*
oDerated eauipment EK1.2 * Knowledge of the operation",l ( E041 LOCA Outside Containment /


Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
X implications of the following ooncepts as they apply to the (LOCA Outside Containment): Normal. abnormal and emergency operating procedures associated ~~ {LOCA Outside Containmen .1.23 - Conduct of Operations: Ability to E11 f Loss of Emergency Coolant  perfOnT! specific system and integrated X Recirculation 14  plant procedures during all modes of plant oDeratio E12 f Unoon\rolJed Depressurization  2.1.20 - Conduct of Operations: Ability to X
II At.m'o'm,m,...moo",'U" m'o" (*.,..how B otbi',""re"'0'""').tAJ 4).r1J C ca RO/SRO Combined Question For system generic KA's, state the system then the generic part (Le.)026G2.2.22 (Q 15).Containment Spray/Knowledge of LCO's and Safety Limits.Many of the U's were attributed to non-plausible distractors that could not be supported.
internret and execute 'nrocedure sten!;. of all Steam Generators f 4
'KJA Category Totals: 3 3 3 3 6 6 Group Point Total:
I '816 (


Many of the stems are inconsistent with the use of verbs such as"is and are." I C 3 x x x y N ,/._--.."--003K1.08 Stem: (,)after power.A and D make absolutely no sense.What about RN and KC flow to and from the NCPs?Repair distractors A and D or explain.RFA 03/25/08" 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utEIS Explanation Focus Dist.Link units ward KIA Onlv/[/2M 2 XYN Ey'004K5.46 Distractor B is NOT plausible because ALL a8Plicants know that RCPs operate when the plant isNT solid and DP is maintained.
ES-401    3    Form ES-401-2 (  McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 2 AA2.02 * Ability to determine and interpret the following as they apply to the Dropped 0031 Dropped Control Rod 11  X Control Rod: Signal inputs 10 rod control svslem AA2.05 - Ability 10 determine and interpret the following as they apply to the Loss of 0331 Loss of Intermediate Range Nudear Instrumentatioo/7 X Intermediate Range Nudear  83 Instrumentation: Nature of abnormality, from rapid survey of control room data 2.2.38 - Equipment Control: Knowledge of 0591 Accidental Liquid RadWaste X conditions and limitations In the facility Release /9 licens .1.20 - Conduct of Operations: Ability to E06 / Degraded Core Cooling /4  X internre! and execute "nrocedure sten .6 85 AA1.02 - Ability to operate and I or monitor ODS/Inoperable/Stuck Control Rod I  the following as they apply to the X Inoperable / Stuck Control Rod: Rod selection switches AA2.03 * Ability to determine and interpret the following as they apply to the 024/ Emergency Boration /1 X Emergency Boration: Correlation between 2.' 58 boric acid controller setpoint and boric acid flow AK1.01 - Knowledge of the operational 0321 Loss of Source Range Nudear X  implications of the following concepts as '
( Instrumentation 17 0331 Loss of Intermediate Range Effects of voltaoe chanoes on oerformance AA1.02 - Ability to operate and I or f'!l0nitor the following as they apply to the Loss of Nudear Instrumentation /7 X
Intermediate Range Nudear Instrumentation: Level trip bvoass AK2.01 - Knowledge of the interrelations 036 { Fuel Handling Incidents /8 X  between the Fuel Handling Incidents and 2.' 61 the following: Fuel handUng equipment AA2.12* Ability to determine and interpret the following as they apply to the Plant 067 I Plant Fire On-site 18  X Fire on Site: location of vital equipment 2.' 82 within fire zone AK3.01 - Knowledge of the reasons'for the following responses as they apply to the 0691 Loss of Containment Integrity /
X  Loss of Containment Integrity: Guidance contal~ in EOP for loss of containment int"""rilv AK2.01 * Knowledge of the interrelations
,
0761 High Reactor Coolant Activity /
X between the High Reactor Coolant Activity and the following: Process radiation monitors .4.8 - Emergency Procedures 1 Plan:
Knowledge of how abnormal operating E021 SI Termination 13  X procedures are used in conjunction :-vith EOP' KiA Category Totals:  1 2 1 2 4 3 Group Point Total:
I 9/4 (


Replace distractor B RFA 03/25/083M 2 X XYN E k5b5K2.03 V Third bullet, need a verb.Make thisQa fill in the blank with choices as follows:.A.600V Unit Load Centers 1 OPEN B.600V Unit Load Centers 1 CLOSED C.600V Essential Load Centers 1 OPEN Essential Load Centers 1 CLOSED RF 3/25/084C 3 XYN E y klO6A4.01 The emphasis is on the wrong word.Bold the words"increase" and"decrease" and"4-7" and"7-10" RFA 03/25/085C3 XYN E K>07A3.01.;C is NOT plausible.
ES-401  4   Form ES-401-2 McGuire 2008 NRC Exam (  Written Examination Outline Plant Systems - Tier 2 Group 1 System # I Name K


Change C to"the reactor coolant drain tank." If the'V do out that the#1 seal discharges to the.CT, twill realize that VCT level will not increase if the filter is c However, thee may NOT realize that reliefs do N dumcft into the R DT, which makes the RCDT a plausible istractor.
K K K K 2 3 4 , K


RFA 93/25/08 6 M 2 XYN 8K2.02 E If B was correct, D would be also If A was correct, C would be also.Distractors C and D need the word"ONL Y" This Q is U because of two NP distractors.
A


RFA 03/25/08 (1 CYN 8K4.01 erbs missing in bullets.This Q has low discriminatory value.Here is a suggested--....-....-....-_._..---_.--._-
A
____P..___...n.*A.The 1 B2 trips on over current OR an event causing containment pressure to increase to 1.5 psig.B.An event causing containment pressure to increase to 1.5 psig ONL Y.C.The normal breaker to 1 ETB opens OR a leak on the shell si e of the1B KC heat exchanger occurs.D.The normal supply breaker to 1 ETB opens ONL Y.This Q is U because of low discriminatory value.RFA 03/25/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LaD (CIA)(1-5)Stem Cues TIF Credo Partial Job-Minutia#1 Back-0=SRO utEIS Explanation Focus Dist.Link units ward KIA Only/<D c 3 X y N 010K1.07 Since Channel 3 high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C.combined with choice 1 is plausible.


By itself it will be readil h eliminated.
A


They might consider it if it is coupled with cannel 1 failing low.Since the switch is in position 1-4, channel 2 failing high is NOT plausible.
A


A.Channel 1 failing low OR channel 3 failing high B.Channel 1 low ONL Y C.Channel 1 OR cannel 4 failing low.D.channel 4 failing low ONL Y This Q is U because the are two potentially NP distractors. 03/25/08 9C3YN SJI 012A3.03 10 C 2YN SJ..-
G    Im a
RFA 03/25/08 11 M 2 XYN EV The stem does not read well.There is eather a run on sentence or punctuation is missing.I get lost in it.Please re-wnte.RFA 03/25/08 12 cl 3 X YA2.03.r t would appear to be common knowledge from an&#xa3;applicant In training that AP-44 is for flooding in the TB and ASB.I do not believe that this qualifies as a&#xa5;Iausible distractor.
        *
A2.01 - Ability to (8) predict the impacts of the following malfunctions or operations on the PZR pes; ana (b)
010 Pressurizer Pressure  based on those predictions, use X    3.6 86 Control    procedures to correct, control, or mitigate the consequences of those malfunctions or operations: Hea~r fajrUTes A2.03 * Ability to (a) predict the impacts of the following malfunctions or .
operations on the CSS; and (b) based 026 Containment Spray  X on those predictions, use procedures to 4.4 87 correcl control, or mitigate the
    :~sequences of those matfun~ons Of o erations: Failure of ESF 2.4.4 - Emergency Procedures I Plan:
Ability 10 recognize abnonnal 061 AUxiliarylEmergency  indications for system operating X    4.7 86 Feedwaler    parameters which are entry*level
    =itiO~S~~ency and abnormal o ratino; ure .2.4 - Equipment Control: (multi-unit license) Ability to explain the variations 073 Process Radiation ( Moniloring X in control board layouts, syslems, instrumentation and p~uraJ actions between units at a fadl '
3.6 88 A2.02* Ability 10 (a) predict the impacts of the following malfunctions or operations on the SWS; and (b) based on those predictions, use procedures 10 076 SefVice Waler  X correct, cootrol, or mitigate the 3.1 80 consequences of those malfunctions or operations: SefVice water header I nressure K1.08 - Knowledge of the physical connections and/or cause-effect 003 Reactor Coolant Pump X  relationships between the RepS and the following systems: Containm'ent isolation K5.46 - Knowledge of the operational im\::Jfications of the following concepts 004 Chemical and Volume  as they apply to the CVCS: Rea~n for X    2.' 2 Control    going solid in PZR (collapsing steam bubble): make ~~: no sleam is In PRT when PORV is 0 ened to drain RCS K2.03 * Knowledge of bus power 005 Residual Heat Removal X  supplies 10 the following: RCS pressure bounda'" motor-o";erated valves A4.01 * Ability to manually operate 006 Emergency Core Cooling  X and/or monitor in the control room: Pumns 007 Pressurizer Relief/Quench Tank X
A3.01 - Ability to monitor automatic operation of the PRTS. induding:
Components which discharge 10 the ,
PRT ( 008 Component Cooling Water X K2.02 - Knowledge of bus power SUPPli~o to :~~i~:ng: ~o: pump, includin em en backu K4.01 * Knowledge of COOS design feature{s) andlor interlock(s) which 008 Component Cooling Water X provide for the following: Automatic star! of standbv num"


his Q is U because Band D distractors are not plausible. calculation in distractor analysis.FA 03/25/08 13C3 Y N 025K6.01----RFA 03/25/08--_.-..,.--.--_..--....14 M 2 XYN 0 K5.01 (istractors Band D say the same thing.Replace one of the two distractors.
ES-401    4  Form ES-401-2 McGuire 2008 NRC Exam (  Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A    a System # I Name 1 2 3 4 5 6 1 2 3 4 G
      , Im *
K1.07* Knowledge of the physical oonnections and/or cause-effect 010 Pressurizer Pressure X  relationships between the PZR PCS 2.9 8 Control    and the following systems:
Containment A3.03 - Ability to monitor automatic 012 Reactor Protection  X operation of the RPS, including: Power 3.4 9 sUDol" K6..Q.3 * Knowledge of the effect ,of a 012 Reactor Protection  X  loss or malfunction of the following will 3.3 10 have on the RPS: Trio loalc circuits K4.08* Knowledge of ESFAS design 013 Engineered Safety X  feature{s) and/or interlock{s) which 3.1 11 Features Actuation I provide for the following Redundancv A2.05 - Ability to (a) predict the impacts of the following malfunctions or .
operations on the ecs; and (b) based 022 Containment Cooling  X on those predictions, use procedures to 3.1 12 correct control, or mitigate the consequences of those malfunctions or operations: Ma'or leak in CCS :
K6,01 - Knowledge of the effect of a loss or malfunction of the following will 025 Ice Condenser  X  have on the ice condenser system: 3.4 13 Upper and lower doors of the ice condenser K501 * Knowledge of operational implications of the following concepts 025 Ice Condenser  X  as they apply to the ice condenser 3.0 14 system: Relationships between I pressure and temPtirature 2.2.22* Equipment Control: Kno,wledge 026 Containment Spray  X of limiting conditions for operations and 4.0 15 safety limit '
K3.02 * Knowledge of the effect that a loss or malfunction of the CSS will have 026 Containment Spray X    4.2 16 on the following: Recirculation spray sYStem A4.04 - Ability to manually operate 039 Main and Reheat Steam  X and/or monitor in the control room: 3.8 17 EmerQenev feedwater pump turbines I ~4:O7 - Knowledge of MRSS design feature(s) and/or interiock(s) which 039 Main and Reheat Steam X    3.4 18 provide for the following: Reactor buildino isolation A1.03 * Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated 059 Main Feedwater  X    2.7 19 with operating the MFW controls including: Power level restrictions for operation of MFW "urn"'" and valve K3.01 * Knowledge of the effect that a 061 AuxilJaryfEmergency X  loss or malfunction of the AFVII will 4.4 20 Feedwater have on the followino: RCS A3.05 - Ability to mOllitor autom;;ttic 062 AC Electrical Distribution  operation of the ac distribution sYste X    3.5 21 (    including: Safety-related indicators and controls A1,01 - Ability to predict and/or monitor changes in parameters aSSociat~ with 063 DC Electrical Distribution  X operating the dc electrical system 2.5 22 controls including: Battery capaCity as it is affected bv dischame rate .


As a result, Band D are NOT&#xa5;Iausible.
ES-401  4  Form ES-401-2 McGuire 2008 NRC Exam (  Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A    e System # I Name 1 2 3 4 5 6 1 2 3 4 G  Im *
K6.0B * Knowledge of the effect of a 064 Emergency Diesel  Joss or malfunction of the following will X
have on the ED/G system: Fuel oil Generator storaoe tanks  :
A2.01 * Ability 10 (a) predlct the impacts of the following malfunctions or operations on the PRM system; and (b)
073 Process Radiation  based on those predictions, us X Monitoring  pmc;edures 10 correct, control, or mitigate the consequences of those malfunctions or operations: Erratic or failed DOwer suoolv 2.4.11 - Emergency Procedures / Plan; 076 SefVice Water  X Knowledge of abnormal condition 4.* 25 procedure ~
K3.07 - Knowledge of the effect that a 076 Service Water X  loss or malfunction of the SWS will have on the followino: ESF loads 2.4.35 - Emergency Procedures I Plan:
Knowledge of local auxiliary operator 078 Instrument Air  X tasks during emergency and the resultant ooerational effect A4.01 - Ability to manually operate and/or monitor in the control room:
103 Containment  X Flow control, pressure control, and (    temperature control valves, including Dneumatlc valve controller :
KIA category Totals: 2 2 3 3 2 3 2 5 3 3 5 Group Point Total:  I 2815 (


D could be a subset of B.herefore this Q is.RFA 03/25/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO U/E/S Explanation Focus Dist.Link units ward KIA Onlv 15C3 X Y II Y?17 E le26G2.2.22
ES-401  5   Form ES-401-2 McGuire 2008 NRC Exam (  Written Examination Outline Plant Systems - Tier 2 Group 2 System # I Name K
'ad'Iv D says that the LCO is not applicable,C says the T5 will ,.not be entered.What is the difference between D and C?Is this required knowledge RO applicants since this isNOTa1 hourT RFA 03..&#xa3;25/08
-[};;::7M2 X Y N le o02 cause the FW5T Lo-Lo level alarm has occurred, istractors A and B are not plausible.


For distractors A and B to be plausible, provide information for the to calculate FW5T level.TU because there are two NP distractors.
K


RFA 0/25/08 17 C 3 X P X Y N E t
K
"(..econd Bullet: Normal what supply??:1115./ are not complete sentences (generic comment),/RF 3/25/08 A V?,'-&39K4.07
,.JP-JIt 18;;X X Y N'EJ/I think this Q can be answered even if you delete everything above the WOOTF statement.


If so, delete it../This thejteria to be an W question.RFAO 5/087, 19 C 2 X X Y Y 59A1.03 I ink this Q also can be answered even if ou delete II e rything above the WOOTF statement.,r so, delete it.Th Q meets the criteria to be an (M)question.RFA 93/25/08 20 C 2 X Y N 61K3.01 E CF and NCPs are not safety related which renders these two distractors NP.Replace these 2 distractors.
K 4 ,
K K


This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E
A A A A 1 2 3 4 G  Im Q
-...._..-"...._------_....p'The.OO seqllencer 8cb!8ted.Irain A.,t",...., I;nht nn 51-14" to the stem.Unbold the words"and" and"then." This will un-complicate the choices.RFA 03/25/0 .I 2.4.Job Content Flaws 0#/1 LOK LOD (CIA)(1-5)Partial Job-Back-Link ward 5.Other I 6.7.Explanation 63A1.01 Create a fill in the blank as follows: Battery CXA will be lost in_1_hours.Battery CXB will be lost in_2_hours.2 N y 0=I SRO I UlE/S KIA Onl X x 2 22IC A.24 B.26 C.3 4 D.3 6 RFA 03/25/08 23M2 X y N 24M2YN , r RFA 03/25/08M2-L(
        *
The A is not met.The KA must involve the SW In the first bullet, it could be any system OT Just.The RN system has to have a direct impact on t:=In fact, you could delete all but the last bullet and Ii Ifanswer the Q This Q isaU because KA not met.D fFI t1 RFA 03/19/08*/
2.1.7 - Conduct of Operations: Ability to evaluate plant performance and make 015 Nuclear Instrumentation  X operational judgments based on 4.7 91 operating characteristics, reactor behavior, and instrument Intemretatlo A2.03* Ability 10 (a) predict the impacts of the following malfunctions or operations on the HRPS; and (b)
Change answer as follows: A.ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV pume Gear oil will overheat.B.ONLY the 2A N Pump Gear oil will overheat.C.ONL Y the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat.D.The 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat.Additionally, all makeup capability is....__....__..*-___*1_____,,-1ost1u tile 2A DG KD--surge Lallk.---...---_
based on those predictions, use:
__This Q isaU because the discriminatory value is to low. YIN 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO UlE/S Explanation Focus Dist.Link units ward KIA Onlv-'28 M 2 XYN V teach in the stem.Start of with WOOTF...The'st the valves.RE 03/26/08 29 C 3 XYN E}'014K4.03 Put"Rod F-2 displayed as" in the stem.03/26/08/ 30C3 y N 017K6./'RFA 0 126/08 t;l-,7 31 C 3YN I-RFA 031 708 32 M 2 7 X y N 57 l hy is"decrease" plausible in distractors C and D?Prove Q will be Sat.RFA 03/26/08M XYN0 1\4.04 tem:"has" to"have" Add Excore R monitors to choice Bandadd Excore SR monitors andlor Trip 2 on 1 EMF-16 to A, C, and 0 to increase discriminatory value.U because of low DV.R 03/26/08 34 M.2YN033K3.01 I RFA 03/26/08 I 35 C 3 X Y N 5A2.05 Without giving the applicant a misleading lead in that might a steam leak, Distractors A and B are not urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-001.Qbecause of two NP distractors.
Pro<.:edures to correct, control, Of 028 Hydrogen Recombiner and X mitigate the consequences of those 4.0 92 Purge Control malfunctions or operations: The hydrogen air concentration in excess of limit llame propagation or detonation with resulting equipment dam-age in containment A2.01 * Ability to (a) predict the impacts of the following malfunctions or operations on the SAS; and (b) based 079 Station Air  X on those predictions, use Procedures 3.2 93 to COfTect. control, or mitigate the consequences of those malfunctions or onl!rations:: Cross-connectlon with lAS K4.03 - KnO'N1edge of RPIS design ( 014 Rod Position Indication X feature{s) andlor interlock(s) which provide for the following: Rod Bottom lioh~  .
32 29 K6.01 * Knowledge of the effect'of a 017ln-core Temperature  loss or malfunction of the following ITM Monitor X  system components: Sensors and 2.7 30 detectors K2.01 * KnO'N1edge of bus pov,te(
015 NucJear Instrumentation X  supplies to the following: NIS channels, 3.3 31 System comoonents, and interconnections K1.01 * Knowledge of the physical connections andfor cause-effect 028 Hydrogen Recombiner and   relationships between the HRPS and Purge Control X    2.' 32 the following systems: Containment annulus venti~\tion system (incJl,lding nressure Iimi~
A4.04 * Ability to manually opE!f8te 029 Containment Purge  X aMrtor monitor in the control room: 3.' 33 Containment Evacuation sional K3.01 * Knowledge of the effecfthat a loss or malfunction of the Spent Fuel 033 Spent Fuel Pool Cooling X  Pool Cooling System will have on the 2.6 34 followino: Area ventilation sYStems A2.05 - Ability to (a) predict the impacts of the following malfunctions or :
operations on the SIGS; and (bY based on those predictions, use procedures 035 Steam Generator  X to correct, control, or mitigate the 3.2 35 consequences of those malfunctions or operations: Unbalanced flows to the SIGs ( 041 Steam DumplTurbine Bypass Control X
A3.03* Ability to monitor automatic operation of the 50S, incJuding: Steam flow 2.7 36


RFA 3/26/08.---,._..---_..-_._-..*_-_.....\.J" A.--y-A3:03---If Tave is decreasing, what else would cause it, if there was no)'team flow?SUli1gest fiiving them a rod shim becalJse inward rod motion wil cause a drop in Tave.Ri99t now distractors A and C are NOT plausible (NP).This Q is U because of two NP distractors.
ES-401  5  Form ES-401-2 McGuire 2008 NRC Exam Written Examination Outline Plant Systems - Tier 2 Group 2 K K K K K K A A A A    Q System # I Name  G    Im #
A 1.06 - Ability to predict and/or r.nonitor changes in parameters(to prevent exceeding design limits) associated 071 Waste Gas Disposal  X with Waste Gas Disposal System operating the controls including:
Ventilation system  :
K5.03 - Knowledge of the operalional implication of the following concepts as 086 Fire Protection X  they apply to the Fire Protection System: Effect of water spray on electrical components
      :
KIA Category Totals: 1 1 1 1 1 1 1 3 1 1 1 Group Point Total:
I 12/3


RFA 03/26/08 37 M 2 XYN I/, 071A1.06 Remove"in" from the stem.RFA 03/26/08 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utE/S/Explanation Focus Dist.Link units ward KIA Only sf,--V 38M2 Y N 086K5.03..--RFA 03/26/08 39 M X Y G2.4.46 lace 1 of the channels that require 2/4 to trip the reactor below the limit.Set it up so 2 reactor trips are in.Add a second annunciator to each choice such that the correct answer has two valid two distractors eachhaveone valid annunciator an one distractor has one channel each below the wire but no annunciators are in.This Q isaU because of low Discriminatory Value...1.-A RFA 03/19/08 I 008AA1.0340C3X Y;: I believe that"A" can be a pot tially corr.ct answer because one can manually stabilize or maintain a CD rate-by adjusting the pot
ES-401 Generic Knowledge and Abilities Outline (Tier3) : Form ES-40 1-3 ( Facility: McGuire 2008 NRC Exam Date: 5/1212008 :
..To ensure that"A" is not an option state in the WOOT statement".....describes the action, as stated in ES-1.2, that will..." As is, this Q is U because there are potentially two correct answers.RFA 03/26/08 41 C 3 Y N jY Much better.Now they have to calc Tstem.RFA 03/26/08 42 M 2 X X Y N E L 011EK3.06"S" does not read correctly.
      :
 
RO, SRO-Only Category KIA # Topic IR Q# IR Q#
I think"are ,.olated" should be removed.If"0" was correct,"C" would be correct also.Need the word"only" in C.RFA 03/26/08 43C3 X Y N ove"Initial reactor power was" to the stem.It will read easier.RFA 03/26/08 44 r..._3.._.
Knowledge of the fuel-handling responsibilities of 2.1.35 SRO' Ability to make accurate, clear and concise logs, 2.1.18 . records, status boards, and report Conduct Knowledge of facility requirements for controlling 2.1.13 ,67 of Operations vitali controlled acces Ability to coordinate personnel activities outside 2. .4 68 the control roo Subtotal     :3 1 Knowledge of the process for conducting special 2. .6 95 or infrequent test Knowledge of limiting conditions for operations 2.2.22 and safety limit . Ability to apply technical specifications for a Equipment 2.2.40 syste Control 2.2.13 Knowledge of tagging and clearance procedure .1 ,70 Knowledge of the process for making changes to 2. .0 *71 procedure Subtotal     '3 2 Knowledge of radiation or containment hazards 2.3.14 that may arise during normal, abnormal, or emeraencv conditions or activitie . Ability to approve release permits : Radiation Knowledge of radiation exposure limits under 2. .2 72 Control normal or emerQency condition .3.11 Ability to control radiation release .8 ]3 Subtotal     2 2 Ability to verify that the alarms are consistent 2.4.46    : with the plant condition Knowledge of how abnormal operating 2. .5 100 procedures are used in coniunction with EOP' Emergency Procedures I 2.4.17 Knowledge of EOP terms and definition .9 :74 Plan 2.4.14 Knowledge of general guidelines for EOP usag .8 75 Subtotal     2 2 Tier 3 Point Total     10 7
 
--------y 1\1.Q22AA204.--._.._------_....-f,/RFA 03/26/08 45 C3X X X Y N E i$03 t Th tern does NOT solicit the effect on the KC system.-write the stem to do so.egarding"C": If the KC system continues to HU, will the NC system eventually start to HU?If so, this may be a correct answer.acility please re-evaluate.
 
RFA 03/26/08 b t
,,J 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO UlE/S Explanation Focus Dist.Link units ward KIA Only I,.;46C3 X Y Nt lA1 027AK1.03 FAC demonstrate how you arrived at this.Did you factor in constant enthalpy?IRFA 03/26/08 47C3 Y N tJI'029EK2.0603/26/08 48M2 XYN V k555EK3.02 The stem has to much fru fru.Re-write the stem as follows: Which one of the following is the bases for NOT the SG's to<110 psig as stated in ECA-0.0, Loss ofaI AC Power?To avoid A.voiding in the head B.an inadvertent criticalit h accident C.nitrogen injection intote RCS O.the loss of SG narrow range level Rij\03/26/08 49M2YN!Y'056AA1.12 RFA 03/26/08 50C3 X Y I N-057AK3.01 To be consistent, why not say in 0 that turbine impulse , , p,ressure channel 1 has failed high Oust the opposite ofFA 03/26/08 51 M<2 X X XYN ,/058AK1.01 Stem;Underline and bold the word minimum Oistractors:
Bold 1 and 4 and automatically and manually.The level of difficulty is marginal.Therefore, incorporate auxiliary battery criteria into the choices too.RFA033P1 08/---.---..---._.--"I-.---...._---_..----M 2 X JLYN 2AA2.06(Ii..f"0" is also a correct answer the way the Q is written.If IT..)l"A" was correct,"C" would also be correct.Add words to the stem to isolate the correct answer so CtJ other choices cannot be psychometricall b eliminated.
 
t tIP This Q is U because two distractors can e eliminated by thethe Q is written.f..or" RFA 0 126/08 ,-,-., yw v E11G2.1.23 ECA-1.1 ,Step 21 b.RNO states to stop one or more SI pumps while maintaining
>1=to flow required by Enclosure 9.Therefore, distractor"A" is also a correct answer.Replace distractor A.Distractor D is NOT an action.Additionally, D has a reason where the other choices do not.Replace distractor D.This Q is U because two choices are flawed.RFA 03/26/08 E12G2.1.20 Even though Band C are incomplete, they are still correct as it stands.I do not believe that D is plausible because there is no procedure guidance anywhere that directs this.This Q is U because all three distractors are flawed.RFA 03/26/08 Stem: Why all the fru fru?Why not just say: WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm flow rate?_Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gpm.As is, B,C, and Dare NP.Therefore this Q is aU RFA 03/26/08 E04EK1.2 Stem: Bring containment pressure up to 8.5 psig to make B, C, and D more plausible.
 
Why has the PRT ruptured?What is dumping into it to cause that?RFA 03/26/08 7.Explanation 065AA2.08 The reason for the trip is NOT solicited.
 
Remove the reasons form all choices.C is still the correct answer because the word FIRST I used in the stem.RFA 03/26/08.y y?X X X*.I X..._.-*._-III_ul'_"+--I I***u...
3 2 2 3 M 55IC 54IC 57 ICI3 5611 M 5*...._.1.I 2.I 3.Psychometric Flaws I 4.Job Content Flaws r-;Qther I 6.Q#I I LOK LOD (CIA)(1-5)I Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=I SRO I U/E/S Focus Dist.Link units ward KIA 53 I CI3 I X Y 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LaD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utE/S Explanation Focus Dist.Link units ward KIA Only 59 C<2 X?y N l/032AK1.01 Distractors A and B are week by themselves.
 
Change Stem to say: WOOTF describes the minimum cause of SR N-31 indication?
A.Control Power fuse failure OR Instrument Power Fuse failure.B.Control Power fuse failure AND Instrument Power Fuse failure.C.As is D.As is RFA 03/26/08 60M2 X X X Y N l ,/033AA1.02 Distractor"A" in and of itself, is also a correct answer as written.The"ensure" statement in"c" and"D" are NOT solicited.
 
Re-work distractors A, C, and D.
 
61C3 X Y N 036AK2.01 Last bullet: This is why verbs an complete sentences are/" necessaz.Are you saying"a KF pump is or C"the"A" F pump is operating?" C-Whay would the think that level is to low when they are told that P level is+0.4 feet?Distractor B is (n0j.plausible.
 
No SFP level trend is provided.Therefore, a avity seal failure is not plausible.
 
Why is"c" correct?Replace distractors Band D.This Q is U because of two NP distractors.
 
RFA 03/26/08 62 M 2 X yE 067AA2.12 Why is distractor"A" plausible?
in the stemremotelyindicates a problem with the CP.Replace distractor"A." RF A 03/26/08...-.--..-.../63M2 X Y Nt-069AK3.01 Distractor D has nothing to do with a rad release offsite.Replace distractor D.RFA 03/26/08 ,y
..............-.................................1.2.3.Psychometric Flaws 4.Job Content Flaws 6.I 7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back" Q=Explanation Focus Dist.Link units ward KIA C I 3 I X y N.076AK2.01 If"B" was correct,"A" would be also.If ECCS was actuated, would it cause a crud burst?If so, replace this distractor.
 
This Q isaU due to multiple distractor issues.RFA 03/26/08 1 15 i 65 C 3 Y 66 M 2 Y 67 M 2 X y G2.1.13 Pa!ile 7 of 15 of the attached reference states in part: Visitors needing to enter a vital area must be escorted by an authorized individual.
 
This leads me to believe that a badged person in a protected area could be"escorted" Into a vital area.If this IS true then"B" is also a correct answer.Please re-verify this."D" is ObviouSlil not true and not plausible.
 
This Q is U un II these issues on both these distractors are resolved.RFA 03/27108 08'-'C I 3 I XII I X I IIIII y IIbl_G2.1.8 There are three actions that could work (B,C, and D).The stem needs to be written to isolate one of them.:,IIIIIIIII V"_Currently there are potentially three correct answere.\I..This Q is U until resolved.RFA 03/27108 69 I C-X I I I X IIIIII y I t'i_G2.2.40 100 F is more common then 200 F.Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answer.Currently, this Q is U because it has no discriminatory value.RFA 03/27108-M__._.--...'--'---._-._.__.---_._..----....II....__..-70 M 2 Y.71)M 2 X X Y G2.2.6 If"B" was correct,"A" would be correct also."A" is a subset of"B"."c" is also a correct answer."c" is a subset of"D." This Q is U because of multiple correct answers.RFA 03/27108 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utEIS Explanation Focus Dist.Link units ward KIA Only ,/72 C<2 X?y Nil/E G2.3.4 4 th bullet: Drop"return via the same path." This is implied and will add to the discriminatory value.Stem: Underline and bold maximum.Choices: Delete"no longer than." Currently this Q is just a number cruncher and has low discriminatory value.Modify the 4 th bullet as suggested for an S rating.FACILITY make sure this is not on Admin exam.-....RFA 03/27/08 73C3 Y NJ..G2.3.11 RFA 03/27/08*II M 2 X Y N G2.4.17.Increase the discriminatory value of distractors Band C.They are to obvious that they are just instrument failures.Possibly add some coincidence logic to them.Q is U because of 2 NP distractors RFA 03/27/08 75 C<2 X?y N E G2.4.14 Change heat sink to an orange path too.As is, the has marginal discriminatory value.FA 03/27/08 SRO ONLY E l-I'76 C 3 X, X y y 009G2.1.27 Stem: Describes (1)the next procedure...and (2)the TS basis for FWST minimum volume for this event.Stem:
FWST level to 220 inches to make the transition to S-1.3 more plausible.
 
A.1.ES-1.2, Post LOCA Cooldown and Depressurization 2.Ensures.....RFA 03/19/08......-..-_.-.----"'y
--------------.,.7f v.:>-x-----J\T t: J, Stem;WOOTF describes (1)...and (2)the required action per AP121,....A.1.50 GPM 2.Isolate KC...Which references will be provided?RFA 03/19/08 ,I
.T 056AA2.18 Remove (;)from all choices and align C and D (Emergency is to far to the left)RFA 03/20108 Explanation 058G2.2.37 If D was correct, B would be also.Therefore D is NOT plausible If C was correct, A would be also.Therefore C is NOT plausible.
 
Stem: Need to rewrite stem to include the word'minimum" This Q is rated U because of 2 nonplausible distractors.
 
A stem correction will validate distractors C and D.RFA 03/20108 7.055EA2.03 The reference document provided does NOT support the use of Enclosure 9, energizing Unit 1 from Unit 2.However, the use of AP-7 is (see step 4 RNO of E-O.)Please re-evaluate.
 
RFA 03/20108 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O.Rewrite A and B to eliminate ambiguity.
 
C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directed.Delete''when directed, exit FR-S.1" C.State"continue performance of Enclosure 2" D.State"terminate performance of Enclosure 2" This Q is U because of 2 NP distractors.
 
RFA 03/19/08 003AA2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input.It does have an affect on the magnitude but the reference is clear'ltlat you comet have a significant deltcrl:mtweeniurbine and nuclear power and NOT have a mismatch.The mismatch is clearly a function of Tave vs Tref.Therefore, This Q is U because distractors Band C are not plausible.
 
Redesign the Q ask what provides the anticipatory signal and that would be the power mismatch input.Distractors could include T and power which would be wrong perMC-IC-IRX, Para 1.2, page 111--7 RFA 03/20108 L-/y y y y y y y y X X-I 1*-----I--+-I X X ,J 3 3 3 79IC 80IC 81IC*"1"._-..,.----.--1.I 2.I 3.Psychometric Flaws I 4.Job Content Flaws I 5.Other 16.Q#I I LOK LOD (CIA)(1-5)I Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q=SRO I U/E/S Focus Dist.Link units ward KIA Onl 8" C I 3 I XYYCI3 0***0._.1.I 2.3.Psychometric Flaws I 4.Job Content Flaws I 5.Other 16:1 7.0#/1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=//Explanation Focus Dist.Link units ward KIA C I 3 I Xyy 033AA2.05 N-35 being"under-compensated" is not plausible compared to N-36.If N-35 were over-compensated, the indicated power level would read lower than actual power level.Change distractors Band D to read N-35 is over-compensated a'rnd part to reflect the same.This Q is aU bec us odistractors are NP.RFA 03/21/08 y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include<1=to 3 rem WB and</=10 rem This Q isaU because the discriminatory va ue is to low.Additionally, without both parts this is NOT SRO only.RFA 03/21/08 851 C I 3 IIIIIIIIII y E06G2.1.20 RFA 03/21/08 86C3 yC3 X y 26A2.03 Change Cntmt pressure to 13 psig.This makes the path more plausible.
 
The actions in"A" are a subset of th"All" the actions in B and D.If B or D was correct, A could be also.The second part of Band D are not plausible because of , JIIII 1IIIII the wording"...Do NOT perform..."Use the"if'statement_in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distractor.
 
All the distractors need to be re-written.
 
This Q isaU because of two or more NP distractors.
 
RFA 03/21/08 881 C I 3 I XIIII XIIIII y I Y I Stem: Change WR level to 30%ACC.This will make B more plausible.
 
Stem: Have CA pumps running but not able to generate flow>450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are off.___,._0*__'BE.__3/21/08_00_.00-...-.....-89 073G2.2.22 75 GPD leakage is NOT supported by the attached ref material.WhX is 30 GPD plausible? 03/21/08 90 I C I 3 I XIII III XIII Y I Y I E"., 076A2.02 Stem: Only train"B" SI actuated.Delete bullet#5.Explain Why<the A EDG does NOT overheat.RFA 03/2108 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.0#1 LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-0=SRO utEIS Explanation Focus Dist.Link units ward KIA Only 1./91C3YY St:.
RF 124/08 e?)C 3 XYY 028A2.03The step requires an action.In this case,"do NOT" statements are NOT plausible.
 
Change distractors A and D to"only" statements as follows: A.Place hydrogen ignitor in service ONL Y, because recomblner operating temperatures may cause a to containment Integrity due to hydrogen f1amma i1ity.D.Similar but change to hydrogen recombines.
 
ThJ..;.?isaU because of 2 NP distractors.
 
RF 03/24/08 93 C 3 XYY E J,o Q;9A2.01 Do NOT teach in distractors.
 
State that 1 VI-820 is either open or closed and delete the reason from all 4 choices.Furthermore, the stem does NOT solicit the reason just the position.RFA 03/24/08 94 M 2 X XYY E t-Istractor D is not plausible because it is common knowledge that RE's are a technical oversite position with no"permissive" authority.
 
Change choices as follows (example):
A.Shift manager OR Fuel handling SRO B.Fuel handling SRO ONL Y C.Refueling Supervisor OR Fuel handling SRO D.Refueling Supervisor ONL Y EI//95M2 X Y Y G2.2.7._....-............_.......,_...._.1"""'".vllonge'''who is" lU WI,icll Olle ottheiollowir 19 is responsible...
.Reason: The original Q does not read well.I had to read it 3 times before I could figure out what was being asked.RFA 03/24/08)1 1.2.3.Psychometric Flaws 4.Job Content Flaws 5.Other 6.7.Q#I LOK LOD (CIA)(1-5)Stem Cues T/F Credo Partial Job-Minutia#1 Back-Q:: SRO U/E/S Explanation Focus Dist.Link units ward KIA OnlyC3 Xyy G2.2.22 It is common knowledge that PORVs are not credited in accident analysis.Replace distractors C and D.This Q is U because of two NP distractors.
 
RFA 03/24/08 97 C 3 X y y E G2.3.14 j/fhere is no mention of gross specificity in the stem.Why is shutdown and cooldown to<500 F plausible?
CAF RFA 03/24/08 98 M 2 X Y y E Q2:3:6The Q is NOT balanced and renders D not plausible.
 
Re-write Q to incorporate another"release may be approved" f'9-'but for a different reason.Since the KA is the ability to aPcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the release.RFA 03/24/08 99C3 XYY G2.4.46 E Change stem so applicants need to calc Tave via Tstm or acquire Tave by some other means.Otherwise, distractors C and D are not This Q is U because of two P distractors.
 
RFA 03/24/08 ,.., 100C3 X Xyy E G2.4.8 Since there is no direct transition to FR-S.1 ever, distractor A is not plausible.
 
Give the applicant entrance into E-O and to reflect this.RFA 03/24/08-__------
*.Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancement.
 
Question Status S I Question is Sat with NO CommentsEI Editorial Changes Needed E*I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat-editorial elsewhere Partially met KA_.-_._-----------_..--...-
ES-403 Written Examination Grading Quality Checklist Form ES-403-1 Facility: McGuire Date of Exam: May 23,2008 Exam Level: RO X SROX Initials Item Descriptionab c 1.Clean answer sheets copied before grading hIe rfa 2.Answer key changes and question deletions justified hIe rfa and documented 3.Applicants'
scores checked for addition errors hIe rfa (reviewers spot check>25%of examinations)
'NjA 4.Grading for all borderline cases (80+/-2%overall and 70 or 80, hie rfa as applicable,+/-4%on the SRO-only)reviewed in detail 5.All other failing examinations checked to ensure that grades"'N/A N/A are justified, , 6.Performance on missed questions checked for training hIerfa deficiencies and wording problems;evaluate validity of questions missed by half or more of the applicants Printed Name/Signature Date a.Grader Bruno L.Caballero06/30/08 b.Facility Reviewer(*)
N/A J N/Ac.NRC Chief Examiner (*)Ronald F.Aiello'-,Y--07/01108 Malcolm T.Widdmann IHy d.NRC Supervisor (*)07/01108 l/iJ-(*)The facility reviewer's signature is not applicable for examinations graded by the NRC;two independent NRC reviews are require ES*501 Post-Examination Check Sheet Form ES-SQ1-1 Post-Examination Check Sheet Facility: McGuire Date of Examination:
May 12*23, 2008 Task Description Date Complete 1.Facility written exam comments or graded exams received and verified complete 2.Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary 3.Operating tests graded by NRC examiners 4.NRC chief examiner review of operating test and written exam I v, grading completed 5.Responsible supervisor review completed IV.6.Management (licensing official)review completed IV.7.License and denial letters mailed v.8.Facility notified of results I v, 9.Examination report issued (refer to NRC MC 0612)IV.10.Reference material retumed after final resolution of any appeals I N/A Final Submittal (Blue Paper)FINAL OUTLINES ES-401 PWR Examination Outline I Form ES-401-2 (FINAL Facility: McGuire 2008 NRC Date of Exam: 5/1212008 Exam RO KIA Category Points Points Tier GroupKKKKKKAAAA G 1 2 3 4 5 6 1 2 3 4*Total A2 G*Total 1.133333 3 1833 6 Emergency 2 1 2 122 1 9224&Plant Tier Evolutions Totals 4 5 455 4 2755 10 12233 2 3 2 2333 26 3 2 5 2.Plant 211 111 1 1 1 1 1 0 10 0 2 1 3 Systems Tier Totals33 4 4 3 43344 3 38538 3.Generic Knowledge&Abilities 1 2 3 4 1 2 3 4 10 7 Categories3322 1 222 Note: 1.Ensure that at least two topics from every applicable KiA category are sampled within each tier of the RO and SRQ-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the"Tier Totals*in each KIA category shall not be less than two)., 2.The point total for each group and tier in the proposed outline must match that specified in the table.The final point total for each group and tier may deviate by+/-1 from that specified in the table based on NRC revisions.
 
The final RO exam must total 75 points and the SRC-only exam must tota125 points.3.Systems/evolutions within each group are identified on the associated outline;systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site*specmc systems that are not included on the outline should be added.Refer to section D.1.b of ES-401, for guidance regarding elimination of inappropriate KIA statements.
 
4.Select topics from as many systems and evolutions as possible;sample every system or evolution in the group before selecting a second topic for any system or evolution.
 
5.Absent a plant specific priority, only those KAs having an importance rating (IR)of 2.5 or higher shall be selected.Use the RO and SRO ratings for the RO an"CSRC-only portions, respB;ctively.
 
, 6.Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categories.
 
7.-The generic (G)KlAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system.Refer to Section D.1.b of ES-401 for the applicable KIA's 8.On the following pages, enter the KIA numbers, a brief description of each the'topics'
importance ratings (IR)for the applicable license level, and the point totals (#)for each system and category.Enter the group and tier totals for each category in the table above.If fuel handling equipment is sampled in other than Category A2 or G" on the SRQ-only exam, enter it on the left side of CohJmn A2 for Tier 2, Group 2 (Note#1 does not apply).Use duplicate pages for RO and SRQ-only exams.9.For Tier 3, select topics from Section 2 of the KiA Catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#)on Form ES-401-3.Limit SRO selections to KlAs that are linked to 10CFR55.43
,
(ES-401 2 McGuire 2008NRCExam Written Examination Outline Emergency and Abnormal Plant Evolutions
-Tier 1 Group 1 Form ES-401-2 ((009/Small Break LOCA/3 X 2.1.27-Conduct of Operations:
KnoWledge 4.0 7.of sYStem puroose and J or function.0261 Loss of Component Cooling 2.1.25*Conduct of Operations:
Ability 10 X interpret reference materials, such as 4.2 77 Water/8 Qraohs.curves, tables.etc.029{Anticipated Transient Without EA2.01-Ability to determine or intel1lret Scram (ATWS)11 X the follOWIng as they apply to a ATWS: 4.7 78 Reactor nuclear instrumentation EA2.05-Ability to detennine or interpret 0551 Station Blackout/6 X the following as they apply to a Station 3.7 7.Blackout When battery is approadling fully discharoed
: AA2.18-Ability to determine and interpret the following as they apply to the Loss of 056/Loss of Off*site Power/8 X Offsite Power: Reactor coolant 4.0 80 temperature, pressure, and PZR level recorders 2.4.21-Emergency Procedures 1 Plan: Knowledge of the parameters and logic used to assess the status of safety 0581 Loss of DC Power 16 X functions, such as reactivity control, core 4.*81 cooling and heat removal, reactor coolant system integrity, containment conditions, radioactivitY release control, etc.: 2.4.46-Emergency Procedures
/
007 I Reactor Trip 11 X Ability to verify that the alarms are 4.2 3.consistent with the olant conditions.
 
AA 1.03-Ability to operate and I or monitor 008/Pressurizer Vapor Space the following as they apply to the X Pressurizer Vapor Space Accident Turbine 2.8 40 Accident 1 3 bypass in manual contralto maintain header pressure EK2.03*Knowledge of the interrelations oog/Small Break LOCA/3 X between the small break LOCA and (he 3.0 41 followino:
SlGs EK3.06-Knowledge of the reasons for the 011/Large Break LOCA 13 X following responses as the apply to the 4.3 42 Large Break LOCA: Acl\Jatioo of Phase A and B durino LOCA initiation AA1.16-Ability to operate and 1 or monilor 015/17 I Reactor Coolant Pump the following as they apply to the Re.aetor Malfunctions 14 X Coolant Pump Malfunctions (Loss of RC 3.2 43 Flow): Low power reactor trip block status linhts AA2.04-Ability to determine and interpret 022/Loss of Reactor Coolant X the following as they apply to the Loss of 2.'44 Makeup 12 Reactor Coolant Pump Makeup: How long PZR level can be maintained within limits AK2.03-Knowledge of the interrelations 0251 Loss of Residual Heat between the Loss of Residual Heat Removal System 14 X Removal System and the following:
2.7 45 Service water or dosed cooling water I numnsAK1.03-Knowledge of the operational 0271 Pressurizer Pressure Control implications of the following concepts as System Malfunction 13 X they apply to Pressurizer Pressure Control 2.*4.Malfunctions:
Latent heat of vaoorizatiorucondensation 0291 Anticipated Transient Without EK2.06-Knowledge of the interrelations X between the and the following an ATWS: 2.'47 Saam (ATWS)/1 Breakers, relays, and disconnects (ES-401 2 McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions
-Tier 1 Group 1 Form ES-401-2 ((EK3.02-Kno'NIedg8 of the reasons for the 0551 Station Blackout/6 X following responses as the apply to the 4.3 48 Station Blackout Actions oontafned in EOP for loss of offsile and onsite DOWer AA1.12-Ability to operate and/or monitor 0581 Loss of Off-site Power 16 X the following as they apply to the Loss of 3.2 49 Offsite Power: Reactor buildino coolino unit AK3.0t-KnO'Ntedge of the reasons for the 057 I Loss of Vital AC Elecbical followiog.responses as they apply to: the Instrument Bus f 6 X Loss of Vital AC Instrument Bus: Actions 4.'50 contained in EOP for loss of vital ae electrical instrument bus AK1.01*Knowledge of the operational 0581 Loss of DC Power/6 X Implications of the following concepts as 2.8 51 they apply to Loss of DC Power: Battery charoer eouioment and instrumentation AA2.06-Ability to determine and interpret 062/Loss of Nuclear Service.the following as they apply to the Loss of Water/4 X Nuclear Service Water: The length of time 2.8 52 after the loss of CON flow to a component before that comoonent may be damaoed AA2.08-Ability to determine and interpret 0651 Loss of Instrument Air/8 X the following as they apply to the Loss of 2.9 53 Instrument Air: Failure modes of air*oDerated eauipment EK1.2*Knowledge of the operation",l implications of the following ooncepts as E041 LOCA Outside Containment
/they apply to the (LOCA Outside 3 X Containment):
Normal.abnormal and 3.5 54 emergency operating procedures associated{LOCA Outside Containment.
 
2.1.23-Conduct of Operations:
Ability to E11 f Loss of Emergency Coolant X perfOnT!specific system and integrated 4.3 55 Recirculation 14 plant procedures during all modes of plant oDeration.
 
E12 f Unoon\rolJed Depressurization X 2.1.20-Conduct of Operations:
Ability to 4.6 56 of all Steam Generators f 4 internret and execute'nrocedure sten!;.'KJA Category Totals:333366 Group Point Total: I'816 (ES-401 3 McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions
-Tier 1 Group 2 Form ES-401-2 ((AA2.02*Ability to determine and interpret 0031 Dropped Control Rod 11 X the following as they apply to the Dropped 2.8 82 Control Rod: Signal inputs 10 rod control svslem AA2.05-Ability 10 determine and interpret 0331 Loss of Intermediate Range the following as they apply to the Loss of X Intermediate Range Nudear 3.1 83 Nudear Instrumentatioo/7 Instrumentation:
Nature of abnormality, from rapid survey of control room data 0591 Accidental Liquid RadWaste 2.2.38-Equipment Control: Knowledge of X conditions and limitations In the facility 4.5 84 Release/9 license.E06/Degraded Core Cooling/4 X 2.1.20-Conduct of Operations:
Ability to 4.6 85 internre!and execute"nrocedure stenS.AA1.02-Ability to operate and I or monitor ODS/Inoperable/Stuck Control Rod I X the following as they apply to the 3.7 57 1 Inoperable
/Stuck Control Rod: Rod selection switches AA2.03*Ability to determine and interpret the following as they apply to the 024/Emergency Boration/1 X Emergency Boration: Correlation between 2.'58 boric acid controller setpoint and boric acid flow 0321 Loss of Source Range Nudear AK1.01-Knowledge of the operational X implications of the following concepts as 2.5 5'Instrumentation 17 Effects of voltaoe chanoes on oerformance AA1.02-Ability to operate and I or f'!l0nitor 0331 Loss of Intermediate Range X the following as they apply to the Loss of 3.0 60 Nudear Instrumentation
/7 Intermediate Range Nudear Instrumentation:
Level trip bvoass AK2.01-Knowledge of the interrelations 036{Fuel Handling Incidents/8 X between the Fuel Handling Incidents and 2.'61 the following:
Fuel handUng equipment AA2.12*Ability to determine and interpret 067 I Plant Fire On-site 18 X the following as they apply to the Plant 2.'82 Fire on Site: location of vital equipment within fire zone AK3.01-Knowledge of the reasons'for the 0691 Loss of Containment Integrity/following responses as they apply to the X Loss of Containment Integrity:
Guidance 3.8 63 5 in EOP for loss of containment int"""rilv AK2.01*Knowledge of the interrelations 0761 High Reactor Coolant Activity/X between the High Reactor Coolant Activity 2.6 64 , and the following:
Process radiation monitors 2.4.8-Emergency Procedures 1 Plan: E021 SI Termination 13 X Knowledge of how abnormal operating 3.8 65 procedures are used in conjunction
:-vith EOP's.KiA Category Totals:121243 Group Point Total: I 9/4 (ES-401 4 McGuire 2008 NRC Exam Written Examination Outline Plant Systems-Tier 2 Group 1 Form ES-401-2 ((System#I NameKKKKKKAAAA G Imp.a12 3 4 , 6 1 2 3 4*A2.01-Ability to (8)predict the impacts of the following malfunctions or operations on the PZR pes;ana (b)010 Pressurizer Pressure X based on those predictions, use 3.6 86 Control procedures to correct, control, or mitigate the consequences of those malfunctions or operations:
fajrUTes A2.03*Ability to (a)predict the impacts of the following malfunctions or.operations on the CSS;and (b)based 026 Containment Spray X on those predictions, use procedures to 4.4 87 correcl control, or mitigate the of those Of o erations: Failure of ESF 2.4.4-Emergency Procedures I Plan: Ability 10 recognize abnonnal 061 AUxiliarylEmergency X indications for system operating 4.7 86 Feedwaler parameters which are entry*level and abnormal o ratino;ures.2.2.4-Equipment Control: (multi-unit 073 Process Radiation license)Ability to explain the variations Moniloring X in control board layouts, syslems, 3.6 88 instrumentation and actions between units at a fadli.'A2.02*Ability 10 (a)predict the impacts of the following malfunctions or operations on the SWS;and (b)based 076 SefVice Waler X on those predictions, use procedures 10 3.1 80 correct, cootrol, or mitigate the consequences of those malfunctions or operations:
SefVice water header I nressure K1.08-Knowledge of the physical connections and/or cause-effect 003 Reactor Coolant Pump X relationships between the RepS and 2.7 1 the following systems: Containm'ent isolation K5.46-Knowledge of the operational im\::Jfications of the following concepts 004 Chemical and Volume X as they apply to the CVCS:
for 2.'2 Control going solid in PZR (collapsing steam bubble): make no sleam is In PRT when PORV is 0 ened to drain RCS K2.03*Knowledge of bus power 005 Residual Heat Removal X supplies 10 the following:
RCS pressure 2.7 3 bounda'" motor-o";erated valves A4.01*Ability to manually operate 006 Emergency Core Cooling X and/or monitor in the control room: 4.1 4 Pumns A3.01-Ability to monitor automatic 007 Pressurizer Relief/Quench X operation of the PRTS.induding: 2.7 , Tank Components which discharge 10 the PRT K2.02-Knowledge of bus power 008 Component Cooling Water X to pump, 3.0 6 includin em en backu K4.01*Knowledge of COOS design 008 Component Cooling Water X feature{s)
andlor interlock(s)
which 3.1 7 provide for the following:
Automatic star!of standbv num" (ES-401 4 McGuire 2008 NRC Exam Written Examination Outline Plant Systems-Tier 2 Group 1 Form ES-401-2 (System#I NameKKKKKKAAAA G Imp.a 1 2 3 4 5 6 1 234 ,*K1.07*Knowledge of the physical 010 Pressurizer Pressure oonnections and/or cause-effect Control X relationships between the PZR PCS 2.9 8 and the following systems: Containment A3.03-Ability to monitor automatic 012 Reactor Protection X operation of the RPS, including:
Power 3.4 9 sUDol" K6..Q.3*Knowledge of the effect ,of a 012 Reactor Protection X loss or malfunction of the following will 3.3 10 have on the RPS: Trio loalc circuits 013 Engineered Safety K4.08*Knowledge of ESFAS design X feature{s)
and/or interlock{s)
which 3.1 11 Features Actuation I provide for the following Redundancv A2.05-Ability to (a)predict the impacts of the following malfunctions or.operations on the ecs;and (b)based 022 Containment Cooling X on those predictions, use procedures to 3.1 12 correct control, or mitigate the consequences of those malfunctions or operations:
Ma'or leak in CCS: K6,01-Knowledge of the effect of a loss or malfunction of the following will 025 Ice Condenser X have on the ice condenser system: 3.4 13 Upper and lower doors of the ice condenser K501*Knowledge of operational implications of the following concepts 025 Ice Condenser X as they apply to the ice condenser 3.0 14 system: Relationships between I pressure and temPtirature 2.2.22*Equipment Control: Kno,wledge 026 Containment Spray X of limiting conditions for operations and 4.0 15 safety limits.'K3.02*Knowledge of the effect that a 026 Containment Spray X loss or malfunction of the CSS will have 4.2 16 on the following:
Recirculation spray sYStem A4.04-Ability to manually operate 039 Main and Reheat Steam X and/or monitor in the control room: 3.8 17 EmerQenev feedwater pump turbines I
-Knowledge of MRSS design 039 Main and Reheat Steam X feature(s)
and/or interiock(s)
which 3.4 18 provide for the following:
Reactor buildino isolation A 1.03*Ability to predict and/or monitor changes in parameters (to prevent 059 Main Feedwater X exceeding design limits)associated 2.7 19 with operating the MFW controls including:
Power level restrictions for operation of MFW"urn"'" and valves.061 AuxilJaryfEmergency K3.01*Knowledge of the effect that a X loss or malfunction of the AFVII will 4.4 20 Feedwater have on the followino:
RCS A3.05-Ability to mOllitor autom;;ttic 062 AC Electrical Distribution X operation of the ac distribution sYstem.3.5 21 including:
Safety-related indicators and controls A1,01-Ability to predict and/or monitor changes in parameters with 063 DC Electrical Distribution X operating the dc electrical system 2.5 22 controls including:
Battery capaCity as it is affected bv dischame rat (ES-401 4 McGuire 2008NRCExam Written Examination Outline Plant Systems-Tier 2 Group 1 Form ES-401-2 ((System#I NameKK KKKKAAAA G Imp.e 1 2 3 4561 2 3 4*K6.0B*Knowledge of the effect of a 064 Emergency Diesel X Joss or malfunction of the following will 3.2 23 Generator have on the ED/G system: Fuel oil storaoe tanks: A2.01*Ability 10 (a)predlct the impacts of the following malfunctions or operations on the PRM system;and (b)073 Process Radiation X based on those predictions, use.2.5 24 Monitoring pmc;edures 10 correct, control, or mitigate the consequences of those malfunctions or operations:
Erratic or failed DOwer suoolv 2.4.11-Emergency Procedures
/Plan;076 SefVice Water X Knowledge of abnormal condition 4.*25 procedures.K3.07-Knowledge of the effect that a 076 Service Water X loss or malfunction of the SWS will 3.7 26 have on the followino:
ESF loads 2.4.35-Emergency Procedures I Plan: 078 Instrument Air X Knowledge of local auxiliary operator 3.8 27 tasks during emergency and the resultant ooerational effects.A4.01-Ability to manually operate and/or monitor in the control room: 103 Containment X Flow control, pressure control, and 3.2 28 temperature control valves, including Dneumatlc valve controller
: KIA category Totals:22332325335 Group Point Total: I 2815 (ES-401 5 McGuire 2008NRCExam Written Examination Outline Plant Systems-Tier 2 Group 2 Form ES-401-2 ((System#I NameKKKK K K A A A A G Imp.Q123 4 ,6123 4*2.1.7-Conduct of Operations:
Ability to evaluate plant performance and make 015 Nuclear Instrumentation X operational judgments based on 4.7 91 operating characteristics, reactor behavior, and instrument Intemretatlon.
 
A2.03*Ability 10 (a)predict the impacts of the following malfunctions or operations on the HRPS;and (b)based on those predictions, use: 028 Hydrogen Recombiner and Pro<.:edures to correct, control, Of X mitigate the consequences of those 4.0 92 Purge Control malfunctions or operations:
The hydrogen air concentration in excess of limit llame propagation or detonation with resulting equipment dam-age in containment A2.01*Ability to (a)predict the impacts of the following malfunctions or operations on the SAS;and (b)based 079 Station Air X on those predictions, use Procedures 3.2 93 to COfTect.control, or mitigate the consequences of those malfunctions or onl!rations::
Cross-connectlon with lAS K4.03-KnO'N1edge of RPIS design 014 Rod Position Indication X feature{s)
andlor interlock(s)
which 32 29 provide for the following:
Rod Bottom
.K6.01*Knowledge of the effect'of a 017ln-core Temperature X loss or malfunction of the following ITM 2.7 30 Monitor system components:
Sensors and detectors 015 NucJear Instrumentation K2.01*KnO'N1edge of bus pov,te(System X supplies to the following:
NIS channels, 3.3 31 comoonents, and interconnections K1.01*Knowledge of the physical connections andfor cause-effect 028 Hydrogen Recombiner and X relationships between the HRPS and 2.'32 Purge Control the following systems: Containment annulus system (incJl,lding nressure A4.04*Ability to manually opE!f8te 029 Containment Purge X aMrtor monitor in the control room: 3.'33 Containment Evacuation sional K3.01*Knowledge of the effecfthat a 033 SpentFuelPool Cooling X loss or malfunction of the Spent Fuel 2.6 34 Pool Cooling System will have on the followino:
Area ventilation sYStems A2.05-Ability to (a)predict the impacts of the following malfunctions or: operations on the SIGS;and (bY based 035 Steam Generator X on those predictions, use procedures 3.2 35 to correct, control, or mitigate the consequences of those malfunctions or operations:
Unbalanced flows to the SIGs 041 Steam DumplTurbine A3.03*Ability to monitor automatic Bypass Control X operation of the 50S, incJuding:
Steam 2.7 36 flow ES-401 5 McGuire 2008 NRC Exam Written Examination Outline Plant Systems-Tier 2 Group 2 Form ES-401-2 System#I NameKKKKKKAAA A G Imp.Q 1 2 3 456 123 4#A 1.06-Ability to predict and/or r.nonitor changes in parameters(to prevent 071 Waste Gas Disposal X exceeding design limits)associated 2.5 37 with Waste Gas Disposal System operating the controls including:
Ventilation system: K5.03-Knowledge of the operalional implication of the following concepts as 086 Fire Protection X they apply totheFire Protection 3.1 38 System: Effect of water spray on electrical components
: I KIA Category Totals:1111111 311 1 Group Point Total: 12/3 ES-401 Generic Knowledge and Abilities Outline (Tier3): Form ES-40 1-3 (Facility: McGuire 2008 NRC Exam Date: 5/1212008:: RO, SRO-Only Category KIA#Topic IR Q#IR Q#2.1.35 Knowledge of the fuel-handling responsibilities of 3.9 94 SRO's.2.1.18 Ability to make accurate, clear and concise logs, 3.6 66 1.records, status boards, and reports.Conduct 2.1.13 Knowledge of facility requirements for controlling 2.5 ,67 of Operations vitali controlled access.2.1.8 Ability to coordinate personnel activities outside 3.4 68 the control room.Subtotal:3 1 2.2.7 Knowledge of the process for conducting special 3.6 95 or infrequent tests.2.2.22 Knowledge of limiting conditions for operations 4.7 96 and safety limits.2.Ability to apply technical specifications for a Equipment 2.2.40 system.3.4 69 Control 2.2.13 Knowledge of tagging and clearance procedures.
 
4.1 ,70 2.2.6 Knowledge of the process for making changes to 3.0*71 procedures.
 
Subtotal'3 2 Knowledge of radiation or containment hazards 2.3.14 that may arise during normal, abnormal, or 3.8 97 emeraencv conditions or activities.
 
2.3.6 Ability to approve release permits 3.8 98: 3.Radiation 2.3.4 Knowledge of radiation exposure limits under 3.2 72 Control normal or emerQency conditions.
 
2.3.11 Ability to control radiation releases.3.8]3 Subtotal 2 2 2.4.46 Ability to verify that the alarms are consistent 4.2 99 with theplantconditions.
: 2.4.8 Knowledge of how abnormal operating 4.5 100 4.procedures are used in coniunction with EOP's.Emergency Procedures I 2.4.17 Knowledge of EOP terms and definitions.
 
3.9:74 Plan 2.4.14 Knowledge of general guidelines for EOP usage.3.8 75 Subtotal 2 2 Tier 3 Point Total 10 7
}}
}}

Latest revision as of 12:54, 14 November 2019

08-301, 05000370-08-301 May 12-23, 2008 Exam Administrative Documents
ML082950046
Person / Time
Site: Mcguire, McGuire, 05000360  Duke Energy icon.png
Issue date: 10/21/2008
From:
NRC/RGN-II
To:
References
50-369/08-301, 50-370/08-301
Download: ML082950046 (66)
v • d • e


Text

ADMINISTRATIVE DOCUMENTS (Yellow Paper)

1. Exam Preparation Checklist ES-201-1 Exam Outline Quality Checklist ES-201-2 Exam Security Agreement(s) ES-201-3 Administrative Topics Outline (Final) ES-301-1 Control Room Systems & Facility Walk-through Test Outline (Final) ES-301-2 Operating Test Quality Check Sheet ES-301-3 Simulator Scenario Quality Check Sheet ES-301-4 Transient and Event Checklist ES-301-5 Competencies Checklist ES-301-6 10. Written Exam Quality Check Sheet ES-401-6 11. Written Exam Review Worksheet ES-401-9 12. Written Exam Grading Quality Checklist ES-403-1 13. Post-Exam Check Sheet . . . . . . . . . . . . . . . . . . . . .. ES-501-1 14. Facility Submittal Letter [ ]

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: McGuire Date of Examination: _May 12-23, 2008_

Developed by: Written - Facility X NRCD II Operating - Facility X NRCD Target Chief Date* Task Description (Reference) Examiner's Initials-180 Examination administration date confirmed (C.1.a; C.2.a and b) rfa-120 NRC examiners and facility contact assigned (C.1.d; C.2.e) rfa-120 Facility contact briefed on security and other requirements (C.2.c) rfa-120 Corporate notification letter sent (C.2.d) rfa

[-90] [ Reference material due (C.1.e; C.3.c; Attachment 3)] rfa

{-75} Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, rfa ES-301-1, ES-301-2, ES-301-5, ES-D-1 's, ES-401-1/2, ES-401-3~ and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70} { Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)}

{-45} Proposed examinations (including written, walk-through JPMs, and rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; rfa ES-202)

-14 1 Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; rfa ES-202)

-14 1 Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f)

-14 1 Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa-7 1 Written examinations and operating tests approved by NRC supervisor rfa (C.2.i; C.3.h)

-7 1 Final applications reviewed; 1 or 2 (if >10) applications audited to confirm rfa qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 1 Proctoring/written exam administration guidelines reviewed rfa with facility licensee (C.3.k)

-7 1 Approved scenarios, job performance measures, and questions rfa distributed to NRC 'examiners (C.3.i)

  • Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility license [Applies only] {Does not apply} to examinations prepared by the NR ES-201 Examination Outline Quality Checklist Form ES-201-2 Facilit: McGuire Date of Examination: 5/12/08 Initials Item Task Description a b* c# a. Verify that the outline(s) fit(s) the appropriate model per ES-40 b. Assess whether the outline was systematically and randomly prepared in accordance W with Section 0.1 of ES-401 and whether all KIA categories are appropriately sample R c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topic I T d. Assess whether the justifications for deselected or rejected KIA statements are T appropriat E N a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transient S I b. Assess whether there are enough scenario sets (and spares) to test the projected M number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; and ensure that each applicant U can be tested using at least one new or significantly modified scenario, that no L scenarios are duplicated from the applicants' audit testes), and scenarios will not be A repeated on subsequent day T To the extent possible assess whether the outline(s) conform(s) with the qualitative and J

o quantitative criteria specified on Form ES-301-4 and described in Appendix R a. Verify that systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks, W distributed among the safety functions as specified on the form

/

(2) task repetition from the last two NRC examinations is within the limits specified on T

the form, (3)* no tasks are duplicated from the applicants' audit testes)

(4) the number of alternate path, low-power, emergency and RCA tasks meet the criteria on the for b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent day . a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sectio G b. Assess whether the 1OCFR 55.41/43 and 55.45 sampling is appropriat E N

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least E d. Check for duplication and overlap among exam section R e. Check the entire exam for balance of coverag A L Assess whether the exam fits the appropriate job level (RO or SRO Printed N Author David LazaronylWestern Technical Se . 3/14/08 Facility Reviewer (*) NRC Chief Examiner (#) NRC Supervisor NOTE: # Independent NRC reviewer initial items in Column "c", chief examiner concurrence require * Not applicable for NRC-prepared examination outlines NUREG-1021 , Revision 9

ES-201, Rev. 9 Examination Security Agreement Form ES-201-3 Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 5/tt-/Ol

.'

5h1/P'g as ~ tht date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination .5 ) 1'2.~ r>,JI sll ') JI!) S To the best of my knoWled~did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~ . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1.V\Lt,~aL\ ().K~,(~ S:~2.()~ \"'; T1WLOtl..- ~;~.~}

-=A I'/'j t.., tl: J P ~~ NPto (.~ . g 5. EriC e W'J*Z7C*~s.-- (;It>>P? ~~ 5"-z:r-oB" l.lL 'J=az= ~.~

t.p~f/ifti 11. 61JTH-A-$1+ KLlMAR..... $-t,~ ..$:vPF'C~I

!E~~

~r oi-12. NA.~AA) ~ ~,fo,J tt ,,(,.tj'CL =:LA'}'. t...fo co ~--2M$-

13. ~NfS f}j,cue~o OPS({HP 3 ~ 12-0'8 , c D -()~

Fit DQ."fL-04:( Zi-(g--o~ Sec ... ~.,..,/..~.3 14. - - titcJ:.'S -Of:>

15. CUt/JeUf:S NOTES:

f\111~ \)o,'1nI. ~ :1l 6AJS 51\91l41S[ <f- IS'IJT C!..ha.4- GI1l¥<JLf!, /t2./'O-Dj'

~~

G'"

__

\

ofl.J- L 1,,\ J.r; * -I,. be" 1-dJ*PJ;P

00 ~ (he ~'l1£jc ES-20~t Examination* v~~urjty Agreement Form ES-£u 1-3 Pre-Examination S/, 2./0;> Q ..... J I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of 5/19'/03 as .of the date of my signature. I agree that I will not knowingly divulge any information about these exami"nations to any persons who have not been authorized. by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management 'or the NRC chief examiner any indications or suggestions that examination security may have been compromised. Post-Examination .5 )12 \e?J 0,,1-. 5 h91 Db" To the best of my knowledge, I did not a!1vulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of { . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR DATE NOTE NOTES:

dP~ ~ L;',.,J, c; .. b6l".I,l O<J.P~..wf NUREG-1021, Revision 9

Ad~\. . <tf£ ~o~

ES-201 Examination Security Agreement Form ES-201-3

,,'\

t** Pre-Examination <) hz/oP at"').

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of <1tQ,lo1 as of the date of my signature. I agree that I will not knowingly divulge any information about these'examTnations to any.persons~ot been authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security"measures aild requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately re'port to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination 5112..)0 eo,.} :s II 910'd To the best of my knowledge, I did not ivulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically not~d below and authorized by the NR PRINTED NAME JOB TITLE I RESPONSIBILITY DATE DATE NOTE 1. ~H Gt Ae3;JtN£.,1 . De\JeLo ~ 5 . r;.7"o?

2. ~ \\). lJVl:fj/!:o~ ~t~ ~LD,,"C?'~ S~27 . Dg 3. L :I'\J~ G-\:'\,t'rT me GWt~t\. -:::fi,.1t(\Ac.-\--o'" S-23-0'6 4. f"FEo l<< l< K \"1\( ~~ _:r;"\~ fu<'

5. $~1Y HMJ/atlJ,J S'>IV\IL "cNQD(L 6. JtltfNU-.SA~Uk Sit. 6f*H+~ SPlt;"T,j1 7*~c..v..le. L. lVl\ G'I\I~\ s 4cl t\'\ (' VI, "S 1)"'<: . *

8. /4;.., .,~rH JlrLfNoJ . Eo P * \D~$

9. "~/?eSl+ '&In~ , !VlCG(.l*I"~~ nD 1O. L'uf2Jflt It) l-Jo/t ,n ~ ft.,."u2~ I Sf? 0./PSt!'}

11. DAAAyt Bt4cHtiJ"r' /'It ~ ~ I Ao *

12. Cll.tle.ri"M Ji,flwtaf\ OPS !Sk-O 1 ~6 /?'/I//1fs (Y1c Gv; (Ie .:r,.vsfrt.l~loy 14. !\)V~~J 9,m t i H _~0Pt;:""";;::-I-L-:...;;R:..3I _

15. Robert Be:> Ie..- __ tJ-Ps-+--II<.---'--o-----

NOTES: cXp.~ - Li~J~ G~b\,e/").

dPJ;J4' NUREG-1021, Revision 9

ES-301 Administrative Topics Outline Form ES-301-1 Final Facility: McGuire Date of Examination: 5/12/08 Examination Level: SRO Operating Test Number: N08-1 Administrative Topic Type Code* Describe activity to be performed (see Note)

2.1.25 (4.2) Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, et M,R JPM: Calculate Dilution Needed for a Specified 111 Rod Change 2.1.20 (4.6) Ability to interpret and execute procedure Conduct of Operations steps N,R

/JL, JPM: Approve a Completed Procedure 2.2.13 (4.3) Knowledge of Tagging and Clearance Equipment Control Procedures N,R JPM: Review Mechanical and Electrical Isolation

~ Boundaries to Isolate 1B NI Pump 2.3.4 (3.7) Knowledge of radiation exposure under Radiation Control normal or emergency condition N,R JPM: Take On-Site Protective Actions During a 1':1- General Emergency 2.4.44 (4.4) Knowledge of Emergency Plan Protective Emergency Action Recommendations Procedures/Plan N,R JPM: Make Protective Action Recommendations

~ r l

and Perform Initial Notification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S; 3 for ROs; S; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank (~ 1)

(P)revious 2 exams (s; 1; randomly selected)

NUREG-1021, Revision 9

ES-301 Administrative Topics Outline Form ES-301-1 Final Facility: McGuire Date of Examination: 5/12/08 Examination Level: RO Operating Test Number: N08-1 Administrative Topic Type Code* Describe activity to be performed (see Note)

2.1.25 (3.9) Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, et M,R JPM: Calculate Dilution Needed for a Specified AI Rod Change 2.1.19 (3.9) Ability to use plant computers to evaluate Conduct of Operations system or component status N,S JPM: Monitor Critical Safety Function Status

/I~ Trees 2.2.13 (4.1) Knowledge of Tagging and Clearance Equipment Control Procedures N,R JPM: Identify Mechanical and Electrical Isolation IlJ Boundaries to Isolate 1B NI Pump 2.4.13 (4.0) Knowledge of Crew Roles and Emergency Responsibilities During EOP Usage Procedures/Plan M,R JPM: Calculate Reactor Vessel Head Venting J/S- Time NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (s 3 for ROs; s 4 for SROs & RO retakes)

(N)ew or (M)odified from bank (~ 1)

(P)revious 2 exams (s 1; randomly selected)

NUREG-1021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Final Facility: McGuire Date of Examination: 5/12/08 Exam Level (circle one): RO (only) / SRO(I) I SRO (U) Operating Test No.: N08-1 Control Room Systems@ (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U, including 1 ESF)

Type Code* Safety System / JPM Title Function Control Rod Drive System 8,D Retrieve a Dropped Control Rod EPE 038 Steam Generator Tube Rupture S,N,A 3 NC Cooldown During SGTR Reactor Coolant Pump System 8,M,A 4P Start "1 B" Reactor Coolant Pump Auxiliary/Emergency Feedwater System 8,M 48 Operate the Turbine Driven CA Pump from the Control Room Containment Spray System S,N,A,EN 5 Manually Actuate Containment Spray System APE 036 Fuel Handling Incidents Start Outside Air Pressure Filter Fan Following Damage of Spent Fuel 8,M 8 Assembly Nuclear Instrumentation System S,D,A,L 7 Respond to a Source Range Nuclear Instrumentation Failure AC Electrical Distribution System 8,M 6 Restoration of Power to Unit 1 6900V Buses using Offsite Power In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U) Chemical and Volume Control System D,R,E 1 Emergency Borate the Reactor Coolant System Locally Using 2NV-269 APE 065 Loss of Instrument Air D,A,E 8 Ensure Proper Response of Diesel VI Compressors on Loss of VI EPE 055 Station Blackout D,E 6 Establish NC Pump Seal Injection from the SSF NUREG-1 021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Final

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control roo * Type Codes Criteria for RO 1 SRO-I 1 SRO-U (A)lternate path 4-6 (5) /4-6 (5) / 2-3 (3)

(C)ontrol room (D)irect from bank 8 (5) /:.~ 8 (5) / 4 (3)

(E)mergency or abnormal in-plant 1 (3) I~?: 1 (3) / ;2. 1 (2)

(EN)gineered Safety Feature - 1 1 1 (1) (Control Room System)

(L)ow-Power / Shutdown  ;~:~ 1 (1) l~:~: 1 (1) 1 1 (1)

(N)ew or (M)odified from bank including 1(A) >: 2 (6) / 2 (5) / > 1 (2)

(P)revious 2 exams  :.~;; 3 (0) / 3 (0)1 2 (0) (Randomly Selected)

(R)CA 1 (1 )t?~ 1 (1) 1 1 (1)

(S)imulator NUREG-1 021, Revision 9

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: McGuire Date of 5/12/08 Operating Test Number: N08-1 Examination:

Initials 1. GENERAL CRITERIA a b* c# The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution). There is no day-to-day repetition between this and other operating tests to be administered during this examination. The operating test shall not duplicate items from the applicants' audit test(s) (see Section D.1.a). Overlap with the written examination and between different parts of the operating test is within acceptable limits. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license leve . WALK-THROUGH CRITERIA Each JPM includes the following, as applicable:

  • initial conditions
  • initiating cues
  • references and tools, including associated procedures
  • reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
  • operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards ¥

- restrictions on the sequence of steps, if applicable D ~~ Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of "-

\)~ ~ ~

the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201- . SIMULATOR CRITERIA - - -

~" ~

The associated simulator operating tests (scenario sets) have been reviewed in accordance with ~

Form ES-301-4 and a copy is attache DL Printed Name / Signature 1 v)\e;¥ Date

~)t{O" Author David Lazarony, Western Technical Services / t> l r;7\.PL> 5/1/08 Facility Reviewer (*) ~eD ~ \(\~ / i'7fldti1Ad1 \Jew- ,/-&-~ S-J-05 NRC Chief Examiner (#) IldJV AJellb / ~-; ~ I ~J-/t7 t? NRC Supervisor o~I/z/tJ9 NOTE: The facility signature is not applicable for NRC-developed test # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

NUREG-1 021, Revision 9

ES-301 Simulator Scenario Quality Checklist Form ES-301-4

~I 'VA L Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers: 45 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of

\J~ ~

service, but it does not cue the operators into expected event £ c*K Dt"

" The scenarios consist mostly pf related events. Each event description consists of

  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)

,~

~

  • the event termination point (if applicable) l)L Jt No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without -¥ a credible preceding incident such as a seismic even b\- d<K ~ The events are valid with regard to physics and thermodynamic D\'~ ~ ~ Sequencing and timing of events is reasonable, and allows the examination team to obtain complete ~

evaluation results commensurate with the scenario objective \) I~ ~ If time compression techniques are used, the scenario summary clearly so indicates. Operators ¥ have sufficient time to carry out expected activities without undue time constraint DL ~ ~ The simulator modeling is not altere at 6Jd( ~ The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenario *

DL at( ~

1 Every operator will be evaluated using at least one new or significantly modified scenario. All other -¥

~

scenarios have been altered in accordance with Section 0.5 of ES-30 \) ~

1 All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the -¥ form along with the simulator scenarios). DL I~ ~

~

1 Each applicant will be significantly involved in the minimum number of transients and events

~

specified on Form ES-301-5 (submit the form with the simulator scenarios). \)L

~

pL ~ ~

"'f" 1 The level of difficulty is appropriate to support licensing decisions for each crew positio Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes - - -

4 5

--

~

,~ Total malfunctions (5-8) 7 7

~ Malfunctions after EOP entry (1-2) 1 1 ~ Abnormal events (2-4) 4 3 -. Major transients (1-2) 1 1 D '~

~t EOPs entered/requiring substantive actions (1-2) 1 1

~ EOP contingencies requiring substantive actions (0-2) 1 0

~ Critical tasks (2-3) 3 2 NUREG-1 021, Revision 9

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers: 123 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected event . The scenarios consist mostly of related event . Each event description consists of

  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable) No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic even . The events are valid with regard to physics and thermodynamic . Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objective . If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraint . The simulator modeling is not altere . The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional ~ ~J '-. fidelity is maintained while running the planned scenario D \.. ocJ.:'\ ~

1 Every operator will be evaluated using' at least one new or significantly modified scenario. All other '" \...¥ '\\. ~

scenarios have been altered in accordance with Section 0.5 of ES-30 \J ~

11 . All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the ruJ ~

form along with the simulator scenarios). ~,

1 Each applicant will be significantly involved in the minimum number of transients and events ~

specified on Form ES-301-5 (submit the form with the simulator scenarios).

I I - - - - - - - - - - - - _ _ + _ _ _ _ _ + . _ _ ~

1 The level of difficulty is appropriate to support licensing decisions for each crew positio D" Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes 1 2 3 dt 1. Total malfunctions (5-8)

Malfunctions after EOP entry (1-2)

2

2

2

~L p ~ ~" Abnormal events (2-4) 3 3 4 D ~ ~ Major transients (1-2) 1 1 1 l)L 8J< ~ EOPs entered/requiring substantive actions (1-2) 1 1 1 l)'\' '91< ~ EOP contingencies requiring substantive actions (0-2) 1 1 1 DL 8¥ ~ Critical tasks (2-3) 2 2 2 \)\.... ~ ~

NUREG-1 021, Revision 9

ES-301 Transient and Event Checklist Form ES.-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1 A E Scenarios I

P V 1 2 3 4 T M P E 0 I I I L N T

!

N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I

C L M A T U N Y M(*)

T P S A B S A B S A B S A B ,R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P i RX 1 1 : 1 1 0

~

NOR 1 1 1 1 1 2,3, 4,5 6 4 4 2 SRQU-1 I/C  :

4,5

MAJ 6 6 2 2 2 1 TS 3,4 2 0 2 2 RX 0 1 1 0 NOR 3,7 1 3 !1 1 1 1,2, 2,3, :4 4 2 SRQU-2 IIC 9 4,5, 4,5 I

MAJ 8 6 2 2 2 1

TS 1,5 2,3 4 iO 2 2 IfH"

-

RX 0 1 1 0 NOR 3 1 2 1 1 1 2,5 2,3, 4 4 2 SRQU-3 IIC 6 4,5 MAJ 8 6 2 :2 2 1

TS 2,3 2 '0 2 2 RX 0 1 1 0 NOR 3,7 2 1 1 1

,4 4 2 SRQU-4 IIC 1,2, 5 4,5,

MAJ 8 1 2 2 1 1,5 i TS 2 O 2 2 I

Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IIC) malfunctions and one major transient, in the ATC position:. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the A:TC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.S.d) but must be significant per Section C.2.a of Appendix D. (*) ReactiVity and normal evolutions may be replaced with additional instrument or component malfuncti,ons on a 1-for-1 basi . Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actio~s that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Transient and Event Checklist Form ES-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1

A E Scenarios

!

P V 1 2 3 4 T M P E 0 : I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A T U N Y I M(*)

T P S A B S A B S A B S A B R I U

E R T 0 R T 0 R T 0 R T 0 I 0 C P 0 C P 0 C P 0 C P RX 0 I 1 1 0

NOR 3 1 2 1 1 1 2,5 2,3, 6 '4 4 2 SROU-5 I/C 4,5 MAJ 8 6 2 '2 2 1 TS 2,3 2 0 2 2

RX 7 1 :1 1 0 6  :

NOR 1 2 1 1 1 2,3, 1,4, 1,4 4 4 2 SROI-1 IIC 9 :

4,5 6 MAJ 6 8 8 3 2 2 1 TS 3,4 2 0 2 2 RX 4 1 1 1 0 NOR 6 1 i 1 I

1 1 2,5 1,2, ;4 4 2 SROI-2 IIC 7 3,4, I

MAJ 6 8 2 2 2 1

1,2,~ 2 TS 3 iO 2

RX 7 1 2 1 1 0 NOR 1 1 1 1 1 2,3, 1,4, 4,5

,4 4 2 SROI-3 IIC 9 !

4,5 6 MAJ 6 8 6 3 ;2 2 1 TS 3,4 2 0 2 2 Instructions:  : Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must ~erve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must pe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi : Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable action's that provide insight to the applicant's competence count toward the minimum requirements specified forthe applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Transient and Event Checklist Form ES-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Te~t No.: N08-1 A E Scenarios P V 1 2 3 4 T : M P E 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A T  ! U N Y I I M(*)

T P S A B S A B S A B $ A B !R I U E R T 0 R T 6 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P  :

RX 4 1 1 1 0 1- ' 1 NOR 3,7 3 1 1 2,5 1,2, 2,3 9 4 4 2 SROI-4 IIC 4,5, 6 I MAJ 6 8 6 3 2 2 1 TS 1,5 2 10 2 2 RX 4 1 1 1 0 NOR 1 1 :1 1 1 2,5 2,3 4 4 2 RO-1 I/C 4 MAJ 6 6 2 2 2 1 TS 0 0 2 2 RX 7 1 !1 1 0 NOR 1 1 ;1 1 1 I

1,4, 2,3 4 4 2 RO-2 IIC 5

MAJ 8 6 2 ;2 2 1 TS 0 ,0 2 2 RX 1 1 1 1 0 NOR 3 1 1 1 1 2,5 4,5 !4 4 2 RO-3 IIC 4 MAJ 8 6 2 ;2 2 1 TS 0 0 2 2

Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must oe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi ; Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Competencies Checklist Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test ~o.: N08-1 APPLICANTS SRO (U/I) ROIATC BOP Competencies SCENARIO SCENARIO SOENARIO 1 2 3 4 1 2 3 4 1 2 3 4 Interpret/Diagnose 1,4,5 2,q,5 2,4,5 1,4,6 1,4,5 1,3,4 1,2,3 2,3,5 Events and 2-8 1-10 1-8 1-9 6,7,8 7,8 6,

6,8,9 6,7,8 7,8, 6,7,8 6,8,9 7,8 10 Conditions Comply With and Use 2,3,5 1-6, 2,4,5 1,4,6 1,4,5 1,4,5 1,3,4 1,2,3 2,3,5 1-8 1-10 1-8 7,8, Procedures (1) 8-9 6,8 7,8 6,7 6,8 6,7 1p 6,8 6,8,9 Operate Control 2,4,5 1,4,6 j,4,5 1,4,5 1,3,4 2,]5 1,2,3 2,3,5 NA NA NA NA 7'1 ,

Boards (2) 6,8 7,8 6,7 6,8 6,7

6,8 6,8,9 Communicate and 1-8 1-10 1-8 1-9 1-8 1-10 1-8 1-9 1-8 1-~ 0 1-8 1-9 Interact Demonstrate Supervisory Ability 1-8 1-10 1-8 1-9 NA NA NA NA NA NA NA NA (3) i Comply With and Use 3-4 1,5 2-3 1-3 NA NA NA NA NA N~ NA NA Tech. Specs. (3)

Notes:  :

(1 ) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable- competency for every applican i NUREG-1 021, Revision 9

ES-301 Competencies Checklist Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test No.: N08-1 APPLICANTS SRO (U/I) RO/ATC ISOp Competencies SCENARIO SCENARIO SCENARIO 5 5 5 Interpret/Diagnose 1,3,5 2,4,6 Events and 2-8 7,8 7,8 Conditions Comply With and Use 1-8 1,3,5 2,4,6 Procedures (1) 7,8 7 Operate Control NA 1,3,5 2,4,6 Boards (2) 7,8 7 Communicate and 1-8 1-8 1-8 Interact Demonstrate Supervisory Ability 1-8 NA NA (3)

Comply With and Use NA 2,5 NA Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

NUREG-1 021, Revision 9

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: McGuire Date of Exam: 5/12/2008 Exam RO/SRO Level:

Initial Item Descri tion Questions and answers technicalf accurate and a licable to facilit , NRC KJAs referenced for all question FaciHt learnin ob'ectives referenced as avaifabl . SRO uestions are a ro riate in accordance with Section D,2.d of ES..401 The sampling process was random and systematic. (If more than 4 RO and 2 SRO questions were repeated from the last 2 NRC licensing exams) consult the NRR OL Pro ram Office Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_ _ the audit exam was systematically and randomly developed, or

_ _ the audit exam was completed before the license exam was started. or

_ _ the examinations were developed independently, or

~ the licensee certifies that there is no duplication, or other ex lain 6, Bank use meets limits (no more than 75 percent Bank Modified New

~,

from the bank at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only uesUon distribution s at ri h I 7 13/5 53/13 ~ X Between 50 and 60 percent of the question on the Memo CIA RO exam are written at the comprehension/

analysis level; the SRO exam may exceed 60 31/ 6 44/19 (JM cl( \"

,

percent if the randomly selected KJAs support the higher cognitive levels; enter the actual RO I SRO uesUon distribution s at ri ht Referenceslhandouts provided do not give away answers or aid in the elimination of distractors~

~ X- Question content conforms with specific KIA statements in the previously approved Q#4 examination outline and is appropriate for the tier to which they are assigned; deviations are ustifle X '\

v, 1 Question psychometric quality and format meet the guidelines in ES Appendfx ~

1 The exam contains the required number of one-point, multiple choice items; the ~

total is correct and a rees with value on cover shee Printep Name I Signa r Date Author Joseph G. Arsenault ~f"""""'. __

....J.(.L.A# 3/15/2008 Facility. Reviewer (*) NRC Chief Examiner (#) NRC Regional Supervisor Note: * The facility reviewers initials/signature are not applicable for NRC-developed examination # Inde endent NRC reviewer initial items in Column get'; chief examiner concurrence re uired.

NUREG-1021 f Revision 9

(\ ~

ES-401 Written Examination Form ES-401-9 Review Worksheet McGuire 2008-301 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Only Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.) Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOO) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the afPropriate box if a~SYChometric flaw is identified:

  • he stem lacks su Icient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the af~ropriate box if a job content error is identified:
  • e question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirement . Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

RO/SRO Combined Question

~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (0 15). Containment Spray/Knowledge of LCD's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."

/V(JrfY

~)f'/'~ ;Us C4trJ ON £~

1 C 3 X X X Y N E 003K1.08 Stem: b> after powe A and make absolutel no sense. What about RN and KC flow to and from the CPs? N Repair distractors A and 0 or explai RFA 03/25/08

~ r-"'. ,~

1. 12. I 3. P"""omebic FI.ws I 4. Job Co,tent Flews I Oth,,-TS:-I II 0#/1 LOK LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis!.

Job-Link Minutia #1 units Back-ward 0=

KIA SRO I utE/S Onl I Explanation 2 I M I 2 I X Y N I E 1004K5.46 Distractor B is NOT plausible because ALL a8~licants know that RCPs operate when the plant is N solid and DP is maintained. Replace distractor B RFA 03/25/08 3 I M I 2 I X I I I I I I X I I I Y 005K2.03 Third bullet, need a ver Make this Q a fill in the blank with choices as follows:

A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D. 600V Essential Load Centers 1 CLOSED RFA 03/25/08 4 I C I 3 I I I I I I I X I I I Y I~ The emphasis is on the wrong wor Bold the words

"increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 I C I 3 I I I I I X I I I I I ~ C is NOT plausible. Change C to "the reactor coolant drain tank." If the\,do figure out that the #1 seal discharges to the CT, the~ will realize that VCT level will not increase if the filter is c 0B~ed. However, thee may NOT realize that reliefs do N dumcR into the R DT, which makes the RCDT a plausible istracto RFA 03/25/08 6 I M I 2 I I I I X I I I I I I Y I N _008K2.02 If B was correct, D would be also If A was correct, C would be als Distractors C and D need the word "ONLY"

-

This Q is U because of two NP distractor RFA 03/25/08 7 I C I I I I I I I I I Y I~ Verbs missing in bullet This Q has low discriminatory value. Here is a suggested change:

A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU£ply breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08

~ ~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Only 8 C 3 X Y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h

with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor RFA 03/25/08 9 C 3 Y N 5 012A3.03 RFA 03/25/08 10 C 2 Y N 5 012K6.03 RFA 03/25/08 11 M 2 X Y N E 012K4.08 The stem does not read well. There is eather a run on sentence or punctuation is missing. I get lost in i Please re-writ RFA 03/25/08 12 C 3 X Y N 022A2.03 -

It would appear to be common knowledge from an applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a

¥Iausible distracto his Q is U because Band D distractors are not plausibl Show calculation in distractor analysi RFA 03/25/08 13 C 3 Y N 5 025K6.01 RFA 03/25/08 14 M 2 X Y N 025K5.01 Distractors Band D say the same thing. Replace one of the two distractors. As a result, Band D are NOT

¥Iausible. D could ~otential be a subset of herefore this Q is .

RFA 03/25/08

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S Explanation Focus Dis Link units ward KIA Onlv 15 C 3 X Y Y? E 026G2.2.22 o says that the LCO is not applicable,C says the TS will not be entered. What is the difference between 0 and C?

Is this required knowledge for RO applicants since this is NOT a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> TS LCO?

RFA 03/25/08 16 M 2 X Y N 026K3.02 Because the FWST Lo-Lo level alarm has occurred, distractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FWST leve T IS Q is U because there are two NP distractor RFA 03/25/08 17 C 3 X X Y N E 039A4.04 Second Bullet: Normal what supply??

Choices are not complete sentences (generic comment)

RFA 03/25/08 18 C? 2 X X Y N E 039K4.07 I think this Q can be answered even if you delete everything above the WOOTF statement. If so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 19 C 2 X X Y N E 059A1.03 I think this Q also can be answered even if rou delete

. , everything above the WOOTF statement. I so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 20 C 2 X Y N 061K3.01 CF and NCPs are not safety related which renders these two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E 062A3.05 Move "The BO sequencer actuated Train A status light on SI-14" to the stem. Unbold the words "and" and "then."

This will un-complicate the choice RFA 03/25/08

~

Q#I I LOK I . Psychometric Flaws 4. Job Content Flaws LaD t---,----,;---,--,----t--.,------r----,;------ir--.------I 5. Other I .

(CIA) (1-5) Partial Job-Link Back-ward Q:= ISRO I UlE/S KIA ani Explanation 22 I C 2 x x y N E 1063A1.01 Create a fill in the blank as follows:

Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour B. 2 6 RFA 03/25/08 23 I M 2 x y N E 1064K6.08 Stem needs verbs and complete sentences RFA 03/25/08 24 I M 2 y N 5 1073A2.01 RFA 03/25/08 25 I M 2 076G2.4.30 The KA is not met. The KA must involve the SW system

~ireltl~. In the first bullet, it could be any system NOT Just . The RN system has to have a direct impact on the In fact, you could delete all but the last bullet and still answer the Q This Q is a U because KA not me RFA 03/19/08 '

26 I C 076K3.07 To low discriminatory value. Change answer as follows:

A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV Pump Gear oil will overhea B. ONLY the 2A NV Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat. Additionally, all makeup capability is lost to the 2A DG KD surge tan This Q is a U because the discriminatory value is to lo RFA 03/26/08 27 I C 078G2.4.35 RFA 03/26/08

~ /\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S Explanation Focus Dis Link units ward KIA Onlv 28 M 2 X Y N E 103A4.01 Do NOT teach in the stem. Start of with WOOTF...

Then list the valve RFA 03/26/08 29 C 3 X Y N E 014K4.03 Put "Rod F-2 displayed as" in the ste RFA 03/26/08 30 C 3 Y N 5 017K6.01 RFA 03/26/08 31 C 3 Y N 5 015K2.01 RFA 03/26/08 32 M 2  ? X Y N 5? 028K1.01 Why is "decrease" plausible in distractors C and D?

Prove plausibility and Q will be Sa RFA 03/26/08 33 M X Y N 029A4.04 Stem: Change "has" to "have" Add Excore SR monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and D to increase discriminatory valu Q is a U because of low D RFA 03/26/08 34 M 2 Y N 5 033K3.01 RFA 03/26/08* .

35 C 3 X Y N 035A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not

~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q is a U because of two NP distractor RFA 03/26/08 36 C 3 X Y N 041A3.03 If Tave is decreasing, what else would cause it, if there was no steam flow? SU~1gest ~iving them a rod shim because inward rod motion wi! cause a drop in Tav Ri!ilht now distractors A and C are NOT plausible (NP).

This Q is U because of two NP distractor RFA 03/26/08 37 M 2 X Y N E 071A1.06 Remove "in" from the ste RFA 03/26/08

~ /"\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S Explanation Focus Dis Link units ward KIA Onlv 38 M 2 Y N S 086K5.03 RFA 03/26/08 39 M X Y N 007G2.4.46 Place 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08 40 C 3 X Y N 008M1.03 I believe that "A" can be a potentially correct answer because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."

As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3 Y N S 009EK2.03 Much better. Now they have to calc Tste RFA 03/26/08 42 M 2 X X Y N E 011EK3.06 j Distractor "8" does not read correctly. I think "are isolated" sholild be remove If "0" was correct, "C" would be correct als Need the word "only" in RFA 03/26/08 43 C 3 X Y N E 015/017M1.16 Move "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 C 3 Y N S 022M2.04 RFA 03/26/08 45 C 3 X X X Y N E 025AK2.03 The stem does NOT solicit the effect on the KC syste Re-write the stem to do s Regarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a

~osslble correct answe acility please re-evaluat RFA 03/26/08

/'. (\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Only 46 C 3 X y N 51 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy? .

RFA 03/26/08 47 C 3 Y N 5 029EK2.06 RFA 03/26/08 48 M 2 X Y N E 055EK3.02 The stem has to much fru fru. Re-write the stem as follows:

Which one of the following is the bases for NOT depressuriZin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?

To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level RFA 03/26/08 49 M 2 Y N 5 056AA1.12 RFA 03/26/08 50 C 3 X Y N E 057AK3.01

1 To be consistent, why not say in D that turbine impulse pressure channel 1 has failed high (just the opposite of

"C")?

RFA 03/26/08 51 M <2 X X X y N E 058AK1.01 Stem: Underline and bold the word minimum Distractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA 03/26/08 52 M 2 X Y N 062AA2.06

"D" is also a correct answer the way the Q is written. If

"A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so other choices cannot be psychometricall eliminate b This Q is U because two distractors can e eliminated by the wa~ the Q is writte RFA 0 126/08

/'

.. . 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other I 6. I 7.

Q#/I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Onlv 53 I C I 3 I X Y N E 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08 54 I C I 3 I X I I I ? E04EK Stem: BrinB containment feressure up to 8.5 psig to make B, C, and more plausib Why has the PRT ruptured? What is dumping into it to cause that?

RFA 03/26/08 55 I C I 3 I I I I X I I I I I I y E11G2.1.23 ECA-1.1, Step 21 b. RNO states to stop one or more SI

~umps while maintaining >1= to flow required by nclosure 9. Therefore, distractor "Au is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 56 I M I 2 I I I I X I I I I I I y I N _E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no

~rocedure guidance anywhere that directs thi _i' I I I I I I I I _ his Q is U because all three distractors are flawe RFA'03/26/08 II ;1 57 I C I 3 I I I I I I I I I I y I N I S 1005AA1.02 RFA 03/26/08 58 I M I 2 I I I I X I I I I I I y I N _024AA2.03 Stem: Why all the fru fru? Why not just say:

WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm boration flow rate?

Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is a U RFA 03/26/08

~

f\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Onlv 59 C <2 X  ? y N E 032AK1.01 Distractors A and B are week by themselve Change Stem to say:

WOOTF describes the minimum cause of SR N-31 indication?

A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X X X Y N E 033M1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "C" and "D" are NOT solicite Re-work distractors A, C, and RFA 03/26/08 61 C 3 X y N 036AK2.01 Last bullet: This is why verbs an complete sentences are necessaz. Are you saying "a KF pump is operating" or

"the "A" F pump is operating?"

Whay would the ag~licant think that level is to low when they are told that P level is +0.4 feet? Distractor B is s* not plausible. No SFP level trend is provided. Therefore,

\ < a cavity seal failure is not plausibl Why is "C" correct?

Replace distractors Band D. This Q is U because of two NP distractor RFA 03/26/08 62 M 2 X Y N E 067M2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the CPo Replace distractor "A."

RFA 03/26/08 63 M 2 X y N E 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08

~ r---.... ~

1. I Q#/I LOK LOD . Psychometric Flaws I 4. Job Content Flaws ~Othe;-~I II (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= Explanation Focus Dis Link units ward KIA 64 I C I 3 I X Y N 076AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 65 I C I 3 I I I I I I I I I I y I N E02G2. RFA 03/27/08 66 I M I 2 I I I I I I I I I y N G2.1.18 RFA 03/27/08 67 I M I 2 I I I I X I I I I I ~:

y N G2.1.13 Page 7 of 15 of the attached reference states in part:

Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badeed person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is obviously not true and not plausibl This Q is U until these issues on both these distractors are resolve RFA 03/27/08 68 I C I 3 I X I I I X I I I I I I y G2. There are three actions that could work (B,C, and D).

The stem needs to be written to isolate one of the j I I I I I I I I _ Currently there are potentially three correct answer This Q is U until resolve RFA 03/27/08 69 I C X I I I X I I I I I I y 1 N _G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27/08 70 I M I 2 I I I I I I I I I I y N G2.2.2.13 RFA 03/27/08 71 I M I 2 I I I I X I I I X I I I y N G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".

"c" is also a correct answer. "c" is a subset of "D."

This Q is U because of multiple correct answer RFA 03/27/08

~

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 72 C <2 X  ? y N E G2. th bullet: Drop "return via the same ~ath." This is implied and will add to the discriminatory va u Stem: Underline and bold maximu Choices: Delete "no longer than."

Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa RFA 03/27108 73 C 3 Y N S G2.3.11 RFA 03/27108 74 M 2 X Y N G2.4.17 Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27108 75 C <2 X  ? y N E G2.4.14 Change heat sink to an orange path too. As is, the

~uesbon has marginal discriminatory valu FA 03/27108 SROONLY X

.. X Y Y E 009G2.1.27

/

76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....

RFA 03/19/08 77 C 3 X X Y Y E 026G2.1.25 Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....

A. 1.50 GPM 2. Isolate KC ...

Which references will be provided?

RFA 03/19/08

~

. . 3. Psychometric Flaws 4. Job Content Flaws 5.0the~. I 7.

0#/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= Explanation Focus Dis!. Link units ward KIA 78 I C I 3 I X Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete "when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 791 C I 3 I I I I I I I X I I I Y 055EA2.03 The reference document provided does NOT sUfPort the use of Enclosure 9, energizing Unit 1 from Unit .

However, the use of AP-7 is (see step 4 RNa of E-O.)

Please re-evaluat RFA 03/20108 80 I C I 3 I I I I I I I X I I I Y I~ Remove (;) from all choices and align C and D wmer3enc7c is to far to the left)

FA 0 12008 81 I C I 3 I I I I X I I I I I I Y IY _ 058G2.2.37 If D was correct, B would be also. Therefore D is NOT r.lausible

/1'1 I I 1 1 I I I I _ f C was correct, A would be also. Therefore C is NOT plausibl Stem: Need to rewrite stem to include the word

'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 82 I C I 3 I I I I X I I I I I I Y I Y _003M2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is cleari that you could have a significant delta between turbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not

~ausibl edesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 11 RFA 03/20108

  • .

~

/\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S Explanation Focus Dis Link units ward KIA Only 83 C 3 X Y Y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated and the second part to reflect the sam This Q is a U because twodistractors are N RFA 03/21/08 84 M y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include </= to 3 rem WB and </= 10 rem orga This Q is a U because the discriminatory value is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 85 C 3 Y Y 5 E06G2.1.20 RFA 03/21/08 86 C 3 y y 5 010A2.01 RFA 03/21/08 87 C 3 X Y Y 026A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of

, the wording "... Do NOT perform ..."Use the "if' statement in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto II

All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 88 C 3 X X Y Y E 061G2. Stem: Change WR level to 30% ACC. This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are of RFA 03/41/08 89 M 2 X Y Y E 073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?

RF 03/21/08 90 C 3 X X Y Y E 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 91 C 3 Y Y S 015G2. RFA 03/24/08 92 C 3 X Y Y 028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:

A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen flamma ilit D. Similar but change to hydrogen recombine This Q is a U because of 2 NP distractor RFA 03/24/08 93 C 3 X Y Y E 079A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2 X X Y Y E G2.1.35 Distractor D is not plausible because it is common knowledge that RE's are a technical oversite position with no "permissive" authorit Change choices as follows (example): Shift manager OR Fuel handling SRO Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY RFA 03/24/08 95 M 2 X Y Y E G2. Stem: Change "who is" to Which one of the following is responsible...

Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08

  • . ~. . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UtEIS Explanation Focus Dis Link units ward KIA Only 96 C 3 X Y Y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3 X Y Y E G2.3.14 There is no mention of gross specificity in the stem. Why is shutdown and cooldown to < 500 F plausible?

CAF RFA 03/24/08 98 M 2 X Y Y E G2. The Q is NOT balanced and renders D not plausible. Re-write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to afcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3 X Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or acquire Tave by some other means. Otherwise, distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X X Y Y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewrite distractors to reflect thi RFA 03/24/08

  • .
  • Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA

ES-401 Written Examination Form ES-401-9 Review Worksheet McGuire 2008-301 0#1 I LOK LOD . Psychometric Flaws 4. Job Content Flaws 5. Other I .

(CIA) (1-5) Partial Job-Link Minutia I #1 units Back-ward 0=

KIA I SRO Only I UlE/S Explanation Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.] Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the appropriate box if a psychometric flaw is identified:

  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirement ca Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

II At. m'o'm,m, ...moo", 'U" m'o" (*., .. how ~""""'" B "><h~- otbi',""re o~ "'0' ""'). tAJ4) .r1J C RO/SRO Combined Question

~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (Q 15). Containment Spray/Knowledge of LCO's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."

I

,

/ ._- -.."--

C 3 x x x y N 003K1.08 Stem: (,) after powe A and D make absolutely no sense. What about RN and KC flow to and from the NCPs?

Repair distractors A and D or explai RFA 03/25/08

" . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Onlv /

[/

2 M 2 X Y N Ey' 004K5.46 Distractor B is NOT plausible because ALL a8Plicants know that RCPs operate when the plant is N T solid and DP is maintained. Replace distractor B RFA 03/25/08 3 M 2 X X Y N E k5b5K2.03 V Third bullet, need a ver Make this Q a fill in the blank with choices as follows:

. A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D':f;~8:V Essential Load Centers 1 CLOSED RF 3/25/08 4 C 3 X Y N E y klO6A4.01 The emphasis is on the wrong word. Bold the words

"increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 C 3 X Y N E K>07A3.01

.; C is NOT plausibl Change C to "the reactor coolant drain tank." If the'Vdo fi~re out that the #1 seal discharges to the. CT, t e~ will realize that VCT level will not increase if the filter is c 0g~ed. However, thee may NOT realize that reliefs do N dumcft into the R DT, which makes the RCDT a plausible istracto RFA 93/25/08 6 M 2 X Y N 8K2.02 If B was correct, D would be also E If A was correct, C would be als Distractors C and D need the word "ONLY" This Q is U because of two NP distractor RFA 03/25/08 (1 C Y N 8K4.01 erbs missing in bullet This Q has low discriminatory value. Here is a suggested

-_.- - ~hang~:____ .~ .. ..- .... - .. ~ . .- _._ .. -- ._- ___... *

A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU~PIY breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LaD (CIA) (1-5) Stem Cues TIF Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only /

<D c 3 X y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C

. combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h

with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor R~A 03/25/08 9 C 3 Y N SJI 012A3.03 RF~3/25/08 10 C 2 Y N SJ..- ~2K6.03 RFA 03/25/08 11 M 2 X Y N EV ~2K4.08 The stem does not read wel There is eather a run on sentence or punctuation is missing. I get lost in i Please re-wnt RFA 03/25/08 12 cl 3 X Y -~ A2.03 t would appear to be common knowledge from an

.r

£ applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a

¥Iausible distracto his Q is U because Band D distractors are not plausibl ~w calculation in distractor analysi FA 03/25/08 13 C 3 Y N 025K6.01

-- ~ . ~--

- -_ . . - -.... ~- -~ ---- RFA 03/25/08 -- _.- ~ .. ,.

14 M 2 X Y N 0 K5.01 istractors Band D say the same thing. Replace one of ( the two distractors. As a result, Band D are NOT

¥Iausible. D could ~otential be a subset of herefore this Q is .

RFA 03/25/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward KIA Onlv 15 C 3 X Y II Y? 17 E le26G2.2.22

,.

'a .~ d'

~'

~

Iv D says that the LCO is not applicable,C says the T5 will not be entered. What is the difference between D and C?

~ ~

~

Is this required knowledge NOT a 1 hourT RFA 03..£25/08 -[};;::7 RO applicants since this is

~ M 2 X Y N le o02 cause the FW5T Lo-Lo level alarm has occurred, istractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FW5T leve T IS~? U because there are two NP distractor RFA 0 /25/08 t ~~4.04 17 C 3 X X Y N E P . econd Bullet: Normal what supply??

"( ./ c~~s are not complete sentences (generic comment)

,/ :1115

,

RF 3/25/08 A

./

V? X X Y N ' EJ/ '-&39K4.07 ,.JP-J ~ It I think this Q can be answered even if you delete RFAO 5/08 ,~ 7 ~aJ W

everything above the WOOTF statement. If so, delete i This ~ets thejteria to be an questio Y~

~

19 C 2 X X Y 59A1.03

, even if II I ink this Q also can be answered e rything above the WOOTF statemen ,r Th Q meets the criteria to be an (M) questio ou delete so, delete i RFA 93/25/08 20 C 2 X Y N 61K3.01 CF and NCPs are not safety related which renders these E two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E ~3.05

- .... ~-

_.. - " ... ._-- .~. - - -- _....

p

'The.OO seqllencer 8cb !8ted.Irain A .,t",...., I;nht nn 51-14" to the stem. Unbold the words "and" and "then."

This will un-complicate the choice RFA 03/25/08

..

1. I . Job Content Flaws 5. Other I .

0#/1 LOK LOD (CIA) (1-5) Partial Job-Link Back-ward 0=

KIA I SRO I UlE/S Onl Explanation 22 I C 2 x X y N 63A1.01 Create a fill in the blank as follows:

Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour A. 2 4 B. 2 6 RFA 03/25/08 23 M 2 X y N 24 M 2 Y N RFA 03/25/08

,r M 2 -L( ~ 076~~,~.1/

The A is not met. The KA must involve the SW ~stem

~ire~I~. In the first bullet, it could be any system Just

~eQ t:=

. The RN system has to have a direct impact on In fact, you could delete all but the last bullet and answer the Q This Q is a U because KA not me RFA 03/19/08 D

OT Ii I ~ ~

fFI

t1/ f .~

~07~;

Change answer as follows:

A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV pume Gear oil will overhea B. ONLY the 2A N Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear

....__ .... _ * - _ _ _ *1 _____

, ,

oil will overheat. Additionally, all makeup capability is-1ost1u tile 2A DG KD--surge Lall ...- - -

_ '~w'_' __

This Q is a U because the discriminatory value is to lo ~08 Y I N . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Onlv -'

28 M 2 X Y N V ~3A4.01 D~T teach in the stem. Start of with WOOTF ...

The 'st the valve RE 03/26/08 29 C 3 X Y N E}' 014K4.03 Put "Rod F-2 displayed as" in the ste R~ 03/26/08 30 C 3 y N ~~ /017K ~~I RFA 0 126/08 t;

/'

l-

~l- RFA 031

,7 31 C 3 Y N ,o'15K2~

I- ~ 708 32 M 2 7 X y N 57 l ~.01 hy is "decrease" plausible in distractors C and D?

Prove Plausibility~Q will be Sa RFA 03/26/08

~ M X Y N 0 1\4.04 tem: Chan~e "has" to "have" Add Excore R monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and 0 to increase discriminatory valu ~ U because of low D R 03/26/08 34 Y N ~/ 033K3.01 I RFA 03/26/08 35 C 3 X Y N 5A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not

~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q iS9~ because of two NP distractor RFA 3/26/08

~ \.J

. ---,._ ..

A

---_ .. -_._- ~- . --y- A3:03--- ..* _-_ .....

~ " If Tave is decreasing, what else would cause it, if there was no)'team flow? SUli1gest fiiving them a rod shim becalJse inward rod motion wil cause a drop in Tav Ri99t now distractors A and C are NOT plausible (NP).

This Q is U because of two NP distractor RFA 03/26/08 37 M 2 X Y N I/, 071A1.06 Remove "in" from the ste RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only /

38 M 2 Y N sf,-- V086K5.03

..-- RFA 03/26/08 39 M X Y G2.4.46 lace 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08 I

..1. - A

~ b t 40 C 3 X Y

008AA1.03 ~ile., ~

I believe that "A" can be a pot tially corr. ct answer

- because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."

As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3 Y N jY ~9EK2.03Much bette Now they have to calc Tste RFA 03/26/08 42 M 2 X X Y N E 011EK3.06 L ~:actor "S" does not read correctly. I think "are

. olated" should be remove If "0" was correct, "C" would be correct als Need the word "only" in ,

RFA 03/26/08

~17AA1.16

~

43 C 3 X Y N ove "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 r. .. _ 3.._ . -~._-- --- ~_.-

y 1\1. +~V' Q22AA204 .-- ._ .. _-- ---- _.... -

f,/ RFA 03/26/08 45 C 3 X X X Y N E i$03 Th tern does NOT solicit the effect on the KC syste t -write the stem to do s egarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a

~ossible correct answe acility please re-evaluat RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Only I,.;

46 C 3 X Y Nt lA1 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy?

IRFA 03/26/08 47 C 3 Y N tJI' 029EK2.06 RF~ 03/26/08 X Y N k555EK3.02 V

48 M 2 The stem has to much fru fru. Re-write the stem as follows:

Which one of the following is the bases for NOT depressurizin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?

To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level Rij\ 03/26/08 49 M 2 Y N

!Y' 056AA1.12 RFA 03/26/08

~

50 C 3 X Y N -057AK3.01

, , I To be consistent, why not say in 0 that turbine impulse p,ressure channel 1 has failed high Oust the opposite of

~.>? FA 03/26/08 51 M <2 X X X Y N

,/ 058AK1.01 Stem; Underline and bold the word minimum Oistractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA033P108

~ ~

/

-- - .--- .. --- ._. -- "I

- . --- .. .. _-- -_ .. -- --

~

M 2 X JL ~ Y N 2AA2.06 (Ii.. ~;r

"0" is also a correct answer the way the Q is written. If

~ I~ )l f IT ..

~

"A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so I~

other choices cannot be psychometricall eliminate b t CtJ tIP This Q is U because two distractors can e eliminated by the wa~ the Q is writte ,~

"

or RFA 0 126/08

- ., ywv

,-,

,,J

  • .... .

I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws r-;Qther I .

Q#I LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis Job- Minutia Link

  1. 1 units Back-ward Q= I SRO I U/E/S KIA Explanation 53 I C I 3 I X Y 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08 .

54 I C 3 X  ? y E04EK Stem: Bring containment pressure up to 8.5 psig to make B, C, and D more plausibl Why has the PRT ruptured? What is dumping into it to cause that?

RFA 03/26/08 55 I C 3 X E11G2.1.23 ECA-1.1 ,Step 21 b. RNO states to stop one or more SI pumps while maintaining >1= to flow required by Enclosure 9. Therefore, distractor "A" is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 5611 M 2 X y E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no procedure guidance anywhere that directs thi This Q is U because all three distractors are flawe *. I RFA 03/26/08 57 I C I 3 5 M 2 X ~<tAA2.03 Stem: Why all the fru fru? Why not just say:

WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm

... _.- *. _- I I I _ul'_" +-- I I***u ... -~----+----1

~9.r~tiQn flow rate? _

Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is aU RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LaD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 59 C <2 X  ? y N l/ 032AK1.01 Distractors A and B are week by themselve Change Stem to say:

WOOTF describes the minimum cause of SR N-31 indication?

A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X X X Y N l, / 033AA1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "c" and "D" are NOT solicite Re-work distractors A, C, and R~03/26/08 61 C 3 X Y N 036AK2.01 Last bullet: This is why verbs an complete sentences are

/" necessaz. Are you saying "a KF pump is op~rating" or

"the "A" F pump is operating?"

~

Whay would the ag~licant think that level is to low when C-(

C they are told that P level is +0.4 feet? Distractor B is n0j. plausible. No SFP level trend is provided. Therefore, a avity seal failure is not plausibl Why is "c" correct?

Replace distractors Band D. This Q is U because of two

,y NP distractor RFA 03/26/08 62 M 2 X y ~ E 067AA2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the C Replace distractor "A."

RFA 03/26/08

... - .- - .. -. ..

63 M 2 X Y Nt- / 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08

.... ... ... .. .. - .... .. .. ....... ... .. .. . .... . ..... . 3. Psychometric Flaws 4. Job Content Flaws I 7.

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back" Q= Explanation Focus Dis Link units ward KIA B~~II C I 3 I X y AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 1 15 i 65 C 3 Y 66 M 2 Y 67 M 2 X y G2.1.13 Pa!ile 7 of 15 of the attached reference states in part:

Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badged person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is ObviouSlil not true and not plausibl This Q is U un II these issues on both these distractors are resolve RFA 03/27108 08'-' C I 3 I X I I I X I I I I I I y IIbl _G2. There are three actions that could work (B,C, and D).

The stem needs to be written to isolate one of the :, Currently there are potentially three correct answer \I .. I I I I I I I I I V" _

This Q is U until resolve RFA 03/27108 69 I C X I I I X I I I I I I y I t'i _ G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27108

- M __ . .. . '--' --- ._- --~ . _. __ . - --_. .... _~.-

II -~- .... __ ..-

70 M 2 Y

.71) M 2 X X Y G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".

"c" is also a correct answer. "c" is a subset of "D."

This Q is U because of multiple correct answer RFA 03/27108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only ,/

72 C <2 X  ? y Nil

/E G2. th bullet: Drop "return via the same path." This is implied and will add to the discriminatory valu Stem: Underline and bold maximu Choices: Delete "no longer than."

Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa .... RFA 03/27/08 73 C 3 Y N ~ G2.3.11 RFA 03/27/08 II M 2 X Y N G2.4.17 .

Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27/08 75 C <2 X  ? y N E G2.4.14 Change heat sink to an orange path too. As is, the

~uestlon has marginal discriminatory valu FA 03/27/08 SRO ONLY I' ,I X, X y y E l- 009G2.1.27 76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....

RFA 03/19/08

. 7f v .:> -x---- ..... .-.. - _.-. - J\ ---- "'y T t: J,

~6(32:t:25 -- - - - - - - - - - - - - . ,

Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....

A. 1.50 GPM 2. Isolate KC ...

Which references will be provided?

RFA 03/19/08

  • "1" ._ - .. , .- -- - . -- I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other 1 .

Q#I LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis Job-Link Minutia #1 units Back-ward Q=

KIA SRO I U/E/S Onl Explanation 8" C I 3 I X Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 79 I C 3 X y y 055EA2.03 The reference document provided does NOT support the use of Enclosure 9, energizing Unit 1 from Unit However, the use of AP-7 is (see step 4 RNO of E-O.)

Please re-evaluat RFA 03/20108 80 I C 3 X y y 056AA2.18 Remove (;) from all choices and align C and D (Emergency is to far to the left)

RFA 03/20108 81 I C 3 X y y 058G2.2.37 If D was correct, B would be also. Therefore D is NOT plausible

,J If C was correct, A would be also. Therefore C is NOT plausibl .T Stem: Need to rewrite stem to include the word

'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 8~~~ C I 3 X y y 003AA2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is clear-I 1 * - ----I--+- I 'ltlat you comet have a significant deltcrl:mtweeniurbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not plausibl Redesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 111--7 RFA 03/20108 L-/

I 0 *** 0. . . Psychometric Flaws I 4. Job Content Flaws I 5. Other 16:1 #/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= Explanation Focus Dis Link units ward KIA //

a'3~1 C I 3 I X y y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated a ' r n d part to reflect the sam This Q is aU bec us odistractors are N RFA 03/21/08 y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include <1= to 3 rem WB and </= 10 rem or~a This Q is a U because the discriminatory va ue is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 I I y 851 C 3 I I I I I I I I I E06G2.1.20 RFA 03/21/08 C 3 y

~ C 3 X y 26A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of the wording "... Do NOT perform ..."Use the "if' statement

,JI I I I 1 I I I I I _ in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 881 C I 3 I X I I I I X I I I I I y I Y I E~1G2. Stem: Change WR level to 30% AC This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are off.

_ _ _,. _0* _ _ ' BE .__ 3 / 2 1 / 0 8 _ _.00- 00 ... -.....-

89 073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?

~F: 03/21/08 90 I C I 3 I X I I I I I I X I I I Y I Y I E "., 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only 1./

91 C 3 Y Y St:. 0~~:.7 RF 124/08 e? )C

~

3 X Y Y 028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:

A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen f1amma i1it D. Similar but change to hydrogen recombine ThJ..;.? is a U because of 2 NP distractor RF 03/24/08 93 C 3 X Y Y E J,o Q;9A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2 X X Y Y E ~~.35 Istractor D is not plausible because it is common t- knowledge that RE's are a technical oversite position with no "permissive" authorit )1 Change choices as follows (example): Shift manager OR Fuel handling SRO B. Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY R~03/24/08

/

95 . _....-.M 2

~ .. .

~ .....

X_

... .....

Y .. ,

Y .

_.... _ EI/ 1"""'"G2. . vllongewho is" lU WI,icll Olle ottheiollowir 19 is responsible... .

Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q:: SRO U/E/S Explanation Focus Dis Link units ward KIA Only

~ C 3 X y y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3 X y y E G2.3.14 j / fhere is no mention of gross specificity in the ste is shutdown and cooldown to < 500 F plausible?

Why CAF RFA 03/24/08 98 M 2 X Y y E Q2:3:6 The Q is NOT balanced and renders D not plausibl Re-f'9-'

~' write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to aPcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3 X Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or E acquire Tave by some other means. Otherwise,

,..,

distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X X y y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewri~actors to reflect thi RFA 03/24/08

-_ _------

  • Independent of whether or not it met the KA, mis-classified WRT RO/SRO,. or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA

_.- _._---- -------_.. - - ... -

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: McGuire Date of Exam: May 23,2008 Exam Level: RO X SROX Initials Item Description a b c Clean answer sheets copied before grading hIe rfa Answer key changes and question deletions justified hIe rfa and documented Applicants' scores checked for addition errors hIe rfa (reviewers spot check> 25% of examinations)

'NjA Grading for all borderline cases (80 +/-2% overall and 70 or 80, hie rfa as applicable, +/-4% on the SRO-only) reviewed in detail All other failing examinations checked to ensure that grades "'N/A N/A are justified ~ ,

, Performance on missed questions checked for training hIe rfa deficiencies and wording problems; evaluate validity I~~

of questions missed by half or more of the applicants Printed Name/Signature Date a. Grader Bruno L. Caballero $~ 06/30/08 b. Facility Reviewer(*) N/A J N/A c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

Ronald F. Aiello Malcolm T. Widdmann

'-,Y

~

~,1i

-- IHy 07/01108 07/01108 l / iJ

-

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are require ES*501 Post-Examination Check Sheet Form ES-SQ1-1 Post-Examination Check Sheet Facility: McGuire Date of Examination: May 12*23, 2008 Task Description Date Complete Facility written exam comments or graded exams received and verified complete Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary Operating tests graded by NRC examiners I v, NRC chief examiner review of operating test and written exam grading completed I . Responsible supervisor review completed I . Management (licensing official) review completed . License and denial letters mailed I v, Facility notified of results I . Examination report issued (refer to NRC MC 0612)

I N/A 1 Reference material retumed after final resolution of any appeals

Final Submittal (Blue Paper)

FINAL OUTLINES

ES-401 PWR Examination Outline IForm ES-401-2 ( Facility:

McGuire 2008 NRC FINAL Date of Exam: 5/1212008 Exam RO KIA Category Points SRO~Ohly Points Tier Group K K K K K K A A A A G

  • Total A2 G* Total 1 2 3 4 5 6 1 2 3 4 Emergency

& 2 1 2 1 2 2 1 9 2 2 4 Plant Tier Evolutions 4 5 4 5 5 4 27 5 5 10 Totals 1 2 2 3 3 2 3 2 2 3 3 3 26 3 2 5 Plant 2 1 1 1 1 1 1 1 1 1 1 0 10 0 2 1 3 Systems Tier 3 3 4 4 3 4 3 3 4 4 3 38 5 3 8 Totals 1 2 3 4 1 2 3 4 3. Generic Knowledge & Abilities 10 7 Categories 3 3 2 2 1 2 2 2 Note: Ensure that at least two topics from every applicable KiA category are sampled within each tier of the RO and SRQ-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the "Tier Totals* in each KIA category shall not be less than two). , The point total for each group and tier in the proposed outline must match that specified in the tabl The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRC-only exam must tota125 point . Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site*specmc systems that are not included on the outline should be added. Refer to section D.1.b of ES-401, for guidance regarding elimination of inappropriate KIA statement . Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolutio . Absent a plant specific priority, only those KAs having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO an"CSRC-only portions, respB;ctivel , Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categorie .- The generic (G) KlAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable KIA's On the following pages, enter the KIA numbers, a brief description of each ~opic, the'topics' importance ratings (IR) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. If fuel handling equipment is sampled in other than Category A2 or G" on the SRQ-only exam, enter it on the left side of CohJmn A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRQ-only exam . For Tier 3, select topics from Section 2 of the KiA Catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to KlAs that are linked to 10CFR55.43

,

ES-401 2 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 2.1.27 - Conduct of Operations: KnoWledge 009/ Small Break LOCA /3 X of sYStem puroose and J or functio .0 .1.25* Conduct of Operations: Ability 10 0261 Loss of Component Cooling X interpret reference materials, such as Water /8 Qraohs. curves, tables. et EA2.01 - Ability to determine or intel1lret 029 { Anticipated Transient Without X the follOWIng as they apply to a ATWS: Scram (ATWS) 11 Reactor nuclear instrumentation EA2.05 - Ability to detennine or interpret the following as they apply to a Station 0551 Station Blackout /6 X Blackout When battery is approadling fully .

discharoed  :

AA2.18 - Ability to determine and interpret the following as they apply to the Loss of 056/ Loss of Off*site Power /8 X Offsite Power: Reactor coolant temperature, pressure, and PZR level recorders 2.4.21 - Emergency Procedures 1 Plan:

Knowledge of the parameters and logic used to assess the status of safety 0581 Loss of DC Power 16 X functions, such as reactivity control, core 4.* 81 cooling and heat removal, reactor coolant system integrity, containment conditions, radioactivitY release control, et :

2.4.46 - Emergency Procedures / PI~n:

( 007 I Reactor Trip 11 X Ability to verify that the alarms are consistent with the olant condition AA1.03 - Ability to operate and I or monitor .

the following as they apply to the 008/ Pressurizer Vapor Space X Pressurizer Vapor Space Accident Turbine Accident 1 3 bypass in manual contralto maintain header pressure EK2.03* Knowledge of the interrelations oog / Small Break LOCA /3 X between the small break LOCA and (he followino: SlGs EK3.06 - Knowledge of the reasons for the following responses as the apply to the 011 / Large Break LOCA 13 X Large Break LOCA: Acl\Jatioo of Phase A and B durino LOCA initiation AA1.16 - Ability to operate and 1 or monilor the following as they apply to the Re.aetor 015/17 I Reactor Coolant Pump X Coolant Pump Malfunctions (Loss of RC Malfunctions 14 Flow): Low power reactor trip block status linhts AA2.04 - Ability to determine and interpret 022 / Loss of Reactor Coolant the following as they apply to the Loss of X 2.' 44 Makeup 12 Reactor Coolant Pump Makeup: How long PZR level can be maintained within limits AK2.03 - Knowledge of the interrelations between the Loss of Residual Heat 0251 Loss of Residual Heat X Removal System and the following: Removal System 14 Service water or dosed cooling water I numns ~

AK1.03 - Knowledge of the operational implications of the following concepts as 0271 Pressurizer Pressure Control System Malfunction 13 X they apply to Pressurizer Pressure Control 2.* Malfunctions: Latent heat of ( 0291 Anticipated Transient Without X

vaoorizatiorucondensation EK2.06 - Knowledge of the interrelations between the and the following an ATWS: 2.' 47 Saam (ATWS) /1 Breakers, relays, and disconnects

ES-401 2 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 EK3.02 - Kno'NIedg8 of the reasons for the following responses as the apply to the 0551 Station Blackout /6 X Station Blackout Actions oontafned in EOP for loss of offsile and onsite DOWer AA1.12 - Ability to operate and / or monitor 0581 Loss of Off-site Power 16 X the following as they apply to the Loss of Offsite Power: Reactor buildino coolino unit AK3.0t - KnO'Ntedge of the reasons for the followiog.responses as they apply to: the 057 I Loss of Vital AC Elecbical X Loss of Vital AC Instrument Bus: Actions 4.' 50 Instrument Bus f 6 contained in EOP for loss of vital ae electrical instrument bus AK1.01 * Knowledge of the operational Implications of the following concepts as 0581 Loss of DC Power /6 X they apply to Loss of DC Power: Battery charoer eouioment and instrumentation AA2.06 - Ability to determine and interpret the following as they apply to the Loss of 062/ Loss of Nuclear Servic X Nuclear Service Water: The length of time Water / 4 after the loss of CON flow to a component before that comoonent may be damaoed AA2.08 - Ability to determine and interpret the following as they apply to the Loss of 0651 Loss of Instrument Air / 8 X Instrument Air: Failure modes of air*

oDerated eauipment EK1.2 * Knowledge of the operation",l ( E041 LOCA Outside Containment /

X implications of the following ooncepts as they apply to the (LOCA Outside Containment): Normal. abnormal and emergency operating procedures associated ~~ {LOCA Outside Containmen .1.23 - Conduct of Operations: Ability to E11 f Loss of Emergency Coolant perfOnT! specific system and integrated X Recirculation 14 plant procedures during all modes of plant oDeratio E12 f Unoon\rolJed Depressurization 2.1.20 - Conduct of Operations: Ability to X

internret and execute 'nrocedure sten!;. of all Steam Generators f 4

'KJA Category Totals: 3 3 3 3 6 6 Group Point Total:

I '816 (

ES-401 3 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 2 AA2.02 * Ability to determine and interpret the following as they apply to the Dropped 0031 Dropped Control Rod 11 X Control Rod: Signal inputs 10 rod control svslem AA2.05 - Ability 10 determine and interpret the following as they apply to the Loss of 0331 Loss of Intermediate Range Nudear Instrumentatioo/7 X Intermediate Range Nudear 83 Instrumentation: Nature of abnormality, from rapid survey of control room data 2.2.38 - Equipment Control: Knowledge of 0591 Accidental Liquid RadWaste X conditions and limitations In the facility Release /9 licens .1.20 - Conduct of Operations: Ability to E06 / Degraded Core Cooling /4 X internre! and execute "nrocedure sten .6 85 AA1.02 - Ability to operate and I or monitor ODS/Inoperable/Stuck Control Rod I the following as they apply to the X Inoperable / Stuck Control Rod: Rod selection switches AA2.03 * Ability to determine and interpret the following as they apply to the 024/ Emergency Boration /1 X Emergency Boration: Correlation between 2.' 58 boric acid controller setpoint and boric acid flow AK1.01 - Knowledge of the operational 0321 Loss of Source Range Nudear X implications of the following concepts as '

( Instrumentation 17 0331 Loss of Intermediate Range Effects of voltaoe chanoes on oerformance AA1.02 - Ability to operate and I or f'!l0nitor the following as they apply to the Loss of Nudear Instrumentation /7 X

Intermediate Range Nudear Instrumentation: Level trip bvoass AK2.01 - Knowledge of the interrelations 036 { Fuel Handling Incidents /8 X between the Fuel Handling Incidents and 2.' 61 the following: Fuel handUng equipment AA2.12* Ability to determine and interpret the following as they apply to the Plant 067 I Plant Fire On-site 18 X Fire on Site: location of vital equipment 2.' 82 within fire zone AK3.01 - Knowledge of the reasons'for the following responses as they apply to the 0691 Loss of Containment Integrity /

X Loss of Containment Integrity: Guidance contal~ in EOP for loss of containment int"""rilv AK2.01 * Knowledge of the interrelations

,

0761 High Reactor Coolant Activity /

X between the High Reactor Coolant Activity and the following: Process radiation monitors .4.8 - Emergency Procedures 1 Plan:

Knowledge of how abnormal operating E021 SI Termination 13 X procedures are used in conjunction :-vith EOP' KiA Category Totals: 1 2 1 2 4 3 Group Point Total:

I 9/4 (

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 System # I Name K

K K K K 2 3 4 , K

A

A

A

A

G Im a

A2.01 - Ability to (8) predict the impacts of the following malfunctions or operations on the PZR pes; ana (b)

010 Pressurizer Pressure based on those predictions, use X 3.6 86 Control procedures to correct, control, or mitigate the consequences of those malfunctions or operations: Hea~r fajrUTes A2.03 * Ability to (a) predict the impacts of the following malfunctions or .

operations on the CSS; and (b) based 026 Containment Spray X on those predictions, use procedures to 4.4 87 correcl control, or mitigate the

~sequences of those matfun~ons Of o erations: Failure of ESF 2.4.4 - Emergency Procedures I Plan:

Ability 10 recognize abnonnal 061 AUxiliarylEmergency indications for system operating X 4.7 86 Feedwaler parameters which are entry*level

=itiO~S~~ency and abnormal o ratino; ure .2.4 - Equipment Control: (multi-unit license) Ability to explain the variations 073 Process Radiation ( Moniloring X in control board layouts, syslems, instrumentation and p~uraJ actions between units at a fadl '

3.6 88 A2.02* Ability 10 (a) predict the impacts of the following malfunctions or operations on the SWS; and (b) based on those predictions, use procedures 10 076 SefVice Waler X correct, cootrol, or mitigate the 3.1 80 consequences of those malfunctions or operations: SefVice water header I nressure K1.08 - Knowledge of the physical connections and/or cause-effect 003 Reactor Coolant Pump X relationships between the RepS and the following systems: Containm'ent isolation K5.46 - Knowledge of the operational im\::Jfications of the following concepts 004 Chemical and Volume as they apply to the CVCS: Rea~n for X 2.' 2 Control going solid in PZR (collapsing steam bubble): make ~~: no sleam is In PRT when PORV is 0 ened to drain RCS K2.03 * Knowledge of bus power 005 Residual Heat Removal X supplies 10 the following: RCS pressure bounda'" motor-o";erated valves A4.01 * Ability to manually operate 006 Emergency Core Cooling X and/or monitor in the control room: Pumns 007 Pressurizer Relief/Quench Tank X

A3.01 - Ability to monitor automatic operation of the PRTS. induding:

Components which discharge 10 the ,

PRT ( 008 Component Cooling Water X K2.02 - Knowledge of bus power SUPPli~o to :~~i~:ng: ~o: pump, includin em en backu K4.01 * Knowledge of COOS design feature{s) andlor interlock(s) which 008 Component Cooling Water X provide for the following: Automatic star! of standbv num"

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A a System # I Name 1 2 3 4 5 6 1 2 3 4 G

, Im *

K1.07* Knowledge of the physical oonnections and/or cause-effect 010 Pressurizer Pressure X relationships between the PZR PCS 2.9 8 Control and the following systems:

Containment A3.03 - Ability to monitor automatic 012 Reactor Protection X operation of the RPS, including: Power 3.4 9 sUDol" K6..Q.3 * Knowledge of the effect ,of a 012 Reactor Protection X loss or malfunction of the following will 3.3 10 have on the RPS: Trio loalc circuits K4.08* Knowledge of ESFAS design 013 Engineered Safety X feature{s) and/or interlock{s) which 3.1 11 Features Actuation I provide for the following Redundancv A2.05 - Ability to (a) predict the impacts of the following malfunctions or .

operations on the ecs; and (b) based 022 Containment Cooling X on those predictions, use procedures to 3.1 12 correct control, or mitigate the consequences of those malfunctions or operations: Ma'or leak in CCS :

K6,01 - Knowledge of the effect of a loss or malfunction of the following will 025 Ice Condenser X have on the ice condenser system: 3.4 13 Upper and lower doors of the ice condenser K501 * Knowledge of operational implications of the following concepts 025 Ice Condenser X as they apply to the ice condenser 3.0 14 system: Relationships between I pressure and temPtirature 2.2.22* Equipment Control: Kno,wledge 026 Containment Spray X of limiting conditions for operations and 4.0 15 safety limit '

K3.02 * Knowledge of the effect that a loss or malfunction of the CSS will have 026 Containment Spray X 4.2 16 on the following: Recirculation spray sYStem A4.04 - Ability to manually operate 039 Main and Reheat Steam X and/or monitor in the control room: 3.8 17 EmerQenev feedwater pump turbines I ~4:O7 - Knowledge of MRSS design feature(s) and/or interiock(s) which 039 Main and Reheat Steam X 3.4 18 provide for the following: Reactor buildino isolation A1.03 * Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated 059 Main Feedwater X 2.7 19 with operating the MFW controls including: Power level restrictions for operation of MFW "urn"'" and valve K3.01 * Knowledge of the effect that a 061 AuxilJaryfEmergency X loss or malfunction of the AFVII will 4.4 20 Feedwater have on the followino: RCS A3.05 - Ability to mOllitor autom;;ttic 062 AC Electrical Distribution operation of the ac distribution sYste X 3.5 21 ( including: Safety-related indicators and controls A1,01 - Ability to predict and/or monitor changes in parameters aSSociat~ with 063 DC Electrical Distribution X operating the dc electrical system 2.5 22 controls including: Battery capaCity as it is affected bv dischame rate .

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A e System # I Name 1 2 3 4 5 6 1 2 3 4 G Im *

K6.0B * Knowledge of the effect of a 064 Emergency Diesel Joss or malfunction of the following will X

have on the ED/G system: Fuel oil Generator storaoe tanks  :

A2.01 * Ability 10 (a) predlct the impacts of the following malfunctions or operations on the PRM system; and (b)

073 Process Radiation based on those predictions, us X Monitoring pmc;edures 10 correct, control, or mitigate the consequences of those malfunctions or operations: Erratic or failed DOwer suoolv 2.4.11 - Emergency Procedures / Plan; 076 SefVice Water X Knowledge of abnormal condition 4.* 25 procedure ~

K3.07 - Knowledge of the effect that a 076 Service Water X loss or malfunction of the SWS will have on the followino: ESF loads 2.4.35 - Emergency Procedures I Plan:

Knowledge of local auxiliary operator 078 Instrument Air X tasks during emergency and the resultant ooerational effect A4.01 - Ability to manually operate and/or monitor in the control room:

103 Containment X Flow control, pressure control, and ( temperature control valves, including Dneumatlc valve controller :

KIA category Totals: 2 2 3 3 2 3 2 5 3 3 5 Group Point Total: I 2815 (

ES-401 5 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 2 System # I Name K

K

K

K 4 ,

K K

A A A A 1 2 3 4 G Im Q

2.1.7 - Conduct of Operations: Ability to evaluate plant performance and make 015 Nuclear Instrumentation X operational judgments based on 4.7 91 operating characteristics, reactor behavior, and instrument Intemretatlo A2.03* Ability 10 (a) predict the impacts of the following malfunctions or operations on the HRPS; and (b)

based on those predictions, use:

Pro<.:edures to correct, control, Of 028 Hydrogen Recombiner and X mitigate the consequences of those 4.0 92 Purge Control malfunctions or operations: The hydrogen air concentration in excess of limit llame propagation or detonation with resulting equipment dam-age in containment A2.01 * Ability to (a) predict the impacts of the following malfunctions or operations on the SAS; and (b) based 079 Station Air X on those predictions, use Procedures 3.2 93 to COfTect. control, or mitigate the consequences of those malfunctions or onl!rations:: Cross-connectlon with lAS K4.03 - KnO'N1edge of RPIS design ( 014 Rod Position Indication X feature{s) andlor interlock(s) which provide for the following: Rod Bottom lioh~ .

32 29 K6.01 * Knowledge of the effect'of a 017ln-core Temperature loss or malfunction of the following ITM Monitor X system components: Sensors and 2.7 30 detectors K2.01 * KnO'N1edge of bus pov,te(

015 NucJear Instrumentation X supplies to the following: NIS channels, 3.3 31 System comoonents, and interconnections K1.01 * Knowledge of the physical connections andfor cause-effect 028 Hydrogen Recombiner and relationships between the HRPS and Purge Control X 2.' 32 the following systems: Containment annulus venti~\tion system (incJl,lding nressure Iimi~

A4.04 * Ability to manually opE!f8te 029 Containment Purge X aMrtor monitor in the control room: 3.' 33 Containment Evacuation sional K3.01 * Knowledge of the effecfthat a loss or malfunction of the Spent Fuel 033 Spent Fuel Pool Cooling X Pool Cooling System will have on the 2.6 34 followino: Area ventilation sYStems A2.05 - Ability to (a) predict the impacts of the following malfunctions or :

operations on the SIGS; and (bY based on those predictions, use procedures 035 Steam Generator X to correct, control, or mitigate the 3.2 35 consequences of those malfunctions or operations: Unbalanced flows to the SIGs ( 041 Steam DumplTurbine Bypass Control X

A3.03* Ability to monitor automatic operation of the 50S, incJuding: Steam flow 2.7 36

ES-401 5 Form ES-401-2 McGuire 2008 NRC Exam Written Examination Outline Plant Systems - Tier 2 Group 2 K K K K K K A A A A Q System # I Name G Im #

A 1.06 - Ability to predict and/or r.nonitor changes in parameters(to prevent exceeding design limits) associated 071 Waste Gas Disposal X with Waste Gas Disposal System operating the controls including:

Ventilation system  :

K5.03 - Knowledge of the operalional implication of the following concepts as 086 Fire Protection X they apply to the Fire Protection System: Effect of water spray on electrical components

KIA Category Totals: 1 1 1 1 1 1 1 3 1 1 1 Group Point Total:

I 12/3

ES-401 Generic Knowledge and Abilities Outline (Tier3)  : Form ES-40 1-3 ( Facility: McGuire 2008 NRC Exam Date: 5/1212008 :

RO, SRO-Only Category KIA # Topic IR Q# IR Q#

Knowledge of the fuel-handling responsibilities of 2.1.35 SRO' Ability to make accurate, clear and concise logs, 2.1.18 . records, status boards, and report Conduct Knowledge of facility requirements for controlling 2.1.13 ,67 of Operations vitali controlled acces Ability to coordinate personnel activities outside 2. .4 68 the control roo Subtotal :3 1 Knowledge of the process for conducting special 2. .6 95 or infrequent test Knowledge of limiting conditions for operations 2.2.22 and safety limit . Ability to apply technical specifications for a Equipment 2.2.40 syste Control 2.2.13 Knowledge of tagging and clearance procedure .1 ,70 Knowledge of the process for making changes to 2. .0 *71 procedure Subtotal '3 2 Knowledge of radiation or containment hazards 2.3.14 that may arise during normal, abnormal, or emeraencv conditions or activitie . Ability to approve release permits : Radiation Knowledge of radiation exposure limits under 2. .2 72 Control normal or emerQency condition .3.11 Ability to control radiation release .8 ]3 Subtotal 2 2 Ability to verify that the alarms are consistent 2.4.46  : with the plant condition Knowledge of how abnormal operating 2. .5 100 procedures are used in coniunction with EOP' Emergency Procedures I 2.4.17 Knowledge of EOP terms and definition .9 :74 Plan 2.4.14 Knowledge of general guidelines for EOP usag .8 75 Subtotal 2 2 Tier 3 Point Total 10 7

Retrieved from "https://kanterella.com/w/index.php?title=IR_05000360/2008301&oldid=2152165"