IR 05000360/2008301

From kanterella
Jump to navigation Jump to search
08-301, 05000370-08-301 May 12-23, 2008 Exam Administrative Documents
ML082950046
Person / Time
Site: Mcguire, McGuire, 05000360  Duke Energy icon.png
Issue date: 10/21/2008
From:
NRC/RGN-II
To:
References
50-369/08-301, 50-370/08-301
Download: ML082950046 (66)
v • d • e


Text

ADMINISTRATIVE DOCUMENTS (Yellow Paper)

1. Exam Preparation Checklist ES-201-1 Exam Outline Quality Checklist ES-201-2 Exam Security Agreement(s) ES-201-3 Administrative Topics Outline (Final) ES-301-1 Control Room Systems & Facility Walk-through Test Outline (Final) ES-301-2 Operating Test Quality Check Sheet ES-301-3 Simulator Scenario Quality Check Sheet ES-301-4 Transient and Event Checklist ES-301-5 Competencies Checklist ES-301-6 10. Written Exam Quality Check Sheet ES-401-6 11. Written Exam Review Worksheet ES-401-9 12. Written Exam Grading Quality Checklist ES-403-1 13. Post-Exam Check Sheet . . . . . . . . . . . . . . . . . . . . .. ES-501-1 14. Facility Submittal Letter [ ]

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: McGuire Date of Examination: _May 12-23, 2008_

Developed by: Written - Facility X NRCD II Operating - Facility X NRCD Target Chief Date* Task Description (Reference) Examiner's Initials-180 Examination administration date confirmed (C.1.a; C.2.a and b) rfa-120 NRC examiners and facility contact assigned (C.1.d; C.2.e) rfa-120 Facility contact briefed on security and other requirements (C.2.c) rfa-120 Corporate notification letter sent (C.2.d) rfa

[-90] [ Reference material due (C.1.e; C.3.c; Attachment 3)] rfa

{-75} Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, rfa ES-301-1, ES-301-2, ES-301-5, ES-D-1 's, ES-401-1/2, ES-401-3~ and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70} { Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)}

{-45} Proposed examinations (including written, walk-through JPMs, and rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; rfa ES-202)

-14 1 Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; rfa ES-202)

-14 1 Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f)

-14 1 Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa-7 1 Written examinations and operating tests approved by NRC supervisor rfa (C.2.i; C.3.h)

-7 1 Final applications reviewed; 1 or 2 (if >10) applications audited to confirm rfa qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 1 Proctoring/written exam administration guidelines reviewed rfa with facility licensee (C.3.k)

-7 1 Approved scenarios, job performance measures, and questions rfa distributed to NRC 'examiners (C.3.i)

  • Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility license [Applies only] {Does not apply} to examinations prepared by the NR ES-201 Examination Outline Quality Checklist Form ES-201-2 Facilit: McGuire Date of Examination: 5/12/08 Initials Item Task Description a b* c# a. Verify that the outline(s) fit(s) the appropriate model per ES-40 b. Assess whether the outline was systematically and randomly prepared in accordance W with Section 0.1 of ES-401 and whether all KIA categories are appropriately sample R c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topic I T d. Assess whether the justifications for deselected or rejected KIA statements are T appropriat E N a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transient S I b. Assess whether there are enough scenario sets (and spares) to test the projected M number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; and ensure that each applicant U can be tested using at least one new or significantly modified scenario, that no L scenarios are duplicated from the applicants' audit testes), and scenarios will not be A repeated on subsequent day T To the extent possible assess whether the outline(s) conform(s) with the qualitative and J

o quantitative criteria specified on Form ES-301-4 and described in Appendix R a. Verify that systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks, W distributed among the safety functions as specified on the form

/

(2) task repetition from the last two NRC examinations is within the limits specified on T

the form, (3)* no tasks are duplicated from the applicants' audit testes)

(4) the number of alternate path, low-power, emergency and RCA tasks meet the criteria on the for b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent day . a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sectio G b. Assess whether the 1OCFR 55.41/43 and 55.45 sampling is appropriat E N

c. Ensure that KIA importance ratings (except for plant-specific priorities) are at least E d. Check for duplication and overlap among exam section R e. Check the entire exam for balance of coverag A L Assess whether the exam fits the appropriate job level (RO or SRO Printed N Author David LazaronylWestern Technical Se . 3/14/08 Facility Reviewer (*) NRC Chief Examiner (#) NRC Supervisor NOTE: # Independent NRC reviewer initial items in Column "c", chief examiner concurrence require * Not applicable for NRC-prepared examination outlines NUREG-1021 , Revision 9

ES-201, Rev. 9 Examination Security Agreement Form ES-201-3 Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 5/tt-/Ol

.'

5h1/P'g as ~ tht date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination .5 ) 1'2.~ r>,JI sll ') JI!) S To the best of my knoWled~did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ~ . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1.V\Lt,~aL\ ().K~,(~ S:~2.()~ \"'; T1WLOtl..- ~;~.~}

-=A I'/'j t.., tl: J P ~~ NPto (.~ . g 5. EriC e W'J*Z7C*~s.-- (;It>>P? ~~ 5"-z:r-oB" l.lL 'J=az= ~.~

t.p~f/ifti 11. 61JTH-A-$1+ KLlMAR..... $-t,~ ..$:vPF'C~I

!E~~

~r oi-12. NA.~AA) ~ ~,fo,J tt ,,(,.tj'CL =:LA'}'. t...fo co ~--2M$-

13. ~NfS f}j,cue~o OPS({HP 3 ~ 12-0'8 , c D -()~

Fit DQ."fL-04:( Zi-(g--o~ Sec ... ~.,..,/..~.3 14. - - titcJ:.'S -Of:>

15. CUt/JeUf:S NOTES:

f\111~ \)o,'1nI. ~ :1l 6AJS 51\91l41S[ <f- IS'IJT C!..ha.4- GI1l¥<JLf!, /t2./'O-Dj'

~~

G'"

__

\

ofl.J- L 1,,\ J.r; * -I,. be" 1-dJ*PJ;P

00 ~ (he ~'l1£jc ES-20~t Examination* v~~urjty Agreement Form ES-£u 1-3 Pre-Examination S/, 2./0;> Q ..... J I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of 5/19'/03 as .of the date of my signature. I agree that I will not knowingly divulge any information about these exami"nations to any persons who have not been authorized. by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management 'or the NRC chief examiner any indications or suggestions that examination security may have been compromised. Post-Examination .5 )12 \e?J 0,,1-. 5 h91 Db" To the best of my knowledge, I did not a!1vulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of { . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NR DATE NOTE NOTES:

dP~ ~ L;',.,J, c; .. b6l".I,l O<J.P~..wf NUREG-1021, Revision 9

Ad~\. . <tf£ ~o~

ES-201 Examination Security Agreement Form ES-201-3

,,'\

t** Pre-Examination <) hz/oP at"').

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks(s) of <1tQ,lo1 as of the date of my signature. I agree that I will not knowingly divulge any information about these'examTnations to any.persons~ot been authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback. Furthermore, I am aware of the physical security"measures aild requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately re'port to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination 5112..)0 eo,.} :s II 910'd To the best of my knowledge, I did not ivulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically not~d below and authorized by the NR PRINTED NAME JOB TITLE I RESPONSIBILITY DATE DATE NOTE 1. ~H Gt Ae3;JtN£.,1 . De\JeLo ~ 5 . r;.7"o?

2. ~ \\). lJVl:fj/!:o~ ~t~ ~LD,,"C?'~ S~27 . Dg 3. L :I'\J~ G-\:'\,t'rT me GWt~t\. -:::fi,.1t(\Ac.-\--o'" S-23-0'6 4. f"FEo l<< l< K \"1\( ~~ _:r;"\~ fu<'

5. $~1Y HMJ/atlJ,J S'>IV\IL "cNQD(L 6. JtltfNU-.SA~Uk Sit. 6f*H+~ SPlt;"T,j1 7*~c..v..le. L. lVl\ G'I\I~\ s 4cl t\'\ (' VI, "S 1)"'<: . *

8. /4;.., .,~rH JlrLfNoJ . Eo P * \D~$

9. "~/?eSl+ '&In~ , !VlCG(.l*I"~~ nD 1O. L'uf2Jflt It) l-Jo/t ,n ~ ft.,."u2~ I Sf? 0./PSt!'}

11. DAAAyt Bt4cHtiJ"r' /'It ~ ~ I Ao *

12. Cll.tle.ri"M Ji,flwtaf\ OPS !Sk-O 1 ~6 /?'/I//1fs (Y1c Gv; (Ie .:r,.vsfrt.l~loy 14. !\)V~~J 9,m t i H _~0Pt;:""";;::-I-L-:...;;R:..3I _

15. Robert Be:> Ie..- __ tJ-Ps-+--II<.---'--o-----

NOTES: cXp.~ - Li~J~ G~b\,e/").

dPJ;J4' NUREG-1021, Revision 9

ES-301 Administrative Topics Outline Form ES-301-1 Final Facility: McGuire Date of Examination: 5/12/08 Examination Level: SRO Operating Test Number: N08-1 Administrative Topic Type Code* Describe activity to be performed (see Note)

2.1.25 (4.2) Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, et M,R JPM: Calculate Dilution Needed for a Specified 111 Rod Change 2.1.20 (4.6) Ability to interpret and execute procedure Conduct of Operations steps N,R

/JL, JPM: Approve a Completed Procedure 2.2.13 (4.3) Knowledge of Tagging and Clearance Equipment Control Procedures N,R JPM: Review Mechanical and Electrical Isolation

~ Boundaries to Isolate 1B NI Pump 2.3.4 (3.7) Knowledge of radiation exposure under Radiation Control normal or emergency condition N,R JPM: Take On-Site Protective Actions During a 1':1- General Emergency 2.4.44 (4.4) Knowledge of Emergency Plan Protective Emergency Action Recommendations Procedures/Plan N,R JPM: Make Protective Action Recommendations

~ r l

and Perform Initial Notification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S; 3 for ROs; S; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank (~ 1)

(P)revious 2 exams (s; 1; randomly selected)

NUREG-1021, Revision 9

ES-301 Administrative Topics Outline Form ES-301-1 Final Facility: McGuire Date of Examination: 5/12/08 Examination Level: RO Operating Test Number: N08-1 Administrative Topic Type Code* Describe activity to be performed (see Note)

2.1.25 (3.9) Ability to interpret reference materials, such Conduct of Operations as graphs, curves, tables, et M,R JPM: Calculate Dilution Needed for a Specified AI Rod Change 2.1.19 (3.9) Ability to use plant computers to evaluate Conduct of Operations system or component status N,S JPM: Monitor Critical Safety Function Status

/I~ Trees 2.2.13 (4.1) Knowledge of Tagging and Clearance Equipment Control Procedures N,R JPM: Identify Mechanical and Electrical Isolation IlJ Boundaries to Isolate 1B NI Pump 2.4.13 (4.0) Knowledge of Crew Roles and Emergency Responsibilities During EOP Usage Procedures/Plan M,R JPM: Calculate Reactor Vessel Head Venting J/S- Time NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (s 3 for ROs; s 4 for SROs & RO retakes)

(N)ew or (M)odified from bank (~ 1)

(P)revious 2 exams (s 1; randomly selected)

NUREG-1021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Final Facility: McGuire Date of Examination: 5/12/08 Exam Level (circle one): RO (only) / SRO(I) I SRO (U) Operating Test No.: N08-1 Control Room Systems@ (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U, including 1 ESF)

Type Code* Safety System / JPM Title Function Control Rod Drive System 8,D Retrieve a Dropped Control Rod EPE 038 Steam Generator Tube Rupture S,N,A 3 NC Cooldown During SGTR Reactor Coolant Pump System 8,M,A 4P Start "1 B" Reactor Coolant Pump Auxiliary/Emergency Feedwater System 8,M 48 Operate the Turbine Driven CA Pump from the Control Room Containment Spray System S,N,A,EN 5 Manually Actuate Containment Spray System APE 036 Fuel Handling Incidents Start Outside Air Pressure Filter Fan Following Damage of Spent Fuel 8,M 8 Assembly Nuclear Instrumentation System S,D,A,L 7 Respond to a Source Range Nuclear Instrumentation Failure AC Electrical Distribution System 8,M 6 Restoration of Power to Unit 1 6900V Buses using Offsite Power In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U) Chemical and Volume Control System D,R,E 1 Emergency Borate the Reactor Coolant System Locally Using 2NV-269 APE 065 Loss of Instrument Air D,A,E 8 Ensure Proper Response of Diesel VI Compressors on Loss of VI EPE 055 Station Blackout D,E 6 Establish NC Pump Seal Injection from the SSF NUREG-1 021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Final

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control roo * Type Codes Criteria for RO 1 SRO-I 1 SRO-U (A)lternate path 4-6 (5) /4-6 (5) / 2-3 (3)

(C)ontrol room (D)irect from bank 8 (5) /:.~ 8 (5) / 4 (3)

(E)mergency or abnormal in-plant 1 (3) I~?: 1 (3) / ;2. 1 (2)

(EN)gineered Safety Feature - 1 1 1 (1) (Control Room System)

(L)ow-Power / Shutdown  ;~:~ 1 (1) l~:~: 1 (1) 1 1 (1)

(N)ew or (M)odified from bank including 1(A) >: 2 (6) / 2 (5) / > 1 (2)

(P)revious 2 exams  :.~;; 3 (0) / 3 (0)1 2 (0) (Randomly Selected)

(R)CA 1 (1 )t?~ 1 (1) 1 1 (1)

(S)imulator NUREG-1 021, Revision 9

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: McGuire Date of 5/12/08 Operating Test Number: N08-1 Examination:

Initials 1. GENERAL CRITERIA a b* c# The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution). There is no day-to-day repetition between this and other operating tests to be administered during this examination. The operating test shall not duplicate items from the applicants' audit test(s) (see Section D.1.a). Overlap with the written examination and between different parts of the operating test is within acceptable limits. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license leve . WALK-THROUGH CRITERIA Each JPM includes the following, as applicable:

  • initial conditions
  • initiating cues
  • references and tools, including associated procedures
  • reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
  • operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards ¥

- restrictions on the sequence of steps, if applicable D ~~ Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of "-

\)~ ~ ~

the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201- . SIMULATOR CRITERIA - - -

~" ~

The associated simulator operating tests (scenario sets) have been reviewed in accordance with ~

Form ES-301-4 and a copy is attache DL Printed Name / Signature 1 v)\e;¥ Date

~)t{O" Author David Lazarony, Western Technical Services / t> l r;7\.PL> 5/1/08 Facility Reviewer (*) ~eD ~ \(\~ / i'7fldti1Ad1 \Jew- ,/-&-~ S-J-05 NRC Chief Examiner (#) IldJV AJellb / ~-; ~ I ~J-/t7 t? NRC Supervisor o~I/z/tJ9 NOTE: The facility signature is not applicable for NRC-developed test # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

NUREG-1 021, Revision 9

ES-301 Simulator Scenario Quality Checklist Form ES-301-4

~I 'VA L Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers: 45 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of

\J~ ~

service, but it does not cue the operators into expected event £ c*K Dt"

" The scenarios consist mostly pf related events. Each event description consists of

  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)

,~

~

  • the event termination point (if applicable) l)L Jt No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without -¥ a credible preceding incident such as a seismic even b\- d<K ~ The events are valid with regard to physics and thermodynamic D\'~ ~ ~ Sequencing and timing of events is reasonable, and allows the examination team to obtain complete ~

evaluation results commensurate with the scenario objective \) I~ ~ If time compression techniques are used, the scenario summary clearly so indicates. Operators ¥ have sufficient time to carry out expected activities without undue time constraint DL ~ ~ The simulator modeling is not altere at 6Jd( ~ The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenario *

DL at( ~

1 Every operator will be evaluated using at least one new or significantly modified scenario. All other -¥

~

scenarios have been altered in accordance with Section 0.5 of ES-30 \) ~

1 All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the -¥ form along with the simulator scenarios). DL I~ ~

~

1 Each applicant will be significantly involved in the minimum number of transients and events

~

specified on Form ES-301-5 (submit the form with the simulator scenarios). \)L

~

pL ~ ~

"'f" 1 The level of difficulty is appropriate to support licensing decisions for each crew positio Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes - - -

4 5

--

~

,~ Total malfunctions (5-8) 7 7

~ Malfunctions after EOP entry (1-2) 1 1 ~ Abnormal events (2-4) 4 3 -. Major transients (1-2) 1 1 D '~

~t EOPs entered/requiring substantive actions (1-2) 1 1

~ EOP contingencies requiring substantive actions (0-2) 1 0

~ Critical tasks (2-3) 3 2 NUREG-1 021, Revision 9

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: McGuire Date of Exam: 5/12/08 Scenario Numbers: 123 Operating Test No.: N08-1 QUALITATIVE ATTRIBUTES Initials a b* c# The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected event . The scenarios consist mostly of related event . Each event description consists of

  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable) No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic even . The events are valid with regard to physics and thermodynamic . Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objective . If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraint . The simulator modeling is not altere . The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional ~ ~J '-. fidelity is maintained while running the planned scenario D \.. ocJ.:'\ ~

1 Every operator will be evaluated using' at least one new or significantly modified scenario. All other '" \...¥ '\\. ~

scenarios have been altered in accordance with Section 0.5 of ES-30 \J ~

11 . All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the ruJ ~

form along with the simulator scenarios). ~,

1 Each applicant will be significantly involved in the minimum number of transients and events ~

specified on Form ES-301-5 (submit the form with the simulator scenarios).

I I - - - - - - - - - - - - _ _ + _ _ _ _ _ + . _ _ ~

1 The level of difficulty is appropriate to support licensing decisions for each crew positio D" Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes 1 2 3 dt 1. Total malfunctions (5-8)

Malfunctions after EOP entry (1-2)

2

2

2

~L p ~ ~" Abnormal events (2-4) 3 3 4 D ~ ~ Major transients (1-2) 1 1 1 l)L 8J< ~ EOPs entered/requiring substantive actions (1-2) 1 1 1 l)'\' '91< ~ EOP contingencies requiring substantive actions (0-2) 1 1 1 DL 8¥ ~ Critical tasks (2-3) 2 2 2 \)\.... ~ ~

NUREG-1 021, Revision 9

ES-301 Transient and Event Checklist Form ES.-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1 A E Scenarios I

P V 1 2 3 4 T M P E 0 I I I L N T

!

N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I

C L M A T U N Y M(*)

T P S A B S A B S A B S A B ,R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P i RX 1 1 : 1 1 0

~

NOR 1 1 1 1 1 2,3, 4,5 6 4 4 2 SRQU-1 I/C  :

4,5

MAJ 6 6 2 2 2 1 TS 3,4 2 0 2 2 RX 0 1 1 0 NOR 3,7 1 3 !1 1 1 1,2, 2,3, :4 4 2 SRQU-2 IIC 9 4,5, 4,5 I

MAJ 8 6 2 2 2 1

TS 1,5 2,3 4 iO 2 2 IfH"

-

RX 0 1 1 0 NOR 3 1 2 1 1 1 2,5 2,3, 4 4 2 SRQU-3 IIC 6 4,5 MAJ 8 6 2 :2 2 1

TS 2,3 2 '0 2 2 RX 0 1 1 0 NOR 3,7 2 1 1 1

,4 4 2 SRQU-4 IIC 1,2, 5 4,5,

MAJ 8 1 2 2 1 1,5 i TS 2 O 2 2 I

Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IIC) malfunctions and one major transient, in the ATC position:. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the A:TC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.S.d) but must be significant per Section C.2.a of Appendix D. (*) ReactiVity and normal evolutions may be replaced with additional instrument or component malfuncti,ons on a 1-for-1 basi . Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actio~s that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Transient and Event Checklist Form ES-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Test No.: N08-1

A E Scenarios

!

P V 1 2 3 4 T M P E 0 : I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A T U N Y I M(*)

T P S A B S A B S A B S A B R I U

E R T 0 R T 0 R T 0 R T 0 I 0 C P 0 C P 0 C P 0 C P RX 0 I 1 1 0

NOR 3 1 2 1 1 1 2,5 2,3, 6 '4 4 2 SROU-5 I/C 4,5 MAJ 8 6 2 '2 2 1 TS 2,3 2 0 2 2

RX 7 1 :1 1 0 6  :

NOR 1 2 1 1 1 2,3, 1,4, 1,4 4 4 2 SROI-1 IIC 9 :

4,5 6 MAJ 6 8 8 3 2 2 1 TS 3,4 2 0 2 2 RX 4 1 1 1 0 NOR 6 1 i 1 I

1 1 2,5 1,2, ;4 4 2 SROI-2 IIC 7 3,4, I

MAJ 6 8 2 2 2 1

1,2,~ 2 TS 3 iO 2

RX 7 1 2 1 1 0 NOR 1 1 1 1 1 2,3, 1,4, 4,5

,4 4 2 SROI-3 IIC 9 !

4,5 6 MAJ 6 8 6 3 ;2 2 1 TS 3,4 2 0 2 2 Instructions:  : Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must ~erve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two IIC malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must pe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi : Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable action's that provide insight to the applicant's competence count toward the minimum requirements specified forthe applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Transient and Event Checklist Form ES-301-5 FINAL Facility: McGuire Date of Exam: 5/12/08 Operating Te~t No.: N08-1 A E Scenarios P V 1 2 3 4 T : M P E 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A T  ! U N Y I I M(*)

T P S A B S A B S A B $ A B !R I U E R T 0 R T 6 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P  :

RX 4 1 1 1 0 1- ' 1 NOR 3,7 3 1 1 2,5 1,2, 2,3 9 4 4 2 SROI-4 IIC 4,5, 6 I MAJ 6 8 6 3 2 2 1 TS 1,5 2 10 2 2 RX 4 1 1 1 0 NOR 1 1 :1 1 1 2,5 2,3 4 4 2 RO-1 I/C 4 MAJ 6 6 2 2 2 1 TS 0 0 2 2 RX 7 1 !1 1 0 NOR 1 1 ;1 1 1 I

1,4, 2,3 4 4 2 RO-2 IIC 5

MAJ 8 6 2 ;2 2 1 TS 0 ,0 2 2 RX 1 1 1 1 0 NOR 3 1 1 1 1 2,5 4,5 !4 4 2 RO-3 IIC 4 MAJ 8 6 2 ;2 2 1 TS 0 0 2 2

Instructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are riot applicable for RO applicants. ROs must service in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC positio . Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must oe significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basi ; Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

NUREG 1021 Revision 9

ES-301 Competencies Checklist Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test ~o.: N08-1 APPLICANTS SRO (U/I) ROIATC BOP Competencies SCENARIO SCENARIO SOENARIO 1 2 3 4 1 2 3 4 1 2 3 4 Interpret/Diagnose 1,4,5 2,q,5 2,4,5 1,4,6 1,4,5 1,3,4 1,2,3 2,3,5 Events and 2-8 1-10 1-8 1-9 6,7,8 7,8 6,

6,8,9 6,7,8 7,8, 6,7,8 6,8,9 7,8 10 Conditions Comply With and Use 2,3,5 1-6, 2,4,5 1,4,6 1,4,5 1,4,5 1,3,4 1,2,3 2,3,5 1-8 1-10 1-8 7,8, Procedures (1) 8-9 6,8 7,8 6,7 6,8 6,7 1p 6,8 6,8,9 Operate Control 2,4,5 1,4,6 j,4,5 1,4,5 1,3,4 2,]5 1,2,3 2,3,5 NA NA NA NA 7'1 ,

Boards (2) 6,8 7,8 6,7 6,8 6,7

6,8 6,8,9 Communicate and 1-8 1-10 1-8 1-9 1-8 1-10 1-8 1-9 1-8 1-~ 0 1-8 1-9 Interact Demonstrate Supervisory Ability 1-8 1-10 1-8 1-9 NA NA NA NA NA NA NA NA (3) i Comply With and Use 3-4 1,5 2-3 1-3 NA NA NA NA NA N~ NA NA Tech. Specs. (3)

Notes:  :

(1 ) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable- competency for every applican i NUREG-1 021, Revision 9

ES-301 Competencies Checklist Form ES-301-6 FINAL Facility: McGuire Date of Examination: 5/12/08 Operating Test No.: N08-1 APPLICANTS SRO (U/I) RO/ATC ISOp Competencies SCENARIO SCENARIO SCENARIO 5 5 5 Interpret/Diagnose 1,3,5 2,4,6 Events and 2-8 7,8 7,8 Conditions Comply With and Use 1-8 1,3,5 2,4,6 Procedures (1) 7,8 7 Operate Control NA 1,3,5 2,4,6 Boards (2) 7,8 7 Communicate and 1-8 1-8 1-8 Interact Demonstrate Supervisory Ability 1-8 NA NA (3)

Comply With and Use NA 2,5 NA Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

NUREG-1 021, Revision 9

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: McGuire Date of Exam: 5/12/2008 Exam RO/SRO Level:

Initial Item Descri tion Questions and answers technicalf accurate and a licable to facilit , NRC KJAs referenced for all question FaciHt learnin ob'ectives referenced as avaifabl . SRO uestions are a ro riate in accordance with Section D,2.d of ES..401 The sampling process was random and systematic. (If more than 4 RO and 2 SRO questions were repeated from the last 2 NRC licensing exams) consult the NRR OL Pro ram Office Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_ _ the audit exam was systematically and randomly developed, or

_ _ the audit exam was completed before the license exam was started. or

_ _ the examinations were developed independently, or

~ the licensee certifies that there is no duplication, or other ex lain 6, Bank use meets limits (no more than 75 percent Bank Modified New

~,

from the bank at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only uesUon distribution s at ri h I 7 13/5 53/13 ~ X Between 50 and 60 percent of the question on the Memo CIA RO exam are written at the comprehension/

analysis level; the SRO exam may exceed 60 31/ 6 44/19 (JM cl( \"

,

percent if the randomly selected KJAs support the higher cognitive levels; enter the actual RO I SRO uesUon distribution s at ri ht Referenceslhandouts provided do not give away answers or aid in the elimination of distractors~

~ X- Question content conforms with specific KIA statements in the previously approved Q#4 examination outline and is appropriate for the tier to which they are assigned; deviations are ustifle X '\

v, 1 Question psychometric quality and format meet the guidelines in ES Appendfx ~

1 The exam contains the required number of one-point, multiple choice items; the ~

total is correct and a rees with value on cover shee Printep Name I Signa r Date Author Joseph G. Arsenault ~f"""""'. __

....J.(.L.A# 3/15/2008 Facility. Reviewer (*) NRC Chief Examiner (#) NRC Regional Supervisor Note: * The facility reviewers initials/signature are not applicable for NRC-developed examination # Inde endent NRC reviewer initial items in Column get'; chief examiner concurrence re uired.

NUREG-1021 f Revision 9

(\ ~

ES-401 Written Examination Form ES-401-9 Review Worksheet McGuire 2008-301 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Only Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.) Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOO) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the afPropriate box if a~SYChometric flaw is identified:

  • he stem lacks su Icient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the af~ropriate box if a job content error is identified:
  • e question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirement . Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

RO/SRO Combined Question

~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (0 15). Containment Spray/Knowledge of LCD's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."

/V(JrfY

~)f'/'~ ;Us C4trJ ON £~

1 C 3 X X X Y N E 003K1.08 Stem: b> after powe A and make absolutel no sense. What about RN and KC flow to and from the CPs? N Repair distractors A and 0 or explai RFA 03/25/08

~ r-"'. ,~

1. 12. I 3. P"""omebic FI.ws I 4. Job Co,tent Flews I Oth,,-TS:-I II 0#/1 LOK LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis!.

Job-Link Minutia #1 units Back-ward 0=

KIA SRO I utE/S Onl I Explanation 2 I M I 2 I X Y N I E 1004K5.46 Distractor B is NOT plausible because ALL a8~licants know that RCPs operate when the plant is N solid and DP is maintained. Replace distractor B RFA 03/25/08 3 I M I 2 I X I I I I I I X I I I Y 005K2.03 Third bullet, need a ver Make this Q a fill in the blank with choices as follows:

A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D. 600V Essential Load Centers 1 CLOSED RFA 03/25/08 4 I C I 3 I I I I I I I X I I I Y I~ The emphasis is on the wrong wor Bold the words

"increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 I C I 3 I I I I I X I I I I I ~ C is NOT plausible. Change C to "the reactor coolant drain tank." If the\,do figure out that the #1 seal discharges to the CT, the~ will realize that VCT level will not increase if the filter is c 0B~ed. However, thee may NOT realize that reliefs do N dumcR into the R DT, which makes the RCDT a plausible istracto RFA 03/25/08 6 I M I 2 I I I I X I I I I I I Y I N _008K2.02 If B was correct, D would be also If A was correct, C would be als Distractors C and D need the word "ONLY"

-

This Q is U because of two NP distractor RFA 03/25/08 7 I C I I I I I I I I I Y I~ Verbs missing in bullet This Q has low discriminatory value. Here is a suggested change:

A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU£ply breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08

~ ~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Only 8 C 3 X Y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h

with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor RFA 03/25/08 9 C 3 Y N 5 012A3.03 RFA 03/25/08 10 C 2 Y N 5 012K6.03 RFA 03/25/08 11 M 2 X Y N E 012K4.08 The stem does not read well. There is eather a run on sentence or punctuation is missing. I get lost in i Please re-writ RFA 03/25/08 12 C 3 X Y N 022A2.03 -

It would appear to be common knowledge from an applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a

¥Iausible distracto his Q is U because Band D distractors are not plausibl Show calculation in distractor analysi RFA 03/25/08 13 C 3 Y N 5 025K6.01 RFA 03/25/08 14 M 2 X Y N 025K5.01 Distractors Band D say the same thing. Replace one of the two distractors. As a result, Band D are NOT

¥Iausible. D could ~otential be a subset of herefore this Q is .

RFA 03/25/08

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S Explanation Focus Dis Link units ward KIA Onlv 15 C 3 X Y Y? E 026G2.2.22 o says that the LCO is not applicable,C says the TS will not be entered. What is the difference between 0 and C?

Is this required knowledge for RO applicants since this is NOT a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> TS LCO?

RFA 03/25/08 16 M 2 X Y N 026K3.02 Because the FWST Lo-Lo level alarm has occurred, distractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FWST leve T IS Q is U because there are two NP distractor RFA 03/25/08 17 C 3 X X Y N E 039A4.04 Second Bullet: Normal what supply??

Choices are not complete sentences (generic comment)

RFA 03/25/08 18 C? 2 X X Y N E 039K4.07 I think this Q can be answered even if you delete everything above the WOOTF statement. If so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 19 C 2 X X Y N E 059A1.03 I think this Q also can be answered even if rou delete

. , everything above the WOOTF statement. I so, delete i This Q meets the criteria to be an (M) questio RFA 03/25/08 20 C 2 X Y N 061K3.01 CF and NCPs are not safety related which renders these two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E 062A3.05 Move "The BO sequencer actuated Train A status light on SI-14" to the stem. Unbold the words "and" and "then."

This will un-complicate the choice RFA 03/25/08

~

Q#I I LOK I . Psychometric Flaws 4. Job Content Flaws LaD t---,----,;---,--,----t--.,------r----,;------ir--.------I 5. Other I .

(CIA) (1-5) Partial Job-Link Back-ward Q:= ISRO I UlE/S KIA ani Explanation 22 I C 2 x x y N E 1063A1.01 Create a fill in the blank as follows:

Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour B. 2 6 RFA 03/25/08 23 I M 2 x y N E 1064K6.08 Stem needs verbs and complete sentences RFA 03/25/08 24 I M 2 y N 5 1073A2.01 RFA 03/25/08 25 I M 2 076G2.4.30 The KA is not met. The KA must involve the SW system

~ireltl~. In the first bullet, it could be any system NOT Just . The RN system has to have a direct impact on the In fact, you could delete all but the last bullet and still answer the Q This Q is a U because KA not me RFA 03/19/08 '

26 I C 076K3.07 To low discriminatory value. Change answer as follows:

A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV Pump Gear oil will overhea B. ONLY the 2A NV Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear oil will overheat. Additionally, all makeup capability is lost to the 2A DG KD surge tan This Q is a U because the discriminatory value is to lo RFA 03/26/08 27 I C 078G2.4.35 RFA 03/26/08

~ /\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S Explanation Focus Dis Link units ward KIA Onlv 28 M 2 X Y N E 103A4.01 Do NOT teach in the stem. Start of with WOOTF...

Then list the valve RFA 03/26/08 29 C 3 X Y N E 014K4.03 Put "Rod F-2 displayed as" in the ste RFA 03/26/08 30 C 3 Y N 5 017K6.01 RFA 03/26/08 31 C 3 Y N 5 015K2.01 RFA 03/26/08 32 M 2  ? X Y N 5? 028K1.01 Why is "decrease" plausible in distractors C and D?

Prove plausibility and Q will be Sa RFA 03/26/08 33 M X Y N 029A4.04 Stem: Change "has" to "have" Add Excore SR monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and D to increase discriminatory valu Q is a U because of low D RFA 03/26/08 34 M 2 Y N 5 033K3.01 RFA 03/26/08* .

35 C 3 X Y N 035A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not

~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q is a U because of two NP distractor RFA 03/26/08 36 C 3 X Y N 041A3.03 If Tave is decreasing, what else would cause it, if there was no steam flow? SU~1gest ~iving them a rod shim because inward rod motion wi! cause a drop in Tav Ri!ilht now distractors A and C are NOT plausible (NP).

This Q is U because of two NP distractor RFA 03/26/08 37 M 2 X Y N E 071A1.06 Remove "in" from the ste RFA 03/26/08

~ /"\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO U/E/S Explanation Focus Dis Link units ward KIA Onlv 38 M 2 Y N S 086K5.03 RFA 03/26/08 39 M X Y N 007G2.4.46 Place 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08 40 C 3 X Y N 008M1.03 I believe that "A" can be a potentially correct answer because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."

As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3 Y N S 009EK2.03 Much better. Now they have to calc Tste RFA 03/26/08 42 M 2 X X Y N E 011EK3.06 j Distractor "8" does not read correctly. I think "are isolated" sholild be remove If "0" was correct, "C" would be correct als Need the word "only" in RFA 03/26/08 43 C 3 X Y N E 015/017M1.16 Move "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 C 3 Y N S 022M2.04 RFA 03/26/08 45 C 3 X X X Y N E 025AK2.03 The stem does NOT solicit the effect on the KC syste Re-write the stem to do s Regarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a

~osslble correct answe acility please re-evaluat RFA 03/26/08

/'. (\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Only 46 C 3 X y N 51 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy? .

RFA 03/26/08 47 C 3 Y N 5 029EK2.06 RFA 03/26/08 48 M 2 X Y N E 055EK3.02 The stem has to much fru fru. Re-write the stem as follows:

Which one of the following is the bases for NOT depressuriZin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?

To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level RFA 03/26/08 49 M 2 Y N 5 056AA1.12 RFA 03/26/08 50 C 3 X Y N E 057AK3.01

1 To be consistent, why not say in D that turbine impulse pressure channel 1 has failed high (just the opposite of

"C")?

RFA 03/26/08 51 M <2 X X X y N E 058AK1.01 Stem: Underline and bold the word minimum Distractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA 03/26/08 52 M 2 X Y N 062AA2.06

"D" is also a correct answer the way the Q is written. If

"A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so other choices cannot be psychometricall eliminate b This Q is U because two distractors can e eliminated by the wa~ the Q is writte RFA 0 126/08

/'

.. . 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other I 6. I 7.

Q#/I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO UlE/S Explanation Focus Dis Link units ward KIA Onlv 53 I C I 3 I X Y N E 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08 54 I C I 3 I X I I I ? E04EK Stem: BrinB containment feressure up to 8.5 psig to make B, C, and more plausib Why has the PRT ruptured? What is dumping into it to cause that?

RFA 03/26/08 55 I C I 3 I I I I X I I I I I I y E11G2.1.23 ECA-1.1, Step 21 b. RNO states to stop one or more SI

~umps while maintaining >1= to flow required by nclosure 9. Therefore, distractor "Au is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 56 I M I 2 I I I I X I I I I I I y I N _E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no

~rocedure guidance anywhere that directs thi _i' I I I I I I I I _ his Q is U because all three distractors are flawe RFA'03/26/08 II ;1 57 I C I 3 I I I I I I I I I I y I N I S 1005AA1.02 RFA 03/26/08 58 I M I 2 I I I I X I I I I I I y I N _024AA2.03 Stem: Why all the fru fru? Why not just say:

WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm boration flow rate?

Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is a U RFA 03/26/08

~

f\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Onlv 59 C <2 X  ? y N E 032AK1.01 Distractors A and B are week by themselve Change Stem to say:

WOOTF describes the minimum cause of SR N-31 indication?

A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X X X Y N E 033M1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "C" and "D" are NOT solicite Re-work distractors A, C, and RFA 03/26/08 61 C 3 X y N 036AK2.01 Last bullet: This is why verbs an complete sentences are necessaz. Are you saying "a KF pump is operating" or

"the "A" F pump is operating?"

Whay would the ag~licant think that level is to low when they are told that P level is +0.4 feet? Distractor B is s* not plausible. No SFP level trend is provided. Therefore,

\ < a cavity seal failure is not plausibl Why is "C" correct?

Replace distractors Band D. This Q is U because of two NP distractor RFA 03/26/08 62 M 2 X Y N E 067M2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the CPo Replace distractor "A."

RFA 03/26/08 63 M 2 X y N E 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08

~ r---.... ~

1. I Q#/I LOK LOD . Psychometric Flaws I 4. Job Content Flaws ~Othe;-~I II (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= Explanation Focus Dis Link units ward KIA 64 I C I 3 I X Y N 076AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 65 I C I 3 I I I I I I I I I I y I N E02G2. RFA 03/27/08 66 I M I 2 I I I I I I I I I y N G2.1.18 RFA 03/27/08 67 I M I 2 I I I I X I I I I I ~:

y N G2.1.13 Page 7 of 15 of the attached reference states in part:

Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badeed person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is obviously not true and not plausibl This Q is U until these issues on both these distractors are resolve RFA 03/27/08 68 I C I 3 I X I I I X I I I I I I y G2. There are three actions that could work (B,C, and D).

The stem needs to be written to isolate one of the j I I I I I I I I _ Currently there are potentially three correct answer This Q is U until resolve RFA 03/27/08 69 I C X I I I X I I I I I I y 1 N _G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27/08 70 I M I 2 I I I I I I I I I I y N G2.2.2.13 RFA 03/27/08 71 I M I 2 I I I I X I I I X I I I y N G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".

"c" is also a correct answer. "c" is a subset of "D."

This Q is U because of multiple correct answer RFA 03/27/08

~

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 72 C <2 X  ? y N E G2. th bullet: Drop "return via the same ~ath." This is implied and will add to the discriminatory va u Stem: Underline and bold maximu Choices: Delete "no longer than."

Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa RFA 03/27108 73 C 3 Y N S G2.3.11 RFA 03/27108 74 M 2 X Y N G2.4.17 Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27108 75 C <2 X  ? y N E G2.4.14 Change heat sink to an orange path too. As is, the

~uesbon has marginal discriminatory valu FA 03/27108 SROONLY X

.. X Y Y E 009G2.1.27

/

76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....

RFA 03/19/08 77 C 3 X X Y Y E 026G2.1.25 Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....

A. 1.50 GPM 2. Isolate KC ...

Which references will be provided?

RFA 03/19/08

~

. . 3. Psychometric Flaws 4. Job Content Flaws 5.0the~. I 7.

0#/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= Explanation Focus Dis!. Link units ward KIA 78 I C I 3 I X Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete "when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 791 C I 3 I I I I I I I X I I I Y 055EA2.03 The reference document provided does NOT sUfPort the use of Enclosure 9, energizing Unit 1 from Unit .

However, the use of AP-7 is (see step 4 RNa of E-O.)

Please re-evaluat RFA 03/20108 80 I C I 3 I I I I I I I X I I I Y I~ Remove (;) from all choices and align C and D wmer3enc7c is to far to the left)

FA 0 12008 81 I C I 3 I I I I X I I I I I I Y IY _ 058G2.2.37 If D was correct, B would be also. Therefore D is NOT r.lausible

/1'1 I I 1 1 I I I I _ f C was correct, A would be also. Therefore C is NOT plausibl Stem: Need to rewrite stem to include the word

'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 82 I C I 3 I I I I X I I I I I I Y I Y _003M2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is cleari that you could have a significant delta between turbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not

~ausibl edesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 11 RFA 03/20108

  • .

~

/\ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO utE/S Explanation Focus Dis Link units ward KIA Only 83 C 3 X Y Y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated and the second part to reflect the sam This Q is a U because twodistractors are N RFA 03/21/08 84 M y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include </= to 3 rem WB and </= 10 rem orga This Q is a U because the discriminatory value is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 85 C 3 Y Y 5 E06G2.1.20 RFA 03/21/08 86 C 3 y y 5 010A2.01 RFA 03/21/08 87 C 3 X Y Y 026A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of

, the wording "... Do NOT perform ..."Use the "if' statement in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto II

All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 88 C 3 X X Y Y E 061G2. Stem: Change WR level to 30% ACC. This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are of RFA 03/41/08 89 M 2 X Y Y E 073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?

RF 03/21/08 90 C 3 X X Y Y E 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 91 C 3 Y Y S 015G2. RFA 03/24/08 92 C 3 X Y Y 028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:

A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen flamma ilit D. Similar but change to hydrogen recombine This Q is a U because of 2 NP distractor RFA 03/24/08 93 C 3 X Y Y E 079A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2 X X Y Y E G2.1.35 Distractor D is not plausible because it is common knowledge that RE's are a technical oversite position with no "permissive" authorit Change choices as follows (example): Shift manager OR Fuel handling SRO Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY RFA 03/24/08 95 M 2 X Y Y E G2. Stem: Change "who is" to Which one of the following is responsible...

Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08

  • . ~. . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UtEIS Explanation Focus Dis Link units ward KIA Only 96 C 3 X Y Y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3 X Y Y E G2.3.14 There is no mention of gross specificity in the stem. Why is shutdown and cooldown to < 500 F plausible?

CAF RFA 03/24/08 98 M 2 X Y Y E G2. The Q is NOT balanced and renders D not plausible. Re-write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to afcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3 X Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or acquire Tave by some other means. Otherwise, distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X X Y Y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewrite distractors to reflect thi RFA 03/24/08

  • .
  • Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA

ES-401 Written Examination Form ES-401-9 Review Worksheet McGuire 2008-301 0#1 I LOK LOD . Psychometric Flaws 4. Job Content Flaws 5. Other I .

(CIA) (1-5) Partial Job-Link Minutia I #1 units Back-ward 0=

KIA I SRO Only I UlE/S Explanation Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.] Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the appropriate box if a psychometric flaw is identified:

  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statement One or more distractors is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirement ca Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

II At. m'o'm,m, ...moo", 'U" m'o" (*., .. how ~""""'" B "><h~- otbi',""re o~ "'0' ""'). tAJ4) .r1J C RO/SRO Combined Question

~eneric: For system generic KA's, state the system then the generic part (Le.) 026G2.2.22 (Q 15). Containment Spray/Knowledge of LCO's and Safety Limit Many of the U's were attributed to non-plausible distractors that could not be supporte Many of the stems are inconsistent with the use of verbs such as "is and are."

I

,

/ ._- -.."--

C 3 x x x y N 003K1.08 Stem: (,) after powe A and D make absolutely no sense. What about RN and KC flow to and from the NCPs?

Repair distractors A and D or explai RFA 03/25/08

" . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Onlv /

[/

2 M 2 X Y N Ey' 004K5.46 Distractor B is NOT plausible because ALL a8Plicants know that RCPs operate when the plant is N T solid and DP is maintained. Replace distractor B RFA 03/25/08 3 M 2 X X Y N E k5b5K2.03 V Third bullet, need a ver Make this Q a fill in the blank with choices as follows:

. A. 600V Unit Load Centers 1 OPEN B. 600V Unit Load Centers 1 CLOSED C. 600V Essential Load Centers 1 OPEN D':f;~8:V Essential Load Centers 1 CLOSED RF 3/25/08 4 C 3 X Y N E y klO6A4.01 The emphasis is on the wrong word. Bold the words

"increase" and "decrease" and "4-7" and "7-10" RFA 03/25/08 5 C 3 X Y N E K>07A3.01

.; C is NOT plausibl Change C to "the reactor coolant drain tank." If the'Vdo fi~re out that the #1 seal discharges to the. CT, t e~ will realize that VCT level will not increase if the filter is c 0g~ed. However, thee may NOT realize that reliefs do N dumcft into the R DT, which makes the RCDT a plausible istracto RFA 93/25/08 6 M 2 X Y N 8K2.02 If B was correct, D would be also E If A was correct, C would be als Distractors C and D need the word "ONLY" This Q is U because of two NP distractor RFA 03/25/08 (1 C Y N 8K4.01 erbs missing in bullet This Q has low discriminatory value. Here is a suggested

-_.- - ~hang~:____ .~ .. ..- .... - .. ~ . .- _._ .. -- ._- ___... *

A. The 1B2 trips on over current OR an event causing containment pressure to increase to 1.5 psi B. An event causing containment pressure to increase to 1.5 psig ONL C. The normal SU~PIY breaker to 1 ETB opens OR a leak on the shell si e of the 1B KC heat exchanger occur D. The normal supply breaker to 1 ETB opens ONL This Q is U because of low discriminatory valu RFA 03/25/08

~ . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LaD (CIA) (1-5) Stem Cues TIF Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only /

<D c 3 X y N 010K1.07 Since Channel 3 failin~ high will fail the low pressure interlock on PORV's 1 C-32B and 36B, distractor C

. combined with choice 1 is plausible. By itself it will be readil eliminated. They might consider it if it is coupled h

with cannel 1 failing low. Since the switch is in position 1-4, channel 2 failing high is NOT plausibl Channel 1 failing low OR channel 3 failing high Channel 1 failin~ low ONLY Channel 1 OR cannel 4 failing lo channel 4 failing low ONLY This Q is U because the are two potentially NP distractor R~A 03/25/08 9 C 3 Y N SJI 012A3.03 RF~3/25/08 10 C 2 Y N SJ..- ~2K6.03 RFA 03/25/08 11 M 2 X Y N EV ~2K4.08 The stem does not read wel There is eather a run on sentence or punctuation is missing. I get lost in i Please re-wnt RFA 03/25/08 12 cl 3 X Y -~ A2.03 t would appear to be common knowledge from an

.r

£ applicant In training that AP-44 is for flooding in the TB and ASB. I do not believe that this qualifies as a

¥Iausible distracto his Q is U because Band D distractors are not plausibl ~w calculation in distractor analysi FA 03/25/08 13 C 3 Y N 025K6.01

-- ~ . ~--

- -_ . . - -.... ~- -~ ---- RFA 03/25/08 -- _.- ~ .. ,.

14 M 2 X Y N 0 K5.01 istractors Band D say the same thing. Replace one of ( the two distractors. As a result, Band D are NOT

¥Iausible. D could ~otential be a subset of herefore this Q is .

RFA 03/25/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward KIA Onlv 15 C 3 X Y II Y? 17 E le26G2.2.22

,.

'a .~ d'

~'

~

Iv D says that the LCO is not applicable,C says the T5 will not be entered. What is the difference between D and C?

~ ~

~

Is this required knowledge NOT a 1 hourT RFA 03..£25/08 -[};;::7 RO applicants since this is

~ M 2 X Y N le o02 cause the FW5T Lo-Lo level alarm has occurred, istractors A and B are not plausible. For distractors A and B to be plausible, provide information for the a~plicant to calculate FW5T leve T IS~? U because there are two NP distractor RFA 0 /25/08 t ~~4.04 17 C 3 X X Y N E P . econd Bullet: Normal what supply??

"( ./ c~~s are not complete sentences (generic comment)

,/ :1115

,

RF 3/25/08 A

./

V? X X Y N ' EJ/ '-&39K4.07 ,.JP-J ~ It I think this Q can be answered even if you delete RFAO 5/08 ,~ 7 ~aJ W

everything above the WOOTF statement. If so, delete i This ~ets thejteria to be an questio Y~

~

19 C 2 X X Y 59A1.03

, even if II I ink this Q also can be answered e rything above the WOOTF statemen ,r Th Q meets the criteria to be an (M) questio ou delete so, delete i RFA 93/25/08 20 C 2 X Y N 61K3.01 CF and NCPs are not safety related which renders these E two distractors NP. Replace these 2 distractor This Q is U because of two NP distractors RFA 03/25/08 21 C 2 X X Y N E ~3.05

- .... ~-

_.. - " ... ._-- .~. - - -- _....

p

'The.OO seqllencer 8cb !8ted.Irain A .,t",...., I;nht nn 51-14" to the stem. Unbold the words "and" and "then."

This will un-complicate the choice RFA 03/25/08

..

1. I . Job Content Flaws 5. Other I .

0#/1 LOK LOD (CIA) (1-5) Partial Job-Link Back-ward 0=

KIA I SRO I UlE/S Onl Explanation 22 I C 2 x X y N 63A1.01 Create a fill in the blank as follows:

Battery CXA will be lost in _1_ hours. Battery CXB will be lost in _2_ hour A. 2 4 B. 2 6 RFA 03/25/08 23 M 2 X y N 24 M 2 Y N RFA 03/25/08

,r M 2 -L( ~ 076~~,~.1/

The A is not met. The KA must involve the SW ~stem

~ire~I~. In the first bullet, it could be any system Just

~eQ t:=

. The RN system has to have a direct impact on In fact, you could delete all but the last bullet and answer the Q This Q is a U because KA not me RFA 03/19/08 D

OT Ii I ~ ~

fFI

t1/ f .~

~07~;

Change answer as follows:

A. ONLY the 2A1 and 2A2 DG VG Air Compressors AND the 2A NV pume Gear oil will overhea B. ONLY the 2A N Pump Gear oil will overhea C. ONLY the 2A NS Pump Motor AND the 2A NV Pump Gear oil will overhea D. The 2A NS Pump Motor AND the 2A NV Pump Gear

....__ .... _ * - _ _ _ *1 _____

, ,

oil will overheat. Additionally, all makeup capability is-1ost1u tile 2A DG KD--surge Lall ...- - -

_ '~w'_' __

This Q is a U because the discriminatory value is to lo ~08 Y I N . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Onlv -'

28 M 2 X Y N V ~3A4.01 D~T teach in the stem. Start of with WOOTF ...

The 'st the valve RE 03/26/08 29 C 3 X Y N E}' 014K4.03 Put "Rod F-2 displayed as" in the ste R~ 03/26/08 30 C 3 y N ~~ /017K ~~I RFA 0 126/08 t;

/'

l-

~l- RFA 031

,7 31 C 3 Y N ,o'15K2~

I- ~ 708 32 M 2 7 X y N 57 l ~.01 hy is "decrease" plausible in distractors C and D?

Prove Plausibility~Q will be Sa RFA 03/26/08

~ M X Y N 0 1\4.04 tem: Chan~e "has" to "have" Add Excore R monitors to choice B and add Excore SR monitors andlor Trip 2 on 1EMF-16 to A, C, and 0 to increase discriminatory valu ~ U because of low D R 03/26/08 34 Y N ~/ 033K3.01 I RFA 03/26/08 35 C 3 X Y N 5A2.05 Without giving the applicant a misleading lead in that might "sug~est" a steam leak, Distractors A and B are not

~Iausible. urthermore no indication was provided that a ORV was or was NOT open that would potentially steer them to AP-00 Q iS9~ because of two NP distractor RFA 3/26/08

~ \.J

. ---,._ ..

A

---_ .. -_._- ~- . --y- A3:03--- ..* _-_ .....

~ " If Tave is decreasing, what else would cause it, if there was no)'team flow? SUli1gest fiiving them a rod shim becalJse inward rod motion wil cause a drop in Tav Ri99t now distractors A and C are NOT plausible (NP).

This Q is U because of two NP distractor RFA 03/26/08 37 M 2 X Y N I/, 071A1.06 Remove "in" from the ste RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only /

38 M 2 Y N sf,-- V086K5.03

..-- RFA 03/26/08 39 M X Y G2.4.46 lace 1 of the channels that require 2/4 to trip the reactor below the limi Set it up so 2 reactor trips are in. Add a second annunciator to each choice such that the correct answer has two valid tr~s, two distractors each have one valid annunciator an one distractor has one channel each below the wire but no annunciators are i This Q is a U because of low Discriminatory Valu RFA 03/19/08 I

..1. - A

~ b t 40 C 3 X Y

008AA1.03 ~ile., ~

I believe that "A" can be a pot tially corr. ct answer

- because one can manually stabilize or maintain a CD rate by adjusting the pot settin~.. To ensure that "A" is not an option state in the WOOT statement "..... describes the action, as stated in ES-1.2, that will ..."

As is, this Q is U because there are potentially two correct answer RFA 03/26/08 41 C 3 Y N jY ~9EK2.03Much bette Now they have to calc Tste RFA 03/26/08 42 M 2 X X Y N E 011EK3.06 L ~:actor "S" does not read correctly. I think "are

. olated" should be remove If "0" was correct, "C" would be correct als Need the word "only" in ,

RFA 03/26/08

~17AA1.16

~

43 C 3 X Y N ove "Initial reactor power was" to the stem. It will read easie RFA 03/26/08 44 r. .. _ 3.._ . -~._-- --- ~_.-

y 1\1. +~V' Q22AA204 .-- ._ .. _-- ---- _.... -

f,/ RFA 03/26/08 45 C 3 X X X Y N E i$03 Th tern does NOT solicit the effect on the KC syste t -write the stem to do s egarding "C": If the KC system continues to HU, will the NC system eventually start to HU? If so, this may be a

~ossible correct answe acility please re-evaluat RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO UlE/S Explanation Focus Dis Link units ward KIA Only I,.;

46 C 3 X Y Nt lA1 027AK1.03 FAC demonstrate how you arrived at this. Did you factor in constant enthalpy?

IRFA 03/26/08 47 C 3 Y N tJI' 029EK2.06 RF~ 03/26/08 X Y N k555EK3.02 V

48 M 2 The stem has to much fru fru. Re-write the stem as follows:

Which one of the following is the bases for NOT depressurizin~ the SG's to < 110 psig as stated in ECA-0.0, Loss of a I AC Power?

To avoid voiding in the head an inadvertent criticalit accident h nitrogen injection into t e RCS the loss of SG narrow range level Rij\ 03/26/08 49 M 2 Y N

!Y' 056AA1.12 RFA 03/26/08

~

50 C 3 X Y N -057AK3.01

, , I To be consistent, why not say in 0 that turbine impulse p,ressure channel 1 has failed high Oust the opposite of

~.>? FA 03/26/08 51 M <2 X X X Y N

,/ 058AK1.01 Stem; Underline and bold the word minimum Oistractors: Bold 1 and 4 and automatically and manuall The level of difficulty is marginal. Therefore, incorporate auxiliary battery criteria into the choices to RFA033P108

~ ~

/

-- - .--- .. --- ._. -- "I

- . --- .. .. _-- -_ .. -- --

~

M 2 X JL ~ Y N 2AA2.06 (Ii.. ~;r

"0" is also a correct answer the way the Q is written. If

~ I~ )l f IT ..

~

"A" was correct, "C" would also be correc Add words to the stem to isolate the correct answer so I~

other choices cannot be psychometricall eliminate b t CtJ tIP This Q is U because two distractors can e eliminated by the wa~ the Q is writte ,~

"

or RFA 0 126/08

- ., ywv

,-,

,,J

  • .... .

I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws r-;Qther I .

Q#I LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis Job- Minutia Link

  1. 1 units Back-ward Q= I SRO I U/E/S KIA Explanation 53 I C I 3 I X Y 065AA2.08 The reason for the trip is NOT solicited. Remove the reasons form all choices. C is still the correct answer because the word FIRST I used in the ste RFA 03/26/08 .

54 I C 3 X  ? y E04EK Stem: Bring containment pressure up to 8.5 psig to make B, C, and D more plausibl Why has the PRT ruptured? What is dumping into it to cause that?

RFA 03/26/08 55 I C 3 X E11G2.1.23 ECA-1.1 ,Step 21 b. RNO states to stop one or more SI pumps while maintaining >1= to flow required by Enclosure 9. Therefore, distractor "A" is also a correct answer. Replace distractor Distractor D is NOT an action. Additionally, D has a reason where the other choices do not. Replace distractor This Q is U because two choices are flawe RFA 03/26/08 5611 M 2 X y E12G2.1.20 Even though Band C are incomplete, they are still correct as it stand I do not believe that D is plausible because there is no procedure guidance anywhere that directs thi This Q is U because all three distractors are flawe *. I RFA 03/26/08 57 I C I 3 5 M 2 X ~<tAA2.03 Stem: Why all the fru fru? Why not just say:

WOOTF identifies the number of turns that the pot setting on NVSS5450 must be turned to establish an 18 gpm

... _.- *. _- I I I _ul'_" +-- I I***u ... -~----+----1

~9.r~tiQn flow rate? _

Why would a 25, 30, or a 35 gpm addition be plausible if they were already informed to add at 18 gp As is, B,C, and Dare NP. Therefore this Q is aU RFA 03/26/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LaD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utE/S Explanation Focus Dis Link units ward KIA Only 59 C <2 X  ? y N l/ 032AK1.01 Distractors A and B are week by themselve Change Stem to say:

WOOTF describes the minimum cause of SR N-31 indication?

A. Control Power fuse failure OR Instrument Power Fuse failur B. Control Power fuse failure AND Instrument Power Fuse failur C. As is D. As is RFA 03/26/08 60 M 2 X X X Y N l, / 033AA1.02 Distractor "A" in and of itself, is also a correct answer as writte The "ensure" statement in "c" and "D" are NOT solicite Re-work distractors A, C, and R~03/26/08 61 C 3 X Y N 036AK2.01 Last bullet: This is why verbs an complete sentences are

/" necessaz. Are you saying "a KF pump is op~rating" or

"the "A" F pump is operating?"

~

Whay would the ag~licant think that level is to low when C-(

C they are told that P level is +0.4 feet? Distractor B is n0j. plausible. No SFP level trend is provided. Therefore, a avity seal failure is not plausibl Why is "c" correct?

Replace distractors Band D. This Q is U because of two

,y NP distractor RFA 03/26/08 62 M 2 X y ~ E 067AA2.12 Why is distractor "A" plausible? Nothi~ in the stem remotely indicates a problem with the C Replace distractor "A."

RFA 03/26/08

... - .- - .. -. ..

63 M 2 X Y Nt- / 069AK3.01 Distractor D has nothing to do with a rad release offsit Replace distractor RFA 03/26/08

.... ... ... .. .. - .... .. .. ....... ... .. .. . .... . ..... . 3. Psychometric Flaws 4. Job Content Flaws I 7.

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back" Q= Explanation Focus Dis Link units ward KIA B~~II C I 3 I X y AK2.01 If "B" was correct, "A" would be als If ECCS was actuated, would it cause a crud burst? If so, replace this distracto This Q is a U due to multiple distractor issue RFA 03/26/08 1 15 i 65 C 3 Y 66 M 2 Y 67 M 2 X y G2.1.13 Pa!ile 7 of 15 of the attached reference states in part:

Visitors needing to enter a vital area must be escorted by an authorized individua This leads me to believe that a badged person in a protected area could be "escorted" Into a vital area. If this IS true then "B" is also a correct answer. Please re-verify thi "D" is ObviouSlil not true and not plausibl This Q is U un II these issues on both these distractors are resolve RFA 03/27108 08'-' C I 3 I X I I I X I I I I I I y IIbl _G2. There are three actions that could work (B,C, and D).

The stem needs to be written to isolate one of the :, Currently there are potentially three correct answer \I .. I I I I I I I I I V" _

This Q is U until resolve RFA 03/27108 69 I C X I I I X I I I I I I y I t'i _ G2.2.40 100 F is more common then 200 F. Change stem and answer to reflect exceeding the pressurizer cooldown rate too and make each selection a two part answe Currently, this Q is U because it has no discriminatory valu RFA 03/27108

- M __ . .. . '--' --- ._- --~ . _. __ . - --_. .... _~.-

II -~- .... __ ..-

70 M 2 Y

.71) M 2 X X Y G2. If "B" was correct, "A" would be correct also. "A" is a subset of "B".

"c" is also a correct answer. "c" is a subset of "D."

This Q is U because of multiple correct answer RFA 03/27108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only ,/

72 C <2 X  ? y Nil

/E G2. th bullet: Drop "return via the same path." This is implied and will add to the discriminatory valu Stem: Underline and bold maximu Choices: Delete "no longer than."

Currently this Q is just a number cruncher and has low discriminatory value. Modify the 4th bullet as suggested for an S ratin FACILITY make sure this is not on Admin exa .... RFA 03/27/08 73 C 3 Y N ~ G2.3.11 RFA 03/27/08 II M 2 X Y N G2.4.17 .

Increase the discriminatory value of distractors Band They are to obvious that they are just instrument failure Possibly add some coincidence logic to the Q is U because of 2 NP distractors RFA 03/27/08 75 C <2 X  ? y N E G2.4.14 Change heat sink to an orange path too. As is, the

~uestlon has marginal discriminatory valu FA 03/27/08 SRO ONLY I' ,I X, X y y E l- 009G2.1.27 76 C 3 Stem: Describes (1) the next procedure... and (2) the TS basis for FWST minimum volume for this even Stem: Chan~e FWST level to 220 inches to make the transition to S-1.3 more plausibl A. 1. ES-1.2, Post LOCA Cooldown and Depressurization 2. Ensures .....

RFA 03/19/08

. 7f v .:> -x---- ..... .-.. - _.-. - J\ ---- "'y T t: J,

~6(32:t:25 -- - - - - - - - - - - - - . ,

Stem; WOOTF describes (1) ... and (2) the required action per AP121, ....

A. 1.50 GPM 2. Isolate KC ...

Which references will be provided?

RFA 03/19/08

  • "1" ._ - .. , .- -- - . -- I LOK I 2. I 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other 1 .

Q#I LOD I

(CIA) (1-5) Stem Cues T/F Credo Partial Focus Dis Job-Link Minutia #1 units Back-ward Q=

KIA SRO I U/E/S Onl Explanation 8" C I 3 I X Y Y 029EA2.01 A and B are not plausible because if you are to remain in FR-S.1 then you would NOT transition to E-O. Rewrite A and B to eliminate ambiguit C and D: If conditions allow exit from Fr-S.1 then it's obvious that you exit the procedure when directe Delete when directed, exit FR-S.1" C. State "continue performance of Enclosure 2" D. State "terminate performance of Enclosure 2" This Q is U because of 2 NP distractor RFA 03/19/08 79 I C 3 X y y 055EA2.03 The reference document provided does NOT support the use of Enclosure 9, energizing Unit 1 from Unit However, the use of AP-7 is (see step 4 RNO of E-O.)

Please re-evaluat RFA 03/20108 80 I C 3 X y y 056AA2.18 Remove (;) from all choices and align C and D (Emergency is to far to the left)

RFA 03/20108 81 I C 3 X y y 058G2.2.37 If D was correct, B would be also. Therefore D is NOT plausible

,J If C was correct, A would be also. Therefore C is NOT plausibl .T Stem: Need to rewrite stem to include the word

'minimum" This Q is rated U because of 2 nonplausible distractor A stem correction will validate distractors C and RFA 03/20108 8~~~ C I 3 X y y 003AA2.02 Rod withdraw due to the PR NIS Mismatch rate signal only is NOT plausible even though it has an input. It does have an affect on the magnitude but the reference is clear-I 1 * - ----I--+- I 'ltlat you comet have a significant deltcrl:mtweeniurbine and nuclear power and NOT have a mismatch. The mismatch is clearly a function of Tave vs Tref. Therefore, This Q is U because distractors Band C are not plausibl Redesign the Q ask what provides the anticipatory signal and that would be the power mismatch input. Distractors could include T and power which would be wrong per OP-MC-IC-IRX, Para 1.2, page 111--7 RFA 03/20108 L-/

I 0 *** 0. . . Psychometric Flaws I 4. Job Content Flaws I 5. Other 16:1 #/1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= Explanation Focus Dis Link units ward KIA //

a'3~1 C I 3 I X y y 033AA2.05 N-35 being "under-compensated" is not plausible compared to N-36. If N-35 were over-compensated, the indicated power level would read lower than actual power level. Change distractors Band D to read N-35 is over-compensated a ' r n d part to reflect the sam This Q is aU bec us odistractors are N RFA 03/21/08 y 059G2.2.38 Since this is an SRO Q, build in both parts of the TS to include <1= to 3 rem WB and </= 10 rem or~a This Q is a U because the discriminatory va ue is to lo Additionally, without both parts this is NOT SRO onl RFA 03/21/08 I I y 851 C 3 I I I I I I I I I E06G2.1.20 RFA 03/21/08 C 3 y

~ C 3 X y 26A2.03 Change Cntmt pressure to 13 psig. This makes the path more plausibl The actions in "A" are a subset of th "All" the actions in B and D. If B or D was correct, A could be als The second part of Band D are not plausible because of the wording "... Do NOT perform ..."Use the "if' statement

,JI I I I 1 I I I I I _ in paragraph 7.15.1.5 of aMP 4-3, P 18 for this distracto All the distractors need to be re-writte This Q is a U because of two or more NP distractor RFA 03/21/08 881 C I 3 I X I I I I X I I I I I y I Y I E~1G2. Stem: Change WR level to 30% AC This will make B more plausibl Stem: Have CA pumps running but not able to generate flow >450 gpm because distractor D is not plausible given the initial conditions that all CA pumps are off.

_ _ _,. _0* _ _ ' BE .__ 3 / 2 1 / 0 8 _ _.00- 00 ... -.....-

89 073G2.2.22 75 GPD leakage is NOT supported by the attached ref materia WhX is 30 GPD plausible?

~F: 03/21/08 90 I C I 3 I X I I I I I I X I I I Y I Y I E "., 076A2.02 Stem: Only train "B" SI actuated. Delete bullet # Explain Why< the A EDG does NOT overhea RFA 03/2108 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0#1 LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- 0= SRO utEIS Explanation Focus Dis Link units ward KIA Only 1./

91 C 3 Y Y St:. 0~~:.7 RF 124/08 e? )C

~

3 X Y Y 028A2.03 The step requires an action. In this case, "do NOT" statements are NOT plausible. Change distractors A and D to "only" statements as follows:

A. Place hydrogen ignitor in service ONLY, because recomblner operating temperatures may cause a challen~e to containment Integrity due to hydrogen f1amma i1it D. Similar but change to hydrogen recombine ThJ..;.? is a U because of 2 NP distractor RF 03/24/08 93 C 3 X Y Y E J,o Q;9A2.01 Do NOT teach in distractors. State that 1VI-820 is either open or closed and delete the reason from all 4 choice Furthermore, the stem does NOT solicit the reason just the positio RFA 03/24/08 94 M 2 X X Y Y E ~~.35 Istractor D is not plausible because it is common t- knowledge that RE's are a technical oversite position with no "permissive" authorit )1 Change choices as follows (example): Shift manager OR Fuel handling SRO B. Fuel handling SRO ONLY Refueling Supervisor OR Fuel handling SRO Refueling Supervisor ONLY R~03/24/08

/

95 . _....-.M 2

~ .. .

~ .....

X_

... .....

Y .. ,

Y .

_.... _ EI/ 1"""'"G2. . vllongewho is" lU WI,icll Olle ottheiollowir 19 is responsible... .

Reason: The original Q does not read well. I had to read it 3 times before I could figure out what was being aske RFA 03/24/08 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q:: SRO U/E/S Explanation Focus Dis Link units ward KIA Only

~ C 3 X y y G2.2.22 It is common knowledge that PORVs are not credited in accident analysi Replace distractors C and This Q is U because of two NP distractor RFA 03/24/08 97 C 3 X y y E G2.3.14 j / fhere is no mention of gross specificity in the ste is shutdown and cooldown to < 500 F plausible?

Why CAF RFA 03/24/08 98 M 2 X Y y E Q2:3:6 The Q is NOT balanced and renders D not plausibl Re-f'9-'

~' write Q to incorporate another "release may be approved" but for a different reason. Since the KA is the ability to aPcprove a release permit, change stem variables to be c ose to the wire but permissible to conduct the releas RFA 03/24/08 99 C 3 X Y Y G2.4.46 Change stem so applicants need to calc Tave via Tstm or E acquire Tave by some other means. Otherwise,

,..,

distractors C and D are not ~Iausibl This Q is U because of two P distractor RFA 03/24/08 100 C 3 X X y y E G2. Since there is no direct transition to FR-S.1 ever, distractor A is not plausible. Give the applicant entrance into E-O and rewri~actors to reflect thi RFA 03/24/08

-_ _------

  • Independent of whether or not it met the KA, mis-classified WRT RO/SRO,. or required grammar or minor enhancemen Question Status S I Question is Sat with NO Comments E I Editorial Changes Needed E* I Questionable Editorial Question is All Hosed Up Questionable Question and stem sat - editorial elsewhere Partially met KA

_.- _._---- -------_.. - - ... -

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: McGuire Date of Exam: May 23,2008 Exam Level: RO X SROX Initials Item Description a b c Clean answer sheets copied before grading hIe rfa Answer key changes and question deletions justified hIe rfa and documented Applicants' scores checked for addition errors hIe rfa (reviewers spot check> 25% of examinations)

'NjA Grading for all borderline cases (80 +/-2% overall and 70 or 80, hie rfa as applicable, +/-4% on the SRO-only) reviewed in detail All other failing examinations checked to ensure that grades "'N/A N/A are justified ~ ,

, Performance on missed questions checked for training hIe rfa deficiencies and wording problems; evaluate validity I~~

of questions missed by half or more of the applicants Printed Name/Signature Date a. Grader Bruno L. Caballero $~ 06/30/08 b. Facility Reviewer(*) N/A J N/A c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

Ronald F. Aiello Malcolm T. Widdmann

'-,Y

~

~,1i

-- IHy 07/01108 07/01108 l / iJ

-

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are require ES*501 Post-Examination Check Sheet Form ES-SQ1-1 Post-Examination Check Sheet Facility: McGuire Date of Examination: May 12*23, 2008 Task Description Date Complete Facility written exam comments or graded exams received and verified complete Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary Operating tests graded by NRC examiners I v, NRC chief examiner review of operating test and written exam grading completed I . Responsible supervisor review completed I . Management (licensing official) review completed . License and denial letters mailed I v, Facility notified of results I . Examination report issued (refer to NRC MC 0612)

I N/A 1 Reference material retumed after final resolution of any appeals

Final Submittal (Blue Paper)

FINAL OUTLINES

ES-401 PWR Examination Outline IForm ES-401-2 ( Facility:

McGuire 2008 NRC FINAL Date of Exam: 5/1212008 Exam RO KIA Category Points SRO~Ohly Points Tier Group K K K K K K A A A A G

  • Total A2 G* Total 1 2 3 4 5 6 1 2 3 4 Emergency

& 2 1 2 1 2 2 1 9 2 2 4 Plant Tier Evolutions 4 5 4 5 5 4 27 5 5 10 Totals 1 2 2 3 3 2 3 2 2 3 3 3 26 3 2 5 Plant 2 1 1 1 1 1 1 1 1 1 1 0 10 0 2 1 3 Systems Tier 3 3 4 4 3 4 3 3 4 4 3 38 5 3 8 Totals 1 2 3 4 1 2 3 4 3. Generic Knowledge & Abilities 10 7 Categories 3 3 2 2 1 2 2 2 Note: Ensure that at least two topics from every applicable KiA category are sampled within each tier of the RO and SRQ-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the "Tier Totals* in each KIA category shall not be less than two). , The point total for each group and tier in the proposed outline must match that specified in the tabl The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRC-only exam must tota125 point . Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site*specmc systems that are not included on the outline should be added. Refer to section D.1.b of ES-401, for guidance regarding elimination of inappropriate KIA statement . Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolutio . Absent a plant specific priority, only those KAs having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO an"CSRC-only portions, respB;ctivel , Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categorie .- The generic (G) KlAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable KIA's On the following pages, enter the KIA numbers, a brief description of each ~opic, the'topics' importance ratings (IR) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. If fuel handling equipment is sampled in other than Category A2 or G" on the SRQ-only exam, enter it on the left side of CohJmn A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRQ-only exam . For Tier 3, select topics from Section 2 of the KiA Catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to KlAs that are linked to 10CFR55.43

,

ES-401 2 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 2.1.27 - Conduct of Operations: KnoWledge 009/ Small Break LOCA /3 X of sYStem puroose and J or functio .0 .1.25* Conduct of Operations: Ability 10 0261 Loss of Component Cooling X interpret reference materials, such as Water /8 Qraohs. curves, tables. et EA2.01 - Ability to determine or intel1lret 029 { Anticipated Transient Without X the follOWIng as they apply to a ATWS: Scram (ATWS) 11 Reactor nuclear instrumentation EA2.05 - Ability to detennine or interpret the following as they apply to a Station 0551 Station Blackout /6 X Blackout When battery is approadling fully .

discharoed  :

AA2.18 - Ability to determine and interpret the following as they apply to the Loss of 056/ Loss of Off*site Power /8 X Offsite Power: Reactor coolant temperature, pressure, and PZR level recorders 2.4.21 - Emergency Procedures 1 Plan:

Knowledge of the parameters and logic used to assess the status of safety 0581 Loss of DC Power 16 X functions, such as reactivity control, core 4.* 81 cooling and heat removal, reactor coolant system integrity, containment conditions, radioactivitY release control, et :

2.4.46 - Emergency Procedures / PI~n:

( 007 I Reactor Trip 11 X Ability to verify that the alarms are consistent with the olant condition AA1.03 - Ability to operate and I or monitor .

the following as they apply to the 008/ Pressurizer Vapor Space X Pressurizer Vapor Space Accident Turbine Accident 1 3 bypass in manual contralto maintain header pressure EK2.03* Knowledge of the interrelations oog / Small Break LOCA /3 X between the small break LOCA and (he followino: SlGs EK3.06 - Knowledge of the reasons for the following responses as the apply to the 011 / Large Break LOCA 13 X Large Break LOCA: Acl\Jatioo of Phase A and B durino LOCA initiation AA1.16 - Ability to operate and 1 or monilor the following as they apply to the Re.aetor 015/17 I Reactor Coolant Pump X Coolant Pump Malfunctions (Loss of RC Malfunctions 14 Flow): Low power reactor trip block status linhts AA2.04 - Ability to determine and interpret 022 / Loss of Reactor Coolant the following as they apply to the Loss of X 2.' 44 Makeup 12 Reactor Coolant Pump Makeup: How long PZR level can be maintained within limits AK2.03 - Knowledge of the interrelations between the Loss of Residual Heat 0251 Loss of Residual Heat X Removal System and the following: Removal System 14 Service water or dosed cooling water I numns ~

AK1.03 - Knowledge of the operational implications of the following concepts as 0271 Pressurizer Pressure Control System Malfunction 13 X they apply to Pressurizer Pressure Control 2.* Malfunctions: Latent heat of ( 0291 Anticipated Transient Without X

vaoorizatiorucondensation EK2.06 - Knowledge of the interrelations between the and the following an ATWS: 2.' 47 Saam (ATWS) /1 Breakers, relays, and disconnects

ES-401 2 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 1 EK3.02 - Kno'NIedg8 of the reasons for the following responses as the apply to the 0551 Station Blackout /6 X Station Blackout Actions oontafned in EOP for loss of offsile and onsite DOWer AA1.12 - Ability to operate and / or monitor 0581 Loss of Off-site Power 16 X the following as they apply to the Loss of Offsite Power: Reactor buildino coolino unit AK3.0t - KnO'Ntedge of the reasons for the followiog.responses as they apply to: the 057 I Loss of Vital AC Elecbical X Loss of Vital AC Instrument Bus: Actions 4.' 50 Instrument Bus f 6 contained in EOP for loss of vital ae electrical instrument bus AK1.01 * Knowledge of the operational Implications of the following concepts as 0581 Loss of DC Power /6 X they apply to Loss of DC Power: Battery charoer eouioment and instrumentation AA2.06 - Ability to determine and interpret the following as they apply to the Loss of 062/ Loss of Nuclear Servic X Nuclear Service Water: The length of time Water / 4 after the loss of CON flow to a component before that comoonent may be damaoed AA2.08 - Ability to determine and interpret the following as they apply to the Loss of 0651 Loss of Instrument Air / 8 X Instrument Air: Failure modes of air*

oDerated eauipment EK1.2 * Knowledge of the operation",l ( E041 LOCA Outside Containment /

X implications of the following ooncepts as they apply to the (LOCA Outside Containment): Normal. abnormal and emergency operating procedures associated ~~ {LOCA Outside Containmen .1.23 - Conduct of Operations: Ability to E11 f Loss of Emergency Coolant perfOnT! specific system and integrated X Recirculation 14 plant procedures during all modes of plant oDeratio E12 f Unoon\rolJed Depressurization 2.1.20 - Conduct of Operations: Ability to X

internret and execute 'nrocedure sten!;. of all Steam Generators f 4

'KJA Category Totals: 3 3 3 3 6 6 Group Point Total:

I '816 (

ES-401 3 Form ES-401-2 ( McGuire 2008 NRC Exam Written Examination Outline Emergency and Abnormal Plant Evolutions - Tier 1 Group 2 AA2.02 * Ability to determine and interpret the following as they apply to the Dropped 0031 Dropped Control Rod 11 X Control Rod: Signal inputs 10 rod control svslem AA2.05 - Ability 10 determine and interpret the following as they apply to the Loss of 0331 Loss of Intermediate Range Nudear Instrumentatioo/7 X Intermediate Range Nudear 83 Instrumentation: Nature of abnormality, from rapid survey of control room data 2.2.38 - Equipment Control: Knowledge of 0591 Accidental Liquid RadWaste X conditions and limitations In the facility Release /9 licens .1.20 - Conduct of Operations: Ability to E06 / Degraded Core Cooling /4 X internre! and execute "nrocedure sten .6 85 AA1.02 - Ability to operate and I or monitor ODS/Inoperable/Stuck Control Rod I the following as they apply to the X Inoperable / Stuck Control Rod: Rod selection switches AA2.03 * Ability to determine and interpret the following as they apply to the 024/ Emergency Boration /1 X Emergency Boration: Correlation between 2.' 58 boric acid controller setpoint and boric acid flow AK1.01 - Knowledge of the operational 0321 Loss of Source Range Nudear X implications of the following concepts as '

( Instrumentation 17 0331 Loss of Intermediate Range Effects of voltaoe chanoes on oerformance AA1.02 - Ability to operate and I or f'!l0nitor the following as they apply to the Loss of Nudear Instrumentation /7 X

Intermediate Range Nudear Instrumentation: Level trip bvoass AK2.01 - Knowledge of the interrelations 036 { Fuel Handling Incidents /8 X between the Fuel Handling Incidents and 2.' 61 the following: Fuel handUng equipment AA2.12* Ability to determine and interpret the following as they apply to the Plant 067 I Plant Fire On-site 18 X Fire on Site: location of vital equipment 2.' 82 within fire zone AK3.01 - Knowledge of the reasons'for the following responses as they apply to the 0691 Loss of Containment Integrity /

X Loss of Containment Integrity: Guidance contal~ in EOP for loss of containment int"""rilv AK2.01 * Knowledge of the interrelations

,

0761 High Reactor Coolant Activity /

X between the High Reactor Coolant Activity and the following: Process radiation monitors .4.8 - Emergency Procedures 1 Plan:

Knowledge of how abnormal operating E021 SI Termination 13 X procedures are used in conjunction :-vith EOP' KiA Category Totals: 1 2 1 2 4 3 Group Point Total:

I 9/4 (

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 System # I Name K

K K K K 2 3 4 , K

A

A

A

A

G Im a

A2.01 - Ability to (8) predict the impacts of the following malfunctions or operations on the PZR pes; ana (b)

010 Pressurizer Pressure based on those predictions, use X 3.6 86 Control procedures to correct, control, or mitigate the consequences of those malfunctions or operations: Hea~r fajrUTes A2.03 * Ability to (a) predict the impacts of the following malfunctions or .

operations on the CSS; and (b) based 026 Containment Spray X on those predictions, use procedures to 4.4 87 correcl control, or mitigate the

~sequences of those matfun~ons Of o erations: Failure of ESF 2.4.4 - Emergency Procedures I Plan:

Ability 10 recognize abnonnal 061 AUxiliarylEmergency indications for system operating X 4.7 86 Feedwaler parameters which are entry*level

=itiO~S~~ency and abnormal o ratino; ure .2.4 - Equipment Control: (multi-unit license) Ability to explain the variations 073 Process Radiation ( Moniloring X in control board layouts, syslems, instrumentation and p~uraJ actions between units at a fadl '

3.6 88 A2.02* Ability 10 (a) predict the impacts of the following malfunctions or operations on the SWS; and (b) based on those predictions, use procedures 10 076 SefVice Waler X correct, cootrol, or mitigate the 3.1 80 consequences of those malfunctions or operations: SefVice water header I nressure K1.08 - Knowledge of the physical connections and/or cause-effect 003 Reactor Coolant Pump X relationships between the RepS and the following systems: Containm'ent isolation K5.46 - Knowledge of the operational im\::Jfications of the following concepts 004 Chemical and Volume as they apply to the CVCS: Rea~n for X 2.' 2 Control going solid in PZR (collapsing steam bubble): make ~~: no sleam is In PRT when PORV is 0 ened to drain RCS K2.03 * Knowledge of bus power 005 Residual Heat Removal X supplies 10 the following: RCS pressure bounda'" motor-o";erated valves A4.01 * Ability to manually operate 006 Emergency Core Cooling X and/or monitor in the control room: Pumns 007 Pressurizer Relief/Quench Tank X

A3.01 - Ability to monitor automatic operation of the PRTS. induding:

Components which discharge 10 the ,

PRT ( 008 Component Cooling Water X K2.02 - Knowledge of bus power SUPPli~o to :~~i~:ng: ~o: pump, includin em en backu K4.01 * Knowledge of COOS design feature{s) andlor interlock(s) which 008 Component Cooling Water X provide for the following: Automatic star! of standbv num"

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A a System # I Name 1 2 3 4 5 6 1 2 3 4 G

, Im *

K1.07* Knowledge of the physical oonnections and/or cause-effect 010 Pressurizer Pressure X relationships between the PZR PCS 2.9 8 Control and the following systems:

Containment A3.03 - Ability to monitor automatic 012 Reactor Protection X operation of the RPS, including: Power 3.4 9 sUDol" K6..Q.3 * Knowledge of the effect ,of a 012 Reactor Protection X loss or malfunction of the following will 3.3 10 have on the RPS: Trio loalc circuits K4.08* Knowledge of ESFAS design 013 Engineered Safety X feature{s) and/or interlock{s) which 3.1 11 Features Actuation I provide for the following Redundancv A2.05 - Ability to (a) predict the impacts of the following malfunctions or .

operations on the ecs; and (b) based 022 Containment Cooling X on those predictions, use procedures to 3.1 12 correct control, or mitigate the consequences of those malfunctions or operations: Ma'or leak in CCS :

K6,01 - Knowledge of the effect of a loss or malfunction of the following will 025 Ice Condenser X have on the ice condenser system: 3.4 13 Upper and lower doors of the ice condenser K501 * Knowledge of operational implications of the following concepts 025 Ice Condenser X as they apply to the ice condenser 3.0 14 system: Relationships between I pressure and temPtirature 2.2.22* Equipment Control: Kno,wledge 026 Containment Spray X of limiting conditions for operations and 4.0 15 safety limit '

K3.02 * Knowledge of the effect that a loss or malfunction of the CSS will have 026 Containment Spray X 4.2 16 on the following: Recirculation spray sYStem A4.04 - Ability to manually operate 039 Main and Reheat Steam X and/or monitor in the control room: 3.8 17 EmerQenev feedwater pump turbines I ~4:O7 - Knowledge of MRSS design feature(s) and/or interiock(s) which 039 Main and Reheat Steam X 3.4 18 provide for the following: Reactor buildino isolation A1.03 * Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated 059 Main Feedwater X 2.7 19 with operating the MFW controls including: Power level restrictions for operation of MFW "urn"'" and valve K3.01 * Knowledge of the effect that a 061 AuxilJaryfEmergency X loss or malfunction of the AFVII will 4.4 20 Feedwater have on the followino: RCS A3.05 - Ability to mOllitor autom;;ttic 062 AC Electrical Distribution operation of the ac distribution sYste X 3.5 21 ( including: Safety-related indicators and controls A1,01 - Ability to predict and/or monitor changes in parameters aSSociat~ with 063 DC Electrical Distribution X operating the dc electrical system 2.5 22 controls including: Battery capaCity as it is affected bv dischame rate .

ES-401 4 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 1 K K K K K K A A A A e System # I Name 1 2 3 4 5 6 1 2 3 4 G Im *

K6.0B * Knowledge of the effect of a 064 Emergency Diesel Joss or malfunction of the following will X

have on the ED/G system: Fuel oil Generator storaoe tanks  :

A2.01 * Ability 10 (a) predlct the impacts of the following malfunctions or operations on the PRM system; and (b)

073 Process Radiation based on those predictions, us X Monitoring pmc;edures 10 correct, control, or mitigate the consequences of those malfunctions or operations: Erratic or failed DOwer suoolv 2.4.11 - Emergency Procedures / Plan; 076 SefVice Water X Knowledge of abnormal condition 4.* 25 procedure ~

K3.07 - Knowledge of the effect that a 076 Service Water X loss or malfunction of the SWS will have on the followino: ESF loads 2.4.35 - Emergency Procedures I Plan:

Knowledge of local auxiliary operator 078 Instrument Air X tasks during emergency and the resultant ooerational effect A4.01 - Ability to manually operate and/or monitor in the control room:

103 Containment X Flow control, pressure control, and ( temperature control valves, including Dneumatlc valve controller :

KIA category Totals: 2 2 3 3 2 3 2 5 3 3 5 Group Point Total: I 2815 (

ES-401 5 Form ES-401-2 McGuire 2008 NRC Exam ( Written Examination Outline Plant Systems - Tier 2 Group 2 System # I Name K

K

K

K 4 ,

K K

A A A A 1 2 3 4 G Im Q

2.1.7 - Conduct of Operations: Ability to evaluate plant performance and make 015 Nuclear Instrumentation X operational judgments based on 4.7 91 operating characteristics, reactor behavior, and instrument Intemretatlo A2.03* Ability 10 (a) predict the impacts of the following malfunctions or operations on the HRPS; and (b)

based on those predictions, use:

Pro<.:edures to correct, control, Of 028 Hydrogen Recombiner and X mitigate the consequences of those 4.0 92 Purge Control malfunctions or operations: The hydrogen air concentration in excess of limit llame propagation or detonation with resulting equipment dam-age in containment A2.01 * Ability to (a) predict the impacts of the following malfunctions or operations on the SAS; and (b) based 079 Station Air X on those predictions, use Procedures 3.2 93 to COfTect. control, or mitigate the consequences of those malfunctions or onl!rations:: Cross-connectlon with lAS K4.03 - KnO'N1edge of RPIS design ( 014 Rod Position Indication X feature{s) andlor interlock(s) which provide for the following: Rod Bottom lioh~ .

32 29 K6.01 * Knowledge of the effect'of a 017ln-core Temperature loss or malfunction of the following ITM Monitor X system components: Sensors and 2.7 30 detectors K2.01 * KnO'N1edge of bus pov,te(

015 NucJear Instrumentation X supplies to the following: NIS channels, 3.3 31 System comoonents, and interconnections K1.01 * Knowledge of the physical connections andfor cause-effect 028 Hydrogen Recombiner and relationships between the HRPS and Purge Control X 2.' 32 the following systems: Containment annulus venti~\tion system (incJl,lding nressure Iimi~

A4.04 * Ability to manually opE!f8te 029 Containment Purge X aMrtor monitor in the control room: 3.' 33 Containment Evacuation sional K3.01 * Knowledge of the effecfthat a loss or malfunction of the Spent Fuel 033 Spent Fuel Pool Cooling X Pool Cooling System will have on the 2.6 34 followino: Area ventilation sYStems A2.05 - Ability to (a) predict the impacts of the following malfunctions or :

operations on the SIGS; and (bY based on those predictions, use procedures 035 Steam Generator X to correct, control, or mitigate the 3.2 35 consequences of those malfunctions or operations: Unbalanced flows to the SIGs ( 041 Steam DumplTurbine Bypass Control X

A3.03* Ability to monitor automatic operation of the 50S, incJuding: Steam flow 2.7 36

ES-401 5 Form ES-401-2 McGuire 2008 NRC Exam Written Examination Outline Plant Systems - Tier 2 Group 2 K K K K K K A A A A Q System # I Name G Im #

A 1.06 - Ability to predict and/or r.nonitor changes in parameters(to prevent exceeding design limits) associated 071 Waste Gas Disposal X with Waste Gas Disposal System operating the controls including:

Ventilation system  :

K5.03 - Knowledge of the operalional implication of the following concepts as 086 Fire Protection X they apply to the Fire Protection System: Effect of water spray on electrical components

KIA Category Totals: 1 1 1 1 1 1 1 3 1 1 1 Group Point Total:

I 12/3

ES-401 Generic Knowledge and Abilities Outline (Tier3)  : Form ES-40 1-3 ( Facility: McGuire 2008 NRC Exam Date: 5/1212008 :

RO, SRO-Only Category KIA # Topic IR Q# IR Q#

Knowledge of the fuel-handling responsibilities of 2.1.35 SRO' Ability to make accurate, clear and concise logs, 2.1.18 . records, status boards, and report Conduct Knowledge of facility requirements for controlling 2.1.13 ,67 of Operations vitali controlled acces Ability to coordinate personnel activities outside 2. .4 68 the control roo Subtotal :3 1 Knowledge of the process for conducting special 2. .6 95 or infrequent test Knowledge of limiting conditions for operations 2.2.22 and safety limit . Ability to apply technical specifications for a Equipment 2.2.40 syste Control 2.2.13 Knowledge of tagging and clearance procedure .1 ,70 Knowledge of the process for making changes to 2. .0 *71 procedure Subtotal '3 2 Knowledge of radiation or containment hazards 2.3.14 that may arise during normal, abnormal, or emeraencv conditions or activitie . Ability to approve release permits : Radiation Knowledge of radiation exposure limits under 2. .2 72 Control normal or emerQency condition .3.11 Ability to control radiation release .8 ]3 Subtotal 2 2 Ability to verify that the alarms are consistent 2.4.46  : with the plant condition Knowledge of how abnormal operating 2. .5 100 procedures are used in coniunction with EOP' Emergency Procedures I 2.4.17 Knowledge of EOP terms and definition .9 :74 Plan 2.4.14 Knowledge of general guidelines for EOP usag .8 75 Subtotal 2 2 Tier 3 Point Total 10 7

Retrieved from "https://kanterella.com/w/index.php?title=IR_05000360/2008301&oldid=2152165"