ML050950471

From kanterella
Jump to navigation Jump to search
February 2005-301 Exam 50-369 & 50-370/2005-301 Administrative Documents
ML050950471
Person / Time
Site: Mcguire, McGuire  Duke Energy icon.png
Issue date: 02/18/2005
From:
Duke Energy Corp
To:
NRC/RGN-II
References
50-369/05-301, 50-370/05-301
Download: ML050950471 (33)
v • d • e


Text

Administrative Documents MCGUIRE FEB 2005 EXAM 50-369 & 370/2005-301 FEBRUARY 7 - 15, 2005 FEBRUARY 18, 2005 (written)

1. Exam Preparation Checklist ....... ............. ES-201 -1/
2. Exam Outline Quality Checklist ...... ........... ES-201-2,/

& Exam Security Agreement ....... .............. ES-201-3

4. Administrative Topics Outline (Final) ..... ........ ES-301-1X/
5. Control Room Systems and Facility Walk-through Test Outline (Final) .................................... ES-301-2
6. Operating Test Quality Check Sheet ..... ........ ES-301-3 ES-301-4 /

Simulator Scenario Quality Check Sheet .........

8. Transient and Event Checklist .... ..... ES-301-5
9. Competencies Checklist ......... ES-301-6 X\ Written Exam Quality Check Sheet ....... .. ES-401-6 /
11. Written Exam Review Worksheet ..... .... ES-401-9/?
12. Written Exam Grading Quality Checklist ..... ..... ES-403-1
13. Post-Exam Check Sheet ........ .............. ES-501-1

/ FA P C,77 Lrc I

D -rD Ii, Ir r ..

// -l2-IS- 2, vo-n - - /-/.q_

Y -

o~c /4P+0"0,,0

-x I ~

LrLAJC.LCL5 ,,a..SX em i. - -

e Osbt

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: A

/ vvii Date of Examination: X__7-405-_l Examinations Developed by: KF~ajgdr D/ NRC (circle one)

Target Chief Date* Task Description (Reference) Examiner's Initials

1. Examination administration date confirmed (C.1.a; C.2.a and b) 7 / i/

-180

2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 1/7/Q

-120 1/9C

-120 3. Facility contact briefed on security and other requirements (C.2.c)

4. Corporate notification letter sent (C.2.d) Y

-120

[5. Reference material due (C.l.e; C.3.c; Attachment 2)3 I 4 (I

[-90]

-75 6. Integrated examination outline(s) due, induding Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and /so(otr ES-401-4, as applicable (C.1 .e and f; C.3.d)

Examination outline(s) reviewed by NRC and feedback provided to facility ,

-70 7.

licensee (C.2.h; C.3.e) 1________

-45 8. Proposed examinations (including written, walk-thmough JPMs, and Il scenarios, as applicable), supporting documentation (including Forms l ES-301-3, ES-301-4, ES-301-5. ES-301-6. and ES-401-6), and reference 1/~

materials due (C.1.e, f, g and h; C.3.d)

/

-30 9. Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; ES-202)

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee review /9 (C.2.h; C.3.f)

12. Examinations reviewed with facility licensee (C.1 .j; C.2.f and h; C.3.g) / / 3,/ >

-14

-7 13. Written examinations and operating tests appmoved by NRC supervisor / S (C.2.i: C.3.h)

-7 14. Final applications reviewed; examination approval and waiver letters sent (C.2.i; Attachment 4; ES-204) (

-7 15. Proctoring/written exam administration guidelines reviewed 2 / &/

with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

Target dates are keyed to the examination date identified in the corporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

Applies only to examinations prepared by the NRC.

ES-201, Page 24 of 27

Form ES-201-2 ES-201 Examination Outline Quality Checklist Jw G2 24-/b/or5

    • 4 v j

[ Failit:YPZDate of Examination: Initials Facility.

a Itc

... _,_ ex ,y ..Task g..._ Description lItem with ES-401. _ ()

'mAft ih- th nutllinets] fitsfs) the appropriate model, in accordance W and randomly prepared in accordance with I D

b. Assess whether the outline was systematically aries are apropatel sampled. 'a APOP Section D.1 of ES401 and whether all K/A cat LI-T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generc topics.

4 A #L E

N d. Assess whether the justifications for deselected or rejected K/A statements are approprate. Xo scenario sets cover the required number 2.

S

_a. Using Form ES-301-5, verify that the proposed of nomal evolutions, instnument and major transients.

and component failures, technical specifications. X I sets (and spares) to test the projected number M b. Assess whether there are enough scenario crew composition and rotation schedule and mix of applicants in accordance with the expeted #

U that each applicant can be tested using without compromising exam integrity, and ensure that no scenarios are duplicated at least one new or significantly modified scenario,

.f A will not be repeated on subs uent days T from the a ficants' audit test(s), and that scenarios outline(s) conform(s) with the qualitative 0 c. To the extent possible, assess whether the ES-3014 and described in Appendix 0.

R and quantitative critea specified on Form meets the criteria specified on Form ES-301-2:

3. a. Verify that the systems walk-through outline of control room and in-plant tasks the required number (1) the outline(s) contain(s)safety functions as specified on the form W distributed among the is within the limits specilied on the form

/ (2) task repetition from the last two NRC examinations T (3) no tasks are duplicated from the applicants' (4) the number (5) the number of of new or alternate modified path, tasks meets low-power, or audit exceeds emergency, test(s) the minimums specified on the form and RCA tasks meet the criteria -I on the foem.

the cniteria specified on Fomm ES-3011

b. Verify Uhtteadministrative outline meets (1) the tasks are distributed among the topics as specifiedi on he form (2) at least one task is new or significantly modified the lastiwo NRC ls nsing exami.nations 3d no more thn one task is repeated from to test the projected number and mix
c. Deterrnine if there are enough different outlines on subsequent davs.~

of api'ants and ensure that no items are duplicated PRA and IPE insights) are covered 4.a Asess heter plant-specific priorities (including in te aproprate xamsections.

sampling is appnopriate.

b.Asses whtherthe 10 CFR 55.41/43 and 55.45 E

r tIts .

/A imortane nabgs (eceptfor plant-specific priorities)

N c. nsurethat E d.Chec forduplcatin ad overlap among exam section S.

A e. Check the entire exam for balance of coverage.

job level (RO or SRO).

f. Assess wlhether the exam fits the appropriate II s/Dae ir l I t_) /
a. AuthorEem 3-6 8 l//i LLYs 11LaTV
b. Facility Reviewer (')

Cg

.,i-rrr/ a

c. NRC Chief Examiner (2)

ES-201, Page 25 of 27

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Fk OD°S as of the*

date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowl dge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of OLŽ75?. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

1. FdtJALIS If. KerALw1c0 NtassiZ STATdr-'

NOLAz!TjAj NPsTICrQ4 ION 1s-'Vcti 44

2. f14N,#AP V j9enFrr
3. D&NI fla kA?
4. Sv T4SI K.J . 1-.- L-X VA-A r- 41Lt .re -Lt- _s2- -0'5

- ,l ZX7e~ .L _ a @% 1-e YI/

7. O9S SfrFT n4.-4pc4.

2-7-oS, -VT-WL4-t A-,W . l 7-o0 f ,-b k

_ -/I//Cs 0jzS ,t * -/2_- 2 0 9 AyAgc = 7Z2-e(

10.  ; ____ *4.( ia
11. /7 fr

/f~S A- At -. ZTT I5/gg-~ 3, T,

_g VrM V

13.

14.

15.

NOTES: Scc Scet s-ES-201, Page 26 of 27

0l ES-201 Examination Security Agreement Form ES-20143 tPre-Examinatton I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of F4,.005 as o1 Ihe date of my signature. I agree that I will not knowingly divulge any information aboutilhese examtna31ons to any persons who have not been authorized bythe NRC chief examiner. I understand that I am nol to Instruct, evaluate, or provide performance feedback to Ihose applicants scheduled to be administered these I1censing examinations from this date until compielion of examilnation adminIstration, except as specifically noted below and l authoilzed by the NRC (e.g., aclina as a simulator booth operatoror communicator is acceptable If the Individual does not selecl thie training content or provide direct or indIrectfesdback). Furthermore, I am aware of Ihe physical aecurity measures and requirements (as documented in the tacility licensee's procedures) and understand Vhaiviolation of the condilions of this agreement may result incancellation of the examinations and/Oran enforcement acton agalnut meor the facility licensee. Iwill immediately report to facility management orthe NRC chlef examiner any Indcalons or suggeslons lthat exaniralfon security may have been compromised.

2. Post-Examinatllon To the best of my knoxqdge, I did not divulge to any unauthorized persons any Information concerning the NRC licensing examinations administered during the week(s) o63. tf75 From the date that I entered Into this security agreneart until the completlon of examination adIninistration, I did not Instruct, evaluate. or provide performnance feed back to those applicants who were administered these licensing examinations, except as specifically VzJ noted below and auihorized by the NRC.

PRINTED NAME JOB TITLE/ RESPONSIBILITY SIGNATURE ( 1) DATE SIGNAJTUYE, f E NOTE 7

1, P&tJAVb '2. 4 7ALwtCAV

2. IXN4D V A6n Er~r IJunS'TArbwa £N-g~flWLU
3. Daro rfc 1t hKa CISi sL)Ih? f trAK 2.7 tali A'/l, 7q r6 5 *v
6. M^. 4t-A ri' tdr <iA'

--1 os--

K-st-

9. vA/  !<.. _.Cr -,, , V

- ft 1;-0 :tat

_ 4.A~ 4kA t

10. ,^~v

_ DJ.Lu)gPLi, S. t =85;M- k--

r1.rhE 2e r.

P-Q n -

P 14_

15.

NO1TES:

'0 0

II ES-201, Page 26 of 27

-4

r.,..ni,,n.nn Qortritv Anrnnmant 43 Fhorm ES-201-3 ES-;-0 201 ,.....n_. ,

1. Pre-Examination -5A, Vae~ I Fla

~b I9, 400d hweek(s) of as of the NRC licensing e> fl orIs I acknowledge that I have acquired specialized knowledge about the about aenam in ns who havy t been authorized date of my signature. I agree that I will not knowingly divulge any informationor provij ierfornmg mapplica heduled to be that I am not to instruct, evaluate, by the NRC chief examiner. I understand aldmin n oed below and of examir administered these licensing examinations from this date until completion measure ents (as docu facility licensee's authorized by the NRC. Furthermore, I am aware of the physical security may ellation of the en , s and/or an enforcement procedures) and understand that violation of the conditions of this agreementmanag mNRC chief examiner any indications or suggestions that to facility action against me or the facility licensee. I will immediately report examination security may have been compromised.

A

2. Post-Examination on con NRC licensing examinations administered To the best of my knowledv, I did dgvule to any unauthorized persor jyntIl the pletion of examination administration, I did not during the week(s) of J M

inthe

'Ptom date that I entered into this instruct, evaluate, or provide performance feedback to those applica io we Wd the licensing examinations, except as specifically noted below and authorized by the NRC.

SNATUF DATE SIGNATURE DATE NOTE PRINTED NAME JOB TITLE / RESPONSIBILI)W

1. eW Ak d A sA -. f M r- A 4,
2. .2~ -

n

  • _ 2 I- 0-,

3.^ol f 4.;be 'l, SoAC ae _ s

'-'4*o X '

6. it-c
7. tZ-Of 8.
9. 13_
14. L o~¶.c brv 15 CPi rtst NOTES: JA Ot .cahn e ~ c M 17 Terry S.- SrC .-S;m s-Vl 25of 25 NUREG-1021, Draft Revision 9

ES-201 Examination Security Agreement FormrES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 3. S1agas of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ofS.27 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) D}IATE NOTE

1. RiCA4W Jtn-r 'A rq od /44"
2. ICT Me/i A/JVCCt/2 SIV2e fV9SratCfA /C ;I
3. ;e*-,.ia/ytn / -- .7-. ,V 4I /
4. bhb C. gofew ot sns %.c 7se A _ a 5.G,<xrttx 1Cok pcrL x;~, efon 9,J 1<N+ Catl si OSZ h )1E C.-! _7_
7. ___

10.

11._

12.-

13.

14.-

15.

NOTES:

ES-201, Page 26 of 27

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of i; :5;as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of tt . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

1. PVAP BODY OP 4 S fl4 r Q&1 7 2.56 c'; z 3*A OPS VALi IDaA-
3. l A L6v7 IES r . I5 lJA, a4-> _,, -i  ;' h
4. f..3._ ' 7/,J~ AC?,M _//s8 /S -32 ;IZ1q 1<1/f561 / 3-2 oe
5. /1
6. _ _
7. _ _
8. _ _

10.

11. ___

12.

13.=

14.-

15.

NOTES:

ES-201, Page 26 of 27

ES-301 Administrative Topics Outline Form ES-301-1 Facility: McGuire Date of Examination: wkzaa/dL Examination Level (circle one) SRO Operating Test Number: '

Administrative Topic Type Describe activity to be performed (see Note) Code*

AFD Calculation with inoperability Conduct of Operations N Conduct of Operations N,S Perform a Shift turnover Equipment Control M, Manual NC Leakage Calculation Radiation Control Emergency Plan N,C Perform RP/1 1 Conducting a Site Assembly or Evacuation NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

^Type Codes & Criteria: (C)ontrol room (D)irect from bank ( < 3 for ROs; < 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( > 1)

(P)revious 2 exams (< 1; randomly selected)

(S)imulator ES-301, Page 22 of 27

ES-301 Administrative Topics Outline Form ES-301-i Facility: _McGuire Date of Examination: 2/7-Examination Level (circle one): RO SRO Operating Test Number: I Administrative Topic Type Describe activity to be performed (see Note) Code*

Conduct of Operations N AFD Calculation with inoperability determination Conduct of Operations M Shift Manning Requirements Equipment Control N Thermal Margin Calculation and Evaluation of Work Allowed Radiation Control M, P. C Review and Approve a GWR Emergency Plan M, C RP/07 Earthquake with Technical Specification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are rptpLinn onnl' thoe mdiniptrtun tnIrc ,*hp aII 6 ,re ron. irr

  • Type Codes & Criteria: (C)ontrol room (D)irect from bank ( < 3 for ROs; < 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( > 1)

(P)revious 2 exams (< 1; randomly selected)

(S)imulator ES-301, Page 22 of 27

ES-31Cntro Romll-Plat Sstem Oulin 1-om t-su-t ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 I Facility: -McGuire Date of Examination: 2&/L-/dI/

Exam Level (circle one) i75O t SRO- Operating Test No.: I Control Room Systems@ (8 for RO; 7 for SRO-1; 2 or 3 for SRO-U)

System / JPM Title Type Codet Safety Function

a. Respond to a Loss of Component Cooling (KC-234A) N, S. A SF-8

. b. Respond to a Leak on operating ND System while at Mid Loop D, L, P SF-4P

c. Intermediate Range Failure (ENB-235A) (SROU) N, S, A SF-7
d. Align the Containment Spray system to Cold Leg Recirculation D,S,P,A SF-5 (lNS-182A) (SROU)
e. Respond to Additional Dropped Rods While Retrieving a Dropped Control Rod (IRE 1741A) A, D, S SF-1
f. Establish Feedwater Flow to S/G's following a Runback (CF-237) N,S SF-4S
g. Align Normal Charging With NV Recirc Path Isolated A,D, S SF-2 (NV-146A)
h. Start and Load 1 B D/G then Separate From the Grid (DG-198) D, S SF-6 IcpnI lSR In-Plant Systems' (3 for RO; 3 for SRO-1; 3 or 2 for SRO-U)
i. Control Steam Pressure Using SM PORVs (Unit 2) (SM238) E, B SF-4S (SROU)
j. Borate the Reactor Coolant System from the Auxiliary Shutdown R. E, B SF-1 Panel ASP-138 (SROU)
k. Aligning Control Air from Backup Cylinders to F VI Compressor E, A, P SF-8 VI-11 OA) j e AMl UwmILJII IdUU[T kdllU III-pIdIlL) bystellb [ IULb be JUie eUl gInU sd~el v euivu in-plant systems and functions may overlap those tested in the control room.
  • Type Codes l Criteria for RO / SRO-I SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank <9/<8/< 4 (E)mergency or abnormal in-plant >1/ >1/>1 (L)ow-Power >1/ >1/>1 (N)ew or (M)odified from bank including 1(A) >2/ >2/ >1 (P)revious 2 exams < 3/ < 3/ < 2 (randomly selected)

(R)CA I>,1/ > 1/ > 1 (S)imulator l or /4 5~k ES-301, Page 23 of 27

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: e0'-t Date of Examination:j2/h/&/%'r Operatir TestNumber:

Initials

1. General Criteria _ _

a b c#

The operating test conforms with the previously approved outline; changes are consistent with 4 t ,,

a. _ 47_

sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered @ t, -

during this examination. _ Y

c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section 01 a.) 2,
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits._
e. It appears that the operating test will differentiate between competent and less-than-competent (4 applicants at the designated license level.=
2. Walk-Through Criteria
a. Each JPM includes the following, as applicable:
  • initial conditions
  • initiating cues /i references and tools, including associated procedures
  • reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
  • operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable _ _ _

b. Ensure that any changes from the previously approved systems and administrative walk-through lj outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance //

criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified

[-I on those forms and Form ES-201-2.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed inaccordance with Form ES-301-4 and a copy is attached. = = =

Printed Name / Signature Date

a. Author 14 A)( 1/

Yk//I,7dT Am -2o, l

b. Facility Reviewer(.) Y t>z / -tll- If /7/w1/2>
c. NRC Chief Examiner(#) - ________
d. NRCSupervisor JC,0ars /lf OV$# c -- [VS l NOTE:
  • The facility signature is not applicable for NRC-developed tests.

I independent NRC reviewer initial items inColumn c"; chief examiner concurrence required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist Form ES-301 4 Facility: of e40"r fe Date of ExarT ( 7SoEnariNumbers: I ~1- I) Operating Test No.:

QUALITATIVE ATTRIBUTES Initials a b- c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
2. The scenarios consist mostly of related events.

U . h

3. Each event description consists of
  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event cii
  • the symptomstcues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable)

A /4/7

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenano without a credible precedin incident such as a seismic event.
5. The events are valid with regard to physics and thermodynamics. , O
6. Sequencing and timing of events is reasonable, and allows the examination team to obtain LA A complete evaluation results commensurate _ withthe scenaro objectives.
7. If time compression techniques are used, the scenario summary clearly so indicates. l"/A sl#

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

8. The simulator modeling is not altered.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator 7 9.

performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. _

10. Every operator will be evaluated using at least one new or significantly modified scenario.

f -l All other scenarios have been altered in accordance with Section D.5 of ES-301.

f  ;

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 _

(submit the form along with the simulator scenarios).

Each applicant will be significantly involved in the minimum number of transients and events v it 5

12. _

specified on Form ES-301-5 (submit the form with thesimulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position. it t' Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes --

I1. Total malfuncfions (5 8) 1 2 / 6,l (1 C

I I id / $ S1

2. Malfunctions after EOP entry(1-2)
3. Abnorrrale vnt (2 4) 51t t8X
4. Majortransients (1-2) lI / Qkl4
5. EOPs entered/requiring substantive actions (1-2) 3 i 11 4.>

EOP contingencies requiring substantive actions (0-2) __ I ` A_

6.

7. Critical tasks (2-3) 3 2, 3 _i ES-301, Page 25 of 27

tiAu)I (Io eW I I I ES-301 Transient and EventChecklist Form ES-301-5 Facility: Date of Exam: Operating Test No.:

A E Scenarios P V P E L N 2 3 4 T M I T 0 C CREW POSITION CREW POSITION CREW POSITION CREW POSITION A N A T L M N YL M T p S A B S A B S A B S A B U E R T 0 R T 0 R T 0 R T 0 M 0 C P 0 C P 0 C P 0 C P RX __ I I R It NORI z .

SRO-1 I/C CI,1, - 3 -, y 4 SRO-U MA' =7 _2 2 TS 2 RX 1 RO NOR - 41 SRO-I I/C 2-. b 2-C = 4 MAJ 2 2 TS 3. 5 1,3 L1 2 RO RX _ 1 NOR _ jl R I/C 3%_ === 4^

SOU MAJ I - 1 TS = =2 RX __1

( NOR _ __ _51 SRO-l I/C I 4 SRO-U TS - - _ 1Z 2 TS 2 Instructions:

1. Circle the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the 'at-the-controls (ATC) and 'balance-of-plant (SOP) positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
2. Reactivity manipulations may be conducted under normal or contriued abnormal conditions (refer to Section D5d) but must be significant per Section C.2.a of Appendix D.
  • Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: 0 J*kyv NRC Reviewer:

IC/-

ES-301, Page 26 of 27

tt z -itJ I22- I23 asza3 2 ES-301 Transient and Event Checklist Fonn ES-301-5 Faclity: = Date of Exam: Operating Test No.:

A E Scenarios P V P E L N 1 2 3 4 T M I T 0 I C CREW POSITION CREW POSITION CREW POSITION CREW POSITION LAM A I A T N - - [M T P S A B S A B S A a SB U E R T 0 R T 0 R T 0 R T O M 0 C P 0 C P 0 C P 0 C P NOR __ _ __ 1-SRO-1 11C 4 2

SRO-U MU_

TS 2 RX 1 11 RO NOR 5 _1-SRO-I I/C =-= = = 4' Z 2 ou MAJ 6 1 TS 8 _ _ _ = 3 12 RX _1 RO NOR - 1-RQl I/C3 -

SRO-U MA _ _ 1_2

___TS 4IS2 RO NOR _

SRO-I IC SRO-U M== 2 Instructions:

1. Circle the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve inboth the at-the-controls (ATCr and 'balance-of-plant (BOPr positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, inthe ATC posidion.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section OD.5d) but must be significant per Section C.2.a of Appendix D.' Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-For-I basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that Drovide insight to the applican s competence count toward the minimum requirement.

Author: IV J7l~

NRC Reviewer: ~L7V r

ES-301, Page 26 of 27

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Date of Exam: Operating Test No.:

A V Scenanos P V P E L N 1 2 3 4 T M I T 0 I C CREW POSITION CREW POSITION CREW POSITION CREW POSITION A N A T L M N V -L- -M-T P S A B S A B S A B S A B U E R T 0 R T 0 R T 0 R T 0 M 0 C P 0 C P 0 C P 0 C P RX I 4

R0 NOR _

SRO-l UC 4-SRO-U MA' 2 TS 2 RX wI

( NOR T11' SRO-I 2C=

U TS _2 RX 71 RO NO SRO-U TIC =-6 =4= A#*

TS n a b 22r RX P, RO N-OR P, SRO-p I/C Sl SRO-U MAJ 2 TS 2 Ins tr c io s

1. Circle the applicant level and enter the operating test number and Form ES-D-l event numbers for each event type:

TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance~-of-plant (ROP)r positions; Instant SROs must do one scenario, including at least two instrument or component (tIC) malfunctions and one major transient, in the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D.
  • Reactivity and normal evolutions may be replaced vith additional instrument or component malfunctions on a 1-for-I basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that rovide insight to the aplicant's competence count toward the minimum requirement.

Author: (Ja,/40n NRC Reviewer nP - A~- ,i7 ES-301, Page 26 of 27

Pleum , , LAI ES-301 Competencies Checklist Form ES-301-6 Facility: Mt, f1- 4.k Date of Examination: Ftb ) ( Operating Test No.: I APPLICANTS ARO- l RO/SRO- RO/SRO- JRO-I/SRO-U I/SRO-U /ISRO-U1 Competencies SCENARIO SCENARIO SCENARIO SCENARIO

[la? Zji- wr---

1 2ra 4 l'1r '21 3 1 4 1 21 '3 l f 3N1 4 1 #2t

_____ _12 41 3 1231234 Interpret/Diagnose 2,( 3Ai ).1 ZA 2n.

Events and Conditions _ ___ 1 Comply With and ,3 2,11 3.7 _ 2,9, 57, Use Procedures (1 1, )i ',S __L,

2. , ZY

),,

Operate Control 4i 2 _ - - I Boards (2 hi ~ - - _ _ -7 7k_

Communicate -4 e -7 and Interact Demonstrate _ _ .

Supervisory Ability (3) _ l _ _ m _ -

Comply With and Use Tech. Specs. (3) _ _ L _ E _ = M =

17- 3

=

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant Author: Y)Atro NRC Reviewer: I/an,

"'F,11 ES-301, Page 27 of 27

(A Ul3 1*

t2:

123 cvl,)

ES-301 Competencies Checklist Form ES-301-6 Facility: Met CXL44\L Date of Examination: Feb 2,CVS Operating Test No.: I APPLICANTS fi3/SRO- RO/SRO- MOO- RO/SRO-I/SRO-U IisfO-Q) l V7SRO-U I/SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO alp 12w 3 4 l1 l23l IT 3 l14 1 2 13 14

______ 1234123412341234 _E _

Interpret/Diagnose 2% i,3 , ,4> 3.0 ,.

Events and Conditions _ , __ - L , _

Comply With and2, ZMI)

Use Procedures (1) a -- - S 2~Z5, Operate Control 1, /,3 Boards (2) b _ _ Y.. -

Communicate and Interact s i EC_

Demonstrate - _ '-l Supervisory Ability (3)-

Comply With and 2- l -

Use Tech. Specs. (3) - = = - == - = - = -= = = =

Notes:

(1) includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant Author: -zLt1j,-_

NRC Reviewer: ,6/-}z 4PAr ES-301, Page 27 of 27

ES-301 Competencies Checklist Form ES-301-6 Facility: Mt 6U A Date of Examination: fJ7 Zoo7C Operating Test No.: I APPLICANTS (f/SRo- ( LR ROI ROISRO-I/SRO-U I/SRO-U l IJ O2L I/SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO Va 4 " "I 3 4 s 123 Interpret/Diagnose 3,' ,-4)

Events and Conditions 7) I _ _, I 6_

Comply With and '-si 2,1, Use Procedures (1) 1)6,e7I - _ _ - - - -__

Operate Control q2t Boards (2)2& LA Communicate and Interact l _ I-7 7-- i1 '

Demonstrate _ _ - -

Supervisory Ability 3 Comply With and _ _~

Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency forrer applicant.

Author:

f NRC Reviewer:

ES-301, Page 27 of 27

ES-401 Wriften Examination Quality Checklist Form ES-401-Facility: Date of Exam: Exam Level: RO/SRO Initial Item Description a b- c

1. Questions and answers are technically accurate and applicable to the facility. __r
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available. /' A*
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401
4. If more than four RO and two SRO questions are repeated from the last two NRC icenping exams, the facility licensee's sampling process was random and systematic. V/A _
5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_ the audit exam was systematically and randomly developed tthe audit exam was completed before the license exam was started tthe examinations were developed independently tthe licensee certifies that there is no duplication other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest _ ,4,!SO g-new or modified): enter the actual RO / SRO-only E q / r question distribution(s) at right. 17
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension/ analysis level; r the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels: enter 1 /52 / zo the actual RO / SRO question distribution(s) at rght.
8. References/handouts provided do not give away answers or aid in the elimination of distractors. _____
9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned: 4/

deviations are justified.

10. Question psychometric quality and format meet the guidelines in ES Appendix B. _____
11. The exam contains the required number of one-point, multiple choice items; a.t 4 the total is correct and agrees with the value on the cover sheet. = =

Printed Name / Signature Date

a. Author I J 7 S
b. Facility Reviewer() c'S/N .17 Bcot ./ / tW
c. NRC Chief Examiner(i) -
d. NRC Regional Supervisor , rf O d1o{ VI Note:
  • The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column c-: chief examiner concurrence required.

ES-401, Page 29 of 33

ES-401 Written Examination Form ES-401-9 Review Worksheet

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Sti dI (F/H) (1-5) Stem Cues T/F Cred Partial Job- Minutia #/ Back- = ISRO U/ElS Explanation Focus Dist. Link units ward K/A Only Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements. Ia One or more distractors is not credible. ' ,/

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 3 Cotc j vs

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). / 9 -&

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).I The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements. S7&-&/

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any "U ratings (e.g., how the Appendix B psychometric attributes are not being met).

RO/SRO Combined Question 1090 H 2 _ E Discuss using over/under compensated vice "higher than actual'.-> E 1091 H 2 a E MS leak not even detectable on RCS. Only MSLB. Suggest Ivl instrument ref leg leak.

1092 H 2 E Change maintenance to repait E'l 1093 F 2 d E reword d to make it look more like b & c N.

1094 F 3 I E See comments on question , N 1095 H 3 x IE GSIoodstart. Need more words to explain basis for distractors. See comments

-iffm- rAlyK44A4' an OX6 /f X +~

75-'

1 2. 3.Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

0# LOK LCD I ' IKA~Ol (F/H) (1-5) Stem j Cues T/F Cred. lPartial Job- Minutia #l/ lBack- 0 S U/EIS Explanation Focus Dist. Link lunits ward KA l _nly l 1096 H 3 X x typo on K/A Eis A. Delete the word "insurgevbCSee comments on question.

X N 1097 F 2 B U a is not really the bases r the step. B is implausible. See coments (rewrote stem) N 1098 H 2 = This is a NOT K/A (reverse) question. le when not to use steam dumps. M 1099 F 2 S5 MSIV isolation ? B 1100 F 1 D~iscuss stem N 1101 F 2 x E Reword stem to remain in SBO conditions. If other diesel start there is no SBO. N 1102 H 2 x _ Question tests indications and not the effect on motors of loss of bus. Also if 9Kyou are verifying actions have occurred they are not manual. Ad >ts N 1103 H 1 x U B corect in any circumstance. See comments on question. N 1104 H 2 S t 1105 H 3 x ES change b,c,d SG to 13,16,14 so that the 3.5 psig in containment means something to the question. Other numbers are below 12% and ACC does't mailer. N 1106 H 2 x X _ _ Not a loss of recirculation if NLO restores valve open. Question should deal I with5su t of K/A. leHow long would NLO have to get valve open before los ofMT due todepletion?

1107 H 2 Iis "d" fully closed? What % gives alarm? Can you do perform this at high S power? N 1108 F 2 X x ES What kind of malfunction.? AP encompasses many. Does not match KA in the way it is worded. Must tie to conditions and limitations in facility license.'

Should be worded something like ' To prevent approaching or exceeding DNBR limits" B 1109 H 2 S IN 1110 H 2 a ES Should avoid using NONE. h a rSo sirtyvedW

_ _ _ _ _ _ _ , Iniat t 1an and giv normal C ciiyIvlA wefM u b

`1-1111 F 2 x U SThis is not an accidental release. N 1112 F 3 bd E 5 Distractor analysis needs work. Replace "no safety injection signal " with

_MSL break outside containment, MSIVs manually closed and".. N

LOK 2L 3. Psychometric Flaws 4.Job Content Flaws 5. Other 6. 7.

(F/H) (1-5) Stem Cues lT/F Cred. Partial Job- Minutia #/ Back- 0=SRO U/EIS Explanation l Focus l Dist. Link units ward K/A Only 1113 H 2 a E See comments on use of the word prtereri*C N 1114 H 3 x E 5 Need to ensure there is enough information in the stem to support that 2 RCPs are still running . Is this RO required knowledge? N 1115 H 2 x E S Remove last bullet regarding charging. B 1116 H 3 a ES add mode 4 or 5 to stem. To make a"a" plausible. Is the second sentence Inecessary. Look like teaching. IN 1117 F 2 ESl Fix distractor analysis and mark "a" correct. Change expected to approximate. B 1118 F 2 d ES Change d to read ."..could cause the failure of the primary ..." These steps ensure the reactor is shutdown immediately and maintained in mode 2 until theconditionh iscorrected. Add "shutdown and coo/down is initiated to answer c. B 1119 H 2 S S What is LTOP setpoint ? Will relief lift so you do not get large increase in Ipressure  ? N 1120 F 3 cd E Feedwater isolation plausible.? N 1121 F 2 d E d does not remove from system. Try venting the VCT. Do head vent go to PRT? N 1122 F 2 S make d a single loop drain.s~ N 1123 H(F) 2 X  ? S Listed KA does not match outline . Should be 008A1.031-1<icuss answer N 1124 F 2 cd E S 50 minutes too Iong to be time critical. Change to 30 minutes and place in I accordance with AP-21 in stem. N 5

1125 H X E KA deals with malfunction of PZR not instrument. A leak at the weld for the 3 instrument could fail detector to read low (1950?) and meet K/A. © Change modulate to "cycle to maintain pressure". Delete Reactor will not trip in a,b,c.

Delete 3 d line of d. M 1126 H 3 a ES change a to Loop 1 Tave fails HIGH. B 1127 H 3 x _ E Remove bypass from stem. Reword dto be like others. Channel 1and 2 1 1tripped, cnmt spray would actuate N

1 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6 7.

Q# LOK LOD j _ _ I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO U/E/S Explanation Focus Dist. Link I units ward K/A Only 1128 = Stem helps to answer question 1120. Reword to All actions associated with H 1 U RCS prsure reaching P-1Il are complete. With cnmt pressure at 1.3 psi9 stem does not matter or add to question. Change Pzr pressure 1840 psig.

Ctmt pressure .8 psig. Change answer to b. M 1129 F 2 B 1130 F 2 ac E9 Distractors not very plausible. What tP would be required? N 1131 H 2 x ab U Delete last bullet after 12 psig. A,b distractors can be tossed because they I are non specific. N 1132 H 3 S Discuss use of reference. Which window is illuminated? M 1133 F 2 x ES Puffing feedwater isolation in stem eliminates ab. Change stem to: Upon receipt of a P-14 signal which of the following occurs? M 1134 H 3 S N 1135 F 1 x U KA is for diesel driven AFW pump. The closest match is turbine driven AFW pump. What is the power supply for control power? N?

1136 F bcd lU 3 distractors very similar or essentially the same condition therfore all can be eliminated.. Do you have ground fault detection circuitry? Bank question distractors better. Replace bor c B 1137 F 2 x E If c true then a & b would be true. Therefore, abc are incorrect. Add if an Si signal were to occur to end of stem. Add only to a. Change c to would start automatically. N 1138 F 3 I NS 1139 F 1 U add to stem, line voltage is 4150v and DG is 4200V. Reword last sentence to

..Must be done before closing the 1ETA Emergency Breaker lAW the 1 procedure. N 1140 F 2 _ lNocorrectanswer. 1EMF-35Triplishutsdownallfans. N 1141 H 2 X l How does this relate to the Secondary closed cooling water ? g _ N 1142 H 3 X US Question does not elicit the desired response. Stem and distractors need to be reworded. Why would DG be running? See Comments N 1143 F 2 lS 1144 F 2 A No correct answer since earist time would be when at 32%level.. Also all Sgs would not read exactly t same. Reworlk N

1. 2. 3.Psychometric Flaws 4. Job Content Flaws 5*Other 6.

O# [OK (F/H)

LOD (1-5) Stem Cues T/F I- red. Partial Job- Minutia #/ Back- 10 RO U/EIS Explanation

_ Focus Dist. Link units ward 1145 F 2  ? E4 Assume all communications operate normally. Are we bordering on SRO event classificaiton? N 1146 H 3 S 1147 H 2 ES Dicuss 1148 H 2 S 1149 H 2 c E cnot real credible. A N 1150 H 3 x 2'Answer is not related to K/A le there is no effect on the FHS due to loss of rad monitor. This may meet K/A discuss use of references. I 1151 H 2 S Rods in Auto ? l 1152' F 2 S E 1153 H 1 X U Cannot describe what features are lost upon loss of 1EVDD. This points directly to 'a" since from the control board is eliminated from the stem.

Remove bullet statements. I 1154 H 3 X E- Appears to not meet the K/A. Where is the inadvertent actuation? ,Z 01/

1155 F 2 S The last bullet about NCO feels announcement is warranted in reference ma be a problem.

1156 F 2 E-S Add lAW OMP 5-2 to stem. Make answer Fire drill in Unit 2 cable spreading room.N 1157 F 2 SW E 1158 F 2 l l h..Change 4 refueling to core unload.l 1159 F 2 S VMay want to put IAW procedure ... /

1160 H 3 x ?_l Not exactly sure what the question is asking. Stem not iear 1161 F 2 Sv E 1162 F 3 ES Bullets are somewhat confusing. May want to be more specific to eliminateN l questions during the exam.

1163 H 3 ?S What are distractors based on? et 4rqee ste ...

1164 F ?I Discuss discriminatory value OK.

ES-401 Written Examination  ; A4l Form ES-401-9 Review Worksheet t

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- = SRO UIE/S Explanation Focus Dist. l Link units u ward KAlOnly Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

One or more distractors is not credible.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-onlv (K/A and license level mismatches are unacceptable).
6. Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any 'U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

RO/SRO Combined Question 165 H 2 _- _r' Why is E-0 plausible in distractors? N 166 H 3 X A Question deals with actual concerns following action taken with a given RCS leak in stem. Since question does not determine or intrepret 7I -

S whether charging line leak exists/does not match K/A N 167 H 2 x Must give entire reference to TS reference Manual rather than pg 14. N 168 H 2 x Give indications nrather than say 'getting worse. Standby MUP should be dissassembled not just tagged for maintenance. N 7/;b7 2-9 t /M */ot J Or 2o% .;

p<5

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

0# LOK LOD I W 7 7 -I I I I I (F/H) (1-5) Stem lCues T/F Cred. Partia Job- Minutia #l Back- 0= 1SRO U/EIS Explanation

[Focusj _ jEs.j__ Link j unitsllward 1K/A ~OnlyJ 169 Hu2 =ib ==

X_ 7 SD: 'Try to restore' sticks out Suggest 'Close ------ to restore offsite power' Could also be additional correct answer.

N lB DG needs to be broken K/A This is ECA 0.0 recovery action and not troubleshooting . N 170 H 2 b,d ll,i U Why would status lights remain illuminated? too&.AbtS N 171 l 1 [ 2 l l l T ?l5 Why is this not just systems knowledge ? B 172 H 2 b,d -I What is indication that implies you have a high level deviation for 5 distractors bd.? How do I know A and B heaters are off? N 173 F 2 x Do not need data in stemrWi Procedure does not require cation bed in service. May want to reword. N 174 H 2 x 2 part K/A. Need procedure part of K/A ' N 175 H 2 . Discuss: 2 inoperable effluent monitors N 176 H 3 x Teaching in stem: delete reference to void formation. Need to discuss references. N 177 H 2 X This is not a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statement. Need to state 3.03 action statement to be consistent. N 178 H 2 x l Need some initial conditions stated in stem for shutdown cooling. N 0

179 H 2 _J/ K/A is predict the impacts of Loss of Air to SS valve and use procedures. v-_

IIX Applicant must be able to predict the impact of loss of air, i.e.2SA-l 4 BC fails open and then choose procedural path. Also reword to say 7i which one of the following actions are correct per plant procedures. N 180 H 3 x Mising second part of K/A. Reword stem WOOTF describes the effect on the release and the actions required. Change distractors ad to l5 include a ns. Why no sampling required? 4,JJd N 181 H 3 x Should tie question to specific procedure i.e. AP-1 1. Add lAW AP-1 1 after 3-2. N 182 H 2 x E Predict the impact part of K/A ? N 184H 2 b Distractor b is not wrong since it will comply with TS 5.2.2. B 184 H 3 = llDiscuss M

C#

1.

LOK (F/H) 2.1 LOD (1-5)

3. Psychometric Flaws StMCesr Stem Cues T/F IFocus I I l 4. Job Content Flaws Cred Partial Job- lMinutia #/ Back-Dist. I Link I Iunits ward 15 Other 0= SRO U/ES K'A iy 6

Iaril0 7 Explanation 185 F 2 x Need distractor analysis. WOOTF describes the correct actions of the

_l, __OSM for this request? Discuss distractors B 186 Fvc 2 S Why is this comprehensive ? Vice memory 187 F 2 X E words 'reduce radiation and guard against personnel exposure" lead right to a. Eliminate all after "take". N 188 H 3 S B 189 F 2 x E RP/0/A/5700/000 is a hand out for 1168 &1178. Ref may be used to eliminated. Discuss distractors. B 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41

ES-403, Rev. 9 Written Examination Grading Form ES-403-1 Quality Checklist Facility: McGuire Nuclear Plant Date of Exam: 2/18/2005 Exam Level: RO/SRO Initials Item Description a b c

1. Clean answer sheets copied before grading VY<C N/A 4
2. Answer key changes and question deletions justified l N/A xXl and documented I/
3. Applicants' scores checked for addition errors zz N/A (reviewers spot check > 25% of examinations) 4_
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, 7UCN/A l as applicable, +/-4% on the SRO-only) reviewed in detail
5. All other failing examinations checked to ensure that grades 4N/A are justified _ _ -
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity N/A l4V of questions missed by half or more of the applicants _=

Printed Name/Signature Date

a. Grader v! e4______3-g- 6*
b. Facility Reviewer(*) (A
c. NRC Chief Examiner (*) qj Wo- / 3- 5a
d. NRC Supervisor (
  • J dWs troT1OO(M.m .f3 et

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

Post-Examination Check Sheet Form ES-501-1 ES-501 Post-Examination Check Sheet .egPIe Date Complete Task Description

1. Facility written exam comments or graded exams received and verified complete _
2. Facility written exam comments reviewed and incorporated AZI& S7 and NRC grading completed, if necessary Operating tests graded by NRC examiners 3/

3.

4. NRC chief examiner review of operating test and written exam grading completed 73/7/5
5. Responsible supervisor review completed .3 /V/D
6. Management (licensing official) review completed
7. License and denial letters mailed
8. Facility notified of results Examination report issued (refer to NRC MC 0612) 3 9.
10. Reference material retumed after final resolution of any appeals ES-501, Page 23 of 25

GARY R. PETERSON Dukie Vice President PA PO u . McGuire Nuclear Station A Duke Energy Company Duke Power MGOO VP/ 12700 Hagers FerryRoad Huntersville, NC 28078-9340 704 875 5333 704 875 4809 fax grpeters @duke-energy.com November 29, 2004 Mr. William D. Travers Regional Administrator, Region II U.S. Nuclear Regulatory Commission Atlanta Federal Center 61 Forsyth Street, SW Suite 23T85 Atlanta, GA 30303-3415

Subject:

McGuire Nuclear Station Reactor and Senior Reactor Operator Initial Examinations 50-369/2005-301 and 370/2005-301 The enclosed information is provided in response to your request of August 17, 2004. This information is supports the McGuire licensed operator examinations scheduled during the month of February 2005.

Specific items provided in response to the request:

  • Simulator Scenarios - (ES-D-1, Scenario Outline Forms in the book)
  • Administrative Topics - (ES 301-1, Administrative Topics Outline Forms in the book)
  • Examination Quality Assurance Checklist Form, ES 201-2
  • Operating Test Quality Checklist Form, ES 301-3
  • Simulator Scenario Quality Checklist Form, ES 301-4
  • Competencies Checklist Form, ES 301-6
  • Reactor Operator and Senior Reactor Operator Written Questions
  • Reference Materials The McGuire Operations Facility Representative has reviewed and approved the proposed examination material per NUREG-1021, Revision 9, Section 201. The completion of this action is documented in the attached letter dated November 18, 2004.

Questions oroeentsoed to Charles Sawyer at (704) 875-5248.

ary R.Peterson 1',21.Hi

U. S. Nuclear Regulatory Commission November 29, 2004 Page 2 Mr. James H. Moorman U. S. Nuclear Regulatory Commission Operator Licensing and Human Performance Branch Atlanta Federal Center 61 Forsyth St., SW, Suite 23T85 Atlanta, GA 30303 Mr. George Hopper U.S. Nuclear Regulatory Commission Atlanta Federal Center 61 Forsyth Street, SW, Suite 23T85 Atlanta, GA 30303

GARY R. PETERSON Duke Vice President

  • hPowere McGuire Nuclear Station A Duke Energy Company Duke Power MGOI VP / 12700 Hagers Ferry Rd.

Huntersvile, NC 28078-9340 704 875 5333 704 875 4809 fax grpeters@duke-energy.corn November 18, 2004 To: Gary Peterson From: Robin Bell As the McGuire facility representative I have reviewed and approved the proposed examination material for the NRC examination to be administered in February 2005.

I have determined this material is accurate, operationally valid, and ready for NRC review. This review and approval is done per NUREG 1021, Revision 9 section 201.

Robin Bell/

McGuire Operations I

www. dukepower. corn

Retrieved from "https://kanterella.com/w/index.php?title=ML050950471&oldid=2594449"