ML050950471
| ML050950471 | |
| Person / Time | |
|---|---|
| Site: | McGuire, Mcguire  |
| Issue date: | 02/18/2005 |
| From: | Duke Energy Corp |
| To: | NRC/RGN-II |
| References | |
| 50-369/05-301, 50-370/05-301 | |
| Download: ML050950471 (33) | |
Text
Administrative Documents MCGUIRE FEB 2005 EXAM 50-369 & 370/2005-301 FEBRUARY 7 - 15, 2005 FEBRUARY 18, 2005 (written)
- 1.
Exam Preparation Checklist.......
............. ES-201 -1/
- 2.
Exam Outline Quality Checklist......
........... ES-201-2,/
& Exam Security Agreement.......
.............. ES-201-3
- 4.
Administrative Topics Outline (Final).....
........ ES-301-1X/
- 5.
Control Room Systems and Facility Walk-through Test Outline (Final)....................................
- 6.
Operating Test Quality Check Sheet.....
........ ES-301-3 Simulator Scenario Quality Check Sheet.........
/
- 8.
Transient and Event Checklist....
- 9.
Competencies Checklist.........
ES-301-6 X\\
Written Exam Quality Check Sheet.......
ES-401-6 /
- 11.
Written Exam Review Worksheet.....
ES-401-9/?
- 12.
Written Exam Grading Quality Checklist.....
- 13.
Post-Exam Check Sheet........
.............. ES-501-1
/
P FA C,77 Lr c D -rD
// -l2-IS-2, Y
o-n -
/-/.q_ o~c /4P+0"0,,0
-x r
I
~
,, X em I
r I I v
LrLAJC.LCL5 a..S -
i,
.i Os e bt bt
ES-201 Examination Preparation Checklist Form ES-201-1 Facility: A
/
vvii Date of Examination: X__7-405-_l Examinations Developed by:
KF~ajgdr D/ NRC (circle one)
Target Chief Date*
Task Description (Reference)
Examiner's Initials
-180
- 1. Examination administration date confirmed (C.1.a; C.2.a and b) 7
/ i/
-120
- 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e) 1/7/Q
-120
- 3. Facility contact briefed on security and other requirements (C.2.c) 1/9C
-120
- 4.
Corporate notification letter sent (C.2.d)
Y
[-90]
[5.
Reference material due (C.l.e; C.3.c; Attachment 2)3 I
4 (I
-75
- 6.
Integrated examination outline(s) due, induding Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and
/so(otr ES-401-4, as applicable (C.1.e and f; C.3.d)
-70
- 7.
Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e) 1________
-45
- 8.
Proposed examinations (including written, walk-thmough JPMs, and scenarios, as applicable), supporting documentation (including Forms Il ES-301-3, ES-301-4, ES-301-5. ES-301-6. and ES-401-6), and reference 1/~
l materials due (C.1.e, f, g and h; C.3.d)
-30
- 9.
Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g;
/
-14
-14
- 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
/9
-14
- 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
/ / 3,/ >
-7
- 13. Written examinations and operating tests appmoved by NRC supervisor
/
S (C.2.i: C.3.h)
-7
- 14. Final applications reviewed; examination approval and waiver letters sent (C.2.i; Attachment 4; ES-204)
(
-7
- 15. Proctoring/written exam administration guidelines reviewed 2 /
&/
with facility licensee (C.3.k)
-7
- 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
Target dates are keyed to the examination date identified in the corporate notification letter.
They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
Applies only to examinations prepared by the NRC.
ES-201, Page 24 of 27
ES-201 Examination Outline Quality Checklist Form ES-201-2
[ Failit:
Jw G2 YPZDate of Examination: 24-/b/or5 Facility.
- 4 v j
Initials lItem Task Description a
Itc
'mAft ih-th nutllinets] fitsfs) the appropriate model, in accordance with ES-401. _
()
ex,y.. g..._
W I
D T
T E
N 2.
S MU A
T0 R
- b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES401 and whether all K/A cat aries are apropatel sampled.
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generc topics.
- d. Assess whether the justifications for deselected or rejected K/A statements are approprate.
_a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of nomal evolutions, instnument and component failures, technical specifications.
and major transients.
- b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expeted crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the a ficants' audit test(s), and that scenarios will not be repeated on subs uent days
- c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative critea specified on Form ES-3014 and described in Appendix 0.
'a APOP LI-4 A #L Xo X
I
.f #
- 3.
- a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form
/
(2) task repetition from the last two NRC examinations is within the limits specilied on the form T
(3) no tasks are duplicated from the applicants' audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the foem.
- b. Verify Uhtteadministrative outline meets the cniteria specified on Fomm ES-3011 (1) the tasks are distributed among the topics as specified on i
he form (2) at least one task is new or significantly modified 3d no more thn one task is repeated from the last iwo NRC ls nsing exami.nations
- c. Deterrnine if there are enough different outlines to test the projected number and mix of api'ants and ensure that no items are duplicated on subsequent davs.~
- 4. a Asess heter plant-specific priorities (including PRA and IPE insights) are covered in te aproprate xamsections.
E b.Asses whtherthe 10 CFR 55.41/43 and 55.45 sampling is appnopriate.
N c. nsurethat
/A imortane nabgs (eceptfor plant-specific priorities) r tIts E d.Chec forduplcatin ad overlap among exam section S.
A
- e. Check the entire exam for balance of coverage.
-I II
- a. Author l
Eem I
t_)
ir
/
s/Dae
- b. Facility Reviewer (')
LLYs 3-6 11LaTV 8
l//i
- c. NRC Chief Examiner (2)
Cg
.,i-rrr/ a ES-201, Page 25 of 27
ES-201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Fk
- OD°S as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination To the best of my knowl dge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of
?.
OLŽ75 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME
- 1. FdtJALIS If. KerALw1c0
- 2. f14N,#AP V j9enFrr
- 3. D&NI fla kA?
- 4.
Sv T4SI K.J VA-A r-41 Lt.re 7.
9 AyAgc
- 10.
- 11.
/7 fr 13.
JOB TITLE / RESPONSIBILITY NtassiZ STATdr-' NPsTICrQ4 NOLAz!TjAj ION 1s-'Vcti O9S SfrFT n4.-4pc4.
0jz S
,t *
/f~S A-At I5/gg -~
3, SIGNATURE (1)
,l ZX7e~
.L 1-.-
-Lt-A-,W T,
44
_ a @%
1-YI/
e 2-7-oS, -VT-WL4-t l 7-o0 f b k
-/2_-
- 4.(
ia
_g VrM DATE SIGNATURE (2)
DATE NOTE L-X
_s2-
-0'5
_ -/I//Cs 2 0 7Z2-e(
-. ZTT
=
V 14.
15.
NOTES:
Scc Scet s-ES-201, Page 26 of 27
0l ES-201 Examination Security Agreement Form ES-20143 tPre-Examinatton I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of F4,. 005 as o1 Ihe date of my signature. I agree that I will not knowingly divulge any information aboutilhese examtna31ons to any persons who have not been authorized bythe NRC chief examiner. I understand that I am nol to Instruct, evaluate, or provide performance feedback to Ihose applicants scheduled to be administered these I1censing examinations from this date until compielion of examilnation adminIstration, except as specifically noted below and l authoilzed by the NRC (e.g., aclina as a simulator booth operatoror communicator is acceptable If the Individual does not selecl thie training content or provide direct or indIrectfesdback). Furthermore, I am aware of Ihe physical aecurity measures and requirements (as documented in the tacility licensee's procedures) and understand Vhaiviolation of the condilions of this agreement may result in cancellation of the examinations and/Oran enforcement acton agalnut meor the facility licensee. I will immediately report to facility management orthe NRC chlef examiner any Indcalons or suggeslons lthat exaniralfon security may have been compromised.
- 2.
Post-Examinatllon To the best of my knoxqdge, I did not divulge to any unauthorized persons any Information concerning the NRC licensing examinations administered during the week(s) o63.
tf75 From the date that I entered Into this security agren eart until the completlon of examination adIninistration, I did not Instruct, evaluate. or provide performnance feed back to those applicants who were administered these licensing examinations, except as specifically noted below and auihorized by the NRC.
VzJ P-Q P
PRINTED NAME 1, P&tJAVb '2. 4 7ALwtCAV
- 2. IXN4D V A6n Er~r
- 3. Daro rfc 1t hKa 5
- v
- 6. M^.
- 9. A/
v
- 10.
,^~v r1.rhE 2e JOB TITLE/ RESPONSIBILITY IJunS'TArbwa £N-g~flWLU CIS i sL)Ih?
f trAK ri' tdr
<iA'
_.Cr V
_ 4.A~
4kA t DJ.Lu)gPLi, S.
t SIGNATURE ( 1) ft
=8 5;M-k--
DATE SIGNA 7
- JTUYE, f
E NOTE tali 2.7 r6 A'/l, 7q 1
-- os--
K-s t-1;-0
- tat r.
n 14_
15.
NO1TES:
'0 0
II
-4 ES-201, Page 26 of 27
r.,..ni,,n.nn Qortritv Anrnnmant Fhorm ES-201-3 201 43 ES-;-0
,.....n_.
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing e>
date of my signature. I agree that I will not knowingly divulge any information about by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provij administered these licensing examinations from this date until completion of examir authorized by the NRC. Furthermore, I am aware of the physical security measure procedures) and understand that violation of the conditions of this agreement may action against me or the facility licensee. I will immediately report to facility manag examination security may have been compromised.
A fl or aenam ierfornmg aldmin
-5A, Vae~
I Fla
~b I 9, 400d Is hweek(s) of as of the in ns who havy t been authorized mapplica heduled to be n
oed below and ents (as docu facility licensee's ellation of the en
, s and/or an enforcement mNRC chief examiner any indications or suggestions that
- 2.
Post-Examination To the best of my knowledv, I did dgvule to any unauthorized persor during the week(s) of M
'Ptom J
inthe date that I entered into this instruct, evaluate, or provide performance feedback to those applica noted below and authorized by the NRC.
on con NRC licensing examinations administered jyntIl the pletion of examination administration, I did not Wd the licensing examinations, except as specifically io we PRINTED NAME JOB TITLE / RESPONSIBILI)W
- 1. eW Ak d A sA -. f M
- 2..2~
n -
3.^ol f
4.;be
'l, SoAC ae X
'-'4*o r-A 4, SNATUF DATE SIGNATURE 6.
7.
8.
9.
DATE NOTE
_ 2 I- 0-,
_ s tZ-Of 13_
it-c
- 14. L o~¶.c b rv 15 CPi rtst NOTES:
17 Terry S.-
SrC
.-S;m s-Vl JA O t
.cahn e ~ c M
NUREG-1021, Draft Revision 9 25of 25
ES-201 Examination Security Agreement Formr ES-201-3
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of
- 3. S1agas of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) ofS.27 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
D}
- 1. RiCA4W rq od Jtn-r
'A
/44"
- 2.
ICT Me/i A/JVCCt/2 SIV2e fV9SratCfA
/C
- I
- 3. ;e*-,.ia/ytn /
.7-.
/
,V 4 I
- 4. bhb C. gofew ot sns %.c 7se A
a 5.G,<xrttx 1Cok pcrL x;~, efon 9,J 1<N +
Catl si OSZ h )1E C.-!
IATE NOTE
_7_
- 7.
10.
11._
12.-
13.
14.-
15.
NOTES:
ES-201, Page 26 of 27
ES-201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of i;
- 5;as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of tt
. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME
- 1. PVAP BODY 2.56 c';
z 3*A
- 3. l A 6v 7
L IES
- 4.
f..3._
JOB TITLE / RESPONSIBILITY OP4S fl4 r
OPS VALi IDaA-r. I5
- lJA, a4->
7/,J~
AC?,M SIGNATURE (1)
Q&1 7
-i
- ' h
_//s8
/S
- IZ1q
-32 DATE SIGNATURE (2)
DATE NOTE 1<1/f561
/
3-2 oe 5.
/1
- 6.
- 7.
- 8.
10.
- 11. ___
12.
13.=
14.-
15.
NOTES:
ES-201, Page 26 of 27
ES-301 Administrative Topics Outline Form ES-301-1 Facility:
McGuire Date of Examination:
wkzaa/dL Examination Level (circle one)
SRO Operating Test Number: '
Administrative Topic Type Describe activity to be performed (see Note)
Code*
AFD Calculation with inoperability Conduct of Operations N
Conduct of Operations N,S Perform a Shift turnover Equipment Control M,
Manual NC Leakage Calculation Radiation Control Emergency Plan N,C Perform RP/1 1 Conducting a Site Assembly or Evacuation NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
^ Type Codes & Criteria:
(C)ontrol room (D)irect from bank ( < 3 for ROs; < 4 for SROs & RO retakes)
(N)ew or (M)odified from bank ( > 1)
(P)revious 2 exams (< 1; randomly selected)
(S)imulator ES-301, Page 22 of 27
ES-301 Administrative Topics Outline Form ES-301-i Facility: _McGuire Date of Examination:
2/7 Examination Level (circle one): RO SRO Operating Test Number:
I Administrative Topic Type Describe activity to be performed (see Note)
Code*
Conduct of Operations N
AFD Calculation with inoperability determination Conduct of Operations M
Shift Manning Requirements Equipment Control N
Thermal Margin Calculation and Evaluation of Work Allowed Radiation Control M, P. C Review and Approve a GWR Emergency Plan M, C RP/07 Earthquake with Technical Specification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are rptpLinn onnl' thoe mdiniptrtun tnIrc,*hp aII 6,re ron. irr
- Type Codes & Criteria:
(C)ontrol room (D)irect from bank ( < 3 for ROs; < 4 for SROs & RO retakes)
(N)ew or (M)odified from bank ( > 1)
(P)revious 2 exams (< 1; randomly selected)
(S)imulator ES-301, Page 22 of 27
ES-31 Cntro Romll-Plat Sstem Oulin 1-om t-su-t ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 I
Facility:
-McGuire Date of Examination:
2&/L-/dI/
Exam Level (circle one) i75O t
SRO-Operating Test No.:
I Control Room Systems@ (8 for RO; 7 for SRO-1; 2 or 3 for SRO-U)
System / JPM Title Type Codet Safety Function
- a. Respond to a Loss of Component Cooling (KC-234A)
N, S. A SF-8
- b. Respond to a Leak on operating ND System while at Mid Loop D, L, P SF-4P
- c. Intermediate Range Failure (ENB-235A) (SROU)
N, S, A SF-7
- d.
Align the Containment Spray system to Cold Leg Recirculation D,S,P,A SF-5 (lNS-182A)
(SROU)
- e. Respond to Additional Dropped Rods While Retrieving a Dropped Control Rod (IRE 1741A)
A, D, S SF-1
- f. Establish Feedwater Flow to S/G's following a Runback (CF-237)
N,S SF-4S
- g. Align Normal Charging With NV Recirc Path Isolated A,D, S SF-2 (NV-146A)
- h. Start and Load 1 B D/G then Separate From the Grid (DG-198)
D, S SF-6 IcpnI lSR In-Plant Systems' (3 for RO; 3 for SRO-1; 3 or 2 for SRO-U)
E, B SF-4S (SROU)
- j. Borate the Reactor Coolant System from the Auxiliary Shutdown R. E, B SF-1 Panel ASP-138 (SROU)
- k. Aligning Control Air from Backup Cylinders to F VI Compressor E, A, P SF-8 VI-11 OA) j e
AMl UwmILJII IdUU[T kdllU III-pIdIlL) bystellb [ IULb be JUie eUl gInU sd~el v euivu in-plant systems and functions may overlap those tested in the control room.
- Type Codes l
Criteria for RO / SRO-I SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank
<9/<8/< 4 (E)mergency or abnormal in-plant
>1/
>1/>1 (L)ow-Power
>1/ >1/>1 (N)ew or (M)odified from bank including 1 (A)
>2/ >2/ >1 (P)revious 2 exams
< 3/ < 3/ < 2 (randomly selected)
(R)CA I>,1/
> 1/ > 1 (S)imulator l
or
/4 5~k ES-301, Page 23 of 27
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
e0'-t Date of Examination:j2/h/&/%'r Operatir TestNumber:
Initials
- 1. General Criteria a
b c#
- a.
The operating test conforms with the previously approved outline; changes are consistent with 4
t sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
47_
- b.
There is no day-to-day repetition between this and other operating tests to be administered t, -
during this examination.
_ Y
- c.
The operating test shall not duplicate items from the applicants' audit test(s). (see Section 01 a.)
2,
- d.
Overlap with the written examination and between different parts of the operating test is within acceptable limits._
- e.
It appears that the operating test will differentiate between competent and less-than-competent (4
applicants at the designated license level.=
- 2. Walk-Through Criteria
- a.
Each JPM includes the following, as applicable:
initial conditions initiating cues
/i references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
- b.
Ensure that any changes from the previously approved systems and administrative walk-through lj outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance
//
criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with
[-I Form ES-301-4 and a copy is attached.
=
=
=
Printed Name / Signature Date
- a. Author 14 A)(
Yk//I,7dT Am 1/
-2o, l
- b. Facility Reviewer(.)
-tll-If Y t>z
/
/7/ w1/2>
- c.
NRC Chief Examiner(#)
- d.
NRCSupervisor JC, 0ars
/lf OV$#
c
[VS l
NOTE:
The facility signature is not applicable for NRC-developed tests.
I independent NRC reviewer initial items in Column c"; chief examiner concurrence required.
ES-301, Page 24 of 27
ES-301 Simulator Scenario Quality Checklist Form ES-301 4 Facility:
of e40"r fe Date of ExarT ( 7SoEnariNumbers: I ~1-I) Operating Test No.:
QUALITATIVE ATTRIBUTES Initials a
b-c#
- 1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
- 2.
The scenarios consist mostly of related events.
U
. h
- 3.
Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event cii the symptomstcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
- 4.
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenano A
/4/7 without a credible precedin incident such as a seismic event.
- 5.
The events are valid with regard to physics and thermodynamics.
O
- 6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain LA A
complete evaluation results commensurate with the scenaro objectives.
- 7.
If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints.
s l"/A l#
Cues are given.
- 8.
The simulator modeling is not altered.
- 9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated 7
to ensure that functional fidelity is maintained while running the planned scenarios.
- 10.
Every operator will be evaluated using at least one new or significantly modified scenario.
f
- l All other scenarios have been altered in accordance with Section D.5 of ES-301.
- 11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6 f
(submit the form along with the simulator scenarios).
- 12.
Each applicant will be significantly involved in the minimum number of transients and events it v
5 specified on Form ES-301-5 (submit the form with the simulator scenarios).
- 13.
The level of difficulty is appropriate to support licensing decisions for each crew position.
it t'
Target Quantitative Attributes (Per Scenario; See Section D.5.d)
Actual Attributes I1.
Total malfuncfions (5 8) 1
/ 6,l 2
(1 C
- 2.
Malfunctions after EOP entry (1-2)
I I
id /
$ S1
- 3.
Abnorrral e vnt (2 4) 51t t8X
- 4.
Majortransients (1-2) lI
/
Qkl4
- 5.
EOPs entered/requiring substantive actions (1-2) 3 i 1 1
4.>
- 6.
EOP contingencies requiring substantive actions (0-2)
`
I A_
- 7.
Critical tasks (2-3) 3 2,
_i 3
ES-301, Page 25 of 27
tiAu)I (Io eW I I I
ES-301 Transient and EventChecklist Form ES-301-5 Facility:
Date of Exam:
Operating Test No.:
A E
Scenarios P
V P
E L
N 2
3 4
T M
I T
0 C
CREW POSITION CREW POSITION CREW POSITION CREW POSITION A
N A
T L
M N
YL M
T p
S A
B S
A B
S A
B S
A B
U E
R T
0 R
T 0
R T
0 R
T 0
M 0
C P
0 C
P 0
C P
0 C
P RX I
I R
It NORI z
SRO-1 I/C CI,1, 3
y 4
SRO-U MA'
=7
_2 2
TS 2
RX 1
RO NOR 41 SRO-I I/C 2-. b 2-C
=
4 MAJ 2
2
- 3.
TS L1 5
1,3 2
RO RX 1
NOR jl R
I/C 3%_
=
4^
SOU MAJ I
1 TS
=
=2 RX
__1 NOR
_51 SRO-l I/C I
4 SRO-U TS 1Z 2
TS 2
Instructions:
- 1.
Circle the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the 'at-the-controls (ATC) and 'balance-of-plant (SOP) positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
- 2.
Reactivity manipulations may be conducted under normal or contriued abnormal conditions (refer to Section D5d) but must be significant per Section C.2.a of Appendix D.
- Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.
- 3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.
(
0
J*kyv
Author:
NRC Reviewer:
IC/-
ES-301, Page 26 of 27
tt z
-itJ I22-I23 as 2 za3 ES-301 Transient and Event Checklist Fonn ES-301-5 Faclity:
=
Date of Exam:
Operating Test No.:
A E
Scenarios P
V P
E L
N 1
2 3
4 T
M I
T 0
I C
CREW POSITION CREW POSITION CREW POSITION CREW POSITION A I
A T
LAM N
[M T
P S
A B
S A
B S
A a
SB U
E R
T 0
R T
0 R
T 0
R T
O M
0 C
P 0
C P
0 C
P 0
C P
NOR __
1-SRO-1 11C 4
SRO-U MU_
2 TS 2
RX 1
11 RO NOR 5
_1-SRO-I I/C
-
=
=
4' ou MAJ 6
1 Z 2 TS 8
=
3 1 2 RX
_1 RO NOR 1-RQl I/C3 SRO-U MA 1_2
___TS 4IS2 RO NOR SRO-I IC SRO-U M==
2 Instructions:
- 1.
Circle the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATCr and 'balance-of-plant (BOPr positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC posidion.
- 2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section OD.5d) but must be significant per Section C.2.a of Appendix D. ' Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-For-I basis.
- 3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that Drovide insight to the applican s competence count toward the minimum requirement.
IV J7l~
Author:
NRC Reviewer:
7V
~Lr ES-301, Page 26 of 27
(
ES-301 Transient and Event Checklist Form ES-301-5 Facility:
Date of Exam:
Operating Test No.:
A V
Scenanos P
V P
E L
N 1
2 3
4 T
M I
T 0
I C
CREW POSITION CREW POSITION CREW POSITION CREW POSITION A
N A
T L
M N
V
-L-
-M-T P
S A
B S
A B
S A
B S
A B
U E
R T
0 R
T 0
R T
0 R
T 0
M 0
C P
0 C
P 0
C P
0 C
P RX I
R0 4 NOR SRO-l UC 4-SRO-U MA' 2
TS 2
RX wI NOR T11' SRO-I 2C=
U TS
=-6
4
TS 2r n a b
2 RX P,
RO N-OR P,
SRO-p I/C Sl SRO-U MAJ 2
T S 2
Ins tr c io s
- 1.
Circle the applicant level and enter the operating test number and Form ES-D-l event numbers for each event type:
TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance~-of-plant (ROP)r positions; Instant SROs must do one scenario, including at least two instrument or component (tIC) malfunctions and one major transient, in the ATC position.
- 2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D.
- Reactivity and normal evolutions may be replaced vith additional instrument or component malfunctions on a 1-for-I basis.
- 3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that rovide insight to the aplicant's competence count toward the minimum requirement.
A#*
(Ja,/40n Author:
NRC Reviewer nP A~-
,i7 ES-301, Page 26 of 27
Pleum,
LAI ES-301 Competencies Checklist Form ES-301-6 Facility: Mt, f1-4.k Date of Examination: Ftb )
(
Operating Test No.:
I APPLICANTS ARO-l RO/SRO-RO/SRO-JRO-I/SRO-U I/SRO-U
/ISRO-U1 Competencies SCENARIO SCENARIO SCENARIO SCENARIO
[la?
Zji-wr---
1 2ra 4 l'1r '21 3 1 4 1
21 '3 1 l #2t f 3N1 4
_12 41 3
1231234 Interpret/Diagnose 2,(
3Ai ).1 ZA 2n.
Events and Conditions 1
Comply With and
, 3 2,11 3.7 2,9, 57, Use Procedures (1
)
1, i
',S __L,
- 2.
),,
Operate Control 4 i 2
I Z Y Boards (2 hi
~
-7 7k Communicate
-4 e
-7 and Interact Demonstrate Supervisory Ability (3)
_ l m
Comply With and 17-3 Use Tech. Specs. (3)
L
_ E _ =
=
M
=
=
=
Notes:
(1)
Includes Technical Specification compliance for an RO.
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Instructions:
Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant Y)Atro Author:
NRC Reviewer:
I/an,
"'F,11 ES-301, Page 27 of 27
(A 1*
Ul3 t2 cvl,)
123 ES-301 Competencies Checklist Form ES-301-6 Facility: Met CXL44\\L Date of Examination: Feb 2,CVS Operating Test No.:
I APPLICANTS fi3/SRO-RO/SRO-MOO-RO/SRO-I/SRO-U IisfO-Q) l V7SRO-U I/SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO alp 12w 3 4
l1 l2 3l IT 3 l14 1
2 13 14 1234123412341234
_E Interpret/Diagnose 2% i,3
,4 3.0,.
Events and Conditions L,
Comply With and2, ZMI)
Use Procedures (1) a S
2~Z5, Operate Control 1,
/,3 Boards (2) b
_ _ Y.. -
Communicate and Interact s i EC_
Demonstrate
'-l Supervisory Ability (3)-
Comply With and 2-l Use Tech. Specs. (3)
=
=
=
=
=
=
Notes:
(1) includes Technical Specification compliance for an RO.
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Instructions:
Circle the applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant
-zLt1j,-_
Author:
,6/-}z 4PAr NRC Reviewer:
ES-301, Page 27 of 27
ES-301 Competencies Checklist Form ES-301-6 Facility: Mt 6U A
Date of Examination: fJ7 Zoo7C Operating Test No.: I APPLICANTS (f/SRo-(
LR ROI ROISRO-I/SRO-U I/SRO-U l
IJ O2L I/SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO Va 4
" "I 3
4 s 123 Interpret/Diagnose 3, '
,-4)
Events and Conditions
- 7)
I
_, I 6_
Comply With and
'-si 2,1, Use Procedures (1) 1)6,e 7 I
Operate Control q2t Boards (2)2&
LA Communicate and Interact l
I-7 i1 7--
Demonstrate Supervisory Ability 3 Comply With and
_~
Use Tech. Specs. (3)
Notes:
(1)
Includes Technical Specification compliance for an RO.
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Instructions:
Circle the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency forrer applicant.
Author:
f NRC Reviewer:
ES-301, Page 27 of 27
ES-401 Wriften Examination Quality Checklist Form ES-401-Facility:
Date of Exam:
Exam Level: RO/SRO Initial Item Description a
b-c
- 1.
Questions and answers are technically accurate and applicable to the facility.
__r
- 2.
- a.
NRC K/As are referenced for all questions.
- b.
Facility learning objectives are referenced as available.
A
/'
- 3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401
- 4.
If more than four RO and two SRO questions are repeated from the last two NRC icenping exams, the facility licensee's sampling process was random and systematic.
V/A
- 5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ the audit exam was systematically and randomly developed t the audit exam was completed before the license exam was started t the examinations were developed independently t the licensee certifies that there is no duplication other (explain)
- 6.
Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest
,4,!SO g-new or modified): enter the actual RO / SRO-only q
E
/
r question distribution(s) at right.
17
- 7.
Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension/ analysis level; r
the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels: enter
/
1 5 2
/ zo the actual RO / SRO question distribution(s) at rght.
- 8.
References/handouts provided do not give away answers or aid in the elimination of distractors.
- 9.
Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned:
4/
deviations are justified.
- 10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
- 11.
The exam contains the required number of one-point, multiple choice items; a.t 4
the total is correct and agrees with the value on the cover sheet.
=
=
Printed Name / Signature Date
- a. Author J
I 7
S
- b. Facility Reviewer()
c'S/N.17 Bcot
./
/
tW
- c. NRC Chief Examiner(i)
- d. NRC Regional Supervisor VI
, rf O
d1o{
Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c-: chief examiner concurrence required.
ES-401, Page 29 of 33
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
7.
Q#
LOK LOD dI Sti (F/H)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- /
Back-
= ISRO U/ElS Explanation Focus Dist.
Link units ward K/A Only Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
Ia One or more distractors is not credible.
,/
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
3 Cotc j vs
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
/ 9 -&
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).I The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
S7&-&/
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7.
At a minimum, explain any "U ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question 1090 H
2 E
Discuss using over/under compensated vice "higher than actual'.->
E 1091 H
2 a
E MS leak not even detectable on RCS. Only MSLB. Suggest Ivl instrument ref leg leak.
1092 H
2 E
Change maintenance to repait E'l 1093 F
2 d
E reword d to make it look more like b & c N.
1094 F
3 I E See comments on question N
1095 H
3 x
IE GSIood start. Need more words to explain basis for distractors. See comments an OX6 /f X
+~
-iffm-rAlyK44A4' 75-'
1
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
7.
0#
LOK LCD I
IKA~Ol (F/H)
(1-5)
Stem j Cues T/F Cred. lPartial Job-Minutia
- l/ lBack-0 S
U/EIS Explanation Focus Dist.
Link lunits ward K A l
_nly l
1096 H
3 X
x typo on K/A E is A. Delete the word "insurgevbCSee comments on question.
X N
1097 F
2 B
U a is not really the bases r the step. B is implausible. See coments (rewrote stem)
N 1098 H
2
=
This is a NOT K/A (reverse) question. le when not to use steam dumps.
M 1099 F
2 S5 MSIV isolation ?
B 1100 F
1 D~iscuss stem N
1101 F
2 x
E Reword stem to remain in SBO conditions. If other diesel start there is no SBO.
N 1102 H
2 x
Question tests indications and not the effect on motors of loss of bus. Also if 9Kyou are verifying actions have occurred they are not manual. Ad >ts N 1103 H
1 x
U B corect in any circumstance. See comments on question.
N 1104 H
2 S t 1105 H
3 x
ES change b,c,d SG to 13,16,14 so that the 3.5 psig in containment means something to the question. Other numbers are below 12% and ACC does't mailer.
N 1106 H
2 x
X Not a loss of recirculation if NLO restores valve open. Question should deal I
with5su t of K/A. leHow long would NLO have to get valve open before los ofM T due to depletion?
1107 H
2 I is "d" fully closed? What % gives alarm? Can you do perform this at high S
power?
N 1108 F
2 X
x ES What kind of malfunction.? AP encompasses many. Does not match KA in the way it is worded. Must tie to conditions and limitations in facility license.'
Should be worded something like ' To prevent approaching or exceeding DNBR limits" B
1109 H
2 S
IN 1110 H
2 a
ES Should avoid using NONE. h a
rSo sirtyvedW
, Iniat t 1an wefM and giv normal C
ciiyIvlA u
b 1111 F
2 x
U SThis is not an accidental release.
N 1112 F
3 bd E 5 Distractor analysis needs work. Replace "no safety injection signal " with
_MSL break outside containment, MSIVs manually closed and"..
N
`1-
LOK 2L
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
7.
(F/H)
(1-5)
Stem Cues lT/F Cred. Partial Job-Minutia
- /
Back-0=SRO U/EIS Explanation l
Focus l
Dist.
Link units ward K/A Only 1113 H
2 a
E See comments on use of the word prtereri*C N
1114 H
3 x
E 5 Need to ensure there is enough information in the stem to support that 2 RCPs are still running. Is this RO required knowledge?
N 1115 H
2 x
E S Remove last bullet regarding charging.
B 1116 H
3 a
ES add mode 4 or 5 to stem. To make a"a" plausible. Is the second sentence Inecessary. Look like teaching.
IN 1117 F
2 ESl Fix distractor analysis and mark "a" correct. Change expected to approximate.
B 1118 F
2 d
ES Change d to read."..could cause the failure of the primary..." These steps ensure the reactor is shutdown immediately and maintained in mode 2 until theconditionh iscorrected. Add "shutdown and coo/down is initiated to answer c.
B 1119 H
2 S S What is LTOP setpoint ? Will relief lift so you do not get large increase in Ipressure
?
N 1120 F
3 cd E
Feedwater isolation plausible.?
N 1121 F
2 d
E d does not remove from system. Try venting the VCT. Do head vent go to PRT?
N 1122 F
2 S
make d a single loop drain.s~
N 1123 H(F) 2 X
? S Listed KA does not match outline. Should be 008A1.031-1<icuss answer N 1124 F
2 cd E S 50 minutes too Iong to be time critical. Change to 30 minutes and place in I accordance with AP-21 in stem.
N 1125 H
X E 5 KA deals with malfunction of PZR not instrument. A leak at the weld for the 3
instrument could fail detector to read low (1 950?) and meet K/A. © Change modulate to "cycle to maintain pressure". Delete Reactor will not trip in a,b,c.
Delete 3 d line of d.
M 1126 H
3 a
ES change a to Loop 1 Tave fails HIGH.
B 1127 H
3 x
E Remove bypass from stem. Reword d to be like others. Channel 1 and 2 1
- 1tripped, cnmt spray would actuate N
1
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6
7.
Q#
LOK LOD j
I (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation Focus Dist.
Link I units ward K/A Only 1128
=
Stem helps to answer question 1120. Reword to All actions associated with H
1 U
RCS prsure reaching P-1Il are complete. With cnmt pressure at 1.3 psi9 stem does not matter or add to question. Change Pzr pressure 1840 psig.
Ctmt pressure.8 psig. Change answer to b.
M 1129 F
2 B
1130 F
2 ac E9 Distractors not very plausible. What tP would be required?
N 1131 H
2 x
ab U
Delete last bullet after 12 psig. A,b distractors can be tossed because they I
are non specific.
N 1132 H
3 S
Discuss use of reference. Which window is illuminated?
M 1133 F
2 x
ES Puffing feedwater isolation in stem eliminates ab. Change stem to: Upon receipt of a P-14 signal which of the following occurs?
M 1134 H
3 S
N 1135 F
1 x
U KA is for diesel driven AFW pump. The closest match is turbine driven AFW pump. What is the power supply for control power?
N?
1136 F
bcd lU 3 distractors very similar or essentially the same condition therfore all can be eliminated.. Do you have ground fault detection circuitry? Bank question distractors better. Replace b or c B
1137 F
2 x
E If c true then a & b would be true. Therefore, abc are incorrect. Add if an Si signal were to occur to end of stem. Add only to a. Change c to would start automatically.
N 1138 F
3 NS I
1139 F
1 U
add to stem, line voltage is 4150v and DG is 4200V. Reword last sentence to
..Must be done before closing the 1 ETA Emergency Breaker lAW the 1
procedure.
N 1140 F
2 lNocorrectanswer. 1EMF-35Triplishutsdownallfans.
N 1141 H
2 X l How does this relate to the Secondary closed cooling water ? g N
1142 H
3 X
US Question does not elicit the desired response. Stem and distractors need to be reworded. Why would DG be running?
See Comments N
1143 F
2 lS 1144 F
2 A
No correct answer since earist time would be when at 32%level.. Also all Sgs would not read exactly t same. Reworlk N
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws 5*Other 6.
O#
[OK LOD I-(F/H)
(1-5)
Stem Cues T/F red. Partial Job-Minutia
- /
Back-10 RO U/EIS Explanation Focus Dist.
Link units ward 1145 F
2
?
E4 Assume all communications operate normally. Are we bordering on SRO event classificaiton?
N 1146 H
3 S
1147 H
2 ES Dicuss 1148 H
2 S
1149 H
2 c
E c not real credible.
A N
1150 H
3 x
2'Answer is not related to K/A le there is no effect on the FHS due to loss of rad monitor. This may meet K/A discuss use of references.
I 1151 H
2 S
Rods in Auto ?
l 1152' F
2 S
E 1153 H
1 X
U Cannot describe what features are lost upon loss of 1 EVDD. This points directly to 'a" since from the control board is eliminated from the stem.
Remove bullet statements.
I 1154 H
3 X
E-Appears to not meet the K/A. Where is the inadvertent actuation?
,Z
/
01 1155 F
2 S
The last bullet about NCO feels announcement is warranted in reference ma be a problem.
1156 F
2 E-S Add lAW OMP 5-2 to stem.
Make answer Fire drill in Unit 2 cable spreading room.N 1157 F
2 SW E
1158 F
2 l
l 4
h..Change refueling to core unload. l 1159 F
2 S VMay want to put IAW procedure... /
1160 H
3 x
?_l Not exactly sure what the question is asking. Stem not iear 1161 F
2 Sv E
1162 F
3 ES Bullets are somewhat confusing. May want to be more specific to eliminateN l questions during the exam.
1163 H
3
?S What are distractors based on? et 4rqee ste...
1164 F
?I Discuss discriminatory value OK.
ES-401 Written Examination A4l Review Worksheet t
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
7.
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-
= SRO UIE/S Explanation Focus Dist.
l Link u
units ward KA lOnly Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-onlv (K/A and license level mismatches are unacceptable).
- 6.
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7.
At a minimum, explain any 'U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question 165 H
2
_r' Why is E-0 plausible in distractors?
N 166 H
3 X
A Question deals with actual concerns following action taken with a given RCS leak in stem. Since question does not determine or intrepret S
whether charging line leak exists/does not match K/A N
167 H
2 x
Must give entire reference to TS reference Manual rather than pg 14. N 168 H
2 x
Give indications nrather than say 'getting worse.
Standby MUP should be dissassembled not just tagged for maintenance.
N 7 I -
J Or
.; 2 o %
p<5 7/;b7 2-9 t
/M */ot
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
7.
0# LOK LOD I
W 7 7 -I I
I I
I (F/H)
(1-5)
Stem lCues T/F Cred. Partia Job-Minutia
- l Back-0= 1SRO U/EIS Explanation
[Focusj
_ jEs.j__
Link j unitsllward 1K/A ~OnlyJ 169 Hu2
=ib
X
=
7 SD: 'Try to restore' sticks out Suggest 'Close ------ to restore offsite power' Could also be additional correct answer.
N lB DG needs to be broken K/A This is ECA 0.0 recovery action and not troubleshooting.
N 170 H
2 b,d U
ll,i Why would status lights remain illuminated? too&.AbtS N
171 l 1
[
2 l
l l
T ?l 5 Why is this not just systems knowledge ?
B 172 H
2 b,d
-I What is indication that implies you have a high level deviation for 5 distractors bd.? How do I know A and B heaters are off?
N 173 F
2 x
Do not need data in stemrWi Procedure does not require cation bed in service. May want to reword.
N 174 H
2 x
2 part K/A. Need procedure part of K/A N
175 H
2 Discuss: 2 inoperable effluent monitors N
176 H
3 x
Teaching in stem: delete reference to void formation. Need to discuss references.
N 177 H
2 X
This is not a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statement. Need to state 3.03 action statement to be consistent.
N 178 H
2 x
l Need some initial conditions stated in stem for shutdown cooling.
N 179 H
2
_J/
K/A is predict the impacts of Loss of Air to SS valve and use procedures. v-_
0 IIX Applicant must be able to predict the impact of loss of air, i.e.2SA-l 4
BC fails open and then choose procedural path. Also reword to say 7i which one of the following actions are correct per plant procedures.
N 180 H
3 x
Mising second part of K/A. Reword stem WOOTF describes the effect on the release and the actions required. Change distractors ad to l5 include a ns. Why no sampling required? 4,JJd N
181 H
3 x
Should tie question to specific procedure i.e. AP-1 1. Add lAW AP-1 1 after 3-2.
N 182 H
2 x
E Predict the impact part of K/A ?
N 184H 2
b Distractor b is not wrong since it will comply with TS 5.2.2.
B 184 H
3
=
llDiscuss M
- 1.
2.1
- 3. Psychometric Flaws l
- 4. Job Content Flaws 15 Other 6
7 C# LOK LOD StMCesr Iaril0 (F/H)
(1-5)
Stem Cues T/F Cred Partial Job-lMinutia
- /
Back-0=
SRO U/ES Explanation IFocus I I
Dist.
I Link I Iunits ward K'A iy 185 F
2 x
Need distractor analysis. WOOTF describes the correct actions of the
_l, __OSM for this request? Discuss distractors B
186 Fvc 2
S Why is this comprehensive ? Vice memory 187 F
2 X
E words 'reduce radiation and guard against personnel exposure" lead right to a. Eliminate all after "take".
N 188 H
3 S
B 189 F
2 x
E RP/0/A/5700/000 is a hand out for 1168 &1178. Ref may be used to eliminated. Discuss distractors.
B 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41
ES-403, Rev. 9 Written Examination Grading Form ES-403-1 Quality Checklist Facility:
McGuire Nuclear Plant Date of Exam:
2/18/2005 Exam Level: RO/SRO Initials Item Description a
b c
- 1.
Clean answer sheets copied before grading VY<C N/A 4
- 2.
Answer key changes and question deletions justified l
N/A xXl and documented I/
- 3.
Applicants' scores checked for addition errors zz N/A (reviewers spot check > 25% of examinations) 4_
- 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, 7UCN/A l as applicable, +/-4% on the SRO-only) reviewed in detail
- 5.
All other failing examinations checked to ensure that grades 4N/A are justified
- 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity N/A l4V of questions missed by half or more of the applicants
_=
Printed Name/Signature Date
- a. Grader v! e4______3-g-6*
- b. Facility Reviewer(*)
(A
- c. NRC Chief Examiner (*)
qj Wo-
/
3-5a
- d. NRC Supervisor
(
- J Ws d tro T1OO(M.m.f3 et
(*)
The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-501 Post-Examination Check Sheet Form ES-501-1 Post-Examination Check Sheet
.egPIe Task Description Date Complete
- 1.
Facility written exam comments or graded exams received and verified complete
- 2.
Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary AZI&
S7
- 3.
Operating tests graded by NRC examiners 3/
- 4.
NRC chief examiner review of operating test and written exam grading completed 73/7/ 5
- 5.
Responsible supervisor review completed
.3 /V/D
- 6.
Management (licensing official) review completed
- 7.
License and denial letters mailed
- 8.
Facility notified of results
- 9.
Examination report issued (refer to NRC MC 0612) 3
- 10.
Reference material retumed after final resolution of any appeals ES-501, Page 23 of 25
GARY R. PETERSON Dukie Vice President PA PO u
McGuire Nuclear Station A Duke Energy Company Duke Power MGOO VP/ 12700 Hagers FerryRoad Huntersville, NC 28078-9340 704 875 5333 704 875 4809 fax grpeters @duke-energy.com November 29, 2004 Mr. William D. Travers Regional Administrator, Region II U.S. Nuclear Regulatory Commission Atlanta Federal Center 61 Forsyth Street, SW Suite 23T85 Atlanta, GA 30303-3415
Subject:
McGuire Nuclear Station Reactor and Senior Reactor Operator Initial Examinations 50-369/2005-301 and 370/2005-301 The enclosed information is provided in response to your request of August 17, 2004. This information is supports the McGuire licensed operator examinations scheduled during the month of February 2005.
Specific items provided in response to the request:
- Simulator Scenarios - (ES-D-1, Scenario Outline Forms in the book)
- Administrative Topics - (ES 301-1, Administrative Topics Outline Forms in the book)
- Job Performance Measures - (ES 301-2, Control Room Systems and Facility Walk-Through Test Outline Forms in the book)
- Examination Quality Assurance Checklist Form, ES 201-2
- Operating Test Quality Checklist Form, ES 301-3
- Simulator Scenario Quality Checklist Form, ES 301-4
- Competencies Checklist Form, ES 301-6
- Reactor Operator and Senior Reactor Operator Written Questions
- Reference Materials The McGuire Operations Facility Representative has reviewed and approved the proposed examination material per NUREG-1021, Revision 9, Section 201. The completion of this action is documented in the attached letter dated November 18, 2004.
Questions oroeentsoed to Charles Sawyer at (704) 875-5248.
ary R. Peterson 1',21.Hi
U. S. Nuclear Regulatory Commission November 29, 2004 Page 2 Mr. James H. Moorman U. S. Nuclear Regulatory Commission Operator Licensing and Human Performance Branch Atlanta Federal Center 61 Forsyth St., SW, Suite 23T85 Atlanta, GA 30303 Mr. George Hopper U.S. Nuclear Regulatory Commission Atlanta Federal Center 61 Forsyth Street, SW, Suite 23T85 Atlanta, GA 30303
Duke
- hPowere A Duke Energy Company GARY R. PETERSON Vice President McGuire Nuclear Station Duke Power MGOI VP / 12700 Hagers Ferry Rd.
Huntersvile, NC 28078-9340 704 875 5333 704 875 4809 fax grpeters@duke-energy.corn November 18, 2004 To:
Gary Peterson From: Robin Bell As the McGuire facility representative I have reviewed and approved the proposed examination material for the NRC examination to be administered in February 2005.
I have determined this material is accurate, operationally valid, and ready for NRC review. This review and approval is done per NUREG 1021, Revision 9 section 201.
Robin Bell/
McGuire Operations I
www. dukepower. corn