IR 05000369/2002301
| ML021060268 | |
| Person / Time | |
|---|---|
| Site: | McGuire, Mcguire  (NPF-009, NPF-017) |
| Issue date: | 02/15/2002 |
| From: | NRC/RGN-II |
| To: | Duke Energy Corp |
| References | |
| -nr, 50-369/02-301, 50-370/02-301 50-369/02-301, 50-370/02-301 | |
| Download: ML021060268 (39) | |
Text
MCGUIRE EXAM 50-369, 37012002-301 FEBRUARY 11 -15,2002 Administrative Documents (Yellow Paper) Exam Preparation Checklist.....................
ES-201-1 Exam Outline Quality Checklist..................
ES-201-2 Exam Security Agreement......................
ES-201-3 Administrative Topics Outline (Final)..............
ES-301-1 Control Room Systems and Facility Walk-through Test Outline (F in a l).................................... Operating Test Quality Check Sheet............ Simulator Scenario Quality Check Sheet......... Transient and Event Checklist................. Competencies Checklist......................
1 Written Exam Quality Check Sheet.............
1 Written Exam Review Worksheet...............
1 Written Exam Grading Quality Checklist.........
1 Post-Exam Check Sheet............
.ES-301-2 ES-301-3 ES-301-4 ES-301-5 ES-301-6 ES-401-7 ES-401-9 ES-403-1 ES-501-1
ES-201 Examination Preparation Checklist Form ES-201-1 Facility:
McGuire Date of Examination:
-Written 02/22/02, Operating 02/11-14/02 Examinations Developed by:
Facilty
/ NRC Target Chief Date*
Task Description / Reference Examiner's Initials-180 1. Examination administration date confirmed (C.1.a; C.2.a & b)
LRM-120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e)
LRM-120 3. Facility contact briefed on security & other requirements (C.2.c)
LRM-120 4. Corporate notification letter sent (C.2.d)
[-90]
[5. Reference material due (C.1.e; C.3.c)]
LRM-75 6. Integrated examination outline(s) due (C.1.e & f; C.3.d)
LRM-70 7. Examination outline(s) reviewed by NRC and feedback provided LRM to facility licensee (C.2.h; C.3.e)
-45 8. Proposed examinations, supporting documentation, and LRM reference materials due (C.l.e, f, g & h; C.3.d)
-30 9. Preliminary license applications due (C.1.1; C.2.g; ES-202)
LRM-14 10. Final license applications due and assignment sheet prepared LRM (C.1.1; C.2.g; ES-202)
-14 11. Examination approved by NRC supervisor for facility licensee LRM review (C.2.h; C.3.f)
-14 12. Examinations reviewed with facility licensee (C. t.j; C.2.f & h; C.3.g)
LRM-7 13. Written examinations and operating tests approved by LRM NRC supervisor (C.2.i; C.3.h)
-7 14. Final applications reviewed; assignment sheet updated; waiver LRM letters sent (C.2.g, ES-204)
15. Proctoring/written exam administration guidelines reviewed with LRM-7 facility licensee and authorization granted to give written exams (if applicable) (C.3.k)
-7 16. Approved scenarios, job performance measures, and questions LRM distributed to NRC examiners (C.3.i)
Target dates are keyed to the examination date identified in the corporate notification lette They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility license Applies only to examinations prepared by the NRC.
NUREG-1021, Revision 8, Supplement 1
ES-201 Examination Outline Form ES-201-2 MA-c'
£-4 Quality Checklist Facilit Date of Examination:
'X/;,2/0.-
Initials Item Task Description a
b-c# a. Verify that the outline(s) fit(s) the appropriate model per ES-40 W A
b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all K/A categories are appropriately sample T T
c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topic E N
d. Assess whether the justifications for deselected or rejected K/A statements are appropriat.
a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of c
,
normal evolutions, instrument and component failures, and major transient S I
b. Assess whether there are enough scenario sets (and spares) to test the projected number and M
mix of applicants in accordance with the expected crew composition and rotation schedule without
,,j compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s)'t and scenarios will not be repeated over successive day c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix.
a. Verify that'
(1) the outline(s) contain(s) the required number of control room and in-plant tasks, (2) no more than 30% of the test material is repeated from the last NRC examination,
/
(3)' no tasks are duplicated from the applicants' audit test(s), and T
(4) no more than 80% of any operating test is taken directly from the licensee's exam bank b. Verify that (1) the tasks are distributed among the safety function groupings as specified in ES-301, (2) one task is conducted in a low-power or shutdown condition, (6 (3) 40% of the tasks require the applicant to implement an alternate path procedure, (4)
kn inpan as tetah applicant's response to an emergency or abnormal condition, and (5) thein-=atZak-throu~h requires the applicant to enter the FIC c. Verify that the required administrative topics are covered, with emphasis on performance-
1./f bae activitie d. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no hiems are duplicated on successive day.
a. Assess whether plant-specific priorities (including PRA and iPE insights) are covered in the appropriate exam sectio G
E b. Assess whether the 10 CFR 55.41143 and 55.45 samplin is appropriat N E
c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least Zt A
d. Check for duplict.ion and overap among exam section L L
e. Check the entire exam for balance of coverag I. Assess whether the exam fits the appropriate job level (RO or SRO).
Pnte am Signature Date a. Author,
-lI3,.
b. Facility Reviewer (14.e' z-t/~
W z
c. NRC Chief Examiner (a) -
9, d. NRC Supervisor I,=a I
11-2 Note:
- Not applicable for NRC-developed examination SIndependent NRC reviewer initial items in Column 'C;: chief examiner concurrence required.
23of 24 NUREG-1021, Revision 8, Supplement 1
ES-201 Examination Outline Form ES-201-2 Quality Checklist A
C. (,..o 0 Date of Examination:
Item W R
I T
T E
N
d. NR*. Superwv
...
".
r Note:
- Not applicable for NRC-developed examination # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.
a,-
Initials a
b*
c#
Facility:
23 of 24 NUREG-1021, Revision 8, Supplement 1 Task Description a. Verify that the outline(s) fit(s) the appropriate model per ES-40 b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all K/A categories are appropriately sample c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topic d. Assess whether the justifications for deselected or rejected K/A statements are appropriat a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, and major transient b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s)*
and scenarios will not be repeated over successive day c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and descrbed in Apndix a. Verify that:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks, (2) no more than 30% of the test material is repeated from the last NRC examination, 53)* no tasks are duplicated from the applicants' audit test(s), and c4) no more than 80r of any operating test is taken directl, from the licensee's exam bank b. Verify that:
(1) the tasks are distributed among the safety function groupings as specified in ES-30l, (2) one task is conducted in a low-power or shutdown condition, (3) 40% of the tasks require the applicant to implement an alternate path procedure, (4)
one in-plIant task tests the applicant's repnse to an emergency or abnormal condition, and I5) the inplnt walk-through requires the aplcnt to enter the RC c. Verify that the required administrative topics are Covered, with emphasis on performance based activitie d. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on successive da a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sectio b, Assess whether the 10 CFR 55.41/43 and 55.45 sam pling is appropriat c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least d. Check for duplication and overlap among exam section e Check the entire exam for balance of covera f. Assess whether the exam fits the appropriate lob level (RO or SRO).
.r dd Name / Signature thor q4A' C. A Low cility Reviewer (S A
)
C Chief Examiner (#)
S I M W T
4.
G E
N E
R A
L a. Au b. Fa C. NR Twate fu-a'
ES-201 Examination Security Agreement Form ES-201-3 Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 2 i/ to,V2-1'as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to Instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result In cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will Immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 24d'z.""zFrom the date that I entered Into this security agreement until the completion of examination administration, I did not Instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME 1 L.
/
4C 8. -De,+.ts 5 t,2. hAs L9f 14.cca c,--
tL, 14L-15. En016 U 3o.r*5 t
JOB TITLE I RESPONSIBILITY
%-Tt$&$V4ar
/rmtlo Pry 6mo a$AmINtrtI'p14*e a
ax.A SIGNATURE (1)
DATE s'-1.oj yg.S
,C ""a'4 iN)~~ok)L a'5*
TtMNNI&4LI u4JM SIGNATU E 2) DATENOTE I
2.2z-&,
k-z
--Z t-olZ NOTES:
NUREG-1021, Revision 8, Supplement 1 24 of 24
r.
rC' nnj n
Examination secuntv Aareernent rurrii co-cu -0 Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11-22 FE]*as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of J*',
-,-
. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME 1. Brian Haagensen 2. Ronald Fortier 3. aul Swetland 6.~I m a 4.
1.c JOB TITLE I RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2) DATENOTE PSHA Examiner
_
PSHA Examiner PSHA Examiner Van".Tý %r !~s'I A
DQ
/Carg o0r-Aq*vowe il,,
4 er.XZ
=So~
NUREG-1021, Revision 8, Supplement I 24 of 24 C
C S
ec flfl4 Z
- T4
C If, In ItCo C
cc
ItC F-NOTES:
C N
C F-orm ES-40 1-3
ES -3~01 Administrative Topics OutlineFomE30-Facility:
McGuire Date of Examination:
Feb 11, 2002 Examination Level (circle one): RO / SRO Operating Test Number:
Administrative Describe method of evaluation:
Topic/Subject 1. ONE Administrative JPM, OR Description TWO Administrative Questions
______________ ____________________________________
I Reactivity Management K/A 2..7/4.4 Conduct of Operations K/A 2.5.25 2.8/3.1 JPM:
Calculate Boron Addition for Rod Change JPM:
Calculate Quadrant Power Tilt Ratio Equipment JP4:
Determine acceptable Main Generator MegaVars for Control specified condition K/A 2.2.22 Repeat but different condition.4/ Radiation JPM:
Using a survey map determine dose time Control calculations K/A 2..5/ Emergency Plan JPM: Make initial notification to the state/Countie K/A 2.4.43 2.8/ Repeat but different conditions.
NUREG-1021, Revision 8 A. 1 Form ES-301-1 V*-ZNI
ES-301 Administrative Topics Outline Form ES-301-1 Facility:
McGuire Date of Examination:
Feb 11, 2002 Examination Level (circle one): RO / SAO Operating Test Number:
Administrative Topic/Subject Description Reactivity Describe method of evaluation:
1. ONE Administrative JPM, OR TWO Administrative Questions JPM:
Perform an Estimated Critical Position Management jCalculation K/A 2..7/4.4 Conduct of JPM:
Based on plant conditions calculate head vent Operations time.
K/A 2.1.25 2.8/ Equipment Control K/A 2.2.13 3.6/ Radiation Control K/A 2..5/ Emergency Plan JPM:
Evaluate a tagout for correctness prior to signing.
JPM:
Calculate stay time with and without a respirator JPM:
Complete the ENS Form and make initial notifications to the State/Counties K/A 2.4.43 2.8/ Repeat but different conditions.
NUREG-1021, Revision 8 A. 3 ES-301 Control Room Systems and Facility Walk-Through Test Outline Form ES-301-2 Facility:
McGuire Date of Examination: Feb.11, 2002 Exam Level (circle one):
0O / SRO(Z)] / SRO(U) Operating Test :
B.l Control Room Systems System / JPM Title Type Safety Codes*
Function / Respond to a Leak on the ND System while D,S,L, (P)
SF-4P at Mid Loop (ND-103) {005-A4.01-3.6/3.4}
(SROU) / Establish Feedwater Control to S/G's D,S SF-4S following a reactor trip (CF-36)
(054-EA2.05 3.5/3.7} /
Start and Load IB Diesel Generator N,S SF-6 (DG-198)
{064-A4.01-4.0/4.3)
d. 004/
Establish normal letdown from excess D,S SF-2 letdown (NV-30)
{004 A3.11-3.6/3.4}
(SROU) /
Emergency Borate the Reactor Coolant N,S,A SF-l system using the PD pump (NV-200A)
{024 AK3.02 4.2/4.41 /
Realign Cooling TO NCPs After Spurious D,S,A SF 8 S/I (KC-150A) {073-K4.01-3.3/3.6) /
Align Containment Spray to Cold Leg S,A,D SF 5 Recirc (NS-182A)
{008-A3.08-3.6/3.7}
Repeat (SROU)
B.2 Facility Walk-Through /
Align Control Air from Backup Cylinder to N,A SF 8 F VI Compressor (VI-IIGA) (078-K4.02 3.2/3.5)
(SROU) /
Start the Hydrogen Recombiner (VX-20)
D SF-5
{028-A4.01-4.0/4.0} /
SKX start up (EPL-199)
{057-AAl.01 N,R SF-6 3.7/3.7)
(New plant equipment)
(SROU)
- Type Codes:
(D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room, (S)imulator, (L)ow-Power, (R)CA, (P)SA NUREG-1021, Revision 8 (P)
-
Indicates this JPM is associated with a Risk Significant System Period as reflected in the MNS Probabilistic Safety Assessment.
or
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
Date of Examination:
Operating Test Numbe Initials 1. GENERAL CRITERIA The operating test conforms with the previously approved outline; changes are consistent with M' /
JL sampling requirements (e.g.. 10 CFR 55.45. operational importance, safety function distribution)-
A
__ There is no day-to-day repetition between this and other operating tests to be administered 1$
during this examination The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.I a). ' Overlap with the written examination and between operating test categories is within acceptable
&t limit It appears that the operating test will differentiate between competent and less-than-competent j4 applicants at the designated license level 2. WALK-THROUGH (CATEGORY A & B) CRITERIA Each JPM includes the following, as applicable:
initial condtions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable The prescripted questions in Category A are predominantly open reference and meet the Ilia
criteria in Attachment 1 of ES-30 Repetition from operating tests used during the previous licensing examination is within acceptable limits (30% for the walk-through) and do not compromise test integrit At least 20 percent of the JPMs on each test are new or significantly modifie. SIMULATOR (CATEGORY C) CRITERIA a
The associated simulator operating tests (scenario sets) have been reviewed in accordance with I j'I/s1 Form ES-301-4 and a copy is attache Printed Name / Sgnature Date a. Author Iia t&
b. Facility Reviewerr)
rnz-4'"
rr/
/L
/L
.
c. NRC Chief Examiner (I)
r,'2?
ltflo--ff/
9-//"A 7 d. NRC Superivsor Eit riSIC e.(
qW_/o2 NOTE:
' The facility signature is not applicable for NRC-developed test # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence require of 26 NUREG-1021, Revision 8, Supplement 1
ES-301 Simulator Scenario Quality GlII ItIor E....-301-4
,
Date of Exam:
ScenanoNumbers: J/ 1/
Operatin Test No-:
QUALITATIVE ATTRIBUTES CInitiaI Initials The iniial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected event.
The scenarios consist mostly of reated events, Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event ut the symptoms/cues that will be visible to the crew the expected operator actions (by shift position)
the event termination point (it arpl cablel No more than one non-mechanisfic failure (e.g., pipe break) is incorporated into the scenario without a credible precedinq incident such as a seismic even I.
/
, The events are valid with, relard to physics and thermodynamics. Sequencing and timing of events is reasonable, and allows the examination team to obtain
'-ml LIM compl evalu~ati~on results LAJ esum wIrflc
- OJCI
--
- If time compression techniques are used, the scenario summary clearly so indicates. Operators kI-AO have sufficient time to carry out expected activities without undue time constraints. Cues are The simulator modeling is not altere /
M The scenarios have been validated. Anry open simulator pertoTnance deficiencies have been ta evaluated to ensure that funictional fidelity is maintained while runnin the lanned scenario.
Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have *.eeo altered in accordance with Section D.4 of ES-30 i All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit L4-'
the form along with the simulator scenarios).
1 Each applicant will be significantly involved in the minimum number of transients and avers
[L on Form ES-301-5 (submit the form with the simulator scenarios).
1 Thelevel of dlficul is app atetosupp nlensing decisionsnforeachcrew LA TARGET QUANTITATIVE ATTRIBUTES (PER SCENARIO; SEE SECTION D.4.D)
Actual Attributes 1.
Total malfunctions LS-8 Is________ Malfunctions after EOP enr (1-2)
7,_____ Abnormal events 2-4 rtransients (1-2 EOPs entered/r uii '*
substantive actions 1-2)11-13_
_,_/ EOP contingences requirno substantive actions 0-2)
I
/
_/
I
___.__ Critical tasks (2-3)
/
1 NUREG-1021, Revision 8, Supplement 1 I
I I-a
_A(
24 of 26
- fl 1 Transient ana venc unecxLILst VUL[II -5Ui-D Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number 1 RO
3
BOP Reactivity
3 Normal
6 RO Instrument/
1,3 2,3 Component Major
5
Reactivity
Normal
As RO Instrument/
Component Major
SRO-I Reactivity
Normal
As SRO Instrument/
Component Major
Reactivity
Normal
SRO-U Instrument/
Component Major
Instructions:
Author:
NRC Reviewer:
(1)
Enter the operating test number and Form ES-D-1 event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum W
e n t
so 8 NUREG-1021 Revision 8, Supplement 1
pg-mi Transient ana venc LfleCK.11512 frOL((I -5UiD Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number
2
6 Normal
2 R02 Instrument/
2,5 1,4 Component Major
5
Reactivity
Normal
SRO-U Instrument/
Component Major
Instructions:
Author:
NRC Reviewer:
(1) Enter the operating test number and Form ES-D-1 event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum NRG12ZqRio en NUREG-1021 Revision 8, Supplement 1
-
01 Transient ana *venc unec+/-lS +/-UL11 mb-iui--'
Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number
2
Normal
RO Instrument/
Component Major
Reactivity
6 Normal
As RO Instrument/
1,4 Component Major
7 SRO-II Reactivity
Normal
2 As SRO Instrument/
1,2, 3,4 Component Major
5 Reactivity
Normal
SRO-U Instrument/
Component Major
Instructions:
Author:
NRC Reviewer:
(1)
Enter the operating test number and Form ES-D-1 event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum 6,
4.qui men NUREG-1021 Revision 8, Supplement 1
ro -, ni Irnq
SflV Rrlr'
tSVt11L
'.A1CUAii StILL
Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number
__
_
OO
3 RO Normal 1___
Instrument/
Component Major1 Instructions:
Author:
NRC Reviewer:
(1) Enter the operating test number and Form ES-D-l event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applican 's competence count toward the minimum rE1ire n NUREG-1021 Revision 8, Supplement 1
Reactivity
---
---
A fl-----4-
rrv-n, PQ-201-R rc
- 2 fl
IrT11 FMII -
L1U
VC11L
+/-+/-CIL.LL.L'S4-Operating Test NO.:
As RO SRO-13 As SRO Instructions:
Author:
NRC Reviewer:
Reactivity
6 Normal
Instrument/
1,4 Component Major
7 Reactivity
Normal
2 Instrument/
1,2, 3,4 Component Major
5 I
Reactivity
Normal
Instrument/
Component Major
(1) Enter the operating test number and Form ES-D-i event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant'
competence count toward the minimum NUREG-1021 Revision 8, Supplement 1 T nsJent anC Event C ec s
orm
ý III I ý ý ES-301-5
Rq -
t Al Trsrienh and Event unec+/-asc rorm fr-iu+/--
Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number
2
4 Reactivity
Normal
RO Instrument/
Component Major
Reactivity
Normal
As RO Instrument/
Component Major
SRO-I Reactivity
Normal
As SRO Instrument/
Component Major
Reactivity
Normal
2
SRO-Ui Instrument/
1,2, 1,2 3,4 3,4 Component Major
5
Instructions:
Author:
NRC Reviewer:
(1)
Enter the operating test number and Form ES-D-l event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applica s
competence count toward the minimum NUREG-1021 Revision 8, Supplement 1
pc--mi Tranient and Event cnecic+/-isr borm -jU1D Operating Test NO.:
Applicant Evolution Minimum Scenario Number Type Type Number l RO
3
SRO Reactivity
Normal
RO Instrument/
Component Major Reactivity
Normal
As RO Instrument/
Component Major
SRO-I Reactivity
Normal
As SRO Instrument/
Component Major
Reactivity Normal
______________________________
I I
2
Instrument/
1,3 1,2 3,4 Component Maj or
5 Instructions:
Author:
NRC Reviewer:
(1) Enter the operating test number and Form ES-D-1 event numbers for each evolution typ (2)
Reactivity manipulations may be conducted under normal or controlled abnormal conditions, but must be significant per Section C.2.a of Appendix (3)
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the
,applican4's competence count toward the minimum NUREG-1021 Revision 8, Supplement 1 SRO-U2
ES-301 Competencies Checklist Form ES-301-6 Applicant #1 Applicant #2 Applicant #3 RO/SRO-I/SRO-U1 RO1/SRO-I/SRO-U R02/SRO-I/SRO-U Competencies SCENARIO SCENARIO SCENARIO Crew1
2
4 1 RO
3
1
3
BOP BOP RO Understand & Interpret 1,2 1,2 1,3 2,3 2,4 1,4 Annunciators & Alarms 4,5
Diagnose Events 1,2 1,2 1,3 2,3, 2,4 1,4
& Conditions 4,5
5
,5
Understand Plant 1,2 1,2 1,3, 2,3 2,4 1,4
& System Response 4,5 3,4
5 5,6
Comply With &
1,2 1,2 1,3, 2,3, 2,4 1,4 Use Procedures (1)
3,4 3,4
5,7
7
5,6
Operate Control 1,3, 2,3, 2,4 1,4 Boards (2)
5
7 Communicate &
1,2 1,2 1,2, 1,2, 1,2 1,2 Interact With the Crew 3,4 3,4 3,4, 3,4, 3,4 3,4
5,6
5,6,
5,6
7
Supervisory 1,2 1,2 Ability (3)
3,4 3,4
5,6
Comply With &
1 Use Tech. Spec (3)
NOTES:
(1) Includes technical specification (2)
Optional for an SRO- (3)
Only applicable to SROs.
compliance for an RO.
INSTRUCTIONS:
Circle the applicant's license type and check the competencies covered by each scenario in the set.
Author:
NRC Reviewer:
(Xttt#r NUREG-1021, Revision 8, Supplement 1
ES-301 Competencies Checklist Form ES-301-6 Applicant #1 Applicant #2 Applicant RO/SRO-I1/SRO-U RO/SRO-12/SRO-U
- 3 RO/SRO I/SRO-U Competencies SCENARIO SCENARIO SCENARIO Crew2
2R0
4 lEO 2
4
2
4 SRO SRO Understand & Interpret 1,2, 1,4, 1,3, 1,2, Annunciators & Alarms 3,4,
5 3,4
Diagnose Events 1,2, 1,4, 1,3, 1,2,
& Conditions 3,4, 5,7
3,4,
5,7 Understand Plant 1,2, 1,4, 1,3, 1,2,
& System Response 3,4, 5,7
3,4,
5,7 Comply With &
1,2, 1,4, 1,3, 1,2, Use Procedures (1)
3,4, 5,7
3,4,
5,7 Operate Control 1,4, 1,3, Boards (2)
5,7
Communicate &
1,2, 1,2, 1,2, 1,2, Interact With the Crew 3,4, 3,4, 3,4, 3,4,
5,6,
5,7
Supervisory 1,2, 1,2, Ability (3)
3,4, 3,4,
5,7 Comply with &
1,2 Use Tech. Spec (3)
1,2 NOTES:
(1) Includes technical specification compliance for an R (2)
Optional for an SRO- (3)
Only applicable to SRO INSTRUCTIONS:
Circle the applicant's license type and check the competencies covered by each scenario in the set.
Author:
NRC Reviewer:
I-t I~
NUREG-1021, Revision 8, Supplement 1
ES-301 Competencies Checklist Form ES-301-6 Applicant #1 Applicant #2 Applicant RO/SRO-13/SRO-U RO/SRO-I/SRO-U2
- 3 RO/SRO I/SRO-U Competencies SCENARIO SCENARIO SCENARIO Crew 3
2 RO
4 1 RO
3
1
3
SRO SRO Understand & Interpret 1,2, 1,4, 1,3, 1,2, Annunciators & Alarms 3,4,
5 3,4
Diagnose Events 1,2, 1,4, 1,3, 1,2,
& Conditions 3,4, 5,7
3,4,
5,7 Understand Plant 1,2, 1,4, 1,3, 1,2,
& System Response 3,4, 5,7
3,4,
5,7 Comply With &
1,2, 1,4, 1,3, 1,2, Use Procedures (1)
3,4, 5,7
3,4,
5,7 Operate Control 1,4, 1,3, Boards (2)
5,7
Communicate &
1,2, 1,2, 1,2, 1,2, Interact With the Crew 3,4, 3,4, 3,4, 3,4,
5,6,
5,7
Supervisory 1,2, 1,2, Ability (3)
3,4, 3,4,
5,7 Comply With &
1,2 Use Tech. Spec (3)
NOTES:
(1) Includes technical specification compliance for an R (2)
Optional for an SRO- (3)
Only applicable to SRO INSTRUCTIONS:
Circle the applicant's license type and check the competencies covered by each scenario in the se Author:
NRC Reviewer:
64 AZ NUREG-1021, Revision 8, Supplement 1
- -L,-k kclAt-M-
ES-401 Written Examination Form ES-401-7 Quality Checklist Facility: mAft gi Date of Exam:
/.,
Eam Level: RL Initial Item Description a
b-Fe Questions and answers technically accurate and applicable to facility a. NRC K/As referenced for all questions b. Facility learning objectives referenced as available RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate t2.2, per Section D.2.d of ES-401 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or./
--the audit exam was completed before the license exam was started; or the examinations were developed independently; or
.
,
--the licensee certifies that there is no duplication; or other (explain) Bank use meets limits (no more than 75 Bank Modified N~eww./
percent from the bank at least 10 percent new, and the rest modified); enter the actual question-23.Q,
-1 distribution at right Between 50 and 60 percent of the questions on Memory C/A^
the exam (including 10 new questions) are written at the comprehension/analysis level; q
_ 5%
enter the actual Question distribution at right References/handouts provided do not give away answers A
L Question content conforms with specific K/A statements in the previously ass ne;uevtiatosaeusiidn4 approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified
"
1 Question ps ychometric quality and format meet ES, Appendix B, guidelines 1 The exam contains 100, one-point, multiple choice items; the total is correct and agrees with value on cover sheet a. Author b. Facility Reviewer (*)
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor go Q N cz. H (
A i 1 es 1f7Wi _
----
--
- --
--
--
--
- - --
---
---
---
---
-
Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examination # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.
NUREG-1021, Revision 8, Supplement 1 42 of 46
ES-401 Written Examination Form ES-401-7 Quality Checklist Facility: M g, ule "
Date of Exam:
0Fo-Exam Level:
R994M Initial Item Description a
b*
c# Questions and answers technically accurate and applicable to facility
Lo a. NRC K/As referenced for all questions b. Facility learning objectives referenced as available
11 RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate 4
,
per Section D.2.d of ES-401 A Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process
- Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or Bank use meets limits (no more than 75 percent from the bank at least 10 percent new, and the rest modified); enter the actual question distribution at right Between 50 and 60 percent of the questions on the exam (including 10 new questions) are written at the comprehension/analysis level; enter the actual question distribution at right Bank Modified New
.2-7 Memory C/A
"W 3/
-j hrrIrl References/handouts provided do not qive away answers Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the Tier to which they are
.,,eirlnaA rtoi',intnn* *rp iJstified A<
1 Question psychometric quality and format meet ES, Appendix B, guidelines I
),% I 1 The exam contains 100, one-point, multiple choice items; the total is correct and agrees with value on cover sheet 1.11" L4 a. Author M,. Vl"Z
...
_
Ž 2__,
_
b. Facility Reviewer (*)-
-1 c. NRC Chief Examiner (#)
_,
-_'
-
d. NRC Regional Supervisor
^L_(_C__
Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examination # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.
NUREG-1021, Revision 8, Supplement 1 42 of 46
__ other kexpla nj I
"
ow ULI t:t
, J ¢
)
142,
ES-401 McGuire Written Examination Form ES-401-9 Review Worksheet.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC 0*
LOK LODI inuti (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation Focus Dis Link units ward K/A Only SRO ONLY
=
H
S 069AA2.01, T1G1 034
H
S WE11G2.1.7, T1G2 051
H
S WE02EA2.1, T1G1 093
H
S WE05EA2.2, T1G2 206
H
S 037AA2.03, T1G2 320
F
S 024AA2.02,T1G1 297
H
X S
G2.1.1 (41.10/45.13), T3, does not have a 55.43 referenc.1 There is no facility learning objective specific to SRO ONL Question documentation references an incorrect 55.43 subpar T/S related and operability call. 55.43.(b)(2)
F
S G2.2.28, T3 35 H
S 073A4.01,T2G2 47 H
S 059AA2.06, T1G1 481
H
S G2.4.44, T3 49 H
X U
007A3.01 (41.7/45.5), T2G3, does not have a 55.43 52 reference. There is no facility learning objective specific to SRO ONLY. Question documentation references an incorrect 55.43 subpar Facility indicated this was beyond RO knowledge. 55.43(b)(5)
Although, contractor will rewrite question and random select from within the same system. New K/A is 007A2.02 Page 1 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAG Q#
LOK LOD Q
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation
Focus Dis Link unitsward KAOnlyr
H
S G2.3.1, T3 66 F
S G2.3.8, T3 67 H
E 056AG2.2.23,T1G3, Distracters reference be in Mode 5 before 70 /26 at 0800, the answer states must be in Mode 5 at 080 Comment incorporated
H
X E
003AA2.03, TIG1, Rods M-13 and B-13 used in distracters C 863 and D do not exis Rods changed to 'M-12' and 'B-12'.
F
X X
U 039A1.09(41.5/45.5),T2G2, does not have a 55.43 reference. 864 There is no facility learning objective specific to SRO ONL Question documentation references an incorrect 55.43 subpart. Distracters are not plausibl Replace the question and randomly sample system 039 in the A2 section. New K/A is 039A2.0 F
X X
X S
029EK3.06 (41.5/41.10/45.6/45.13), T1G1, does not have a 865 55.43 reference. There is no facility learning objective specific to SRO ONLY. Question documentation references an incorrect 55.43 subpart. The stem should be changed to ask
"which of the following statements provides the basis for immediately tripping the turbine required by FR-S.I". Without this change there maybe two correct answers A and.43(b)(5) reference, this is an EOP basis questio Correction made to the stem omitted the word 'why' and added the word 'the' in front of the word 'turbine'. Provided FR-as the specific EOP basis in the stem.
Page 2 of
1. Psychometric Flaws 4. Job Content Flaws 5. Other.
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO U/E/S Explanation
Focus Dis Lnk units ward K/A Only
H
x X
S 005AK1.05 (41.8/41.10/45.3), T1G1, does not have a 55.43 86 reference. There is no facility learning objective specific to SRO ONLY. Question documentation references an incorrect 55.43 subpart. The first part of the answer is a direct look-up, which narrows the choice to 50-50. The second part of the answer has two answers with SDM does not change which could lead one to that answer. Check that rods are above RIL as stated in Distracter Analysis for answer.43(b)(2) Determining wether rod is trippable is an SRO call. Requires two different thought processes on rod and affect on SDM. Reworded question to get rid of reference and focus on SDM aspec F
X E
W/E10EA2.1, T1G1, The wording of the stem elicits answer A 871 or Stem modifie H
E 054AA2.08, T1G2, The answers do not specify which level is 872 decreasin S/G level specified as decreasin F
X E
G2.2.34, T3, There are two possible answers, C and D. The 88 lesson plan does not specify rod insertion required and the procedure does not address allowable time after anticipated time of criticalit Distractor 'C' modified to state 'Trip the reactor and recalculate the ECP.' The licensee operations representative expectation is to insert the control rods and recalculate the EC F
X S
027AK3.03 (41.5/41.10/45.6/45.13), T1G2, does not have a 901 55.43 reference. There is no facility learning objective specific to SRO ONLY. Question documentation references an incorrect 55.43 subpar Referenced to a 55.43(b)(5) since it is an EOP basis questio H
S G2.4.32, T3, Enclosure 4.2 of RP/0/A/5700/000 Step 4.2U.1 has "CONTINUED" should this be "END"?
No change.
Page 3 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC Q# LOK LOD StmCe0TFCe.PrilJb iui (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO U/E/S Explanation I
I Focus Dis Link units ward-K/A I9Only I
H
E G2.1.25, T3, Change distracter B to remove "may" in the "NI 912 pump may be stopped." and in distracter A, 380 gpm is not the 50 minute numbe Distractor 'A' changed 380 to 378. Distractor 'C' and 'D'
numbers changed from 450 to 445 and 500 to 495 respectivel RO ONLY I
H
U WE11EG2.1.7, T1 G2, This has a 43 reference from the 05 NUREG1022 -should not be RO ONLY. REFERENCE PROVIDED PROVIDES DIRECT ANSWER ECA steps provided asking what alignment should be, procedure does not directly provide this information but is required to determine the alignment. Meets reference 55.41 (b)(1 0)
QUESTION WAS REWRr'TEN
F
S 061K5.03, T2G1 158
H
S 027AK3.03, T1G1 370
F
S G2.1.1, T3 32 H
S 001K4.03, T2G1 50 F
S 013K4.11, T2G1 548
F
S G2.3.1, T3 564
H
S 039A1.09, T2G2 605
F
S 004K6.04,T2G1 613
F
S 073A4.01, T2G2 67 H
X E
016G2.1.25, T2G2, Will you require your ROs to use TS in this 69 manner?
Question revised to have the RO's to determine when the accumulators exceed T/S limit H
S 003K3.02, T2G1 715.1 Page 4 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
-
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation
Focus Dis Iunis ward KA Ony
F
X S
WE05EA2.2, T1G2, This has a 43 reference from the 776 NUREG1022 -should not be RO ONLY Tied to 55.41(b)(10) referenc F
S 029EK3.06, T1G2 86 F
S 005AK1.05,T1G1 869
H
X S
WE09EA2.1, T1G1, This has a 43 reference from the 87 NUREG1022 -should not be RO ONL Tied to 55.41(b)(10) reference. Facility has a learning objective in the lesson plan and the facility feels the RO must know this informatio H
S 007A3.01, T2G3 875
F
S 076K2.04, T2G3 882
H
S 075A2.01, T2G2 886
H
X S
G2.2.34, T3, This has a 43 reference from the NUREG1022 -
887 should not be RO ONLY. QUESTION 887.1 USED ON SRO ONLY Tied to 55.41(b)(1) referenc H
E 059K1.05, T2G1, Distracters B and C should should clarify 890 what temperature is being reached (Tavg) and how many sources required such as 553F on 2/4 loop Distractor 'B' changed to add Tav H
S 033A3.02, T2G2 892
F
U 056AG2.2.23, TIG3, This has a 43 reference from the 895 NUREG1022 -should not be RO ONL USEOF REFERENCE IS A DIRECT LOOK-UP. Does not discriminat Tied to 55.41(b)(10) referenc Changing the stem and distractors to focus on the RO's understanding of what makes an EDG inoperable, therefore the reference is not needed.
Page 5 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC O#
LOK LOD I
I (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation Focus I Dis I Link unts ward IO
H
X U
015K3.03, T2G1, The question does not match the KA. The 897 question is more of a TS question on fuel handlin Question will be changed to reflect when can you stop fuel handling vice when can you restart. This change will ensure the question meets the K/ X S
G2.4.32, T3, CHECK SRO ONLY QUESTION 909.1, Although 909 the event has a loss of all annunciators in the stem, the question deals with EP notification not operator response to the los Facility does not have a procedure for loss of all annunciator K/A changed to G2.4.29 and tied to 55.41.(b)(10). Question will remain as writte RQ/SRO COMMON QUESTIONS
H
S 033AK1.01, T1G2 03 F
S 012K5.01, T2G2 048
H
S G2.3.2, T3 124
H
S 034A2.01, T2G2 13 H
S G2.1.21, T3 14 F
X U
G2.1.31, T3, Delete the "a" in the first sentence. Could an 16 argument be made for "manual or leaving manual off answer and assume that it is in manual"? The question does not match the K Deleted 'a' in first sentence of stem. Distractor 'A' changed from tMC-10'to 'IMC-11'. Distractors 'A' and 'B' modified for semetry, 'Ensure AUTO is selected on the heater mode swsitch on 1MC-10 and 5.' These enhancements ensures the question now matches the K/ F
S 045A4.02, T2G3 177 Page 6 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
f (F/H)
O (1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
QBack-
= SRO U/E/S Explanation
- Q Focus Dis Link units ward K/A Ony
F
X U
024AK3.02,T1 G1, Distracters A and C imply continuous action 181 to "maintain" and the action was a single step, therefore, distracters A and C are not valid. Question is now 50-5 Change distractor wording in A and C to take out the word
'maintain' and provide action verbs to make these distractors more in line with B and H
S 061 K3.02, T2G1 19 H
S G2.2.4, T3, The stem does not include the #2 reference that is 26 contained in the answe Comment incorporate H
S 038EK1.02, T1G2 321
H
X U
WEO4.EK3.4, TIG1, Question does not match KA. (Possible 35 EK3.2 Change of KA would not skew the sample plan.)
K/A changed to W/E04.EK3.2. Question will remain unchange F
S 076AA2.01, T1G1 380
F
S 011EK3.07, T1G1 387
H
S 061AA1.01, T1G2 398
H
S 035A1.01, T2G2 400
H
S 068A4.03,T2G1 407
H
S 056K1.03,T2G1 41 H
S 029K3.02, T2G2 43 F
X U
051AA2.02,T1G1, Given AP-23 Loss of condenser vacuum 45 the correct answer is a look-up. Distracters B and C are not credible. Do Not Use a Referenc Question was rewritten and no reference will be provide F
S 086G2.4,12, T2G2 460 Page 7 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC O#
LOK LOD D
-
Q (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO U/E/S Explanation Focus Dis Link units ward K!A Ony
F
N/A 059K1.03, T2G1, Reference material provided(OP-MC-CF-IFE 53 Rev 16 page 33) indicates answer A is correct not answer THIS KA USED TWICE. THIS QUESTION NOT ON SAMPLE PLA Question submitted in erro F
E 013A2.01, T2G1, To avoid confusion place "2A" before NI, CA, 540 ND (the second pump listed in each line of the answers)
Comment incorporate F
X S
055K3.01, T2G2, The distracters A, B, and D are clearly things 547 that would be normal or cause and increase in condenser vaccum. Only answer C is different and stands out as suc Question fine as i H
S G2.2.33, T3 56 F
S WE03EK2.1, T1G2 571
F
X U
040(WE12)AA2.02, T1 G1, Reference not required, Answer A 593 could be argued to be correct based on wording of answer Question will remain as is and no reference will be provide Facility would not support answer 'A' since applicants must look at the question chronologicall H
S 056A2.04, T2G1, Listed as new question based on #649 not 64 include Fine as is question has not been used prior to this exa F
E 025A2.02, T2G1, Can distracter C be made correct with an 681 argument and an assumption?
Fine as is.
Page 8 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC 0#,
LOK LOD Q
-
i I-(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- 1 Back-Q= SRO U/E/S Explanation
____
IFocus Dis ___Link units Iward ~K/A Onlyj
_
_________________
__
F
F U
WE16EK3.1, T1G2, This has two possibly three right answers. 684 What is the reason for having "the controls rods do not tdp for 3 minutes?
Stem reworded to clarify actions taken for ATWS and the only B NC pump was cycled. The correct answer distractor was reworded to eliminate the words 'cycling' and now 'mechanical shock'.
F
S G2.3.4, T3, 70 H
X U
025G2.1.7, T1G2, This has a 43 reference from the 71 NUREG1022 -should not be RO/SR Current question difficulty level is too high for RO's (no job link). Question will be replaced and new question will be specifically referenced to a 55.41 for RO's level of knowledg F
S 064A1.08, T2G2 74 F
S 028K6.01, T2G2 76 H
S 071 K1.06, T2G1 77 F
E G2.1.23, T3, It should be stated in the stem that the 33 communicator is a "qualified person" as required in OMP 4-1 page 15. This will prevent someone from assuming that there is no right answe Comment incorporated to ensure the applicants know the communicator is qualified. The stem changed to state that the person is in contact with an operato H
X U
005A2.02, T2G3, Is this the level of detail McGuire requires of 83 there ROs? Two distracters A and D are not creditible because it is clear by the other two answers that the
"Containment Inside Isolation" are not liste Question will be replace H
S 022AA2.04, T1G2, Distracter B and C overla Comment incorporated. Distractor 'B' and 'C' changed to ensure no overlap.
Page 9 of
1.. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAG Q#
LOK LOD I iu F
i (F/H)
(1-5)
StemiCues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO UIE/S Explanation Focus Dis Link units ward K/A Onyv U
S I -
OF
F
X U
022G2.4.22, T2G1, This has a 43 reference from the 858 NUREG1022 -should not be RO/SRO. Question is not related to K Current question will not be used. Question will be rewritten to match the K/A, new question will have a specific 55.41 reference for RO' K/A will be randomly resampled to 022A3.01
F
S 103A2.04, T2G2, Insert "and" between 2EMF-3 and 2EMF-3.1 In answer A specify 2EMF-3 actuates the alar The word 'and' added to the stem as specified. No change require as a result of the second part of this commen H
S 072A2.02, T2G1 860
F
S 006G2.3.4, T2G2 861
H
S 026K3.02, T2G1 862
F
S 001A3.08, T2G1 866
H
X S
003K6,14, T2G1, 867
F
E 015AA2.09, T1G1, Change the stem to "when is the earliest 870 time that the 1A NCP must be secured?
Comment incorporated. Changed number in stem from '31' to
'312'.
F
S 002A2.02, T2G2, The question is a play on "terminate" and 873 block. Recheck sources for SI block to make sure it is not <
1955 Changed 1955' in stem to 1956'.
H
S 057AK1.04, T1G1 874
F
S 010K4.01, T2G2 876
F
S 011 K5.06, T2G2 877 Page 10 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC (F/H)
O L5) Stem Cues i T/FCred. Partial Job-Minutia
- 1 Back-0=
SRO U/E/S Explanation
- Q Focus
[
Dis MLink units ward K/A OnljyU S
_
H
X S
015K4.01, T2G1, What is a loss of EKVB? Question does not 878 conform to KA Comment retracted, the question meets the K/A. The P-10 interlock is tested. Some clarifications made to the stem and distractors (correcting typographical errors).
F
X S
062K4.05, T2G2, Distracter B, C, D are not creditibl Question does not discriminat Automatic sync switch, verified on the simulator that distractors are satifactory, comment withdraw F
S 063A4.03, T2G1 881
F
X U
078K4.01, T2G3, It could be said that there is no right answer 883 because answer A states "no response" when the yellow
"reset" light will illuminate. Could answer C be correct?
Should the stem include information that the Hi/Lo switch is set for HI?
Eliminated 'No response' from distractor 'A'. Position of HI/LO switch is understood to be in H F
E 007EK2.02, T1G2, For each answer include "automatic reactor 884 trip signals" rather than "auto", it may prevent confusion and an appea Comment incorporate H
x E
004K2.06, T2G1, Documentation supplied does not provide 885 information used in Distracters concerning Channel Reference provided reverse logic the answe EVID is channel 4 power supply to pzr pressure, channel 4 does not feed pzr level. Distractors cover each of the channels affecting pzr level. Answer 'D' is no affect on the system. There is no protective action from channel 4 therefore, the reference of the 'load list' is not needed and will not be provide H
S WE08EK3.3, T1G1 888
F
S G2.4.26, T3 889 Page 11 of 13.
3. Psychometric Flaws 4.Job Content Flaws j 5. Other.
B Q
S Q
(F/H)
(1-5)
Stem Cues T/F Gred. Partial Job-Minutia
- /
Back-0=
SRO U/E/S Explanation
Focus Dis Link units ward K/A Only C
F
X E
WE15EK2.2,T1G3, Distracters C and D are not credibl Revised distractor 'C' from KC system' to' hydrogen purge is compromised by loss of direct access to containment atmosphere.' Distractor 'D' will remain unchange H
S 014K1.02, T2G1 89 H
S 062AK3.04, T1G1 894
H
X U
026G2.2.23, TiG1, This has a 43 reference from the 896 NUREG1022 -should not be RO/SRO. Use of reference makes the question a direct look u Question will be rewritten and specific tie will be identified to 55.41 for RO knowledge. May need to resample if direct tie to 55.41 can not be mad F
X E
022K2.01, T2G1,.Dstracter D needs to be changed. It can be 898 argued that there are two correct answers, if the assumption is made that the power supply to the AHU is from the emergency power suppl Distractor 'D' is being modifie H
S 008AA1.07, T1G2 899
F
S 079A2.01, T2G2 900
H
X S
028AA2.02, T1G3, This has a 43 reference from the 902 NUREG1022 -should not be RO/SR Tied to 55.41 (b)(7) referenc F
E 032AK1.01, T1G2, Distracter D is not credible 903 No modification necessar F
E 058AK3.02, T1G2, Distracter B is not credible and provides 904 clues to the correct answe Major modification of all the distractor F
X S
068AA1.19, T1G1 905 Page 12 of
45 of 46 NUREG-1021, Revision 8, Supplement I 25 SRO ONLY QUESTION COMMENTS PROVIDED TO MCGUIRE 01/04/02 @ 1400.
ANSWER KEY DISTRIBUTION RO A - 24% B - 37% C - 20% D - 19%
SRO - A - 23% B - 38% C - 18% D - 21%
Page 13 of 13.
3. Psychometric Flaws 4. Job Content Flaws 5. Other.
FAC 0*LOK LCD f
i (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO U/E/S Explanation
Focus Dis ink units ward K/A only
F
S 055EK1.01, T1G1 906
F
S 074EK2.06, T1G1 907
F
S 067AG2.3.10, T1G1, QUESTION KA LISTED AS SYS BUT IS 908 APE Comment incorporate F
S G2.4.25,T3 910
F
S 017K3.01,T2G1 911
H
S 001AK1.21, T1G1 913 176 l I 3 1 F 1 3 1 1 1 1 1 S 10591<11.OT2G1 1[914 1
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facilitv: I-'Yic2 ('1eu Date of Exam: *Exam Level(RhOSRO Initials Item Description a
b c Clean answer sheets copied before grading R6___ Answer key changes and question deletions justified and Old documented Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) Grading for all borderline cases (80% +/- 2%) reviewed in detailNA All other failing examinations checked to ensure that grades are justified N A Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date a. Grader b. Facility Reviewer(*)
c. NRC Chief Examiner-Aro 2-d. NRC Supervisor (*)
__ __ _ c_
-
....
()
The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
5 of 5 NUREG-1021, Revision 8, Supplement 1
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: (NPGulze Date of Exam:,Z 102-.
Exam Level: RO!""
Initials Item Description a
b c Clean answer sheets copied before grading X T,, Answer key changes and question deletions justified and documented Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)L.& Grading for all borderline cases (80% +/- 2%) reviewed in L4 detail All other failing examinations checked to ensure that grades are ustified Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date a. Grader b. Facility Reviewer(*)
c. NRC Chief Examiner (*)
d. NRC Supervisor (*)
sAt ak-f
(*)
The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
5 of 5 NUREG-1021, Revision 8, Supplement 1
ES-51 Post-Exam i nation Check Sheeti Task Description Date Complete Facility written exam comments or graded exams received and 2/26/02 verified complete Facility written exam comments reviewed and incorporated and 2/27/02 NRC grading completed, if necessary Operating tests graded by NRC examiners 3/01/02 NRC Chief examiner review of written exam and operating test 3/14/02 grading completed Responsible supervisor review completed 3/18/02 Management (licensing official) review completed 3/18/02 License and denial letters mailed 3/22/02 Facility notified of results 3/22/02 Examination report issued (refer to NRC MC 0610)
3/22/02 1 Reference material returned after final resolution of any Material will be appeals kept Form ES-501-1 (R8, S11)
I:::*-*;('11