ML032020274
| ML032020274 | |
| Person / Time | |
|---|---|
| Site: | Farley  |
| Issue date: | 07/03/2003 |
| From: | Ernstes M Operator Licensing and Human Performance Branch |
| To: | Beasley J Southern Nuclear Operating Co |
| References | |
| 50-348/03-301, 50-364/03-301 50-348/03-301, 50-364/03-301 | |
| Download: ML032020274 (41) | |
See also: IR 05000348/2003301
Text
Administrative Documents
.
FARLEY EXAM
50-348 & 50-364/2003-301
MAY I 9 .
26. 2003
Exam Preparation Checklist ....................
Exam Outline Quality Checklist . . . . . . . . . . . . . . . . . ES-201-2
Exam Security Agreement .....................
Administrative Topics Outline (Final) . . . . . . . . . . . . . ES-301-1
Control Room Systems and Facility Walk-through Test Outline
(Final) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Operating Test Quality Check Sheet . . . . . . . . . . . . . ES-301-3
Simulator Scenario Quality Check Sheet . . . . . . . . . . ES-301-4
Transient and Event Checklist . . . . . . . . . . . . . . . . . . ES-301-5
Competencies Checklist ......................
Yo/- 6
Written Exam Quality Check Sheet . . . . . . . . . . . . . . ES-401-7
Written Exam Review Worksheet . . . . . . . . . . . . . . . . ES-401-9
Written Exam Grading Quality Checklist . . . . . . . . . . ES-403-1
Post-Exam Check Sheet ......................
Examination Preparation Checklist
Form ES-201-1
~~~
~
Target
Chief
Date*
Task Description / Reference
Examiner's
Initials
LM
-180
1. Examination administration date confirmed (C.1.a; C.2.a & b)
Facility:
Date of Examination:
Examinations Developed by:
Facility I NRC (circle one)
~~
~
~
-120
LM
-120
4. Corporate notification letter sent (C.2.d)
LM
3. Facility contact briefed on security & other requirements (C.2.c)
~~~
~~
~
~
-75
-70
6. Integrated examination outline(s) due (C.1 .e & f; C.3.d)
7. Examination outline(s) reviewed by NRC and feedback provided
LM
LM
to facility licensee (C.2.h; C.3.e)
11
-120
I 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)
I
LM
-30
-1 4
-14
9. Preliminary license applications due (C.1 .I; C.2.g; ES-202)
10. Final license applications due and assignment sheet prepared
LM
LM
(C.1.l; C.2.g; ES-202)
11. Examination approved by NRC supervisor for facility licensee
LM
review (C.2.h: C.3.f)
11
[-901
I [5. Reference material due (C.l .e; C.3.c)l
I
LM
~
~~
-7
14. Final applications reviewed; assignment sheet updated; waiver
letters sent (C.2.g, ES-204)
15. Proctoring/written exam administration guidelines reviewed with
facility licensee and authorization granted to give written exams
(if applicable) (C.3.k)
-7
-7
16. Approved scenarios, job performance measures, and questions
distributed to NRC examiners (C.3.i)
LM
LM
LM
8. Proposed examinations, supporting documentation, and
II
-45 I
reference materials due (C.l.e, f, g & h; C.3.d)
I
LM
11
-14
I 12. Examinations reviewed with facility licensee (C.1.j; C.2.f & h; C.3.g) 1
LM
13. Written examinations and operating tests approved by
II
-7
I
NRC supervisor (C.2.i; C.3.h)
I
LM
Target dates are keyed to the examination date identified in the corporate notification letter.
They are for planning purposes and may be adjusted on a case-by-case basis in coordination
with the facility licensee.
Applies only to examinations prepared by the NRC.
[ ]
23 of 25
NUREG-1021, Draft Revision 9
Examination Outline Quality Checklist
Form ES-201-2
- acilit!
Item -
-
1.
W
R
I
T
T
E
N
2.
s
i
M
-
3.
W
/
T
-
4.
G
E
N
E
R
A
L
-
Fariey
Date of Examination:
5/19-26/03
Task Description
-
a
a. Verify that the outline(s) fit@) the appropriate model per ES-401.
b. Assess whether the outline was systematically and randomly prepared in accordance with
Section D.l of ES-401 and whether all KIA categories are appropriately sampled.
c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.
a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of
normal evolutions, instrument and component failures, and major transients.
b. Assess whether there are enough scenario sets (and spares) to test the projected number
and mix of applicants in accordance with the expected crew composition and rotation schedule
without compromising exam integrity; ensure each applicant can be tested using at least one
new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit
test@)'. and scenarios will not be repeated on subsequent days.
c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and
quantitative criteria specified on Form ES-301-4 and described in Appendix D.
a. Verify that:
TK
(1) the outline(s) contain@) the required number of control room and in-plant tasks,
(2) no more than 30% of the test material is repeated from the last NRC examination,
(3)' no tasks are duplicated from the applicants' audit test@), and
(4) no more than 80% of any operating test is taken directly from the licensee's exam banks.
b. Verify that:
TK
(1) the tasks are distributed among the safety function groupings as specified in ES-301,
(2) one task is conducted in a low-power or shutdown condition,
(3) 4 - 6 (2 - 3 for SRO-U) of the tasks require the applicant to implement an alternate path
procedure,
(4) one implant task tests the applicant's response to an emergency or abnormal condition, and
(5) the in-piant walk-through requires the applicant to enter the RCA.
c. Verify that the required administrative topics are covered
d. Determine if there are enough different outlines to test the projected number and mix Of
applicants and ensure that no items are duplicated on subsequent days.
a. Assess whether piant-specific priorities (including PRA and IPE insights) are covered in the
appropriate exam section.
b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
c. Ensure that WA importance ratings (except for plant-specific priorities) are at least 2.5.
d. Check for duplication and overlap among exam sections.
e. Check the entire exam for balance of coverage.
f. Assess whether the exam fits the appropriate job level (RO or SRO).
TK
TK
TK
TK
TK
TK
TK
TK
a. Author
b. Facility Reviewer r)
c. NRC Chief Examiner (#)
Note
. Not app cable for NRC-oeveloped exam nations
- Independent NRC rev ewer initial items in Column c,' cnief exam ner conc.rrence required
24 of 25
NUREG-I 021, Drat? Revision 9
II
Farley
Date of Examination:
5119-28/03
Examination Outline Quality Checklist
Form ES-201-2
I1
Facili;
Item -
-
1.
w
R
i
T
T
E
N -
2.
S
I
M
-
3.
w
/
T
-
4.
G
E
N
E
R
A
L -
Na
/Signature
Date
a. Author
.-p,
[ ~ r b
/+
5-/+ 03
b. Facility Reviewer (')
c. NRC Chief Examiner (#)
d. NRC Supervisor
h
--
,
k ' ' & W [ L
eei<f&(%
rl/&,c Enflsrw /& -
-
Note:
- Not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c:
chief examiner concurrence required.
Task Description
"*
c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.
MI
Initials
Ll\\
L h
l a l b . I c #
a. Verify that the outline(s) fit(s) the appropriate model per ES-401.
c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and
quantitative criteria specified on Form ES-301-4 and described in Appendix D.
a. Verifv that:
b. Assess wnether tne outline was systematically and ranoomly prepared n accoroance w th
Sec1,on D.l of ES-401 and whetner a KIA categor es are appropriately sampled.
A-
4
m
(1) the OJtI ne@) conta n(s) tne reqJ red ndmoer of control room and In-plant tasns,
(3)' no tasks are dJplicaled from me app cants aJo t lest(sJ. and
(4) no more tnan 80% of any opeiat ng test IS taken oirect y from the licensee's exam banks
(2) no more lnan 30% of tne test materia is repeated from the ast NRC examination.
I
a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of
normal evolutions, instrument and component failures, and major transients.
v
LA
b. Assess whether there are enough scenario sets (and spares) to test the projected number and
mix of applicants in accordance with the expected crew composition and rotation schedule without
compromising exam integrity: ensure each applicant can be tested using at least one new or
significantly modified scenario, that no scenarios are duplicated from the applicants' audit teSt(S)^,
and scenarios will not be repeated on subsequent days.
b. Verify that:
(1) the tasks are distributed among the safety function groupings as specified in ES-301,
(2) one task is conducted in a low-power or shutdown condition,
(3) 4 - 6 (2 - 3 for SRO-U) of the tasks require the applicant to implement an alternate path
procedure,
(4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and
(5) the in-plant walk-through requires the applicant to enter the RCA.
c. Verify that the required administrative topics are covered
d. Delerm ne if there are enoLgn d fferent oLt nes to test the projected nLmber and m x of
appl cants and ensue that no items are dLp cated on sLbseqLenl oays
a. Assess whether plant-specific priorities (including PRA and iPE insights) are covered in the
24 of 25
NUREG-1021, Draft Revision 9
Examination Outline Quality Checklist
Form ES-201-2
Item
Initials
I
I
Task Description
pecified in ES-301,
implement an alternate path
b. Facility Reviewer ('1
W/A
n
c. NRC Chief Examiner (#)
&3 2. Mcf/M
LrcYrrJze
ZizZ
d. NRC Supelvisor L
Kkf E
u
Note
- Not app cao e for hRC oeveloped examinations
P naepenaent hRC revie.ver n val !!erns in Column c chief examiner concdrrence requred
NUREG-1021, Draft Revision 9
24 of 25
E
0
m
c
.-
c
.-
E
W
4
v)
0
w
a
ri
m
N
O
Y-
!
i
i
,
I
r
06/04/2003 13:41 FAX 3013301102
Studsvlk Scandpower
86/84/2683 12: 43
~72764945
TRAINING
La 002
PkGE
El:!
Administrative Topics Outline
Form ES-301-1
Administrative Topic
(see Note)
Describe activity to be performed
Calculate Reactor Vessel Head Venting Time (New JPM)
Conduct of Operations
2.1.25 (2.813.1)
Conduct of Operations
Equipment Control
Radiation Control
Perform ECP [CRO-O25A]
2.1.1 0 (plant parameter verification)
(2.713.9)
Maintenance Retest of 1 B RHR Pump (New JPM)
WA 2.2.12 3.013.4
~~
~~
Perform A Shielding Calculation (New JPM)
2.3.2 (2.U 2.9)
NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless
!hey are retaking only the administrative topics, when 5 are required.
Administrative Topics Outline
Form ES-301-1
Facility:
Farlev
Date of Examination:
5/19-27/2003
Examination Level (circle one): RO /=
Operating Test Number:
1
Administrative Topic
(see Note)
Conduct of Operations
Conduct of Operations
Equipment Control
Radiation Control
Describe activity to be performed
Calculate Reactor Vessel Head Venting Time (New JPM)
2.1.25 (2.8/3.1)
Perform ECP [CRO-O25A]
2.1 .IO (plant parameter verification)
(2.7/3.9)
Maintenance Retest of 1 B RHR Pump (New JPM)
WA 2.2.12 3.013.4
Perform A Shielding Calculation (New JPM)
2.3.2 (2.W 2.9)
Classification of an Emergency Event (New JPM)
2.4.41 (2.3/4.1)
NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless
they are retaking only the administrative topics, when 5 are required.
Control Room/ln-Plant Systems
Form ES-301-2
System / JPM Title
Outline
Type Code*
Safety
Function
Facility:
Farlev
Date of Examination: 5/19-27/2003
Exam Level (circle o n e ) : m / SRO(I) / SRO(U)
Operating Test No.:
1
b. Verify Phase B Containment Isolation and Containment Spray
Initiation CRO-406B new
MASL
5
4s
I
DS
I
a. Shift AFW pump suction to Service Water CRO-239
e. Perform the required actions for Cold Leg Recirculation
CRO-333A
DSL
3
2
I
NAsL I
c. Two Train Verification of ECCS equipment CRO-406E NEW
g. Perform an emergency boration. CRO-65 New
h. Parallel the Main Trubine with the Grid CRO-177A
d. Restore Instrument Air to Containment-CRO-328B
I
DASL
I
8
N S A
1
D S L
6
.
. Manual operation of S/G Atmospheric Relief SO-549A
Makeup to SFP from the RWST SO-130 New
f. Align R-1 lFI-12 to normal in response to spurious SI
SRO-343H
R,N
8
D
4s
c. Bleed and Feed Generator for H2 Purity SO-251
I
D
l
6
' Type Codes: (D)irect from bank M odified from bank, (N)ew, (A)lternate path, (C)ontrol
'oom, (S)imulator, (L)ow-Power, ( Ad A "
control HOOm/ln-Plant systems
Form tS-3072
Outline
DSL
Facility:
Farlev
Date of Examination: 5/19-27/2003
Exam Level (circle one): RO / SROfIL/ SROW )
Operating Test No.: 1
3
~-
Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)
DS
System / JPM Title
7
~~
a. Shift AFW pump suction to Service Water CRO-239
b. Verify Phase B Containment Isolation and Containment Spray
Initiation CRO-406B new
c. Two Train Verification of ECCS equipment CRO-406E NEW
~~
d. Restore Instrument Air to Containment-CRO-3286
e. Perform the required actions for Cold Leg Recirculation
CRO-333A
f. Align R-lI/R-12 to normal in response to spurious SI
SRO-343H
g. Perform an emergency boration. CRO-65 New
-
h.
In-Plant Systems (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)
il.
j.
Manual operation of S/G Atmospheric Relief SO-549A
Makeup to SFP from the RWST SO-130 New
~~
-~
k. Bleed and Feed Generator for H2 Purity SO-251
Typecode* I
Safety
Function
DASL
I
8
6
D
l
Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room,
Shmulator. (Uow-Power. (RKA
Operating Test Quality Checklist
Form ES-301-3
Facility:
Farley
Date of Examination: 5119-26/03
Ope1
1. GENERAL CRITERIA
II
a.
The operating teSt conforms with the previously approved outline; changes are consistent with
sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function
distribution).
There is no day-to-day repetition between this and other operating tests to be administered
during this examination.
The operating test shall not duplicate items from the applicants' audit test(s)(see Section
b.
C.
d.
Overlap with the written examination and between different parts of the operating test is within
acceptable limits.
It appears that the operating test will differentiate between competent and less-than-competent
applicants at the designated license level.
e.
2. WALK-THROUGH CRITERIA
a.
Each JPM includes the following, as applicable:
. initial conditions
' initiating cues
. references and tools. including associated procedures
' reasonable and validated time limits (average time allowed for completion) and specific
' specific performance criteria that include:
designation if deemed to be time crilicai by the facility licensee
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical stem and their associated Derformance standards
- restrictions on the sequence of steps. if applicable
II
b
Repel tion from operating tests used our ng the previous Iicens ng examination IS witnin
acceptaole limits (30% for the wa &.lnro-gh) and do not comprom se tesl integrity
At least 20 percent of the JPMs on each test are new or sign ficantlf modifed
C
3 SIMULATOR CRITERIA
a
The assoc aled slmJaror operating tests (scenario sets) nave been rev ewe0 in accordance
w th Form ES 301-4 and a copy is attached
a Author
o Facility Rev ewer(')
h
1
c NRC Chief Exam ner (k)
Lee R M erl
d hRC Supervisor
.-
ng Test Number: 1
Date
$7- 2/47
NOTE:
- The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
24 of 27
NUREG-1021, Draft Revision 9
Operating Test Quality Checklist
Form ES-301-3
- aciiity:
Farley
Date of Examination: 5119-28103
Operating Test Number: 1
I
1.
The operating test conforms with the previously approved outline; changes are consistent with
sampling requirements (e& 10 CFR 55.45, operational importance, safety function distribution).
There is no day-to-day repetition between this and other operating tests to be administered
during this examination.
w
The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.1.a).
Overlap with the written examination and between different parts of the operating test is within
acceptable limits.
It appears that the operating test will differentiate between competent and less-than-competent
applicants at the designated license level.
-
).
W'
1.
?.
2. WALK-THROUGH CRITERIA
_.
1.
Each JPM includes the following, as applicable:
. initial conditions
. initiating cues
. references and tools, including associated procedures
I I
reasonable and validate0 time mils (average time allowea for compiet'on) ana specific
des:gnatlon 'f deemed 10 oe time cril ca by me facility licensee
spec'Cc performance cr teia that include:
F.
- detailed expecteo aclions w th exact criteria and nomenc alae
. system response ana otner examiner cLes
. statements describ ng important observat ons to De made oy the applicant
- criter'a lor successk comp el;on of the tas6
- dentifcar.on of crit'cal steps and mer associated performance standards
- restr ctlons on tne seqLence of steps. if applicable
b.
Repet t.on from operat ng tests Lsed auring tne prev'oLs licensing examination 's with!-
accepta0.e m'ts (30% for the walk-through) ana do not comprom se test integrity
At east 20 percent of the .PMs on each test are new or s gnifcantly mooifed.
F*c
gut.
C.
3. SIMULATOR CRITERIA
..
1.
The assoc atea SimLlator operat ng tests (scenar:o sets) have Deen rev'ewed in accordance w:th
Form ES-301-4 and a copy s attached.
Printed Name / Signature
Date
3. Author
-7zZ&&+.Ld(L
Lk& /Ac 2 &d!!
&
rnICHltFL E ' E ; d J I W / U E ?.x
/-
- z
I, Facility Reviewerr)
- . NRC Chief Examiner (#)
-
4'V/YIO?
1. NRC Supervisor
\\IOTE:
M
fl?J
- The facility signature is not applicable for NRC-developed tests.
- independent NRC reviewer initial items in Column '"c;" chief examiner concurrence required.
24 of 27
NUREG-I 021, Draft Revision 9
Simulator Scenario Quality Checklist
Form ES-301-4
Facility:
Fariey
Date of Exam: 5/19-26/03
Scenario Numbers: 1 / 2 / 3 Operating
Test No: 1
I
QUALITATIVE ATTRIBUTES
3.
Each event description consists of
the point in the scenario when it is to be initiated
the maifunction(s) that are entered to initiate the event
the symptomslcues that will be visible to the crew
he examination team to obtain
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator
25 of 27
NUREG-I 021, Draft Revision 9
..
. ..... .. . . .
. .
....
Transient and Event Checklist
Form ES-301-5
OPERATING TEST NO: Crew 1
SRO-U 1
Instructions:
(1)
(2)
(3)
Enter the operating test number and Form ES-D-1 event numbers for each evolution type,
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section
D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal evolutions may be
replaced with additional instrument or component malfunctions on a one-for-one basis
Whenever practical, both instrument and component malfunctions should be included: only those that require
verifiable actions that provide insight to the apaicant's competence count toward the minimum requirement.
-
Author:
4-
NRC Reviewer:
26 of 27
NUREG-1021, Draft Revision 9
SRO-U
Instructions:
(1)
(2)
Enter the operating test number and Form ES-D-1 event numbers for each evolution type.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to
Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal
evolutions may be replaced with additional instrument or component malfunctions on a one-for-one
basis.
Whenever practical, both instrument and component malfunctions should be included; only those that
reauire verifiable actions that Drovide insiaht to the amlicant's cornoetence count toward the
(3)
Reactivity
0
Normal
I*
Instrument /
2*
Component
Major
1
Author:
-
. .
NRC Reviewer:
Lc4lK-k
26 of 27
NUREG-1021, Draft Revision 9
Transient and Event Checklist
Form ES-301-5
OPERATING TEST NO: Crew 3
SRO-I
As SRO
Instructions:
(1)
(2)
Enter the operating test number and Form ES-D-1 event numbers for each evolution type.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to
Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal
evolutions may be replaced with additional instrument or component malfunctions on a one-for-one
basis.
Whenever practical, both instrument and component malfunctions should be included: only those that
rewire verifiable actions that provide insight to the applicant's competence count toward the
(3)
Author:
NRC Reviewer:
-K,&W
26 of 27
NUREG-1021, Draft Revision 9
Transient and Event Checklist
Form ES-301-5
OPERATING TEST NO: Crew 4
Instructions:
(1)
(2)
(3)
Author:
NRC Reviewer:
Enter the operating test number and Form ES-D-1 event numbers for each evolution type.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to
Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal
evolutions may be replaced with additional instrument or component malfunctions on a one-for-one
basis.
Whenever practical, both instrument and component malfunctions should be included; only those that
require verifiable actions that provide insight to the applicant's competence count toward the
minimum requirement.
26 of 27
NUREG-1021, Draft Revision 9
Competencies Checklist
Form ES-301-6
2.3,
4.5,
6,7
2,3,
4,5,
6
12,
3.4,
5.6,
7
12.
3,4.
5,6,
7
3.4,
5,6
CENARIO
2
3
2,3.
4,6,
7
1,2.
3.4.
5,6
1.2,
3,4.
5,6.
7
1.2,
3.4.
5.6.
7
2.3,
4.5
Competencies
and Conditions
Communicate and
Interact
I
Comply With and
Use Procedures (1 )
1,2.
3,4.
5.6
Operate Control
Boards (2) I
Demonstrate Supervisory
Ability (3)
Comply With and
Use Tech. Specs. (3)
Notes:
5,6
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Circle the applicant's license type and enter one or more event numbers that will allow the
examiners to evaluate every a
Author:
/
NRC Reviewer:
-e
d
k
27 of 27
NUREG-1021, Draft Revision 9
Written Examination
Form ES-401-6
Quality Checklist
Facility:
Farley
Date of Exam: 5/30/03
Exam Level: RO/SRC
2
the examinations were developed independently; or
-
the licensee certifies that there is no duplication; or
-other
(explain)
from the bank at least 10 percent new, and the
rest modified); enter the actual RO / SRO-only
question distribution(s) at right
the RO exam are written at the
I-
Bank use meets limits (no more than 75 percent
Bank
Modified
New
c
C
.
6.
&
43/13 9-
12/6
7.
Between 50 and 60 percent of the questions on
Memory
C/A
,. ,
45/40
55/60
comprehension/analysis level; the SRO exam
may exceed 60 percent if the randomly selected
WAS support the higher cognitive levels: enter
the actual RO / SRO auestion distribution(s) at
9
a.
-
@
9.
Question content conforms with specific KIA statements in the previously
approved examination outline and is appropriate for the Tier to which they are
assigned; deviations are justified
Question psychometric quality and format meet ES, Appendix B, guidelines
The exam contains the required number of one-point, multiple choice items; the
total is correct and agrees with value on cover sheet
10.
11.
&
a. Author
-$Judd
-
-qm
Y./6$3 &&&
b. Facility Reviewer (*)
- /A
d. NRC Regional Supervisor b
e
IHC
E Q d J ? e v / M . e25
c. NRC Chief Examiner (#)
& 2.."ll7cl 4 - L
Note:
- The faciiity reviewer's initialskignature are not applicable for NRC-developed examinations.
5
NUREG-1021, Draft Revision 9
. .
300f 34
o?
c:
.
W
w
>.(A
2
0
E
r;
c
2
f
v x x x x x
i
2 . 5
Y ) ' 2
c
%
u
f
v x x x x
0
c
W
x
r-
d
5:z
N
N
r
m
w
v:
w
w
c
0
u
CU
a
c)
6
B
a
v) a
M
E
(rl
3
3
X
m
z m
r-
3
.
6 2rA
I
x
-
N
N
N
m -
z
0
e
! 2 8
.E .3
w
m
r-
N
x
x
x
z z
M
N
3
x
x
T
r-:
w
II
..
4
m
%
t
4
w
m
m
m
-
m
c
J
I
rn
m
-
m
m
m
cl
I x
I x
x
1
%
-r
7
L
t
I m
_.
z u
m
z m
-+
r- '0 -
'0
'0
.
w Zrn
0
t
v)
W
w
W
I
I
I
0
3
CI
vl
W
W
W
Q\\
c m
m
W -
-
d
d
W
I
I
I
I
I
rn
!
d a
1
0
i o d
.
d 2 m
5
rl
x
x
I
1
I
7 -
a e q
Q
rn
d
00
I
.
w 2VJ
I
1
+
+
X
m
W
00
a
% a
h
e,
2
ce
- 3
0
I
x i
n
Im -
m
m
00
=
n -
X
Ll
rA
X
f
x
X
t
T-
-+ -
f
I
- a
I
I
cu
m
a
a
00 a
-
2
a
Written Examination Grading
Form ES-403-1
Quality Checklist
Facility:
Date of Exam:
Item Description
1.
2.
Clean answer sheets copied before grading
Answer key changes and question deletions justified and
documented
Applicants' scores checked for addition errors
(reviewers spot check > 25% of examinations)
Grading for all borderline cases (80 +/- 2% overall and 70 +/-
4% on the SRO-only) reviewed in detail
All other failing examinations checked to ensure that grades
are justified
Performance on missed questions checked for training
deficiencies and wording problems; evaluate validity of
questions missed by half or more of the applicants
Printed Name I Signature
3.
4.
5.
6.
a. Grader
- L. R. Miller/
b. Facility Reviewer(*)
- N/A
c. NRC Chief Examiner (*)
-L. R. Miller/ m
d. NRC Supervisor (*)
- G.T. Hopper/
/ J
Kam Level: ROISRO
Initials
a
I
b
+
A
-
$
C
LM
LM -
-
LM
LM
LM
LM -
Date
- 6/30/03-
f*I
The facilitv reviewer's signature is not applicable for examinations araded bv the
-
I
,
5of5
NUREG-1021, Draft Revision 9
Post-Examination Check Sheet
Form ES-501-1
Task Description
1.
Facility written exam comments or graded exams received and
verified complete
2.
Facility written exam comments reviewed and incorporated and
NRC grading completed, if necessary
3.
Operating tests graded by NRC examiners
1.
NRC Chief examiner review of written exam and operating test
grading completed
-
3.
Responsible supervisor review completed
5.
7.
Management (licensing official) review completed
License and denial letters mailed
3.
Facility notified of results
3.
Examination reDort issued (refer to NRC MC 0612)
IO.
Reference material returned after final resolution of any
appeals
Date
Complete
6/6/03
6/30/03
611 3/03
7/01/03
7/01/03
7/03/03
7/03/03
7/03/03
7/03/03
21 of 23
NUREG-1021, Draft Revision 9