ML032020274

May 2003 Exam 50-348/2003-301 Administrative Documents

ML032020274
Person / Time
Site:	Farley
Issue date:	07/03/2003
From:	Ernstes M Operator Licensing and Human Performance Branch
To:	Beasley J Southern Nuclear Operating Co
References
50-348/03-301, 50-364/03-301 50-348/03-301, 50-364/03-301
Download: ML032020274 (41)

See also: IR 05000348/2003301

Text

Administrative Documents .

FARLEY EXAM

50-348 & 50-364/2003-301

MAY I 9 .26. 2003

Exam Preparation Checklist . . . . . . . . . . . . . . . . . . . . ES-201-1

Exam Outline Quality Checklist . . . . . . . . . . . . . . . . . ES-201-2

Exam Security Agreement ..................... ES-201-3

Administrative Topics Outline (Final) . . . . . . . . . . . . . ES-301-1

Control Room Systems and Facility Walk-through Test Outline

(Final) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ES-301-2

Operating Test Quality Check Sheet . . . . . . . . . . . . . ES-301-3

Simulator Scenario Quality Check Sheet . . . . . . . . . . ES-301-4

Transient and Event Checklist . . . . . . . . . . . . . . . . . . ES-301-5

Competencies Checklist . . . . . . . . . . . . . . . . . . . . . . ES-301-6

Yo/- 6

Written Exam Quality Check Sheet . . . . . . . . . . . . . . ES-401-7

Written Exam Review Worksheet . . . . . . . . . . . . . . . . ES-401-9

Written Exam Grading Quality Checklist . . . . . . . . . . ES-403-1

Post-Exam Check Sheet . . . . . . . . . . . . . . . . . . . . . . ES-501-1

ES-201 Examination Preparation Checklist Form ES-201-1

Facility: Date of Examination:

Examinations Developed by: Facility I NRC (circle one)

~~~ ~

Target Chief

Date* Task Description/ Reference Examiner's

Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a & b) LM

1~~

-120

~

I 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)

~

I LM

-120 3. Facility contact briefed on security & other requirements (C.2.c) LM

-120 4. Corporate notification letter sent (C.2.d) LM

1~~~

[-901 I [5.Reference material due (C.l .e; C.3.c)l

~~ ~ ~

I LM

-75 6. Integrated examination outline(s) due (C.1.e & f; C.3.d) LM

-70 7. Examination outline(s) reviewed by NRC and feedback provided LM

to facility licensee (C.2.h; C.3.e)

I -45 I 8. Proposed examinations, supporting documentation, and

reference materials due (C.l.e, f, g & h; C.3.d) I LM

-30 9. Preliminary license applications due (C.1.I; C.2.g; ES-202) LM

-14 10. Final license applications due and assignment sheet prepared LM

(C.1.l; C.2.g; ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee LM

review (C.2.h: C.3.f)

1 -14 I 12. Examinations reviewedwith facility licensee (C.1.j; C.2.f & h; C.3.g) 1 LM

I -7 I 13. Written examinations and operating tests approved by

NRC supervisor (C.2.i; C.3.h)

~~ ~

I LM

-7 14. Final applications reviewed; assignment sheet updated; waiver LM

letters sent (C.2.g, ES-204)

15. Proctoring/written exam administration guidelines reviewed with LM

-7 facility licensee and authorization granted to give written exams

(if applicable) (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions LM

distributed to NRC examiners (C.3.i)

• Target dates are keyed to the examination date identified in the corporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination

with the facility licensee.

[ ] Applies only to examinations prepared by the NRC.

23 of 25 NUREG-1021, Draft Revision 9

ES-201 Examination Outline Quality Checklist Form ES-201-2

Fariey Date of Examination: 5/19-26/03

-

acilit!

Item Task Description -

- a

1. a. Verify that the outline(s) fit@) the appropriate model per ES-401.

W

R b. Assess whether the outline was systematically and randomly prepared in accordance with

I Section D.l of ES-401 and whether all KIA categories are appropriately sampled.

T

T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

E

N d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of

normal evolutions, instrument and component failures, and major transients.

s

i b. Assess whether there are enough scenario sets (and spares) to test the projected number

M and mix of applicants in accordance with the expected crew composition and rotation schedule

without compromising exam integrity; ensure each applicant can be tested using at least one

new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit

test@)'. and scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and

- quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verify that: TK

(1) the outline(s) contain@)the required number of control room and in-plant tasks,

W (2) no more than 30% of the test material is repeated from the last NRC examination,

/ (3)' no tasks are duplicated from the applicants' audit test@), and

T (4) no more than 80% of any operating test is taken directly from the licensee's exam banks.

b. Verify that: TK

(1) the tasks are distributed among the safety function groupings as specified in ES-301,

(2) one task is conducted in a low-power or shutdown condition,

(3) 4 - 6 (2 - 3 for SRO-U) of the tasks require the applicant to implement an alternate path

procedure,

(4) one implant task tests the applicant's response to an emergency or abnormal condition, and

(5) the in-piant walk-through requires the applicant to enter the RCA.

c. Verify that the required administrative topics are covered TK

d. Determine if there are enough different outlines to test the projected number and mix Of TK

- applicants and ensure that no items are duplicated on subsequent days.

4. a. Assess whether piant-specific priorities (including PRA and IPE insights) are covered in the TK

appropriate exam section.

G

E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. TK

N

E c. Ensure that WA importance ratings (except for plant-specific priorities) are at least 2.5. TK

R TK

d. Check for duplication and overlap among exam sections.

A

L e. Check the entire exam for balance of coverage. TK

f. Assess whether the exam fits the appropriatejob level (RO or SRO). TK

-

a. Author

b. Facility Reviewer r)

c. NRC Chief Examiner (#)

Note . Not app cable for NRC-oevelopedexam nations

1. Independent NRC rev ewer initial items in Column c,' cnief exam ner conc.rrence required

24 of 25 NUREG-I021, Drat? Revision 9

ES-201 Examination Outline Quality Checklist Form ES-201-2

1

I

-Facili; Farley Date of Examination: 5119-28/03

I

Item Task Description

M Initials I

- l a l b . I c #

1. a. Verify that the outline(s) fit(s) the appropriate model per ES-401.

w

R b. Assess wnether tne outline was systematically and ranoomly prepared n accoroance w th

i Sec1,on D.l of ES-401 and whetner a KIA categor es are appropriately sampled.

T "*A-

T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. Ll\

E

-

N d. Assess whether the justifications for deselected or rejected KIA statements are appropriate. Lh

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of

normal evolutions, instrument and component failures, and major transients.

S I

I b. Assess whether there are enough scenario sets (and spares) to test the projected number and

M mix of applicants in accordance with the expected crew composition and rotation schedule without

compromising exam integrity: ensure each applicant can be tested using at least one new or

significantly modified scenario, that no scenarios are duplicated from the applicants' audit teSt(S)^,

and scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and

4 m

- quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verifv that:

(1) the OJtI ne@)conta n(s) tne reqJ red ndmoer of control room and In-plant tasns,

w

/

(2) no more lnan 30% of tne test materia is repeated from the ast NRC examination.

(3)' no tasks are dJplicaled from me app cants aJo t lest(sJ. and

v LA

T (4) no more tnan 80% of any opeiat ng test IS taken oirect y from the licensee's exam banks

b. Verify that:

(1) the tasks are distributed among the safety function groupings as specified in ES-301,

(2) one task is conducted in a low-power or shutdown condition,

(3) 4 - 6 (2 - 3 for SRO-U) of the tasks require the applicant to implement an alternate path

procedure,

(4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and

(5) the in-plant walk-through requires the applicant to enter the RCA.

c. Verify that the required administrative topics are covered

d. Delerm ne ifthere are enoLgn d fferent oLt nes to test the projected nLmber and m x of

- appl cants and ensue that no items are dLp cated on sLbseqLenl oays

4. a. Assess whether plant-specific priorities (including PRA and iPE insights) are covered in the

G

E

N

E

R

A

-

L

-

Print Na /Signature Date

a. Author .-p [,~ r + /b 5-/+03

b. Facility Reviewer (') h -- ,

c. NRC Chief Examiner (#) k&W[L -

eei<f&(%

d. NRC Supervisor rl/&,c Enflsrw /&

Note: * Not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column "c: chief examiner concurrence required.

24 of 25 NUREG-1021, Draft Revision 9

ES-201 Examination Outline Quality Checklist Form ES-201-2

Initials

Item Task Description I I

pecified in ES-301,

implement an alternate path

b. Facility Reviewer (1' W/A n

c. NRC Chief Examiner (#) &3 2.Mcf/M LrcYrrJze ZizZ

d. NRC Supelvisor L Kkf E u

Note * Not app cao e for h R C oeveloped examinations

P naepenaent hRC revie.ver n val !!erns in Column c chief examiner concdrrence requred

NUREG-1021, Draft Revision 9 24 of 25

m

N

Y-

O

E

.-c0

m

.-c

E

W

w

4

v)

0

a

ri

!

i

i

,

I

r

06/04/2003 13:41 FAX 3013301102 Studsvlk Scandpower La 002

86/84/2683 12: 43 ~72764945 TRAINING PkGE El:!

ES-301 Administrative Topics Outline Form ES-301-1

Administrative Topic Describe activity to be performed

(see Note)

Calculate Reactor Vessel Head Venting Time (New JPM)

Conduct of Operations 2.1.25 (2.813.1)

Perform ECP [CRO-O25A]

Conduct of Operations 2.1.1 0 (plant parameter verification)

(2.713.9)

Maintenance Retest of 1B RHR Pump (New JPM)

Equipment Control WA 2.2.12 3.013.4

~~ ~~

Perform A Shielding Calculation (New JPM)

Radiation Control 2.3.2 (2.U 2.9)

Emergency Plan NIA

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless

!hey are retaking only the administrative topics, when 5 are required.

ES-301 Administrative Topics Outline Form ES-301-1

Facility: Farlev Date of Examination: 5/19-27/2003

Examination Level (circle one): RO /= Operating Test Number: 1

Administrative Topic Describe activity to be performed

(see Note)

Calculate Reactor Vessel Head Venting Time (New JPM)

Conduct of Operations 2.1.25 (2.8/3.1)

Perform ECP [CRO-O25A]

Conduct of Operations 2.1 .IO (plant parameter verification)

(2.7/3.9)

Maintenance Retest of 1B RHR Pump (New JPM)

Equipment Control WA 2.2.12 3.013.4

Perform A Shielding Calculation (New JPM)

Radiation Control 2.3.2 (2.W 2.9)

Emergency Plan Classification of an Emergency Event (New JPM)

2.4.41 (2.3/4.1)

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless

they are retaking only the administrative topics, when 5 are required.

ES-301 Control Room/ln-Plant Systems Form ES-301-2

Outline

Facility: Farlev Date of Examination: 5/19-27/2003

Exam Level (circle o n e ) : m / SRO(I) / SRO(U) Operating Test No.: 1

System / JPM Title Type Code* Safety

Function

a. Shift AFW pump suction to Service Water CRO-239

I DS I 4s

b. Verify Phase B Containment Isolation and Containment Spray MASL 5

Initiation CRO-406B new

c. Two Train Verification of ECCS equipment CRO-406E NEW

d. Restore Instrument Air to Containment-CRO-328B

II NAsL

DASL

II 2

8

e. Perform the required actions for Cold Leg Recirculation DSL 3

CRO-333A

f. Align R-1lFI-12 to normal in response to spurious SI

SRO-343H

g. Perform an emergency boration. CRO-65 New NSA 1

h. Parallel the Main Trubine with the Grid CRO-177A DSL 6

. Makeup to SFP from the RWST SO-130 New R,N 8

. Manual operation of S/G Atmospheric Relief SO-549A D 4s

c. Bleed and Feed Generator for H2 Purity SO-251

I D l 6

' Type Codes: (D)irect from bank M odified from bank, (N)ew, (A)lternate path, (C)ontrol

'oom, (S)imulator, (L)ow-Power, ( AdA "

ES-301 control HOOm/ln-Plant systems Form tS-3072

Outline

Facility: Farlev Date of Examination: 5/19-27/2003

Exam Level (circle one): RO / SROfIL/ SROW) Operating Test No.: 1

~-

Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

~~

System / JPM Title Typecode* I Safety

Function

a. Shift AFW pump suction to Service Water CRO-239

b. Verify Phase B Containment Isolation and Containment Spray

Initiation CRO-406B new

c. Two Train Verification of ECCS equipment CRO-406E NEW

~~

d. Restore Instrument Air to Containment-CRO-3286 DASL I 8

e. Perform the required actions for Cold Leg Recirculation DSL 3

CRO-333A

f. Align R-lI/R-12 to normal in response to spurious SI DS 7

SRO-343H

g. Perform an emergency boration. CRO-65 New

-

h.

In-Plant Systems (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

il. Makeup to SFP from the RWST SO-130 New

j. Manual operation of S/G Atmospheric Relief SO-549A

~~ -~

k. Bleed and Feed Generator for H2 Purity SO-251

D l 6

Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room,

Shmulator. (Uow-Power. ( R K A

ES-301 Operating Test Quality Checklist Form ES-301-3

Facility: Farley Date of Examination: 5119-26/03 Ope1 ng Test Number: 1

I 1. GENERAL CRITERIA

a. The operating teSt conforms with the previously approved outline; changes are consistent with

sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function

distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered

during this examination.

C. The operating test shall not duplicate items from the applicants' audit test(s)(see Section

d. Overlap with the written examination and between different parts of the operating test is within

acceptable limits.

e. It appears that the operating test will differentiate between competent and less-than-competent

applicants at the designated license level.

2. WALK-THROUGH CRITERIA

a. Each JPM includes the following, as applicable:

. initial conditions

' initiating cues

. references and tools. including associated procedures

' reasonable and validated time limits (average time allowed for completion) and specific

designation if deemed to be time crilicai by the facility licensee

' specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical stem and their associated Derformance standards

- restrictions on the sequence of steps. if applicable

I b Repel tion from operating tests used our ng the previous Iicens ng examination IS witnin

acceptaole limits (30% for the wa &.lnro-gh) and do not comprom se tesl integrity

C At least 20 percent of the JPMs on each test are new or sign ficantlf modifed

3 SIMULATOR CRITERIA

a The assoc aled slmJaror operating tests (scenario sets) nave been rev ewe0 in accordance

w th Form ES 301-4and a copy is attached

Date

a Author $7-2/47

o Facility Rev ewer(') NIA h 1

c NRC Chief Exam ner (k) Lee R M erl

d hRC Supervisor

.-

NOTE: * The facility signature is not applicable for NRC-developed tests.

1. Independent NRC reviewer initial items in Column 'c; chief examiner concurrence required.

24 of 27 NUREG-1021, Draft Revision 9

ES-301 Operating Test Quality Checklist Form ES-301-3

aciiity: Farley Date of Examination: 5119-28103 Operating Test Number: 1

I

1.

).

The operating test conforms with the previously approved outline; changes are consistent with

sampling requirements (e& 10 CFR 55.45, operational importance, safety function distribution).

There is no day-to-day repetition between this and other operating tests to be administered

during this examination.

-

w

The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.1.a). W'

1. Overlap with the written examination and between different parts of the operating test is within

acceptable limits.

?. It appears that the operating test will differentiate between competent and less-than-competent

applicants at the designated license level.

2. WALK-THROUGH CRITERIA _.

1. Each JPM includes the following, as applicable:

. initial conditions

. initiating cues

. references and tools, including associated procedures

reasonable and validate0 time mils (average time allowea for compiet'on) ana specific

des:gnatlon 'f deemed 10 oe time cril ca by me facility licensee

I I

spec'Cc performance cr teia that include:

- detailed expecteo aclions w th exact criteria and nomenc a l a e

F.

. system response ana otner examiner cLes

. statements describ ng important observat ons to De made oy the applicant

- criter'a lor successk comp el;on of the tas6

- dentifcar.on of crit'cal steps and mer associated performance standards

- restr ctlons on tne seqLence of steps. if applicable

b. Repet t.on from operat ng tests Lsed auring tne prev'oLs licensing examination 's with!-

F*c

accepta0.e m'ts (30% for the walk-through) ana do not comprom se test integrity

gut.

C. At east 20 percent of the .PMs on each test are new or s gnifcantly mooifed.

3. SIMULATOR CRITERIA ..

1. The assoc atea SimLlator operat ng tests (scenar:o sets) have Deen rev'ewed in accordance w:th

Form ES-301-4 and a copy s attached.

3. Author -7zZ&&+.Ld(L

Printed Name / Signature

• Date

I, Facility Reviewerr)

. NRC Chief Examiner (#)

1. NRC Supervisor

& M fl?J

NIA

Lk& - /Ac 2 &d!!

rnICHltFL E ' E ; d J I W / U E  ?.x

- /- z

4'V/YIO?

\IOTE: * The facility signature is not applicable for NRC-developed tests.

1. independent NRC reviewer initial items in Column '"c;" chief examiner concurrence required.

24 of 27 NUREG-I 021, Draft Revision 9

ES-301 Simulator Scenario Quality Checklist Form ES-301-4

Facility: Fariey Date of Exam: 5/19-26/03 Scenario Numbers: 1 / 2 / 3 Operating

Test No: 1

I

QUALITATIVE ATTRIBUTES

3. Each event description consists of

the point in the scenario when it is to be initiated

the maifunction(s) that are entered to initiate the event

the symptomslcues that will be visible to the crew

he examinationteam to obtain

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator

25 of 27 NUREG-I 021, Draft Revision 9

.. . ..... .. .. . .. ....

ES-301 Transient and Event Checklist Form ES-301-5

OPERATING TEST NO: Crew 1

1 SRO-U

Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution type,

-

(2) Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section

D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal evolutions may be

replaced with additional instrument or component malfunctions on a one-for-one basis

(3) Whenever practical, both instrument and component malfunctions should be included: only those that require

verifiable actions that provide insight to the apaicant's competence count toward the minimum requirement.

Author: 4 -

NRC Reviewer:

26 of 27 NUREG-1021, Draft Revision 9

Reactivity 0

Normal I*

SRO-U Instrument / 2*

Component

Major 1

Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution type.

(2) Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to

Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal

evolutions may be replaced with additional instrument or component malfunctions on a one-for-one

basis.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that

- ..

reauire verifiable actions that Drovide insiaht to the amlicant's cornoetence count toward the

Author:

NRC Reviewer: Lc4lK-k

26 of 27 NUREG-1021, Draft Revision 9

ES-301 Transient and Event Checklist Form ES-301-5

OPERATING TEST NO: Crew 3

SRO-I

As SRO

Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution type.

(2) Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to

Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal

evolutions may be replaced with additional instrument or component malfunctions on a one-for-one

basis.

(3) Whenever practical, both instrument and component malfunctions should be included: only those that

rewire verifiable actions that provide insight to the applicant's competence count toward the

Author:

NRC Reviewer: -K,&W

26 of 27 NUREG-1021, Draft Revision 9

ES-301 Transient and Event Checklist Form ES-301-5

OPERATING TEST NO: Crew 4

Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution type.

(2) Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to

Section D.5.d) but must be significant per Section C.2.a of Appendix D. * Reactivity and normal

evolutions may be replaced with additional instrument or component malfunctions on a one-for-one

basis.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that

require verifiable actions that provide insight to the applicant's competence count toward the

minimum requirement.

Author:

NRC Reviewer:

26 of 27 NUREG-1021, Draft Revision 9

ES-301 Competencies Checklist Form ES-301-6

SRO RO BOP

Competencies CENARIO

2 3

2.3, 2,3.

4.5, 4,6,

and Conditions 6,7 7

Comply With and

Use Procedures (1)

Operate Control

I 2,3,

4,5,

6

1,2.

3.4.

5,6

Boards (2)

Communicate and 1,2. 12, 1.2,

3,4. 3.4, 3,4.

Interact 5.6 5.6, 5,6.

7 7

I

Demonstrate Supervisory 12. 1.2,

3,4. 3.4.

Ability (3) 5,6, 5.6.

7 7

Comply With and 3.4, 2.3,

5,6 4.5

Use Tech. Specs. (3) 5,6

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the

examiners to evaluate every a

/

Author:

NRC Reviewer: -ed k

27 of 27 NUREG-1021, Draft Revision 9

ES-401 Written Examination Form ES-401-6

Quality Checklist

Facility: Farley Date of Exam: 5/30/03 Exam Level: RO/SRC

2the examinationswere developed independently; or

-the licensee certifies that there is no duplication; or

-other (explain)

Bank use meets limits (no more than 75 percent Bank Modified New

I-

6.

&

9-

c

from the bank at least 10 percent new, and the

C .

rest modified); enter the actual RO / SRO-only 43/13 12/6

question distribution(s) at right

7. Between 50 and 60 percent of the questions on Memory C/A

the RO exam are written at the ,. ,

comprehension/analysislevel; the SRO exam

may exceed 60 percent if the randomly selected

WAS support the higher cognitive levels: enter 45/40 55/60

the actual RO / SRO auestion distribution(s) at

9

a. - -

9. Question content conforms with specific KIA statements in the previously

approved examination outline and is appropriate for the Tier to which they are

assigned; deviations are justified

@

10. Question psychometric quality and format meet ES, Appendix B, guidelines

11. The exam contains the required number of one-point, multiple choice items; the

total is correct and agrees with value on cover sheet

&

a. Author -$Judd

b.

c.

Facility Reviewer (*)

NRC Chief Examiner (#)

1. /A

& 2.."ll7cl 4 - L

- -qm

d. NRC Regional Supervisor b e I H C E Q d J ? e v / M . e25 Y./6$3 &&&

Note: * The faciiity reviewer's initialskignature are not applicable for NRC-developed examinations.

5

3 0 0 f 34 .

NUREG-1021,

.

Draft Revision 9

20

r;

c E

c:

w

.

W

>.(A

o?

2

f

%

u

f

v x x x x x v x x x x

2 . 25

i

Y ) '

c

0

c

x

d N

5:z

N W r-

r c

0

c)

u

6

C

a

B

a

U

m w v: w w

v)

a

M

E

(rl

3

3

X

m

zm

r-

3

6

.

2rA

x I

m

-

z

-

N

N

N

e

!28

.E .3

0

w 3

x

x x

x x

m

zz

r- M

N N

..

T

4

m

r-:

w I w c

J

%

t

4 m

-

m

m

m

rn

m I

m

-

m

-r

m

cl

I x

I x

x 1 %

7

L

t

I

-+

m m

_ .

zu z m

r-

'0 '0

- '0

w

.

Zrn v) W w W

0

t

d

c m

I I I

Q\ 0 3 CI m d

vl W W W W W

-

I I I I

I *

rn

d

a

1 0

i o d

d

.

2m 5 rl

x x

I

1

I

Q rn d 7

-

! aeq

00 I

I a

%

a

h

e,

2ce

• 3

0

w

.

2VJ

X

1

x I

+

+m

W

00

i

n Im

-

m

m

00

=

n Ll rA

-

f

X X X x

t

T-

I

-+

cu

a

I

m

a

-

f I

a

a

- 2 00

a

ES-403 Written Examination Grading Form ES-403-1

Quality Checklist

Facility: Date of Exam: Kam Level: ROISRO

Initials

1.

Item Description

Clean answer sheets copied before grading

+- a I b

LM

C

$

2. Answer key changes and question deletions justified and -A LM

documented -

3. Applicants' scores checked for addition errors LM

(reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80 +/- 2% overall and 70 +/- LM

4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades LM

are justified

6. Performance on missed questions checked for training LM

deficiencies and wording problems; evaluate validity of

questions missed by half or more of the applicants -

Printed Name I Signature Date

a. Grader -L. R. Miller/ -6/30/03-

b. Facility Reviewer(*)

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

-N/A

-L. R. Miller/

-G.T. Hopper/

m

/ J

f*I

I , -

The facilitv reviewer's signature is not applicable for examinations araded bv the

5of5 NUREG-1021, Draft Revision 9

ES-501 Post-Examination Check Sheet Form ES-501-1

Task Description Date

Complete

1. Facility written exam comments or graded exams received and 6/6/03

verified complete

2. Facility written exam comments reviewed and incorporated and 6/30/03

NRC grading completed, if necessary

3. Operating tests graded by NRC examiners 6113/03

1. NRC Chief examiner review of written exam and operating test 7/01/03

grading completed

-

3. Responsible supervisor review completed 7/01/03

5. Management (licensing official) review completed 7/03/03

7. License and denial letters mailed 7/03/03

3. Facility notified of results 7/03/03

3. Examination reDort issued (refer to NRC MC 0612) 7/03/03

IO. Reference material returned after final resolution of any TBD

appeals

21 of 23 NUREG-1021, Draft Revision 9