ML032480796

Administrative Topics Outline

Form ES-301-1

inial Submittal

Facility: Oconee

Examination Level (circle one): RO / SRO

Date of Examination: June 16,2003

Operating Test Number:

Administrative Topic

Conduct of Operations

GEN 2.1.23 (3.914.0)

Conduct of Operations

GEN 2.1.3 (3.013.4)

Equipment Control

GEN 2.2.12 (3.013.4)

Radiation Control

GEN 2.3.4 (2.5/3.1)

Emergency Plan

GEN 2.4.38 (2.2/4.0)

Describe activity to be performed

CRO-203, Calculate Final SFP Boron Concentration

OP/1&2/A/I 104/006 C (SFP Makeup), Enclosure 4.9 (SFP

Makeup With DW) (group activity) (new) (10 rnin)

JPM-003, Evaluate Overtime Eligibility

OMP 2-01 Attachment "C", NSD 200 (SRO only)

(25 rnin)

CRO-204, Perform weekly surveillance test to

determine RIA40 setpoint

PT/230/001 End. 13.10 (Operation of RIA-40)

(new) (20 min)

CRO - 205, Calculate the Maximum Permissible Stay

Time Within Emergency Dose Limits (new)

(20 min)

SRO-206, Determine Emergenqy Classification and

'rotective Action Recommendations (SRO only)

group activity) (new)

120 min)

Jote: All items (5 total) are required for SROs. RO applicants require only 4 items

inless they are retaking only the administrative topics, when 5 are required.

NUREG-1021, Draft Revision 9

Control Roomlln-Plant Outline

Form ES-301-2

'inial Submittal

Facility: Oconee

Date of Examination:

Exam Level (circle one): RO l SRO(I) l SRO(U) Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

System / JPM Title

Type Code*

Safety

Function

@ CRO-200, Makeup to the LDST

OP/l103/004 (Soluble Poison Control)

[KA: 004 A4.13 (3.312.911 (new) (15 min)

1

(..&

CRO- 083, Re-establish RCS letdown flow

AP/32 (Loss of Letdown)

[KA: 004 A2.07 (3.4/3.7)] (IO min)

M, A, S

2

c. CRO- 066, Perform Required Actions for RCS Pressure S

3

550 psig EOP End. 5.1 (ES Actuation)

[KA: EPEOll EA1.13 (4.1/4.2)] (15 min)

D, A, S

3 CRO-013, Align MDEFDWP Suction to the Hotwell and

Feed the SGs

D, L, F !L

4s

EOP End. 5.9 [KA: APE054 AA1.01 (4.514.411 (IO min)

'-e.

CRO-201, Restart RCP

--

EOP, Encl. 5.8 [KA: 003 A4.06 (2.9*/2.9)] (new) (20 min)

I

4p

@ CRO-009, Following a Keowee Emergency Start Transfer

from CT-4 to CT-5

OP/O/NI 106/079 Encl. 4.12

[KA: 062 A4.01 (3.3/3.1)] ( I O min)

g. CRO-202, Reset RIA40 setpoints and enter the OAC Pri to

Sec Admin Limit

PT/230/001 Encl. 13.10 (Operation of RIA-40)

[KA: 073 A4.02 (3.7/3.7)] (new) (IO min)

D, L, S

N, S

6

7

@ CRO-114 Align Intake Canal For Recirc On Dam Failure

AP/13 (Dam Failure), [KA: 075 A2.01 (3.0/3.2)] (15 min)

D, L, A, S

8

In-Plant Systems (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

NLO-022, Station ASW Pump Alignment

(last exam) (12 min)

supply power to the SSF ASW and SSF RCMU pumps

, AP/25, [KA: 062 A2.11 (3.7/4.1)] (IO min)

Service Air Header

D

8

AP/32, Encl. "Emergency Start of the Diesel Air Compressor",

[KA: APE-065 AA1.04 (3.5*/3.4*)] ( I O min)

EOP Encl. 5.10 [KA: APE054 AA1.01 (4.5/4.4)]

D. R, L

4s

3 CRO-47, Emergency start SSF Diesel Generator and

0

NLO-007, Start Diesel Air Compressor And Align To

M, A, L

6

Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room,

S)imulator, (L)ow-Power, (R)CA

NUREG-1021, Draft Revision 9

Control Roomlln-Plant Outline

Form ES-301-2

inial Submittal

Facility: Oconee

Date of Examination:

Exam Level (circle one): RO / SRO(I) l SRO(U) Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

-~

System l JPM Title

@ CRO-200, Makeup to the LDST

OP/1103/004 (Soluble Poison Control)

[KA: 004 A4.13 (3.3/2.9)] (new)

N, S

1

T

C

E

-

083, Re-establish RCS letdown flow

AP132 (Loss of Letdown)

[KA: 004 A2.07 (3.4/3.7)]

M, A, S

2

a

CRO- 066, Perform Required Actions for RCS Pressure .S

3

550 psig EOP Encl. 5.1 (ES Actuation)

[KA: EPEOII EA1.13 (4.1/4.2)]

D, A, S

4s

L A

7

CRO-013, Align MDEFDWP Suction to the Hotwell and

Feed the SGs

EOP End. 5.9 [KA: APE054 AA1.01 (4.5/4.4)]

D, L, 9

3. CRO-201, Restart RCP

EOP, End. 5.6 [KA: 003 A4.06 (2.9*/2.9)] (new)

-~

f.

CRO-202, Reset RIA40 setpoints and enter the OAC Pri to

PT/230/001 Encl. 13.10 (Operation of RIA-40)

[KA: 073 A4.02 (3.7/3.7)] (new)

g. CRO-IIA, Align Intake Canal For Recirc On Dam Failure

Sec Admin Limit

N, S

7

\\ AP/13 (Dam Failure), [KA: 075 A2.01 (3.0/3.2)]

D, L, A. S

8

n-Plant Systems (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

0

NLO-022, Station ASW Pump Alignment

EOP Encl. 5.10 [KA: APE054 AA1.01 (4.5/4.4)]

D, R, L

4s

(last exam)

supply power to the SSF ASW and SSF RCMU pumps

AP125, [W 062 A2.11 (3.7/4.1)]

NLO-007, Start Diesel Air Compressor And Align To

Service Air Header

D

8

AP132, Encl. "Emergency Start of the Diesel Air Compressor",

[KA: APE-065 AAI 04 (3.5*/3.4*)]

9

CRO-47, Emergency start SSF Diesel Generator and

M, A. L

6

7. a

Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path,

C)ontrol room, (S)irnulator, (L)ow-Power, (R)CA

NUREG-1021, Draft Revision 9

Control Room/ln-Plant Outline

Form ES-301-2

3 NLO-022, Station ASW Pump Alignment

EOP Encl. 5.10 [KA: APE054 AA1.01 (4.5/4.4)]

(last exam)

inial Submittal

Facility: Oconee

Date of Examination:

Exam Level (circle one): RO / SRO(I) / SRO(U) Operating Test No.:

D, R, L

4s

~

Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

System / JPM Title

@ CRO- 083, Re-establish RCS letdown flow

AP/32 (Loss of Letdown)

[KA: 004 A2.07 (3.4/3.7)]

b CRO- 066, Perform Required Actions for RCS

'

Pressure 5 550 psig EOP Encl. 5.1 (ES Actuation)

[KA: EPEOII EA'f.13 (4.1/4.2)]

a

CRO-202, Reset RIA40 setpoints and enter the

OAC Pri to Sec Admin Limit

PT/230/001 End. 13.10 (Operation of RIA-40)

[KA: 073 A4.02 (3.7/3.7)] (new)

n-Plant Systems (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

Type

Code*

N, S

Safety

Function

2

@ NLO-007, Start Diesel Air Compressor And Align

To Service Air Header

AP132, End. "Emergency Start of the Diesel Air

Compressor", [KA: APE-065 AA1.04 (3.5*/3.4*)]

8

Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path,

C)ontrol room, (S)imulator, (L)ow-Power, (R)CA

NUREG-1021, Draft Revision 9

Operating Test Quality Checklist

Form ES-301-3

1. GENERAL CRITERIA

t-

a.

The operat'ng test conforms w lh the prev.ous {approved OLI :ne; changes are cons'stent wltn

sampling req. rements (e.9.. 10 CFR 55.45, operat ona. importance, safety f.nct on distrnbution).

There is no day-to-oay repetit on between th's and other operating tests 10 De admin'stered

dLr.ng th s examhat on.

Tne operating test shall nor dcpliwte items from the appliwnls' aLo:t test(s)(see Section D.l .a).

Overap w'tn the wrillen exam nat on and Detween different parts of the operat ng lest is w Ih n

acceptable lim'ts.

b

C.

d.

e.

It appears that the operating test will differentiate between competent and less-than-competent

applicants at the designated license level.

2. WALK-THROUGH CRITERIA

_.

a.

Each JPM includes the following, as applicable:

w

. initial conditions

. initiating cues

. references and tools, including associated procedures

reasonable and validated time limits (average time allowed for completion) and specific

designation if deemed to be time critical by the facility licensee

. specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing imporiant observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b.

Repetition from operating tests used during the previous licensing examination is within

acceptable limits (30% for the waltthrough) and do not compromise test integrity.

Printed Name / Signature

Date

a. Author

5-s-J-3 *;

b. Facility Reviewer(*)

c. NRC Chief Examiner (#)

d. NRC Supervisor

44/03

NOTE:

The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column "c:" chief examiner concurrence rewired.

NUREG-102?, Draft Revision 9

Operating Test Quality Checklist

Form ES-301-3

inal Submittal

1. GENERAL CRITERIA

k-

Initials

I

a.

The operating test conforms with the previously approved outline; changes are consistent with

sampling requirements (e.g.. 10 CFR 55.45, operational importance. safety function distribution).

There is no day-to-day repetition between this and other operating tests to be administered

during this examination.

W-

b.

b

C.

d.

The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.1.a).

Overlap with the written examination and between different part9 of the operating test is within

acceptable limits.

e.

It appears that the operating test will differentiate between competent and less-than-competent

applicants at the designated license level.

!$.&

2. WALK-THROUGH CRiTERlA

-

L4

a.

Each JPM includes the following, as applicable:

. initial conditions

. initiating cues

. references and toois. including associated procedures

. reasonable and validated time limits (average time allowed for completion) and specific

designation if deemed to be time critical by the facility licensee

specific periormance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing impoltant observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b.

Repel'l.on from opera1 ng less used dJr ng the previos licens'ng examinat on 's witnin

acceptab e I m m (30% for the walk-lhro-gh) and (10 not comprom se lesi integrity.

At least 20 percent of the .PMs on eacn test are new or s gnifcanl y moa'fed.

w-

C.

w

3. SIMULATOR CRITERIA

..

a.

Tne assouateo simLlator operathg tests (scenario sets) have oeen reviewed 'n accoroance w lh

Form ES-301-4 and a copy s attached.

Printed Name / Signature

Date

a. Author

(63'-Jc@

b. Facility Reviewerr)

c. NRC Chief Examiner (#)

d. NRC Supervisor

NOTE:

The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column "c:

chief examiner concurrence required.

NUREG-1021, Draft Revision 9

/&/ne

C&.L

Simulator Scenario Quality Checklist

Form ES-301-4

QUALITATIVE ATTRIBUTES

Initials

a

b*

c#

1

Tne msa conditions are realist c. in thal some eq!.

pment andlor instr.Imenlation may oe OLI

of

sew ce, but I does not c.e

me operators mlo expected events

1Bwu/

9.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator

performance deficiencies have been evaluated to ensure that functional fidelity is maintained

while running the planned scenarios.

2.

The scenarios consist mostly of related events.

ll%

Y

3.

Each event description consists of:

.

No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the Scenario

without a credible preceding incident such as a seismic event.

the point in the scenario when it is to be initiated

the malfunction(s) that are entered to initiate the event

the symptomslcues that will be visible to the crew

the expected operator actions (by shifl position)

the event termination point (if applicable)

4.

@w

12.

Each applicant will be significantly involved in the minimum number of transients and events

specified on Form ES-301-5 (submit the form with the simulator scenarios).

I

5.

The events are valid with regard to physics and thermodynamics.

\\

fin

6.

Sequencing and timing of events is reasonable, and allows the examination team to obtain

complete evaluation results commensurate with the scenario objectives.

If time compression techniques are used, the scenario summary clearly so indicates. Operators

have sufficient time to carry out expected activities without undue time constraints. Cues are

given.

7.

TARGET QUANTITATIVE ATTRIBUTES (PER SCENARIO SEE SECTION D.5.d)

Actual Attributes

--

_.

I-

I

i

8.

The simulator modeling is not altered.

._

I "

I

i

I O .

Every operator will be evaluated using at least one new or significantly modified scenario. All

other scenarios have been altered in accordance with Section 13.5 of ES-301.

I-

I

13.

The level of difficulty is appropriate to support licensing decisions for each crew position.

I

I^

I

1

1.

Total malfunctions (5-8)

7 I 7 1 7

6.

EOP contingencies requiring substantive actions (0-2)

NUREG-1021, Draft Revision 9

S-301

Simulator Scenario Quality Checklist

Form ES-301-4

QUALITATIVE ATTRIBUTES

Initials

a

b'

c#

1

The in 1 al condir ons are realist c in that some eqL pment ano or mtrmentation may oe OJI of

sew.ce, bL1 it does not cLe the operalors nlo expected events

3.

Each event description consists of:

the point in the scenario when it is to be initiated

the malfunction(s) that are entered to initiate the event

the symptomslcues that will be visible to the crew

the expected operator actions (by Shift position)

the event termination point (if applicable)

4.

No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario

without a credible preceding incident such as a Seismic event.

The events are valid with regard to physics and thermodynamics.

5.

8w M

%

gwv /IK

n

6.

Sequenw'ng and liming of events is reasonable, and allows the examination team to obtain

complete evaluation results commensurate with the scenario objectives.

If time compression techniques are used, the scenario summary clearly so indicates. Operators

have sufficient time to carry out expected activities without undue time constraints. Cues are

given.

7.

%

9.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d). any open Simulator

performance deficiencies have been evaluated to ensure that functional fidelity is maintained

while running the planned scenarios.

IO.

Every operator will be evaluated using at least one new or significantly modified scenario. All

other scenarios have been altered In accordance with Section D.5 of ES-301.

All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit

the form along with the Simulator scenarios).

Each applicant will be significantly involved in the minimum number of transients and events

specified on Form ES-301-5 (submit the form with the simulator scenarios).

11.

12.

I.

I

8.

The simulator modeling is not altered.

n wJ*e 9

UVW

8

I -

I

13.

The level of difficulty is appropriate to support licensing decisions for each crew position.

~

NUREG-1021, Draft Revision 9

Transient and Event Checklist

Form ES-301-5

Normal

Instrument/

Component

OPERATING TEST NO.: 1

I b h m L 9 4

0

1

1,

2*

3,6 2,4

2,3 1,4

Applicant

Type

Reactivity

Normal

Evolution I Minimum I

Scenario Number

0

I *

1

Instrument/

Component

2*

3,6

2, 5

Major

1

1 7 , ~

j

Reactivity

0

Normal

I*

1

Instrument/

Component

2*

3,6

2 4

2,4

Type

I Number I

RO

BOP 8

3

RO -

~

BOP

L

RO ' BOP

-. .

~

SRO

Reactivity

Normal

1

RO

2,3 I&

4

T

I

4*

I

Instrument/

Component

1.4

Major

I

1

I

Reactivity

1

I *

1

5 I

I

I 6

1

2,3 1,4 tti

6, 7 6, 7

As RO

Major

I

1

1 7, 8 I 7,8 I

I 7, 8 1 7.8

SRO-I

As SRO

384

1:(

1.4

SRO-U

5 1

I

Instructions:

(1)

Enter the operating test number and Form ES-D-1 event numbers for each evolution

conditions (refer to Section J.5.d) but must be significant per Sectjon C.2.a of

Appendix D. *Reactivity and normal evolutions may be replaced wlth additional

inntriirnent or cornnnnent malfunctions on a one-for-one basis

Pe. . .

eactivity manipulations ma be conducted under normal or controlled abnormal

(2)

~

~~~~

.r

~.

.~

. . ~.

~.

(3)

Whenever practical, both instrument and componenimaifmctions shoLld be

includea: only those that require ver'faole acrions mat provide insight to the

apalicant's competence count toward the minimum requirement.

Author:

L

NRC Reviewer:

NUREG-I 021, Draft Revision 9

'w

Applicant

Type

a

6, 7 6, 7

Normal

I*

Instrument/

Component

2*

Major

1

Normal

Instrument/

SRO-U

I*

1

2*

293

I

Major

1

1 7 3 I

Transient and Event Checklist

Form ES-301-5

Final Submittal

OPERATING TEST NO.: 1

Evolution

Minimum

Type

Number

Scenario Number

2

I

3

1

SRO

RO I

BOP .:

r

Reactivity

Normal

I 3 , 5 I 2 , 4

Instrument/

Component

Major

1

6

1

I

Reactivity I

I *

1

~

1

Instrument/

3,5 2,4

Component

AsRo I

Major

7.8 7,a

I

Reactivity

1

0

I SRO-I

I

1

2'3

4,5

6

~

7, a

As SRO

I

Reactivity I

0

Component

4,5

6

Instructions:

(1)

Enter the operating test number and Form ES-D-1 event numbers for each evolution

conditions (refer to Section J.5.d) but must be significant per Section C.2.a of

Appendix D. *Reactivity and normal evolutions may be replaced with additional

instrument or component malfunctions on a one-for-one basis.

Whenever practical, both instrument and component malfunctions should be

included; only those that require verifiable act!ons that provide insight to the

pe. . .

eactivity manipulations ma be conducted under normal or controlled abnormal

(2)

(3)

icant's competence count toward the minimum requirement.

i/

Author:

NRC Reviewer:

NUREG-1021, Draft Revision 9

I N I f / 4 L

/-dZ

Form ES-301-6

Competencies Checklist

RO

BOP

L

SCENARIO

2

3

1

2

3

1

2, 3

4, 5

6. 7

3, 5

6, 7

8

2, 3

5, 6

8

2.3

5.6

7

2,4

7. 8

2,3

Interpret I Diagnose

4, 5

Events and Conditions

6,7

8

3,4

Comply With and

5,6

Use Procedures (1)

7,8

Operate Control

Boards (2)

2,4

5, 6

7

3, 5

6, 7

8

2, 3

5, 6

7

la, I b

4, 5

3, 5

6, 7

8

2,3

5,6

7. a

2. 3

5, 6

7

1,2

4, 7

8

Communicateand

1 F!

Interact

3,4

Demonstrate

Supervisory

5, 6

Ability (3)

7, 8

la, I b

2,3

4, 5

6 7 , 8

3,4

5 6

7. a

2,3

4, 5

6, 7

8

2,3

4, 5

6. 7

Ib, 2

3,4

5,6

7,8

5

2

3

Comply With and

Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Onlv armlicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to

evaluate every applicable competency for every applicant.

Author:

-NRC

Reviewer:

NUREG-I 021, Draft Revision 9

'L

L

SCENARIO

Final Submittal

SCENARIO

Competencies Checklist

Form ES-301-6

Competencies

Interpret / Diagnose

Events and Conditions

Comply With and

Use Procedures (1)

Operate Control

Boards (2)

Communicate and

Interact

~

Demonstrate

Supervisory

Ability (3)

Comply With and

Use Tech. Specs. (3)

1

2.3

4,5

6, 7

8

3.4

5, 6

7, 8

3

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

2

1

3

Ib. 4

1,4

5, 6, 8

6, 7

6.7

4,5

4. 5

6, 7 I

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to

evaluate every applicable competency for every applicant.

Author:

J

NRC Reviewer:

NUREG-1021, Draft Revision 9

Final Submittal

Written Examination

Form ES-401-6

Quality Checklist

Date of Exam: 06/27/03

Exam Level: SRO

acility:

Oconee Nuclear Station

-

the audit exam was systematically and randomly developed; or

-

the audit exam was completed before the license exam was started; or

comprehension/analysis level; the SRO exam

may exceed 60 percent if the randomly selected

WAS S U D D O ~ ~

the hiaher cognitive levels; enter

the actual RO / SRE) question distribution(s) at

(32%)

(68%)

'

right

Referenceslhandouts provided do not give away answers

Question content conforms with specific WA statements in the previously

approved examination outline and is appropriate for the Tier to which they are

8.

9.

$w

assigned; deviations are justified

1

10.

11.

Question psychometric quality and format meet ES, Appendix 6, guidelines

The exam contains, the required number of one-point, multiple choice items; the

total is correct and agrees with value on cover sheet

I

Printed Name I

Signat re

a. Author

b. Facility Reviewer (3

/A/

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor

Michael E. Ernstes

EL;.6-

Larry S. Mellen ip.- LA S d ,

Ronald F. Aiello 1 Hw

Note:

The facility reviewer's initialslsignature are not applicable for NRC-developed examinations.

Independent NRC reviewer initial items in Column '"c;" chief examiner concurrence required.

300f 34

NUREG-1021, Draft Revision 9

Final Submittal

Written Examination

Form ES-401-6

Quality Checklist

Facility:

Oconee Nuclear Station

Date of Exam: 06/27/03

Exam Level: RO

Initial

Item Description

1.

2.

Questions and answers technically accurate and applicable to facility

a. NRC WAS referenced for all questions

b. Facility learning objectives referenced as available

SRO questions are appropriate per Section D.2.d of ES-401

Question selection and duplication from the last two NRC licensing exams

appears consistent with a systematic sampling process

Question duplication from the license screeninglaudit exam was controlled as

indicated below (check the item that applies) and appears appropriate:

-

the audit exam was systematically and randomly developed or

-

the audit exam was completed before the license exam was started or

X- the examinations were developed independently; or

-the

licensee certifies that there is no duplication; or

3.

4.

5.

-

other (explain)

Bank use meets limits (no more than 75 percent

from the bank at least 10 percent new, and the

rest modified); enter the actual RO I SRO-only

auestion distribution(s) at right

6.

7.

Between 50 and 60 percent of the questions on

the RO exam are written at the

comprehensionlanalysis level; the SRO exam

may exceed 60 percent if the randomly selected

WAS support the higher cognitive levels; enter

the actual RO I

SRO question distribution(s) at

right

Memory

(44%)

(56%)

'p

I

6.

Referenceslhandouts provided do not give away answers

\\a

9.

Question content conforms with specific WA statements in the previously

approved examination outline and is appropriate for the Tier to which they are

assigned; deviations are justified

Question psychometric quality and format meet ES, Appendix E, guidelines

The exam contains, the required number of one-point, multiple choice items; the

total is correct and agrees with value on cover sheet

I O .

11.

Printed Name I

Signat

Date

a. Author

Larry S. Mellen

c. NRC Chief Examiner (#)

Ronald F. Aiello / /&

b. Facility Reviewer (3

/

d. NRC Regional Supervisor

Michael E. E r n s t e d h A / E-

6(/r/ol

Note:

The facility reviewer's initialskignature are not appl:cable for NRC-developed examinations.

Independent NRC reviewer initial items in Column "c: chief examiner concurrence required.

300f 34

NUREG-I 021, Draft Revision 9

,

N ,

fl4L

roJ Mia#?@

Written Examination

Form ES-401-7

Quality Checklist

u y

7.

I Between 50 and 60 percent of the questions on I

Memory

CIA

Facility: Oconee Nuclear Station

Dateof Exam: 061

03

Exam Level: SRO

I

Referenceslhandouts provided do not give away

approved examination outline and is appropriate for the Tier to which they are

Question psychometric quality and format meet ES, Appendix B. guidelines

8.

answers

9.

Question content conforms with specific KIA statements in the previously

assigned; deviations are justified

IO.

11.

"

&The exam contains 25, one-point, multiple choice items; the total is correct and

Item Description

I

A

I

h

9

b

-I

\\B

s that there is n

percent from the bank at least 10 percent new,

and the rest modified);

enter the actual question twNi ~ , ~ a i ~ ~ 9 4 ~

1

the exam are written at the

comprehensionlanalysis level; enter the actual

question distribution at right

I

Printed Name lignaturq

Date

a. Author

5/7/3

b. Facility Reviewer r)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Michael E. Ernstes

Note:

The facility reviewer's initialslsignature are not applicable for NRC-developed examinations.

Independent NRC reviewer initial items in Column "c:" chief examiner concurrence required.

a,

$ n o Liwm MA/'

E f i c m Q Z 68 9,

y,

r,q ,a p#,>r ~ K d m

coflm*'ws I

U

~

orp p4:-f

r * u ~ p , p ? ~ n ~ a ' e

7-3

c/9

, , + r i g ~

s u ~ * . M '

Written Examination

Form ES-401-7

Quality Checklist

Facility: Ownee Nuclear Station

Dateof Exam: 061

03

Exam Level: RC

I

indicated below (check the item that applies) and appears appropriate:

-

the audit exam was systematically and randomly developed; or

z t h e examinations were developed independently; or

the audit exam was completed before the license exam was started; or

6.

Bank use meets limits (no more than 75

percent from the bank at least 10 percent new,

Date

a. Author

5 7 2 h

b. Facility Reviewer C)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Michael E. Ernstes

Note:

The facility reviewer's initialslsignature are not applicable for NRC-developed examinations.

Independent NRC reviewer initial items in Column '"c:" chief examiner wncurrence required.

c

u

ii

q c e C

m

A

W

Written Examination

Form ES-401-9 (R8, SI)

Review Worksheet for Oconee Nuclear Station (Initial)

Q#

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

LOK

LOD -

(C/M) (1-5) Stem Cues T/F

Cred. Partial Job- Minutia

/

Back- Q= SRO U/E/S

Explanation

Focus

Dist.

Link

units ward

KIA Only

~

~~

~.

~

,

~

,

~

~,~

~

.

~

The stem lacks sbffident focus to elicit the correct answer (e.g.. unclear intent, more information is needed, or too much needless information)

The Stem or distractors contain cues (;.e., clues, specific determiners. phrasing, length, etc).

The answer choices are a collection of unrelated trbe/false statements

3#

~

~~

~

~~

More than one distractor is not credible.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem),

The question is not linked to the job requirements &e., the question has a valid WA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from

memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

4.

Check the appropriate box if a job content error is identified:

5.

6.

Check auestions that are samuled for conformance with the approved WA and those that are desisnated SRO-only (WA and license level mismatches

are unacceptable).

Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or

(S)atisfactory?

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

LOK LOD

(C/M) (1-5) Stem Cues T/F Cred. Partial Job- Minutia

/ Back- Q= SRO u/E/S

Explanation

Focus

Dist.

Link

units ward WA Only

7.

At a minimum, explain any U ratings (e.g., how the Appendix 6 psychometric attributes are not being met).

c

3

c

4

c

3

c

3

c

3

c

3

c

3

c

3

c

3

M

3

M

3

c

3

/

_ _ _ ~ ~

3. Psychometric Flaws

Back.

--

Stem Cues TIF

Jist. I

X

4. Job Content Flaws

-

ob-

dinutia

-

dother

6.

7.

UIEIS 1

-

E

II

Explanation

E

-

U

-

S

U

-

E -

E

S

~000028AK1.01

II

3. Psvchometric Flaws -

'ark

4. Job Content Flaws ' -

-

&'Other

6.

7.

UIEIS I

Explanation

-

U

-

U

I

II

3. Psychometric Flaws

,tern Cue: 7

1

4. Job Content Flaws\\

Minutia -

-

(Other

6.

7.

Explanation

-

U

-

U

00402.4.11

This question has nothing to do with knowledge of abnormal

condition procedures.

-

U

E

U

-

U

S

007K1.03

I1

12

L3

$4

15

46

47

48

Ainutia -

c

M

c

M

--

C

c

'/ Back- Q= SRO

UIEIS

Explanation

Y

N

Y

N

Y

N

Y

N

Y

N

Y

N

S* 1 ? s l k c k to see if the backup string is off of the vital

11

3. Psychometric Flaws

S

4. Job Content Flaws

EW/E13EA2.1

pip

unit!

S

11

G2.1.11

6. I

S

7.

62.1.32

,.- II

S

G2.1.6

UIEIS I

Explanation

-

U

I

E

U?

I Is this 0

a < 1 hr TS?

II

3. Psychometric Flaws

/M)

(1-5) Stem Cues

Focus

X

4. Job Content Flaws\\ -

-

Other

6.

U/E/S

~~

7.

Explanation

S

lG2.3.2

II

S

lG2.4.12

II

S

U

S'

37 Yellow: An enhancement is required or question needs dispositioned

before ONS receives.

47 Red: Implausible questionidistractors, WA is wrong, Question has a

technical issue.

16 Green: None to very minor enhancements.

Question requires Utility input

Written '&..dination

Final Review Worksheet for Oconee Nuclear Station

With Validation Comments in /talks

Form ES-,_ /9

Draft Revision 9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

Q#

LOK

LOD

(cw (1-5)

U/E/S

Explanation

Stem Cues T/F

Cred. Partial Job- Minutia

/

Back- Q= SRO

Focus

Oist.

Link

units ward

WA Only

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

Check the appropriate box if a psychometric flaw is identified:

8 The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

e

The stem or distradors contain cues (Le.. clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated truelfalse statements.

. One or more distractors is not credible.

. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).

. The question requires the recall of knowledge that is too specific for the closed reference test mode (Le.. it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are

unacceptable).

Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or

(S)atisfactory?

7. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

1.

2.

3.

4.

5.

6.

Page 1 of 12

3. Psychometric Flaws

4. Job Content Flaws

q-mxqw

units

/

i. Other I 6. I

7.

4 I

Explanation

nlyl

I

IESTIONS

S

000003G2.4.1

No utility comments.

Changed correct answer to "C". Modified "C" and

" B to ensure only one correct answer. Verified

resuonse on simulator. Changed to RO Question.

U

000008AA2.22

-

ICE 'concurred.

I S ~000009G2.1.31

No utility comments.

Attachment required:

EOP Encl. 5.1 Page 5, Figure 1 (Required HPI Flow

Per Header) CE concurred.

EOP has changed and ONS no longer bumps

RCPs.

Replaced with Bank question 164. CE concurred.

KA does not match. KA is for a LBLOCA. At ONS

we have Boiler Condenser cooling instead of

Reflux Boiling. 200 gpm leak will not saturate the

plant. Added SBLOCA to stem. TA and TB

Switchgear locked out added to stem to eliminate

cue in stem that made "C" and " D

not plausible.

Chanaed to SRO onlv. Changed to KA

X

E

000009EA2.15

U

000009EK1.01

X

U

OOOOIIEK1.01

No utility comments.

Page 2 of 12

,

X

E

000025AK3.01

Added SEE A'ITACHMENT

pachment: Page 27 of 29 of EOP tab TBF. SRO

E

Modified stem to remove reference to Immediate

Manual Actions because entering an AP is not an

Immediate Manual Action. Reworded distractors to

000027AK1.01

Added "indication" to stem. Suggest cog level is

CIA. CE concurred.

Added "indication" to PZR Saturation

readability. CE concurred.

dded Drocedure titles to AP/20 and AP/25.

E

U

E

U

concurred.

000028AK1.01

Added "slowly increasing" to stem and "A" and "B

choices. Pressure would slowly increase if PZR

level is increasing. Changed to KA 000028AK2.02

CE concurred.

000029EA2.09

EOP no longer has a limit on SO level during UNPP

Replaced modified bank question 199. CE

concurred. Changed to RO.

000029EK3.12

Editorial changes to match current EOP

designations. CE concurred.

000033AA2.11

ONS no longer has Intermediate Range detectors.

KA no longer applicable to ONS. Suggest new KA

000036AA2.02. Replaced with new question. CE

concurred.

Pressure.

00028AA2.01

dded "with SASS in auto" and "due to an internal

F

insure " D is the only correct answer. CE

power failure" to stem to clarify question and to

Page 3 of 12

S

E

S

U

lnew question that matches KA. CE concurred.

c 1000056AA2 47 ONS has hydro electric versus

\\J

000038EA1.19

No utility comments.

Added "?A Main FDWpump operating"to stem t8

clarify plant status.

000040AA2.1

Removed refer to attachment. Attachment not

required. Removed tab letter designations from

distractors, not used at ONS. Changed " B

to "Los!

of Subcooling Margin" to reflect ONS EOP tab. CE

concurred.

000051AA2.02

No utility comments.

000054AK3.03

Replaced question because EFDW valve

controllers have been replaced and no longer

operate as the question assumes. NO longer an

AP119, information moved to EOP. Bank CF025004

CE concurred. CE concurred.

000055EA2.01

Question does not meet the KA. Question deals

with cycling TBVs due to emergency CCW flow

during a blackout. The KA specifies valve position

during a loss of IA as a result of a blackout.

Conditions stated in question are no longer

addressed in current procedure. Replaced with a

v

E

U

Page 4 of 12

EDGs. Therefore, CE determined this KA

acceptable because ONS load sheds up front vs

sequencing loads. Intent of KA met.

0000576.2.1.8

Remove "RPS Channel testing is also due during

your shift" from stem. Has no bearing on question.

Attach reference OP/3/A/l107/004, Enel. 4.15

(System Drawing) CE concurred.

000057M1.06

ICs has been upgraded and loss of KI no longer

requires use of Aux Shutdown Panel. Replaced

with bank question STG636. CE concurred.

H

4

F

2

H

3

X

F

2

F

3

F

2

H

3

F

3

H

4

H

3

E

00059AK3.01

dded (LPSW DISCH) to stem. CE concurred.

00061K1.01

No utility comments.

U 000062AA1.07

Operability determinations are performed by SROs.

+------

ReDlaced with modified bank auestion 605 that

meets KA. CE concurred.

Added "requiring activation of the SSF" to stem to

ensure proper path in the AP. CE concurred.

E

000067G2.4.27

S

000067AK3.04

U 001A2.13

No utility comments.

Two correct answers ("B and "D"). Replaced with

new question. CE concurred.

Added procedure title. Changed "returned to

service" to "restarted" to clarify stem. Changed

RHR to DHR. Made Units designations match in

E

003K5.04

-

btem. CE concurred.

LJ

1003A3.02

-

~

Instrumentation mentioned in question is not

monitored by the operator. Replaced with bank 162

CE concurred.

Need procedure number from facility

Reworded stem to improve readability. Added

procedure number and title. CE concurred.

E

004G2.4.11

Page 5 of 12

U

004K2.02

,_

Does each ACB have its own transfer switch? If

so, should switch be switches? Should is in

AUTO be Are in AUTO

The question concerned how aux power was

supplied to the Keowee units. The KA concerned

the power supply to the RCS Makeup pumps. Wrotc

a new question that matched the KA. CE

concurred.

No utility comments.

Removed the following bullets LPI H D R IA

INJECTION FLOW LO alarm (01A1310) LPI

H D R 18 INJECTION FLOW LO alarm (01A1311

from stem. They will not alarm unless ES has

actuated.

S

00662.1.7

Reworded stem and answers to improve

readability. CE concurred.

No utility comments.

Corrected question by rewording stem, C and D

choice. ONS does not have auto isolation of CC to

individual RCPs. In D with CC-718 closed there

would be no CC flow. CE concurred.

S

005K3.07

S

006A4.05

S

007K1.03

U

008A201

S

008A4.01

E

Page 6 of 12

E

S

U

S

IJ

S

I-

/

011K3.02

The status of SASS is required to answer this

question. Added "with SASS in manual" to stem.

CE concurred.

012K5.01

No utility comments.

012K6.04

Question assumes only one SID Bypass Key

Switch. Each RPS Channel (4) has a SID Bypass

Key Switch. Question reworded, modified stem and

rewrote all distractors. CE concurred.

013A1.06

No utility comments.

013K3.03

Reworded stem for clarification. CE concurred.

015G2.1.32

No utility comments.

016A2.01

Question concerned SASS operation with a failure

of Thot. SASS no longer swaps Thot. Thot is now

median selected. Wrote new question on failure of

PZR temperature and SASS. CE concurred.

022A1.04

Original KA not applicable. Changed to KA

08K3.02. CE concurred.

H

3

F

3

H

3

H

4

H

3

F

3

H

3

F

2

F

3

H

3

F

3

F

3

Page 7 of 12

S

E

02662.1.27

No utility comments.

026K3.01

No utility comments.

029K1.04

No utility comments.

03462.1.27

RO duties during refueling no longer include

activities in the RB or SFP. Therefore the KA was

changed to 034GEN2.2.27. Replaced with modified

bank question 359. CE concurred.

E

Iconcurred.

S b56A2.04

v

35A4.05

Caps and bolded KEY. Added "with a subcooled

RCS" to stem to clarify plant conditions. CE

concurred.

Added 'Yo prevent overcooling" to stem to clarify

question. This question is written based on an

ONS plant event. This event concerned

overcooling during a low decay heat natural

circulation. During normal approach to natural

circulation, "C" would be correct.

\\No utility comments.

S b59A1.03

S

E

INO utility comments.

U 1061A3.01

039K1.02

No utility comments.

Changed the word 'Tinoperative" to

'Tnoperable" in the stem to match ONS

terminology.

039K5.01

Modified stem to improve readability. CE

concurred.

055A3.03

Reworded "C" to improve plausibilitv. CE

U

Page 8 of 12

Question no longer correct due to plant mods. KA

does not match. Replaced with bank question 43 to

match KA. Requires memorization of procedure.

CE concurred.

061K6.01

Original question had FDW-3151316 failing open.

Question explanation discussed ARC valve failure.

No correct answer. Wrote new question to address

ARC valve failure with a correct answer.

CE concurred.

U

062K4.02

Jlncorrect logic for "c**

LPI pump start. No auto star

- /

062A2.10

Does the gauge have power? If so, could " B be

correct?

CE: Facility check to make sure distractor "8" not

correct also.

Question setup not plausible. I&E working in an

electrical cabinet would not affect the air supply to

the MS gauge. Does not match KA. Replaced with

bank question 735 that matches KA. CE concurred

on "C" LPI pump. Rewrote-stem and distractors to

make correct. Changed cog level to CIA.

CE concurred.

INO utility comments.

U 1063K2.01

.

S

E

S

U

~~~

~.

In stem loss of power was to aux oil pump not the

TDEFDW Pump. Tripping throttle valve would stop

all steam flow to turbine. No correct answer.

Rewrote answer choices to ensure a correct

choice. Added Aux oil pump to stem to clarify what

lost power. CE concurred.

064K4.03

No utility comments.

071K4.01

Capped and bolded NOT in the stem. Added

"initially" to "D". CE concurred.

075K1.01

No utility comments

076A2.01

Not required for the operator to have this

information memorized. This question would

require 4 attachments. This information is in the

OP L&P because of complexity of operability

determination. If the OP is given it would be a

direct lookup. Replaced with new question.

API024 (Loss of LPSW) is the procedure used to

mitigate the consequences of this malfunction. CE

concurred.

Page 9 of 12

'F

F

2

F

2

F

2

X

3

F

3

H

3

F

3

H

4

H

3

H

3

H

3

S

078K1.04

-

hanged cog level to CIA. CE concurred.

U

E

S

E

S

U

S

U

E

078K3.02

Ldded (IA and AIA) to stem to clarify question. CE

II

concurred.

079A2.01

At ONS IA does not backup SA. Original KA is not

applicable. Changed KA to 014A1.02. Replaced witt

bank question 367. CE concurred.

086K4.03

This question requires the recall of knowledge that

is too specific for the closed reference test mode.

Wrote new question. CE concurred.

BW/AOIAA1.2

Added delta to "A". Modified "C" to match "B. CE

concurred.

BW/AO4AA2.2

No utility comments.

BW/A05AK2.1

SSF Diesel Generator will not tie to the grid

but can tie to Unit 2's MFB #2. Added "Unit 2'!

MFB #2" to stem to match our nomenclature.

CE concurred.

Underlined "emergency" to emphasize start

method.

BWlEOZEK2.2

No utility comments.

BW/E04EK2.2

Three correct answers. A, B, and C. Modified " A

and "B" to make incorrect. CE concurred.

BW/E04EK3.3

No utility comments.

BW/E08G2.4.18

Answer incorrect. Modified stem and distractors tc

improve readability and make "A" correct. Added

ONS specfic nomenclature. CE concurred.

Added "controller" to "0"

to clan@ location of

manual control.

Page 10 of 12

~~

S

E

BWlE13EA2.1

x

i

No utility comments.

Changed "C'?

to read "tab SA (Subsequent

Actions) I' to match current EOP nomenclature.

Added "(HPI)" to D. This is the Rule 6 title.

G2.1.11

Is this Q a c I hr TS?

CE: faci/ity verify this Q is c I hr TS, ofhewise

G2.1.12.

Original question did not meet KA GEN 2.1.11.

Selected bank question to meet KA GEN 2.1.11.

CE concurred.

G2.1.14

Added (s) to notification to indicate one or more

notifications. CE concurred.

In the stem changed "RO supervising" to rea

%perator overseeing" because RO do not

bupervise.

S IG2.1.27

3 e F

84

85

86

87

88

89

90

91

92

-

F

H

F

H

F

H

Page 11 of 12

S

E

No utility comments.

G2.1.32

No utility comments.

G2.1.6

No utility comments.

G2.2.12

No utility comments.

G2.2.17

Removed "You are the Plant Supervisor." from

stem not required to answer the question.

Reworded stem to improve readability. CE

concurred.

G2.2.2

Changed stem to "FDW Calibrating Integral" due tq

new ICs. Changed "Bailey" to "Master" in " D to

match current plant designations. CE concurred.

G2.3.2

Added "SEE ATTACHMENT" Alara Manual

Appendix "C" Section 4.4 (General Dose Reductio]

Methods) CE concurred.

S

E

U

E

v

x

_.

J

4

J

X

J

X

i/

G2.3.3

No utility comments.

G2.4.12

No utility comments.

G2.4.23

No utility comments.

G2.4.25

Cog level change to memory. CE concurred.

G2.4.3

Redesigned the stem to improve readability.

Added "ES' to the stem. Added "and 2 have

actuated" to stem to make "C" correct and "D'

plausible. CE concurred.

G2.4.41

Added "SEE ATTACHMENT" to stem. CE

concurred.

G2.4.6

The question requires the recall of knowledge that

is to specific for the closed reference test mode.

Replaced with bank question 190. CE concurred.

G2.4.7

Added "RCP to stem. Should be SRO question

because it is asking for actions of the procedure

director who is an SRO. Cog level should be CIA.

CE concurred.

"1

F

4

F

2

H

2

Page 12 of 12

F

3

H

4

F

3

F

3

ES-403

Item Description

Written Examination Grading

Form ES-403-1

Qualitv Checklist

a

Facility:

Oconee Nuclear Station

Date of Exam: 06/

03

Exam Level: RO

Initials

2.

Clean answer sheets copied before grading

(LXRTest machine graded)

Answer key changes and question deletions justified and

documented (No changes or deletions were made)

Applicants' scores checked for addition errors

(reviewers spot check > 25% of examinations)

(LXRTest machine graded)

Grading for all borderline cases (80% +/- 2%) reviewed in

detail

(No failures or borderline cases)

All other failing examinations checked to ensure that grades

are justified

(No failures or borderline cases)

Performance on missed questions checked for training

deficiencies and wording problems; evaluate validity of

questions missed by half or more of the applicants

2.

3.

4.

5.

6.

Printed Name / Signature

a. Grader

Ronald F. Aiello 4-

b. NRC Reviewerr)

Gerard W.

Laska /A

c. NRC Chief Examiner (*)

Ronald F. Aiello

d. NRC Supervisor (*)

NIA *

-

NIA 2

9

%

h

-