ML051440166

Initial Exam - 12/2004 - Public Forms

ML051440166
Person / Time
Site:	Palo Verde
Issue date:	01/19/2005
From:	Gody A Operations Branch IV
To:	Overbeck G Arizona Public Service Co
References
50-528/04-301, 50-529/04-301, 50-530/04-301 50-528/04-301, 50-529/04-301, 50-530/04-301
Download: ML051440166 (12)

Text

v) a, 0

z c -

a, a,

Q m o c

S E n o 0

Q 0

v) a, c

L n

a, m

a, S

c n

n -

-,?-

CI) w 7

mi 7

cu 0

X W

Z a..

b f 3

i:

a, 0

3

ES-701 LSRO Examination Outline Quality Checklist Form ES-701-5 Facillt)l Item

1.

W R

I T

T E

N

2.

0 P

E R

A T

I N

G

3.

G E

N E

R A

L Date of Examination:

Task Description

a.

Verify that the outline fits the model in accordance with ES-701.

b.

Assess whether the outline was systematically and randomly prepared in accordance with Section D.l of ES-401 and whether all KIA categories are sampled at least once.

Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

c.

d.

Assess whether the justifications for deselected or rejected K/A statements are appropriate.

a.

Verify that the overall operating test:

(1) includes at least two tasks that require the use of technical specifications (2) does not duplicate any tasks from the applicants audit test(s)

Verify that the administrative tasks:

(1) are distributed among the four administrative topics described in ES-301 (2) include no more than one repeat from the last two NRC licensing examinations (3) include at least one task that is new or significantly modified Verify that the systems walk-through includes:

(1) two tasks requiring the manipulation of fuel handling equipment (2) two additional tasks related to Tier 2 systems other than fuel handling equipment (3) two tasks requiring implementation of alternative path procedures (4) no more than one repeat from the last two NRC licensing examinations (5) at least one task that is new or significantly modified Verify that the E1APE walk-through includes:

(1) three JPMs based on the Tier levolutions, including a refueling accident (2) one task requiring implementation of an alternative path procedure (3) no more than one repeat from the last two NRC licensing examinations (4) at least one task that is new or significantly modified Determine whether there are enough different outlines to test the projected number of applicants and ensure that no items are duplicated on subsequent days.

Assess whether plant-specific priorities (including PRA and IPE insights) are covered inthe appropriate exam section.

Assess whether the 10 CFR 55.41143 and 55.45 sampling is appropriate.

Assess whether the sampling process adequately considered plant-specific refueling components, systems, and procedures that are not included in the generic models.

Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5.

Check for duplication and overlap among exam sections.

b.

e.

d.

e.

a.

b.

c.

d.

e.

f.

Check the entire exam for balance of coverage.

g.

Assess whether the proposed sample is consistent with the LSROs job responsibilities.

Printed Name 1 S ature

a.

Author

?h:[I:, G. L+&+-r-j

b.

Facility Reviewer (*)

b r r m A b Po+ r :/ u&%&&

c.

NRC Chief Examiner (#)

d.

NRC Supervisor Note:

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

i I

I I

I I

I I

I I

I ES-701, Page 15 of 18

LSRO Written Examination Form ES-701-6 I

Qualitv Checklist I ES-701 Item Description

1.

Questions and answers are technically accurate and applicable to the facility.

I a

b*

c#

.w-d

• fl I

I I

I I

I I

I I

I I

I I

I I

I Facility:

Date of Exam:

Initial I

I

2.

a.

b.

NRC WAS are referenced for all questions (as applicable).

Facility learning objectives are referenced as available.

icensing exams

5.

Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed the audit exam was completed before the license exam was started

?i: the examinations were developed independently the licensee certifies that there is no duplication other (explain)

I I

I b

6.

Bank use meets limits (no more than 30 questions Bank Modified New 27%

I from the bank, at least 4 new, and the rest modified);

enter the actual question distribution at right.

11.

The exam contains 40 one-point, multiple choice items; the total is correct and agrees with value on cover sheet.

Date

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Note:

• The facility reviewers initialslsignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-701, Page 16 of 18

ES-701 LSRO Operating Test Quality Checklist Form ES-701-7 Facility:

Date of Examination:

Operating Test Number:

Item Description

1.

The operating test conforms with the LSROs job responsibilities and the previously approved outline (Form ES-701-4).

Any changes from the previously approved outline have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations) specified on the outline.

There is no day-to-day repetition between this and other operating tests to be administered during this examination.

The operating test does not duplicate items from the applicants audit test(s).

(See Section D.1.a of ES-301).

Overlap between the written examination and the operating test is within acceptable limits.

It appears that the operating test will differentiate between competent and less-than-competent

2.

3.

4.

5.

6.

7.

Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable Printed Name I Signature

a. Author

b. Facility Reviewerr)

c. NRC Chief Examiner (#)

d. NRC Supervisor Initial NOTE:

• The facility signature is not applicable for NRC-developed tests.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-701, Page 17 of 18

PVNGS Written Examination Grading Quality Checklist PVNGS Form ES-403-1 Facility: PVNGS December 13 2004 LSRO Written Examination Item Description

1. Clean answer sheets cotied before rzradinp

2. Answer key changes and question deletions justified and documented.

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80% +/- 2% overall and 70 or 80, as applicable, +/- 4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants

a. Grader Printed Name / Signature Initials Date

b. Facility Reviewer (*)

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

(*)

The facility reviewer's signature is not applicable for examinations graded by the NRC: two independent NRC reviews are required.

m v,

12..

8 L

w a

-1 W

I 2

0-

[r 3

I m

O d

0 0

cu T-w a

-I w

I 2

I n

U 3

I m

0 d

0 0

cu 7

d d

d 8

8 2 2 ? 5 o

a o

0 0

0 Ki Y

U a

I W" rr 4

Q a

s?

7 0

0 0

cu F:.

03 cu m

0 0

0 m m O b

.cu a 8

% x a m ?

P O d

0 0

0,

?!

?!

F -

Ki a

Y U

I W"

5 I

Q E

n 7

0 m

d 0

0 cu.

vj Y

U a

I W" rr P

Q E

n 7

0 m

d 0

0 cu.

oj Y !I a

I W-n:

a I

LL LL LL K

E 2 Ki Y

U a

2 W-5 I

LL LL LL C

TI E

a r-Y 7

7 0

0 m

m d

d 0

0 0

0 N

N o

c n

m m

cu 0

0 0

0 0

0 m a m m urn O b O b O b

.cu

.cu

.cu z

d s

a 8 a,&!

a,N E x E x E E a,.. a,.. a,..

vj Y

a:

a H

W-LL LL LL C

E 2 F

0 m

d 0

0 cu.

0 m

In 0

0 0

m a O b

.cu $8

$ X m a 8

2

$1 Y

P O Ql-d.

uj Y

CT W"

U 9

5 0

0" 7

0 m

d 0

0 cu.

a, cu m

0 0

0 m m O b

.cu $ 8 k X O O m a ni-d 0

0 0

c!

2 7

Ki Y

U a

I W-5 I

0 0"

7 0

m d

0 0

cu.

Ki a

Y a:

H W-0 0

n 7

0 m

d 0

0 cu.

a 0

0 0

0 0

0 0

m m mu3 O b O b

.cu

.cu 2 s :

a,%

E x P x m a z a n + ni-a,.. a,..

P O O O J

J a

0 b

O O

b 0

0 0

0 0

0 Q

Q

> F J

a..

In m

m Lf!

0) 0 hi

.a 6 al u) m c

n C

0 m

al LT 2

r o (0

I) 3 ii 3

38 2

L J a

6 8 2 ;

m C

0.-

c

$ n v) 8

-0 0

8 Q) v)

m c

n S

0..

P K

-I a..

1 m

v) z 0

a v)

W lx.

W 1

+

t m 4

6233936164 12+'09/2004 11: 33 6233936164 4

Q zn d

PAGE 01