ML110270046

PV-2010-11, Exam Assignment Tickler

ML110270046
Person / Time
Site:	Palo Verde
Issue date:	11/05/2010
From:	Brian Larson Operations Branch IV
To:
References
ES-201-2 PV-2010-11
Download: ML110270046 (19)

Text

11 7/30/2010

]Feedback OR integrated outlines provided to facility I

II 1-Replaces NUREG-1022, Revwon 9, Supp 1, Forms ES-201-1 and ES-501-1

ES-20i Examination Zlutiine Guaiiiy Checkiist Form ES-209-2 Date of Examination:

Task ~escriplion

1.

w R

E T

T E

N

a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions. instrument and component failures, technical specifications, and major transients.

I I

~ - -

and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated (I) the ouiiine(s) contain(s) the required number of control room and in-p!ant tasks distributed among the safety functions as specified on the form (2) task r e ~ ~ o n from the last hrro NRC ~amina~ions Is within the llmiis s

~

~

e d

on @e (om (3) no tasks are duplicated from the applicants' audit test(s)

(4) the number of new or modified tasks meets or exmds the minimums spedfied on the form

15) the number of alternate path. I o ~ D ~ r,

e m e r ~ e n ~,

and RCA [asks meet the criteria (2) at least one task is new or significantly modified

a. Author

b. Facility Reviewer c)

c. NRC Chief Examiner (#)

d. NRC Supefi4sor Note:

independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

Not aDDk8ble for NRC-oreoared examination odlines

Exam Level RO El SROO Facility Paio Verde Date of Exam 1 1 /05/10 Item Description

1.

2.

a.

NRC WAS are referenced for all questions.

Questions and answers are technically accurate and applicable to the facility.

b.

Facility learning objectives are referenced as available.

SRO questions are appropriate in accordance with Section D.2.d of ES-401 The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).

Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or

/the audit exam was completed before the license exam was started; or the examinations were developed independently; or A t h e licensee certifies that there is no duplication; or other (explain)

3.

4.

5.

6.

Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO l SRO-only question distribution(s) at right.

Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right.

7.

8.

Referencesihandouts provided do not give away answers or aid in the elimination of distractors.

Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they x e assigned; deviations are justified.

Question psychometric quality and format meet the guidelines in ES Appendix 8.

The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.

9.

IO.

11.

Printed Name / Signature

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor initial Date 10/19/10 10/19/10 Note

• The facility reviewers initialslsignature are not applicable for NRC-developed examinations

1. ifidependenr NKC reviewer initial items in Column c, cniei examiner concurrence required ES-401, Page 29 of 33

1. General Criteria

2. ~ a ~ k - ~ h r o u g h Criteria I

i I

a e foil ow in^. as ap~licab~e 9

ini~!ating cues references and toots, ~ n c ~ u d ~ n reasonable and validat~d time limits ~

~

~

e

~

a

~

e time a l l o ~ ~ ~

for c ~ m p l ~ t i o n ~

and specific designa~ion if deemed to be ~ime~ritical by the facil~~y ii~nsee

=

opera~io~ai~y i ~ ~ o ~ ~ n t s p e a k e ~ ~ r m a n c e cr~~eria that i n c ~ u d ~

ctions with exact c~i~efia and n o m e ~ c l a ~ u ~ e system response and other examiner cues statements describing i ~ p o ~ a n t obse~ations to be made by the applicant crttena for successful completion of the task identi~cation of critical steps and their associated p e ~ o r ~ a n c e s t a n d ~ r d ~

res~~ic~ions on the sequence of steps, if applicable use, repetition from the last 2 NRC examinations~ specified a

Author b

Facrlity Reviewerr) c NRC Chief Examiner (#)

d NRC Supervisor NOTE The facility si~nalure is not aooiicable for N R ~ - d e v e i ~ ~ e d test%

Independent NRC reviewer initial items in Column "c", chief examiner concurrence required

1 itrons are reaiistic, in that some equ of sewics?. but it does n cue the o ~ e ~ a ~ o r s into ex 2

3 The scenarios consst mostip of related events Each even^ d e s c ~ ~ ~ t i o n consrsls of e pofnt in the s ~ n a ~ ~ o when it IS to be i n ~ ~ ~ ~ ~ e d e m a l f u n ~ i o n ~ s ~

that are entered to initiate the event the s y ~ ~ t o ~ s / c u e s t at will be visible to the crew 5

ralor actions (by shift p o s i ~ ~ o n ~

p e ~ o ~ a n c e defiaencies or d ~ ~ i a t i o n s from the referenced plant have been eyalua~ed to ensure that ~ u n ~ [ i o n a ~

fidelity IS m a i ~ ~ a i ~ e d while running the planned scenarios d a s verified using Form ES-301-6

Facility: PVNGS Date of Exam: 1 110511 0 Exam Level: ROIJQ SROm Initials Item Descriotion I

a bf c

3.

Applicants' scores checked for addition errors (reviewers soot check > 25% of examinations)

4.

Grading for all borderline cases (80 m2% overall and 70 or 80,

b. Facility Reviewer(*)

d. NRC Supervisor (*)

ES-403, Page 6 of 6

Ir Facility: PVNGS Date of Exam: 11/05/10 Exam Level: Ron S R O m I

Initials I

I Printed Name/Signature Date SEAN W L l E I

a. Grader

b. Facility Reviewer(*)

e. NRC Chief Examiner (*)

d. NRC Supervisor (*)

// (*)

The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

G t-:

t-:

t-:

I-2 2

z K

CL s

3 3

3 4

4 m

m m

2-2-

z 2

K 4

m 2-5:

4 K

2 5:

3 B,

U LL LL U

L L LL LL LL LL LL LL LL U

U U

LL LL U

U LL U

c E

Q Q

2 e!

F!

a CL c

E 2 V

0 n

0 0

n N

N T -

0 K

v) r T-T-

0 m

0 N

E.

7 0

m 0 -

T-0 m

0 0

N T-.

T-0 m 0 T-O m

0 m

a, 0

0 u m

u) a L

d S

0 rn I-2 0

N.

0 N.

0 N.

0 N.

0 N.

0 m

in 0

0 0 -

z z g 8

& X 0 0 2 2 0 0 2s 0 0 am5 0 0 2 2 0 0 2 2 0 0 2 2 0 0 am2 T-.--

T T

e Q) u)

a, U

0 0

a, m

m

=:

d C

0 5l z

J

-1 a

In 0

a, E

P 0

m Q -

L 2 -

m c e 0

B t?

0 3

v) B 0

2 v) a a,

e 0

0 0

0 0

m r_

P!

7-L c

c e 0

2 t?

0 3

0 ct v) 0 -

B v) z P

a, E

0 m

Q -

L c

0 m -

c e 0

2 t?

(?

3 v) B m

2 v) 0 m -

L Q, a Ln

-=k..

C 0

u?

0 IY

t-

1 a

Y-O li-cu

B.- 5 0

cu tl) u)

K 0

'c; tl) a2 en En 3

u) wu k=

m b

E.-

E X

0) a2 0

c E

0 u:

z Qt 0

6 L

0 c

n g!

pg

$ E cum S E a

0 3

d)

Eo e m

L.

0 p;"

m