ML100670660

AN2-2009-08-Public Forms

ML100670660
Person / Time
Site:	Arkansas Nuclear
Issue date:	08/07/2009
From:	Brian Larson Operations Branch IV
To:	Entergy Operations
References
Download: ML100670660 (12)

Text

ITlAL O P E ~ A T O ~

(1 Chief: 1 Brian T. Larson Facility:

AN2 Date of Written Exam:/ 8/7/2009 I/

l

-acility:

Date of Examination:

Item

1.

w R

I T

T E

N

2.

S I

M U

L A

T 0

R

3.

W I

T Initials Task Description a

b*

c Assess whether the outline over-ernohasizes anv svstems. evolubons. or aeneric toolcs

b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the aodicants' audit testk). and that scenarios will not be reoeated on subseauent davs.

c. To the extent possible, assess whether the outline@) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain@) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit test@)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(2) at least one task is new or significantly modified (31 no more than one task is reoeated from the last two NRC licensina examinations (7;

+h-l.--lrr A i r t r i h i h d rrrnrrnn thn tnnirc I C cnnrifinrl nn tho fnrm L I I G Lacin* a & =

U 1 ~ L I I U " L b U u"'Vy L I I Y LYt.3'"'"'

"y"Y""u

" I,... "

. -.

• I.

c. Determine if there are enough different outlines to test the projected number and mix

a. b.uthor

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Supervisor Note:

1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

• Not applicable for NRC-prepared examination outlines

ueiear One Unit 2 Date of Exam:

Exam Level: RO Item Description

1.

2.

Questions and answers are technically accurate and applicable to the facility.

a. NRC WAS are referenced for all questions.

b. Facility learning objectives are referenced as available.

SRO questions are appropriate in accordance with Section D.2.d of ES-401

3.

4.

The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office).

5.

Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or

__ the examinations were developed independently; or X the licensee certifies that there is no duplication; or other (explain)

6.

Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right.

Between 50 and 60 percent of the questions on the RO exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO Question distribution(s) at riaht.

7.

8.

Referenceshandouts provided do not give away answers or aid in the elimination of distractors.

Bank Modified New 22.711 6 12/28 65.3156 40 I 2 4 60 I 7 6

9.

Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified.

IO.

11.

Question psychometric quality and format meet the guidelines in ES Appendix B.

The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet Printed Name I Signature Initial Date

a. Author

b. Facility Reviewer ("1

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor

1. Independent NRC reviewer initial items in Column "c": chief examiner concurrence reauired.

ES-401~ Page 29 of 33

e.

It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.

2. Walk-Through Criteria

a.

Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable previously approved systems and administrative walk-through

3. Simulator Criteria c

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

Initials Date a

Author b

Facility Reviewerr) c NRC Chief Examiner (#)

d NRC Supervisor NOTE; The facility signature is not applicable for NRC-developed tests Independent NRC reviewer initial items in Column "c", chief examiner concurrence required

1 2

3 The inittal conditions are realistic, in that some equipment andlor i~s~rumenta~!on may be out of sewice S ~ i i rt docs not clie the operators into erpected events The scenanos consist mostly of related events Each event descnption consists of a

e 8

s No mare than one non-mechanisk farlure (e 9, pipe broakl IS incorporated into the scenario without a credible precedrng incident s u d i ds d seismic event the point in the scenano when it ib to be initrated the maifiinc~ion(s} that are entered to initiate the event the sy~ip~oms~cues that wfll be visible to the crew the expected operator actrons (by shiff positionf the event terminatton point (it; applicable) 4 5

The events are valid \\nrith reaard to nhvsics and ~ h e ~ ~ o d v n ~ m i c s 6

Sequencing and timing of eveiik is reasonable, and allows the examination teain to obtain complete evaluahon results coi~m~nsu~ate with the scenano objectives If time compression teChRiqlJf3$ are wed, the scenano summary clearly so indicates Operators have sufficient time to carry out expected actwities wtnout undue time constraints Cues are aiven 7

a

8.

The sirntiiatur inorielinn ts not aitered i flL 9

The scenarios have been validated Pursuant to 10 CFR 55,46(d). any open simulator performance deficiencies or deviations from the referenced plafit have been evaluated to ensure fhat functional fidelrtv is maintained while runninq the planned scenarios 10 Every operator wli be evaluated using at least one new or ~fgni~cantl~~

modrfted scenario Ail other scenanos have been aitered in accordance #!th Section D 5 of ES-301 specified on Form ES-301-5 (sub~it the fom with the simulator scenarios) 1 Total ~ a l ~ n c ~ i o n § 2

~aifuncf~ons aEer EOP entrv 11-21 1

4:'332 I h&

3 Abnormal events (2-41 5

EUPs entered/requriinq substantive actions (1-2)

I l l l i l 6

EOP conbnqencres requirinq substantive actions (0-2) 1 o i i / o f $4

7.

Critrcal tasks (2-3) 2 i 2 ! 2

ritte in Facility: ANQ Unit 2 Date of Exam: 08/07/2009 Exam Level: RQ H SRQ Initials item Description

1.

Clean answer sheets copied before grading ges and question deletions justified

4.

Grading for all borderline cases (80% ~t 2% overall and 70 or 80, as applicable, 2 4% on the SRQ-only) reviewed in detail

5.

Ail other failing examinations checked to ensure that grades are justified

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity Printed Name / Signature Date

a. Author

b. Facility Reviewerr)

c. NRC Chief Examiner(*)

d. NRC Supervisor(*)

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC; ivvo i ~ d ~ ~ e ~ d e ~ ~

NRC reviews are required.

ES-403, Page 6 of 6

i i

0 0

v)

W..

.- s 2

m

f 0

0

'El ::

0) ut m

c Q

C 0

En E

-1 a

P

CI I-

.- E 3

h

.b E