ML091490527

2009-03 - Public Forms

ML091490527
Person / Time
Site:	Fort Calhoun
Issue date:	03/27/2009
From:	Brian Larson NRC Region 4
To:	Omaha Public Power District
References
50-285/09-301 50-285/09-301
Download: ML091490527 (18)

Text

OBDl202 - INITIAL OPERATOR LICENSING PROCESS Chief: BI I I SUNS1 checklist to LA

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Fort Calhoun Date of Examination: 3/30/2009 Initials Item Task Description T/Tq-T I. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

W R b. Assess whether the outline was systematically and randomly prepared in accordance with i Section D.l of ES-401 and whether all WA categories are appropriately sampled.

T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

E N d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and maior transients.

I M b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation scheduie L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants' audit test($), and that scenarios will not be repeated on subsequent days.

0

c. To the extent possible, assess whether the outlineis) conform(s) with the qualitative R

and suantitative criteria soecified on Form ES-301-4 and described in Aooendix D.

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form I ( 2 ) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants' audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form

( 5 ) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at leas: one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

b. Assess whether the 10 CFR 55.41143 and 55.45 sampling is appropriate.

c. Ensure that WA importance ratings (except for plant-specific priorities) are at least 2.5.

d. Check for duplication and overlap among exam sections.

e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RO or SRO).

a Author b Facility Reviewer (*,

c NRC Chief Examiner (#)

d NRC Snper?r!cor Note: # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required

• Not aDDliCabk?for NRC-Dreoared examination outlines

Facility: Fort Calhoun Date of Exam:3/30/09 Exam Level: BOTH I , Initial ,

5. Question duplication from the license screeninglaudit exam was controlled 2s indicated below (check the item that applies) 2nd appears appropriate:

- the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or

-the examinations were deve!opec! independently; or

-the licensee certifies that there is no duplication; 01

- other (explain)

6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only question distribution(s) at right.

7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right.

t give away answers ms with specific WA statements in the previously approved is appropriate for the tier to which they are assigned;

a. Author

o. Facility Reviewer (*)

3. NRC Chief Examiner (#)

j. NRC Regional Supervisor Vote:

• The facility reviewer's initia!s/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-301 I ity Form ES-301-3 Initial

1. General Criteria a b*

a. Each JPM includes the following, as applicable:

• initial conditions initiating cues references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified Printed Name I Sianature n Date a Author I! Facility Reviewer(*)

z NRC Chief Examiner (#)

A NRC Supervisor NOTE:

• The facility signatuie is not applicable foi NRC-developed tests.

1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

1. The initial conditions are realistic, in that some equ instrumenta~ionmay be out of service, but it does not cue the operators into ex

_____ ~

3. Each event description consists of

• the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate h e event the symptomskues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

4. No more than one non-mechanisticfailure (e.g., pipe break) is incorporated into the scenario tion team to obtain

7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are oiven.

, as verified using Form ES-301-6

ES-403 Written Examination G r a d i ~ g Initials Item Description a I b C

1. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified and documented

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases f80 +2% overall and 70 or 80, as applicable, +4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed NameKignature Date

a. Grader

b. Facility Reviewer(*)

c. NRC Chief Examiner (*)

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

Quality Checklist iI I initials i

Item Description a b i I 4. Grading for ail borderline cases (80 22% overall and 70 or 80, Printed NamelSignature

b. Facility Reviewer(*)

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

D tu 6.

0 2

P

-0 5

(u fn tu 0

0 E-M N

n n n n n n n n n

-I s

0 0

P cn.

W 0

- L n  ?

P F 8 w '

n r 0 I

P 5

23 -(I 5

nl UI (D

0 0

0 h ) h ) o o 0.

'D VI O N N O O 0 0 0 0 0 m 0 0 m 0

0 x

I

a. .-

8 .

I .

. .._ . L :

From: BARRY, TIMOTHY J Sat: Tuesday, April 07,200972.19 PM To: GADE, RANDALL B subject: RE: NRC exam security agreement

!Y 7 =,-

,