ML071570402

Generation Station - 11-2006 - Public Forms; Examination Assignment

ML071570402
Person / Time
Site:	Columbia
Issue date:	04/18/2006
From:	Gody A Operations Branch IV
To:	Garchow S Operations Branch IV
References
Download: ML071570402 (21)

Text

A.pril 18, 2006 NOTE TO: Steve Garchow Chief Examiner, Operations Branch FROM: Anthony T. Gody, Chief Operations Branch Division of Reactor Safety

SUBJECT:

EXAMINATION ASS IGNMEN1 You have been assigned as Chief of the Columbia Generating Station examination. The operating test has been scheduled to be completed by December 1, 2006. Thank you for contacting the Columbia Generating Station facility to finalize the details of the examination You are reminded that the RPSllP system must be maintained to ensure that the exarninm and numbers of candidates are accurate. In addition, you are reminded that only qualified examiners are permitted to conduct any part of the examination.

Division of Reactor Safety

Replaces NUREG1021 Revision 9, ES Forms 201-1 and 501-?

Pq Due Date I Description IDate Complete I Initials Notes produced by Chief Examiner produoed by OLA

~

print Report-21

~ produced by Chief Examiner

• Indicates the due dates are more conservative than the ES-201-1 requires.

ES-201 Examination Outllne Quality Checklist Form ES-201-2 Facility: Date of Examination: II 127 10 7 Initial Task Description a I b' 1.

1111 I a. Verify that the outline(s) fit@)the appropriate model, In accordance wjth ES-1.

R b. Assess whether the outline was systematically and randomly prepared in accordance wifh I Section D.l of E$-401 and whether all WA categories are appropriately sampled.

c. Assess Wether the outline overemphasizes any system, evolutions, or generic topics.

E

d. Assess whether the justifications for deselxted or rejected WA statements are appropriate.

of normal evolutions, instrument a d component failures, technical specifications, plicants' audit t&(s)

CA tasks meet the criteria Date

a. Author I -Y -07

6. Facility Reviewer (*)

c. MRC Chief Examiner (#)

d. NRC Supervisor law Note: # Independent PIRC reviewer initial items in Column "c'; chief examiner concurrence required.

ES-201, Page 25 of 27

ES-401 Written Examination Qualitv Checklist Form ES401-6 Facility: b l o / H b; Date of m m : ' I/z!/,& Exam Level: ROlSRO Initial I I

4. If more than four RO and two SRO questions are repeated from the last two MRC licensing

5. Question duptication from the license screeninglaudit exam was controlled as ' dicated below (check the item that applies) and appears appropriate:

Ah

- audit exam was systematically and randomly developed t k audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication other (explain)

I I I

6. Bank use meets limits (nomore than 75 percent Bank Modifid New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right /<tY I LUQI @J $

7. Between 50 and 60 percent of the questions on the RO Memorj exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS suppott the higher cognitive Levels; enter the actual RO I SRO question distnbution(9) at right.

8. Referencesthandouts provided do not give away answers or aid in the elimination of distractom.

9. Question content conforms with specific WA statements in the previously approved examination outlhe and is approprlate for the tier to which they are assigned; deviations are justified.

10. Question psychomtric quality and formt meet the guidelines in ES Appedix 6. Id4-h IY

11. Tlae exam contains the required number of onepoint, multiple choice items; the total is correct and agrees with the value on the cover sheet.

a. Author

b. Facility R e v i e w r (")

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor I Note: The facilily reviewer's initialdsignature are not applicable for NRC-developed examinations.

1. Independent NRC revlewer initial items in Column "c"; chief examiner comurrence required.

ES-401, Page 29 of 33

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: CklJ*b ;cy Date of Examination: ' ' / Z 7 / a k Operatir rest Number

1. General Criteria c#

a. The operating tesf confoms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distriblrtion).

b. There is m day-to-day repetition between this and other operating tests to be administered during this examination.

C. The operating test shall not duplicate $ems from the applicants' audit test(?.). (see Section D.1.a,)

d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.

e. It appears that the operating test will differentiate b e h e n competent and less-thancompetent applicants at the designated license level.

2. Walk-Through Criteria

a. Each JPM includes the following, as applicable:

initial conditions initfating cues references and tools, including a a c i a t e d procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-crifical by the f a c i l f licensee operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observationsto be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performam standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previouslyapproved systemsand administrativewalk-through outlines (Forms ES-301-1 and 2) have not calrsed the test to deviate from any of the acceptance criteria (e.g.<item distribution, bank use,repetition from the last 2 NRC examinations) specified on those forms a d Form ES-201-2.

3. Simulator Criteria The associated sirnulator operatirrg tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

Printed Name I Signature

a. Author

b. Facility Reviewer?)

c. NRC Chief Examiner (#)

I

d. NRC Supervisor I

NOTE: The facility signature is not applicable for NRCdeveloped tests.

f Iddependent NRC reviewer initial items in Column "c";chief examiner concurrence required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 11 Facility: & I u w &#'- Date of Exam:h&enario Numbers: I Zt 3 0 p e m U Test

~ No.:

QUALITATIVE ATRIBWE5 Initials I I

1. The initial conditions are realistic. in that wme equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.

2. The scenarios consist mostly of related events.

3.

Each went description consists of the point in the scenario when it is to be initiated the malfunction(s)that are entered to initiate the event the symptomshes that Will be visible to the crew the expected operator actions (by shill position)

• the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. 11sri

5. The events are valid with regard to physics and thermodynamics. w

6. Sequencing and timing of events is reasonable, and a l l m the examination team to obtain complete evaluation results commensurate with the scenario objectives.

7. If time compression techniques are used, the scenario summary clearly sa indicates.

Operators have sufficient time to carry olrt expected activities without undue time constraink.

Cues are given.

8. The simulator modeling is not altered.

9. Tho mnarios have been validated. Pursuant to 10 CFR 55,46(d), any orpen simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

I

22. Each applicant Will be significantly involved in the minimum number of transients and events ES-301, Page 25 of 27

ES-301 Transient and Event Checklist Form ES-301-5 Scenarios 2 I 3 I 4 M I

N 1

M U

M

- 1*

- 1*

- 4*

2 2

1*

1*

- 4*

2 SRO-U TS - 2 I*

I RO I= I 1 I I

- 4 2

SRO-U TS F A SRO-U * -

2 2

1. Circle the applicant level and enter the operation test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and balance of plant (BOP)positions; Instant SROs must do one scenario, including at least two instrument or component O K ) malfunctions and one major transient, in the ATC position.

2. Reactivity manipulations m a y be conducted under norma1 or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.aofAppendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for I basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Page 1

ES-301 Transient and Event Checklist Form ES-301-5 P - -

bcility: ColFbia Generating Station Date of Ex ER 2006 Operating Test Number: -

M I

N I

M U

M

- 1

- 1*

iRO-I 4*

xo-I SRO-U SRO-I SRU-U zo mo-I

- 2 SRO-U 2 nstructions:

I. Circle the applicant level and enter the opcration test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and baIance of plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component ([IC)malfunctions and one major transient, in the ATC position.

I Reactivity manipulations may be conducted under normal or uonirolkd abnormal conditions (rcfcr to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for 1 basis.

3. Whenevcr practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the mininium rquirement.

Page 2

ES-301 Competencies Checklist Form ES-301-6

&I Roq11 IISRO-

ENARIO SCENARIO 1 t

Notes:

(I Includes Technical Specification compliance for an RO.

{Z) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicantslicense type and enter one or more event numbers that will allow the examiners to evaluate every Author:

NRC Reviewer: p

/

- aev q ES-301, Page 27 of 27

ES-301 Competencies Checklist Form ES-301-6 Competencies Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions Circle fhe applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every cy for every applicanl.

Author:

/

NRC Reviewer:

ES-301, Page 27 of 27

ES-403 Written Examination Grading Form ES403-1 Quality Checklist Date of Exam: '1/27/& Exam L e v e l m R O Initials Item Descriation

1. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified II and documented I

u r n J?

I I

3. Applicants' scores checked for addition errors

{reviewers spot check > 25% of examinations)  ?

Grading for all borderline cases (80 k29'0 overall and 70 or 80, 4.

as applicable, k4Y0 on the SRO-only) reviewed in detail @

I 5.

6.

All other failing examinations checked to ensure that grades are iustified Performance on missed questions checked for training

~

deficiencies and wording problems; evaluate validity u & 3 d @

of questions missed by half or more of the applicants

a. Grader

b. Facility Reviewerr) &hd

c. NRC Chief Examiner (") /45/D6

d. NRC Supervisor (*) I VGJQ r) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-403 Written Examination Grading Form ES-403-4 Quality Checklist Facility: G/O v r l b L a - Date of Exam: "/L7/& Exam Level: R O I ~

I I Initials

4. Grading for all borderline cases (80 k2Y0 overall and 70 or 80, as applicable, k4% on the SRO-only) reviewed in detail

5. AH other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed NamelSignature - , Date

a. Grader

b. Facility Reviewerr)

c. NRC Chief Examiner (*)

d. NRC Supervisor I")

(*) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

IO LL LL U U LL LL C

E 3 D 8

4 a

s.

c N

Ill IIIII Ill IIIII

Lu IIIII 1Ll sh Q

c T 2

IIIIIIIIIIIII w

I- .%

w 0

2 Id I IIIIIIIIIII iI a -

c

I IIIIIII I IIIIIII II w

U r

F