ML091110175

2009-03-Public Forms

ML091110175
Person / Time
Site:	Columbia
Issue date:	08/07/2008
From:	Garchow S NRC Region 4
To:	Energy Northwest
References
50-397/09-301
Download: ML091110175 (16)

Text

August 7, 2008 FROM:

TO:

SUBJECT:

c Ryan Lantz Division of Chief, Operations Steve Garchow Chief Examiner, Operations Branch IN ITlAL OPE RATOR LICE NSlNG EXAM I NATION ASSIGNMENT You have been assigned as Chief Examiner of the Columbia Generating Station, Unit 2, initial licensing examination. The operating test has been scheduled to be completed by January 16, 2009. Thank you for contacting the Columbia facility to finalize the details of the examination.

You are reminded that the RPS/IP system must be maintained to ensure the examiners and numbers of candidates are accurate. In addition, you are reminded that only qualified examiners are permitted to conduct any part of the examination.

S :\\DRS\\O B\\O B-0 N LYWDIVI I N WS S I G N M E NT SHE ETS\\CY'OS\\JAN 09-CG S-ASS I G N M E NT MEMO-SG. DOC

OBDl202 - INITIAL OPERATOR LICENSING PROCESS Chief:

Skve Garchaw 1

Facility:

Columbia Date of Written Exam: +f%N99!

3/tG Start of Op Test:

4#2/2009 End of Op Ted:

I Written Exam Developed By:

NRC I

Facility

. Due Date I

Description 9/5/2008 9/5/2008 10/10/2008 Facility Contact Briefed on Security & Other Reqs Corporate Notification Letter sent Reference material due (if NRC authored) 11/21/2008 12/5/2008 12/5/2008 12/12/2008 12/12/2008

~

DRAFT exam / docs / support reference material due Peer review of written exam complete Preliminary license applications due Preliminaly license applications and waivers reviewed DRAFT exam reviewed by CE; feedback approved by BC 12/26/2008 1/2/2009 Final applications due & List of Applicants prepared Final applications approved & waiver letters sent 2/23/oq Zbw~

S-201-4 prepared by LA 1/2/2009 1/2/2009 Branch Chief approves FINAL exam (Written 8 Op Test)

Proctoringlwritten exam admin guidelines reviewed w/ facility 3/3/0 9 Jh 3/(;/07 1/5/2009 1/12/2009 Exam material to exam team Administer Operating Test 3/3/os 2/13/2009 2/27/2009 RPSllP number of examinees updated Examination Report Issued 3/6/2009 3/13/2009 SUNS1 checklist complete and exam docs to ADAMS Ref Matl Returned afler Final Resolution of Appeals f&oq %& SUNS1 checklist to LA I

N54 f i b.

Operating Test Develc led By:

NRC I Facility Notes

&M Hrd.,,

ES-201 Att-4 produced by CE ES-201 All-3 I[

7/11/2008 IWritten Exam & Op Test Dates Confirmed 11 9/5/2008 INRC Examiners & Facility Contact Assigned 1 1 10/24/2008 llntegrated exam outlines due 1 1 10/31/2008 loutlines reviewed by CE; feedback approved by BC ES-201-2 signed by CE & BC

( 1 11 10/31/2008 IFeedback on integrated outlines provided to facility Document review on ES-401-9

.NRC Forms 3981396 e

11 12/12/2008 (Feedback on DRAFT exam provided to facility 11 12/15/2008 Ion-site validation & 10% audit of license applications LA produces / BC signs Exam 11 1/23/2009 IFacility post-exam documentation due 11 1/23/2009TNRC written exam grading completed 1/23/2009 1/30/2009 2/6/2009 Examiners document op test results on ES 303s Chief Examiner review of written exam & op test completed Branch Chief review of exam results completed 1

2/13/2009 Waiverddeferrals reviewed for impact on licensing decision Signed ES 303s to BC II 11 2/13/2009 I LicensdDenial letters mailed; Facility notified of results

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:

Date of Examination:

Task Description Initials h

1.

w R

I T

T E

N

2.

S I

M U

L A

T 0

R

3.

w I

T

a. Using Form ES-301-5. verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.

k

b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit testb). and that scenarios will not be reDeated on subseauent davs.

4 3 b

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and auantitative criteria sDecified on Form ES-3014 and described in ADDendix 0.

I I

a. Verify that the systems walk-through outline meets the criteria Specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit test@)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

t@

Iu

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

b.

c. Ensure that WA importance ratings (except for plant-specific priorities) are at least 2.5.

d.

e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RO or SRO).

Assess whether the 10 CFR 55.41143 and 55.45 sampling is appropriate.

Check for duplication and overlap among exam sections.

b. Facility Reviewer (*)

c NRC Chief Examiner (#)

c ; chief examiner concurrence required.

t

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility Columbia Date of Exam. March 2009 Exam Level R O m S R O M I

I Initial Item Description

1.

Questions and answers are technically accurate and applicable to the faciliv.

2.

a.

NRC WAS are referenced for all questions.

b.

Facility learning objectives are referenced as available.

3.

4.

SRO questions are appropriate in accordance with Section D.2.d of ES-401 m M w The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL prograrri office).

5.

Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) arid appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or

&he examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain)

I I

I

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Note:

• The facility reviewers initialskignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301 Operating Test Quality Checklist Form ES-301-3 b

Ensure that any changes fnrm the previously approved systems and administrative walk-through outlines (Forms ES-3Dl-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g.. item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.

M@

Date of Examination: March 2009 Operating Test Number: 1 11 Facility: Columbia I

Initials a

b' c#

1. General Criteria I

I

e.

It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.

2. Walk-Through Criteria I

I l

a Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associate8 performance standards restrictions on the sequence of steps, if applicable.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

1 a.

Author Date

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Target Quantitative Attributes (Per Scenario; See Section D.5.d)

Facility: Columbia Date of Exam: March 2009 Scenario Numbers. 1 I 2 I Spare Operating Test No.: 1 I

Actual Attributes QUALITATIVE ATTRIBUTES a

1.

The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service. but it does not cue the operators into expected events.

AA

1.

Total malfunctions (5-8)

2.

Malfunctions afler EOP entry (1-2)

3.

Abnormal events (2-4)

4.

Major transients (1-2)

5.

EOPs enteredlrequiring substantive actions (1-2)

EOP contingencies requiring substantive actions (0-2)

6.

7.

Critical tasks (2-3)

~~

~~

2.

3.

The scenarios consist mostly of related events.

Each event description consists of No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible Drecedina incident such as a seismic event.

the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shifl position) the event termination point (if applicable)

4.

61 7 1 5 l Z / Z I /

/

I

(

I

/

L /, ? I /

I 1

1 1

2 2 I Z l t Z l L l Z Q?

~

5.

6.

The events are valid with regard to physics and thermodynamics.

Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

7.

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

8.

9.

The simulator modeling is not altered.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

A/D

~

10.

Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301.

All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

11.

All

12.

Initials T-p

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facilitv: Columbia Date of Exam: 3/13/09 Exam Level: RO w SRO Item DescriDtion

1.

2.

3.

4.

Clean answer sheets copied before grading Answer key changes and question deletions justified and documented Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

Grading for all borderline cases (80 &2% overall and 70 or 80, as applicable, *4% on the SRO-only) reviewed in detail

5.

All other failing examinations checked to ensure that grades are justified

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants -

Printed NamelSignature A

Initials TTT-TT Date

a. Grader

b. Facility Reviewer(*)

t /l9/64

'Ilglb4 V/9h 4

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

(*)

The facility reviewer's signature is not applicable for examinations graded by the NRC;

ES-403 a

Written Examination Grading Qualitv Checklist b

C Form ES-403-1 I1 Item DescriDtion

1.

2.

Clean answer sheets copied before grading Answer key changes and question deletions justified and documented

3.

4.

5.

Applicants scores checked for addition errors (reviewers spot check > 25% of examinations)

Grading for all borderline cases (80 &2% overall and 70 or 80, as applicable, +4% on the SRO-only) reviewed in detail All other failing examinations checked to ensure that grades are justified

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity o

f o

n s

missed by half or more of the applicants Date Printed Name/

a. Grader

b. Facility Reviewer(*)

3 JI+~

rlg)ooi

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-301 Transient and Event Checklist Form ES-301-5 T

0 T

A L

M I

N I

M U

M 2

1*

1

• 6 4*

7 2

L 2

m 1*

1

• 6 4*

m 2

2 2

1*

4*

1 6

2 2

2 1

3 I*

4*

2 6

2 2

4 2

1*

1*

4*

2 MA J 1

1 TS 2

i 2

1 Circle the applicant level and enter the operation test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and balance of plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component (IC) malfunctions and one major transient, in the ATC position.

Reactivity manipulations may be conducted under normal or conkolled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a I for 1 basis.

2.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Page 1 rev 1211 8/2008

ES-301

'f ransient and Event Checklist Form ES-301-5 SPARE SCENARIO ATTRIBUTES Facilit RO SRO-I SRO-U

Colu -

E v

E N

T T

Y P

E Rx NOR 1/c MAJ TS -

ibia Date of Exam: March 2009 Operating Test Number: 1 SPARE Scenarios 3-SPA1 Cre Posi S

R 0

3 1 -

1 -

A T

C 1

2 1

1 1

I T

0 T

A L

1*

4* 3 2

Page 2 rev 1211 8/2008

ES-301 Competencies Checklist Form ES-301-6 Facility: Columbia Competencies InterpreVDiagnose Events and Conditions Comply With and Use Procedures (1 )

Operate Control Boards (2)

Com mu n ica te and Interact Demonstrate Supervisory Ability (3)

Comply With and Use Tech. Specs. (3)

Notes:

Date of Examination: March 2009 Operating Test No.: 1 gn-1..LO -z,&.3

,&+APPLICANTS I

I li -1,' J - 2 ; J -3 z - i ; p - 2 ; L - 3 RO RO RO 0

RO 0

SRO-I SRO-I 0 SRO-I 17 SRO-I SRO-U SRO-U [7 SRO-U SRO-U 1

SCENARIO (1

SCENARIO 11 SCENARIO SCENARIO Includes Technical Specification compliance for an RO.

Optional for an SRO-U.

Only applicable to SROs.

instructions:

Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant

ES-301 Competencies Checklist Form

~

ES-301-6 Facility: Columbia Competencies InterpreUDiagnose Events and Conditions Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact Demonstrate Supervisory Abilitv (3)

Comply With and Use Tech. Specs. (3)

Date of Examination: March 2009 Operating Test No.: 1

-q SRO-I SRO-U 0 RO 0

I APPLI RO SRO-I 0 SRO-U 17 Notes:

(1)

(2)

Optional for an SRO-U.

(3)

Only applicable to SROs.

Includes Technical Specification compliance for an RO, 4RI 3 -

SRO-I 0 SRO-I SRO-U 0 Instructions:

Check the applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant

Page 2 of 4 04/13/2009 Report 21 Region: 4 08:21:54 Phase Code: 5 Operator Licensing Exam Schedule From 10/01/2008 To 09/30/2009 Summary By Date ji 0912008 WNP - Columbia Generating Station R O - 0 SROl - 0 SROU - 0 LSRO - 0 09/2008 R O - 0 SROl - 0 SROU - 0 LSRO - 0 1012008 WNP - Columbia Generating Station 1012008 12/2008 WNP - Columbia Generating Station R O - 0 SROl - 0 SROU - 0 12/2008 R O - 0 SROl - 0 SROU - 0 01/2009 WNP - Columbia Generating Station 0112009 03/2009 WNP - Columbia Generating Station R O - 4 SROl - 4 SROU - 3 03/2009 R O - 4 SROl - 4 SROU - 3 06/2009 WNP - Columbia Generating Station 06/2009 08/2009 WNP - Columbia Generating Station R O - 0 SROl - 0 SROU - 0 08/2009 R O - 0 SROl - 0 SROU - 0 09/2009 WNP - Columbia Generating Station LSRO - 0 LSRO - 0 LSRO - 0 LSRO - 0 LSRO - 0 LSRO - 0 Total for Columbia Generating Station: 0 Total for 09/2008: 0 Total for Columbia Generating Station: 0 Total for 12/2008: 0 Total for Columbia Generating Station: 11 Total for 03/2009: 11 Total for Columbia Generating Station: 0 Total for 08/2009: 0 Sites: WNP Orgs: ALL Exam Author: ALL

ILC hldc m w w (

ES-601 Examination Security Agreement Form ES-601-1

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC requalification examinations scheduled for the week(s) of i/r %9 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRCs chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those operators scheduled to be administered these examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRCs chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC requalification examinations administered during the week(s) of 3//6/09. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those operators who were administered these examinations, except as specifically noted below and authorized by the NRC.

6.

i

7.

I

8.

I

9.

10.

11.

12.

13.

14.

15.

NOTES:

ES-601, Page 27 of 36

ES-601 Examination Security Agreement Form ES-601-1

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC requalification examinations scheduled for the week(s) of c; z/&l as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRCs chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those operators scheduled to be administered these examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRCs chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did administered during the week(s) of to any unauthorized persons any information concerning the NRC requalification examinations

. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those operators who were administered these examinations, except as specifically noted below and authorized by the NRC.

/

/

./

V.

I I/

7.

8.

9.

I O.

11.

12.

13.

14.

15.

NOTES:

ES-601, Page 27 of 36

L U r LJ&

Zcin 9 ES-201 Examination Security Agreement E6m ES-2'01-3

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of ' 1 d 9 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledg during the week(s) of 7 instruct, evaluate, or provi +

e performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered

. From the date that I entered into this security agreement until the completion of examination administration, I did not PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2)

DATE NOTE ES-201, Page 26 of 27