ML032671240

Init Exam - 03/2003 - Public Forms

ML032671240
Person / Time
Site:	Columbia
Issue date:	03/27/2003
From:	Gody A NRC Region 4
To:	Parrish J Energy Northwest
References
50-397/03-301
Download: ML032671240 (8)

Text

APPENDIX I Operations Branch Examination Assignment Check Sheet:

(Includes ES-201-1 & ES-501-1 Rev. 8, Supplement 1 information)

Chief: H. Rundv S:\\DRS\\OB\\EXAMS\\Cgs\\Retake March 2003\\GoodPractice-2003-app-l-r4-draft.wpd as of:

3/17/03 Facility/Task: Columbia/Written Retake Exam Task Start Date: 3/27/03 ITEM DESCRIPTION DUE DATE INIT DATE 0

Exam/Inspection Schedule Agreement Sep 28, 2002 ATG 2/9/03 1

NRC Staff & Fac. Contact Assigned Sep 28, 2002 ATG 2/9/03 2

Facility contact briefed on security & other issues Sep 28, 2002 ATG 2/9/03 3

Corp. Notification Letter Sent Sep 28, 2002 HB 2/14/03 4

Task Expectations, Issues, & Standards Discussed w/ BC Dec 27, 2002 HB 2/6/03 5

Reference Material Due [Req'd for NRC-authored exams only]

Nov 27, 2002 NA 6

Integrated Exam Outlines Due Nov 27, 2002 HB 3/10/03 7

Outlines reviewed by NRC & Feedback Sent Dec 11, 2002 HB 3/11/03 8

Preliminary Applications Due Feb 25, 2003 HB 2/20/03 9

Draft Exams w/ Doc./Ref. Due Jan 26, 2003 HB 3/10/03 10* Independent Reviewer Initials As Reviewed All Parts Feb 5, 2003 3

11* NRC Supervisor Initials Approving for Fac. Rev.

Feb 5, 2003 A

/

12 Exams Reviewed w/ Fac.

Feb 5, 2003 g 13 Final Appl. Due & Assign. Sheet Prepared Mar 13, 2003 HB 3/13/03 14* NRC Supervisor Approved Final Exams Mar 20, 2003 A r 15 Final Appl. Rec'd & Waivers Sent Mar 20, 2003 HB 3/13/03 16 Proctor Rules Reviewed w/ Fac. & Written Authorized Mar 20, 2003 17 Exam/lnsp Material to Team Mar 20, 2003 NA 18 BC Discussed Final Exam Fairness w/ Licensee Mar 20, 2003

/J (co) 19 Fac. graded exam & Comments Rec'd Apr 8, 2003 20 NRC Written Grading Completed Apr 11, 2003.

21 Examiners Finished Grading Op. Tests Apr11, 2003 22 NRC Ch. Ex. Review Completed Apr 21,2003 23 NRC BC Review Completed Apr22,2003',4-W' 24 RPS/IP Examinees Updated Before Report Issued Apr27, 2003 25* BC Discussed Exam Admin Issues w/ Licensee Apr 27, 2003 Qij 26 License/Denials Signed & Facility Contact Notified of Results May 15, 2003

/7/3 27 Report Issued ADAMS MGCESSION N May 15, 2003 41((/3 28 Appendix H to OLA TEMPLATE N-May 29, 2003

• Supervisor or Independent Reviewer initials required in lines 10, 11, 14, 18, 23, & 25.

ES-201 Examination Outline Form ES-201-2 Quality Checklist Faciity,:

Onj-fit 1 a (e '-n, 4 sAA Date of Examination:

Initials Item Task Description a

bec#

1.

a. Verify that the outline(s) fit(s) the appropriate model per ES-401.

4 AXV w

9 R

b. Assess whether the outline was systematically and randomly prepared in accordance with T

Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

4 T

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

E N

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.

'i

1. 4

2.

a. Using Form ES-301-5, verify that the proposed scenario sets coverthe required number of normal evolutions, instrument and component failures, and major transients.

4 J S

I

b. Assess whether there are enough scenario sets (and spares) to test the projected number and M

mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s),

and scenarios will not be repeated over successive days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and tJA quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3.

a. Verify that:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks, W

(2) no more than 30%/6 of the test material is repeated from the last NRC examination,

/

(3)* no tasks are duplicated from the applicants' audit test(s), and T

(4) no more than 80% of any operating test is taken directly from the licensee's exam banks.

b. Verify that:

(1) the tasks are distributed among the safety function groupings as specified in ES-30l, (2) one task is conducted in a low-power or shutdown condition, (3) 40%/6 of the tasks require the applicant to implement an alternate path procedure, (4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and (5) the in-plant walk-through requires the applicant to enter the RCA.

c. Verify that the required administrative topics are covered, with emphasis on performance-MNI4P based activities.

d. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on successive days.

4.

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam section.

4 E

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N E

c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

( ax A

d. Check for duplication and overlap among exam sections.

L

e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RO or SRO).

a. Author 3i gnaur Qate

b. Facility Reviewer()

/

c. NRC Chief Examiner (#) <

9' chf t/

A

/

B

d. NRC Supervisor B DS2 Note:

Not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c;" chief examiner concurrence required.

l I

I 23 of 24 NUREG-1021, Revision 8, Supplement 1

VA,.

ES-401 Written Exambnain FoM ES401-7 Quality heIui

,t ans.

weuM Lc au and E.

tq

._d'_

S.

ROISRO avef, is no awe thn Is pecn. and SRO w-sto ar _prt Sec~on 024d c ESAGI

~

(

4.

MQ M esinuleallon ad (hupficmton from the last wo NRO licersig swn

_doau _eo _c~eI t_ iem ls __,e.,ni ~a b'

_~ta the auit Oxon was satemdeanci and nt nydm woudo the aumi SD as cormpted beore liense mm wstuaited or

...jh eOmuumk~

were derelope mdeopendently, or 4

2L at kcne awffies NRCt theI eno uploati or am* use iecte aqits (no mom th" 75 S"n Madfied Now pemcentmfrmte ukwaIleaswt 10pacwnlfew.~

a~dW V es m.Merlisasthe cWquesbmO..Q AO itf at u

7.

Betwen so mmd so pescem at the pusuffm on MWnoy CIA 11w exam (Includin tO new question) aue L._

Wdosu FM~n mriYS Wetf

9.

QueslM OM onfOM wit 891eI WAstteNRC m tsinpreviously aPProved xamm wun oitin a s appnapdubt.orth lifar towhihtey E _

-!3!.

10.

.usto

_nooei qult i uignsl. AeniS.

.ad~le i

C~ue d

_ rom we L n

e-ma orda b1. bd iloncw lmthe i

lem coiead me

_ Auntor eFNerde Chief Err (0)

NOWe The fadisy rwiwomes MOIVORAmewe rarno applicable for NRO-devskped emuniatlons.

C vewe iltIs an oln tdefelaor cocnec 1

NUREM-1o1, Pmviun 8, Speme 1 42 of 46 0-(-0o)

IRO, a/

b. (em) 10Ah

, iSt%5-Z998 LL£ 609 ONINIVHI SdO HO0d HV0 L 6 S00Z-SZ-E I *d

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility:Co0u4idap uCn n

it XAtpate of Exam: '7/0 3

Exam LevelRROl Initials Item Description a

b c

1.

Clean answer sheets copied before grading

2.

Answer key changes and question deletions justified and documented AL

3.

Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) kip v

4.

Grading for all borderline cases (80% +/- 2%) reviewed in

5.

All other failing examinations checked to ensure that grades

/

f A/A are justified

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date

a. Grader

b. Facility Reviewer(*)

c. NRC Chief Examiner (*) A

d. NRC Supervisor (*N AT

/

() The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

I 5 of 5 NUREG-1 021, Revision 8, Supplement 1

Page 1 of 4 04/04/2003 Report 21 Region: 4 14:16:09 Operator Licensing Exam Schedule From 10/01/2002 To 09/30/2003 Phase Code: 5 Operational I Exam Week El Site/Docket No./nsp Rpt #

I1

1. Candidates I Type Ih Exam Authorsi Chief Examiner 1I Examiners Assianed I

10/07/2002 Columbia Generating Station / 05000397 / 2002301 RO - 6 TAC #: X02226 SROU - 3 SROI - 6 Admin STETKA, THOMAS F.

BUNDY, HOWARD F.

LANTZ, RYAN E.

MCKERNON, THOMAS 0.

STETKA, THOMAS F.

MCKERNON, THOMAS 0.

STETKA, THOMAS F.

BUNDY, HOWARD F.

12/09/2002 Columbia Generating Station / 05000397 / 20020OZ Procedure#: 7111111B 02/20/2003 Columbia Generating Station / 05000397 / 2003301 RO - 1 TAC #: X02260 MCKERNON, THOMAS 0.

FFF BUNDY, HOWARD F.

Sites: WNP Orgs: 4620 Exam Author:ALL

Page 2 of 4 04/04/2003 Report 21 Region: 4 14:16:09 Operator Licensing Exam Schedule From 10/0112002 To 09/30/2003 Phase Code: 5 Operational I Smmay By~

10/2002 WNP - Columbia Generating Station RO - 6 SROI - 6 10/2002 RO-6 SROI-6 12/2002 WNP - Columbia Generating Station SROU - 3 SROU - 3 LSRO -0 LSRO -0 Total for Columbia Generating Station: 15 Total for 10/2002: 15 12/2002 02/2003 WNP - Columbia Generating Station RO - 1 SROI - 0 SROU - 0 LSRO - 0 Total for Columbia Generating Station: 1 Sites: WNP Orgs: 4620 Exam Author:ALL

Page 3 of 4 04/04/2003 Report 21 Region: 4 14:16:09 Operator Licensing Exam Schedule From 10/01/2002 To 09/30/2003 Phase Code: 5 Operational summary By Site WNP - Columbia Generating Station RO-7 SROI - 6 SROU - 3 LSRO - 0 Total for Columbia Generating Station: 16 Sites: WNP Orgs: 4620 Exam Author:ALL

I I~v A4.

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examinatlon I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any Information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to Instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented In the facility licensee's procedures) and understand that violation of the conditions of this agreement may result In cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will Immediately report to facility management or the NRC chief examiner any Indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of _

. From the date that I entered Into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY S

ATURE (1)

DATE SI E (2) DATENOTE

2. tA 3.PJAW, arm0

!egs k

ga--

u e

w-

4.

-4x-~jy 4K r---

-5 so i tn e

6.

.uf._

NOTES:#

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24