ML032380154

Feb 2003-301 Exam Administrative Documents

ML032380154
Person / Time
Site:	Brunswick
Issue date:	09/09/2002
From:	Ernstes M Operator Licensing and Human Performance Branch
To:	Keenan J Carolina Power & Light Co
References
50-324/03-301, 50-325/03-301
Download: ML032380154 (14)

Text

Administrative Documents BRUNSWICK EXAM 50-2003-301 50-325 & 50-324 FEBRUARY 10 - 14 & 19,2003 Exam Preparation Checklist.................... ES-201-1 Exam Outline Quality Checklist................. ES-201-2 Exam Security Agreement..................... ES-201-3 Administrative Topics Outline (Final)............. ES-301-1 Control Room Systems and Facility Walk-through Test Outline (Final).,.................................. ES-301-2 Operating Test Quality Check Sheet............. ES-301-3 Simulator Scenario Quality Check Sheet.......... ES-301-4 Transient and Event Checklist.................. ES-301-5 ES-301-6 Competencies Checklist......................

Written Exam Quality Check Sheet.............. ES-401-7 rif 11.p&t%ten Exam Review Worksheet................ ES-401-9

@I

2.

Written Exam Grading Quality Checklist.......... ES-403-1

@-+ 13.

Post-Exam Check Sheet......................

J ES-501-1

ES-201 Examination PreDaration Checklist Form ES-201-1 (R8.Sl)

12. Examinations reviewed with facility licensee (C.1.i; C.2.f & h; C.3.g)

Facility: Brunswick Steam Electric Plant U 1 & 2 Date of Examination: Februarv 2003 Examinations Developed by:

Facility / NRC (circle one)

RSB Target Date*

14. Final applications reviewed; assignment sheet updated; waiver letters sent (C.2.g, ES-204)

15. Proctoring/written exam admin,istration guidelines reviewed with facility licensee and authortzation granted to give written exams (if applicable) (C.3.k)

16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (c.3.i)

-1 80

-1 20

-1 20

-1 20 W I

-75

-70 RSB RSB RSB

-45

-30

-14

-14

-14

-7

-7

-7

-7 Task Description / Reference Chief Examiner's Initials

~~

1. Examination administration date confirmed (C.l.a; C.2.a & b) 1 RSB

~

2. NRC examiners and facility contact assiqned (C.1.d; C.2.e)

I RSB

~

~

3. Facility contact briefed on security & other requirements (C.2.c)

I RSB

~~

4. Corporate notification letter sent (C.2.d)

I RSB

~~

~

[5. Reference material due (C.1.e; C.3.c)l I

RSB

~~

~

6. lnteqrated examination outline(s) due (C.l.e & f; C.3.d)

I Region IlRSB

7. Examination outline s) reviewed by NRC and feedback provided to facility licensee (d.2.h; &.e) 1 RSB

8. Proposed examinations, supporting documentation, and reference materials due (C.l.e, f, a & h: C.3.d)

I RSB

~

~

9. Preliminarv license aDplications due (C.1.I; C.2.g; ES-202) 1 RSB

10. Final license a lications due and assignment sheet prepared (c.1.I: c.2.a: ~F-202) 1 RSB

11. Examination ap roved by NRC supervisor for facility licensee 1

RSB review (C.2.h: 23.f)

13. Written examinations and o erating tests approved by NRC SuDervisor (c.2.i: c.3.h I

RSB Target dates are keyed to the examination date identified in the corporate notif/cation letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

Applies only to examinations prepared by the NRC.

[ ]

ES-201 Examination Outline Form ES-201-2 (R8,Sl)

Quality Checklist pciJ Item -

1.

W R

I T

T E

N -

2.

S I

M

3.

W I

T

4.

G E

N E

R A

L Brunswick Date of Examination Task Description

a. Verify that the outline(s) lit@) the appropriate model per ES-401

a. Author

b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KIA categories are appropriately sampled.

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

d. Assess whether the justilications for deselected or rejected KIA statements are appropriate.

a Us ng Form ES-301-5. verify that the proposed scenario sets cover tne req.. red number 01 norma evoluions, instrxnent ana component faildres. and major tiansients

b. Assess whether there are enough Scenario Sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s)',

and scenarios will not be repeated over Successive days.

c. To the extent possible. assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

a. Verify that:

(1) the outline(s) contain@) the required number of control room and in-plant tasks, (2) no more than 30% of the test material is repeated from the last NRC examination.

(3)' no tasks are duplicated from the applicants' audit test(s), and (4) no more than 80% of any operating test is taken directly from the licensee's exam banks.

b. Verify that:

(1) the tasks are distributed among the safety function groupings as specified in ES-301, (2) one task is conducted in a low-power or shutdown condition, (3) 40% of the tasks require the applicant to implement an alternate path procedure, (4) one in-plant task tests the applicant's response to an emergency or abnormal condition. and (5) the in-plant walk-through requires the applicant to enter the RCA.

c. Verify that the required administrative topics are covered, with emphasis on performance-based activities.

d Determine if there are enodgh aillerent oulllnes to test tne pro ected nJmber and mix of appl cants and ensue that no ilems are a~plicated on SLcceSSive days

a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam section.

b. Assess whether the 10 CFR 55.41143 and 55.45 sampling is appropriate.

c. Ensure that WA imporiance ratings (except for plant-specific priorities) are at least 2.5.

d. Check for duplication and overlap among exam sections.

e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RO or SRO).

b. Facility Reviewer r)

, NRC Chief Examiner (#)

cl. NRC Supervisor February 2003 lnitia Note:. Not applicab e lor NRC-aeveloped exam nations.

b Independent NRC reviewer.nilial items n Colwnn 'c:" cnief examiner concdrrence req~ired.

ES-301 Administrative Topics Outline Form ES-301-1 (R8, SI)

Administrative TopiclSubject Describe method of evaluation:

1. ONE Administrative JPM, OR A. 1 scription GEN 2.1.33/2.2.12 A.l.l

2. TWO Administrative Questions JPM Complete Jet Pump Operability per OPT-13.1 Note: Data will indicate a failed Jet Pump.

A.1.2

~~

~~

GEN 2.1.5 (2.3/3.4)

A.2 A.3 A.4 JPM Evaluate Overtime Eligibility SEN 2.2.14/2.2.11

2.5)

JPM Given an approved Temporary Change (TC) make the necessary changes to the applicable drawings.

GEN 2.3.10 (2.9/3.0) 2.3.1 (2.6/3.0)

GEN 2.4.39 (3.3/3.1) 1..

You have been notified by the Refuel Floor SRO that a spent fuel element has just dropped into the fuel pool and he is evacuating the reactor building.

A.

What action must you take to protect yourself from any ensuing radiation? (.5)

How long do you have to accomplish this? (.3)

And What is the allowable stay time in the Control Room. (.2) Cite References.

B.

C.

2.

Determine which operator of obtains a lower dose for 2 operators using different paths.

JPM Estimate Release from Unit 1 Reactor Building and Turbine Building Per PEP-03.6.1.

O:\\Brunswick Examinations\\lnitial Exam 2003-301\\QA forms\\Brunswick 2003 ES-301-1 Administrative Topics Outline RO (final).wpd

fl Form ES-301-1 R8, SI)

ES-301 Facility: -Brunswick Examination Level (circle one): RO / SRO Operating Test Number:

Date of Examination: -February 2003 Administrative TopiclS u bject I

A. 1 A.l.l A.1.2 A.2 A.3 A.4 scription GEN 2.1.3312.2.12 (4.0)

GEN 2.2.3212.2.27 (3.5)

GEN 2.2.1412.2.11 (3.0)

GEN 2.3.6 (3.1)

GEN 2.4.40 (4.0)

Describe method of evaluation:

1. ONE Administrative JPM, OR

2. TWO Administrative Questions JPM Complete Jet Pump Operability per OPT-13.1 Note: Data will indicate a failed Jet Pump.

~~~

~

~

~

JPM Using a prepared, partial view of the newly refueled core and Core Loading Plan, determine if the core loading has been done correctly.

JPM Given an approved Temporary Change (TC) complete SRO responsibilities for installation per OOLP-22.

JPM Given data provided by the on-shift Chemistry Technician, issue a Liquid Radwaste Discharge per OOP-06.4 JPM Determine Off-Site Release Per PEP-03.4.7 and Recommend Protective Actions.

O:\\Brunswick Examinations\\lnitial Exam 2003-301\\QA forms\\Brunswick 2003 ES-301-1 Administrative Topics Outline SRO (final).wpd

ES-301

b. Reduce RPV water level using RWCU to Radwaste (BNP-

c. Emergency equalization around MSlVs using Hard Card (BNP-03-A1 C)

Control Room Systems Form ES-301-2 (R8, SI)

"S) 2 (DIP) 3 and Facility Walk-Through Test Outline

~

~

e. Vent the Drywell per OP-IO w/Stack Rad Monitor

f. Manual Startup of Control Building Emergency Ventilation -

Increase >50% (U) (BNP-03-Ble)

Trip of One Fan (U),

(BNP-03-Blf)

Facility: -Brunswick Exam Level (circle one): RO I SRO(I) I SRO(U)

B.l Control Room Systems Date of Examination: -February 200:

Operating Test No.:

(D)(A)(S) 5 (N)(A)(S) 9 System I JPM Title

a. Start RClC from remote S/D Panel (U) (BNP-03-B2a)

b. Local Manual Start Of " A DG using Prelube Start Control (BNP-03-B2b)

a. Reactor Recirculation Pump Start - Recirculation Pump Speed Control Failure ( BNP-03-B1 a)

(D)(R) 2 (D) 6 I

Type 1

Safety Code*

Function

c. Fire Water Injection Using The Motor Driven Fire Pump (U)

(BNP-03-B2C)

(M)(R) 8

d. Shutdown Cooling Restoration With RHR Pump overload.

4 (BNP-ObB1 d)

~~

g. Core Performance Parameter Check-manual APRM GAF Adjustment Required (jJ) (BNP-03-Blg)

ES-301 Operating Test Quality Checklist Form ES-301-3 LJ Facility: /?R U 45 L)

I Date of Examination: a/;

D / o 3 Operatir

1. GENERAL CRITERIA

a.

The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g.. 10 CFR 55.45, operational importance. safety function distribuh'on).

There is no day-to-day repetition between this and other operating tests to be administered during this examination.

The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.1.a).

Overlap with the Hnitten examination and between operating test categories is within acceptable limits.

It appears that the operating test will differentiate between competent and less-thancornpetent applicants at the designated license level.

b.

C.

d.

e.

2. WALK-THROUGH (CATEGORY A & B) CRITERIA

a.

Each JPM includes the following, as applicable:

. initial conditions

. initiating cues

. references and tools. including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee

. specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

. system response and other examiner cues

- statements describing important ObSeNationS to be made by the applicant

~ criteria for successful completion of the task

- identification of critical steps and their associated performance standards

~ restrictions on the sequence of steps, if applicable

b.

The prescripted questions in Categoly A are predominantly open reference and meet the criteria in Attachment 1 of ES-301.

Repetition from operating tests used during the previous licensing examination is within acceptaMe limits (30% for the walk-through) and do not canpromise test intwrity.

At least 20 percent of the JPMS on each test are new or significantly modified.

C.

d.

3. SIMULATOR (CATEGORY Q CRITERIA

a.

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-3014 and a copy is attached.

Printed Name I Sianature A

Test Number:

Initials Date IZJL/O

a. Author

b. Facility Reviewerr)

I+

c. NRC chief Examiner (#)

Z H Q J

d. NRC SupeM'sor 1/6/03

~

NOTE

• The facllity Signature is not applicable for NRC-developed tests.

I I

ES-301 Simulator Scenario QualiW Checklist F

o

~

ES-301-4 I

3.

Each event description ms'sts of the point in the scenario vhen it is to be initiated the malfuncbion(s) !hat are entered to iniSate the event NUREG-1021, Revision 8, Supplement 1 24 of 26 i

-1

Transient and Event Checklist Form ES-301-5 (R8, SI)

ES-301 OPERATING TEST NO.: 1 - 3 u

c As RO SRO-I As SRO SRO-U I

ES-301 Competencies Checklist Form ES-301-6 (R8, SI) 7 Competencies Understand and Interpret Annunciators and Alarms Diagnose Events and Conditions Understand Plant and System Response Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact With the Crew Demonstrate Supervisory r Ability (3)

Comply With and Use Tech. Specs. (3)

Notes:

Applicant # I RO SCENARIO I

I I

j-+f 6.7.8 12.3 1 3 1.2,

,6,4, 4.5.6 3.4 5

1.2.3 1.2.3 1.2.

.4.5 A5.

3.4 6.7.8 6.7 Applicant #2 Applicant #3 1

SRO-U SRO-I SCENARIO SCENARIO RO SRO (1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

Gilbert Johnson i/

NRC Reviewer:

Richard S. Baldwin

-~

ES-401 Written Examination Form ES-401-7 Quality Checklist I

, Initial,

11 Item Description

1.

2.

Questions and answers technically accurate and applicable to facility

a. NRC WAS referenced for all questions

b. Facility learning objectives referenced as available ROISRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or e audit exam was completed before the license exam was started; or s"

the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) percent from the bank at least 10 percent new, and the rest modified); enter the actual question

3.

4.

5.

6.

Bank use meets limits (no more than 75 Bank Modified New distribution at right

\\ sfio 39 YO (0 //

2% 49 Date

a. Author

b. Facility Reviewer r)

c. NRC Chief Examiner (#)

d. NRC Regional Supelvisor Note:

• The facility reviewer's initialslsignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column IC;" chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46

Written Examination Grading Quality Checklist Form ES-403-1 (R8, SI)

ES-403 LJ

6.

Performance on missed questions checked for training Printed Name / Signature Date

- A M z.

a. Grader P

ichard S. Baldwin 2/26/03

b. Facility Reviewerr)

NIA

c. NRC Chief Examiner (*) Georae

&7* T. Hotme

d. NRC Supervisor (*)

(*)

2/26/03 mL.&A/C. C A -

3 h-LJ Michael E. Ernstes The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-501 Post-Examination Check Sheet Form ES-501-1 (R8, SI)

Task Description Date Complete

1.

Facility written exam comments or graded exams received and I 02/25/03 verified complete

2.

Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary Operating tests graded by NRC examiners

3.

02/26/03 03/07/03

~

~

~

~

~

4.

NRC Chief examiner review of written exam and operating test grading completed

5.

Responsible supervisor review completed

6.

Management (licensing official) review completed

7.

License and denial letters mailed I

NA 03/07/03 0311 3/03 0311 3/03

a.

Facility notified of results

9.

Examination report issued (refer to NRC MC 0610) 03/13/03 03/13/03 I O.

Reference material returned after final resolution of any.

appeals NA