ML032680765

Various Checklists for Palisades Initial Examination - July/Aug 2003

ML032680765
Person / Time
Site:	Palisades
Issue date:	07/21/2003
From:	Hensley D Nuclear Management Co
To:	NRC/RGN-III
References
50-255/03-301
Download: ML032680765 (17)

Text

VARIOUS CHECKLISTS FOR THE PALISADES INITIAL EXAMINATION - JULY/AUG 2003

Form ES-201-3 ES-201 Examination Security Agreement

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of XI.1 4-as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the,best of my know1 dge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week@) ofr{y w. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2) DATENOTE

N M C ~

r Committed to Nuclear Excellence Palisades Nuclear Plant Operated by Nuclear Management Company, LLC 7

June 3,2003 Mr. Dell McNeil Nuclear Regulatory Commission Region I l l 801 Warrenville Road Lisle, IL 60532-4351 PALISADES NUCLEAR PLANT INITIAL LICENSE EXAMINATION Nuclear Management Company, LLC, is submitting the initial license examination for the Palisades Nuclear Plant, in accordance with NUREG-I 021, Operator Licensing Examination Standards for Power Reactors, Revision 8, Supplement 1. The initial license examination is scheduled for July 21, 2003, through August 1, 2003. The following materials are enclosed:

ES-301-3, Operating Test Quality Checklist ES-301-4, Simulator Scenario Quality Checklist, final version ES-301-6, Competencies Checklist, one for each group ES-401-7, Written Exam Quality Checklist, one for Senior Reactor Operator (SRO) and one for Reactor Operator (RO)

ES-301-2, Control Room Systems and Facility Walk-through Test Outline, (updated)

Certification of no duplication with audit exam 125 written exam questions, including distractor analysis, supporting references, and original form of bank question (as appropriate) 3 simulator scenarios (Scenario 1, Scenario 2, Scenario 3) 30 job performance measures (JPMs) (20 system, 10 administrative)

CD-ROM with applicable Palisades references Hard copy of Technical Data Book 27780 Blue Star Memorial Highway Covert, MI 49043 Telephone: 61 6.764.2000

2 Pursuant to NUREG-1021, these materials shall be withheld from public disclosure until after the examinations are complete.

Please contact Darrell Hensley at (269) 764-21 33, if you have any questions regarding this submittal.

Doudlas E. Cooper Site Vice-president, Palisades Enclosure

ES-301 ODeratina Test Quality Checklist Form ES-301-3 Facility:

Date of Examination:

Operating Test Number:

I

1. GENERAL CRITERIA

. initial conditions

. initiating cues

. references and tools, including associated procedures s reasonable and validated time fimk (average time allowed for completion) and specific s specific performance criteria that include:

designation if deemed to be time critical by the facility licensee

- detailed expected actions with exact criteria and nokenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completlon of the task

- identificatlon of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable 4

ory A are predominantly open reference and meet the Date Printed Name I Signature

a. Author

b. Facility Reviewerr)

c. NRC Chief Examiner (#)

7// 5/&3

d. NRC Supervisor NOTE:

The facility signature is not applicable for NRCdeveloped tests.

1. Independent NRC reviewer initial items in Column 'c:" chief examiner concurrence required.

23 of 26 NUREG-1021, Revision 8, Supplement 1

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 (R8, SI)

QUALITATIVE ATTRIBUTES 11 Facility: PALISADES I

I Date of Exam: July 2003 Scenario Numbers: 1 I 2 I 3 Operating Test No.: 1 Initials a

b*

c#

1.

The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.

The scenarios consist mostly of related events.

2.

3.

Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

I

4.

No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.

The events are valid with regard to physics and thermodynamics.

5.

6.

Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

7.

If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.

The simulator modeling is not altered.

ll 8.

The scenarios have been validated. Any open simulator performance deficiencies have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.4 of ES-301, All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

12.

Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

13.

The level of difficulty is appropriate to support licensing decisions for each crew position.

!?@ dp I

TARGET QUANTITATIVE ATTRIBUTES (PER SCENARIO; SEE SECTION D.4.D)

Actual Attributes

1.

Total malfunctions (5-8) 6 1 8 1 7 1

1 2

1 2

2.

Malfunctions after EOP entry (1-2)

ES-301 competencies Checklist Form ES-301-6 (R8, SI)

PALISADES Understand Plant and System Response Use Procedures (1)

Boards (2)

Comply With and Operate Control Applicant #I RO-1

~

1,2,4,6 2,4,5,6,7 9

All Ail 2,4,5,6,7 1,2,6,7 Applicant #2 R O - 2 2'415'7' 9

Applicant #3 R O - 3 1,2,4,5,8 SCENARIO SCENARIO SCENARIO Competencies I

2 I

2 3

1 4

I Understand and Interpret Annunciators and Alarms Diagnose Events and Conditions All 2,4,5,6, 7

I All I

All All All Notes:

(1 ) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

NRC Reviewer:

Palisades Nuclear Plant July 2003

ES-301 Competencies Checklist Form ES-301-6 (R8, SI)

PALISADES 314'5161 7,8,9 I

3,5,8,10 Competencies 3'4'5'627 8,9 Understand and Interpret Annunciators and Alarms 3,5,8,10 Diagnose Events and Conditions Understand Plant and System ResDonse Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact With the Crew Demonstrate Supervisory Ability (3)

Comply With and Use Tech. Specs. (3)

Applicant #4 SRO - I {I)

SCENARIO I l 2

---I--

2,5,6,7,9 2,3,10 All 1

All 2,3,5,8,10 Ti-T Applicant #5 SRO - I (2)

SCENARIO 1'2'4' 2,4,9 All All All Notes:

(1 ) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Applicant #6 SRO -l(3)

SCENARIO 4-2,3,5,8,10 I All I

All Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

NRC Reviewer:

Palisades Nuclear Plant July 2003

ES-301 Competencies Checklist Form ES-301-6 (R8, SI)

PALISADES 4,5,7 Applicant #7 SRO - I(4) 3,7,9 Applicant #8 SRO - I(5)

Applicant #9 SRO - I (6)

SCENARIO SCENARIO SCENARIO Competencies I

3 1

4 2 I 3-1 1

2 3

4 5 7 3,4,5, 6,7,8, 9

2,4,5 Understand and Interpret Diagnose Events and Conditions 3,6,7 3,6 3,4,5, 3-58, 10 23, 10 I

Understand Plant and System Response Comply With and Use Procedures (1 )

Operate Control Boards (2)

Communicate and Interact With the Crew Demonstrate Supervisory Ability (3)

I 21383 I

All I All All I All

• I' I

All All 2 4,

5,6, 7

2,3,5!

8,lO All 1

All All All All 1 I Comply With and Use Tech. Specs. (3) 3,7 I

3,7 I

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

NRC Reviewer:

I Palisades Nuclear Plant July 2003

ES-30 1 Competencies Checklist Form ES-301-6 (R8, S I )

PALISADES

~

~~~

Applicant #I 1 SRO-U (2)

Applicant #I 2 SRO-U (3)

Applicant #I 0 SRO-U (1)

SCENARIO Competencies SCENARIO 3,4,7,9 I

2 Understand and Interpret Annunciators and Alarms Diagnose Events and Conditions Understand Plant and System Response Comply With and Use Procedures (1)

All I All AI1 I All All All Operate Control Boards (2)

Communicate and Interact With the Crew All I All All All Demonstrate Supervisory Ability (3)

Comply With and Use Tech. Specs. (3)

Notes:

All 4 s I

(I)

Includes Technical Specification compliance for an RO (2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

NRC Reviewer:

Palisades Nuclear Plant July 2003

ES-401 Written Examination Form ES-401-7 Quality Checklist I

Initial

5.

Question duplication from the license screening/audit exam was controlled as indicated below (check the item ttjat applies) and appears appropriate:

c

• the audit exam was systematically and randomly developed; or

~

the audit exam was completed before the license exam was started: or the examinations were developed independently; or z t h e licensee certifies that there is no duplication: or

3.

Question wntent conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified Question psychometric quality and format meet ES, Appendix E, guidelines IO.

3. Author

). Facility Reviewer r)

. NRC Chief Examiner (#)

1. NRC Regional Supervisor Jote:

The facilitv reviewets initials/sianature are not aDDlicable for NRC-developed examinations.

1. Independent NRC reviewer inical items in Column c; chief examiner concurrence required.

NUREG-1 021, Revision 8, Supplement 1 42 of 46

ES-40 1 Written Examination Form ES-401-7 Quality Checklist Facility:

l i s a d a Date of Exam: T u [ V m3 Exam Level:@

RC I

1 Initial Item Description a

b' c'

1.

2.

Questions and answers technically accurate and applicable to facility

a. NRC WAS referenced for all questions

b. Facility learning objectives referenced as available I

3.

4.

5.

ROISRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item tbat applies) and appears appropriate:

' the audit exam was systematically and randomly developed; or

~

the audit exam was completed before the license exam was started; or T the examinations were developed independently; or

/the licensee certifies that there is no duplicati,on; or b

other (explain)

6.

Bank use meets limits (no more than 75 Bank Modified New percent from the bank at least 10 percent new, distribution at right the exam (indudlng 10 new questions) are written at the comprehensionlanalysis level; enter the actual question distribution at right and the rest modified); enter the actual question 38 8

s4

7.

Between 50 and 60 percent of the questions on Memory CIA 44 58

9.

3.

. Referenceslhandouts provided do not give away answers Question wntent conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified Question psychometric quality and format meet ES, Appendix 8, guidelines The exam contains 100, one-point, multiple choice items: the total is correct and

10.

1 1.

--P--

1

3. Author I. Facility Reviewer (*)

. NRC Chief Examiner (#)

1. NRC Regional SupeM'sor qote:

The facility reviewer's initialskignature are not applicable for NRCdeveloped examinations.

1. Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46

ES-30 1 Control Room Systems Form ES-301-2 (R8, SI) and Facilitv Walk-Throuah Test Outline System / JPM Title

a.

Perform a Dropped Rod Test Facility: PALISADES Date of Examination: JULY 2003 Exam Level (circle one): SRO Operating Test No.: 1 Type Safety Code*

Function DLS 1

(1 5.1 Control Room Systems NLS

b.

Align Charging Pump Suction to SIRWT DS G.

Alternate Pressurizer Pressure Controllers N LS

d.

Latch and Rollup the Main Turbine 2

3 4

DLR

a.

Alternate Methods of Auxiliary Feedwater II I

I 4

Vent Reactor Head Gases

)I e.

I I

DLSA 5

Shift CCW Pumps ll f.

1 MSA I

8 Manually Divert to Radwaste II g.

I NSA 1

9 Manually Transfer Y-50 ABT II b.

I DLA I

6 Manually Start P-41 Fire Pump 11 c.

8 I

NL I

• Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room, (S)imulator, (L)ow-Power, (R)CA

ES-301 Control Room Systems Form ES-301-2 (R8, SI) and Facilitv Walk-Throuah Test Outline Type Code*

Facility: PALISADES Date of Examination: JULY 2003 Exam Level (circle one): RO Operating Test No.: I B.l Control Room Systems Safety Function System / JPM Title DLSA MSA NSA Perform a Dropped Rod Test I1 a.

5 8

9 Align Charging Pump Suction to SIRWT Alternate Pressurizer Pressure Controllers

d.

Latch and Rollup the Main Turbine

e.

Vent Reactor Head Gases

f.

Shift CCW Pumps

g.

Manually Divert to Radwaste B.2 Facility Walk-Through

a.

Alternate Methods of Auxiliary Feedwater I/

Manually Transfer Y-50 ABT Manually Start P-41 Fire Pump DLS 1

1 NLS 1

4 DLA 1

6 NL 1

8

• Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room, (S)imulator, (L)ow-Power, (R)CA

Certification of No Duplication with Audit Exam Per NUREG-1021, rev 8, Supplement 1, ES-401, C.l.f, please be informed of the following:

1.

As the Exam Author, I, Darrell D. Hensley hereby certify that 1 have prepared the Palisades Nuclear Plant July 2003 Initial License Exam.

AND

2.

Both exams were prepared such that there is NO duplication, or potential of compromise, between the audit exam and the license exam. Specifically, please note the following points:

The licensing exam was prepared using the systematic random sampling process in strict accordance with NUREG-1021, rev 8, Supplement 1. Comparing the resulting written exam questions on the licensing exam with the written exam questions on the facility audit exam indicates NO duplication of exam questions, and NO potential for compromise of the written licensing exam.

Addition a I Inform at ion I, as the Exam Author, did prepare several quizzes and comprehensive exams for the License Class during the early and middle part of the class. These quizzes and exams were completed and graded well before starting development of the Initial Licensing Exam. I certify that this activity resulted in NO compromise of the initial licensing exam.

Darrell D. Hensley a

Palisades Facility Representative and Exam Author palisades nuclear plant July 2003 initial license exam

ES-403-1 Item Description Written Examination Grading Quality Checklist a

Facility: PALISADES Date of Exam: August 01,2003 Exam Level: RO

1.

2.

Clean answer sheets copied before grading Answer key changes and question deletions justified and documented 2.d nla

3.

Applicants scores checked for addition errors (reviewers spot check > 25% of examinations)

Grading for all borderline cases (80% +I-2%) reviewed in detail All other failing examinations checked to ensure that grades are justified Performance on missed questions checked for training questions missed by half or more of the applicants

4.

5.

6.

deficiencies and wording problems; evaluate validity of 71J nla nla 2k, Initials

$I?

nla

b. Facility Reviewer(*)

nla

c. NRC Chief Examiner (*) BAh /~&/G/L,/

/gi&+?M @!$if

+

nla nla nla Date nla

, - r -.-

I

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403-1 Item Description 1.

2.

Clean answer sheets copied before grading Answer key changes and question deletions justified and documented Applicants scores checked for addition errors

3.

(reviewers spot check > 25% of examinations)

Written Examination Grading Quality Checklist a

b C

.fro' n/a k n/a n/a n/a At/

n/a L

L

)I Facility: PALISADES Date of Exam: August 01,2003 Exam Level: SRO I

4.

Grading for all borderline cases (80% +/- 2%) reviewed in detail n/a I

Initials n/a n/a

5.

All other failing examinations checked to ensure that grades are justified n/a n/a n/a

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants A-3J n/a

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC: two indePendent NRC reviews are reauired.