ML20153G642

Summary of 980715 Meeting with Representatives from Region II Facilities in Richard B Russell Bldg Re Operator Licensing Exam Techniques.Extends Invitation to Attend Training Managers Conference on 981105

ML20153G642
Person / Time
Site:	Summer
Issue date:	08/24/1998
From:	Peebles T NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION II)
To:	Gabe Taylor SOUTH CAROLINA ELECTRIC & GAS CO.
References
NUDOCS 9809300151
Download: ML20153G642 (96)

Text

.

?~

\\

August 24,1998 South Carolina Electric and Gas Company ATTN: Mr. Gary J. Taylor, Vice President Nuclear Operations Virgil C. Summer Nuclear Station P. O. Box 88 j

- Jenkinsville, SC 20065

SUBJECT:

MEETING

SUMMARY

AND

PUBLIC MEETING ANNOUNCEMENT

-JULY 1998 NRC REGION 11 EXAMINATION WORKSHOP AND NOVEMBER 1998 TRAINING MANAGERS' CONFERENCE - VIRGIL C. SUMMER NUCLEAR STATION

Dear Mr. Taylor:

Region 11 facilitated a workshop on Operator Licensing Examination Techniques on July 15, 1998, conducted at the Richard B. Russell Building. The workshop attendees included representatives from all Region il facilities. It is our opinion that the workshop was beneficial and provided an excellent opportunity for open discussion on the operating test portion of the operator licensing examination process.

During the workshop, we covered a pre'iminary response to concerns expressed at the January 1998 workshop and a synopsis was promised, but due to the status of the program, cannot be provided. The slides used for our discussions are enclosed.

Also, I would like to extend an invitation to you, and to rnembers of your operations and training staff, to attend this year's Training Managers' Conference to be held on November 5,1998. Our goal for the meeting is to provide an open forum for discussion of operator licensing issues.

The site for this year's conference will be in the Richard B. Russell Building Auditorium on Spring Street in downtown Atlanta. As of this date, the agenda is open. We encourage you to submit, via telephone, a list of topics that you would like to have discussed.

Additionally, we wouh appreciate an update of the home addresses of your licensed operators.

Please send them in an envelope marked "To Be Opened by Addressee Only" to either Ms.

Beverly Michael or myself. If you have any questions or need additionalinformation, please contact Bev at (404) 562-4640 or me at (404) 562-4638.

I Sincerely, (Original signed by T.A. Peebles)

Thomas A. Peebles, Chief Operator Licensing and Human Performance Branch Division of Reactor Safety Docket No.: 50-395 License No.: NPF-12

Enclosures:

As Stated 9909300151 980824 PDR ADOCK 05000395 V

PDR

.3, -

)

j e

-SCE&G' 2

cc w/encts:

T. Matlosz, Manager, Nuclear Training, i

V. C. Summer Nuclear Station S. Byme, Plant Manager, V. C. Summer Nuclear Station A. Rice, Manager, Nuclear Licensing and Operating Experience Distribution:

PUBLIC B. Michael, DRS i

l l

i i

f

. f '.fp t

(

t

j j, l\\CRS I

(

fgg Cpcu

/

/

200013-t Ril:DRS Ril:DRSg Cf -

POC T

ESBTM my.

~g41

i 4

OPERATING TEST WORKSHOP Richard B. Russell Auditorium July 15,1998 8:00 Opening Remarks (Johns Jaudon) 8:20 Standard JPM format (SSNTA) 8:40 JPM critical tasks (Hopper & Mellen)

What constitutes a critical task?

The importance of measurable criteria?

• Good examples

• Bad examples Discrimination (it has to be failable!)

• Good examples

• Bad examples 9:30 JPM Questions (Baldwin)

Direct look up. As defined in ES-602. Attachment 1, B.2.e (p.15)

• examples

• " fixes" to those examples Use of Open and Closed Reference items as defined in ES-301, D.1.1(p.9) which states:" closed reference items may be used to evaluate the immediate actions for emergency and other procedures, certain automatic actions, operating characteristics, interlocks, and set points.. "

• examples

• " fixes" to those examples 10:30 Administrative JPMs (Steiner) 11:00 Scheduling (Steiner)

• ways to optimize the material developed

• simulator bottle necks

• control room JPMs

• reasonable daily work loads

• candidate stress

• exam delays 11:30 Lunch 1:00 Exam predictability and exam security (Payne) 1:30 Simulator scenario development (Payne & Hopper)

• scheduling and crew makeup

• evaluation tool

• malfunctions in relation to major event

• level of detail 3:30 Questions and Answers 4:30 Closing g

s

t REGION 11 WORKSHOP - OPERATING TEST JULY 15.1998 Richard B. Russell Building Strom Auditorium l

l'

. David Lane Examiner-Sonalysts

{

l-Larry Kelley Training Advisor-OHN/Pickering 1

John Brewer Manager-Authorization Training - Ontario Hydro Nuclear Carolina Power and Liaht Company Tom Hackler Requal Training - Brunswick Curtis Dunsmore Initial Training - Brunswick

- Tony Pearson initial Training - Lead - Brunswick Terry Toler instructor - Harris Rick Garner Sperviisor-Ops Training - Harris Dwayne Coffey LOCT Supervisor - Robinson Dave Neal OIT Lead - Robinson Scott Poteat Support Lead - Robinson Duke Enerov Corporation - Catawba. McGuire. and Oconee David Re Training instructor -

Charles Sawyer Senior Tech Spec James Presten Instructor Brent Moore instructor Bill Caudill Nuclear Instructor -

E. T. Beedle Instructor - Catawba 1

Reggie Kimray Nuclear Instructor-Catawba l

John Supte ~

Operations - Catawba Rob Billings Instructor-McGuire 4

Steve Helms Instructor - McGuire 1

Robby Pope Supervissor - Mcguire Rick Robinson Ops Training Coordinator-Oconee Robin Lane Wning Instructor - Oconee J. R. Steely.

Training instructor-Oconee David Covar Nuclear Instructor-Oconee Randall Yarbrough Nuclear instructor - Oconee Bobby Ayers Ops instructor-Oconee Florida Power Corooration_

Ivan Wilson Ops Manager Jack Springer

. Supervisor - Training - Crystal River Johnie Smith Ops Training Supervisor-Crystal River

.1 l

l Operating Test Workshop 2

July 15,1998 l

Florida Power and Liaht Company Dave Brown initial Training - St. Lucie Tim Bolander Simulator and Exams - St. Lucie Mike Croteau instructor - Training - Turkey Point Rich Bretton LOCT Supervisor - Training - Turkey Point South Carolina Electric and Gas Company Jim Callicott Senior Instructor Perry Ramicone Instructor - V. C. Summer Southern Nuclear Operatina Comoanv. Inc. (SNC)

Tom Blindauer Senior Plant Instructor - Simulator - Farley Bill Oldfield Training - Farley Steve Be Training - Hatch Ken Drawdy Training Instructor - Vogtle Thad N. Thompson Ops Training Instructor - Vogtle Perry Tucker Ops Training instructor - Vogtle Michael Henry Nuclear instructor-Vogtle Leon Ray Ops Training Supervisor - Vogtle Fred Howard Ops Reg Instructor-Vogtle Perry Vannier Initial Training - Vogtle Charlton Sal Requal Training - Vogtle Steve Dyer Requal Training - Vogtle Tennessee Vallev Authority Phillip H. Case Simulator Instructor-NC Training Denny Campbell Ops instructor Browns Ferry Marvin Meer Ops Instructor-Browns Ferry Jim Kearney Ops instructor - Sequoyah Dave Davidson Ops instructor-Sequoyah Steve Taylor Ops Instructor - Sequoyah Ricky C. King Senior Ops Instructor - Sequoyah Ed Keyser Simulator instrurtor - Sequoyah Tom Wallace Supervisor-Watts Bar Terry L. Newman Ops Instructor - Watts Bar Jack Cox Training Manager-Watts Bar John Roden Ops Training Manager Watts Bar Randy Evans HLT Lead - Watts Bar

9 4

Operating Test Workshop 3

July 15,1998 Virainia Electric and Power and Power Company Walt Shura Supervisor-Training - Neith Anna Steve Crawford Senior Instructor (Nuclear)- North Anna Ken Grove Senior instructor - Surry Ray Simmons Senior Instructor-Surry l

c 4

I 1

I i

1

EXAM REVIEW GUIDELINES l

I.

TECHNICAL ACCURACY Is there more than one correct answer?

Is the given answer correct?

Adequatedatainthestem?

Is cata in the stem consistent and plausible?

II.

PSYCHOMETRICS: The process of applying sound qualitative processes to mental measurements.

PSYCH 01ETRIC FLAWS THAT COULD DIMINISH THE VALIDITY OF THE EXAMINATION!

FLAW

. GUIDANCE APPENDIX B REFERENCE

1. Low level of Question should be written to reflect App. B

./

knowledge the level of knowledge most 1.d appropriate for a specific K/A.

When there is a choice, try to write the question to reflect the higher level.

• SEE LEVEL OF KNOWLEDGE BELOW

2. Low operational Does the question test the intent of App. B validity the K/A?

1.a/b/e Could someone do the job safely and 2.k effectively without being'able to answer the question?

3. Low discriminatory Will a less than competent candidate App. B validity miss the item?

1.d Can a person understand the principle 2.g being tested and still miss the item?

• SEE LEVEL OF DIFFICULTY BELOW.

4. Implausible Can a distractor be eliminated with App. B Distractors out understanding the concept being 2.b/f/h/m tested?

5. Confusing or State the question as concisely as App. B ambiguous language possible but provide all necessary 1.c information.

6. Confusing negatives Avoid negative stems.

App.B 2.e

7. Collection of Each item should focus on one K/A App.B true/ false item determined by the stem.

1.f 2.c

8. backwards logic Examine on a topic in a way that is App.B consistent with how the K/A should be 1.h remembered and used.

LEVEL OF DIFFICULTY Establish a level of difficulty that will enable an ap31icant who is capable of safely operating the plant to complete and review t7e examination within four hours and achieve a grade of 80 percent or greater. [ES-401 p.4]

Since item difficulty can usually be decreased or increased by revision, the examination author need not be overly preoccupied with difficulty when writing the items. The author should focus on achieving a valid measure of the concept he is attempting to evaluate.

[ Appendix B, p.

6]

LEVEL OF KNOWLEDGE Level 1: FUNDAMENTAL KNOWLEDGE The recall or recognition of discrete bits of information.

- knowledge of terminology

- definitions

./

- set points

.other specific facts Level 2: COMPREHENSION Involves the metal process of understanding the material through relating it to its own parts or some other material.

- describing or recognizing relationships

- recognizing how systems interact l

- consequerces or implications of events Level 3: ANALYSIS. SYNTHESIS OR APPLICATION Involves assembling. sorting or integrating information to predict an event or outcome.

Requires mentally using the knowledge and its meaning to solve problems.

L l

i

NUREG-1021. APPENDIX B. GUIDANCE 1.

Generic Princioles a '.

Ensure that the concept being measured has a direct, important relation ship to the ability to perform the job.

b.

Make sure that the question matches the intent of the K/A.

c.

State the question unambiguously and precisely.

d.

Writ ~e the question at the highest level of knowledge reflected in the testing objective.

e.

Avoid questions that are unnecessarily difficult or irrelevant.

.f.

Limit the question to one concept or topic, unless a synthesis of concepts is being tested.

./

g Avoid copying text directly forma training or other reference material.

h.

Avoid backward logic questions.

2.

Other Construction Guidelines a.

Use four answers.

b.

Do not use "none of the above" or "all of the 'above" c.

Do not present a collection of true-false statements.

d.

Define the question task or problem in the stem.

i e.

Avoid using negatively stated stems when possible.

f.

Provided sufficient counter balance in questions w th multi-part

answers, g.

Include common misconceptions as Distractors.

h.

Make all answer options homogeneous and highly plausible.

I.

If the answers have a logical sequence. put them in order.

j.

Avoid overlapping answer options.

k.

Do not include trivial distractors with more important distractors.

1.

Vary the location of the correct answer.

m.

Avoid specific determiners that give clues as to the correct answer.

1 (1).

distractors that do not follow grammatically from the stem.

(2) 03tions that can be judged correct or incorrect without reading t1e stem.

(3) equivalent and /or synonymous options which rule out both options.

(4) an option which includes another option, i

(5) implausible distractors.

(6) a correct answer which is longer that the distractors.

(7) cualifiers in the correct answer unless they are used in i

cistractors.

(e.g. probably, ordinarily)

(8) words such as "never', "always" which suggest a wrong answer.

(9) a correct option that differs from the distractors in

./

favorableness, style, or terminology.

4 t-i

III.

BEANS SONS..

.Bf416.

..sOiG BEAN LIMIT REFERENCE Knowledge level questions

< 50 ES-401 p.4 SRO / RO overlap 5 75 ES-401 p.5 Questions 'from training class quizzes 5 25 ES-401 p.5 OR last two NRC exams.

Questions from licensee audit exam 50 ES-401 p.5

.(same author for audit exam)

./

Questions from licensee audit exam 55 ES-401 p.5 (independent author for audit exam)

Questions from licensee bank 5 50 ES-401 p.5 New questions at comprehension or 2 10 ES-401 p.5 analysis L

r l

t

i 9

l 4

I 1

1 f

a d

4 JPM CRITICAL TASKS i

AND MEASURABLE o

i CRITERIA I

4 G.

-033ER 1

4 i

V

._ \\

J 4

l

'l i

3.

Develop Performance Criteria The JPM should have meaningful performance requirements that will i

provide a legitimate basis for evaluating the examinee's ability to i

safely operate the system or the plant.

Artificially subdividing,

existing tasks to generate new ones may dilute the value of the JPMs to a point wh.ere they become meaningless.

1 c

The JPM shall identify specific performance standards, or check points, that will permit the examiner to evaluate successful progress toward i

completing the task in accordance with the procedural references.

Detailed control and indication nomenclature and criteria (e.g., switch positions and meter readings even if these criteria are no)t specified in the procedural step.s The JPM should also note any important observations that should be made by the examinee while performing the task.

i t

The JPM must clearly identify the task standard; i.e., the predetermined outcome (qualitative and/or quantitative) against wh.ich task performance l

will be measured. Hv.epygpt;o.cedura]gstep;that (6bVVeoMylg(drentaccurately,^iin the~ proper seq..the e.xaminee must perf i

iiide')$iIizor~difsto2laEcomplish the ' task standard shallibe ~ identified ictitica77tep and shall have an associated performance standard.

Ifi. there are any specific procedural restrictions on the sequence in 1

which the steps are performed they shall be clearly noted in the JPM.

i

l i

, Measura]~ e 3er =ormance Inc.iCa': ors

~

A measura.J e Jer =ormance incica :or consis:s o = Jositive ac: ions

la: an 0;] server can o.Jjec:ive~y icen~:i=y

a<en Jy an incivicua~ (/ crew).

xam'] es:

Ac: ions

acen in

le E03s suc1 as in resJonse

o an A~~WS.

~

Con:ro~

mani'Ju a : 1ons suc1 as a

manua reac:or

ri J or

.:le star: o

=

~

an

ECCS pum].

reJor:s or no:1 fica:1on o

=

VerJa ~

~

aJnorma Jarame:ers or conc 1:1ons.

l 1

~

\\on-meaSuraJ e >erformance

ncica : ors:

Veri =ica: ion

la: an ex'Jec:ec resJonse las occurrec:

.) Veri =ica: ion anc/or ensure s:eJs w1ic1 recuire no ac: ion.

3assiVe o.JserVa: ions suC1 as moni :oring

le 'Jer =ormance o = a sys:em.

4-

9 J.E IN.ED TAS( S~~ANDAR)S

~~

~

asc s:ancarcs slou c inc~uce oDjec:ive.recuiremen:s wi:1 a ~~

~

owaJ e

~

~:0 erances agreec u]on

.Jy

le "aci ~ i :y anc

le

\\ RC.

T1e acce3tance cri:eria must.3e ai e to ciscriminate/icenti=y aoor 1

performance 3ac Exam-]~es:

"I=

Jressure "a ~~ s

.Je ow :. LOO Jsi,

~

~

s:ar:

Jum:J is a 'Jer=ormance measure

1a:

is no: o3jec: 1ve.

~~he

~

o'Jera :or :Jer=orming

11s ~;as( cou c

~

conceivaJ y s:ar:

le JumJ w1en

Jressure reacles 0 'Jsi anc s: 1~

~

no:

vio~a:e

le :Jer=ormance measure s:a:ec in

le Jrocecure, even

lougl

~; 1e "aci~i:y ~icensee ex:Jec:s

le o:Jera :or ~:0 s :ar~;

le

Jum:J sooner.

~

~~1e

\\ RC anc =aci~ i :y

~ icensee snou c

agree in wri:ing

la:

le ~imi:s =or eac1 CS or C~~ are acce'Jta] ~ e.Je= ore

le examination.Jegins.

- or

le

~

exam 3 e given a.Jove, accing an

p l

acce'JtaJ e 3ressure to~erance (e.g..

~

wi:lin 200 :Jsi) wou~ c c~ ari =y

le s :ancarc :o-

'Jerformance ~:la : is ex:Jec :ec

"::mmecia :e? y Jora :e

le RCS i = ae~ ow u

l roc inser:lon lml :s 1ere ls no ce-lnr:1on 0-1mmecla e 1n

11s si :ua :i on.

Anywlere ~=orm one

o

en l

minu:es mlgT:

Je arguec as acce'J :a,3 e.

l l

n

3rocer Cueinc Ex:erna~

s:imu~us slou c 'Jrom3: an

~

o'Jera:or

o res'Jonc

.Jy

acing cer:ain ac:1ons.

~~

1e incica: 1ons o= a sys:em or a.comJonen~: ma

=unc; ion (inc~ucing Jassive

=ai~ ureslJy me:ers anc a arms

~

mus: Je accura :e anc. inc ucle a--

ex'3ec:ec. incications.

1 JOB PERFORMANCE MEASURE l

Pr' ovide this page to the Candidate i

l I

initial conditions:

l A Station Blackout has occurred on Unit 2. Unit 1 is in a LOOP with both Emergency Diesel Generators in service. The NPS and ANPS have determined the need to crosstie electrical power from the 1 A EDG to the 2A3 4.16 KV switchgear via the SBO AB Bus Crosstie.

Initiating Cue:

The ANPS has directed you to accomplish the Unit to Unit crosstie to the 2A3 4.16 KV Bus by performing 2-EOP-99, Table 7 and then 2-EOP-99, App. V within 10 minutes.

l l

0821129. Rev D2 Page 16 of 16 1

e l

JOB PERFORMANCE MEASURE i

(C) Indicates a Critical Step PERFORMANCE CHECKL!ST 1.

(C)

Element / Step OPEN and GREEN FLAG the following startup transformer breakers:

A.

Standard:

S.U. Transformer 2A (2-30102) l Cue:

GREEN LIGHT ON, FLAG GREEN B.

Standard:

S.U. Transformer 28 (2-30202)

Cue:

GREEN LIGHT ON, FLAG GREEN C.

Standard:

S.U. Transformer 2A (2-20102)

Cue:

GREEN LIGHT ON, FLAG GREEN D.

Standard:

S.U. Transformer 2B (2-20302)

Cue:

GREEN LIGHT ON, FLAG GREEN 2.

(C)

Element / Step Ensure the following breakers are GREEN FLAGGED and OPEN:

A.

Standard:

Aux Transformer 2A (2-30101 ) (2WB7)

Cue:

GREEN LIGHT ON, FLAG GREEN Standard:

Aux Transformer 2B (2-30201) (2W85)

Cue:

GREEN LIGHT ON, FLAG GREEN Comments-I I

l.

0321129, Rev 02 Page 6 of16

JOB PERFORMANCE MEASURE (C) indicafe's a Critical Step PERFORMANCE CHECKLIST

2. (Coni'd)

' 83.

Standard:

Aux Transformer 2A (2-20101) (1WBS)

Cue:

GREEN LIGHT ON, FLAG GREEN Standard:

Aux Transformer 2B (2-20301) (1WB4)

Cue:

GREEN LIGHT ON, FLAG GREEN C.

Element / Step Tie breakers between normal and emergency 4160V buses:

Standard:

4.16 KV Bus Tie 2A2-2A3 (2-20109) l Cue:

GREEN LIGHT ON, FLAG GREEN Standard:

4.16 KV Bus Tie 2A3-2A2 (2-20209 Cue:

GREEN LIGHT ON, FLAG GREEN

)

i Standard:

4.16 KV Bus Tie 2B2-2B3 (2-20309)

Cue:

GREEN LIG'HT ON, FLAG GREEN l

Standard:

4.16 KV Bus Tie 2B3-282 (2-20411)

Cue:

GREEN LIGHT ON, FLAG GREEN D.

Element / Step 4.16 KV Bus 2AB Tie breakers Standard:

Feed to 4.16 KV Bus 2AB (2-20208)

Cue:

GREEN LIGHT ON, FLAG GREEN Standard:

Incoming feeder from 4.16 KV bus 2A3 (2-20505) i Cue:

GREEN LIGHT ON, FLAG GREEN 0821129, Rev D2 Page 7 of 16 i

(.

i o

I

JOB PERFORMANCE MEASURE 2'

(C) indicates a Critical Step PERFORMANCE CHECKL!ST 2.D. (Cont'd)

Standard:

Incoming feeder from 4.16 KV bus 283 (2-20504)

Cue:

GREEN LIGHT ON, FLAG GREEN Standard:

Feed to 4.16 KV Bus 2AB (2-20409)

Cue:

GREEN LIGHT ON, FLAG GREEN 3.

(C)

Element / Step OPEN the following 4.16 KV feeder breakers to the station service transformers:

A.

Standard:

Station Service Transformer 2A1 (2-20110)

)

~ Cue:

GREEN LIGHT ON B.

Standard:

Station Service Transformer 2A5 (2-20210)

Cue:

GREEN LIGHT ON 4

C.

Standard:

Station Service Transformer 2A2 (2-20213)

Cue:

GREEN LIGHT ON 7

D.

Standard:

Station Service Transformer 2B1 (2-20310)

Cue:

GREEN LIGHT ON E.

Standard:

Station Service Transformer 2B2/2B5 (2-20402)

Cue:

GREEN LIGHT ON 0t21129. Rev D2 Page 8 of 1$

JOB PERFORMANCE MEASURE l

,s' (C) Indicates a Critical Step PERFORMANCE CHECKLIST 4

(C)

Element / Step OPEN and GREEN FLAG the following 480V feeder l

breakers from the station service transformers:

l l

A.

Standard:

480V Bus 2A1 Feeder (2-40103)

Cue:

GREEN LIGHT ON, FLAG GREEN l

1 l

B.

Standard:

480V Bus 2A5 Feeder (2-40361) l Cue:

GREEN LIGHT ON, FLAG GREEN l

C.

Standard:

480V Bus 2A2 Feeder (2-40219) l l

Cue:

GREEN LIGHT ON, FLAG GREEN l

D.

Standard:

480V Bus 2B1 Feeder (2-40419) l Cue:

GREEN LIGHT ON, FLAG GREEN l

E.

Standard:

480V Bus 285 Feeder (2-40653)

Cue:

GREEN LIGHT ON, FLAG GREEN i

F.

Standard:

480V Bus 2B2 Feeder (2-40503)

Cue:

GREEN LIGHT ON, FLAG GREEN 1

SAT UNSAT Comments:

i 1

\\

t e

0821129. Rev D2 Nge 9 of 16

y JOB PERFORMANCE MEASURE 4

(C) Indicatss a Critical Step PERFORMANCE CHECKLIST 5.

(C)

Element / Step OPEN the following 480V bus tie breakers A.

Standard:

480V Bus Tie 2A2-2AB (2-40220)

Cue:

GREEN LIGHT ON B.

Standard:

480V Bus Tie 2AD-2A2 (2-40702) i Cue:

GREEN LIGHT ON C.

Standard:

480V Bus Tie 2AB-2B2 (2-40706)

Cue:

GREEN LIGHT ON j

i D.

Standard:

460V Bus Tie 2B2-2AB (2-40504)

Cue:

GREEN LIGHT ON

)

j SAT UNSAT Comments:

m'

.;?'

l 0821123. Rev C2 hge 10 of 16 j

JOB PERFORMANCE MEASURE (C) Indicafes a Critical Step PERFORMANCE CHECKLIST 6.

(C)

Element / Step Establish communications with Unit 1 Standard:

ESTABLISH COMMUNICATIONS with Unit 1 via Gai-Tronics or

]

plant radio (if available).

Cue:

COMMUNICATIONS ARE ESTABLISHED 7.

Element / Step PLACE the following pump switches in the PULL TO LOCK position:

(C)'

A.

Standard:

2A ICW Pump l

i Cue:

SWilCH IN PULL TO LOCK B.

Standard:

2B ICW Pump Cue:

SWITCH IN PULL TO LOCK Stan jard:

2C ICW Pump Cue:

SWITCH 1N PULL TO LOCK (C)

D.

Standard:

2A CCW Pump Cue:

SWITCH IN PULL TO LOCK E.

Standard:

2B CCW Pump Cue:

SWITCH IN PULL TO LOCK

~

F Standard:

2C CCW Pump Cue:

SWlTCH IN PULL TO LOCK SAT UNSAT Comments:

0521129. Rev D2 Pa;ps 11 of 16

l l_

JOB PERFORMANCE MEASURE (C) Indicates a Critical Step PERFORMANCE CHECKLIST 8.

(C)

Element / Step Verify the EDG output breaker on the selected 4.16 KV bus is open l

Standard:

VERIFY the EDG output breaker on the selected 4.16 KV bus (2-20211)is OPEN

. Cue:

GREEN LIGHT IS ON. REPORT UNIT 1 IS READY TO CROSSTIE AB 4.16 KV BUSES.

9.

(C)

Element / Step Close in the Unit 2 SBO breaker Standard:

CLOSE IN the Unit 2 SBO breaker 2-20501.

Cue:

RED LIGHT ON 10.

(C)

Element / Step Request the Unit 1 control room to close the Unit 1 SBO breaker Standard:

REQUEST the Unit 1 control room to close the Unit 1 SBO breaker 1-20501.

Cue:

UNIT 1 ACKNOWLEDGES REQUEST.

END Element / Step TERMINATION i

Standard:

Student requests Unit 1 to close the Unit 1 SBO crosstie breaker.

Comments:

=

l l

l 3

Otr21129, Rev C2 Page 12 of 15

m _. _.. _ -. _ _ _... _. _ _ _. _..... _ _... _ _ _ _

Qj gwp/-e. Of D'TI" '

' ' ~'

JOB PERFORMANCE MEASURE i

(C) Indicates a Critical Step PERFORMANCE CHECKLIST 1

1.

Element / Step:

Review the EOOS log and determine if channel RM-26-18 (PAG-203) has been declared out of service.

Standard:

Verifies RM-26-18 is not out of service.

d'

• y Ep }p (

Cue:

RM-26-18 IS NOT OUT OF SERVICE p

p 2.

Element / Step:

. Check the Met Towerfor operability Standard:

Verifies Met Tower chart recorder working properly..

l Cue:

MET TOWER CHART RECORDER TRACKING PROPERLY.

{

3.

Element / Step:

Verify gas release permit properly filled out and authorized, enter release permit number and tank to be released on procedere.

)

Standard:

Verifies permit fliied out properiy and authorized, enters release permit number (98-007) and 2C GDT on procedure.

Cue:

98007 AND 2C GDT ENTERED ON PROCEDURE

4. (C) Eiernent/ Step:

Verify the following vaive alignment:

VS745 Closed V06142 Open V7071 Open V7070 Open V7072 Locked Ciesed VS742 Locked Closed Standard:

Verify all above listed vaives in proper positions

~ Cue:

VE745 FULLY CLOCKWISE V06142 FULLY COUNTERCLOCKWISE V7071 FULLY COUNTERCLOCKWISE V7070 FULLY COUNTERCLOCKWISE V7072 FULLY CLOCKWISE WITH LOCK ATTACHED V6742 FULLY CLOCKWISE WITH LOCK ATTACHED SAT UNSAT Comments:

0521163. Rev DO Page 5 of 12 O

JOB PERFORMANCE MEASURE l

(C) Indicates a Critical Step PERFORMANCE CHECKLIST 4.

Element / Step Check closed FCV-25-9, " Continuous Containment / Hydrogen Purge Control Valve Filter inlet."

Standard:

At the NON-SAFETY VENTILATION HVAC PANEL:

VERIFY CLOSED FCV-25-9 Cue:

0%, GREEN LIGHT ON, RED LIGHT OFF SAT' UNSAT

~

l Comments:

S. (C) Element / Step Throttle FCV-25-28," Continuous Containment / Hydrogen Purge Control Valve Bypass" to approximately 10% OPEN position.

Standard:

At the NON-SAFETY VENTILATION HVAC PANEL: POSITION FCV 28 to the open position UNTil the valve position indicates 10% OPEN Cue:

10%, BOTH RED & GREEN LIGHTS ON SAT UNSAT Comments:

i S.

Element / Step Start HVE-68," Shield Building Exhaust Fan."

Standard:

At the B TRAIN EMERGENCY VENTILATION HVAC PANEL:

POSITION HVE-6B contml switch to START Cue:

RED LIGHT ON, GREEN LIGHT OFF SAT UNSAT Comments:

D621056, Rev DG Page 6 of12 I

9 JOB PERFORMANCE MEASURE 4

C. 8 The system / equipment status reflects de overalt intent of what the JPM required upon completion.

D.

Correctfy perform all critical steps.

All steps where procedural guidance exists may be considered critical. Performance of Off-Normal Operating Procedure immediate actions will be from memory.

During the course of the JPM, there may be some tasks you will have to perform that will mquire you to implement contingency actions in order to complete them. Even in these' cases, you are expected to make decisions and take actions based on the indications available and in accordance with the facility's' procedural guidance.

liA;na Cue (s):

The ANPS has directed you to respond to the abnormal alarm LAW 1-0120035.

References:

ONP 1-0120035, Rev 1B During the performance of the task I will tell you which steps to simulate or discuss.

l Vertiali::e each step before you do it. This gives you a chance to self-check and use STOP during the performance of each task element.

Verify the position or condition of equipment or components by pointing to the instrumentation and providing a brief explanation of how the indication is used for verification.

I will provide you with the appropriate cues for steps which are simulated or discussed.

You may use any approved reference materiais normally available in the execution of this Job Performance Measure, including logs.

=

Do you understand these directions?

if you have any questions, ask them now, and I will answer them.

During the test I cannot answer questions.

When you complete all steps correctly, you will pass this job performance measure.

Begin the task now.

oe2ms. w os e.v w no

JOB PERFORMANCE MEASURE PERFORMANCE CHECKLIST f

1.

Eternent/ Step Verify pressurizer spray, proportional and backup heaters are operating property in automatic, Standarti:

OBSERVE any of the foidowing Pressurizer pressure indications on RTGB 103 and/or RTGB 106 ta DETERMINE improper automatic response:

PR-1100 PIC-1100X PIC-1100Y Pl-1102A Pb1102B Pi-1102C PI-1102D PIA-1102ALL PIA-1102BLL PIA-1102CLL PIA-1102DLL Observe the proportional heater control and indication for P-1 and P-2 Observe the B/U heater control and indication for banks B-1 through B-6 Observe the spray valve controller HlC-1100 NOTE TO EXAMINER: The CUES should provide sufficient information to diagnose the failure of the selected pressure channel LOW. tt should be recognized that Pressurizer pressure is actually increasing. All of the indicators listed may not be used by the operator when diagnosing this problem. The student may refer to Appendix "A" for expected automa*.ic responses.

Cue:

For PR-1100, PIC-1100X, PlC-1100Y :

SELECTED CHANNEL-DOWNSCALE LOW, NONSELECTED CHANNEL IS =2300 PSIA AND SLOWLY INCREASING For other Pl instruments:

INDICATED PRESSURE IS =2300 PSlA AND SLOWLY INCREASING For Pressurizer heaters:

SWITCHES IN AUTO, HEATERS LIGHTS INDICATE ON g.

For Pressurizer spray controller HlC-1100:

INDICATES NO OUTPUT SAT UNSAT Comments; h

i 052100, Rev 06 Par 5 ef 10 i

l JOB PERFORMANCE MEASURE

\\

(C) Indica [es a Critical Step PERFORMANCE CHECKLIST s

l

2. (C) Element / Step g the selected pressure channel has failed, Then shift to the operaole pressure channel.

Standard:

At RTGB 103: POSITION HS-1100 to the attemate pressure contro!

channel l

Cue:'

ALTERNATE CHANNEL SELECTED. PROPORTIONAL HEATER OUTPUT REDUCING, SPRAY VALVE OUTPUT RfSING, PZR PRESSURE RETURNING TO NORMAL /

l NOTE -The ANPS directs that the rest of the ONP be carried out.

SAT UNSAT Comments:

3.

F.lement/ Step Verify SE-02-03 and SE-02-04 " Auxiliary spray Valves *', are closed i

Standard:

At RTGB 103: DETERMINE keyswitches and indicating lights for SE-02-03 e

and SE-02-04 to be CLOSED Cue:

SE-02-03, SE-D2-04 GREEN LIGHTS ON AND RED LIGHTS OFF SAT UNSAT Comments:

4.

Element / Step Verify power operated relief valves are c!ased.

Standard:

At RTGB 103:: DETERMINE position indicating lights for both power operated relief valves CLOSED Cue:

PORV-1402, PORV-1404 GREEN LIGHTS ON AND RED LIGHTS OFF SAT UNSAT Comments:

ce210 c,Rev M Page 6 cf 10 I

i l

t JOB PERFORMANCE MEASURE 8

PERFORMANCE CHECKLIST 5.

Element / Step Ensure that PORVs V1402 and V1404 hand switches are in the proper position for existing plant conditions.

Standard:

At RTGB 103: DETERMINE PORVs hand switches are in NORMAL Cue:

PORVs HAND SWITCHES IN NORMAL SAT UNSAT Comments:

6.

Etement/ Step Verify pressure anomaly is NOT caused by a large rate of change of Tavg.

l Standard:

At RTGB 103: OBSERVE any of.the following indicsfions and DETERMfNE that Tavg is fairiy stable:

TR-1111X/1121X, Ti-1102A, TR-1115/1125, Ti-11028 TIA-1111X, T1-1102C, TIA-1121X, Ti-1102D, TIC 1111Y, TIC-1121Y

}

Cue:

Tavg HAS BEEN STABLE THROUGHOUT THE EVOLUTION SAT UNSAT Comments:

l i

END Element / Step TERMINATION

=

Standard:

The pressurizer pressure control system is responding properiy to control oressure at 2250 psia.

600. Rw D6 Page 7 of 10

l OPERATING TEST l

WORKSHOP i

l RUSSELL BUILDING JPM QUESTIONS i

l RICK BALDWIN JULY 15,

' 998 1

i

ES-301, D1(l}

l Sta :es~:

"he Drescriatec cues: ions or Ca':egories A anc B may inc uce a com 3l nation o~ 0 3en-anc c osec-re erence items. Open-reference i: ems t,at rec uire a 33 icants to apply t1eir knowledge o ':he olant to aos:u a:ec norma a3 norma anc emercency situatio,ns are preferred. C15 sed-reference i~: ems may be used :o i

eva uate t7e immeciate ac: ions o cer:ain automa':.otler 3rocecures, emerc ency anc Ic ac~: ions claracteristics inter oc<s, o3 era:Incse:.aoints a a 3 3ro ariate to he ~ aci i:y., Min'imize t7e use o" closed-reference c ues:lons :la:

re y sg e y on memory, anc avoid :le use o~ 0 3en-re~erence aue_stions-hgse answe.r can sinh aly be lo_oke_d wup if the applicant can "ind the correct _ document.

Re~er to Sec: ion 3.6 o more guidance regarc. Appendix Cor ing ~:le ceve 03 men: anc use o~ 03en re erence c ues~:lons ~or :le wa < ~:1roug 1 ~:es:.

Appendix C:

=

Sta:es:

6. Deve 03 Pre-scriatec ro low-u a Questiors If t7e JPM will 3e usec curinc an initia licensinc examination, it s' al"incluce a l

sufficieri: num 3er o 3rescriatec cuestions lwitl answers anc re"erences\\ to evalua':e ~:le examinee's uncerstancing o" two know ecqe anc/or a3ility (K/A1 sl sys:em or fas<atemen~tsrelatec to t7e

~

More tlan one cuestion may 3e recuirec to e=ective y eva uate some K/A statements.

Tle mos': a 3 3ro ariate "orma': "or ~:his a33 ication is t7e short-answer to compo, wlica recuires t7e examinee c uestion se a response ratler tla.n se.ec': from amonc a se': o~ a ':ernative res3onses as is ~."le case wi':1 mu ti3 e-cloice ma,tclinc, anc.truet.a se c uestio,ns.

Kee3 ~:le ~o owinc cuice ines, in adcition :o t7e ceneric item construction 3rincia es iri A33encix

i i

'3, in rninc w1en are3aring t7e c ues~:lons:

a. Provice clear, exa ici': cirections

/guice ines "or answering t.le cuestion so that the examinee uncerstancs what constitutes a fully correct response.

Choose words carefully to ensure tlat t7e stiau ations anc recuirements of t1e cuestion are a33roariately conve ec.

Worcs puc1 as,','evalu. ate " y'out ine,"ang ex 3 aln can invr:e a o~: o~ ce~:al tla: is n,ot necessari y re evan:.

3.

IV a <e sure :la': t7e answer key to) ponse matches {and is limitedquestion.quiremen in the resthe re W1en a33roana:e, Incicate t7e amoun~: o~~ 3ar:la crecr:

to 3e grantec "or an incomo ete answer.

Zor cuestions recuirinc com3uta': ion, specify the dearee of precision expected.

~~ry'fo ma <e t1e answer turn ou: to De w1o e num3ers.

.c. Avoic givinc away Jar: or a

.o ti.le answer b)LYle way t1e cuestion is worc ec

-or exam 3le:

"If the letcown line 3ecame 03structec, coulc 3 oration of t1e alant 3e accoma islec short y after a reactor tria to aut the alant in colc shu:cown ?

l~ so, how?"

A test-wise examinee can rea ize

':lat the answer las to 3e yes, or e se ~:he seconc 3 art o' t7e cuestion wou c have reac sometlinc ike "lf not, wly not?"

c. Avoic waa': cou c 3e consicerec

"': rick" c uestions in whic, ~:le answer

<ey coes not 3reciseb q~ uestion. For exama'/ matc1 t1e e as<inc "Fow co ~:le Si termination c, riteria" chdnge followinc a Si reinitiation?"

imalies tlat the':ermina': ion criteria will clance, w1en in ac':ua i~:y t1ey co not.

v

e. Avoid direct look-up quest. ions that only require the examinee to recall where to find the answer to the question.

T1e 03erationa orien':ation recuirec of c uestions on ~:le wa <-tarouc 1 ':es:

anc t7e examinee's access to ~

reference cocuments, arc ue acains':

t7e use o cuestions :laf tes': "or

~

reca anc memoriza': ion. Any questions that do not require a.ny analysis, synthes.is or application of inTormafion by th,e examinee should be answerable without the aid of reference materials.

Re er

~:o ES-602., A':':ac1 men': :, ~ or a more Ce ai ec ciscussion o cirec: oo <-u 3 C ues: ions.

orm ES-602

" \\RC C lec < is : ' or 0 3en-Re erence, Tes': I.: ems,"

con ~:ains a is: o~ c ues':lons ~:la: can 3e usec to eva ua':e t7e sui':aaii':y o

~:le "o ow-u a c ues':lons 3 a_nnec ~or

le wa < ~:1rouc 1 aor:lon o~ :le 03 era:inc :es':." A tlougl :he clec< is: was ceve 03ec or use in

~

evaluatinc rec ua i'ica': ion written examinations, t 9

' 0 mos': o t1e criteria (i.e., all excea anc the

(/A a33l. rating on i:em, 7}, are, genenca y Icable anc coulc De usec as a 3 asis for revisina or rejectinc aro 30sec walk-throuc, c ues: ions.

P J

e i

a 4

4

l^

?

i ES-602 NRC Checklist for Form ES-602-1 Open-Reference Test items s

l Test item Level 1.

Does each test item have a documented link to important licensee tasks, K/As, and/or facility learning objectives?

l 2.

Is each question operationally oriented (i.e., is there a correlation between job demands and test demands)?

3.

Is the question at least at the comprehension-level of knowledge?

4.

Is the context of the questions realistic and free of window dressing and backwards logic?

5.

Does the item require an appropriate use of references (i.e., use of analysis skills or synthesis of information either to discern what procedures were applicable or to consult the procedures to obtain the answer)?

6.

Is the question a " direct look-up" question, or does one question on the examination compromise another? A " direct look-up question"is defined as a question that immediately directs an licensee to a particular reference where the answer is readily available.

7.

Does the question possess a high K/A importance factor (3 or greater) for the job position?

8.

Does the question discriminate a competent licensee from one who is not?

9.

Is the question appropriate for the written examination and the multiple choice format?

10.

Do questions in Section A take advantage of the simulator control room setting?

11.

Does ary question have the potential of being a " double-jeopardy" question?

12.

Is the question clear, precise, and easy to read and understand?

13. - Is there only one correct answer to the question?

14.

Does the question pose situations and problems other than those presented during training?

15.

Does the question have a reasonable estimated response time?

l l

l:

l l

CONCLUSIONS I

@ 03en-re"erence c uestions whose answer can sima y 3e lookec ua if the a33licant can finc the correct l

cocument are NOT acceata3 e.

L

@ Analy. sis, Synthesis, Com arehen.sion cues':lons sloulc 3e usec to avoic cirect look-u a 3 rob ems.

@ On all cuestions where the exaectec resaonses are multiaart. we will notify the cancicate o" t7e num3er of known correct answers anc the l

numoer neecec for ful crecit.

@ Examiners will ask non-arescriotec follow ua c uestions, as necessary, to clarify or confirm the cancicate's uncerstancing of 3rescriatec cuestions or are-alannec tasks.

The followua cuestions s1ould 3e to "urther ex3 lore the lack of cancicate

~

i knowl cuest.ecge in ':le saecific area in ion 4

f dD Assign ooint values to each answer that n.as mu tia.e aarts,istency.

to ensure examiner gracing cons

@ Icentify on the cancicate's sheet the status of reference materia usage.

@ There is aro30 sal to im30se an allowance o"only 30% closec-reference c uestions of either Category A or B.

f 1

1 m

v

l DIRECT LOOK QUESTIONS l

WITH ACCEPTABLE CORRECTIONS t

I i

(

RO Admin.- A.1 (Fuel Handling), Question 1 l'

, 2.1.23 3,9/4.0 f

QUESTION:

Given the following plant conditions:

Reactor shutdown for refueling outage Unit offline:

1/1/9712:01 AM Entered Mode 3: 1/1/97 2:10 AM e

Entered Mode 4: 1/1/97 6:17 AM e

Entered Mode 5: 1/1/9711:45 PM What is the earliest date/ time core ofiload can conunence?

ANSWER:

1/5/97 6:10 AM 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> after shutdown

REFERENCE:

GP-010, " Refueling", step 5.3.1 l

I l

l l

l i

01/06/98 5:43 AM

AUTHORIZED COPY c

INIT

'~~

5.2:28 IF needed for SFP water clarity, THEN place the SFP skimmer in service IAW OP-910.

5.3 Fuel Assembly and Core Component Movement

]

'~~~'"""

NOTE:

A case evaluation has been performed IAW PLP-037 for each major evolution in this section. The case determination is defined prior to each applicable evolution.

Check that the Reactor has been suberitical for at least hq 5.3.1 ~

100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> AND record hours suberitical. (TRMS 3.12) hrs 5.3.2 Verify EST-001 is complete.

ENG NOTE:

The following equipment tests need to be completed prior to rnoving fuel.

5.3.3 Verify the following equipment necessary to support fuel off-load has been tested LAW EST-030 AND mark the equipment

~..

that is not needed to support fuel off-load N/A.

- Fuel Transfer System (Section 8.6.2)

ENG

- Manipulator Crane (Section 8.6.3)

ENG

- CV RCC Change Fixture (Section 8.6.4)

ENG

- New Fuel Handling Equipment (Section 8.4)

ENG

- NFB New Fuel Lift (Section 8.5.1)

ENG

- SFP New Fuel Monorail (Section 8.5.2)

ENG

- SFP Bridge Crane (Section 8.5.3)

ENG

- SFP New Fuel Elevator (Section 8.5.4)

ENG l

i Rev.36 Page 24 of 79

i Decay Time i-3.12 3.12 JECAY TIME TRMS 3.12 Movement of fuel within the core shall not be (CTS 3.8.1.h) initiated prior to 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> after shutdown.

APPLICABILITY:

MODE 6.

COMPENSATORY MEASURES CONDITION REQUIRED COMPENSATORY MEASURE COMPLETION TIME A.

Requirements of TRMS A.1 Sus and movement of fuel Immediately not met.

witlin the core.

TEST REQUIREMENTS TEST FREQUENCY None.

NA l

3.12-1

l-Decay Time B 3.12 8 3.12 DECAY TIME BASES l

The restriction of not moving fuel in the reactor for a period of 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> after shutdown reduces the consequences of a fuel handling accident by providing for decay of short lived fission products and the reduction of fission gas inventory in any potentially failed fuel.

Fuel handling accidents in containment and the Spent Fuel Building have been evaluated by postulating that the failure of all fuel rods in one assembly occurs 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> after shutdown.

i 4*

B 3.12 1

^

L i

l RO Admin. A.1 (Fuel Handling), Question 1 l

2.1.23 49/4.0

\\

l-REFERENCE ALLOWED L

QUESTION:

Given the following plant conditions:

L Reactor shutdown for refueling outage Unit offline:

1/1/9812:01 AM

-l

. Entered Mode 2: 1/1/9812:38 AM i

Entered Mode 3: 1/1/98 2:10 AM Entered Mode 4: 1/1/98 6:17 AM Entered Mode 5: 1/1/98 11:45 PM What is the earliest date/ time core offload can conunence?

ANSWER:

1/5/98 6:10 AM (100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> after shutdown) 1

REFERENCE:

GP-010. " Refueling", step 5.3.1

~

PLP-100 (Technical Requirements Manual), section 3.12 J

02/13/98 9:58 AM

RO JPM CR-019, Question 2 006 K103 4.2/4.3 s

QUESTION:

Given the plant conditions:

Mode 1,100% power Accumulator levels / pressure "A"

68 %

600 psig "B"

70%

630 psig "C"

70% 645 psig Annunciator APP-002-B4 "SI ACCUM A HI/LO PRESS" illuminated Describe the basis for NOT being allowed to raise the pressure in the "A" Accumulator and lower the pressure in the "C" Accumulator by simultaneously opening the vent valves for the two accumulators.-

ANSWER:

Sjmultaneously opening the accumulator vent valves would connect the two accumulator gas spaces. If a large break LOCA were to occur on either of the loops ("A" or "C") both accumulators would depressurize invalidating the LOCA analysis.

(Not required for credit: Accumulator design capacity is based on one accumulator spilling to the containment floor through the break, the other two accumulators fill the core to the mid-plane.)

REFERENCE:

FSAR section 6.3.2.2.6 OP 202, step 4.20 APP-002-B4 "SI ACCUM A HI/LO PRESS" s.

I i

01/06/98 I:43 AM

l UPDATED FSAR l

3.

Finally the second low level alarm on the RWST sounds.

At this time, the: operator performs the switchover operation.

1 The changeover from injection to recirculation is effected by the operator in the Control Room via a series of manual switching operations according to written procedures.

Valves SI-856A and B are manually closed at l

l the valves.

i Remotely operated valves for the injection phase of the SIS (Figures 6.3.1-1 and 6.3.1-2) which are under manual control, (this is, valves which normally are in their ready position and do not receive a SI signal) have their positions indicated on a common portion of the control board.

At any time during operation, when one of these valves is not in the ready position for injection, it is shown visually on the board.

Table 6.3.2-1 is a listing of the instrumentation readouts on the control board which the operator can l

monitor during recirculation.

In addition, an audible annunciation alerts the i

operator to the condition.

6.3.2.2.5.1 Location of the major components required for recirculation.

The RHR pumps are located in the RHR pump pit (Elevation 203 ft 0 in.) which is below the basement floor of the Auxiliary Building (Elevation 226 ft 0 in). The RHR pump pit is located between the Containment Building and the Auxiliary Building.

The residual heat exchangers are located on the first floor of the Auxiliary Building.

The high head SI pumps, component cooling pumps and component cooling heat exchangers are located in the Auxiliary Building (Elevation 226 ft 0 in).

The service water pumps are located in the intake structure, and the redundant piping to the component cooling heat exchangers is run underground.

6.3.2.2.6 Accumulators. The accumulators are pressure vessels filled with borated water and pressurized with nitrogen gas.

During normal plant operation, each accumulator is isolated from the RCS by two check valves in series.

Should the RCS pressure fall below the accumulator pressure, the check valves open and borated water is forced into the RCS. Mechanical operation of the swing-disc check valves is the only action required to open the injection path from the accumulators to the core via the cold leg.

The accumulators are passive eng'ineered safety features (ESF) because the gas forces injection; no external source of power or signal transmission is needed to obtain fast-acting, high-flow capability when the need arises.

One accumulator is attached to each of the cold legs of the RCS.

The design capacity of the accumulators is based on the assumption that flow from one of the accumulators spills onto the containment floor through i

l-the ruptured loop.

ine flow from the remaining accumulators provides sufficient water to fill the volume outside of the core barrel below the nozzles, the bottom plenum, and one-half the core, l

i l

l-6.3.2-6 Amendment No. 12 l

4.0 (Continued)

I 16.

A case evaluation has been performed for each section of this procedure IAW PLP-037.

The case determination and any associated i

additional requirements are defined at the beginning of each I

j section.

]

17.

The Dedicated Operator utilized for filling SI Accumulators shall be any active licensed individual other than the Reactor Operator on watch, and shall remain at the KTGB until the filling evolution is complete.

18.

If any SI Accumulator level increases greater than 10% (70 gal) due to inleakage when the RCS pressure is >1000 psig, then the affected accumulator shall be sampled within the next 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />.

(ITS SR 3.5.1.4) 19.

When drawing an oil sample from an SI Pump, remove the Controla Power Fuses.

Reinstall the Control Power Fuses when sampling has been completed AND the oil reservoir has been refilled to the normal level. During the interval with fueses removed, the SI Pump is inoperable.

& 20.

Do HQI open more than one SI Accumulator Vent valve at a time when the SI Accumulators are required to be operable to prevent invalidating the LOCA Analysis. (Westinghouse Memo CPL-96-210) v 21.

Operation with RWST level greater than the high level setpoint should be avoided to prevent water level at the Spring Line of the RWST.

OP-202 Rev. 44 Page 10 of 120

l l

l l

RO JPM CR-019, Question 2 l

006 K1.03 4.2/4.3 REFERENCE ALLOWED QUESTION:

Given the plant conditions:

Mode 1,100% power Accumulator levels / pressure L

"A" 68%

600 psig "B"

70 %

630 psig "C"

70 %

645 psig Annunciator APP-002-B4 "SI ACCUM A HI/LO PRESS" illuminated QUESTION A:

Determine which accumulator parameter (s) are outside the normal operating band.

ANSWER A:

"A" Accumulator pressure is low (normal band = 614 to 646 psig)

REFERENCE ALLOWED QUESTION B:

Can this evolution be performed and describe the basis for your response.

ANSWER B:

No, not allowed. Simultaneously opening the accumulator vent valves would connect the

.two accumulator gas spaces. If a large break LOCA were to occur on either of the loops

("A" or "C") both accumulators would depressurize invalidating the LOCA analysis.

(Not required for credit: Accumulator design capacity is based on one accumulator spilling to the containment floor through the break, the other two accumulators fill the core to the mid-plane.)

REFERENCE:

FSAR section 6.3.2.2.6 I

OP 202, step 4.20 APP-002-B4 "SI ACCUM A HI/LO PRESS" t

l 02/13/98 9.58 AM

?

f

RO JPM CR-025, Question 1 005 K407 3.2/3.5 QUESTION:

Given the following plant conditions:

RCS cooldown is in progress Plant is in Mode 4 RCS T.vg is 348 F i

RCS pressure

+. PT-402 = 468 psig

.+. PT-403 = 470 psig

+ PT-404 = 472 psig i

)

What must be done to operf,MOV-750/751 to place RHR in service?

ANSWER:

Reduce RCS pressure (sensed by PT-403) to less than 465 psig

' Verify SI-862A/B "RWST TO RHR" and SI-863 A/B "RHR LOOP RECIRC" closed with breakers closed and control power switches in " NORMAL"

REFERENCE:

OP-201, " Residual Heat Removal System", :.

System

Description:

Residual Heat Removal System l

j.

i 01/08/98 12:51 PM

AUTHORIZED COPY 0,

^

4.0 PRECAUTIONS AND LIMITATIONS 4.1 Reactor Coolant System temperature and pressure shall be less than 350*F and 375 psig bcfore the Residual Heat Removal System is piut iriservice, and the RHR system will be removed from service before RCS pressure and temperature are raised above these values.

4.2 To prevent boiling the CCW liquid contained in an RHR HX, CCW flow should not be isolated to an RHR HX when the temperature of the RHR System is greater than 200*F. (CR 95-00565) 9.3

[Neither RHR-750 nor RHR-751 will open unless trie following conditions are satisfied:.

- The breakers fo'r SI-862A and B are closed.

- The breakers for SI-863A and B are closed.

- The control power switches for SI-862A and B are in NORMAL.

- The control power switches for SI-863A and B are in NORMAL.

m y

, Valves SI-862A and B are closed.

- Valves SI-863A and B are closed.

- RCS pressure is less than 465 psig.

4.4 SI-862A & B, and SI-863A & B are interlocked so they cannot be opened unless the RHR loop pressure is less than 210 psig.

4.5 When the Residual Heat Removal System is providing Core Cooling AND seal injection flow is desired to maintain a positive AP across the Thermal Barrier of the Reactor Coolant Pumps, letdown flow through HCV-142 and PCV-145 should be maintained to provide makeup to the VCT, 4.6 When RHR-757C or RHR-757D is closed,3,350 gpm flow, indicated on F1-605, with one RHR pump running or 6,700 gpm flow with two RHR pumps running shall not be exceeded, except as allowed / required by approved test procedures for which flowrates on FI-605 may be as high as 3800 gpm for one pump or 7600 gpm for two pumps.

Rev. 34 Page 6 of 67

4 l

RO JPM CR-025, Question 1 005 K4.07 3.2/3.5 l

REFERENCE ALLOWED QUESTION:

C - tue following plant conditions:

. - JCS cooldown is in progress Plant is in Mode 4 RCS T,,,is 348'F RCS pressure

+ PT-402 = 461 psig '

+ PT-403 = 470 psig

+. PT-404 = 472 psig

- What conditions must be satisfied to open MOV-750/751 to place RHR in service?

ANSWER:

[.5) Reduce RCS pressure (sensed by PT-403) to less than 465 psig

[.5] Verify SI-862A/B "RWST TO RHR" and SI-863A/B "RHR LOOP RECIRC" closed with breakers closed and control power switches in " NORMAL"

REFERENCE:

OP-201," Residual Heat Removal System", step 4.3 System

Description:

SD-003, Residual Heat Removal System 4

i j

-~

• e L

NS 61ocom 02/13/98 9:58 AM e

l RCS Specific Activity 3.4.16 ACTIONS (continued) 2 CONDITION REQUIRED ACTION COMPLETION TIME i

i i

C.

Required Action and C.1 Be in MODE 3 with 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> associated Completion T,,, < 500*F.

l Time of Condition A not met.

l l

_O_R l

DOSE EQUIVALENT I-131 in the unacceptable region of l

Figure 3.4.16 1.

L SURVEILLANCE REQUIREMENTS SURVEILLANCE FREQUENCY SR 13.4.16.1 Verify reactor coolant gross specific 7 days activity s 100/E pCi/gm.

EhY i

SR 3.4.16.2

- --- - - ----- NUTE-Only required to be performed in MODE 1.

Verify reactor coolant DOSE EQUIVALENT 14 days I 131 specific activity 5 1.0 pCi/gm.

{

Between 2 and 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> after a THERMAL POWER change of a 15% RTP within a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period (continued) i t

i -

3.4 46

RCS Specific Activity B 3.4.16 BASES (continued)

SURVEILLANCE SR 3.4.16.1 REQUIREMENTS SR 3.4.16.1 requires performing a gamma isoto3ic analysis as a measure of the gross specific activity of t1e reactor coolant at least once every 7 days. The analysis shall consist of a qualitative measurement of the total radioactivity of the primary coolant in units of Ci/gm.

While basically a quantitative measure of radionuclides with half lives longer than 15 minutes, excluding iodines, this measurement is the sum of the degassed gamma activities and the gaseous gamma activities in the sample taken. This Surveillance provides an indication of any increase in gross specific activity.

Trending the results of this Surveillance allows proper remedial action to be taken before reaching the LC0 limit under normal operating conditions. The Surveillance is applicable in MODES 1 and 2 and in MODE 3 with T at least 500 F.

The 7 day Frequency considers the unlikel10 cod of a y

gross fuel failure during the time.

}

SR 3.4.16.2 This Surveillance is performed in MODE 1 only to ensure iodine remains within limit during normal operation and following fast power changes when fuel failure is more apt to occur. The 14 day Frequency is adequate to trend changes in the iodine activity level, considering gross activity is monitored every 7 days. The Frequency, between 2 and i

6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> after a power change a 15% RTP within a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> 7

period, is established because the iodine levels peak during this time following fuel failure: samples at other times would provide inaccurate results.

SR 3.4.16.3 A radiochemical analysis for s determination is required every 184 days (6 months) with the plant operating in MODE 1 equilibrium conditions. The E determination directly relates to the LCO and is required to verify plant operation within the specified gross activity LC0 limit. The analysis for E is a measurement of the average energies per disintegration for isotopes with half lives longer than (continued)

B 3.4 102

SRO(I) Admin. A.1,(Plant Chemistry), Question 1 2.1.14,2.5/3.3 REFERENCE ALLOWED QUESTION:

Given the following plant conditions:

The plant is at 100% power, equilibrium Xenon, all systems aligned for normal operation (Jan 15,1998,12:01 AM)

Chemistry personnel report they have completed obtaining RCS and Pressurizer liquid samples (9:00 AM)

A runback due to a dropped rod occurred at 9:15 AM Recovery actions are in progress QUESTION A:

What are the chemistry sampling requirements for this plant condition?

ANSWER A:

[.5) Between 2 and 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> following a reactor power change of215% in 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> (in Mode 1), RCS Dose Equivalent I-131 shall be verified i 1.0 micro-curies / gram.

(Between 11:15 AM and 3:15 PM)

NO REFERENCE ALLOWED QUESTION B:

What is the basis for the time frame after the power change?

~

ANSWER:

[.5] Ensure Iodine remains within limit following fast power changes when fuel failure is more apt to occur. 2 to 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> following a power change oft 15% in a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period is established because this is when the Iodine level in the RCS would peak due to fuel failure.

REFERENCE:

OMM-001-13, " Plant Chemistry", s.g.ction 5.2 ITS, SR 3.4.16.2 A5

<5t0ed 02/13/98 9:58 AM

SRO(I) Admin. A.1,(Plant Chemistry), Question 1 2.1.14 ; 2.5/3.3 QUESTION:

Given the following plant conditions:

The plant is at 100% power, equilibrium Xenon, all systems aligned for normal operation (Jan 15,1998,12:01 AM)

Chemistry personnel report they have completed obtaining RCS and Pressurizer liquid samples (9:00 AM)

A runback due to a dropped rod occurred at 9:15 AM The plant is now stable at ~68%

e Recovery actions are in progress What are the chemistry sampling requirements and basis for this plant condition?

ANSWER:

Between 2 and 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> following a reactor power change of > 15% in I hour (in Mode 1),

RCS Dose Equivalent I-131 shall be verifiedi 1.0 micro-curies / gram. (Between 11:15 AM and 3:15 PM)

Ensure Iodine remains within limit following fast power changes when fuel failure is more apt to occur. 2 to 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> following a power change of215% in a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period is established because this is when the Iodine level in the RCS would peak due to fuel

{

failure.

REFERENCE:

Plant Chemistry", section 5.2 SR 3.4.16.2 i

l 01/08/98 10:38 AM

POOR QUESTIONS KA: 062AA1.01

\\

importance: 3.4/3.8

\\

Reference allowed (FSAR)

Question: What is the limiting factor on the amount of current that can be passed from Unit 1 to Unit 2 through the SBO crosstie?

Expected Response: The electrical cable between the two units is the limiting factor.

KA:033000K303 Importance: 3.0/3.3 Reference allowed Question: What is the response of the Spent Fuel Pool Cooling System ~KF', and why, regarding temperature and level following a Blackout?

' NOTE: Assume NO operator action is taken~

Expected Response: Spent Fuel Pool level and temperature will increase due to decay heat of the spent fuel assemblies.

m -.. - -.... _ _ _

__..m Conduct of Operation (SRO 1)

Fire' Brigade KA:

194001K116 3.5/4.2 Lesson Plan:

EAP-SEP

Reference:

Fire Plan, (E-Plan) RP/1000/29 Fire Brigade i

Response, NSD 112, Fire. Brigade Organization, Training, and Responsibilities Task:

2610000, 3710001

_ Source:

NEW PRA 3-18-97

+

4.

As the Operations Shift lupervisor serving as the Fire Brigade Leader during an actual fire or fire drill, you have several responsibilities.

Describe the' normal duties as the Fire Brigade Leader at the fire scene?

ANSWER:

l 1-Serve as the Fire Brigade Commander and direct the Fire I

. Brigade during the. event.

2-Obtain support as needed such as Security, Radiation Protection, Chemistry, Offsite Fire Department and Hazmat.

l

{

I (3-Ensure all. fire protection equipment is restore to full capability immediately fol. lowing the event).

l (4-Complete the Fire Emergency Report and forward the l

i report to the EP (Emergency Planning) Section).

'l 1.

l 6

i 1

f KA:

062000A401 (3.3/3.1)

Lesson Plan:

EL EPD Objective R8 page 25

Reference:

OMP Task:

002630001 Source:

Bank EL 96 (JPM CRO 08) RO QUESTION:

Describe the safety and personnel requirements for manual operation of switchyard disconnects.

ANSWER:

Rubber safety gloves and safety glasses must be worn.

At least two people in the crew performing the task, one of which is a supervisor.

Nomex suits should be worn by the breaker operator.

l

Conduct of Operations (SRO 1)

Self Checking / STAR KA:

194001K101 (3.6/3.7)

Lesson Plan:

ADM-OMP

Reference:

OMP 1-22, Job Assignments Task:

3610052 Source:

PRA 3-6-97 NEW 1.

As an SRO (Shift Supervisor) you have the responsibility of performing Pre-Job Briefs with other operators on your_

shift, you make the decision of the level of detail and information within the Pre-job Brief.

What are several guidelines that you will use to determine the amount of detail of the Pre-Job Brief presentation and describe the " STAR" component of the Pre-Job Brief?

ANSWER:

(2 of 5) 1)

Complexity of the task Consequences of the task i

Importance of the task

)

Frequency of the tack Unfamiliarly of the task to the performer 2)

" STAR" is a self checking method (that operators use to reduce the potential of errors).

("S"

- Stop)

("T"

- Think)

("A"

- Act)

("R" - Review) i

)

ACCEPTABLE QUESTIONS Importance: 2.6/3.0

Reference:

Steam Tables Question: The RCS is at 2250 psia, Quench tank pressure is 3.5psig.

If a small leak developed in the seat of Code Safety V 1201, what temperature would you expect to see on TIA-1107?

Expected Response: 230 degrees I

Question #1.

KA: 001K5.02 Importance: 2.9/3.4

Reference:

Unit 2 Plant Physics Curves Question: Unit 2 has 6,000 EFPH on the core and experiences a dropped rod resulting in the NI power level changes from 100% to 93%, what is the approximate worth of the dropped rod?

Expected Response: Approximately 75 to 100 pcm.

Question # 2.

KA: 001K5.28 Importance: 3.5/3.8

Reference:

Unit 2 Plant Physics Curves Question:

In order to withdraw the same CEA without changing the power level or temperature of the RCS, how much would RCS boron concentration have to be changed?(PPM)

• • lf Question 1 is missed: Assuming the worth of a dropped CEA was 100 pcm, how much would boron concentration have to be changed to withdraw the rod without changing power level or temperature?

Expected Response: approximately 12 PPM (Boron worth for the present conditions is 8.38pcm/ ppm)

l "HLC EXAM DEVELOPMENT EXAM BANK" TEST ITEM DATA SHEET

===========================================================

I.

CROSS-REFERENCE DATA RECORD NUMBER: 1427 TYPE: General Use LESSON 1: LOR-SIM-JP-019-A05 LESSON 1 OBJECTIVES: 01 STYLE: Short Essay /Other POINT VALUE: 1.00 REVISION: 3 TIME TO COMPLETE: 4 Minutes ENTERED BY:

DATE ENTERED:

10/10/94 MODIFIED BY:

DATE MODIFIED:

04/27/98 DATE LAST USEU:

(approved by:

~~

ASSOCIATED TASKS:

No Tasks are currently referenced to this question.

ASSOCIATED K/A's:

206000 A1.01 ROI: 4.3 SROI: 4.4 Ability to predict and/or monitor changes in parameters associated with operating HIGH PRESSURE COOLANT INJECTION SYSTEM REACTOR WATER LEVEL:

BWR-2,3,4 controls

REFERENCES:

2 APP A-01 3-1 /R21

====---===================______==========------=========

II. QUESTION:

HPCI started on high drywell pressure, but tripped on high RPV level.

Explain how HPCI responds as level lowers from the high level trio to Lo Level 3.

1 1

Additionally, if you wanted to restart HPCI at 120", what actions would be required to perform that action?

i

===================================================--------------------

1 III. ANSWER:

1 As level lowers, HPCI will not restart until level reaches LL-2 (105").

HPCI will then reset its trips and start and inject with no operator action.

HPCI will continue to run as level lowers to LL-3.

To restart HPCI prior to reaching LL-2, depress the high water level trip reset pushbutton, the drywell signal will then restart HPCI and' cause it to inject.

l t

PAGE 1 OF 1

_ 7 F

l l

l "NRC JPM 98, Rev OH EXAMINATION l

QUESTION 3.

POINT VALUE: 1.00 Using the attached diagram, explain how it is possible to reset a scram with the mode switch in SHUTDOWN.

t +

1 l

l i

l l

PAGE 3 1

-.. ~.. - -. -

.. =

- ~ _..

[

I-i i

I i

Ik i

l.

- K1,M A1

K13C A2 s

,7_ NEUTRON _____)

SHORilNG UNK i

I l

L

_J l

/

l

--K138 B1 TA K16A l

K130 B2 C

2 SEC

)

1 OPEN IN I i

SHUTDOWN l POSm0N i j

u r____s 7bK15A l

K16A m

I L), _!

SI

(=L ibK15C f-

~

1 I *CLoSb~lN '

i g

r-----,

l

^

K17A, I CLOSED IN i 1

• REFUEL * &

u TDC s' SHUTDOWN

• 1 1

L _$7Ag7_yp= J 2 SEC 6-y-

a 7,-___

o I

N i

e I

to'---

L -:= $1 6

J POSH TO l -

/

n SCRAM SCRAM SW @

-Un I

i I

i l

K15A K15C 41TA.

7000 6

\\ KIM s 2 SEC.

K19A :=

K15A ::K15C r,:K19C j

RGU lREU f

l.

REACTOR MANUAL SCRAM lm SHUTDOWN SCRAM RESET INTERLOCK m

m m

TR1P CHANNEL *A3*

"l' TRIP SYSTEM *A*

F I

I' Figure 03-21 Shutdown Scram Reset interlock i

l I

I L

CSC-:2 R e, 2:

Page 9C :I: C'

JOB PERFORMANCE MEASURE 2

Provide this page to the Candidate Health Physics has performed a survey of the Unit 2 Charging Pump rooms and hallway. Given a survey map, determine how each room and hallway should be posted.

T

'l l

t Page 6 of 7 i-l

.~ -.. -.

i o

(

)

1

{

l A

=

a t

a I

i I

s

$g$ j a e la ej I

i i

a s

v gs h

J

' um' os A d

'I i

m a

'l 11 sl3* v.F g])n]j!

g"-

fid L

v y-'

4

,3 s

r g

u s

p y!

qltN.,ljh a

[

\\

{

l

-!v

!ss c

g s!=

ese

!g i~7 7 7 E I U u u za u x R

I.

J c'

i lq,-~~~~~~--e===: vee::e y < y y lx w w i

s3e e

a Figure 4 2301205. Rev. 7 FOR TR AtNtNG USE ONLY

'7

l

+

f I

j J 3 Y SC

~ ) J _:.'\\ G PAUL STEINER l

l l

l

J w SC E J __.:: \\ G C J\\S:: J:E RA~~::0\\S Amount of material to be generated:

1 Licensee Cost.

Licensee Manpower.

Examiner Review Time.

Validation Time on Simulator During Prep-Week.

The current trend is a shift towards a single JPM set, administered piece ;y piece, with all applicants receiv.,g the same piece each day.

Considerations with this technique:

Availability of both Simulator and Booth Operators for two shifts.

Sequestering.

Candidate Stress.

Examiner Stress.

(No laughing ~please!)

i

l LUrrerr:

)roi ems

~

n JPMs are lasting 30 minutes to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

Longer is not better.

Take the time it takes a staff instructor to perform the task, with questions, and double it.

l The last three examinations have run

.past 10:00 pm and were scheduled to end at 6:00 pm.

Applicants are arriving at 7:00 am and are not being exam.ined until 7:00 pm.

u No margin for error or simulator failure.

o

l l

r C 3 E RA~~I \\G

.EXAV:: \\ A ::0\\

AJ V :: \\ IS 1A -..V:-

0 3.. : S

3v s vs SES~~::0\\S Paul Steiner l

l l

l t

l l

l i

l l

l

ES-301 Specific Instructions for Category A o

Although Admin topics may be examined L

separately, it is preferable, whenever

possible, to link, associate, or integrate them with tasks and events conducted during Categories B and C Using a single Admin JPM is generally L-L preferred, however, two prescripted

-questions may be used.

If the. applicant has a "U" in only one L

e-Admin topic, the examiner may fail the i

applicant in. Category A depending on the u

importance. of the identified deficiency.

t

- Topics in the administrative portion of o

the NRC initial examination are weighted the highest of all examination areas, and are thus the most. likely to result in a l

failing grade.

L

- A. single. knowledge weakness / or applicant

-error can result in an initial examination L

failure..

.p L

a.

Common Single Failure Points:

Clearance Error.

Reactivity Balance Error.

The key is a balance between questions and JPM's.

J All JPMs will result in a long Admin exam, with a high potential to fail a candidate for a single error.

All questions usually results in a weak Admin exam.

- /

i a

I

..,e 4

_4--,-,

Exami es o= Gooc Acmin ? Ys Shutdown Margin Calculation.

Approval of a C1earance Order.

e ECP Calculation.

Manual Leak Rate Calculation.

Risk Matrix Utilization.

e Off-Site Dose Projection.

e Review a Survey Map and Demonstrate i

Knowledge of Radiological Hazards in a Work

~

Zone.

e' Evaluate the Applicants Scenarios for Emergency Plan Application and Make Protective Action Recommendations.

~

- The key to success with these types of tasks is solid and thorough validation.

- If the task is not clear, and well defined, the applicants will become confused.

- If the task is too

long, it will begin to loose its evaluating abi11ty 1

Examples of Poor Admin JPMs t

Check out. a key from the key locker.

~

l Make a log entry.

~

Frisk out an item.

e Do you want an applicant to fail for touching the surface?

Make a call-in for emergent work while reading from a procedure.

Perform a pre-job brief.

-e These are items of Low Discriminatory Validity, and if performed poorly can result in severe grading.

l

~

Otner Jifficu~ ties dit1 Acmin 4

SRO applicants should be evaluated at e

greater depth on Admin topics.

There must be a difference between the RO and SRO Admin examinations.

Control Room Software not available on the simulator or applicants don't have the proper password.

The question does not solicit the answer.

Put validators in the mind set of applicant.

Assigning point values to multiple answer questions.

The limit is 80%.

If there are four

~

answers, the applicant must get a7 7 four correct.

Don't require applicants to catch. integrity issues, or misspelled words when approving clearances or valve line-ups.

. Direct look-ups are prohibited!

I enn m "M

V n

..i I

i _.

v ANJ

~.

V..

-_..g

_3

\\n_

u

.. v C.

PAY \\'E 1

I

\\

l 4

EXAMINATION SECURITY PER 10 CFR 55.49 -

" APPLICANTS, LICENSEES, AND FACILITY LICENSEES SHALL NOT ENGAGE-IN ANY ACTIVITY THAT COMPROMISES THE INTEGRITY OF ANY APPLICATION,: TEST, OR EXAMINATION BY-THIS PART" RULE IMPLEMENTED IN NUREG-1021 i

ES-201 - C.1 & C.2 & C.3 (RESPONSIBILITIES)

ES-201 - D.2 (PERSONNEL RESTRICTIONS) e ES-201 - ATTACHMENT 1 (PHYSICAL SECURITY & EXAM BANK LIMITATIONS)

ES-201 - FORM ES-201-3 (SECURITY AGREEMENT) e ES-205 - GFES EXAM ADMINISTRATION e

ES-402 - C.1 (RESPONSIBILITIES) e ES-402 - E.3 (POST-EXAM REVIEWS) e ES-501 - POST-EXAM DOCUMENTATION e

APPENDIX D, SECTION F (SIMULATOR SECURITY CONSIDERATIONS) e L

~

EXAMPLES n

INSTRUCTOR SIGNED SECURITY AGREEMENT AND DISCUSSED EXAM CONTENT WITH EXAMINEES REVEALING OF WHAT IS NOT ON THE EXAM (APPLICANTS SHOULD NOT BE ABLE TO PREDICT OR NARROW THE POSSIBLE SCOPE OR CONTENT OF EXAM BASED ON YOUR TEST DEVELOPMENT PRACTICES)

BIAS OF SCOPE, CONTENT, OR LEVEL OF DIFFICULTY OF AN EXAM TO ENHANCE CHANCES OF CANDIDATES PASSING TEST LOSS OF CONTROL OF EXAM MATERIAL (NOT LOCKED UP WHEN LEAVE OFFICE, PARTS OF EXAM LEFT IN COPIER, PARTS OF EXAM LEFT IN. SIMULATOR BOOTH AFTER VALIDATION)

INSTRUCTOR ON SECURITY AGREEMENT INTERACTS WITH SR0(U) CANDIDATE DURING REQUAL (TAUGHT CLASS, EVALUATED SIM. SCENARIOS, SAT-0N AUDIT BOARD)

WRITE EXAM TO SAME FORMAT EVERY TIME S0 IT BECOMES PREDICTABLE CHANGING K/A NUMBERS ON OLD QUESTIONS IN ORDER TO FIT NEW SAMPLE PLAN PERSONNEL NOT ON SECURITY AGREEMENT IGNORE WARNING SIGNS AND WALK IN ON EXAM DEVELOPMENT ACTIVITIES DRAFT EXAM MATERIAL NOT PROPERLY PACKAGED WHEN SENT TO NRC AND WAS DELIVERED OPEN

I..- -..

.-na~---.--..

. -. -. ~. _ - ~ _

-_-~

---

~_- --

i e

i a

i I

f I

1 2

\\

I l

1 1

i l

j

..s...-*se....,,--e,..y*- :r-- %.,.w w. c : q ;n,.

s v~e. q,.% 47".-w,--

3 2.I;.:,.-..--

...,,.. -a,7

.. j

.. s '- m* --k [ -

. s::..<... =, - -c.

u.,

. w

.m

. a- : _.. -__

3.3

*W- -- -- %DN.yT-s "v. ~.

4

./l'

-r;,..

• ,r.

I t5 N i,'... ",, ; y :. ;,I,.,~[. p.v=

.t' -~ -

.E. 4

"--s M

j

- *. p

, y

(

.w

," i.%-.., --.i.#- */@

' i t

g...-

u.pq-u-

)

.3p

..4 j

--_--~.-M-

)

j

-e-

-%.,.-.r.

a

• 2J:-

. f ~ < a.-

1

., Q' N I

f n._

• .*s.

. - Q'.Q,.. 3.. :.s

~~

1 j

y :.

1

~X-

.. ' g :(;,$,e.

a ek -

s

.4 e_

-- e~-

e pe

.e C

%.y.

.. 'g.. g.. a g.J..v. ',...>

(

... f.,

w

. y:; w..;..:

3,->

,.. (4 ~.

f r.

.- 1

..,*.u j

, [ M. E" "",, {

a;,

,. $ h_ *f','

a s

m+ '

WA '.....,

a X W $. -@ @>. m@ % % M %n u

c acr..

. s...

.x.

m.:

. - v,y s s m ;, ~,.,. c ' --.- t.<.

er,

• ... e.. :.

< - %=.; r.--,:, ;. a -..

3

. u:

4

+....ss: ~+.

~

.,...,.a.,.m..,...%.;.

c w:

r' h

<.. M..

.:.----~s

..u w:

q3.p g,-.eu-. A.,~..z:..,c.c.,,.

..<e

9. -. :

p...*.

r.

e

4...

f..

ev=

4 A

- a. ;

% s_,

M. A

. -. -, - ' +a;

.,,s..,.,.,,

.o g

.r..

.,2.. +,;; 3.

..se=:.,-. 9.'.

c..

1.m

.s.n.. --.wx.:w:..

..c

.... y q.

,s; >

..a.._,,.,.....u ;--. m.

es g

.,:Q....

_,,s

+

. (.-: -

..~..

.n.w.

w.

..,. - 1,, e.u.~ :,.., -..: 7. Q:

s

' JJlc r *.."..L;.-

{

pg.Pg.,W3..*

-~

y.g.,,._.,. q

-- -. m,,a.p -, s

....,.i..,..

7 %;

'5 :::.4.,,...V'. s--.;..; *..

.. WG.,"..u *'.':*r M * " C..,%

.2

a..z.,. y:,

a ww

[

b

• ~ '.

.g

.' f.; 2.

.f...

$.f;.. W 1,,-

I

....p.,

,3,.-

p%

..,e

-. a. ~. u..,

....n 4:,,

a

.,..... -; -w,: n. r..a

,.n..-

.w s

• ip

.u..

- c%:%

-. x.

~

y

~.x.

+

r

.l..a. x.. s,.=

3. r.s-6.

s.a.mm,s

'~m

.a-.

,-l

' % : 3,.

~.c,.,,,s-.=

m.

/ '>u. r ;

a..<., M

.s.

. :. r. :,...* Q; 4.s*

?

.--n k. 4 9~..~% L:y^".j.

Q._

w:

,, +...a,, -~; g ~., f.. '...;:.y:

.l.~.+ :.

. % w.

y

- y s.-.

.s..

.e 4% _,

-+-

~

m,.... -

y

%.. ' - ;. ?,..,. 4.,w. :,u. x - a

.; w

-.- ~

u

- (K.-y, W'+ y..

. kh r ;~[.

'cn...,

s :.-- n.

.....~.5**.._

_ ' _ - -._?:-

.R

.sa.=..

,... ~., -.

o-

- c k.

.,y

-p

~h 5 *~

$*~

~

'~

~

..y

~ ?'Q

s &. q?

~

23*--

W

- m s.-... ; m.-- -

c

=

.e

- ^...j, m _,

y '~

G

-JN-% -

-s' A,

1. _h j

7-':wn.ir - '.;

s s

i

-se'r W

-.p'

-Q.4 -=

~ -. _

• A ~j-3

^

-f-f g'

W.

"'t w.;*

_.w-e

---e---=-

t

,, ~ m c.

c

,z Ws4 @ -J

..T..

~

% R: 3: ' - 't%

v4 = L

. <f-

_ % ; y g., Q

.. A

(---

r-

%,- gp' _"'

'^

=.e or.

.,. - v - -

.j-A.

..m i

3 3

c y .+*

,e 7-

'~,y l

5

.-'h

.y -

,,f.((de 8

3.

I.

.- f s

b 4

^

i

..c _ -

3 r -,..

_.m....-.-.

(

3

,t

.r

~

4 c.

... r ; -. _

.....,,.ry._..

__*'n--,-

~..

4

.z.

'.' r. a,.~f,,.'l g (. "". i '. -

-g

.~-.

5~'.

,i,... p rT a.

f

.._ 4

~-

~._

-p j

[g s h.c._

.$.7 ~7.

--"'.J,J,,,.,.#,

' W ".,.;..'

.[.

- k

~-

...a q

..s-

-2

^

?f}-

}

,y

~

"m.

.. _.1 :

j,

=4 w

f b

~..,,: $

h k I _ f, -

~

x.-.

- z

.s

.c w m.

• w.8%==si j

a.'%.

d4

. ew A o

.4 j

-~ -

~ ;

M-.'

q, J

q 4

.y j

(

s N

~%

.....'N a

l i

,y

-'t i

.h

[. ' " s. -I - __' -

L-

' ~

] -

. {.

- - '. - - 7

- ',-M [ ~

l I

k 1

4 4

4 4

4 4

4 1

4 4.

i.

l i

i 4

m BONSEODENCES

g -

NUREG-1600, " GENERAL STATEMENT OF POLICY AND PROCEDURES FOR NRC ENFORCEMENT' ACTIONS" APPLIES 4

IF HAVE INDICATION OF COMPROMISE, ACTION WILL.BE TAKEN TO ENSURE AND RESTORE THE-INTEGRITY AND SECURITY OF PROCESS.

INCLUDES:

e NOT GIVING EXAM

~

MAKING ADDITIONAL CHANGES T0 EXAM VOIDING EXAM RESULTS IF EXAM ALREADY GIVEN e

2 9 REEVALUATING LICENSING DECISIONS PER 55.61(b)." "Y, e

POSSIBLY IMPOSING ENFORCEMENT ACTIONS INCLUDING:

e CIVIL PENALTIES ORDERS IMPLEMENTATION OF DELIBERATE MISCONDUCT RULE (10 CFR 50.5)

(

4

EXAM PREDlCTABILITY a

APPLICANTS SHOULD NOT BE ABLE TO PREDICT OR NARROW THE POSS OR CONTENT OF. EXAM BASED ON YOUR TEST DEVELOPMENT PRACTICES

~

EXAM DEVELOPMENT TECHNIQUES OR RULES SHOULD NOT BE DISCUSSED W CANDIDATES (e.g., 25% OF WRITTEN WILL BE OFF THE MOST RECENT EXAM)

EXAM METHODOLGY SHOULD BE VARIED FROM EXAM TO EXAM (e.g., SECTION A.4 SHOULD NOT ALWAYS BE " CLASSIFY THE SCENARIO" FOR SRO's)

EXAM DEVELOPMENT CRITERIA LIMITATIONS SHOULD NOT ALWAYS BE THE THE EXAM CONTENT (e.g., NO OVERLAP WITH THE AUDIT TEST SHOULD NOT BE A RULE STRICTLY FOLLOWED WITH NO EXCEPTION) IF DONE CANDIDATES CAN EXCLUDE EVERY' THING FROM THEIR AUDIT AS NOT BEING ON THEIR TEST NARROWS THE SCOPE.

ALLOW AUDIT AND LICENSE EXAMS TO DEVELOP INDEPENDENTLY AND IDE THE CHIEF EXAMINER THOSE AREAS THAT OVERLAP WITH A PROPOSED RESOLUTION, IF NEEDED.

AREAS TO WATCH:

NO OVERLAP FROM AUDIT EXAM 3

25% FROM THE LAST TWO NRC EXAMS 50% FUNDAMENTAL KNOWLEDGE i-NO TEST ITEM REPEATS FROM DAY TO DAY WRITTEN EXAM ANSWERS FAVOR a,b c, OR d ALL JPMs DONE ONLY ON A SPECIFIC UNIT

a s

ba.a-Laa-esa A--g+A, 4--,--sm---,--,--ss.,

I I

i 4

S i

l I

4 l

SIMULATOR SCENARIO DEVELOPMENT l

4 i

t l

C.

JAY \\E G.

-033ER i

}

CR::

CA_

~~AS (S da: cons:1-u:es a cri:ica~

as(?

l L

~~

~

1e recua i=ica: ion examina: ion uses l

cri :ica~

as(s (C-~s) =or' eva~ ua :ing crew Jer=ormance on ~;as

4 N-BOP Realignment of charging and letdown 5

C-BOP 2B CCW Pump trips S

' BOD ro 801", 2A S!G c:ccm Scw t=cdcr fe"c Ngh 7

M-BOP 2A Steam Generator tube rupture (250 GPM), 2A main M-RO feed line break inside containment on reactor trip C

A train CSAS feils to actuate C

2A Main Feed isolation valves fail to close on MSIS (MFIV failure, continues to feed containment)

C FCV 071 A fails to fully open (N)ormal, (R)eactivity, (1)nstrument, (C)omponent, (M)ajor L

e a

ES-301 Simulator Scenario Quality Assurance Checklist Fonn ES-301-4 r

Feaility:

Dete of Exem:

Scenario Numbers:

/

/

Operating Test No.:

QUAUTATWE ATTmsUTES laitials j

a b

c 1.

The esenenes howe c4eeriy steted ebiectives in the soonerio summenes a

2.

The initial condreens ero realistic, in that some emapment and/or instrumentessen may be out of servios, but it does not ove the operators into espected ownts.

3.

The noenenes cenant meetly of related events.

4.

Each event '- s consists of the point in the scenario when it is to be inrested a

the malfuncaien(s) that are entered to inroete the ownt the symptoms / cues that weill be visible to the crew the espected operator actions (by shift position) the event temenston point (if sooiicable) 5.

No more then one nore mecherustic failure (e.g., pipe breek) is incorporated into the scenario without a credsbie preceding incident such as a seismic event.

8.

The events are welid with regard to physics and thermodynamics.

7.

Sequencing and timing of events is reasonable, and allows the examination team to obtain complete eweiuscon resutte commensurete with the scenerio objectives.

8.

If time compreeeien techruques are used, the sceneno summery cieerty so indicates.

Operators how suf6cient tirne to carry out expected activities without undue time constreints. Cues are giwn.

9.

The ermulator modeling is not sitered.

10.

The scenarios have been validated.

11.

Ewry operator will be ewelusted using at least one new scenario. All other scenaries how been modined in acceedence with Section D.4 of ES-301.

4 12.

Allindividual operator competencies een be eweiusted, as wri6ed using Form ES-301-6

)

ieubmit the form along writh the simulator scenenos).

13.

Each applicent wit! be signific.ently involod in the minemum number of trenaients and ownts specified on form ES-301-5 (submit the form along with the simulator scenarios).

j

.14 The 6ewel of difficulty is sopreonete to support iioenerno deersions for each crew position.

TARGET QUANTTTATWE ATTMsUTES (ptR SCENAntO)

Actual Attributes 1.

Tesel malfunctons (5-8)

/

/

2.

Me8 functions efter EDP entry (1-2)

/

/

3.

Abnormal ownts (2 4)

/

/

4.

Maior trene;ents (12)

/

/

5.

EOPs entered / requiring substantive actions (12)

/

/

6.

EOP contingencies requiring substantive actions Q-2)

/

/

7.

Critical tasks (2-3)

/

/

NUREG-1021 24 of 26 Interim Rev. 8, January 1997 L

1 e

ES-301-Transient and Event Checklist Form ES-301-5 DPERATING TEST NO.:

Applicant Evolution Minimum Scenario Number Type Type Number 1

2 3

4 Reactivity 1

Normal 1

Instrument 2

- RD Component 2

)

Major 1

Reactivity 1

Normal 0

Instrument 1

h RO Component 1

Major 1

SRO-I Reactivity 0

j Normal 1

As SR0 Instrument 1

Component 1

Major 1

Reactivity 0

Normal 1

SRO-U Instrument 1

Component 1

Major 1

Instructions:

(1)'

Enter the operating test number and Form ES-D-1 event numbers for each evolution type.

(2)

Reactivity manipulations must be significant as defined in Appendix D.

I i

l Author:

Chief Examiner:

NUREG-1021 25 of 26 Interim Rev. 8, January 1997

j r.

\\

ES-301-Competencies Checklist Fonn ES-301-6 l

i Applicant il Applicant #2

. Applicant #3 RO/SRO-I/SRO-U RO/SRO-1/SRO-U RO/SRO-I/SRO-U

-Competencies-SCENARIO SCENARIO SCENARIO I

2 3

4 I

2 3-4 1

2 3

4 understand and Interpret Annunciators and Alanns Diagnose Events and Conditions

\\

Understand Plant and System Response Comply With and Use Procedures (I)

Operate Control Boards (2)'

Comununicate and Interact With the Crew Demonstrate' Supervisory Ability (3)

Comply With and Use Tech. Specs. (3)

Notes:

(1)

Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SR0s.

Instructions:

Circle the applicant's license type and enter the event numbers that test the competency for each scenario in the set.

Author:

Chief Examiner:

NUREG-1021 26 of 26 Interim Rev. 8, January 1997 i

Q ~ Yfi