ML20211Q758
| ML20211Q758 | |
| Person / Time | |
|---|---|
| Site: | Crystal River  |
| Issue date: | 09/01/1999 |
| From: | Christensen H NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION II) |
| To: | Cowan J FLORIDA POWER CORP. |
| References | |
| NUDOCS 9909150144 | |
| Download: ML20211Q758 (86) | |
Text
rz w.; a a.,
s .
September 1, 1999
. Mr. John P. Cowan, Vice President Nuclear Operations Florida Power Corporation .
-ATTN: Manager Nuclear Licensing (NA1B)
Crystal River Energy Complex ;
.15760 West Power Line Street Crystal River, FL 34428-6708
SUBJECT:
TRAINING MANAGERS CONFERENCE MEETING
SUMMARY
Dear Mr. Cowan:
On August 12 - 13/1999, Region ll hosted a Training Managers Conference on recent changes to the operator licensing program. The meeting covered changes to the Regulations, the Examination Standards (NUREG 1021), the new inspection program, and other training issues.
Enclosure 1 is the list of attendees and Enclosure 2 is a copy of the slide prasentations.
Enclosure 3 is a list of questions received from the participants. These questions will be reviewed and addressed at a future date.
If you have any questions conceming the conference, please contact me at 404-562-4638.
Sincerely, Original signed by Harold O. Christensen Harold O. Christensen, Chief Operator Licensing and ,
Human Performance Branch !
Division of Reactor Safety. i Docket No. 50-302 ,- .-fGL License No. DPR , J ' "i !
Enclosures:
' 1. List of Attendees
- 2. Licensee Presentation Handouts
- 3. Participants Questions cc w/ encl: (See page 2)
I
, r i h b!N lk . NS W l l
}
9909150144 990901 PDR ADOCK 05000302 V PDR
_. , $$ 1
n-
~
FPC 2 cc w/encls:
Thomas Taylor, Director Nuclear Operations Training Crystal River Energy Complex
._ 8200 West Venable Street Crystal River, FL 34429 Charles G. Pardee, Director Nuclear Plant Operations (PA4A)
Florida Power Corporation Crystal River Energy Complex Electronic Mail Distribution Sherry L. Bernhoft, Director Nuclear Regulatory Affairs (NA2H)
Florida Power Corporation Crystal River Energy Complex Electronic Mail Distribution Distribution w/ encl:
L. Wiens, NRR R. Gallo, NRR D. Trimble, NRR R. Conte, RI D. Hill, Rill !
J. Pellet, RIV '
PUBLIC !
l l
l l
l l
l OFFICE Ril:DRS RJ J :1)R) _
SIGNATURE /M M///
NAME M'dristensen ji4Bopanc DATE (f/,/ /99' Q/ M /99 8/ /99 8/ /99 8/ /99 ^
8/ /99 8/ /99 COPY? /iES) NO l(YES/ NO YES NO YES NO YES NO 7
J, YES NO YES NO OFFitfAL RECORD COPY ' DOCUMENT NAME: Gi\ DOCUMENT \FPC\fpcsumnary.wpd
]
L _.
LIST OF ATTENDEES i
U. S. NUCI PAR REGULATORY COMMISSION Luis A. Reyes, Regional Administrator Victor McCree, Deputy Director, Division of Reactor Safety (DRS)
Harold Christensen, Chief, Operator Licensing & Human Performance Branch, (OLHP), DRS Fred Guenther, Senior Reactor Engineer, Nuclear Reactor Regulator l Ronald F. Aiello, Reactor Engineer, OLHP, DRS j Richard S. Baldwin, Reactor Engineer, OLHP, DRS Michael E. Ernstes, Reactor Engineer, OLHP, DRS George T. Hopper, Reactor Engineer, OLHP, DRS Lany S. Mellen, Reactor Engineer l OLHP, DRS
, Beverly Michael, Licensing Assistant, OLHP, DRS Mark S. Miller, Reactor Engineer, OLHP, DRS
- j. . Charles Payne, Reactor Engineer, OLHP, DRS Marvin Skyes, Reactor Engineer, OLHP, DRS Hironori Peterson, Senior Examiner, Region lli l LICENSEE CAROLINA POWER AND LIGHT COMPANY Max Herrell, Training Manager, Brunswick Ralph Mullis, Operations Training Superintendent, Brunswick Gregg Ludiam, Supervisor - Operator Continue Training, Brunswick Mark Keef, Training Manager, Harris Thomas Natale, Operations Training Manager, Robinson DUKE ENERGY CORPORATION Al Lindsay, Training Manager, Catawba James Teofilac, Operations Training Manager, Catawba L Al Orton, Operations Training Manager, McGuire Ronnie White, Site Training Manager, McGuire Robby Pope, Supervisor of License Requal Training, McGuire j Gary Voller, Operations Human Performance Manager, McGuire l Tom Coutu, Superintendent of Operations' Oconee John Steely, Supervisor Nuclear Operator Training, Oconee Paul Stovall, Manager Operator Training, Oconee i Scott Hollingsworth, Operations Training Liaison, Oconee !
Rick Robinson, Operations Training Liaison, Oconee Jack Brission, Operations, Oconee i
Enclosure 1
(
{
p 2
FLORIDA POWER AND LIGHT COMPANY Mark Shepard, Operations Training Supervisor, St. Lucie Jo Magennis, Nuclear Assurance, St. Lucie Maria Lacal, Training Manager, Turkey Point Phillip Finegan, Operations Training Supervisor, Turkey Point Bill Burrow, Online Schedule Supervisor, Turkey Point FLORIDA POWER CORPORATION Ken McCall. Operations Training Manager, Crystal River l Frank Dola, Senior Nuclear Operations Specialist, Crystal River Tony Roberts, {FRG Corporation} Representative t-l SOUTHERN NUCLEAR OPERATING COMPANY. INC.
Scott Fulmer, Training Manager, Farley
-Joe Powell, Nuclear Operations Senior Instructor, Farley Gerry Laska, Nuclear Operations Instructor, Farley Gary O'Hustede, Operation Training Plant Instructor, Farley t John Lewis, Training Manager, Hatch Steven Grantham, Operations Training Supervisor, Hatch Robert Brown, Plant Training & Emergency Preparedness Manager, Vogtle t SOUTH CAROLINA ELECTRIC AND GAS COMPANY l
Albert Koon Operations Training Manager, Summer .
Perry Ramicone, Lead Instructor Exam Development, Summer James Callicott, Training Evaluation Coordinator, Summer TENNESSEE VALLEY AUTHORITY l l Daniel Sanchez, Training Manager, Browns Ferry !
Ardie Champion, Operations Training Manage, Browns Ferry l Denny Campbell, Shift Operations Supervisor instructor, Browns Ferry John Parshall, Shift Operations Supervisor instructor, Browns Ferry Richared Driscoll, Training Manager, Sequoyah
- Walt Hunt, Operations Training Manager, Sequoyah
! John Rodden, Operations Training Manager, Watts Bar Tom Wallace, Operations Superintendent, Watts Bar VIRGINIA ELECTRIC AND POWER COMPANY !
Joe Scott, Operations Training Supervisor, North Anna Steve Crawford, Senior instructor Nuclear, North Anna David Llewellyn, Superintendent of Nuclear Training, Surry i Harold McCallum, Operations Training Supervisor, Surry Michael Brady, Supervisor of Nuclear Training, Surry OTHERS' James Makucin, INPO !
Bob Post, NEl Enclosure 1 1.
b
1
( o W e
- 3. . .
A
^ '
p @ necoq
+
. . . . .p#
WELCOME TO
~
U.. S. NUCLEAR REGULATORY COMMISSION i REGION II TRAINING MANAGER'S CONFERENCE 1 AUGUST 12-13, 1999 l
SAM NUNN ATLANTA FEDERAL CENTER 61 FORSYTH SW, SUITE 23T85 !
ATLANTA, GA 30303 .
6 ENCLOSURE 2
- eo e oe -
REGION ll TRAINING MANAGER CONFERENCE AGENDA Sam Nunn Atlanta Federal Center (Bridge Conference Room B)
Thursday, August 12,1999 8:30 - 9:00 a.m. Introduction L.Reyes V. McCree C. Christensen 9:00 - 10:00 a.m. Summary of Significant C. Christensen NUREG 1021 Changes 10:00 -10:15 a.m. Break
., 10:15 - 11:45 a.m. ES-200 Series (Exam Process) M. Emstes 11:45 a.m. - 1:00 p.m. Lunch 1:00 - 2:00 p.m. Changes in the NRC B. Boger 2:00 - 2:15 p.m. Break 2:15 - 3:45 p.m. ES-300 Series (Operating Test) R. Aiello 3:45 '4:00 p.m. Break 4:00 - 5:00 p.m. New inspection Program C. Christensen Friday, August 13,1999 8:00 - 8:15 a.m. Day 2 Opening Remarks C. Christensen 8:15 - 9:45 a.rn. ES-400 Series (Wntten Exams) R. Baldwin 9:45 - 10:00 a.m. Break 10:00 - 11:00 a.m. ES-500 Series C. Payne (Post-Exam Process) 11:00 a.m. - 12:00 p.m. Recent Training Program issues G. Hopper 12:00 - 1:00 p.m. Lunch 1:00 - 2:00 p.m. ES - 600 Series (Requal Program) M. Sykes G. Hopper 2:00 - 3:00 p.m. Closing Remarks L Reyes V. McCree C. Christensen
i i TRAINING MANAGERS CONFERENCE - .
l August 12 - 13,1999
- ?* *'%
I I
TRAINING MANAGERS l CONFERENCE INTRODUCTION f%
@%) .....
Luis Reyes !
Victor McCree .
Chns Christensen i
TRAINING MANAGERS l CONFERENCE !
AGENDA - DAY ONE j
8:30 a.m. Introduction ! !
9:00 a.m. NUREG 1021 Changes !
10:00 a.m. Break 1 10:15 a.m. Exam Process 11:45 a.m. Lunch !
1:00 p.m. Changes in the NRC l 2:00 p.m. Break !
2:15 p.m. Operating Test l 3:45 p.m. Break . i 4:00 p.m. New Inspection Program l 5:00 p.m. End Day One
e i
I I -
4 i TRAINING MANAGERS CONFERENCE I l /O .
i t
W)g !
i ,
! VICTOR M. McCREE !
Deputy Director, Division bf Reactor Safety i Region 11 l August 12 13,1999 j
- i
. j rg r kl REGULATORY TRENDS I
eBACKCROUND e DESCRIBE THE CHALLENCE FACINC NRR
{
j e EXPLAIN HOW NRR IS MEETING THE CHALLENCE e DISCUSS HOW NRR 15 DEFINING SUCCESS e
e DISCUS $ STATUS OF HIGH PRIORITY ARIAS FOR ACTION i e THEN.NOW AND THE FUTURE I
- i O '
J BACKGROUND l
e U.S. Notasar Roscier ladestry Aeerage 5efery Performonee Has impreved beaddy . .
~
- Number of Accedens Segeeeee Precereers Decioned 5 gaincenity 5. ace 1944 '
- I'm of The h AC Trocked Persermance Indice ers show S.gaincent .
approvement Seare 1985 (estematic screes, safety syssem esteeteens, !
sigas6eent eveans, equipescat forced esteges and sollecteve redsauen esposere)
- Chalaense is se Der.ae Progrees (la Aspiety Chang *g Sesimess And Regenetery Envireaments) et a 1sul % hich:
- Mesanese Sefety
- Redere Unneseenery Regedecery Bordea
= lactones Public Cearmsease
- Improve EfEasency Aasi Effectiveness
. 1
4 1
. AREAS OFNRC '
, . . STAKEHOLDER CONCERN '
e Senese & Hesse Commista Reports on NRC Ap proprietaeas.Early June 1998 i e Commission bleeting With Stakeholders. July 17 & Nov. IJ.1998 ;
e NRC Oversight Hearing With Senete Sobcommittee. July 30,1998
{
e Regulatory Framewerk Needs so Be Fredictah6e, Objective. And i Tamely e Cemeern Emines That Some NRC Reguistions And Regelster Practice Pese Usessessary Borden en Licensees a la Deregulated Electric Utility Envireement, Useecessery Reguleaery Burden Is of Sigeirscent Cescera se Lacensees
. e Need For Contiemees improvementla Regulesery Effectiveness i And Efficiency .
. 1 q l t
M.. ..) POST-HEARING TASKING MEMO !,
I e Meme From Chairmee to EDO. August 7.1998 1 e identires Commissies Proposed High Priority Areas For Action f'
, o Tasking Meme Response. August 25,1994-Conseins Sher And 14eg Tern Acceems (Updesed Meathly)
. e Meissaieing Safety Remeias h Priority e Many Tasks Previessly Identered And in Operating Plan; RemainingTasks Added e Some Esisting TesLS May Be Appropriese to Slow Defer, Cancel, '
Other so Accelerate e Challenge is to Maintain Sefery While Redecing Uanecessary
..,de.
i f
. PERFORMANCE GOALS FOCUS ATTENTION TO MEASURE NUCL EAR REACTOR SAFETY PROGRA%! OUTCOMES: , ; I e MAINTAIN SAFETY e REDUCE UNNECESSARY REGULATORY BURDEN !
- INCREASE PUBLIC CONFIDENCE e INCREASE EFFICIENCY / EFFECTIVENESS O F KEY NRC -
PROCESSES I Determined by NRC Nacieer Reacter Reguistion Team Working With Centracter se Der.me And implement Pieme eg Budgeting, And ,
Performance Menegement Precues(PBPM) 8 i
i i
i e
l PRIMARY AREAS OF AGENCY FOCUS .
i e ha Informed And Performance Based Regulation f a Reactorlaspection And Enforcement e Reacter Licensee Performance Assessment !
e Rosetor Licensing And Oversight I g
a NRC OrganisessemalStructure And Resources j
e Oteer Agency Programs And Areas af Focus (Le. License Transfers.
Dry Cask Sierege Decommeeening) l e Urosium Rocevery lasses j
, a Cheoges to NRC's Hearing Process I e REACTOR OVERSIGHT 3
. PROCESS IMPROVEMENTS <
ASSESS >fENT. INSPECTION AND ENFORCEME.%T eSuspended SALP Program. Aledfaed Periodic Plant Reviens I aPerformance Raults %ill Be Evolueted se Desereine % ben Enhanced NRC Deegnesis of1.icensee Performence is Werransed. A RmL-informed !
Baseline inspecten Program Will Be Performed For All Sites,
, sFromework: Performance Inderseers And Risbinformed inspecten Amula WiH Be Used as biensure Lacensee $sfety Performance. Results Will Be Evolvesed Using Equivoient Robinformed Scales. (Thenholds) sinspeceeens Win Become Store Risk informed and Results %111 Se !
. Evolueeed For Their Rak Significance Usms Rules-Based (Esemples)
Scale.
i eAssessement: a Streamlined. $4rtetured Resiew Process %111 Se Used. An Action Slatria Will Provide Consissency in >taking Repense Decisiens. .
l l
REGULATORY FRAMEWORK ,
f Please See Handout i l
i 1
i J
i
. ACTION MATRIX l Please See Handout :
I I
l i
i I i
i I' 5
l l
'l I
i e
0 1
S h
l TRAINING MnNAGERS i CONFERENCE l AGENDA. DAY TWO .
I 3
Opening Remarks f o8:00 a.m. I o8:15 a.m. Written Examination
. o 9:45 a.m. Break !
310:00 a.m. Post Exam Process e 11:00 a.m. _ Recent Training l
- Program issues !
c 12:00 p.m. Lunch a 1:00 p.m. Requal Program e2:00 p.m. Closing Remarks 1 Question From the Last Training ,
Managers Conference l November 5.1998 I o Need to stay flexible on exam schedule and !
do not wait until the last minute to accept the criteria from licensee. Suggested method
! was to accept the criteria early in process of the prep week. Would prefer to have 30-45 i
. days prior to the scheduled Exam. l
. The Finial Rev 8 Examiner Standard now request
. that Outlines be sent 75 days prior to the exam date and that the Exam be sent 45 days prior to the exam date. This can be negotiated with the Chief Examiner. l s
l l
. Last Conference Questions j l oThe NRC should publish the exam schedule '
early. Suggestion was to publish at least 1 ;
year in advance.
~
. An Operator Licensing WEB page will be coming -
soon and it will have the exam schedules.
Additionally, we have been sending confirmation i
~
letters to each licensee on the exam schedule.
o Recommend the NRC tum over the GFES to the Licensee. j
. The near term we plan to go to three GFES !
exams per year. Long Term we plan to develop a ;
computerized GFES. ;
i
Last Conference Questions I i
{ = The issue of written exams and limited staff in NRC create a "de facto" situation for :
licensees to have to write their own exams. .
- For FY2000 we are writing more exams and Headquarters has requested for additional l i
resourses. However you may be requested to l i wnte an exam if you want a given date. !
aThe issue of tying up exam writers.
, . The security requirements are like Requal exam i requirements now.
\ .
i 1 Questions for last Conference ) .
e There is inconsistency in the examiner i standards and the K/A manual. For example l the sampling plan and Part 20 references.
- Final Rev 8 issued, however we need more
] information to better answer questions.
i s in using the Requal procedure, is the NRC I going to inspect manipulations for reactivity .
levels on an individual basis? Or can the record be maintained as a team. l
. Records should be individual because the license !
is issued to an individual.
I Questions for last Conference l l'
i eWould like NRC clarification on following the I
10 CFR for an SAT program rather than following the guidance in the memo once i issued by the Director of NRR.
- You can follow your SAT based program, however if you have a Tech Spec or FSAR requirement you need to follow those requirements or get them changed. i o Written exams are getting harder due to the r::ising cognitive levels. Can there be less of j i
cceeptance % for the higher level. i
- Rev 8 placed a limit on the higher level questions ,
50 -60% and no more. Additionally, the time limit a for the exam has been extended to 5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br />.
f
SUMMARY
OF SIGNIFICANT CHANGES OR CLARIFICATIONS Chris Chnstensen l
i
,36 R R[
/ %.
/
i .
t t
SUMMARY
OF SIGNIFICANT CHANGES OR CLARIFICATIONS l o Changes to 10 CFR 55 3
. New 10 CFR 55.40
- Exams Prepared Using NUREG-1021 i - Licensees may Prepare. Procor and Grade Wntien ;
i Exam j
! - Licensees May Prepare Operating Test !
- Licensees Shall Establish Procedures to Control Exam Securty and integnty When Prepanng Examinations ,
- Authorized Representative Shat Approve Exams Before Subrnttal to NRC
- Licensees Must Receive NRC Approval of Exam
- NRC shall Prepare, Proctor and Grade Examinations Upon Licensee's Wntien Request
SUMMARY
OF SIGNIFICANT -
i CHANGES OR CLARIFICATIONS o Changes to 10 CFR Q
-Was Revised to Clarify Comproi.Se and Securty Expectations t
oChanges to NUREG 1021 '
. ES 200 Series: Examination Process
- Due dates for Eram Outline and Drait Exam Advanced
- Personnel Restnctions are Like Requal l l
-The Region May Approve Separabng the Wntten Exam 4 and Operating Test By up to 30 Days ,
4 t
1 i
l
SUMMARY
OF SIGNIFICANT !
CHANGES OR CLARIFICATIONS j o Change ~s to NUREG 1021 ES 300 Series: Operating Tests
- Dominant Accident Sequences Should Be Considered for Sampling During Operating Test j
- Prescripted JPM Questions Deleted j
- l. - can use somew.up ques sons for cause i i
j - Anemme path JPass increased to 40% l 4
- No Reuse of Material on Subsequent Days l '
I - STA Use OK per Licensee Practace I
t I
I
~.
' .i .
SUMMARY
OF SIGNIFICANT '
CHANGES OR CLARlFICATIONS i i
a Changes to NUREG 1021 ,
l
- ES 400 Series: Written Examination f I
- Systematic Sampling Required for Outline Construction
- Leaming Otsectives Not Required ,
- Higher Cognitive Questions 50 - 60% of Exam
- New and Updated Forms
- 30 Question Sampiang Review
- - Exam Time Raised to 5 Hours
, - Clean Copy of Answer Sheet Required
- ES 500 Series: Post Examination
- May Hold License for 80-81% Passes
- Administrative Review Process Streaminned I
- Licensee May se Requested to Provee fieference Maieral and i T.cnn.cannrormaaon I
SUMMARY
OF SIGNIFICANT i i CHANGE OR CLARIFICATIONS i c Changes to NUREG 1_021
- ES 600 Series: Requalification ~
- Test item Duplication Expectations Clarified
- Licensed Operators Detailed Off-site Clarifed
. - Proficency Watch Expectations Clarified
- 50 Question Wntten Exarnination
- Appendices
- Guidance for Developing Mutiple Choice Questions in - - - - -
- App. B
- App. E Clarired Making Assurnptions
- App. F. Defined: .
- Responsahne Power Plant Expenence !
- Technscal spearscatens as a Reference .
i
. e i
i i
! Examination Process
- ES-200 Series i
! Mike Emstes t.
i l
t 4
l l
e ES-201
- Examination Process l.
- 5. Feeky envetesed assumamens must most tre doesweig-(1) emmesy men asuREG-1021 (2)eneset t empeonere and seneaem essway preunthems (3) esern suemmels meat to appresed by en euereroso - .n - - ,
, (4) NRC must esprove su proposed esammenens. 1 I
i '
C.is Amouests for NRC --_^ - - . . of ensneusems must be m umice e .
ensemenos um to CFR M eo(c).
Respend to NRC esmuel n_ _ . _ . ; iseer end keep regen oppreeed of any cnsness. Contact Asgen # OLS arench Chef by onene to. . _ esan i seems and : opeens. Perwa seweepenent may be negonesed
- i l
6 i !
i ES-201 Examination Process C.1 b The agency ensernamere poecy apphes to esem consromme.
l
=m.ener. i s e es n.need os., Cor e,s ns .h.e.es noi n ;
. sere., noe. -- -- - ene eseg,ey -s .
I C 1 e The emeurs of meerenne menenes resussend mera sne smoky hennese .a be '
seusand tened on ese NRC's level of sweswoment m to essmasten i es=esoament process. The Chef esensner one chsoues retronom maneral '
.1 Centent wel ese deems shamg Wie phens ces pnar to tne 120<$sy esser. I The leonese is peouessed to eAwne ovos noses of tne authnes and 3 i
esammagsns. Oney one copy of me ess e rences a roeused (Regen N '
reevest)
! ~ CJ J A teomy meeruser er manager shes messensonny review we esemeenan mahnes and to proposed esens toewe eney are s.mmeed to ete NRC, I
t-
t I
l' ES-201 !
1 I
. Examination Process 6 i
C.10 An eJharmed mereenrant of we temiey 6censee ares approve me '
euemesis ne#are soneng mem to tw NRC for renew. The aumonred '
mpresentstas es not the same person es lhe facday meewer The j mJthargeo represerustsve we be me sehe person met me Thy inter is sent to. He Ones not need to row.se to test osma nor to en me secunty C.1 j Feahty a enmaraged e omwnuncese agruncere connems sath the careent I for efeuRy s,# the NRC presered esem et me Changes met the NRC has '
,' erecnod for sa proposed esem. I C., a re ty mosa e,,neos.ne,y n.n.as toihe e nmemons as e,eed l
upon unm tie NRC.
'i.
l C2.C Abcmd four msnma besse me esermnesen, Os Chet Eneminer we asil me
.feahty to io means . of dehwery emes may ens. the
- e.nne
.e,emms temd. .
, e .name ,e .
C.2 : E nm-s he e v. n e na p apme a me prep - ou j l
i ES-201 Examinatson Process t
, C. h the - e . seng - , - me,..e .y =
j esys.
- Cm emnch Ch.e -s . grim. oA.ne.S-hen . em e.
esameusens are vessy for eenmeremort C.3 f *$emping Reast of me ennen enemmenen ehes se ownesened wahm er= =en.,or.mas mo re.
ms .a. ew ==,amme.ne me r= nearme or we l. ve,.e.
I C.3 J ERO unyemes feng en RO or BOP m en not need to to evenmud '
=0*"Ebe**V l
,i i
ES-201 i i
Examination Process i
03 e Featty showed erne access to swy those particms wnusi the rutvidual bears !
researmeiinir 03.D G=es esempass at *penrubeed seinees* sur ruswasweas on the securny AFN f Supennears and mana0ers enthe 5ecarity Agreement may contam ther '
genered overs.gne of re reeung program rendene ve=e= of mammadons and remecei trenng They may not prende andendwel apphcent fosch a
' i i
I
. i ES-202 ;
i e Prepanng and Review Operator Licensing Applications t
i I c.t. r mom em em mance now pasene enne en ese-m e meecer }
, mesmaamn. v. toowy ones owwy em e. sapenwu nas nos so.oisese ey meanse. eenemort i e
l c.2.n The esomemwe ser n egnecem venamey.2- . _ eemnnat i
- D.3 Engemy seens ter Lennes sener Roemer openers mese som ES 70s.
l l
i I
i 1
, l i
i ES-204 j Processing Waiver Request :
6
-I D.t.s A renehe - _ ___ . nwet emme pues seen one year et ce amo e menen
+
the commi of me orgnet opptemmen toesne anel.
l l' O 1.g.esThe regen m.ay.e some se . the.s.oonemente
. - io. y. - - d.er en enemneman same, es iI.he sopicent s .mremeuaansmensuoyersago o i h Two-,se,s.o -=r. one ser e e,e ee
.no - e.e.n e _ _ _ ro.se
.e in ee-re esteemmet A seef w refweeng hennes wee be ===.9 i
1 i- !
! ES-205 ',
Generic Fundamental- Eramination Program i
c.i.e re wy nonnesse snowe newy v. win so n=ne.no parem se r.c. r :
9.y see or senses en sne.sheel from mer pre.soussy outenmes regersuon '
tener ser me GFES testy, me enemmenon a semnessees '
I I I
A swa GFES is passeis n 2000 Oceaner 1999, fewery 2000. & Ace .
2000 are the8y es.a.
The GFES enem ame a saaeys me weenenney ener the ekst Sunaisy of ee !
eneres !
Ls.a---
T N
EN MO E EI G A T C
N AL E NU R RAG E OME T
FS CM R N CE99 EAR OI 9 RRO D,OC GT I
CF1 R FO. 21 RRA E 1 EP ER G1 T GN AN S O OR NO AI G U BI A
.T E MGU ACL E EC GR .E A P U N CN U SN _
RI F h
I N
I BFO A OE R NC T OF I
I S F I
O V
I D
9 LM. ; -
W g
O. ,
- i. i M
i,1: 8 1 aa ,s .
R I*1 '..l a -E w!
8I f '
d)5 i j' i
3 -i M i-sd"5 t i ile :-I a
.l gt! 11. 1 m 11 al "a
all6 3:
1
. t 1 o
- a c II 8: -
.1 k, r, , ,1 gj Ik 8
3 I'E !
e s;
158 g **! sle!
g- -
ia 515 I
t l'E' f {h g"8 $
I 2 bl
$ms
~" o- .3 2 Il ta 5 ,
I B Eg }
- e51 i11 =
El -
- o. 8 8 $$ 2 2 2 5
i 1 s*El a 4 a
l o
S n
i-I is, I3I
- 8 8]I, ti-ji 3r
,) u'a l
[ E
- as -
a 1
's" ljs *
- j.1 i A
I fi A2
${! I s h I 2
1la1 le i
=
f
O e
h 3 _ _ _
[
O .~.
.u. m+ ..< / o u
g
.. g.. ,,,,
iI $ h:hi' w ..:a,g.
o m.
a &
b .
l O
Q pT
+ ^--_-
s -- -
- f u
h ..
E
~
Wrl-- 3 g $ itE &
xwm x
.r... :. g.
%.y %a s u;;.e "Q*"
~
U
's ' * ~
- q' gyif*54:4 . 5C-i -
<yE. $q',. 0;{% -- :
.;.y >c.,4.'i:.
Y.':7g$.k,i
- a.
' T'f CT:.:a$
3;. --
.z
.I!?
resc p
,*Til.gll:e.f:.5lOS Z O
C
,r
."Msggifp,yV ......
Q sTe U
o m
1
~
N -
O -
^r l -
'E C - D T - N O - A R -
P NN MO O I EI _
l A
LTT BAU I
N O
OCO I L _
RFS U PI E P
A T NR U - E _
C - ID l
C -
O -
Y -
TN C -
E FI A I
L AL SIVTR l
. l
. . U K.
R O P -
- S O
O Y E
C _
S K R R E AFEI I T T YE S U M
A HOR T A A E F CN R
O O
T O R
F TTRR LL AE I
D A A S ND EE GR WT A C
S S N DL Y AU EP R RA SN I O O E P UE D I R
O ESLO HE C ME ER OM I
N I
T A S l
i T P CN E ME A CR U SO C R R L AN NR I
L l U OI N N O i G B S CV A ON FN T E UA RT Y
Y N MI R T T E O I
R P EI R CR I I
RG E O E E S RE F F P I I
AT A R S I C _
N S E N T E I
P I O D
,r - _
R -
i n 0 TY f
N OS -
sl nt yo, CEF T M I
Cr er e si A T E -
Rv a s A E A GS -
NOSM R S I TY I S
- E C
M N
'. G NS UOF I
I I
T R TN E AE e
I TV P IE -
c -
i c n N ga s I t e mae a r r s r foA e -
t r n -
S e o t -
P s -
r e -
n -
r o -
C -
i u
=
y B _
e xadme i
1 1 1 t E1 05 E1 1 % 11 r
dy d xi O 5 0 0% 555 xen kkk G 0
0 1
A W
0.
5l R 2 t0 2 0 l
>l>
00
- 0. G 5 A I I 1> >1 > 5> 1 5> > > W d
m h y B
- de aem 11 S h sdup %%
1111
%E5%
11
%E%
ed t
r es I
m 0 0 O 88 0J00 000 0 0 3 t & 3a
>l> >2 h e t t 222 5 M i kI kR > > > 1 > >1 >1 >>> >
C ,
O i r
F r a r i c e w r i
(o e r t
8 M r s m a M m e e t
P f a )s r v t a i y s M tt io (o H 1 1 1 1 a (a pr is n1c 11 l
a me hg01OGCl i OI 1iWI l
a a R s u c xx c r T sP I sS l
p WI HRRi B1 NU I
i l I O brb s i i t P e n2 f RI I F t O B AD>B i
t i
0 E (a
l I 1 as c de 0 0
l e i t
i i a i 7 r
)U S sr
) s e
Oo l
b o e n a 0 p i
p (S t i t
T 0 m s yu ip d 0 e 7 t r
o y l t
i c F
i N n r
ps f )s Oe r c m )sd2 i
l 1 o
wts i
i t r s c st nd sta 2
rra t
mio n a
cs 1
r o wt oq Ua F t
S an at q np h 2 P r n ed e w1s de fa t
r de as i t s t s
a mt ni o ms ye y )s a o su sa S g S yc k aa ya r
d n
i qm a v ii r
c e qo t
fe w t
er fa t i
I U n '
S p U p Sa (a S q t
s s
u er t a
e s y
v S E g h g u i i
r u
i l
d a
dg C
u e h m I
d -
n a
y B r e 1 d os eta n r % % %
i l o % % 0 0 0 5 u up 0 0 qgs 0 0 A 0 O 0 l 1
eee I 1
/ 7 G 9 l 3 0 5 5 RRR > > N < < < > > > > >
d d
n a -
't n
s y B -
d d r e C
e l h
o s
eos s ta n al o % % % %
0 1
S eup 0 0 0 0 0 5 R e r gs 0 0 0 0 0 0 r c 9 4 n ee 5 5 6 8 9 5 0 2 2 O h l
T T iRR A ) s C m s e e us
, l
)
. I u r e s c r D n ni o i
n t r
e n x le u N r e e o i
x s
,a t r o ve r b f _
e u I
E a a s r r e r u
d n a msu g uq ,
u ep g t C mnr l r s
e) q p a c c
I e
r o ao r
N ( i a
vo u usr e t n o p gi yu o ev t
c A i d t
yf l
ae h ig Oh t e c
(
e n e r r r M v , l s vr t R n r s c a ( P p h a e Ei s n
er)s R
it t i c
t u y u e p e m e y e no l s ye n r c t O Am i oi v h q t u es (
e r e r o n) i l
it h
F c c l
mer nr o Ki c y )s v ur t f r
e a s r b g R i ouo i v f r t
ir i ccau mte ia n E
f i
cp e mp mf e r
oex l i
bt e
t c
e Oq P r r oa er l i P ug p ee aa r t eS mu s f n f r u R du minr p gr f r n u t
leq E iu e eq r
Sh iu uo e t a o efo P l
es 1
) c x mive v nl l R r l
o u s m r u nt n e S e ad o ei u r p mo n o ve i r 1 CT mi, xr (
cd mo t
n H u i or)s u) l f h
t ap e r E o a s gu e e Rf o (
e a ef qd r s r c me i
( m c p t
s s Ce l v E o T mn) t ei t l (h n a
( n yu t r a cre yr i o r o Pl e a t i S o eau e i
/ b p P ve ) a e es er n d r i p t r Rc ge m o e nv i
u g i r
s rc e k p e s q og u r gr Dt r t
yer av r o
i oe np F o oi n c t t t l S pa aS k o f a a i r t
a p o2 et e i
(F p S ra ne e a a r pp p1 i r t
s, u L .
e cg x d u yr e LeLf n
i i eh ae q
d c h P i cc)si i
f n Es u ad R s au et r
t (
u e e it i t
t eq ur n o e r r r o cg t r l
ol u T s aae ou lai nv r
Mec Ar u S nr - c De oa o l t
if eeg i P pt Nd oe i
r n r Cvf t n o ma c r l ea r
dty Cn d of l
e u oa n
o r lys u et nt e l i
r vu nl i i r t
a p Or De r e nd f a oh o d ne i n x Daqh ai b pg t
c a ns s m c
t I ae E/ un S/u c ot s r eo er e sr ne t
a nv c n cr i t t t r a oer SCecr Ot a hg i l f ci r T t -
d e oe l
i ei l cu E c ov ev tnre _
l e R m 'p R p Cp D r
R Et e hi lAre Od r
R (o P (o P e FP i
n _
t o 1 n y n i t _
g a 1 e t
o c _
n l
o t
n s l f i
l t e .
e i
o e s a a b o n
d C i e nS r -
d m yn c o d P o 1a r n in a t
s s l
om i n de t o R l r rC t ce t a e gar ai pt a cy a
c e el ie at s n r i i n r u ey o ep ui cd l t b fe s y
r o rF a RS
+-
C mre c a OR PS ua h _
C B4 4 EP P _
N N
~
, y ..
n : l o
n ,'e. $4 i
A e p ib m ~8 4 i
/
, /
4$,1,1, 1[e$.i'o&/
i l
s
~s 's
t h d, h o o t n it N t iw e w le s e in g p s g bt t g n ana ar ,a r i t
ude n it t
epl e P pdn M e s e ee S. n ee c ;O a e ee oBlb mest fiye c Mes sc nnn di oL nn nn t sa oee oet n U a. . dehi ep t
icm si Mek . ic sie l
.t t
sLe to ovl
- s. L rm i
la . t r g -
e" miet r .incy r hsfe moa min n r
e e 'l oe v 6eina OFPWUS t
oe a CSM dRi r
OoA r -
-.ig een CSa na s s ens, e .eg )
't n eh n r dl pt ot vn iit n o e ci nw t
o ion te d )
ne e eisp u t cdny m a mdt te )
e oc e n
l dl t e nat e ea F L m in aueI r n jacf is..og re ma a sd tr n oa r s s a n s
r g M m w 't OgnS
- bt f si i
a
- rl e ua D f) (
n pp l o ime mr c gr en ia opt Tcr f
e , oou g .nn
.ea f h dog 44 n w 0 5. er mfoi I
DeCN penin r t g eni nFe ist n Lt ie n enn oSi n CoSM 2.0 l nito o ero en r
eodYioL Pes r anD o v vt e dtsh r h rti ee e me 25 d wec eme Cr Pim e it oio of is is t
rde er scn t ows eev eio nt RR<O p s (o ss e g n e R iepmrglt e a pR1 emt w eudr u g Oteen ns ovO l i t
i ( ice le FF J vs s es im usa w spues i
eprC CCl r eI n
> eoeu r oesea Dec R A m Ochn -
i RCDMoCMiRM s EMiL ic mN BInC a s a 00 C As/ s o Diist a e LI 1 1
- - - R a (w C EDwM A I
uicn e
)t t e n w eps n e C io e E nt a n M R t c
f o
i v
EC it hI u ono e CN NA Wwpm oifnonwio r .hi ein t )
A N
h ee ps su t
el6 tr n oa
)
h R
o t sd pp l 4
IX A MIC d2l e( et l
e rtese t c ung la (R it Ina nn ne it w
RI F deYiPrMdi h e nr e ooe s f
let w
d C oo pC gr n e
R ON aniWims r ro c go eraer it ga Snet nn aoio n s eg istnio t sc d T FG gt et ce r n emh t Rn /w e c sn uae P Deso3eCia My vl eda e ime A RI E S r
e s yta;tcmt Rs r n i e sg s ss i
ined t ea i
d vs sp sme c
M PYT emtu nop nr at rseie jnf oiU mh n e er se leur scg sa k r cg esein r
ir Don fr e s
N E E OCioaAOMS nr Sebia Ddi daw t
csv UAO aoe oe As/ s Aec EF BFD DD R a (w RPL i
IO S A <
NS s T E t u n p e o o C IC N LI G n c n t r oD
)
it c
t e
A e S i e e s h .
A a a )De e v p nn tr n
)
t -
E ite h nrmneM oy C Bon (r s it cC s o i M-pa oa plp i
w -
R e In n en W iot l l C )f sr su r f (t
eei c ce rrR oN d s
ere= gr t
e e
N ot e eeF n RA? i/s tnio wnnPms irL hi Ch a p wec M n gn t
C ni Dh I
Trt eo ico e t t t
na r fesgCt iv t
ewhg ei eu n - ei l i eme vsp s D 'e De s ofiee;c r aiow snis n ior H w mdi ura e c es r -
edna t aeeb wie st et eo cgn r eIn o ne n c e j
r r ve sN r icv ao oea Ds/ Cc -
O (n o tcSAO D as (w ii i
BDM LAO BF DDi n ,
BL i -
e cn dngnM )s ee t
e h r
iv n) )
aan to y o oe tr n oa it w
cl in t t -
c r cn i it t
pp l dps e e n m )sdsl eo e n gren t
erl in eu r l o
ipi r e nsc t r esa e mfoPFmFr (
se s nose ena r C o
mnB ist
/ nit o M .
sPr e( oCv S i e t e r i(
o em wece C e s toic:i t e ntn e f n iemp Be s ts6 e ntc n eI sn n o nia vs s es r s r ei n one il it iId) r e cf k- eg lAuit pd s rb ej ee usR oe ei t ic c is s
aro n
o Ds s1 I Rc RR( S l
AInnnGO i i LA RBP N D a (w SL i
n n o o it it e c c t n
t n
yc r A e p
y r e e one e s o m m tar e s lo t
la sn st sg luf e n C uo sr eo ics in gn e bs et l
gi sp e eo ic R ec t se us e RC L N' RA AR PAM 3
gb jUy) l)Z uu {uuE )l
(
8p02 O
~
)
2 1
2 8
L
(
Q "s
t n
l a
P ~
r e
w o
P r
a e e s u
l c e
- . u in i
g N l e
t t a d a l i
u g
F e n y n n c a o i l
i s
r o p
i c P e s n h n g i o t i
h n t
a t w
c i t
a i c s e
t n
e r e
f i
c r e t e
T p e p
t n is s
/r O s i n _
O f o
l a
l a o t
c n c a
r e
u i
n i o t o t s n n e
p i
t g h c s e s e .
a e r t n m I 4
.F t g e O 'g h g
n o lp a t a
n u C t
s i
s o e y u h r 'd m a t n o ic C d a s lo p
s e s t r t n a s
.,o n o e s t
c e it e a m a m s e g it r s F a n
l p le e e l
a v r o i m t o o y y n f t c e o _
i l
o ic c e C _
P l
o e s R P R U N
- e e
- e L
h d c e e a v h e o t n
y r t b p ae d be p
d a- e e d s m n aa r o oh f
o i s l y
r s et e
p i
m blie l
e m i d l
b o wi r r f
t o - C ot o r d sl a e e t s u 8 n w s 9 e x m i
o a 9 dr p b t
es i 1
- u r -
o T- a 5 b s A hd y n 3 y
- t n t S ea r i
v e r S o 5i o
) t i
t h o N a
( t c t c n ,
Alug
) a a f l /
e o aio I S e
(
al u t r t r t ut a N r 1 p c a p
cn A yr e r- ai m a o- e s
- 3. in f
f a e - e a s r
dh x r s 5 a t a
t n
a nt e t
o e 5M h t l a
p h t
a a ce e
- l s d c n
e n e
Ry s n
f- t f e n n Fi t
o l
a u yt I
- s n
r e c t o u Ci tv o lsi d e i
t t l a t cl i it e d 'sr se u c aic u 0 c l
u n a p a e a ov f
l oo i v
e re d
1 e in l
p h n mtar o e t r a l a f c e , o R m u oi e e a a t r i
l u p gt n d l
o t
c a s u sl a
r os t y; e i e u mno v bs is r i d 't t
n e t p s i h n y i ve o h e it ag t i
r c .t c e a , l cn c9 4 g t n l m ai i A1 n
a o ch u a t pra mps r pe l
t i
n d f y1 e c e o o ng i eat r b
$ t e mp aor h ey b od es t
i n
gan m r e s t dt h d t i i c o u u enit wro n g nf au 5 u G4 i l aor e l
si lf r l e5 p pp e u n ee us y 5 i
gr l
u esa e R ollotnn c a Ct oar i oms r
et o 5
Riseb u r
d d d cia t Rlau R F t qn s t eu u l l d g C n e e c u s o o eRliM r
oWW*
p
- te Re 01 a
r o l u r e C*
- P *
- R*
- o I l i
i ES-301 l l Final Rev 8 Change Overview .
3 l
i k a
- I I
I l
I Purpose "A" i I
i i
i 1 I A8 apphcents for reactor operator (RO) and sensor reactor operator (SRO) heensas at power reactor facemos are requesd to take an
' opetelmg test, unless a has been weared m accordance enth 10 CFR 55.47 (res er to ES 204). The speafic content of the operatmg ;
test sepends on the type of hoense for which the opphcant has '
applied.
- i This standard desenties the procedure for developmg operstmg t tests that meet the requeernents of 10 CFR 55 45. mcivemg the use )
or reactor pent samusanon facaines and the conouct of muR>una eveavanons.
~
t Background *B*
i
~
l To the estent apphcab6e, the operalmg test enil reques the apphcant to '
comonstrate an unoerstandag of, and the atutny to perform, sne ackons necessary to accompush a representenve sampkng from the 13 mems scentifred a to CFR 55 45(a)(all13 frems ses not need to be semped on every opereeng fest).
In addason, the content of the opersong test wdl be edentifed, M part, from teammg obpecttwes contamed M the facdety hcensee's trawwng program and from Mformaten m tne feel safety anaysis report, system cescnpten manuats and operstmg procedures,the facdsty kcense and beense amendrnents, hcensee event reports, and other matenals ,
requested from the facday keensee Dy the Commissen.
l
l i
Category "B" Control Room Systems and Facihty Walk through (B.2) t i
6 Category B is danced into two succeisgones. The flrst and larger suecategory (9 t. " Contre Room Systems 7 focuses on those systems with j wruch 6consad operators are most evo4ved (i.e. those hawmg controls and ,
eneaeuens an the mem comrol room). The second subcategory (B.2, *recihty Week.
l o,e,.Througn7
. ensures
.on a sysiems ioc d that the a.pph.
ouis e cant isroom.
me.n comra femdier wem tne assign and l
i ru.ppuc.nc, snow ,s .nd ewat r.ses. go .nen ,ye,em re .
encuened by semimetenny Janis end, when necessary, spectne renow.
up questoons bened en the appucent's porturmence et each Jpst. l i
i Category "C" i
integrated Plant Operations (B.3) ;
i
! i Each applicant must semonstrato proricsoney on every competency j l apphoemas to tus or her 6 cense tevet The enty escopeon is that SRO ,
Competency Number $. *ComrW Soord Operemons." ss optenal for SRO. j t
j upgrade opphcants (i.e., SRO4,pprese appecents Wo not have to fin a posissen that ;
reemros eensret board operekons: however. H they do rosete into '
such a peeMon. they ewH be premed on thus competency even though they eney not be ineeddueHy observect by en NRC esarruner, as
, escussed in ES-302).
1 t
INSTRUCTIONS ,
General Guidehries (D.1.a)
A Ts sys,mante.preectobety ems. operei.ons sa,nd es .ementam ev edtest wnnentegrny.
.p,. vaned subrects. -
e..,n.,,ed ihe - i,me. .n.ess ,r,s.su,es .,e is.. en ios,,ec inai,udeare noi .e.ng
- i. e,ie,senon among e,e ap,,canu n,e ,ne Jr., en,.or tor.co ,,os shnu not be ,e,.ste, on succeserve days. i e
S I
' s General Guidelines (D.1.a) cont !
i a
' r l
j Opereung tests wrmen by the feceity boonsee sney not suphcote test items h
, (simunnter econenos or J9ees) trem me applicants 'eudtt nett (or tests I
I fr me oppdicent de reesning she eserninetien) gwen at or near the end of the hamnse troeung csess. Senuantor events and JPeas that are smaar to i I mese inet were tested on the auda esammenon are permeied provided the actso=ts requesd to metsgets the trenseent or composte the task te.g ueine en essernew rem os suecuneed on Appenas C) are asgnoncentir eneront t>em shone reeuered nunne the euer i enemmetten. The necintry beeneee ehen idendfy for the NHC chef f
eneminer shone eknuteser evense and J9ese shot are einwier no shone
, ther more sensed on me eumi esenwneemn.
'l.
I i
e I
f General Guidelines (D.1.d) ;
I I
! i I
e When selectsng ent'1 . , snotenets (JPMs. econonos, and questions) ser the operstmo test, ensure that the instonets sontntute to the test's overes copossly to OINorenhole between those appecents who are competent to safety operuse the paont and anose who are not.
a Andmenewy, eII of the sont enems ehenistincluee the moee necess of l sett vesidtry (i.e., consent, operosenal, and me.,-' l
) descussed e in Appenns A.
Any test soms that, when enessed, would rene awestent vegerihng adequate pa ' - , for denymg the opphcent's hcense eheutd not be l
, included on the operstag test t !
General Guidelines (D.1.i) j i )
l
- l 1
Every facet at the operating test. inclushne the prescrvpeed Caespory A oueeseens and answers, the Jeets for Cetopones A engt 8, and the ;
l
\
Casepory C ermuissor scenenos, enousct be pionned, researched. , i senessed, and oocumented to the mesanum essent poesitte before the i test is admmatered. l 0
Thet ts "BEFORE-e l
I i
1 i
i
e 4
I L l
, General Guidelines (D.1.j) i I
. t I
Esaminers who we be administenne the operatmg tests but were not g hvolved in ther cove 60pment are expected to research and etudy the l topocs and systems to be eaarmned on the operating test so that they are ;
propered to est whatever pertormance-booed to#ow up queshons might 1 be necessary to setermine W the applicant as competent in those areas. i As esoted in 10 CFR 66.46{e), the operating test requires the applicent k
to demonettere en underesen6ng of and the abilhy to perform the t ackens neceanery to accompissh a repreeentetwe semple from l among 13 homeinstedin the enroe. i i
i l
s t
i General Guidelines (D.1.j) cont 3 1
' it she appkcent terrectly performe e .99h0 (includmg both crtticalend noncertscal asape) and demonstreres ternekenty with the equepment and proceelures, It is not necessary no ask any tonomuy questoons.
i Nowever, if the applicent fedia to accompisen the tosh stenderty for the l
.99h0 or demonetrones e fech of underween6ng regarding the I equipment end precedures such as havrng strfticuhy locating intermeGen, controlbonretin6catoons, or centrois, the esemaner must 1 he propered to ask performance-based tokoe+up questoons, es
- neconsery, to ciertty or confirm the opplocent's undereten6ng of the l eyesem es it redetes to sne tesA that was performed.
I e
f' j General Guidelines (D.1.!)
, The presenpted guestions tor Category A and the performance-based
. 9eidow up quantrons der Casegory D mey sncluee e combonetton of open- l and cloosd reference hems. Open-refemnce noms that requere applicants i i
18 apply ther knowiecge et tne p6 ant to poetulated normal, abnormal, and !
i emergency satustaans are pretened. t CloseMference hems may be used to evetuate the immediate actions of .
i e=rg.ne .nd.ein.,
ch.rectenom. proc wres.
ntenoco. esi m=ria.n suioniaue end ,oot,ne aci.o.ns,.
ad,n,n op.raung
,et,.e act. 4,es.
as appropriate to the recinty. '
Hefer to Attecirmsnt 1 for enere gudalence reger6ng the development and l une orproecropeed open rere.nce eunet,ons ror Cerepory a or the woln. ,
} through seat. To the essent poossbee, the concepts in the ettechment ,
shouett else be opphed to performance besett 164towwp questions. g i
I !
I i
l
- i Catagory "A" i -
i I I
Administrative Topics (D.2.b) ;
i i t For each senurustretwa sumpset, estermee the best method for evaluatmg l
. the apphcanrs knowsoege or skety an that stes. Although a performance- l
' bened evoiwomen, uoms e enges aenensstratwo JPM is genereHy preferred,
' j two presenseed gusehens may to used to omnduct the eveaustion m each ;
i specWac sutpoct eres soincted for evoluehon.
l l
- ~r o. se cat.o .w, C., I rh. : cr a sua ., d,er ~r l he admin 6esered eeperonely.
8
' I
~. , .
t i
. Administrative Topics (D.2.g) :
'l Fonners the completed euenne to the NRC chset osammer oc that R is meesved by the sene agreed upon wqth the NRC regenet ofrece et the eme tne esammekon errengements were cenermed;the oumne a normesy due apprealmesady 75 eiere before the scheduend enemmenon este. Refer to l ES 201 for sessmenei maruchens regaremg the review and sunnusal of the a esaminemen euene. j 1
1 Administrative Topics (D.2.h) 1
~
l 3
After the NRC crsaf esammer approves the operstmg test sumne. prepare the fmal Category A test fnedensis m accordance with the general l pperstmg test guesehnes m Secten D.1.the open reference question gumeenes m Appener B and the JPM guicohnes m Appendia C.
i Va.. she refs, praecrapeed spueneens, and enewers) l l
I l
i
Control Room Systems and Facility Walk-Through ,
Specific instructens For Category *B"(D.3) l 1
i
, Thse sesopory of die operst/ng seet eveduesmo the appecent on !
eye ^ ' K/Ae by herung the opphetnt perform eelected tosks f i
and, wnen.nece.an.ery,
,seo,he, ne. .e e< 8ben.ed e . or on.the o,ppkcent aye.em d s. eenocensd e perrormance,
.v,th pro 6ong speconconno eer i i
The Cenegory a teste are si edmoon m and should me sme,ent som ine i events and evolutens eenducted dunng Category C," integrated Plant I operatens?
i .
I 1
Specific instructions For Category *B" (0.3.a) cont l i The 10 systems and evolukons seiscend for RO and SRO4 apphcents should evolusie et least 7 dmorent setety funciens. As of the syneems and evoluhens in eeCh euttelegory of the test should be selected from Odferent assety funceen tats. and sw same syneem or evesuien ensuid not be used to evoluste enere Wien one safety funcien en each subcategory. For pWR speseeng smete, the prfenery and eccenslery eyesome hefed ernWer $efety ,
Funceon 4, *Neet noneevel From Meector Cere,* sn Sectoon t.9 of .
l CUREG-1122 ereseme one pnmeryneer he treened and en eeperose one seconciary, meysetety funct.oons; be ee cred La., two tron, seresy
- Functon 4.
I i
J Spedfic instructions For Category *B* (D.3.a) cont ,
The 10 systems and evolutens seiscsed for RO and SRCW epphcents ,
should evenuste et isost 7 deerent safety functens. All of the systems and I evolutaans et each sutcetegory of the test should be seiected from enerent safety funesen hats. and the some system or evo6uien should not be used to eveauste enore then one safety funts on in each subcategory.
For PwR eperating seess, the primary end eoconnery eyenems kered under Seroty Functon 4, *Neet Mornovel From Reector Core.'in
- Secean 1.0 of NUREG-1122 may be arented en separere setery I tunctens; J.e., envo eyesems, one prtneery and one seconsory, nesy be '
eeeecned from Seifety Functon 4 ,
i
l l
Specific instructions For Category *B* (D.3.b)
I i l
i For each system selected for evolueton select from the appecapie KfA l cousing or the faceir hcensee's one spectre task 6st one task for wnich a
. Jeu es ms or een be seveW. Renew the assocasted ownuistor outhne
, W lt has already been propered (refer to secton D.4). and avoid those i tasks met have alreasy beert setected for evaluehon on the dynamic sunuester lost i
l The Jpets shouegr, benevnnueHy end as a group. hene oneeningWul 1
perfernesace requiremente anat eftiprowsele a dogftsenere tests for l ove6mong sne appscenra sneeressadmg of and e6eirry so se#Wy
- onorese sne aseechened aretems and the poent les reguned by so cFR y 55.46).
I i l
, Specific instructions For Category *B* (D.3.b) cont i
P At loost one of the teelts sha8 be reisted to a shutdown or kwpower condeson, and 40 pertern of the tasks (Le 4/f 0 for ROs andinssent
) 3 roe and 35 for upprede SROe) shen require the apphcant to
- esecuse essernese poens ensnin wie feedsryis operseng precomires.
.l l In edewen. at least one of the tasks conducsed in the plant (i.e.,
, Subcategory 8.2) snati eveausse the opphcont s ainmiy to implernent schons ,
regured sunne en emergency or etnormal consson. and another shali !
I regure the opphcent to enter the RCA.
I I This prownes on oncement opportunny forme opphcant to siscuss or ;
esmanstrase the reesten control sutp essenhed in Admwustretwe j Vope A.3.
j i l e
i I
l Specific instructions For Category *B" (D.3.c) l l
' I Forward the completed walk-througn test outhne to the NRC chef Czarmner so that it is recomed by the oste agreed upon with the NRC 4
regional ofree at the time the exernmation errengements were confirmed; ;
the authnes are normally due approrernesely 75 siere before the '
scheduled esammsten date. Refer to ES-201 for addnenalinstructions regardmg the revew and suommel of esanunaten authnes. ;
I l
5 t I l
l .
1
? i Speerfic instructions For Category *B' (D.3.e) ,
)
i i
I i 1
, Sutwnet the entre operahng test package to the designated facday reviewer I e
or the NRC ch of saarnmer, as appropnese, for renew and approval m I t accorsance wnh Sechon E. The test must te recearec ey the NRC cheef f enemmer approsimenely 46 steys before the scheduoed rewow date, unless other errengements have been made, l'
i
)
I l
I
- ?
I ,
Integrated Plant Operations !
Specific Instructions For Category *C- (D A.d) j Each scene'to ut must, at s nononum. reemre each apphcant to respond to the types of evolueens.feitures, one transients m the quanteses
, esenkned for the apphcanrs amense level on Form ES 3015.*Transent and Event Chechnet* An apphaent should newy be geven creen for those everus that regure the apphcent to perform vermesse schens that previce
! eneight to the apphaenrs compownce.
The requer s should normony be
.am, e,estinstrument
- .w.s.n. ,he end component
,.e,or i,ona , htture, h.,.,o hose ,n,ee,e, ener the nmjor srenenent shound se corosouy rowewed eecause they ;
mey reeurre eene appucent ocean end prowne vae inese ht reparosne ,
shour persarmence.
j i
~.
i Specific Instructions For Category *C- (D A.d) cont Each event should eniy be counced kr applicant.
e For tsampee: a power change can to counwd as a normel eveduuon OR es a !
reactivny manipuisuon.
- senaany, a component fanure that enmeomiety ruuits m a maior transent counts es one or the otner, eut not oath.
I 1
I J
i Speedic Instructions For Category *C' (D.4.d) cont My normel evolunon, component felture, or ebnormel event (other then a reactor trip or othersuromove power reductson) that reQurren the operator .
to perform e controhed power or rencorny change wsil senefy the l requirernent ter a reec9eity manipuennon.
t '
i Then includen evente auch an en emorpency hereden, a dropped rod ;
. recovery, e signtnoont red bank reekonenent, or a menuel reactor power -
i reduchon in reopense to e secondary eyesem upset. Such events may *
! reduce e more umely epwetor and poent roeponee then a normelpower l 1 caenge.
l l 1
. I e !
~
i I
Speer6c Instructions For Category *C* (D.4.d) cont !
. i l* Cf the tecieNy hcensee normally operones with andis requned by rte ,
techancelspec
- i ,eo,n. the eh.e,6Ngevene to esere neore then two e-m.n.,-y aud ,t,e the une ored.,ee. MOe in the co,ntrol austegoces to fl# out the crews. I l-
! -l
. In euch cae.e. sese ar. on pneanir,g th. u. nonce to eneure that the i enhavnenet operators do not reduce the eneminers'ab#rry to eveduere ,
each apphcent en the Neuered number of evente and on every ,
e cornpetency and rebng Coctor, i
.i r
i
~
i
!E Specific Instructions For Category *C"(DAe) l 1
i When the proeosed senuestor operstmg test outimes are complete, forward !'
them to the NRC chest osermner so they are recorvea by the sete egreed upon with the NRC regenet orrce et the twne the enemmehon ervangements were con 6rmed; the outimes are normally due approsmeefely 78 Woye before the scheduled esammehon date. Refer to ES 201 for ocastenei sietruchons reparams the renew ena submrttel of the Csemmehon outines, 5
i i
t f Speerfic Instructions For Category *C" (D.4 g) i i
u .e e,ees ope,s.ng ., paci.ge io l
.s,ine NRC ch.or. san.ne,. as .,vo-o. - -,tne dos.gnated raany ,e-,
anda,-vein accordance wnn Sectson E. !
I l l The test must be feceived Dy tne NRC chef exarruner approsfrnefely 45 I I
Were before the schecuted aetrurustrmson date, unless other arrangemords have beert inade.
i l
i
' l
.l t
i I
! QUALITY REVIEWS Facility Management Review (E.1)
Othe operatsng led tuas prepared by the facimy im.1eee. the predarseinary i
euthne sad the propeeed sest shell be MeeperuseriUy revenwed by a
. suponneer er nionsger before sney are summmed to the NRC regenal ofice 5
for fewesw and approval m erzortlance imeh Efr201.
' The reviewer should evm the ouane and ast uomo the criiene on Forms !
ES-2012. ES-3013 and ES.301-4 and mceues the sagned forms (for each j esMarent opereeng test) et ene esammation package summmed to the NRC in l
accordance aseth ES 201. ,
i 1
. ~
l i
! l ATACHMENTS j j i
Attachment 1 (F) l I
i "Open-Reference Question Guidelines" i
l
)
I I 1
I' l
Opef> Reference Question Guidelines I
4 approprose l s.,ogu,,se The meethe e,,ucan,f.armet cem,s.ese a me shers
-,s.e enewer
,e,her .en gwesen, ee,ec whee,n from emeng a set of eherneen responeen. as en the con wnh munemhoose, menchme, and nrumenne gausens.
l 2. Provsne comer. eepNen 1. _ _ _ . . L ' noe ser enewering the guenten no lhet Ihe app #sent asnWoreunde whef eenedtaNee a fu#y J eervoce roepense. chosee worse serenmy se ensure wwr me ;
esponeene and regu6roment of um gueenen are apprennesety eenvered ewree such as eemounce,'ouwkm,= and ~eurmin.* can invrie e for of WesellIhef de not neceomerWy resevent ,
i l
. s ,
J i
Open-Reference Question Guidelines (cono 3.Mehe saa e shot she espenned roepense matchee land be knehod so)
Ihe requiremones gesentin she gumehen. Censagerthe encount of pertief erest se to pressert for en sneempfeso enewer, For gumenene. . . , _ . . .. speeHy the snoonen of, especsesf. Try so moes see onewer turn out to to wfeeds nuenters.
I
- d. Aveder gnalng esey part ere# of she sneemer by she esey site queneen i de worsed. Mr enempde: s she asesswn ene sesome emenrucmd.
l eeuftf tesomen of she pdent to accomphoned enerWy sher a rescoor fdp de pen Ihe pient in cederenueWownF ff ee, how?' A seef-wees
- apphoent een restes enet she onewer hee se to yee, or efee sne
- second eers of she spueenen wount hen md something once ~of net.
w*y ster 7 i
l
~ .
~
i I
Open-Refefence Question Guidelines (cent) ch
' 3.& void what
-p.c,.d e w.r ceuest.be o.e - pr cene,ndered .y gu.e ch , ,. m'e,guee,6ene
.. po, emp, in whnch the eeking *Newide) the SI sernunenen eneene enenge fenewing en SI
, noennemen?*impkee thet the termnnetion ensene wHI change, when in actuohty t0ney de not S.De not une Werect fee &qsp eveneens that only require the opphcent to rec 7# where to and the enemer so the gueeWen. The opestrenal ersonenen requirost of sueemens on the oeft.through seer end the oppscente secess se reference securnenss, ergue agemer the use of guestnene shot seat for rece# and noemettrenen. Any eveneens rhet de h not require any eneipess, syntheess, or opphoenen ofinterreachen by the g appecent shouht to enowereede wnneur the edst of reference mosersels. !
Anfor se Es-e02, Asaechment 1, for a more seasided ehecueeden of pract 1 febe.up quentene !
e
5 s
Oper> Reference Question Guidelines (cont)
)
! I i
l 1.Quandens should steo edhere to the generte hem construction principtoe and guiseknee in Appendes B. Moreover, Form ES-0021,
~NMC Chechhot Nr Openduerence Test hems.* conseins a kst of
- Queevone that can be used to evolunte the outenbikty of the e
questeens for the enelk through pertN>rt oflhe operoung tesL ANheuph lhe eheckhet enes devedeped kr ues ist evoluetong requehnceben eetnen esenidneeone, OR of the crNorte escept 9,10, i 11, and the K/A reteng en hem 1 are generscelly app 6l cable.
i I
, 602-1 Excerpt !
items 9,10, and 11
- 9. 4s the queston apprognose for the wroten saanune:4n and the
-l estected formet (e.g., short snower or snufhpe chore)?
- 10. Do quesmone M Seckon A take seventage of the esmutator control
- toom eening? l j
i i t ones any u.enen here the menw or i eine e souw ,ooparde ,
ousenon?
j c !
I
~
ES FORMS i I
i l
ES-301-1,2,3,4,5, and 6 l l,
I I
e I
9
i Examples of LOW discrimination i
! JPMs j
____ g ____
l-
- a. Aciu *Ds( op) (awR) !
, i
- 3. Start the Hydrogen Recomanner (without a fault) a to , w.the Res w.n ine emergency nu.i ,sion v.
l (PWR) l t
4 Examples of DISCRIMINATORY !
JPMs l t
++++ @++++ l
- 1. Dropped red recovery (drop a second red dunng recovery requrmg romaar tnp)
- 3. Local start of equipmers wah failures requrmg the use of enemate procedures.
1 e
W
I l
l i
i ES-302 .
1 i
i j Final Rev 8 Change Overview I .
l l
l I a !
i .
I I
! l1
,. t l
l,
, Purpose "A*
4 i
l i
I This standard aestnoes how to admmister operstmg tests to inNasl license l apahcants in acco dance wah sne requeemeras of to CFR 55 45, n inedes pe6ces and gudehnes for adnumstenng both the wom-through 4 and the esegrated pdant operations caengenes of the operstmo test. R is l assumed that the operstag test was prepared en accorsence vath ES-301. -
i i 1
~.
i
} Background *B' i !
As noted in ES 201, facshty 6consees win generally prepare proposed !
, operstmg tests in accordance with ES-30t and suoma tnem to the ,
responsdHe NRC regional office for revow and approval. !
l' !
Regardless of w%ther it was prepared by the facihty heensee or the NRC, ,
every operstmg test unil be indepeneenUy admmestored and graced by an NRC hcensmg saammer in accordance wtm the instructions contamed herem and an ES-303. i l
8 i i 4 l i
i l
l
4
, i Responsibilities "C" I
f Facility Licensee (C.1.b)
, Safeguard me integrey and secunty of the operating tests in accordance
, wrth teckhy proceelurae enembkshed pursuent to to CFR SKdO(b)(2) end the pussehnes discussed et Anschment 1 of ES-201.
I 4
'l l Responsibilities "C" i
i NRC Regional office (C.2.a)
_- m 4 Wort edin ehe nec6Nty conenct to coernmene the operetsng East l ednernistressett acheeluce nn e amenner that naessousen etncioncy and neeenseens securtry.
Nornmelly, the opereerng easts should be nelneindnserad enthin 30 deys before cone-or ette,r ,.mthe thewrreien esemeneDe.ns.
NRR e,e,eter cene,,,p The fogson
,,op,.m shal,l.obte,rn o . the euenernation deems dtverge by more then 30 eneys. (Rerer to ES-201 nel generence regerekag esemonevens that have to be for eddetroed r.03 6u tov.och en eccepmbo. 9,.duca l
l t
i Test Administration Instructions l j
and Policies (D) l General (D.1.d) t -
Normelly, en NRC eseerner will be seeigned to indMduelly evolue te each appescent during the esmutator opereung test. However, M e three-person opersong crew conesets entsrely of eetuor reactor operator ($RO) operene oppkcerrte (who do not laeve to be evaluated --
en the control boerds), the cheef esammer oney esespn only two esammere to observe the crew.
Althoupft the opphcents in the reactor operator and belance of pinnt
, peehoons mey not be indovialueNy evaluered, they edit be held ecGountebee for any errors that occur as a result of their action (s) or inoceronts) and areded on theirabnorty to *Operete the control
, Boertis*(i.e.,5RO Competency 6). SRCMnetentepphcents will
> erweys he indeveduelly evoluered by en NRC esernmer reperdeess what operetmg peeroon they are 16thng dunny a green 3conano, f
f
l l
g General (D.1.j) i
. Athougn he genutshon facility operator wW normally assume the role of
( the other personnel that the opphcents seect or nehty regereing piant 4 epershons, the chef enem treeung or operanens seal,mer (e.g., emay sh#tpermit etner enembers sechadcoladvieor of to (3TA)) the fecahty
-} eugment the operoung shNt seem Wnecessary.
The must e noner ehes wy onetinne ww.wause rege,eng ther
. . reperung rogueoments euhes, and level of perucepeten i tesore the operekng test teges. The gaanuners must not footnct the surregnes operators acsivihes to such en essent that the opphcents bemg l "" are requesd to assume reopenedbikhos toyend the scope of their poenaan, l
i n. eunegme opere=s em ne upomos se meu,no ihe w . . _ _-__3 -
Cf the retos they take et the apareams test. Coneufsesens wfsh en STA sher he genduesentin eccennenste entsh she he4Nry heennee's normel general reem preesite; e g., en STA sheII not be seekened en the I edesudosor # shey are o#> cell et she one.
E l
i !
^
t Wak-Through (Categories A and B)(D.2.b)
I i
! . Ta.the eenent o room scenese,the epm. en v. simuisw. esement ree orihoneherAd have es ng the opp the opphcent. perform the coniio esecnee how he er she neues encompton the test.
- she seemeiner stoorves e sheerspency between she admasdesor estup 1
- ans' sees sondemns speedNed M e Jpti, then the sessuusner shott osep
- the Jpnf and n=ect she eduuseen, es noseenery, i ff the snee een to resopdesed with oNWorent solume (e.g., winst esection
, when Wessensnung a preesseive acten n - 1 son aliarsag en emergency), then she esenuner ehen anecuenent she ONorences and coereneese even she poemry connect east the WRC chsef esenwner to monense she opp 6 cent's reopense aneser she actuel senmerens.
8 g
t I
l Wak-Through (Categories A and B)(D.2.f)
I i
An esosest in 10 Cpff 58 48(e), she opereeng seet toepmus the app 4 cent se sentenesrese en 14 . _ , of and rne sed #rry to peryerm the eveene neceanery se accennpken a~ repreeeneense semple from emeng 12 6eeme hosedin the rune. .
If the appNoent correctly per%rnme e Jpht (incluelong both crttical and s 4 noncrencef esepe) ener spemennessee sleneNerrey wtsh the oevapenent and '
proceahnee, the esenunerenoukt inner niet she oppucent's ;
or %reann*ng of the eyweenuteek te new and refrein troen asking -
fle.w w up gesmeteens. ;
Nowower, M she appNeent Codis to acconapNeh the ansk esenenerst for the Jper, erhedte tedenover shot ' . _ _ _ __ e becA of Jimm#senry with the I apenpment and procemenen, er be unohde to decote int >>rnmetson, centrol ,
, beeruf snecefens, or centrods, sht< esenuner ehwid sea pers%rmance.
heaed t>Newwp queekens as necessary to ciertty or confirm the ;
l epphcents unsere=neng of seie syssom me it redeses to the seen shot was perferneed.
e e
i Wak-Through (Categories A and B) (D.2.f) cent
!. I i
' 4
$snakerty, it aNe appNcent gives en embeguous enewer to e preecripted :
adeninsetronse queeson in Category A the eseminer as espected to l i sek preheng quessons to ensure met the appkcent uneloretoed the i l Ornprael quageen end Oe appNesb60 kneendedge or abHny, l
6 The emone6aer eheII anecuneens en pertermance bened quesarens and j enewere for Anser evelseWen.
l If en opphoent redunenere .:or correctedinformation efter
- having ceanpieted e sash et quageen, she esenuner ehen efter the
\ apphoent the opportunny to anhe erhosever oceans enoudet be required on a skuainer enewonen in she paent.
The esoneiner enGI reeerd any revdesene to previously perterment seeks or enamore ser eenetnereuen erhen preding she opereune test per Es.
act i
4 1
Wak-Through (Categories A and B)(D.2.g) l 1
6 l The ese,n,nermp,ec.co O oreeod eueh 0 w.on g seen= ques es escusseden secoca o orAppenes c.
8 I
i i l
i i !
l
. i
~ .
f i
Wak Through (Categories A and B)(D.2.o) i -
. _ I it the sarnulation tecsiny should tuecome inoperebee and cause excessive ;.
Geley of the operahng tests. the chset oserruner snoutri docuss the I situaton anth the tecshty hcenese and the responsites regional supervisor so that management con tnote a secesson regermng the conduct of the 3 operstmg tests. R eney tse necessary to rescnedute the semuantor ,
l exerninehens for a later dete. ,
The simudeter aheuigt be coneseleredinoperoboe uneler any of the I fonowfng congreons: !
i '
. The simutetor estelbete a neeenAnnergy imbebence, errotic logic, or l inesphcekee panelindice6 ens alurrng neoenetesecution. ,
. Thee" . eshibha unpeenned and unospaetned events or l
, naettunceone that ceuee the opphcents to desert from the espected ;
reopensee and succean peth of the paenned scenent
r l
i I
! i I i f
l l 1 i
Walk-Through (Categories A and B)(D.2.o) cent ,
I 8
i e
! l I
- The ownedsfor autenaufselly pees to the *freere* essee during e l
l' &cenerto er a 'heroner einroeeeeef hinetts'eserm is received en the instruefer seeWork I g . The elenueenerinnerectorinferene she - seem that e
- i sentsere posefuee hos hoheef er *Alcheaf out" Occurrence of any of these ebnennaelsknuseter operedng eeneNeens eluring en anone6neden conestueen sonnesent ceuee to step the seenerte. Emneundene of she sepeeeents'eL. _ ;e anuring any of tineee shnenenter someWemetien eeneNGene neey be unreniable. l l
Wherr the ohnsuderer fees toen reeserset se fasil opere6dfNy, the chief emanainer enGi 600ernmene M the scenerto reenirse repeaceneent, neey be pesanesest Jn progress, or musy he teeterseef #ene the beginning.
1
)
i 4
O
.s e
i
- l
~
l I
i l
l
1 l
1 i 1
! l i
ES-303 I e
4 Final Rev 8 Change Overview i
' I l
I l
l 1
e 1
t 1 i
( ,
, Purpose *A* i i I l
'The elendard desentes the procedures for t-_ -__.__., SN categones of i the Operseng test grieelmg me data to ornwe at e pass or fail 1 g' . , ~ . . . " _ ,, and remeanng the - - -~ . to ensure quehty. j i I
. - - j I
i 6
l t
I Background *B*
- ~
The standard assurnes 'that the operetag test was prepared and f
. adnwnstered m accordance with ES-30s and E5-302,respectwely.
l c
The procedures contained herem reques tne mmmer to miusie each l i
appacanra performance on the operateg test and maae a Adgement as to I whether the opptcents tevel of knoweedge and unoerstandmg meet the mwurnum requwerments to safety operate the faciety for which the kcense is
, sought The esanner eveaustes each noted deficiency m nght of the total twendth of itnowmage end stutty omrnonevated by the app 6 cent in that subrect area _
e
L i l i
i Responsibilities "C" l NRC Examiner of Record (C.2)
! As soon as possede eher admrunto the test. the emanuner of record shen review, eveausse, and Anakre each apphcents operateg test l -
. m accoreence unth the instructens M Secten D.
H en opphcent meee en error artsh sordene sehrty consequences, the enemener naey re...- ::en operedng sont DInuure even N the I
gree >ng innerucelone in Seo6en O ereuest nornaeuy resultin a poening l prode. Unaw such edrcemetences, she arenwner ehe# sheroughly puestry engt deeuneent she bee 6e herome tl enure in accernence arten Secoon D.J.D.
eneroever, she NRC rennenet etnoe ehen obsein arrtenen concurrence t>ene ;propreen ornce bedlere sempoeting
. e coshe. NRM eperoser
. os.on.
i l
Grading and Documentation i Instructions "D" '
l I Evaluate the Applicant's Performance Form ES-303-1, Category B (D.2.b) t J
g To estermme e pose for the eyeesmatJPMs teemd on Form ES Solt.
eveauste seen esAmancy endes en the rough noems 8er Category S. If the i tedeweg sroene are enet, onesen e - - ' ~ , grese by pesong en *S* M the "Eveauseen" coeumn for that eyetemtJPM; otherwise sneer a V; Tomcyncel JPMs must be composeed wehm sne seemed twne.
i l
i Evaluate the Apphcant's Performance Form ES-303-1, Category B (D.2.b) cent The test eiensere for the JPM enust me accompiished by conectly compostmg e4 of the cnhcal steps.
. If the opphcent inneedy fmased a crfbcel step but later performed it conecay and accomphshed tne task stannard without segroomg the conoston of the system or the plant, the appicents performance on that JPM snould he greeed as setofactory.
f
-ve e .e-a .r,o, she. .e socumen,.d M e_e.-e I weth Seaan D.3.
F t
- Evaluate the Applicant's Pefformance Form ES-303-1, Category B (D.2.b) cont i
s
- The roepenses to eny perterrnence-bened feHowp questions enhed pursuant to secuen D.31 ef E5 302 must connem that the eppkcent'e underesenekng of the eyesenefJpht de settelectory.
l i l ff the feNewcp queeWone feweelther the app # cent's l
, unero.nong of Che eyo.enefou is e.r,eu.Iy aw.nuhe
, enemener may recommend en smennetectory groeie for the eyesem even theoph Ine appNeent succeaefuny sernpeneed the i seen essasserd for the .rht. The beefs for the recernmenenven j eheM be thereuphlyjustNied enet documeneed its accornnonce erNh seceen D.3.
.I I
i I e
i
]
l 1-Evaluate the Applicant's Performance l Form ES-303-1, Category B (0.2.b) cont
. l I
- Convereely, # the apphoent eldst not accomphen the seek esonderd and g
fleNewwp guanteamp revoeded rhet the fe# pre esos ceueed by e
} seRcoency in the precedure or eenee other nector beyengt the 1 oppkcent's noneel, the esennemer neey enll recommend e estatectory l greads for the eyesonafJpht.
- I I
Once Opein, the beeis for the recomenendedon shellbe thoroughly
- juonned and necumementen eccerence eme Seeson D.3. f t
9 b
i Evaluate the Apphcant's Performance g Form ES-303-1, Cawgory B (D.2.b) cont ; 1
. I )
Ctler greenrng the opphcent's performance earth respect to all the ,
Ceregory B syneems, seternune en overen grene for Ceregory B by I
calcudetrap the percensspe of eatssectory eyesem proches. !'
W the appkennt has en *S* en et doest a0 percent of the eyetems '
asernened, the opp # cent passes Casspory B and receives en *S* .
overall. W the oppkcent hos en *S* en fewer than 80 percent of the '
eyesems, the opphcent neNe Category B and receives e 'U* evereII. I i
Document the oppkcent1e prode by pencing an *S* or a *U*in beeck B,
- Centrol Room 5 yetems and Facurry Mfelh-Through,' en the
, *Doeretung Test Kunemory* en pope 1 of Form ES-3031. Enter *NT* ,
W this cesegory eues swervedin occerelence earth E5-304. Docuneent t endJusuf)r overy deficoency in occaraience errnh sectron D.3.
I _
9 i'
Evaluate the Applicant's Performance l Form ES 303-1. Category C (D.2.c)
{.
} Usine Form ES-303-3 er ES-303-4. empenene en the opphoenrs 6 cense level, evoluene any eleAmences ceded for Casogery C. Ceces the integrel reung value (1 through 3) L. _-.; to the senevieral anchor that 6
, meet escurately resects the apphcenra performance. A reung of *t woukt ,
, he keened a the appesant neeeed e armeer iosa c.e., my emessen or l ineerrect persermance) er sammend rws errors of sesser segninconce j j ihat have a seenne en the reens sector.
I thseans one or more seences tasks fees nor . eneen met the !
esennent we ses me -- inst nor seen s on every craicei test j erevent the esenener esm .__ . - _-._- A sosture ir the assecont had SIher esflessnesse stat In the enormeele. esoter the Isaure tened en the k
_ _ - - _. an emesseeeenn us. sos. - . y s se l
Spelemel fDr WMD spprede apphoenge Newever, me emanumershe#
evindusse # , , 5 #she appNeoper peeseedines en opereeng crew peanden sent soeused she appassar se meanipuisse me senerede.
Deessnent endfunney owery nonedencyin aseerwenee unen seesten l o.s. .s
,t - ,
i Finalize the Documentation (D.3.b) !
DeGesonades seat ole not cenardeuse se en aposeeng eget Casspery Anddure sino# ease as -
Newever, e erset sesoament elesenehey she erner anst efte esponsost essen er roepense de generemysarfWedent.
Esenedners sneemst nesp in noner snet snedr seeneing recommenmenon engt she '7 I _ . are eastreet se reveow er the chsef ,
eessuednerassW ffRC soyenel ofNee seessesponsent.
Thenpfere, she --aion sheardW conessa mannesent esses # se shot I she insepassesnt powdsesor, sosponemie supervener, anaf diceneang emedel een needle e impeal messeen in support of sne enanuner's
-se seny or sense me seenee.
i.
~
i t
l i
Finatze the Documentation (D.3.b) cont ,
+
t
- I Calain rough - _ . until the chsef esanoner and NRC regonal ,
i esse snonagemern have reviewed the esonener's re ... . ~ ^ s and eencuned in the seeune (reser to ES 501L :
- Enoneinere shellowesin an appeiceeer neeen and secuneenestron
, see9esssed sogen propossef elenande ungfl she sensede beconee Snel.
t
! Esenentere are aN seet euch noose asessfer es subf oet to l
- eseceeenre if remumenent unoer sne Freeeem er enfermeeen Act. <
l .
- i i
L_
! 1
-i ,
Form ES-303-1 i i
3 i
, Individual Examination Report !
--- I.
l ES 303-1 '
i I
l I
f 1
o 4 ,
l 1
l
e 1
4 1
t Appendix C Final Rev 8 Change Overview o
l l
i 9
i Purpose *A*
6 f
^
a Th.s 4.enes ,, es a e wora for ,rewnng .nd e ng pb :
perfo,menc. a.o,es vPMano ensure mey .re of a.m.n.e .
submance and format for euhat operator toenomg and requesfication i omanunamens. The fomewmg sterneras are shocussed m metail or enached j for informahert
[
!
- a basse proemdure for -- , ., new JPMs (Sechen B), incdushng forms to document me JPM and to assess the queaty of tne product (Form ES.
C.1 and ES-C 2) ;
+ pasehnes for the deveenpment and use of enemste-path JPMs (Sechon i C) 4 dearnaam of wek-through e eiuebon techruques (Sechon D)
.THE PRESCRIPTED QUESTION BULLET WAS DELETED l
t i
Development and Reviewing JPMs *B" i
~
l ALL PRESCRIPTED QUESTION DEVELOPMENT PARAGRAPHS WERE DELETED 2
l
l Attachments / Forms !
i t
I ATTACHMENT 1, PRESCRIPTED i QUESTION SAMPLES WEREDELETED ,
l !
+ l j
) ?
i I
.l 6
. 1 s l l
W e
0 e
a 0
i i
! TRAINING MANAGERS I
- CONFERENCE :
NEW INSPECTION PROGRAM i-f 4
i i
NEW INSPECTION PROGRAM
= The New Program Will Establish Baseline l Inspections Common to All Plants
+ Inspection Beyond the Baseline Will Be ;
- Performed at Plants Below a Specified Threshold ;
.! - Predicated on Performana indicators 1
-Inspection Findings i
- Response to Specine Events or Prob 6 ems *
= Baseline inspections will Be Grounded on l
" Cornerstone" Areas
. Focused on " Risk Significant" Activities and Systems I
. Focused on How Utilities Find and Fix Problems !
. Focused on How Utilities Accept and Encourage !
Employees to Raise Safety issues
~.
t NEW INSPECTION PROGRAM o Major Parts of the Baseline inspection '
Program .
i
+ inspect Areas Not Covered By Performance l
, Indicators ;
- Inspect to Verify the Performance Indicators !
. Inspect / Review Effectiveness of Finding and ;
Resolving Problems (Corrective Action Program) ,
' oCORNERSTONES l
. Monitor Performance in Three Areas: ;
i - Reactor Safety
- Radiation Safety j - security ,
i
i .
NEW INSPECTION PROGRAM Cornerstones
, oReactor Safety l 1 . Initiating Events ; )
, + Mitigation Systems ;
i
! oRadiation Safety
!
- Plant Worker l
- General Public j oSecurity i
I
~
l I
i i New Inspection Program I l
Cornerstone Cross-Cutting Elements i i !
- o Cross-Cutting Elements i i - Element that Effect Each Cornerstone
]' Human Performance
. Ability to Raise Safety issues 1 Finding and Fixing Problems ,
t i .!
~ _..
~.
I I
i i NEW INSPECTION PROGRAM l
Major Elements of the Baseline Program
. ,i i eThe Program is Indicative and Not Diagnostic
- Program Delineates Specific inspection Activities
. inspection Findings are Evaluated for Significance I
- Diagnostic / Root Cause Determinations Done By ;
Supplementalinspeetion Program .
{
l l
NEW INSPECTION PROGRAM
- Major Element of Baseline Program l
= Baseline Program is Risk informed !
+ Inspectable Areas Selected based on ,
Significance from a Risk Perspective ;
+ Risk Factor in to Program Four Ways
-Inspectable Areas are Based on importance to l
i Measuring Comerstone Objective i i -Inspection Frecuency and Number of Activtes and I i Time Spend inspecting Based on Risk j - Selection of inspection Activtes in Each inspectable
, Area Based on a Risk Matrix Modtred by Plant Specific l
- information .
-Inspectors Are Trained in the Use of Risk information 'l
! a Baseline Program is the Minimum Program l i
NEW INSPECTION PROGRAM i, Cornerstone link to inspectable Areas !
d MgME W M E
k~=!!EmM 8 ,
i l l
M !
i f
j NEW INSPECTION PROGRAM PERFORMANCE INDICATORS i a
i olnitiating Events: i
+ Unplanned Reactor Shutdown !
+ Loss of Normal Rx Cooling Sys Following l Unplanned Shutdown j
, + Transients - Unplanned Events that result in Rx {
! o Mitigating Systems:
- Safety Systems Not Available ,
- Spectric ECCS l
- Emergency Power Systems -
- Safety System Failures l l
l
\
i
. I
- NEW INSPECTION PROGRAM ,!
' Performance indicators
=lntegrity of Barriers : ;
. Fuel Cladding (coolant activity)
~
- Rx Cooling System Leak Rate k
. Rx Containment Leak Rate
= Emergency Preparedness:
. Emergency Response Organization Drill Performance
- Readiness of Emergency Response Organization
. Availability of Notification System i
?
NEW INSPECTION PROGRAM i
Performance indicators *
, = Occupational Radiation Safety:
l . Compliance with Regulations for Controlling Access to Radiation Areas in Plant
!
- Uncontrolled Radiation Exposures to Workers Greater than 10% of Regulatory Limit l
I = Public Radiation Safety:
. Effluent Releases Requiring Reporting Under i NRC Regulations and License Conditions i l
i 4 NEW INSPECTION PROGRAM Performance Indicators l
= Physical Protection: !
. Security System Equipment Availability -
,'
- Personnel Screening Program Performance j Employee Fitness-for-Duty Program Effectiveness ,
i I
I l
I NEW INSPECTION PROGRAM
- inspection Findings / Performance Indicator Data j
l oinspection Findings:
- Inspector Observations are Evaluated to '
. Determine Significance i
- Use Defined Process: Significance Determination .
Process i
o Performance Indicators: ;
- Thresholds Set Regulatory Response
. -Example : l
- Dre/Enercsee Performance . The percentage of au Drtil, esercise. . +
and actual opporturutes that were perftrmed m a time 4y and accurately dunng the prevmus egnt guarters ' l' i
NEW INSPECTION PROGRAM Regulatory Response !
j e Significance Determination Process !
j
- Characterize the Risk Significance of issue i . Each issue is evaluated and assigned a color Using a Process Flow Chart
-GREEN; Licensee Response
-White: Increased Regulatory Response '
- Yellow. Required Regulatory Response
- Red: Plant Not Perrnetted to Operated wrthin this Band ,
l l
NEW INSPECTION PROCESS PILOT PROGRAM ,
aTwo Pilot Plants Per Region j
+ Sequoyah I
. Harns l o Pilot Program Commenced June 1999 !
o Full implementation of New Inspection !
Program by April 2000 i
NOCL3COMMISSloy AR REG ULA Top P i,
.gpg\NG MANAGEgg CONFERENCE p*"%, ,
..e*
- /CXBALMN% :
Training Managers Conference Changes & Clanfications M ,101. Part 1 PREPARING INITIAL SITE-SPECIFIC WRITTEN EXAMS e D.1.D The ouslme must be seinemeucesy sencned. Snati not use the ;
ese speame KIA cs%
The Piant Wde Generc (PWG) Ter 3 showed NOT ndude system ponere tasks. The sencs for PWG Tie 7T12 and the four K/A categanes for Tor 3 snes be setected from sechan 2.
Genenc Knowesege and Abstees from the M/A cotanog, e D.1,c 10 sae sesarc K/As may repiece 10 syeremahc semple tems, for estads or issues, unin bests and Ctwef Examewr approval.
e 0.1.d Ensure euthne samples et enest every KIA area swee and the SRO sempes tomes requwed by 10 CFR 55 43(b).
~.
. .s.ao*- past sno Empewesen ous w a se e5a01-2 an=r Den es En '
i
)
e* Esen w i 9 9 00A Ceaneery Perus 9 l x x x\x s l e-x x A A A}A 09 y i s e 1 2 sid
- i.1 1 % [ht *L @*3? to a a
, gg y, g g ,,
w s P!! 5 :5 15 9 s
'~~"'
,' e EW ? R1
, , ,s 4 q P 17 Tw l Teems I l 40 i j 3 Genens Mriemandes one Amenes Cat 1 Cat ? Cat 2 h Ca'4 ,
l l
l l
t 4
Training Managers Conference i Changes & Clanficatens to ES-401, Part 11 y i
'
- D.2.s use essetmg. modmed or new quesuons. N coveten from !
sutwruned semple as necessary docuss with the chef. Se able '
- to escuss any the change was necessary. Document n 4,e
, reasons. I I
i e D.2.c The wrmen esenwnshan eIUST to 50 80% tugner cognawe '
, erger esms. (NO mero Nas)
I The SRO en6y quashens on en esem must te et the SRO level.
!e 0.2.0 not just quessons at the RO level These enould be setneuted g amon0st the 3 ters.
t I
- f l
Training Managers Conference
- l Changes & Clanficatens to ES-401, Part lil l
- D.2.f Ranske e _- _ _ _ _ _ _ _
. . ems .,em e ed .moy NOTe.n.no
.onse have.any on_ overtop or reuse No evertop between NRC _.__ _ ^ :- and auet uneess eneepenseney esveisped. Then only 5 quechens answed.
Repest of ONLY 25 quechens from test 2 NRC enanunehens and hems used We trerung. ,
eD.2g Faahty teammg empeeve redevences see encouraged but not
,e -d.
n.eanung et,e..wes a, noi ave.e e.ir !
ine .ueeien ,,ow.eed .e es a,p, -e su s. endnoi e,va seie iechn.ca, .
re orences. I 1
I i Training Managers Conference Changes & Clanficatens to ES-401 Part IV
- D2e The d*t sanonomen must be recewed si i=t at ders before !
i the eununeuon. I e E.2 a NRC wiu reveow and get supervesory revew before Wascussang enth boonsee, t e E.2.c The NRC WlQ perform a 30 questen semple review, wWI revow e oil new plus modded. euestens N retured. The samp4e unu j include 10 new and 20 modefed questions (AN 125 quashons wW, undergo e review.)
Questens previousey rowe=ed and approved by the NRC for '
. that faceuty enn have kmned review for unaccepeanes flaws per E S. 401.g.
e
4 I
Training Managers Conference -
Changes & Clanfications to ES-401. Part V l l
e e.u ,ewsw n e se, np.e shows.issa =n . . ems .,e unacce,ta e. .eia ed
.e ,esi n e esem,nsi,on w coni.nue. n o,esier -
then 6 tems are found unacceptab6e. NRC M AY retum the esammetson Or we may complete na revsewTview wel' use ES- '
401-9.
If the esammahen is returned, we expect that the hCenses
- correct the seentded flows and moes 6ke kmd fisws that were not
. epecacesty leonimod 10.e rest of the queehons.
l l
- E.3.s The NRC Supennsor MUST review and approve aN unesomptatise hem commenta e E.3.b The NRC supervoor WILL rewsw and approve each comment i that wou60 reeuwe the licensee to towerk a NRC-vandated euesten. (pronousey used test temsj
' l 6uo,. a_ _ = .s.,
, ..v.. . l 1
. .- - .- l w .i... . i .,. i P- ._.... 1 t
{
.; c. . .-..__ .
. . . . _ _ . _ ,. .z .
.,.=.r....___......
p _ =._p
==__,,.2_.... _ ..= = m. -
p .====.: . . __ _ -. ,
2 , ~s ?_~_'~ :L~.__~'====..=.=..==:
3 _..__ _. . - . _ ... . . . . _ . . . l g,. z_.. . .
=.__.7._.- . . _ . _. .
l Training Managers Conference i Changes & Clanfications to ES-.401, Part VI l
.ed ,me, v d.oon , esammaien .her w.una cn.n es is .
.._ _ = w m es.u,,ed.
I e Att.1 Desenhos en ;
seecson for.ecceptable samphng enethododogy for systemet c e wreen outhne. ,
e Form Modered verson of thss form prowdes blants to record test sem 401 7 count for reuse from the lost esammatens. the source of the l
. questens and the cogrwhve level for the questens for the .
esammahon i e Form Wnhen esamenshon Renew Worksheet. Used to keep track of j i 1
401-9 esmeed guesions l -
fs401* M.m.n Ea.mn tr. F.rm E5 dot 7 ;
. 3 Ou w Ch.sa e9 '
i l
r -- - - c .< t. -
s w, .os.c l 1
e
- . .. a
- s. .. --
. . - -~ .
.- . . ~ o- = ! !
e so . 0 2. .e 8M0. .
.. t _. m ..,, i e ~
i 4
~.
i l
I Training Managers Conference i Changes & Clanfications to ES 402. Part i !.
ADMINISTERING INITIAL WRITTEN EXAMINATIONS (
e C t.a The econoce has to enernam accurey of the eaartunshons, o C.t.e The licensee may use a J- _ ;; sbee sheets but not i ~*=d e CJ s The 6eensee is ear,. sed to sammester en NRC seve40 ped enemmalupft. I I
e C.2 b Durmg a keensee admwustered wrmen saam, the NRC eAUST be ,
on see or avedaWe by phone.
l Aher NRC approvel, the wnnen exam may be admenetered any l eme .nthan 30 cays of the operymg test. 4 I
Training Managers Conference Changes & Clanfications to ES-402, Part !! ,
' ADMINISTERING INITIAL-WRITTEN EXAMINATIONS 1
i i
e 0.4 6 New twne irrut for tne wreen 6s 5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br />. It con be amenced by so mwmme merements wah PRIOR NRC approval The new ,
tune tma should not change the oeweiopment process. ,
eE4 Unensee shoutd suems formel comments .ntnin 5 wortung cars aher the wnnen exammation is samnusiered.
l I
, i
! I I
Training Managers Conference ' '
. Changes & Clanfications to ES-403 GRADING INITIAL SITE-SPECIFIC WRITTEN EXAMS .
- C.1.b ff NRC Oevetped. bconsee has responseddy to submA comments a concommg changes to the esaminehon. j e C.2.b NR.C en maynon eeuwthe hcensee to mectane grade e NRC developed g
- j. n. .
e D.1.a Do N,fpqI delete any queehon et change en answer without a vehd reference. Unreasoname or unesated assumptons do not peufy e cnonge.
l
. e D.2. Copy each appaconra enswer sheet. and set e.ee. Do !!pqImars
.a m.engm .nu .a comm.ms .re nn.=ed.
I e D.2.d n ,.o d. aide io sne,e meti iwAav gr.o.s do so wiin c.uno,s.
4 The NRC MAY NOT accept as tne 6censee's changes.
I I
Training Managers Conference '
Changes and Clanfications To Appendix B l Wntten Examination Guidelines, Part I t
i e C.t.a K/A references are recured but Leamme Obrecoves are oesned.
g This e e chece and beence on me sacahes trenung program.
.i i
e C.1.b uste sure the ouemen matches the enent of the K/A.
i e C.1.c Deenmmahan vendey a conned.* the key purpose of any test
' f esm is to essess 6mportant K/Aa at e levet that omhnguishes l between safe and unsafe opphcants.* !
e imp 6ementaten requwes autWwe judgement in construchng the I stem and detro:: tors. '
i a
i !
f
~.
4 Training Managers Conference
{ Changes and Clanfications To Appendix B i
! Wntten Examination Guidehnes, Part il I i e C.2.s Mun,6e chees questens wnch recure the MOST CORRECT
- answer are !!pqi enowed. Un a procedurei rsferencei .
e C.2.f As the eWormehon in the stem should be ro6 event. (Dont pney 6nd the rock) Dani sed seconcery peces of information in the siem .
that are not reeevent, m arcer to make the questen look more 8 OWfeull l
- C.2.n use of generceny conect answers is anowed but the stem needs j to be wntten such that the stem mekes tnem c4early encarrect. ;
i
~ -
, ES-501
! INITIAL POST EXAMINATION ACTIVITIES
, / %
i ,
)
D. Charles Payne August 13.1999 b
SUMMARY
OF CHANGES
', a Supervisor or manager shall confirm grading
! quality and sign OA sheet.
4 o CE independent regrade for 78-82%
o Potentially hold passes 80-81%.
e Exam report content more clearly defined.
o PDR records defined.
o New letter for delayed results.
~
l ES-501 o C.1 No changes to facility requirements.
o Note that clean copy of written exam answer sheet is expected to be provided.
o C.2 No changes to regional requirements.
o Note criteria for determining written exam validity following post-exam comments.
o S% changes / deletions 4 facility explanation.
o 10% deletions 4 evaluate adequate sample.
i ES-501
= D,1 Facility management exam reviews.
l, = Suoervisor or manaaer shall confirm quality l of grading is licensee graded written and sign '
i QA check sheet. Used to be " authorized j facility representative."
l = Signed QA form represents facility senior i management concurrence with individual l, and collective exam results.
i l
I i
ES-501 (
l 1
= D.2 Chief Examiner reviews.
! = No post-exam change will be accepted I
without a valid plant reference. Uncontrolled
) lesson plans are not acceptable.
l = Verify answer key used as template or to i machine grade written exam is accurate.
= Independently review every borderline written
- exam (78-82%).
.t l ES-501 1
e D.3 NRC managernent review. i'
, e Pass letters for applicants.who passed exam but licenses are being withheld.
e if pass written exam with 80-81% and another applicant fails, will hold license until assured
' pass / fail decision not affected. l e For delayed licenses, shall ensure still medically fit within last 24 months, not developed permanent physical or mental condition, and up to date in i i requal.
, a if > 3 months pass, advise licensee to properly - !
activate license per 10 CFR 55.53(f). 4
{
i
L I !
l ES-501 !
\
= E.1 and E.2 No significant changes. ;
= Region still will retain EOPs, AOPs, E-Plan and Tech Specs for incident response.
= E.3 Exam report documentation. Some i significant changes.
= Previous revisions stated generic exam
- report content requirements. Rev. 8 spells 1
out specific types of issues to be included. -
}
ES 501 i I
- a Factual description of test item changes i l including type and number of psychometric '
,' enhancements made. !
- a Conclusions regarding adequacy of facility j proposed exams are not reovired and should I only be considered if have a programmatic .
l issue. I l o Any delay in administering the exam and the reason, and any extensions of the written ,
exam time beyond five hours. i o Any exam security issues / incidents. ,
i
!. ES-501 l o All simulator deficiencies encountered while
- preparing or conducting operating tests will !
be documented in Simulation Facility Report. .
o Generic comments submitted by licensee !
regarding exams or the process are welcome and will be included in exam report. These do not require regional response or i resolution. ;
i a Region will ensure SRO upgrade applicants that fait exam still comply with 10 CFR 55 ;
before resuming RO duties. -
l !
l l 6 ES-501 ;
- l. .
l i o PDR records will include the following: !
-exam outlines ,
- draft and final written i
- - draft and final operating tests l l l' - cssociated QA check sheets !
i
- Other documents" I i
! eintermediate working copies not needed to !
I be sent to PDR unless provided to facility j j licensee to facilitate communication. i l l I
l j .
l l
e t
l l
! l l
l O
1
I
! ES-502 i
- _i -
l PROCESSING REQUESTS FOR ADMINISTRATIVEl f EVIEWS AND HEARINGS AFTER INITIAL I
LICENSE DENIAL .l t '
f"'%,,
l i %...../
l D. Charles Payne ,
j August 13,1999 i
I i
ES-502 1
SUMMARY
OF CHANGES I I !'
o Reorganized to remove detailed sample letters and administrative review procedures.
l o New section noting expectation of facility g licensee support during appeals. l i o New section to better define NRC I 1
l responsibilities. l o Administrative review process streamlined.
I l l
! I
! ES-502 l o C.1 Applicant responsibilities. No changes. l l e Has 20 days to act on proposed denial. Has
- 3 options: l I 1. Do nothing, j
, 2. Request reconsideration. .
- 3. Request a hearing. l
! o ff application denied because of training or f
, experience, can reapply when corrected. i e ,
I l r i
! ES-502 ,
j = C.2 Facility licensee responsibilities. New section.
= Facility is expected to provide reference i 1
materials and technical support as necessary l for NRC to evaluate and resolve concems i raised by applicant. I o This includes organizationally supporting the response provided in the answer key.
i j .I I
}
, ES-502
-i _
c C.3 NRC responsibilities. New section but no
, new responsibilities.
l o Splits out our responsibilities from mechanics j of the review process.
! e Application denials will be processed per D.1.
l
, o Admin reviews will be processed per D.2. i o Hearings will be conducted per 10 CFR 2,
{
subpart L. ,
! i i i i
i I ES-502 o D.1 Application denial admin review. t c Not many have occurreif in Region 11. But be
, cautious of potential outcomes should one be '
required.
o HQ gknerally will complete the review within i; 60 days. j o Since draft applications are not due until 30 i
days before exam, any issue with eligibility Jnost likely will result in the applicant missing the scheduled exam. ,
ES-502 eD.2 Exam failure. Some minor changes.
! a Detailed administrative review procedures and sample letters have been removed and incorporated into separate internal NRC documents.
i e Added option to review the appeal intemally at HQ.
o HQ chooses how to process the appeal. -
- 1. Can reviewintemally I 2. Can refer to affected region . ,
! 3. Can convene an appeal panel e b e
4 4
t i i l I
! D/HiM DJPKN l i i i
l.
I
/* "'%g s
9 -
i !
l l
l
\ . . . ./
l THEISSUE l
Is it an acceptable practice to readmmister an
.i identical examinaten to separate crews that l have been separated in time over the finite testmg period of the biennialwTitten cum ?
i i
, ?
l l
l l
MAJORISSUESREVOLVING l AROUND REPEnnVE USE OF TEST NE ---
~
TESTING EFFECTIVENESS i,
> Do you have a testing practice that measures i up to sound and accepted principles of ;
testing?
l
> Are your examination conditions (size scope, j discrimination quality) relatively unifonn i among crews.
i l
, DEFINITIONS i e DISCRIMINATION VALIDHY -
i I
v e The ability to discrurunate or to make same !
.! distinction along a continuum of exammee
- perfonnance to detemune whether or not your
- operators have sufSciently 'mastenxr' the i i knowledge, skills, abilities, and other attnhnes ,
top:rfonntheirjobs. '
I l o.PREDICTABILITYOFATEST- l
- i
' f O "Ihe ability to forecast or anticipate the est iter.ts' l or topics that will apoear on an evanmanon. j i o Previouslyadministers4 test itans reduce l examinaten integrity tm.uuse examination discrimination is reduced. j I
l o When the bank ofitat.: L hiown oranticipated i prior to the examination, tha exam is highly j i predictable. Disenmination lduced because
- j. the agnitive level at which tne examinus are i
j tested could decrease to the simple recognition l
. level.,
o To assume that the capability for items within an examination to discriminate, over time, in the .
same manner as those items d,isenmina,ted on :'
the first and second examinations is narve.
t j ' QUESTION ,
i i
+ How does excessive repetitive use of ;' '
i test items overa short intervalof time affect examination validity ?
i i
- o If the examinees know or can anticipate the '
d precise and limited pool fmm which the test -
itens will be drawn, they will tend to only ;
study from that pool and may likely exclude ,
a largerdomain ofjob knowledge.
o When high perrentages of testitem l duplication takes place (e.g., >50%), the '
l disemamant validity of the examination i comes under question. j o Successiveadministrationsof thesameor l
- closely similar examinations to different !
crews over the period covering the biennial ,
. written exam raises the potential for .l compmmising examination integrity.
l i
GOAL i !
l .
l 0 Achieve uniform testing conditions j
, among crews as best as can reasonably i l be achieved so that the exam will be a ;
reliable tool for assessing operator !
competence.
i _
i ACCEPTABLE !e
! PRACTICE !
> To minimize thepotential of reduced
- discruninant vahdity, a 50% portion of any readministered examination should consist of
. a replacement of modified or new items of likdind content, pychometric attributes,
, and difficulty leveis. Moreover,when items : I are to be repeated among successive crrws, -
they should be repeated m a distributed manner and approximately equally over all
. previous exams so as to reduce predictability of a disproportionately large number ofitem coming form the most recent examination.
I
SUMMARY
i_
i
- Succesive administrations of the same biennial requalification examination to different crews I unde thetame requalification taining is i
! cons' unacceptable. Thiswould seriousl
. question the discruninant validity of the exam.y l
- W hen the contet to be tested W highly
- predictable, and the boundanes ofwhat will likely be tested are known to the candidate, then l the medidate will likely prepare ONLY to that lew! den =arint by the examination. t huproper practimswilllikelylead to an l
- erossonof and long term declinein
)
l operator gdvia.Es;
- I-i l
! WHY !
- YOU MAY ASK ?
l'
> When is dininished in levelor i onamitted in - ,knowlege degradation
! ****5'
-i . > The subtle but important coertion implicit in l piiparation for an examination is lost.
- > Attention will be focused on what leads to visible success for a candidate.
t
> The las of specific content area study can nsult in knowlege gaps that cause operstor I i errors.
~.
O
c-ES-601/602 CONDUCTING NRC REQUALIF'. CATION EXAMINATIONS
- NO SIGNIFICANT REV. 8 CHANGES e REACTIVE INSPECTION / EXAMINATION
- SCOPE DETERMINATIONS BASED ON:
o PLANT PERFORMANCE o INSPECTION PROGRAM RESULTS o INITIAL AND REQUAL RESULTS o OTHER FACTORS
~ i' !
l ES-601/602 CONDUCTING NRC REQUAL IFICATION EXAMINATIONS o NRC CONDUCTED OPERATOR REQUAL EXAM COMPOSED OF THREE PARTS:
o 1WO SECTION OPEN. REFERENCE WRITTEN O PLANT AND CONTROL SYSTEMS O ADMN57RATIVE CONTROLS / PROCEDURAL UMITS
{
o WALK-THROUGH EVALUATION l 0 DYNAMIC SIMULATOR l I l 1
ES-601/602 CONDUCTING NRC REQUALIFICATION -
l EXAMINATIONS !
! o EVALUATION OF REQUAL PROGRAM I AND OPERATORS :
,! o MINIMUM 12 OPERATORS REQUIRED I i o 3/4 OF OPERATORS MUST PASS EXAM o 2/3 OF THE CREWS MUST PASS THE 1 SIMULATOR EXAM I. i
( ;
i i
i I
i
- m.g i i
., . . . . . ) ,
, Licensed Operator I
Requalification Inspection Procedure 71111 REAC FOR SAFETY-INITIATING EVENTS, MITIGATING SYSTEMS , BARRIER INTEGRITY ,j Attachment 11 INSPECTION OBJECTIVE !
i
-To independently gather baseline inspection indicators to determine whether licensee performance meets the following comerstone
! objectives: }
i i
l a lnitiating Events: To limit the frequency of those events that upset plant stability and }
challenge critical safety functions, during i shutdown as well as power operations.
l o Mitigating Systems: To ensure the l availability, reliability, and capability of j systems that mitigate initiating events to j prevent reactor accidents. !
o Barrier Integrity: To ensure that physical !
barriers protect the public form radionuclide i releases caused by accidents. i
! l l
! REQUALIFICATION l CORNERSTONES -
= Mitigating systems (75%)
= Barrier integrity (25%)
= Emergency Preparedness Inspection Bases f
[
- Inspection supports cornerstones because it I can assess operator performance adequacy J in responding to events. This inspection evataates operator performance in mitigating the consequences of events. Poor operator performance results in increase risk due to the human performance factors terms, and
' assumed operator recovery rates and
- personnel induced common cause error i
rates assumed in the facilities IPEs.
I
~.
l INSPECTION AREA VERIFIES:
c Procedure quality and human performance which are both key atfributes of the Mitigating Systems comerstone for which there are no -
! performance indicators, i o Human performance which is also a key i attribute of the Barrier integrity cornerstone
. for which there are no performance
- indicators.
l .
I I
41 li l' l PROCESS OLRUNE i I
i WW MmMl
^
-_ E 2"'h* -
y -~~ ..<- m 4 g_ _- w I
O O
O e
Alm i
FY 2000 REGION II EXAMINATION SCIIEDULE Revised Aueust 6 1*M Date Facility Number of Type of Activity Chief Examiner Examinanon Author Docket No Candida'es 9/27/99 Catawba 3RO Retake R. Baldwin Licensee 50413 1SROU 10/C/99 Hatch frunal Prep C. Payne 50-321 10/18/99 Hatch 10 SROI Irunal C.Payne NRC / Licensee i1/1/98 50-321 2 SROU
!!/8/99 Crystal River RequalInspection G. Hopper 50-302 11/6/99 Browns Ferry RequalInspection C. Payne 50 260 11/29/99 Sequoyah RequalInspection L. Mellen 50 327 11/29/99 Vogtle Ininal Prep R. Baldwin 50424 12/6/99 St. Lucie RequalInspeenon G. Hopper 50-335 12/13/99 Vogtle 1 RO Inidal R. Baldwin NRC 50424 3 SROI 2 SROU 1/10-2/14/00 Farley Requal Inspection TBD 50-348 1/10 2n/00 Turkey Point Req 6alInspection TBD 50-280 1/24/00 St Lucie Ininal Prep TBD 50 335 1/31/00 Brunswick Irutial Prep G. Hopper 50 325 2n/00 St Lucie 5RO Retake TBD 50-335 1 SROI 2 SROU 2/. 3/00 North Anna Requal Inspection TBD 50-338 -
2/14/00 Brunswick 12 RO irutial G. Hopper NRC 2/21100 50-325 4 SROI 4/24/00 Farley trutial Prep M. Ernstes 50-343 6/24/00 McGuire Irunal Prep C. Payne 50-369 _
5/8/00 Farley 6 RO Irunal M. Ernstes Licensee 9/22/00 50-348 6 SROI 5/8/00 McGuire 6 RO Irutial C. Payne Licensee 5/22/00 50-369 2 SROI 5 SROU 5/29/00 Browns Ferry trutial Prep L. Mellen 50-259 6/12-7/14/00 McGuire Requal Inspecnon 1BD 50 169
D:t3 Facihty Number of Type of Activity Chief Examiner Examination Author Docket No Can6dstes 6/12/00 Browns Ferry 10 RO Initial L. McIlen NRC 6/26/00 .50-259 3 SROI 3 SROU 6/26/00 Oconee Initial Prep G. Hopper 5n.76o 7/10/00 Oconee 8 RO initial G. Hopper Licensee 7/17/00 50-269 2 SROI 3 SROU 7/2u00 Summer Initial Prep M. Ernstes 50-395 7/24/00 Sequoyah initial Prep C. Payne 50 327 8/00 Hatch Recual Impeerion TBD 8n/00 Summer 8 SROU Initial M. Ernstes NRC 50-395 80/00 Sequoyah 5 RO Irutial C. Payne Licensee / NRC
. 50-327 4 SROU 3 SROI 8/14/00 Crystal River initial Prep TBD 50-302 8/28/00 Crystal River 3RO Irutial TBD Licensec 9/11/00 50 302 3 SROI 3 SROU 8/28/00 North Anna trunal Prep R. Aiello 50-338 8/28/00 Surry initial Prep R. Baldwin 50-280 9/18/00 North Anna 7 RO Initial R. Aiello Licensec / NRC 9/25!00 50-338 iSROI 3 SROU 9/18/00 Surry 8 RO Initial R. Baldwin Licensee / NRC 9/25/00 50-280 2SROI 3 SROU 1
l'Y 2001 i 1
11/13/00 St. Lucie tsunal Prep C. Payne l 50-335
!!/13/00 Turkey Point Inical Prep G. Hopper 50 250 11/27/00 Harris initial Prep M. Ernstes 50 400 12/4/00 St. Lucie 4 SROI Initial C. Payne Licensee 50-335 5 SROU i
12/4/00 Turkey Point 16 initial G. Hopper NRC 12/18/00 50-250 12/11/00 Harris 3RO Irutial M. Ernstes Licensee 50 400 2SROI 3SROU 3/26/01 Robinson 7RO Initial TBD TBD 50-261 5SROU
I
.e D:ta Facihty Number of Type of Activity Chief Examiner Examinanon Author Docket No Candedates 4/01 Vogtle 16 Initial TBD NRC 50-424 4/01 Catawba 18 Initial TBD Licensee 50-413 5/01 Waas Bar 7RO Irutial TBD Licensee 50 390 3 SROI 6 SROtf o
l l
- m. ,
TRAINING MANAGERS CONFERENCE August 12-13,1999 COMMENTS / QUESTIONS A. Written Examination Questions:
- 1. The most common issue rilsed by Hot Ucense Candidates and Requal license
. holders surround the issue of" trick questions" and operator written exams not being a fair test of, operator knowledge.
1
- 2. If INPO creates a national initiallicensed operator exam bank, will the NRC consider the INPO bank to be current questions that cannot be used as new l I
questions on the exam to be developed?
- 3. Do not feel that the written exam is a discriminatory tool. How many people do poorly on the written exam that are not weak on the operating test? Let us use !
our process to take care of the written with our audit exam.
)
- 4. The utilities should.hl.QT be the ones to develop the sample plan. This should be developed by the NRC for all examinations administered in the region.
- 5. NRC needs to understand that increased difficulty of exam process is a negative motivator and could be a distraction to competent board operators. Recommend Survey to Understand Scope and Potential impact on Safe Plant Operations, j
- 6. Evaluate changing initial exam grading to a curve for pass / fail.
- 7. Exam difficulty his gone beyond reason and is impacting the requal program.
People are not willing to put up with the hassle and it does not result in better operators. It is impossible to meet question standards and avoid " Tricky" questions, very knowledgeable operators can appear less that competent based on complexity of question rather than a test of knowledge.
- 8. The NRC exam has become an exercise in exam taking skills instead of a knowledge assessment.
- 9. Would you comment on the following proposal ? Have a " team" from the utility !
come to the region and work directly with the chief examiner to develop the ;
written exam. I would propose that a team of experienced utility instructions could bring the exam bank and associated reference material and they, with the j chief, could produce the written exam in less than 40 hours4.62963e-4 days <br />0.0111 hours <br />6.613757e-5 weeks <br />1.522e-5 months <br />. 1 Benefits - lower man hours cost, reduced security concerns (less time on site),
fever negative exam report corrects. I i
Enclosure 3 l
2
- 10. If the utility is producing the written exam, when (how may days / weeks) is your
- expectation for the chief to get the sample plan to the utility? The point is - getting the sample plan in accordance with NUREG 1021 will not work.
- 11. In light of the NRC's new goals of reducing unnecessary regulatory burden and increasing efficiency and effectiveness, would it be possible to allow a licensee to build an initial license exam entirely from the bank (rather than 50% new questions), assuming the bank was an appropriate size and security concems could be solved.
- 12. The examination process seems to be gotting harder as compared to a few years ago.
- 13. Once we un a comprehensive level question, does it become a knowledge base questions the next time we use it.
- 14. We may want to have an exam writing workshop.
B. Operatino Examination Questions:
- 1. The continuous racheting of expectations is bypassing the SAT process. Example -
Cannot use a high importance JPM because it is perceived to be too easy, and operators are trained and tested on it.
- 2. Current subjectivity on what is a discriminatory JPM with the removal of the questions.
- 3. Need region workshops to calibrate us on future JPM direction.
- 4. Why can't the selection of JPM's for the license exam be driven by the SAT process and K/A value? " Low discriminatory valve" is a euphemism for "too easy" and as a result, the difficulty of the exam is racheting up to an unreasonable level. This is contrary to the NRC stated goals.
- 5. Open Reference Tech Spec. - it's too complicated to memorize. Tech Specs should be open reference or better yet covered by Operating Exams (JPM). We do not want our Operators to spend valuable time memorizing ITS, nor do we want them to operate from memory.
- 6. Operatino Exam - Section "A" A_dmin. (Cateoorv): This " category" of the ne.w exam process needs to be integrated into the written and JPM (walk thru) segn:.3nts, and eliminated as a separate entity - only a couple of areas are examined, with no margin for error! An Individual can scope high on the written exam, do excellent on the simulator, and pass all of the systems JPMs yet fail to get licensed due to not passing a couple of admin " questions"- the knowledge and/or abilities could easily be included with other exam segments.
Enclosure 3 m
3 C. Licensed Operator Experience Questions:
- 1. What are experience requirements for SRO/RO?
l
) 2. For a SAT-based program, what and where are the requirements for " responsible power )
plant" experience? ,
- 3. Question - Experience Requirements e 3 years e 1 year l e 6 months on site l What are the real requirements if you have SAT based program?
- 4. " Responsible" power plant experience
- This issue needs to be resolved
- INPO, NRC, NEl need to determine the specifics and let us know.
- We need to know without reservation that SRO-instant candidates meet this ambiguous " experience" requirements prior to them entering a license class.
D. SAT Proaram Questions:
l
- 1. What is/where do I find my " Commission Approved" Training program?
- 2. How familiar are, and what kind of training have the examiners received on the SAT process? How familiar (knowledgeable) are the headquarters management on the SAT process? What kind of training have they received?
- 4 E. Reactivity Manipulation Questions:
- 1. 10 CFR 55.59 - the use of SAT based program vice regulatory based programs. Why do you have to track individual control manipulations if you have a SAT based program?
- 2. " Control Manipulations"in Requal- a prior guidance from previous NRC meeting clearly indicated bean counting control manipulation from the Denton letter was a thing of the past - SAT based requal training would naturally contain a large portion of the annual / biennial tasks and evolutions, therefore, program participants would be involved during simulator training / evaluation, and/or annual Op. Eval. JPMs; " individuals i simulator critical tasks" went away and " crew critical tasks" were required.
l l Enclosure 3 l
(J ,
4 i Teamwork / communications command's control /by the team was the most important.
I Bottom line - the implied expectation expressed on 8/12/99 is not congruent with that provided in 1989 by T. Peebles, S. Lawyer, and others who provides us guidance. It appears that we are returning to the middle to early 80's again.
- 3. Reactivity Manipulations: 1) For ILO training what is the status of allowing simulator manipulations. (when unable to perform in-plant): also, define (What constitutes a control
, manipulation); why is a rod operability surveillance ok at one plant but not another?
) What constitutes a large change? 2) For LOCT- INPO's policy for tracking manipulation seems to be in conflict w/NRC requirement (INPO doesn't require tracking on individual basis). ,
F. GFES Questons or Concerns:
l 1. 2000 GFES Dates: Licensee have developed schedules and allocated resources to participate in a April GFES. Changing to a February, June, October schedule would be disruptive, perhaps a April, June schedule for 2000 would allow for a smooth transition (others Licensees made same comment).
- 2. In order to facilitate transition to administering 3 GFE/ year, is it possible to consider administering exams in April, June, and October during year 2000? This would minimize the impact on utilities that already have an exam scheduled. If implementation occurs in FY 2000 and exams are given in February, June, and October (as proposed),
unnecessary burden on these utilities could result.
l G. Miscellaneous Questions:
i 2. When evaluating SRO success in " Classifying the REP" during the operating exam, what I criteria do the examiners use for, when to start the 15 minute clock (expectation)? (15 l
minute from event to classification)
- 3. Use ofinstructors is still an issue. The use of an instructor, who is on the exam security agreement, can't teach candidates attending the Requal program. This is an j unnecessary burden on resource restrictions.
- 4. Is there some way to do a better distribution of clarifications / rulings from one site in the region to another? This would help all of us meet your expectations.
l l
l Enclosure 3 u