ML20211Q480
| ML20211Q480 | |
| Person / Time | |
|---|---|
| Site: | Hatch, Vogtle, Farley  |
| Issue date: | 09/01/1999 |
| From: | Christensen H NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION II) |
| To: | Woodard J SOUTHERN NUCLEAR OPERATING CO. |
| References | |
| NUDOCS 9909150078 | |
| Download: ML20211Q480 (86) | |
Text
, - l September 1,1999 Southern Nuclear Operating Company, Inc.
ATTN: Mr. J. D. Woodard l Executive Vice President l P. O. Box 1295 Birmingham, AL 35201
SUBJECT:
TRAINING MANAGERS CONFERENCE MEETING
SUMMARY
Dear Mr. Woodard:
On August 12 - 13,1999, Region 11 hosted a Training Managers Conference on recent changes to the operator licensing program. The meeting covered changes to the Regulations, the i Examination Standards (NUREG 1021), the new inspection program, and other training issues. l Enclosure 1 is the list of attendees and Enclosure 2 is a copy of the slide presentations.
Enclosure 3 is a list of questions received from the participants. These questions will be reviewed and addressed at a future date.
If you have any questions concerning the conference, please contact me at 404-562-4638.
Sincerely, Original signed by Harold O. Christensen l Harold O. Christensen, C'..sf l Operator Licensing and Human Performance Branch l
Division of Reactor Safety l Docket Nos. 50-348,50-364,50-321, 50-366 l 50-424 and 50-425 License Nos. NPF-2, NPF-8, DPR-57, NPF-5, NPF-68 and NPF-81
Enclosures:
- 1. List of Attendees
- 2. Licensee Presentation Handouts
- 3. Participants Questions cc w/encis: (See page 2) c
.~ '
)
(
lC CM' l
- , j ,j n . c/Gbg 7 f3 !-
1 /
(f 9909150078 990901 PDR ADOCK 05000321 V PDR kg
r- 1 SNC 2 l
i cc w/encis: Bob Brown, Plant Training &
D. N. Morey Emergency Prepardness Manager !
Vice President Vogite Electric Generating Plant !
P. O. Box 1295 P. O. Box 1600 Birmingham, AL 35201 Waynesboro, GA 30830 l
H. L. Sumner, Jr. J. T. Gasser l Vice President General Manager, Plant Vogtle P. O. Box 1295 Southern Nuclear Operating Company, Inc.
Birmingham, AL 35201-1295 Electronic Mail Distribution J. B. Beasley, Jr., Vice President J. A. Bailey P. O. Box 1295 Manager-Licensing Birmingham, AL 35201-1295 Southern Nuclear Operating Company, Inc.
Electronic Mail Distribution Scott Fulmer, Plant Training ,
& Emergency Preparedness Manager M. J. Ajiuni, Licensing J. M. Farley Nuclear Plant Services Manager, B-031 ,
P. O. Box 470 Southern Nuclear Operating Ashford, FL 36312 Company, Inc.
Electronic Mail Distribution L. M. Stinson General Manager, Farley Plant Southern Nuclear Operating Company, Inc.
Electron le Mail Distribution John C. Lewis Training Manager, Plant Hatch U. S. Highway 1 North P. O. Box 2010 Baxley, GA 31513 P. H. Wells General Manager, Plant Hatch Southern Nuclear Operating Company, Inc.
Electronic Mail Distribution D. M. Crowe Manager Licensing - Hatch Southern Nuclear Operating Company, Inc.
Electronic Mail Distribution Distribution w/encls: (See page 2)
, .. ~
l l
SNC 3 Distribution w/encls:
M. Padovan, NRR L. Olshan, NRR R. Assa, NRR R. Gallo, NRR D. Trimble, NRR R. Conte, RI D. Hill, Rlli J. Pellet, RIV PUBLIC S
OFFICE Ril:DRS R!y gh l
i SIGNATURE % y& \
NAME HCh'rlstensen PSkInner DATE /)/ / /99 4/ l /91 8/ /99 8/ /99 8/ /99 8/ /99 8/ /99 COPY 7 #EA NO 'YES @0) YES NO YES NO Y[S NO YES No YES NO OFFICIAL RECORD COPY DOCUMENT NAME: G:\ DOCUMENT \SNC\sncsummary.wpd
c s
LIST OF ATTENDEES
{
U. S. NUCLEAR REGULATORY COMMISSION Luis A. Reyes, Regional Administrator Victor McCree, Deputy Director, Division of Reactor Safety (DRS)
Harold Christensen, Chief, Operator Licensing & Human Performance Branch, (OLHP), DRS Fred Guenther, Senior Reactor Engineer, Nuclear Reactor Regulator Ronald F. Aiello, Reactor Engineer, OLHP, DRS Richard S. Baldwin, Reactor Engineer, OLHP, DRS Michael E. Ernstes, Reactor Engineer, OLHP, DRS George T. Hopper, Reactor Engineer, OLHP, DRS Larry S. Mellen, Reactor Engineer, OLHP, DRS -
Beverly Michael, Licensing Assistant, OLHP, DRS Mark S. Miller, Reactor Engineer, OLHP, DRS Charles Payne, Reactor Engineer, OLHP, DRS Marvin Skyes, Reactor Engineer, OLHP, DRS Hironori Peterson, Senior Examiner, Region ill LICENSEE l CAROUNA POWER AND LIGHT COMPANY ~
l Max Herrell, Training Manager, Brunswick Ralph Mullis, Operations Training Superintendent, Brunswick Gregg Ludiam, Supervisor - Operator Continue Training, Brunswick i Mark Keef, Training Manager, Harris I Thomas Natale, Operations Training Manager, Robinson I DUKE ENERGY CORPORATION Al Undsay, Training Manager, Catawba l James Teofilac, Operations Training Manager, Catawba L Al Orton, Operations Training Manager, McGuire l Ronnie White, Site Training Manager, McGuire l Robby Pope, Supervisor of Ucense Requal Training, McGuire Gary Voller, Operations Human Performance Manager, McGuire l Tom Coutu, Superintendent of Operations, Oconee John Steely, Supervisor Nuclear Operator Training, Oconee Paul Stovall, Manager Operator Training, Oconee Scott Hollingsworth, Operations Training Uaison, Oconee l Rick Robinson,' Operations Training Liaison, Oconee j Jack Brission, Operations, Oconee 9
Enclosure 1
L
- g. . .
2
- . FLORIDA POWER AND LIGHT COMPANY l Mark Shepard, Operations Training Supervisor, St. Lucie Jo Magennis, Nuclear Assurance, St. Lucie Maria Lacal, Training Manager, Turkey Point Phillip Finegan, Operations Training Supervisor, Turkey Point Bill Burrow, Online Schedule Supervisor, Turkey Point FLORIDA POWER CORPORATION '
Ken McCall, Operations Training Manager, Crystal River Frank Dola, Senior Nuclear Operations Specialist, Crystal River Tony Roberts, {FRG Corporation} Representative ;
i SOUTHERN NUCLEAR OPERATING COMPANY. INC.
Scott Fulmer, Training Manager, Farley Joe Powell, Nuclear Operations Senior Instructor, Farley Gerry Laska, Nuclear Operations Instructor, Farley Gary O'Hustede, Operation Training Plant Instructor, Farley , )
John Lewis, Training Manager, Hatch !
Steven Grantham, Operations Training Supervisor, Hatch I Robert Brown, Plant Training & Emergency Preparedness Manager, Vogtle SOUTH CAROLINA ELECTRIC AND GAS COMPANY Albert Koon, Operations Training Manager, Summer Perry Ramicone, Lead Instructor Exam Development, Summer James Callicott, Training Evaluation Coordinator, Summer i
TENNESSEE VALLEY AUTHORITY Daniel Sanchez, Training Manager, Browns Ferry Ardie Champion, Operations Training Manage, Browns Ferry Denny Campbell, Shift Operations Supervisor Instructor, Browns Ferry John Parshall, Shift Operations Supervisor Instructor, Browns Ferry Richared Driscoll, Training Manager, Sequoyah Walt Hunt, Operations Training Manager, Sequoyah John Rodden, Operations Training Manager, Watts Bar Tom Wallace, Operations Superintendent, Watts Bar ylBSINIA ELECTRIC AND POWER COMPANY Joe Scott, Operations Training Supervisor, North Anna Steve Crawford, Senior Instructor Nuclear, North Anna David Llewellyn, Superintendent of Nuclear Training, Surry Harold McCallum, Operations Training Supervisor, Surry Michael Brady, Supervisor of Nuclear Training, Surry OTHERS James Makucin, INPO Bob Post, NEl Enclosure 1 i
]
c 2
( o 3
- ee e e.:
W e 1 p** "'*%,
I !
- s,* <11N /
+
- e.
WELCOME TO
~
U.. S. NUCLEAR REGULATORY COMMISSION REGION II TRAINING MANAGER'S CONFERENCE AUGUST 12-13,1999 SAM NUNN ATLANTA FEDERAL CENTER 61 FORSYTH SW, SUITE 23T85 ATLANTA, GA 30303 . .
Age i
ENCLOSURE 2
- .e e 0 1-
V REGION ll TRAINING MANAGER CONFERENCE AGENDA Sam Nunn Atlanta Federal Center (Bridge Conference Room B)
Thursday, August 12,1999 8:30 - 9:00 a.m. Introduction L.Reyes V. McCree C. Christensen 9:00 - 10:00 a.m. Summary of Significant C. Christensen I NUREG 1021 Changes 10:00 -10:15 a.m. Break I
., 10:15 - 11:45 a.m. ES-200 Series (Exam Process) M. Emstes 11:45 a.m. - 1:00 p.m. Lunch l
1:00 - 2:00 p.m. Changes in the NRC B. Boger 2:00 - 2:15 p.m. Break 2:15 - 3:45 p.m. ES-300 Series (Operating Test) R. Aiello j 3:45 ~4:00 p.m. Break 4:00 - 5:00 p.m. New inspection Program C. Christensen d n' Friday, August 13,1999 8:00 - 8:15 a.m. Day 2 Opening Remarks C. Christensen 8:15 - 9:45 a.m. ES-400 Series (Written Exams) R. Baldwin 9:45 - 10:00 a.m. Break 10:00 - 11:00 a.m. ES-500 Series C. Payne (Post-Exam Process) 11:00 a.m. - 12:00 p.m. Recent Training Program issues G. Hopper l l
12:00 - 1:00 p.m. Lunch i l
1:00 - 2:00 p.m. ES - 600 Series (Requal Program) M. Sykes G. Hopper 2:00 - 3:00 p.m. Closing Remarks L.Reyes )
V. McCree C. Christensen
e e
l 1 .
i TRAINING MANAGERS CONFERENCE l
August 12 - 13,1999 fm ata. 'Q (M, h>l
- ,,+*
i TRAINING MANAGERS j CONFERENCE INTRODUCTION f'"'%
.,
- j I
Luis Reyes Victor McCree Chns Christensen l I
TRAINING MANAGERS
- CONFERENCE i AGENDA- DAY ONE !
j
- 8:30 a.m. Introduction !
- 9:00 a.m. NUREG 1021 Changes !
- 10:00 a.m. Break :
- 10:15 a.m. Exam Process -
- 11:45 a.m. Lunch !
+ 1:00 p.m. Changes in the NRC ;
- 2:00 p.m. Break !
- 2:15 p.m. Operating Test j
- 3:45 p.m. Break . i
- 4:00 p.m. New inspection Program j
- 5:00 p.m. End Day One i
y-
! l i
l l t I TRAINING MANAGERS CONFERENCE I l /
\, ..... !
I
! VICTOR M. McCREE
! Deputy Director, Division of Reactor Safety i Region II l Augun 12 13,1999 l t
'l l
=
f O
W REGULATORY TRENDS ;
I eBACKCROUND e DESCRIRE THE CHALLENCE FACING NRR l
r e EXPLAIN HOW NRR IS blEETING THE CHALLENGE f
e DISCUSS HOW NRR IS DEFINING SUCCESS I
- DISCUSS STATUS OF HICH PRIORITY AREAS FOR ACTION i !
e THEN.NOW AND THE FITTURE I t g ..... BACKGROUND i
i e U.S. Naciser Resener ladestry Average Sefery Performance Has improved 5:eedily .
~
- Nember of Acadent Segmenee Precersers Dociened 5.gnificanity Since 1944
- Fies of The NRC Trocked Performenee Indicasers Show 5.gnificena leprovement Sense 1965 (astemesic serems, safety syssem accessions, setn'fecent evenas, esteipmens forced estages end sollective radiation espesere) e Chessente is se perene Programs (In Rapidly Changing Sosines And Regolesery Env6rennents) at a Level % hich:
- Meinaain 5efety
. Reduce linnecessary Regenesery Borden
- Bacreen Pebbs Conr.dence i
- Improve Efrecency And Effeeniveness
[ i 4
r AREAS OF NRC
{. ... STAKEHOLDER CONCERN e Senate & Hesse Committee Reports on NRC Ap propriations-Early ;
June.1998 i
e Commission kleeting With Stakeholders-July 17 & Nov.13,1998 ;
e NRC Oversight Hearing With Senate Subcommittee July 30,1998 e Reguletory Frenework Needs to Be Predictable. Objective And -
. Timely l e Concern Esists That Some NRC Regeissions And Reguietor Practice Pese Unnecessary Borden en Licensees e in Deregulated Electrie Utility Environment. Uenecessary Regelstory Burden is of Segrificant Concern to Licensees e Need For Continuous imprevesent in Regulatory Effectiveness i
And Efficiency l
POST. HEARING TASKING MEMO l
- hieno From Chairman to EDO-August 7,1998 i e identifies Commenien Proposed High Priority Areas For Action
, o Tasking bleme Repense August 25,1998 Conteia:Short And I leeg Tern Acteens (Upes tad bienthly)
, e kleistaisieg Safety Remains Highget Priority e .%Iany Tasks Previously Identined And in Operating Plant Cemeining Tasks Added a Some Esisting Tasks hiey Se Appropriate to Slow Defer, Concet, '
Other to Accelerete j
e Challenge is to .%Isinisin Safety While Reducing Unnecessary Barden '
}
/
..... PERFORMANCE GOALS FOCUS ATTENTION TO h1EASURE NUCL EAR REACTOR SAFETY PROGRAhl OUTCOSIESL e e SIAINTAIN SAFETY ,
e REDUCE UNNECESSARY REGULATORY BURDEN e INCREASE PUBLIC CONFIDENCE e INCREASE EFFICIENCY /EFFECTNENESS O F KEY NRC ,
PROCESSES Determined by NRC Nuclear Reacter Regulation Team Working With Contractor to Denne And Implement Planneag, Sudgeting And .
Performance Atenegement Process (PBPAI)
[
i l
- )
1
)
i
'.S I
..... PRIMARY AREAS OF AGENCY FOCUS !,
e Risk-leformed And PerformanceBased Regulation l e Rosetor laspecties And Enforcement
= Reacter Licensee Performance Assessment ;
e Reactor Licensing And Overseght '
\
e NRC Organiastional Structure And Resources \
[ l i
e Other Agency Protrees And Areas of Focus (i.e. License Transfers, ,
Dry Cesk Storage, Decommmeiening) e a Uranium Recovery lasses
, e Changes to NRC's Hearing Process i
i 1
t l
'5 REACTOR OVERSIGitT PROCESS IMPROVEMENTS .
I ASSESSMENT. INSPECTION AND ENFORCEh!ENT j eSuspended SALP Program, Medir.ed Periodic Plant Reviews e Performance Results Will Be Evaluated to Determine % hen Enhanced [
NRC Diagness of Licensee Performance is Warrensed. A Rask-Informed i
, Basehne laspection Program Will Be Performed For All Sises.
, eFramework: Perferenance Indicasers And Rak-Informed laspection Raula Will Se Used se Measure Licensee Safety Performance. Results Will Se Evaluesed Using Equivaietet Risbinformed Scales. (Themheads) einspecteens Will Become More Risk.laformed and Results Will Be
, Etelusted for Their Rak Segnificance Using RuwBased (Esamples) ,
Scale.
e Assessment: a $sreamlined, Structured Review Procus Will Be Used. An Acnen %Istria Will Provide Consistency in Making Response Decisions. ,
I REGULATORY FRAMEWORK
. i Please See Handout I
'k l
I l
- i I
F I
l h
- ACTION MATRIX i
- 1 Please See Handout
. 1 i
l I i
I I
l I
l e
O e
em 0
T" TRAINING MANAGERS CONFERENCE l AGENDA - DAY TWO o 8:00 a.m. Opening Remarks e 8:15 a.m. Written Examination 09:45 a.m. Break !
c10:00 a.m. Post Exam Process a 11:00 a.m. Recent Training
- Program issues a 12:00 p.m. Lunch !
e 1:00 p.m. Requal Program -
o2:00 p.m. Closing Remarks Question From the Last Training Managers Conference l November 5,1998 i o Need to stay flexible on exam schedule and !
do not wait until the last minute to accept the j criteria from licensee. Suggested method :
t was to accept the criteria early in process of I the prep week. Wou!d prefer to have 30-45 ,
days prior to the scheduled Exam. l
. The Finial Rev 8 Examiner Standard now request that Outiines be sent 75 days prior to the exam date and that the Exam be sent 45 days pnor to i the exam date. This can be negotiated with the .
Chief Examiner. l l
l
._ )
l Last Conference Questions :
a The NRC should publish the exam schedule
~
early. Suggestion was to publish at least 1 yeisNn ::'vance.
- An Operator Licensing WEB page will be coming soon and it will have the exam schedules.
Additionally, we have been sending confirmation i letters tc each licensee on the exam schedule, o Recommend the NRC turn over the GFES to f ine Licensee. !
- The near term we plan to go to three GFES !
exams per year. Long Term we plan to develop a ,
computenzed GFES. i
p Last Conference Questions I
- oThe issue of written exams and limited staff -
in NRC create a "de facto" situation for ! i licensees to have to write their own exams. .
i I
. For FY2000 we are writing more exams and j l
2 Headquartera has requested for additional i i
resourses. However you may be requested ta i i wnte an exam if you want a given date. !
i' oThe issue of tying up exam writers.
}
i . The security requirements are like Requal exam l requirements now. I i l i 1 Questions for last Conference o There is inconsistency in the examiner
{
standards and the K/A manual. For example the sampling plan and Part 20 references.
. Final Rev 8 issued, however we need more (
,j information to better answer questions. !
i a ln using the Requal procedure, is the NRC !
going to inspect manipulations for reactivity .
1 vels on an individual basis? Or can the ,
r cord be maintained as a team. ;
- Records should be individual because the license is issued to an individual.
Questions for last Conference i aWould like NRC clarification on following the '
10 CFR for an SAT program rather than following the guidance in the memo once I issued by the Director of NRR. '
- You can follow your SAT based program, however l
if you have a Tech Spec or FSAR requirement you need to follow those requirements or get them changed.
l eWritten exams are getting harder due to the raising cognitive levels. Can there be less of i acceptance % for the higher level. !
, e Rev 8 placed a limit on the higheilevel questions 1 50 -60% and no more. Additionally, the time limit i for the exam has been extended to 5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br />.
I l
r lm
SUMMARY
OF SIGNIFICANT CHANGES OR CLARIFICATIONS Chris Chnstensen i
- 3"%
n s .
i i
SUMMARY
OF SIGNIFICANT CHANGES OR CLARIFICATIONS ;
i
, o Changes to 10 CFR 55 -
+ New 10 CFR 55A0
- Exams Prepared Using NUREG-1021 i - Licensees may Prepare, Proctor and Grade Wntten l 8
Exam i
- Licensees May Prepare Operating Test !
- Licensees Shall Estabhsh Procedures to Control Exam Securty and integray When Prepanng Examinations i'
- Authonzed Representative Shall Approve Exams Before Submetalto NRC
- Licensees Must Receive NRC Approval of Exam
- NRC shall Prepare, Proctor and Grade Examinations Upon Licensee s Wntten Request
SUMMARY
OF SiGNIFICANT ,
CHANGES OR CLARIFICATIONS t
, o Changes to 10 CFR 55
-Was Revised to Clarify Compromise and Securty Expectations I
o Changes to NUREG 1021
. ES 200 Series: Examination Process .
- Due dates for Exam Outhne and Draft Exam Advanced
- Personnel Restnctions are Like Requal '
- The Region May Approve Separating the Wntten Exam and Operating Test By up to 30 Days a
- l
SUMMARY
OF SIGNIFICANT i l CHANGES OR CLARIFICATIONS t
~
j e Changes to NUREG 1021 (
. ES 300 Series: Operating Tests l
-Dominant AccdJe'it Sequences Should Be Considered i l
l i for Sampline; Ourit g Operating Test j l - Prescneed JPM Q seshons Deleted ,
i
- can une romp ai eenons for cause l l j . Anemse pain JPMs snowned to 40% I e
- No Rouse of Matenal on Subsequent Days (
l - STA Use OK per Licensee Practsee s
i j
SUMMARY
OF SIGNIFICANT l CHANGES OR CLARIFICATIONS i e Changes to NUREG 1021
' . ES 400 Series: Wntten Examination
- Systematic Samphng Required for Outline Construction
- Learning Otsechwes Not Required
- Higher Cognstive Questions 50 60% of Exam
- New and Updated Forms l
,' -30 Questen Samphng Revew I
- Exam Time Raised to 5 Hours
, - Clean Copy of Answer Sheet Required
?
e ES 500 Series: Post Examination
- May Hold License for 80-81% Passes *
- Administrative Revew Process Streamhned
- ton e u., .e Re.oested to Provide Reference Meeral and 1eene, -oon ,'
. 1
. i
SUMMARY
OF SIGNIFICANT i l CHANGE OR CLARIFICATIONS i
' e Changes to NUREG 1_021 e ES 600 Series: Requalification l
- Test item Duplication Expectations Clanfed
- Licensed Operators Detailed Off-site Clanfed
- Proficency Watch Expecsatens Clanfed
. ES 700 Series: Limited SRO '
- 50 Queston Wntten Examinaten e Appendices
- Guidance for Developing Multiple Choice Quesbons in j App. B ,
- App. E-Clanfed Making Assumptions
- - App. F
- Defined a Responsese Power Piant Esponence
- Tecnneet specticamens as a Reverence l >
r l
l l l i i
- I Examination Process
~
l
- ES-200 Series l Mike Emstes i
t I
ES-201 Examination Process
. 8 % e.vop.d. _ musm.o.me -
t, I (1) opngwy wem NUREG 1021 I i
l m -- - ere - - -es (3)esam summeses must to approved by en sumorned representauwe (a) NRC muss approve me proposed esennetens.
- C.t o Roomsis sur NRC aewnstrate of esemnsuons must be m wrung n l aczarnanos wun 10 CF R M 40 (c).
Respond to NRC amuel eennereave tener and toep regen score. sed of any
' cheriges Corsect Regen N oLB erench C#wef by pres to negeusse esam 3 asses and seweepmeru apnons Peruss se. . may be negousted I
1 l i
l
$ ES-201 I Examination Process I.
l !
C.1 D The agency erwarusmeni poacy appnes to enam compromese i i i
Attachment 1 has a seenan smeed oiner Conseeraiens' wtwen was not n l
Weerrn Rev. O wrucm summernes some esam securuy and euegnty asues l l C t o The amouru of ere men mennet -'-d kom me fecery iconsee we be j eeusied eseed on ms NRC's evel Of ewoewoment m Ins saammsten ,
omvemoment pnxess The Crue# esammw we discuss rerwence meier ai {
j j corneru as due oeios durin0 ine pnone can pnar to one 120 cey inner the amensee e reeweswd e.ame.i.ns o,,, to.,o sum,ma ine enr.oe copes of tne authnes and ,
e,or s.re ed s- -
i reeussi) l I
C 1.f A tecsty sweemsor er manager snea emenendencey rewww the esammation euumes are em proposed anons te# ore tney are s.mmmed to me NRC. !
l 1
r .
L
4 1
!' ES-201 !
, Examination Process l 1
- C.l e An .umonzed ,eere ni.i.e or v. fealey hc.n.ee .nes .pprove the ubm Th I
- m. tefo.re e.n no on.m to the NRC 10,, r.ev.eu,nortred e, .e_e -m .
in. ;
... ._ -e.._ ne m.e p..on m. .ine,.v.
.n uo y on .
m.n.o.r.e.d n . e . .e.,ey i 1
C.1 i Fech,y . e,uuns. sed u onmmun as egn(s.nl conc.m. .gn v. cor.ent i
- .for re eh.lfa.b.ity
. .,--e. at pio NRC gr.pe. red es.m of 9te ch.ng., t.t the NRC hr .
!. C u r.o.,y .,,y - - . . - - . reed won.ith sie NRC.
1 l CdC About four fnere. Delo,e lh. e mm an, p. Ch.t es.mm., c.N tie w ,y . . .e, . d. e . .e e,y ,n.,
- .e . o. m , e ,.
.l Car t ne.r.he.ev. one,. ,., imp me. prep.e.h.* 1 i.
. ES-201 Examination Process C.: h th. .n.en .n. no - m. y .y up . no
.ey..
- ' C2i .- - , , m,o, =
.,.,.n Ca .
e ,,
oA .,.ei. n .
C3f s.mphne
- ,Re*.# of F. .r.ene--, es.mm.sen
.,e, en.a be an. node,ed
.,e .e .ein
_. : .een..a. e ,
I C3j sRO upgrene.fi.no .a RO . sop po on so not n.ed so b. eveta.+.d I i
. i t,
t ES-201 i i'
Examination Process r
l.
o.3 o ,F.c.ty esponse .nound y em. . ace so e,wy e e ponen. .nen the sendue b..rs
- D.2 b G=e. es.mp.e. or ' pro,mb.ed.cs.ne.' fo, no due. on t soony l Agre.merm ',
suo m .no .e peaer.8 overs.om e,n -.pror.m
.n v. seany reve...y ar m of con,,nu.
es.me.t e.n.
- r. v.s.ig eicau no
.nd ,entsch. verung They m.y nos geovia, e.= eau.i .pphc.ru feedb.cA t
l l
t 1
l
1 l .
l !
! : ES-202 ,
1 I '
i
. Preparing and Review Doerator Licensing Applications i l l
l C 1.a r mwe een sa me.es have poseed sece en appacanre meccal I esammaton, to econsy ones owWy ther we appoca nas not es.eaoped '
my mpensee conemort {
l
.m .. .s - l
! c.2. = re em w e +m- I i
- D3 Esqpanley creene ser Lated sener p-ar** operesars moed *om ES-701.
!, i 4
. .l
' 1 ES-204 :
i i
j I
Processing Waiver Request t
D 1 a A resake
~e sam, .w.u.sen
- - mai. muss inne pesos wenn.one year of pu eene on wnen l 1
I
! l o.i e ww.sme.an pre m.ay y we=
r-e. e.,mo.nen-r.es.=,y
. in - ac - -n o.nmee.n f v s.epecers W M re.ml dess When two years ago g
D 1 AunoThe - reqpon
- . may
, e acompt
,es so.phca,y tens - og s.enasier
.eeenams.to.apoecants
,es .
enuieemet A codd or refuswig Icense we tue asued-i I
I I I
! ES-205 Genenc Fundamentals Examination Program i i C 1 a Fashty bcensees snowid notify tw NRR emerator hamnsmg program DMme f l they add er seete en mowouel from per previous 4 sdynstied vegetaten 8 tener for une GFES wtwo tw enemmeren a eennsiered A two GFE$ e poseme si 2000 Oczomer 1999. Fopruary 2000. & Ape i 2000 are hmey esses. -
I i
, The CFE5 e am soie a neweys the weewsoey after we frst sunney of the .
raon't ! j l
l
e T
N
. E N M
EI O
E C G T A N AL E NU R RAG 4
E OME T
FS CM R NE9C 9 EAR OI 9 RRO D,OC GT I
CF1 R FO12 RRA E 1 EP ER G1 T GN ANS OOR NO AI G U BI A
.T E MGU ACL
.E A E EC GR P U N C U NS N I
RI F $
N I BFO A OE R NC T I OF I
S F I
O V
I D
s llll
a a n: .
,t io 2 .
zt z
ta _
te e_ d S m r
a r f a_
n 7,, st e o W-. .B EC
.y h/ " t h ic k. ,hc ala n c r e
n re n a
h c n w n.na A fom r r &n e&r B or r
_& r e o B a iB ov t s ter G, ns s v ng t oac cr epmr e n o
wB en t
nioo r
E, itn no et ac t r er mrDai ite ei mca se
. ee t
c -
Dig y n c Rau t
sien em v
se
., 4_ cmh nyot ic ed s e uR a lu s mr c r r u wen oga l ooPp ea t e p
sr na s e fcR Amw e ed rt nar fvl D S oo i
r enB u ic a n tsCP e &.
Ra l
Og e
h c L t S n n
- n ee n M e ev
_ R T E N o Gni F
s m
e r t og tcro -
ieP r
l D&
en t o iai t n
_ cc o
_ oe sp it n".
s s An e
c pen t h c
n no
.s n a I
r o
e o mor B a
r t
oi ia t m%
u t et cg f r gc m ee H.
gnt 5 oa e a
pll nef h f
nir r sAh n c r aD g isPc t oMy o r
i&n r
oe a n e&o n
9 c t P r ic eB r d cB iemu r ap n o
nn ea L c n
Dr gD e r oa _
no it c
e V, ent fem or p An r r eo le P s Qia pf r .
f l
v In M OeP O
r n eo I r
o et t l
cl a c uu ror e g N gt i r tc n f ecde oe f j r i
n err y ror nt ot o is o
a rit t Pec c oDu p c edme ir R 1
!s DagneD t I 1 e
1 if c ir D D D f
a D gay P P e Oe n oia n nt up P
R le sMe h n V fve D I i c DiL D P
i s i s .
y la n
A rl oe ls o
fk r
r o R h teh cc t
r n
to hn f r v c r o n n o cc ogt tcie nc iCar ima er dCn ee r &B hB e& h iT r r cg er ef lag nc D&
l l
ieO c nr e on
&I n t
e g Dny ngt u i
ine ee i tse irei ctta Br a
iien ie t
' cs on l onp aEe h n ci eg r ine le ne se teg Em iv D en t
MnE w Ask L D ME ts ru
- t n
=. c I j
e r
o
- P
? s h
?, r y is c n
h c h
. ol a a n c ya n r a f r
_ r oat no S B
r r
? t c s s teB fat c&e m e
e yi r m S n lr t D Oef y t
sy e
ts bm
.e S y os n at S r s toSupe r o t n
Pe s is s tc a fe s
lv mD e e P A Ot s R y .
S
S e
W w c- n;;
'@T.5;k.h78Sp%y* .
C.%.'.:: : :l ,~ 3
- ' ]
A
.. s..1:12_;;\
, * ;! ~ W' :._m~!L' s>:.::.
~
.;T, J.'Q.
':.z,;;; .
. i;f^ 'e;:: -E*,0
- ?. [
. !.,?:A:~ '
~
N *,0 '
u d.mm_.
k -
A
/ h Q , . .
/
/ o T)
.) .' . G:- . :.i .l-(.. . %st AMM;,,~f'D~,'j,.iA.J..w
- df;
/ H d "E - $u.,p.Y..y.,er_
~ . . . ,'
f w
2/d "Et?!y..
.: u p
[ ;,
? ~^
7D.D..I.,,y;,,
s .
~ , . . . .
%st -
4 .e. E w
Zg l
g e
p' >
m r ..h.) YN ,, v w$ n$[:aw '
'Y e$4/[34:'~'
m:vw.>e< ::,:e
- h. U w#$pQ{c.
"v.'M. Tiz;R.G.:w - ,;p ---..Mif?.A n
. LT:!.nd2CL-
$% x.c. z j
Q O ' q .t;y-:u : . ,. .,..
., q:.<. , > ;1%' iL~n'.:. 2. " ' '
, .y hij.(
~~ $
- D U
C
-, x
.Ts -
1
N LOl' - -
_ A -
I
_ CC I
S l f O - A D PR -
R P NN
_ A MO O I U '
EIT T L -
G ^ BAU _
E OIC O L -
N R
- E .
- D
- I Y
TN -
E FI A K AL SIVTOR R - S O
C S
K R R E AF EI I T T YS U -
M A HOR T A A F E CN ND E R O
O T O R
F TTRR LL AE I
D A A S EE GR WT A C
S S N D -
Y AUEP R RA SN I O L O E P UE D I R
O ES HE CLO ME ER IOM N I
T A S l
i T P CN E ME A CR U SO C R R L AN NR I I L
U OI N N O I G B S CV A ON FN T E UA RT Y
Y N MI T E R T O I
R P EI I
RG R
E OC F E ER S I
I l'. E F P l C
AT A R S i
BN S E N T E I
P I O D R 4 -
l yo n O Y N OS -
sl Cr c s at i T
C T E T M I
F A E - .
Rerv ai s A A GS T
E NOSM E S I -
R TY I S C M N .
NA _
NS UO l
I F I
T R TN E AE e
I TV P E -
c I i
c n N qmaa s -
I i e r r s -
t noA S re f
e n
o -
t -
P s r -
e n
r o
_ C -
d n
a y B l r e utom 1 1 1 1 5UB
- r a ro E 1 E 1 11
- i ud sp O 0 0 5 0 5 EE%
qr i a 0. 0 2 t0 2 0 U eho G A 5. U0 A
>G5
- l 51 l RI H > >
/
N 1 >>1 > >l> 5>.1 > > N
/
l u
a y B h
ka d w e S
e on hs ss a 11 1111 11 R
O h e ud n t y 0 0 O EE 88 B55E 00 E6%
000 0 M l r
k3 l
n%eR s 3>
1
> 1 >
33
>1 0>l>>
t 9. t 2>1 212 5
. C E l r
N a i
s 1 c e w r M
i t
d (o w r m r s t o M P f ia )s m u s a o k i y 1 1 1 1 a M am (l E e
s x-1 i1 R
I
(
s g w a l a
c t m u gG1sDGC
]
OI H1SWH s
i p
a H ur 6 P u11BH HRRI BI NI4 AB>I2M1 i i 1 P k i of t
b O E r B r t
- f 1
l as I 0 0 (
a e i c a k W 0 7 )U ) s t
i i S s e Na Oe E
i r
p (S te l r
u T 0 p 0 m n s tya i F
a 0 e c g i l
i g 7 d N t i
n rg a2 pn d )s n )s a s l 1 i o su i
s Oe v i
t E e ea a ni u r r t
r nd lr i
u a
c sn l
at q n uq Uet F
t P r np n S a h 2 e r de as i t
w1s d fa ted s t s) s a
a mi a n s a aa ya ri ms S g i
ye y S s yeir c r i t t n i a ii a t a aew eo u
h ra i
U n r
c S p U p n
f S (a fa S q t
a e
s e
m o sy e v S n E g o
e g i s r r i n i t
e d a a g m ll o
C M
h M i
d "
n -
a -
y B r e 1 d os i
r an et l o % % % % %
uup 0 0 0 0 0 5 qgs 0 0 A 0 O 0 1 1
eee I 1
/ 7 G 9 l 3 0 5 5 RRR > > N < < < > > > > > -
d n
d a -
y B
't s n
t -
d r e c k eos n 1 __
C o t s %
h s al ao %
0 0
% 0 % %
S e eup 0 0
0 0 5 R r r gs c 0 0 0 9 0 1 -
0 n ee 9 5 5 6 8 5 0 2 2 O h l ,
iRR > > > < < < > > > > >
T T A ) s
. C m s l s e
. I D u r e
)
s eu c r N
i n t r
r e n ni o n
e x le u o
i x s
,a t r ove r e b f e u I
s e r d a E a g uq ,
a u r r g u n t msu C mn l r s
e) q ep p a c c
I r o ao r
N ( r i a u vyf o e t n o e p gi yu c o ev t
A lusr h Oh e e i
t d ae g R
t c
(
s e n a (
r r r Ei n t
M v t, l
h s vr i e r s c P p y a ner)s R
i t i c
t u u e e m e y e
no l s ye p n c t O Am i oi v h q t u o
es (
e r e r
r o n) i l
it h
y )s t f a s F cc l
mer nr Ki c v ur r r b g _
e a ouo ccau P t
R i i v f r r i _
E f
e mp e oex i
l e c t
mte in _
i cp mfs r ibt e Oq r
fo a r l i er _
r u R du P eS ug p ee a au r
f t
n p
minr mu gr f t n u r
e leq E i
Sh uo r a o eq l i
xu e t ef o P es 1
) c mive v nl l R
l o m r nt u s u n n r
e S e ad o ei u r p mo CT mi i
x r (
cd r
mo t
n mu i o e or)s E o u) t t, h ap e r af s v _
Rf o (
ea ef qd r s r e c (
ei m me c p t
s s Ce l i
v E o gu ee T mn) t t l (h n ( n yu t r a e i o o Pl e cesr Ra ce er t a n d i
S o e a cr r i g p ir p t
yr e Pr iv )/ b a t
s r e k p ge m io e nv i
u qu og s u gr e Dt r av r ioepr np yer o loin c re F o t t t S pa aS k o f a a t o2 e i (F p e . a ea r pp a p1 ir t, ne n s, u e t
x d u S ra e q L h icg eh i i ae r d c L l f
P icc) i s f n Es u Rad au et t y (r ee o e t t i i t
o s req r
cg u ol uu our ai l t r r l r
S irn De n aae oa o iT f if eeg i s
c P pt r Nd nv Mec Ar u oe Cn r n c
r o
Cvf t n o ma r e
l ea dty ir De r d of le u oa a p Or l
n r lysu et nt x i
r vu nl i t
e nd f in D ha q t
c a ns s m a
c t oh o d ne ae E ai b pg un S/u ot s r n eof t I 4
d c nv a
i oer SCecr t
n cr /
ll Ot agh t t r a i ci r Tcc ov tere s r e tnr e e m 'p oe i r R lele cu E r ev e Et hi R (o P (o i
l R Rp Cp D e Ar Od P e FP n -
t o 1 n y n i t
g a 1 e t
o c n
l o
t n s l f i
t t e
e i
o e s a a a o n
d C 1 e nS h r
d m yn c o d P o 1a r n in a t
s s l
om i nde t o R l r rC t ce t a
g e r ai pt a e y a
c e el ie at s n r a 6 i n r ey o ep ui l t s
r r Fu cd b fe y _
o a RS C mr e OR c a ua h C B4 4 4 EP PS P _
s n .
s e
c '.
o r ,h P k[
e t T h
g
[f, ,
s g
L A
i i
n s -
M, ,
d r n e i F
v g n
f o
O g n t i
t e n n 'inr n_o oe o i
t t e o ~ o _i p M i n e iI_t MtA@gytt c et ARn t
a u
U U
a c e l r nm t
l n e s a P e e m s ["_t o e s a sms e E v
e s gekl s a cik guses s A k s c i n L (k eRAi A
a l M - b u
P
-,il i l I l t
l t h d. h o o it n it N t w p e w le n bt tse g s g ana ig n ud n
_ a r ,ra it Ses it t
pl e e e e P pdn M ee y.n ee c;Oae ce mest f e i c di Mse ac nnn nn nn toBlb oL sa oee Mek oet n Uadit eh p icm si ic sie
_ l l mt it ncy t e sLe r g o oe s
sL m
imea t
ar r vit imo r e
ef omicte r ei r rt haf min n e v mig vee na oe a dRi r c t
oen na OPPWr US CSM r
OoA CSa
- s. s '
e dlept otu ens. eg vn )
n t
n e
eh cit nw n
o io n
r te d e
)
ne e o
it t df it s p
.it dny c m a n mdt l L e )
m inoc e jacf nat e e e ea r n is F tr n s s aueI ;bt f a s r iog ma a sd Df ( ) oa r o s a n Te cr ua i
r gM m w mia r l n
p lp ime mroi c gr en f
e ,oou 't OsignS opt n mea nn f h 44 w DeCl pe ng n lennoSi i r t eni g d og nFe 0 5.r I n mfr Lt n e _
CoSM n Pes r 2.0 e ist int io o o ero e !v anD r n eodYioL h e e me 25 d wec Cr Pim e eme ivt s e dtsh oio rt e ev eio of r is n R RRo (o ss ege u g (ows i e s irde t
t e e a pR l
erit e w escn t
i n
s vO no intc e FF J lvs p es s im usa y c
le spu es r eI n ri pmglt 1 Oee t
CCt A
> eoeu r mt oesea ud r Dec ic eprC R a nsa 00 C As/ s m o Ochn Diist a e n
RCDMoCMiRM s EML i LI mN BiC 1 1
- - - R a (w C iDwM t
A a
i
)t e uicn t
e n w eps n e C o e n
E E it nt a M R if t
co on d .
C hI u r einh i e CN NA Wwpm t o A
) N h
ee ps su t
et io i
t n roa
)
h R _
d2l loi l
X MIC A et eesen fo rt tnwitc e
!s( R it ina sd nn oo n eplp it w
a n
I RI F ain nr e f w d C p gr n o R ON e d e aniWims r o
( Y hi Pc reM 'e r r g itooe ga s let Sn et nn no sC eg ist i ni o sc e l a
e T FG gt r go eHa etr cen emh aoit Rn wec t sn uae R _
A RI S E
eso3eCia Desyt r t vl My Rs r ini e sg s s is eda ined s a t
e a i
d ieme vs p s cme s s M PYT emt nop u at nra;cmt Sejnf aeie oil mht n sere e leur s cg k r cg eseIn r s ir Don fr e n r r bi a Ddi ic sv aoe oe As/ Aec _
N E E E F OCioaAOMS daw LAO BFD DD R a (w RPL i
O I
Sl /
NS s T E t u n o CG p e io C
t _
)
N c r _
A ILIS in n l e oD e tc e s )
ht a a eM )De e e A e iv nn tr n inrmn p
E it h oy C Don (r s tcC s oit pa o r oa pp l i
w e n gr e in R ot l l (tc e R s p t W )f eree C s rsu r c r
r n e ot e eeF f
e ei oN d e N n RAR ist o M I
wnnPms hiL ir Dh Cht t a p t n gn
/ ni wec t Tr eo co ev r est igCi C
ni t
ewhg ei eu ei no i eme De how mdtc i
vs sp De s ofier te;c in -w f t ci s nis ura e es r edma se nst ie n or eie teo cgp r eI n o ne n not rr ej b ave r i ct icv sl ao l
oes Ds/ s Cc O (i cSAO BDM LAO DF DDin D a (w ,
BL i
e cnngnMd )s ee t
e h aan to y r
o v it i nC o- t r
oa 9r it w
r cn t
t i c t c8l pp f n m )sdsr ll o i eo e r
dpsea n en t
e er i in eu ipt nsc r gr e mfoP(FmF r
enar o C
e s a mnB ist o
/ ni M .
se soCe nos S i e rI ( wec t C e sPr e( t v e eI t
ntn e e f oem n eme ivs sp De s satoi s
t c e ee c;i n c t n
t itd) i sn n o I nia k- eg l
r e es ei n r s one Auipej pd s rb usR ei t s s o n r s I l
oe icc iar o Ds/ Rc RR( S l
AInnnGO I i LA RBP N D a (w SL i
n o n it io t
e c c t t yc A e y n n r p r e e ton e e s to m m
_ lar e e
s I n as n st s r csi n s g uf gn n
e C lu gi o eo sp i
l bs e et
_ eo R us e t
ic ec se RC L N RA AR PAM gHjmy umZ mtQ u' _ $p6E O __
t .
)
2 1
2 8
L.
G
(
"s t
n l
a P ~
r e
w o
P r
a e e s u
l c e
.
- u in i
g N le t t d a a i u
F le g n y n n c a o i i
s r
lop i
c P e s n h n g o t i
it w h n a t c i t
a i c s e
t n
e r e
f i
c r e t e
T p e p
t n
i s
s
/r O s i n
t o f o
l a
l a
n o
c a e c o t r u i
n i s
o t n
n e
p i
t g h c s e s e a e r t n m .
t F t g e O g h g
n o
la p t
a n u t
s i
s o ~C e y u r h
d n m c _
a t o i C d a s l
o s p sr e n t
t n a. s _
'o e o e s t
c i
t a m e a m g s
F e itr s _
l p le e a _
e n l a v r o im t o o y y n f t ic e o l
o ic c e C R
l P o e s
. " P R U N _
e e e e
h c d e a e h e v t .
y o r t n b p ae _
d p d be e a -
e n d s m
r o aa __
o i s l oh f
r s y .
et e
p i
m blie l
e m il d i
b o wf r t
o - C r ot o _
r d sl a _
e e t s u 8 n w
o p b s
a i
xm ei s 9 e 9 dr 1
r T
- t a - - u _
o h d 5 b _
s y A t n 3 y n t S ea r i
v e S o
)
5i o i t
c h r
o c n ,
N a t _
( t a t
Alug _
)al a e r
f o
l aio ut a
/
I S e
( u t c
t r
a t
cn N yr _
1 p e r- p ai A r
- 3. n i f
f o- e - e m a e sa a r dh x s r s 5 a t a
t n
a nt e t
o e -
5M h t l a t a a ce e s
d c n e Ry s p
f-h t
- l f
e n e n n t n l a - I s r e o u _
Fi o u y n c t Ci tv sil d e i
c ic io t t t l a t a
i l
t u e s e u s c 0 a c l u
p n
a e a ov l d
o o
'r i v d 1
i n
l p h f mtar e re e a l a
t f
n o e ce ,
r g t o R m u oi te e
r iup l
n d t
c s lau a a o y; e i e _
lo a s r s t _
t r
n e t u
p s i mno d 't y n i
v b is s ve o h e it h- ag i
t i
c t c e la m
, l cn c9 4 g r n ai A1 mpsit t
n o ch u pa t
l n
a a f r r pe y1 e i
c d o o ng i eat r e b e mp aor od es i
'fi t n h ey b gan m t
r e u u s t dt h t i i i c o en g nf de au 5 u G4 l
slif wro l
r l i n aor e5 p pp e ut i ee us y 5 Roln ot nn gr oms 5 l
u sa r et o l
c a o ar i
e e Riseb r u d d d Ct cia t Rlau R F t q n s t
eu u l l d g C n e e c u s o o eRliM r
oWW*
p
- t e eR 01 a
r u o r
l e
C*
- P * 'q\ R*
- r-I 1
- I
. i : !
! \
I i
ES-301 .i Final Rev 8 Change Overview :
- 1 i
r i )
l s
t Purpose *A" l
t I t
, M appbconts for reactor operator (RO) and sensor reactor operator (5RO) 6 censes at power reactor facenes are reeuwed to taae an
' operateg lost, unsess a has been waeved m accordance enth to CFR 55 47 (refer to ES-204). The specsrc content of the operateg ,
test depends on the type of teense for which the apphcant has '
apphed.
This standartf describes the procedure for developmg operetag tests that meet the regurements of 10 CFR 55 a5 mcsuomg the use of reactor piant senunatsun facenes and the conduct of muR*und evaluations.
I l
\
. 1 t
Background *B" i
l I
To the estent apphcab6e, the operateg test will recure the apphcant to '
demonstrale en understandmg of. and the ability to perform, the actions j necessary to accomp6rsh a representatsve sampimg from the 13 Rems saintifed m 10 CFR 55 45(a)(aII13 noms do not need to be sampeed
~
an every operettng rest In additen, the content of the operateg test will be scontried in part, frsm leammg obpectares contamed m the facility hcensee's trommg program and from artformaten m the fmal safety ansysis report, system desenpten manuals and operstmg procedures the facday 6 cense and bCOnse amendmertts, bconsee event reports, and other matenals ,
requested from the fechty bcensee Dy the Comrnissen t
f-t i
Category "B" I f e Control Roorn Systems and Facility Walk-through (B.2)
! Category B 6s devised into two subcategones. The first and larger
! suticategory (81,"Centrol Room Systems") focuses on those systems with
, whci acensed operators are most envolved (i.e.,those hevmg controls and ,
encuatens et the mem control room). The second subcategory (8.2 "Facshty I
. Wom-Through") ensures that the apphcent is femaler isth the design and
, opereuon et systems locsied outsee the mem control toom. ,
- The toptocent's knownedpe and abishies reactive to each aystem are evenuered by edwnoesenng Jous and. when neeensory. spectne ronow.
7 up oueenens bened on the opptocant's performance or each JPM.
l h t t
.I i
I Category "C" 5
Integrated Plant Operations (B.3) '
l I
i Each applicant must dema n. , e prorcency on every competency l.
apphcaese to his or her 6ces v- level. The onsy excepten es that SRO !
Competsncy Number 6, *Ca rol Board Operatens."is opeenal for SRO- '
upgrade ap,wcants (i.e., L Qopprede aph come .% not have to RI!e posnoon that ,
requores ceneralboard operetos e; however. If they do rosese into !
aush a poemen, they wolt be gros.
- en thss competency even though ,
they may not be individuelty obseru.Oy en NRC esamuner, as dueruseed en E5402).
j I
INSTRUCTIONS -
8 i
General Guidelines (D.1.a) 6 To mnemste preecebety and mentam test etegnty. vaned sabrects. .
systems. and operatens shall be evaluated witn appiecants tnat are not beeig j tsImased et the some tene. uneess measures are taken to preclude interaction among the opphcants The some JpMs and smwtetor scenenos sheII not be repeared on successive ders. .
r l
l
. +
I
- . 4 1
, General Guidelines (D.1.a) cont !
l 4
0 l
6 l l
, Operaung to ses wreen by the recety heensee may not duphcote test mems (etmutetor scenertoe or JPets) from the appitcents'euet test for tests if she appl 6 cent is seenheng ghe esenunation) geven et or near the end of I l l the hcense treewng caess. Senuestor events and JPMs that are samner to l '
those that were tested on the oudet osanuneben are permeted prove 5ed the t achons requesd to megets the transeent or complete tne task (e.g Using en eNernese path as dVecueeedin Appendis C) are soentncendy efteront trem shooe requ, red during the audn l eseminathen. The hetNty keeneee ehett identify for the NK ' chief esammer those atmunenor events and JPue that are eindser no those
, that were tensed on the audit esenGnetton.
4
- I .
I I I
l i
i General Guidelines (D.1.d) :
1 I
I e
' l l l j i
[ When seeschng and seveiopeng metensis (JPMs. scenenos, and I queshons) tar the operetng test. ensure that the metenets conenbute to the l
-l coers overes cepecey to esterenuate between those opphcents who are j i compant so seveer opersie tne ,eent and n=se who are not. ;
{ AddrooneMy, ett of the nest teems showedinctuae the three recets of e e test vetadny(Le., content, en:_ '. and escrinuneson) escussed ,
e in Appenes A. !
Any test eems that, when nussed. would teme questens regereng l.
edequate sustdiceuon for eenying the opphcents 6 cense should not be t
, included on the operstmg test. '
e i
l l Genetal Guideltnes (D.1.3) ;
' l l
. i
~
I Every recet of the opereung test dnesueng the prescripved Ceregory A Questrens and answers, the JPhee for Categorres A and B, and the ;
l Category C anmutator scenernos, eheutd be pJenned, researched. ,
vehoeied. and documemed to the merimum extent possatwo before the j i test u admmatered.
That is "BEF0RE-t,
! =
4 .
' i i
i f
r I
1 4
i
, General Guidelines (D.1.j) i -
i I l
i i
l Esameners who win be admmisienng the operating tests but were not !
- invo#ved en thee coveiopment are espected to researca and study the
, topics and systems to be emenwed on the operetsng test so thet iney are ,
t prepared to ask whatever performance based toalow-up questions megnt {
be necessary to determew a the apphcant is compeient in those areas. l I As storedin to CFR 68.46(n), the opereung test requires the appucent
.i to demonseen en unsereundme or and me abuny to perform me l ecoons necoeury to accomptosh a representative sempte from ,
tmong 12 hems knred on the rure. s
~
,n I
l l
General Guidelines (D.1.j) cont '
i l !
- 1 I
i I
1 1
' It we appucant cormctly pertorrne a Jeu pnctadme both crtrices and noncrmcal enope) and aemonstreres termiertry wrtn the equipment
- and poucedures. or is not necessary to ask any tonow up ouesvens.
I However, et the opphcant tous to accomptesh the sesh standerst for the I i JpM or demonstreres a sock of underasenene rege.*ing the ! i equipment and procedures such as henne drencuory sceaung . i int 6rmacon, contret board inorceuens. or controns the enmmer unust ;
be prepared to ask persormancsbased tenow.up euestions, as e i
neconsary, to ciertty or connem the apetacant*s unoerstanarne of the l trs=m as et redetes to the tesh that was performed. ,
i
~
General Guidelines (D.1.1) 1 I
1 The presenpted questions for Category A and the performance based j n
96How.up questions for Category B rney include a cornbmatson of open.
and closed.reterence hems. Open-reference soms that reeuwe appiscants -
t to Oppsy thee know6 edge of the pont to postuleied normal, etnormal, and emergency sstuations are prefeneef, f l Closed-reference items may be used to evaluate the immediate actions of i j tmergency and other procedures, certain automatic accons. operatog l t
[ characterstics, entertocks, set ponts, and routmo edammstrerive scartpos, a is apprognate to the facittty, Ref r ng us,er to ,tsachment of-se,r,-, o,e,, ,st for enere renc. gurdencee,o,y eyes,,o,is rega,o@,
, et,he ca,the
- w. . , development and '
through test. To the essent possabee, the concepts en the attachment GC.ould Biso be appered to performence besed tonow up questoons. ?
I t
I 1
l l
t I
L
i, Catagory "A" i -
t i 4
Administrative Topics (D.2.b) ,
l For each admmestretwo subpect, estermme the best method for evelwateg
, the apphcant's 2 - . _ or stety in that area. ARhough a performance. !
based evoluehon, unng a smgie admmestretwe JPM is genereely preferred, j two presonpeed queelsons may be used to conduct the evaluahon m each ;
- specinc suspect area seleoled for evaluehon. .
- 1 The queenens may be eenocieeed enth Category B JPNs or shey may .
l be admindetered separeenly.
t i i l
l l
- l
- , \
l l
Administrative Topics (D.2.g) ;
I
)
l l Fonserd the comeisted euene to the NRC chef esammer so that R is l recomed Dy the este agreed upon web the NRC regonal ofree et the tune i the enemmenon arrangements were cor*med;ine ovume is normeer due t .
approximesety n aisys before the scheduled esammason sate. Refer to r ES 20t for sessenet meeruchone regardeg the rewow and subnuttal of the i Osammaeon authne, j
i Administrative Topics (D.2.h)
I After the NRC chsef esanuner approves the operstmg test ouene, prepare s the fbal Category A test metenets m accordance wah the general i operstmg test guessimos in Secten D.1, the opeWerence questen guedehnes M Appentha B. and the JPM guseetmes m Appendas C.
(i.e., the JPNs, preecrapeed quantons, and answers)
Control Room Systems and i Facility Walk-Through ;
I Specific instructions For Category "B* (D.3) I i
, This setegory of she operating east evolueree the opphcant on Eyeneme related K/As by herung the applicent perform selected tesks f and, when necessary, bened on the applicent's peryormance, probsng l
hos or her know6 edge of the sesk end its associated syetem with ;
spectre hMtow up queettons. -
i The Category 8 taslLs are in edeton to and should be eferent eum the events and evolukons conducted dunng Cesegory C," Integrated Plant i Operatens."
i i
i i
Specific instructions For Category *B" (D.3.a) cont l i
l i
. The 10 systems and evokttsons setected for RO end SRO l app 6 cants should evaluate at least 7 Weerent safety funchons. AA of tne systems and i
evolutens in each subcategory of the test should be setected from different safety funchon hets, and the same system or evoluten should not be used to evaluate more than one safety funcien $n each subcategory. For PtVR opetoong seass, the primary and seconelery systems heted under safety ,
Functron 4,
- Meet Rornovel Frorn Reactor Core,* in sectoon 1.0 of ,
(:UREG-1122 mey be treated as seperate setery functions;le., two l tystems, one prsmary end one secondary, rney be seeected from setery '
Functron 4. ,
l 4
i i
Specific instructions For Category "B" (D.3.a) cont i
The 10 systems and evolutens selected for RO and SRO l appkcents
{
should evoluste et losst 7 detterent safety functens. An of the systems and a evolutens in each subcategory of the test should be seeected from detterent safety funcien 6sts and the some system or evoluten should not be used to evaluate enore than one satsty functon ei each subcategory.
4 For PtVR operetmg tests, the prtenary and secondary systems hated under Setety Functron 4, *Neet Removel from Reactor Core,"in a seccan t.0 of NUREG-1122 eney be treeted es separete sekty functoons:le., two aystems, one putmery and one secondary, may be t selected from sekty Fsonctron 4.
s
i Specific Instructions For Category *B* (D.3.b)
I For each system selected for evetuation, select from the appicatste K/A l catalog or the fealey Icensee's sne-specaric task list one task for whch a
. JPM esists or can be deveeoped. Rowow the assometed swnuestor ouume
- if it has streedy been prepared (rever to Secten D 4), and avons mose i tasas that have streedy been seected for eveaustion on the dynerruc ownuantor test, l The JpMa should, ondev6duelty and as a group, have meaningful b
perforenonce requirernents thet willprende e legertonete beans for
} evaluaang the appircant's underesendmg of and ehiltty to estely operor. u,e ses.cuo.a eyet.ma and the po.nt c.a r u, red sy ya crn ss.ds).
l
. i I
, Specific Instn/ctions For Category *B" (D.3.b) cont 6
t i At least one of the tasks shes te related to e shutdown or hpower condsen, and 40 percent of the tasks (Le., arvo for Ros and instant i SLOs end 3ts for upprede $Roej shalt requae she appercent to
- esecure eteernene pause wethen the tectoryt operosmo procedures.
i j in additen, at least one of the tasks conducted 6n the piant (6 e.,
Subcategory B.2) shall evaluate the appscant's atweny to enpiernent actens regured dunne en emergency or abnormal condden, and another shan
,i requre the opphcent to enter Ine RCA.
1 This prowdes an escenent opportuntiy for the appicant to discuss or ,
demonstroie the redeten control suh ectst descnDed in Admrustratrve j Tope A.3.
j t
' +
i !
~ .
l t
I Specific Instructions For Category *B"(D.3.c) l Forward the completed walk-through test outhne to the NRC ctwef (sommer so that a is receeved by the date agreed upon with the NRO regionW ofree at the twne the esenwnstion anongements were conhrmed; ;
the authnes are normany due approssmerely 78 asers before the schedueed enemmaten date. Refer to ES-201 for edditenai enstructions regardmg the review and autwnntal of enemmation outhnes ;
i k
i I
, l j
i l 1
I
. i l I i :
l l
' l Specific Instructions For Category 'B' (D.3 e) j l n
Sutwns the entre operstmo test package to the seeignated faoldy reviewer ,
! or the NRC chef exammer, as appropnote, for revew and approval m i accordance wnh Secmon E. The test must be recewed by the NRC chef f
, enemmer approutrnetely 46 ainys before l
- unless .iner .rr.n.ements have e.be.n mm the scheduled review i date.
i I
l
- l l
I s
Integrated Plant Operations Specific Instructions For Category "C" (D.4.d)
Each sceneno set muet, et a nwumum. requee each apphcant to respond
^; to the types of evokskons fadures, and trans.orits m the quantehes edentsried ter the apphcartt's bcense level on Form ES 3ot-5,"Trans.ent
- anJ Event Checkhst? An opphcant should on#y spe geven crect for those events that requwe ine appacant to pertarm vent.abee actens that provee I
meeght to the opphcant's competence, l
The requiredinexrurnent and component taiturma abould normatty be i c1mpoeted before startmp the mejor Lienaent; those that are snroated '
L9ter the mejor trenseent should be carefully revrewed because they l mey reeuere btree apporcent action and provose betse inaught regarding a theor pertornwnce.
t I
i Specific Instructions For Category *C* (D 4 d) cont
~
l _
t Each cvent showto only te counted once per apphcant.
l For esemple: a power change can be counted as a normal evaduten OR as a a re2ctwity mampulshort.
1 Sendany, a component fadure that immedetety resutts in a maior transent l i counts as one or the other, tput not both.
9 l
f r
1
l
\
l Speedic Instructions For Category "C" (DA.d) cont Any normel evolution, remponent failure, or abnormel event (other then a reactor trip or other euromatic power reduction) that requires the operator l
, to perforrn a controleed power or reactivery thenye will settsfy the l ,
requirement for a reettivity manipuJetson.
l I I' This includen mate such as en emergency boreson, a dropped red
' l l rec 1very, e slantfleent red bank reekentnent, or a menuel reactor power l
t, reduction produc. ainm.oe respons,e trr.etoy aop.retor.I,d secondary syssem upset.
nr,t ep.ne. t n,such evenu,mey
. n.,m. p.w.,
l thenge. l' l i I
i '
l l
l i Specific instructions For Category "C"(DA.d) cent '
l l
l' ff the fecihty licensee normally operetes wtth and de required byits technical specifica6ene to have more then nro ROs in the control I i reem, the chtef esammer may eau orne the use af addruenal I
l surrepetes to fillest the crews. "
l-
) in such cases, sehe care in peanning the scenenos to ensure that the I
addaronel operators do not reeface the eseminers' ability to evoluete each appkcent on the requued number of events and on everf c1mpetency and seOng factor, i i
= .
~
e i
Specific instructions For Category *C"(DA e)
}
When the proposed senuletor opereung test outhnes are composte. fonverd i them to the NRC chet saarmner se they are rece,ved by the cele agreed upon enth the NRC regenal ottice at the trne the esarmnsten i anangements were corthrmed; the authnes are normally due , .
(pprorronesedy F# eleye before the scheduced exermnahon date. Refer to
' ES 2ot for addamnal metructens regardmg tne renew and outruttal at the ssermnauon outhnes.
l
f[ .
1 i
i.
t Specrfic Instructions For Category *C" (D.4 g) l i
I Sutwnst the entre operateg test pacAage to the desgnated facdsty reviewer l
i
, or the NRC cheef esemmer, es appropnete. for review and approval m ,
accordance wth Seckon E.
l T
1 '
The test must he received by the NRC cheaf emermner appros/marely 45 l t
.er. o,e me sch.duied ed n.eirei,on .eie. unions oiner mangemonis !
heve .en de.
l
- i
.l l
1 l
1
. 1 I ;
I i QUALITY REVIEWS l
- Facierty Management Review (E.1) !
l Cthe opereeng test was prepared by the facairry bcensee. the prehminary ,
e marr/rne and the proposed fest shaft be independency reviewed by a l
supervisor or manager before they are suernmed to the NRC regumet offee !
for review and approval m accordance with ES-201.
The reviewer shouid evaluate the outione end test uomg the entene on Forms !
ES-3012. ES 3013. and ES-3014 and inciuse the sgned forms (for eacn i Gifferena opreeng test) m the esamenetson package submmed to tne NRC m !
accorcance wth ES-201.
I i
ATACHMENTS j
. i Atta;;hment 1 (F) ,
"Open-Reference Question Guidelines" f .
i
I i ,
. I t Open-Reference Question Guidelines
- i e
- t. The unost appropriate formet is the short-enswer questoon, wNch requirne the applocent to compose a response rather then nebect from among e set of einernative roeponses, as in the cese with mulogie4hoece, matching, and trueMelee queckons.
h 2. Provide cieer, esplicit : . _ 2;uidelines forenswering the oueetion so ther the oppescent underesends what constitutes e fully correct reopenee. choooo words carefuny to eneure that the esputecone end reouorenwnte of the eueeson are appropraenely conveyed. werde such as *evolunte,* "ouesne.* end 'euptein,* can invrte a lot of doenil that is not neceanerily redevant l
I i
g J !
l Open-Reference Question Guidelines (cont)
I i
l 3. hiehe sure that me espected roeponse tentches (and in Gmhed to) the requeremente penedin the questoon. Coneiner the amount of partnel crodrt to be granned for en incomp6ese enewer For ueenone requinng componeoon, specify the degree of precision 42pected. Try no onehe the enewer turn eJr to be whose numbers.
i 1
4.&weid guving eney part or06 of the answer by the wey the queseen is wereed. Mr esemple: *lf the detdown kne became obstructed, l couM borenen of the pient be accompisshed shordy sher a coactor tnp to put the plant in ceM shutoown? If so, hewt* A test-wase s
ipelocent can reehze that the enewer has to be yes, or etee the l eecond part of the Quesuon wouM have read something hhe *lf not, why natt i i
, Open-Refefence Question Guidelines (cont)
- 3. Avoid what couM be considered *Dtch' questions in which the espected enewer does not procusely match the questoon. For esemple, eshong *How(00) the $1 eernwnetoon cinene change tonowsng en SI reenhoenont* tonphee that the termonetoon cnterse will change, when in
, actueltty they do not, ;
I 6.Do not use erect teoh-up queneens that only reourre the opphcent to a res:N where to Mnd the enower to the questron. The operational l Onensetton required of questoons on the wolk-through test and the l topkeent's access to reference documents, argue ageinst the use of l
, Ques >ons ther nest kr receIIand memonsetron. Any quoskons that do s
, not require any enelyels, syntheess, or oppkcation ofinnermaeon by the ;
Cphcent shouM be enewerebee wrthout the aid of reference merenels.
Refer to ES-802, Arrechinent f, for a enore deteited secussion of erect Ic%h. sop ouosvens.
e e
t t
i .
Open-Reference Question Guidelines (cont)
I i
I 2 Questoons should eteo enhove to the generte hem construction pnnenp6es and g.Nn.kn.e in Appene,8. heereover, Form ES-602.,,
- swRC,,Checkinet
. e .no , met an for Opemte Tent noms,' consoon he e e or e .9, se u,s.a
.,g, ao,e . e a,.,..o.easa,a,,.1,s
- .<,0.-o,-t a het or htth0
. .uon .e., eu .r e .,,,e, i ,,,-.U.gh 9,0 Che.ck.et eues deve00 ped kr Une in evoluotingen,,he a ,e en .,0.e, , 7 e,e -.uy.,,.u e ce co . ,
I I
-le I
i 9 I l 602-1 Excerpt hems 9,10, and 11 i e se me .n e ,,.,n - wie -eien u.non..n .no me esassed fe, met (e.g., aho,t answe, or rnutspee choace)?
l so. oo eu.mione vi s.a.n Ai.e u ,uge or me e. mown convoi 3 room eette g?
l I
i1. Does any ouween how me ,oiennai of emno e souwe. pop-or Queehon?
I l l l a l
\
. ~
ES FORMS i i
i ES-301-1,2, 3,4, 5, and 6 i I
I i
l L
. Examples of LOW discrimination i JPMs t
.... g ---- '
i 1. Roset the Turtune Dnven AFW Pump Tnp Throtue Vs.ve (PWR) i
+ toc y .e,.e ine acs wiih in. emergency me,ue, ,sion es ve !
3 (PWR) {
Examples of DISCRIMINATORY ,
JPMs !
i
++++ @++++
i l
- 1. Dropped rod recovery (drop e second rod dunne recovery reewnng reactor esp) 3 Local stort at equipment wah fedures requang the use of oftemale proceeures.
j l
a 6
t
. f l
D I. ES-302 ;
4 6
l Final Rev 8 Change Overview i
i i
l l
! I I
i !
l
. i Purpose *A*
i l
l i
- The mended e sennes how to sommieter opereung wets to inne 6 cense
- appiecents in occareence enth the reeuwements of 10 CFR 55 45. It i meiwees psiew$ end gwo.w.s nor samm.m.nne notn ine wouhrouan i
and the eneersed porn opermens cowganes of tre opwoung test. n u assumed that the Operstmg test was prepared m accordance with ES301, ;
a s
/ .
l l l
l
' i I
. I i
i.
~
. Background 'B*
i !
j As noted in ES40s, facety 6censees uns generetty prepare proposed !
, opersung tests m accornance with ES-30 t and submit them to the tsponsstHe NRC regenet omce for review and approval !
I Cegardless of whether R was prepared by the facslety tr:ensee or the NRC, ,
6 overy operstmg test will be meepenoently commatered and graded by en fC.C hcenseg esaminer m accordance with the instructions come ned herein and in $$-303. '
1
, i s
l I
f i
Responsibilities "C" 4
3 Facihty Limnsee (C.1.b) f Seteguera the enregrey and secunty or the operating tests da accordance
. wrth reculty procedures ense6kshed pursuant to 10 CFR SS.60(b)(2) and the gussehnes d.scussed in Anschment 1 or ES.201.
I I
l t
I Responsibilities "C" l
l i NRC Regional Office (C.2.a)
J Wort with the esc #rty contact to coordinate the operoWag test
} edsendelseson scheeWe in a menner that anermuros efhedency and
. morneems securtry.
I Normally, the opereang emets should be adminsseered wNhin 30 days .
before or efter the wrtreen esenunevons. The repoon ehell obtain concurrence from the NRR operotor keenemy progreM emco if the l s l t,o,imenetson add, detes ogu, deverge by more then 30 nays. (Refere to E.5 201 nce,og.,0,ng.
,esthe.i,o,ed to ach. eve er, ecce,,e ,e.mm.t,ons roco that hewe to :.
l I
l Test Administration Instructions i and Policies (D)
, General (D.1.d)
~
i l Normally, en NRC esammer stu be eaetyned to indierduelly evaluete eelh apphcent during the surnutetor operetmg teet. However, if a three. person operwyng crew conststs ennrely of sensor reactor i operotor (ERO) opgrene appItcente (who do not here to be evaluated on the control peerds), the chnet esemonerasey assign only two )
esammere to obeerve the crew.
Although the Oppiscents in the reactor operator end bedence of plant p poentons may not he makvenueHy evolueted, they wiH be held l
, acrounteDee for any errors that occur as e result of their actson(s) or l
, dnectron(s) and graded on theer ebutry to *Operste the Control I i Goards"(i.e., ERO Competency 5). SRO.inesent opphcents wtII l
etweys he indevedueHy evoluesed by en NRC esemoner regardless I what operetmg posroon they are Nokng dunny a pren scenerro.
l 1
1
i 1
1 I
)
1 l
, General (D.1.j) .
a 4
Athougri the sanutoten facJetty operator will normally assume the role of the other personnelthat the oppiecents drect or nauly regardmg plant l I
. opershons. the chet osammer may perma other members o' the facshty troenmg or opereemns steft (e p., a ehlft tocharcal savssor (sTA)) to l-
, augment the operating shift seem Wnecessary.
, The cluef enemmer shes fuNy bnsf those indmduals regaromg their )
responsitMhtes, reparung requwements. autes, and level of parucapoten )
l j i before the opereung test begms. The enemmers must not restnct the surrogese operators' actnenes to such an eatent that the sophcants bemg
. eveausied er, requeed to assume respanoituates beyond the scope or I ther posihort.
i The surrogeie operators enN be expected to assume the fut respons:tnartes n es sne roles tney tone m the operenne test coneuhettons with en srA 1 shellbe conductedin accordence with she $ncHety hcensee's normal
- control room procace; e g., en s TA ehell not be sunoned in me s
simudener n mer ero on con et the sne.
l l i
. i l
l r
i Wak-Through (Categories A and B)(D.2.b) !
[ i l
l l l
l l l
! i
, Ys the extent poseatWe, the esanuner should have the apphcartt perform the 6
control room JPMs on the senuistor, rether than estmg the oppkcont to I sescribe how he or she would accompassh the task.
5 W Ehe esaminer obeerves a 6screpency between the simusetor setup i
and the cendroons specnied in a Johf, then the esenuner sheII stop the Joht and correct she sinuetoon, as necessary.
ff the seen con be compiered wrth awfmns values to e.. und dereenan '
when eenernunme a prencore ocean recommennenen dureng an emergencyp. then the esenweer ehen document the derrmnces and coordmete wrth the facHrry connect and the NRC chnet esemoner to
,esonore the apohcant a umapense unoer the actuel conenons.
i
~
1 l
- Wak-Through (Categories A and B)(D.2.f)
As eseredin to CFR $$ eMa), the operatrng nest requires the appincent ts demonstrate en understenomy of and the eburty to perform the levens necessary to accompensh a representatrve semple from emong i 13 home hatedin the rule. . ,
if the applicent correctly performs a Joht (inclu$ng both crrucal and o nonerthcal steps) and nemensoetes femtInertty wtth the equepment and procedures, the ereminer should infer that the apphcant's ;
underosen6ng of the syneerrytesk de adequere and reffern from asking *
- follow-up questrons.
r Nowever, N the applicant feels to accomphsh the task standard for the Johf, erhlbfts behevoor that elemonetreres a deck of femH#erfty wtth the I equepment and procedures, oris uneNo to locere inferrneuen, control boerdin@cetens, or controls, the enemmer should ask pedormance. '
bened follomup Quesv
.pplaantu n. ore. ens as ng stecessary otth. sys,e.n toa,cienfy or conform n t.se,., themat to the tasa met performed. l 1
l l
I l
I t--
l l l l t :
I t l l
i Walk.Through (Categories A and B)(D.2.f) cont ,
1 i
l
' e Simnersy. if she appl 6 cent p6ves en emboguous enewer to e preecripted :
edminierretire queenen in Category A. the esamineris especaed to I i eek probeng quencons 80 ensure that the applocent understood the f l eriginal queenen end she appItsebee knowoodge or abiltty. !
e The esernener shool docuenent all performance-bened ques eens and I l enewere forse=r sveven.
- eten a,po,eeat oun,. ore eddmener or corr.c,ed unronnati en.r hevsng eempiereda eeen er quacaen, me enmmerehers ener the I. eppercent the oppersuntry to sehe whoseeer ecsons wound be required in a sinuser steues6en in me pient.
The eseminor will record any rev6erens to provtously persernnd sesks or enewere Glor conenderoven when predong the operosing teet per ES.
30J.
1 l
l
! Walk-Through (Categories A and B) (D.2.g) e w eunaner shound precoce emer ecod wee-mrough eveouneon
- sechnoeues es escussedon secean o or Aeoenas c. ;
I i e i l
i
~ .
~ .
I I i
! I i ,
Walk-Through (Categories A and B)(D.2.o) '
i i
4
! l tt m on .
de.ey ,nu.en te.rmy or me e-re .hou .ecorne
. eeis.me cn < .no,erem,,ou m.cu..
cou.e e-e..
.e
- estuanon we me teomy scensee en.e..,n.ne, .
the responsee regenei supennsor so met management can make e oeceon regaroeng the conduct of me operettrig tests, it may be necessary to reschedute the annuintor l e emineuons for a sneer este, l 7he ermutetor enould be coneodered enoperende under any of me I followmg conmeens: l
. The simusetor euhtbite e onese/ energy tunbetence. orresse logic, or
- enemplocaboo penetendocorrens atursne modelesecutoon.
' . Tbe etmusetor euhibtse unpaenned end uneupteined esonss or l
\
\
mortuncnone snet cause the appencents so dovert from the espected
} roepennee end succese path of the pionned scenerto.
,l
l I I f
I l I i
Walk.Through (Categories A and B) (D.2.o) cent I
i I t i .
i . The enmuneter enemeeselty rees to me *troen~ etate curtne e i t scenene er s 'berend etmanened n,mns eterm se recorved en the
- inenructor eeneen. !
g . The atmunener snegructorits9erme she eneminetten seem that e
- g conhwere medu6e hee hohed or *hecked out" De:urrence of any of 8hese sheermalsimuteter operedng cont lt6 ens during en eneminetten conestutes su9tfsient seuse to step the tcenerte. Eretunefone of she appNsents'performence alunny any of these almueeter neeMunetron coneNinene neey be unroeiehde.
tween tree eineuinter has been resterett se full operabiMy, the thref eseerner nGI eneterneine W the sceomene requires repeacement, may be resumedin proprose, er nuey be teeterned from the bogenning.
l 1
S l
1 I
J i
1 l
l - .
M 4
t l
ES-303 l.
Final Rev 8 Change Overview l
l t
r f
I i
, Purpose *A*
i Tne eteneerd eencrees the procedures for documenung en categones of
-l the opereung test, commeng me asia to arrwe et a pass or fed rew ~ . 2. and rows mg the socumentshan to ensure quemy.
i e
i i
i i Background *B*
l nm ==nas, ... : m we opersong =si w p,epe,eo ano i eennewred m accornance wnh ES-30t and ES-302, respechwety. '
. I in. proc.oures conte.nea ne.n team me menner io wueie ..cn I apose-ent s performerce on the operstmg test and mene e pengement es to i
+
wnetner tne sepacent s sevei or anowisope ena unoersanoma meet the i mmemurn reqmmeras to utiy operate the facety vor encn ine scense is i
, sought.
Tne eneminer eveauens each nowd ocreeney m none of the sowi bromotn of ano nesee ano sinniy o.monstreme my the appecent m snet suoinc.: I aree !
I I
i i i
! Responsibilities "C" li 1 1
l NRC Exarniner of Record (C.2) '
l l As soon as posstNo aner esminestermg tne test, tne eneminer of record
.nen rev w. . ewe. and sm.we .acn oppucenra . reing iesi
- alocumentation m accordance untn tne instructions m Sechon D.
1 If en appticent mesle en error wrth serious sekty consequences, the i
esammer mey recommend en opereeng nest fatture even er the I
preeNng instrucuens on Secten D ewould normelly result en a passmg l grenie. Unner such strcumesences, the enemmer shalt thoroughly justHy and documeert the beeis har the totture in accordence wrth Secten D.J.A.
Meroever, the NRC reponeloffice shell obsein avrtteen concurrence trem the NMR enerotor heensing program ornce bekre co.wng the beensing Octen.
i 1
1
- 4
(
l Grading and Documentation i instructions "D" j i Evaluate the Applicant's Performance Form ES-303-1. Category B (D.2.b) 9 J
- Ta determme a grade for the systems /JPMs hated on Form ES-305t.
evaluate eacn sencsoney coded m tne rougfi reies for Category B. If tne veno.ano cruena are met, ass.en a satsfectory grade by piacmo an s m )
tne "Evenuouon* coeumn for that syemm/JPM otnenume enter a "U : l I
Twne.crncal JPMs enust be completed wanm the ainotted turm. i i
1 1
Evaluate the Applicant's Performance Forrn ES-303-1, Category B (D.2.b) cont I
j Tne '
, -, tasksinneetanda,rd e o inefor theSt.,s.
cnio J,PM must be accompitsned by enrrectly l
. it tne appicent maesy erussed a criticar etep. but inter performed it I conectry and eccomponed tne task standard wanout degrading the canamon orine system ortne want.the appicant's performance on that l l ,
i JPM anould be graded a1 satisfactory.
l
' I wowever. ine .,umants er,or snaii .e docur,emed .ccord.nce --
witn Sechon D.3.
l l
t
! i i
f, Evaluate the Applicant's Performance !
Form ES-303-1, Category B (0.2.b) cont !
s The responees to any performence bened followwp questoons seeed pursuant to Section D.2.1of Es-202 must connem that the eppkcont's unnieresendong of the ayeserWJPM in settstectory.
l
, H ghe t%Newwp oueettone reveel that the applicant's l 4
undereseneng of the evenerWJPat is sortouery derscoent, the eueminer mey recommend en uneetnotectory prede for the ayenem even though the applicent succeenfuny compooned the i teek esonderd for the JPat. The basis for the recommendesbsn l shen be moroughlyjueened and documennedin accordence with
! Secuen D.3.
I Evaluate the Apphcanfs Performance Form ES-303-1 Category B (D.2.b) cont I
' 1 I
- convereely, u me applacent ed not accomphs N me sesk saanderd and toNow up questioning reveened that the feMure was ceueed by a deRciency in the procedure or some other factor beyond the opphcant's control, the esaminer may emil recommend a satsetectory ,
prede for the eyesemfJPM. ,
i '
' Once egeln, the bests for the recommendenen shen be thoroughly
- justined and docuenensed in accordence wnh Sectron D.3 f i
! i, I
1 .
l 8
i Evaluate the Apphcanfs Performance Form ES 303-1, Category B (D.2.b) cont After preOng the applicant's performance with roepect to all the l Category B syeeems, determone en overell prede for Cenegory B by ,
} l Calculetmg the percentage of setostectory system predes.
I W the applocent has en *S* en et seest 30 percent of the systems es:mmed. the appucent pessse Category B and receoves en 'S' overeII. W the oppiocent has en *S* en twwer men 80 percent of the '
tyetems, the opphcent fehe Corepory B and receives e *U* overeII. I i
Document the opphcent) grede by 96ecing en *S* or e 'U"in block B.
- C:ntrol Room 5yenoms and fecutty Welk-Through.*in the
- Operetong Test Summery
- On page 1 of Form ES-303-1. Enter *WE* ,
M thos cenegory wee wervedin accordence wrth ES 204. Docunent t
, cndfuenfy every deficoency in accorelence with sectron D.3.
. e f
I'
I Evaluate the Applicant's Performance l Form ES-3031. Category C (D2.c)
Osmg Form ES.3013 or ES.303 4. dependmg on the appicent's bcense tevet, evaluate any estcaences coced for Category C. Carcas the mtegrel retag vesue (t through 3) conospondmg to the beneviorsi ancnor that most occuroiety renects the appicent's performence. A rating of 't would i be justited r the opphcent trussed a crtucal test (te., by omassen or i encorrect performance) or commmed mungeo errors of Jesser sgnticence that heve a beenng on the tsung tector.
Messen one or more crnscal teoks does nor necessenly mean that the f sophcene wds s,..ennne e. fed thetr-n., s muleta tesi noreones co,,m.,emo .u,e succes,s craical taskl on every ned
. tn.; nos..ceni .
otner defoonces that m the saareaste. sisterthe fe.iure based on the '
l competency evesuelens An escussed m Esaot, competency 5 se ,
eptoonal ter 5MO upprence opphcente. However, the esammer ahall evetunee compeeeney 6 If the oppheent reentedinto en operating crew poennon thet required the opphcent to neenipusese tne centrole. l Docuenent andjustify every etenesency in accomnce wrth Secuan
! D.1
- 1 Finatsze the Documentation (D.3.b) l l
Denciencies that do not contribure to en opereong eest Category teiture shelleJeo be anocuenented.
l Nowever, a besef eensement alencishing the enur and the espected l ochen er roepenee 6e ponereoty outncoent.
l
! Exminers should keep in surnd that their 6scensing recommenenoon 6 an1 the essecessed elocumenessen are subyect to renew by the cheef f
egewner and NRC repdonal ofnce snenegeenent.
Therefore, the erecumenanteen shonest centern suffs' ient detail so that the endependent renewer, reopenstese supervesor, and Itcensong ofnisel can meere e logical decsonen in support of the esammer's recommeneleeren so deny or sssue the kcense.
~ .
l Finalize the Documentation (D.3.b) cont Retem rough documentaten untd the chief emanner end NRC regenet offici management have renewed the esenwner's recommencatens and concurred m the resulte (refer to ES-So1).
Exminers shell resein eIIappincekee notes and documentatoon eseociated ertth propeeed den 6els unal the dendals becerne final.
r Enerruners are advseed that such norea would be subject to l Ostlosuro it requented sonder the Freedom ofinformatson Act.
i l
r-1'
- \
I o t i
s I
Form ES-303-1 l 1
I l Individual Examination Report t l
l l ES 303-1 l
1 1
4 lP
. 4
?
I l
1 1
. . 4 er l 1
l 9
m I
f
4 Appendix C Final Rev 8 Change Overview i
I h
i I
Purpose *A*
Tnis Appenais prmes a vrameworn for prep.nng and ww.hng po performance rnessures (JPMs) to ensure they are of appropnate substance and format for edhal Operator hoensing and requehnceton i esamenshons. The famounng eternents are oescussed in oetail or attached j for WWormshon.
6 a pese proardure for seve#oping new JPus (seaan e), housing forms ;
to cocument the JPu and to assess the eushey of the procud (Fonn ES- ;
C 1 end ES-C 2)
. guisonnes for the seve6opment and use of enemate-patn JPMs (Secten C)
- e aiscussen of um.inrougn e,esuaten secrwueues (Seaen D)
.THE PRESCRIPTED QUESTION SULLET WAS DELETED t
i l
Development and Reviewing JPMs *B*
ALL PRESCRIPTED QUESTION DEVELOPMENT PARAGRAPHS WERE DELETED 6
0 i
l i -' '
I Attachments / Forms I
I i
ATTACHMENT 1, PRESCRIPTED .
i QUESTION SAMPLES WERE DELETED .
i !
i i
i i
e 4
4 8
e 0
9 0
TRAINING MANAGERS I CONFERENCE i
I
, NEWINSPECTION PROGRAM 1-l P l i j
< i
! l
~
\
i NEW INSPECTION PROGRAM
= The New Program Will Establish Baseline i inspections Common to All Plants
. Inspection Beyond the Baseline Will Be -
- Performed at Plants Below a Specified Threshold ;
- Prodcated on Performance indicators i
- -Inspechon Findmgs
- Response to spectric Everts or Problems
= Baseline inspections will Be Grounded on .
'Comerstone" Areas
. Focused on
- Risk Significant* Activities and Systems 4
. Focused on How Utilities Find and Fix Problems
. Focused on How Utilities Accept and Encourage ;
Employees to Raise Safety issues I
! NEW INSPECTION PROGRAM l c Major Parts of the Baseline inspection Program ,
i
. Inspect Areas Not Covered By Performance l
, Indicators '
. Inspect to Verify the Performance indicators
~
. Inspect / Review Effectiveness of Finding and ,
Resolving Problems (Corrective Action Program) oCORNERSTONES '
. Monitor Performance in Three Areas. ,
! - Reador Safety
- Radiation safety
- - securty ,
r NEW INSPECTION PROGRAM Comerstones i
, o Reactor Safety l
.i + Initiating Events ;
, . Mitigation Systems ;
. Barrier Integnty
! oRadiation Safety
. Plant Worker l l
- General Public , ,
j e Security '
j
. Physical Protection i l
l
\
l 1
New inspection Program !
Cornerstone Cross-Cutting Elements i !
- o Cross-Cutting Elements i
- Element that Effect Each Comerstone
- Human Performance l )
l i
! . Ability to Raise Safety issues I
- Finding and Fixing Problems ,
I i .
i i NEW INSPECTION PROGRAM i
Major Elements of the Basehne Program sThe Program is indicative and Not Diagnostic ,
- Program Delineates Specific inspection Activities
+ Inspection Findings are Evaluated for Significance !
. Diagnostic / Root Cause Determinations Done By Supplementalinspection Program 6
1 4
(
t i l
NEW INSPECTION PROGRAM l t Major Eiernent of Baseline Program '
o Baseline Program is Risk informed j
- Inspectable Areas Selected based on Significance from a Risk Perspective ;
- Risk Factor in to Program Four Ways '
-Inspectable Areas are Based on importance to ;
Measunng Cornerstone Objectwe
, -Inspection Frequency and Number of Actuties and i
! Trne Spend inspecting Based on Risk l
, - selection of Inspection Activtes in Each inspectable l
, Area Based on a Risk Matnx Modifed by Plant Speofic l
- Inforrnation 8
-Inspectors Are Trained in the Use of Risk information l
! a Baseline Program is the Minimum Program l i
f NEW INSPECTION PROGRAM i Cornerstone link to inspectable Areas '
.;2ll MgMM M M agggg is a m i l
- f. m--rY .i t
i l l l
i l
!. NEW INSPECTION PROGRAM l PERFORMANCE INDICATORS !
a lnitiating Events: l'
- Unplanned Reactor Shutdown !
+ Loss of Normal Rx Cooling Sys Following l Unplanned Shutdown ;
i . Transients - Unplanned Events that result in Rx !
e o Mitigating Systems: l
- Safety Systems Not Available l
- Specific ECCs j
- Emergency Power Systems
- Safety System Failures - l
I i NEW INSPECTION PROGRAM Performance indicators i
= Integrity of Barriers . ,
. Fuel Cladding (coolant activity) i
. Rx Cooling System Leak Rate I,
. Rx Containment Leak Rate 1
= Emergency Preparedness:
. Emergency Response Organization Drill Performance
. Readiness of Emergency Response Organization
. Availability of Notification System l
I I
- NEW INSPECTION PROGRAM i Performance Indicators
, = Occupational Radiation Safety:
, . Compliance with Regulations for Controlling
,' Access to Radiation Areas in Plant l 3
. Uncontrolled Radiation Exposures to Workers t Greater than 10% of Regulatory Limit j
= Public Radiation Safety: -
. Effluent Releases Requiring Reporting Under i ;
NRC Regulations and License Conditiens ;
1 i
1 NEW INSPECTION PROGRAM Performance indicators ,
= Physical Protection: l
. Security System Equipment Availability
. . Personnel Screening Program Performance i
. Employee Fitness-for-Duty Program Effectiveness ,
i
. i i
l l
I l
+
i l NEW INSPECTION PROGRAM :
t inspection Ffndings / Performance indicator Data l j
- einspection Findings
- Inspector Observations are Evaluated to '
. Determine Significance i
- Use Defined Process: Significance Determination Process j o Performance Indicators: ;
- Thresholds Set Regulatory Response I e - Example : l
- DrwEserene Perfomence .The percentage of au orill. esen;ise, i and actual opporturutos vm were performed in a timely and
- eir.onn i ,re . e.orii . ner, j j I
NEW INSPECTION PROGRAM i Regulatory Response l
- o '
- Significance Determination Process f Characterize the Risk Significance of issuo
.
- Each issue is evaluated and assigned a color Using a Process Flow Chart
- GREEN: Licensee Response {
-White: increased Regulatory Response '
- Yeuov Required Regulatory Response ,
1
- Red: Plant Not Permitted to Operated within this Band l I
i ,
I I NEW INSPECTION PROCESS PILOT PROGRAM
. i oTwo Pilot Plants Per Region d
- Sequoyah !
- Harris l e Pilot Program Commenced June 1999 1 e Full implementation of New inspection !,
l l
Program by April 2000 i
l !
l l -
V'OCLE AR R EG ULA ToD COMMISSlog L
p MANAGERS g t4\t4G C0t4FERENCE
, O f"% -
y e Q '
r I 3 e
I i
- /CN B Alb%'h i
4 4
9 Training Managers Conference Changes & Clanfications to ES-401. Part 1 I
. PREPARING INITIAL SITE SPECIFIC WRITTEN EXAMS
- D.I.D The oumne must be systematcany eesected. Snen not use the i este spearic KiA cataeog The Pierit %4de Generc (PWG) Tour 3 should ANT W1clude eyelem genere tasks. The topscs for PWG Teer 4 & 2 and the four K/A categones for Ter 3 Shad be seiscled from section 2, Genenc Knounedge end Ateinses from the KIA cataeog.
- D.1.c 10 ene-spec #rse K/As may repesco 10 systematic sampee esms, for metains or,6ssues, with basis and Cher Dermner approval.
e D.1 d Ensure outione samples at least every K/A area twee and the SRO sampses topics roowered by 10 CFR 55 43(D).
~.
5401" 8WR SRO Ememeneese Case *w e Farm f Ea013 i ersar Deen e8 Ed !
On Ener* Led i 1 1 e&A Cessgery Puents 9 iner l Game 9amt1 K K K K K K A A A A Gi Teesi 1 2 3 e* s 6 9 ? 3 4
- 11 1 % M **1 M"'b 24
- "mf* '
s re V W R% <s e-3 M& a = u 3
,'e::e 24? Ke
, , ,e .
29
%, 7 17 Svesene 3 4
{ ,7eer 40 e 1
- 3. Gene = une.neeve one amanes co's ces t ' cet3 l Cara 9 l i
i t
Training Managers Conference i 5
Changes & Clanficatsons to ES-401, Part H ,
i
- D.2.s une esenne. mesmed or new questens. if seveten from i-suemnted osmote e necessery secuss wan tne Cruef. Se etse
! to ensues why sne change was necesserf. Document these reasons.
l e 0.2.c Tne wrmen esenunehen $$ be S40% tugher cognawe arcer esms. (NO more os) i i e D.2.d The SRO eniy eusemens on en esem must be et the SRO esvel.
! not just euestons et the ROlevel. These eheuld be esentuted
- amongst se 3 tiers.
t .!,
l . !
l t
Training Managers Conference Changes & Clanficatsons to ES-401. Part HI f
j l
e 0.2.f Metehe e.__ __ -__ ; may NOT have any overtop or reuse Iloms Wem the teded hoense esanunehen l
, Ne overtep bomseen NRC u. __ .-. . and autt unless J meopenseney seveteped. Then oney 5 queshens esemed.
Repest of ONt.Y 25 gunshens from emot 2 NRC emanunehens and elems used ei trening. ,
e D.2 g Faciley teemmg thpochve references are encouraged but not requered. ;
ff teamen espectw ine .we s.on ,,ove.os ed aare hasnot sveiletMe, e,p,- a and th.is does not envahdate techn.cei ,
i re%eences. l 4
I I
i i
Training Managers Conference Changes & Clanfications to ES-401, Part IV -
l
_ i i
e 0.2 g The draft ossmmation must be recewed at toest g says before ine enenensuon. i I
e E 2.e NRC unit review and get supervoory revew before discussmg unth licensee.
3 .
- E.2.c The NRC wliperform a 30 aueouon sempae revow. vail revow i all new plus modded, Questeens. N requered. The sempie will j mciuoe 10 new and 20 meeWed questens. (All 125 euestens will unsergo a revow.)
I Questens pronously reviewed and approved by tne NRC for
. that facsiny tail have kmned revow for unacceptetpe Sows per E S.4019 e
r l
Training Managers Conference - i -
Changes & Clanficat#ons to ES-401. Part V ,
I I *
- e E.2.C ff fN sempio shows toss men 6 mems are unacceptolpe. Gete.4ed !
remow of the ress of the esammehon win comanue. If greater then e.om.n 6 Mems on , are we found eneyunacceptetue,
- .3,ew,ew ww.ew NRC MAY w usereturn.the es- -
f' e019.
' {
If the esammsteen is retumed, we espect that the hcensee l l ,
t compCl me e$entihed flows and those iske kmd f6ews that were not 1 i
. iidentfad to me rest of the queshons. j
- e E.3 e The NRC Supermeer MUST remw and approve et unecespistne them esmments e E.3.b The NRC suponnsor WILL renew and approve each comment
, that would reeuwe the hennese to rework e NRC-veisdated I gueshon. (Pronounty used lost sems )
l
.ue,.
, _n a- a u ,.
e e.weseneet , .
i
.e. ,4 .. .- .
.~ - ~Li . -- ,l .
-I . . --. .
l.
,..a...._._-....._-
- ~= ._. :..=~:: ._ . _ _ , I J.,.: :
=___.:.$=.f_._=.
n:-- - = .:. . v ~_ :==::.=. _~._ .: ... : -~.~.'
1
- :=. _:.'
a.. .
4 _ ..- .._ .
<.v-..~. - _- .
Training Managers Conference ;
Changes & Clanfications to ES-401, Part VI '
.c. ,m. d..on o,0.o,,w,. ten .he,-etmg c,,enges s recommenced but g required.
I e Art.1 Desenties en acceptelpe sempemg mettedoeogy for systematic ,
s04eCisen for me wftten outine.
e Form Moened vereen of the forrn premdes tsients to record test hem ,
401 7 count for reuse from the emot eserrunonons, the source of the l
questens and the cognEsve level for the questens for the esammaton '
I e Form Wniten esammaten Review Worksheet, Used to keep track of I e019 esmated euestens I
I
~
. .. - ,- euoi., ;
. . o rc e
., .- - . ..- - s , .-
- 1
, ~.
, l
.- - ~_ - 1 s- ..
- 1 wnor.
a sse r.- - - i j
1 l ;
L
~ D.es.. _W -.-l..
, .. . - ~
.a e a g G,.
- s. .s. , e.t
.I 4 u.h
-~ - _. .. .
, .. .- -.n- l i'
I Training Managers Conference :
I Changes & Clanfications to ES-402. Part I j ADMINISTERING INITIAL WRITTEN EXAMINATIONS i e c.t.a The noensee has to me.niam securey ofine e.ammaimns.
e c.t e The nr.enese may use macame-grade e sheets not not
. required.
e c.2 a The 6censee . amowed to adnunasier en NRC covedoped l e..m.n.imn i l ;
. c.. . on . ..e o,. . r mm. .re, wr n e. ,. tne NRc usT e
.e ., ,none.
..nen ie,e. .ny
.uie, uRc 30 e won.n .,,, i. ine wni,en
- orine e,e...n may
.n ie.t i I
l l l
l Training Managers Conference Changes & Clanfications to ES-402, Part il ,
ADMINISTERING INITIALWVRITTEN EXAMINATIONS j i
eD4a New eme kmn for tne wrmen is 5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br />. It can be e tenced by 30 mmute mcrements wan PRIOR NRO approval. Tne new wne ama snould not change ine oevelopment process. ,
eE4 LJoi 2-. snauid submn formal comments wnne 5 woriung cays ofier tne wmien o.ammation is admmistered.
1 I
l
. i
> I Training Managers Conference i a
l 1 Changes & Cienficatens to ES-403 GRADING INITIAL SITE SPECIFIC WRITTEN EXAMS l l i e C t.b tf-NRC sevo..ng. toped... 6e.ennes has .n res.ponsemeny to subms comments t
i e C.2.b NRC mey seewthe scensee to meenme grees a NRC devemped
.rmen u _ l l ,
o D.1.s De N,!QT deeme any eusehen or change en answer wehout a vehd f romvence unreseenstes or unesened ensumphens do not justify e
.ange.
- se e D 2.eon copy. eneach maappteenra sa .enimeenswer .,e nesheet,
- d. and.e.t essee. Do N,d,0T mark t
6 e 0.2.d W you seese to one,e PastwimARY greou so so witn cauten.
The NftC MAY NO1 accept ou e bonnese's changes.
l I
Training Managers Conference
- i Changes and Cienfications To Appendix B l Wntten Examination Guidelines, Part I
- '. C.i.e w4, t- o.,s e e,s .o.,ed.
- Tte. . e en.e. em 1!Ehd. to at-,e, -
! . C.i.. M su.e e .us.en es e weni or.e wa.
i e C.S.c o ssnamenen venmey to eenned. * .the ney purpose or any wet !.
.m.e.i ngmehes e.s. . o.. and u s.soi e, ween e . was . . .e.ei cs,..-
i
. e-ni.en ,e.u,,es su.,e e iu. gen,eni m -notn, the elem and $stractors. '
I l e i i i I
t
- Training Managers Conference Changes and Clanfications To Appendix B i Wntten Examinaten.Guidehnes, Part 11 i e C.2. Museos Cho r.e ausehens wtuch reques the *MOST CORRE CT- >
, snower e,e g snowed. Use a procedursi refe,ences .
. C.2.f As the Wormaison in the stem should be redevant. (Don't psey find the rock.) Don't med secondary peces of enformaten en the stem .
that are not relevant, en orser to make the questen look mnre awrcun. l
- l l e C.2.n use of genenceny correct answers . amowed. but tne stem nosos j to to wreen such.et the stem makes them cseerly enconect. ; ;
- e l
1 l l
l
b ES-501 INITIAL POST EXAMINATION ACTIVITIES fY%s y
)
l D. Charles Payne August 13,1999
~.
ES-501 j
l
SUMMARY
OF CHANGES o Supervisor or manager shall confirm grading
- quality and sign OA sheet.
4 l o CE independent regrade for 78-82%.
o Potentially hold passes 80-81%.
o Exam report content more clearly defined. ,
e PDR records defined. I o New letter for delayed results.
l l
=.
l ES-501
' 1 o C.1 No changes to facility requirements. j
~
o Note that clean copy of written exam answer sheet is expected to be provided.
e C.2 No changes to regional requirements.
o Note criteria for determining written exam validity following post-exam comments.
o S% changes / deletions 4 facility explanation.
, c 10% deletions 4 evaluate adequate sample.
l
ES-501 c D.1 Facility management exam reviews.
l a Supervisor or manaoer shall confirm quality of grading is licensee graded written and sign ,
OA check sheet. Used to be " authorized facility representative "
I o Signed QA form represents facility senior
! management concurrence with Individual l and collective exam resutts.
t I
1 i
ES-501 l
e D.2 Chief Examiner reviews.
{ o No post-exam change will be accepted 6
without a valid plant reference. Uncontrolled l lesson plans are not acceptable.
! o Verify answer key used as template or to j machine grade written exam is accurate.
o independently review every borderline written exam (78-82%).
l i l
l ES-501 1
- a D.3 NRC management review, a Pass letters for applicants _who passed exam but licenses are being withheld, e If pass written exam with 80-81% and another applicant fails., will hold license until assured pass / fail decision not affected.
, a For delayed licenses, shall ensure still medically fit within last 24 months, not developed permanent physical or mental condition, and up to date in i requal. '
, e if > 3 months pass, advise licensee to properly {
retivate license per 10 CFR 55.53(f). 4 i l
t ES-501 I l
1 j
\
j o E.1 and E.2 No significant changes.
, o Region still will retain EOPs, AOPs, E-Plan i
and Tech Specs for incident response.
o E.3 Exam report documentation. Some I significant changes. j l
o Previous revisions stated generic exam i )
report content requirements. Rev 8 spells l out specific types of issues to be included.
j
! .! I i
l ES-501 i i
i e Factual description of test item changes !
l including type and number of psychometric l enhancements made. j l o Conclusions regarding adequacy of facility
- proposed exams are not reouired and should I only be considered if have a programmatic ,
! issue. l i
i l e Any delay in administering the exam and the l rzason, and any extensions of the written )
exam time beyond five hours, j '
a Any exam security issues / incidents.
i.
I t
ES-501 l o All simulator deficiencies encountered while l l : preparing or conducting operating tests will !
l be documented in Simulation Facility Report. .
, o Generic comments submitted by licensee rzgarding exams or the process are welcome and will be included in exam report. These r
do not require regional response or resolution. '
, a Region will ensure SRO upgrade applicants that fail exam still comply with 10 CFR 55 i before resuming RO duties.
l I l
4
. ES-501
, o PDR records will include the following: !
- exam outlines ,
- draft and final written i
- draft and final operating tests
! - cssociated QA check sheets I -
"Other documents" i i
l ointermediate working copies not needed to !
I be sent to POR unless provided to facility l licensee to facilitate communication, l ;
l I i
i I e
e l
l l
l l
l o
6 0
I l i
! ES-502 _.
1 PROCESSING REQUESTS FOR ADMINISTRATIVE l REVIEWS AND HEARINGS AFTER INITIAL j I
LICENSE DENIAL ' '
i !
+ en aeq%
(W),, !
\
j D. Charles Payne
{
August 13,1999 '
l l- ES-502 i
SUMMARY
OF CHANGES I .
I
= Reorganized to remove detailed sample letters and administrative review procedures.
New section noting expectation of facility
{ = licensee support during appeals.
! = New section to better define NRC !
- responsibilities. l
= Administrative review process streamlined. ; 4 I
i i l
- . 1
~
i
- . t
! ES-502 i o C.1 Applicant responsibilities. No changes. l' o Has 20 days to act on proposed denial. Has 3 options: l l
- 1. Do nothing. . j i 2. Request reconsideration.
- 3. Request a hearing.
o ff application denied because of training or :
- experience, can reapply when corrected. '
t I
r e
I
- ES-502 ,
i = C.2 Fab,ility licensee responsibilities. New section.
l = Facility is expected to provide reference !
r '
materials and technical support as necessary ;
! for NRC to evaluate and resolve concerns !
I raised by applicant. '
i i
= This includes organizationally supporting the l response provided in the answer key.
l
. . 1 l
1 I
ES-502 i i
l o C.3 NRC responsibilities. New section but no
, new responsibilities.
l o Splits out our responsibilities from mechanics j of the review process.
! e Application denials will be processed per D.1. l
, o Admin reviews will be processed per D.2.
, a Hearings will be conducted per 10 CFR 2, subpart L. ;
4 i
+
i
! ES-502 i
o D.1 Application denialadmin review. !
o Not many have occurred in Region ll. But be i cautious of potential outcomes should one be -
required.
- a HQ gknerally will complete the review within !
60 days. ;
o Since draft applications are not due until 30 ~
i '
days before exam, any issue with eligibility post likely will resett in the appi; cont missing the scheduled oxam.
i
r i
i l .
l l ES-502 l
, e D.2 Exam failure. Some minorchanges.
! o Detailed administrative review procedures cnd sample letters have been removed and f incorporated into separate intemal NRC l documents.
l c Added option to review the appeal intemally ctHQ.
{
j e HQ chooses how to process the appeal.
! 1. Can reviewinternally l 2. Can refer to affected region
! 3. Can convene an appeal panel -
l O
e k
as O
i
i l
\IMatacartcA%.\
! l.
i
,s# ** s,
}
i l
T1EISSUE !
l Is it an acceptable practice to readminister an
. identical examination to separate errws that
'. have been separated in time over the finite testing period of the biennial written exam ?
i .
i I
'j 1
MAJORISSUESREVOLVING AROUND REPEin1VE USE OF TEST H BIS TESENG E6ECTTVENESS !
i
> Do you have a testing practice that measures '
up to sound and accepted principles of testing? j
> Are your examination conditions (size scope, i I
discrimination quality) relath ely uniform i among crews.
l
[
F l 1 l l l
l i DEFINITIONS i i u DISCRIMINATION VALIDITY - '
I i i O TheabilitytodisenninateortomakesGne !
l i distinction along a contintnzn of exarmnee i perfonnance to detemune whether or not your i
operators have sufficiently ' mastered" the knowledge, skills, abilities, and other attnbutes to perfoun theirjobs.
i l i
l l 0 PREDICTABILTIYOFATEST- l l
o The ability to forecast or anticipate the test items' I
- or topics that will appear on an exammation. j _
i 1
l i o Previouslyadministered testitems riduce '
l examination integri because examination 4 discrimination is uced. .
i :
I o When the bank ofitems is known or anticipated ,
i prior to the examination, the exam is h bly predictable. Discrimination is reduced use l
4 i the cognitive level at which the examinees are :
I tested could decrease to the simpic recognition l 5
lent. j
' o To assume that the capability for items within an examination to discruninate, over time, in the same manner as those items discrrninated on the first and second examinations is naive.
l l
1 n,
F l
j QUESTION ,
i, e ,
, i
+ How does excessive npetitive use of ,' '
i test items over a short inten>al of time affect examination validity ?
1 i
f l o If the examinees know or can anticipate the i precise and limited pool fmn which the test stems will be drawn, they will tend to only ;
study from that pooland maylikel i a larger domain ofjob knowledge.y exclude O When high percentages of test item ,
duplication takes place (e.g., >50%), the '
i discriminant validity of the examination ,
i comes under question, j o Successiveadministrationsof thesameor i
- closely sandar examinations to different l' crews over the period em'ering the biennial written exam raises the potential for .l
. comprunising examination integrity. ju GOAL i
l -
- o Achieve uniform testing conditions !
- among crews as best as can reasonably j i
be achieved so that the exam will be a :
reliable tool for assessing operator !
l competence.
I i
i i ACCEPTABLE l
! PRACTICE !
> To minimize the potential of reduced
~
discriminant validity, a 50% portion of any readministeral examination should consist of
, a replacement of modifial or new items of like kind content, mychometric attributes, l and difficulty leve s. Morrever,when items !
are to be repeated arnong successive erre, -
l they should be repeated m a distributed i manner and approximately equally over all
( ! previous exams so as to reduce pralictability of a disproportsnately large number of item coming form the most recent examination.
l
i
SUMMARY
i o Succesive administrations of the same biennial ualification examination to different crtws j them requalification trainingis unacceptable. Thiswould seriously
- questen the disenminant validity of the exam.
l o When the content to be tested becomes highly
- predictable, and the boundaries ofchat will t hkely be tested are known to the candidate, then j the candidate will likely prepare ONLY to that leveldemanded by the examination.
' o Improper practimswilllikelylead to an
! erosion of and long tenn declinein '
l operator performance.'
l WHY !
j YOU MAY ASK 7
' l
>- When testing is diminished in level or
, ommitted in kind, knowlege degradation
! occurs.
i . > The subtle but important coerrion implicit in
! piiparution for an examination is lost.
- > Attention will be focused on what leads to visible success fora candidate.
l > The loss of specific content anea study can itsult in knowlege gaps that cause operator i
errors.
O
i ES-601/602 i i
CONDUCTING NRC REQUALIFICATION EXAMINATIONS ,
- NO SIGNIFICANT REV. 8 CHANGES e REACTIVE INSPECTION / EXAMINATION
- SCOPE DETERMINATIONS BASED ON:
i o PLANT PERFORMANCE I o INSPECTION PROGRAM RESULTS o INITIAL AND REQUAL RESULTS o OTHER FACTORS l !
t l ES-601/602 CONDUCTING NRC REQUAL IFICATION EXAMINATIONS 1
o NRC CONDUCTED OPERATOR REQUAL EXAM COMPOSED OF THREE PARTS:
o TWO SECTION OPEN-REFERENCE WRITTEN o PLANT AND CONTROL SYSTEMS l o ADMINISTRATIVE CONTROLS / PROCEDURAL UMITS
{
o WALK-THROUGH EVALUATION o DYNAMIC SIMULATOR I l l
l ES-601/602 CONDUCTING NRC REQUALIFICATION
- EXAMINATIONS '
i o EVALUATION OF REQUAL PROGRAM l i
AND OPERATORS :
o MINIMUM 12 OPERATORS REQUIRED -
i o 3/4 OF OPERATORS MUST PASS EXAM o 2/3 OF THE CREWS MUST PASS THE i j
SIMULATOR EXAM ;
i I
B l
i
- ~%,"A !
l Licensed Operator !
l Requalification l t'
Inspection Procedure 71111 REACTOR SAFETY-INITIATING EVENTS, MITIGATING SYSTEMS , BARRIER INTEGRITY j 3 Attachment 11 l
1 l
l l
l lNSPECTION OBJECTIVE !
l c To independently gather baseline inspection indicators to determine whether licensee performance meets the following comerstone
! objectives: l 1
l '
i l .
l l l e hitiating Events: To limit the frequency of l
) 8 those events that upset plant stability and l ,
challenge critical safety functions, during i shutdown as well as power operations. i 1
o Mitigating Systems: To ensure the availability, reliability, and capability of ,
systems that mitigate initiating events to !
prevent reactor accidents. i e Barrier integrity: To ensure that physical ! 1 barriers protect the public form radionuclide i 1 releases caused by accidents. ;
1 ,
l r i 1
i
! REQUAllFICATION j CORNERSTONES -
j = Mitigating systems (75%)
Barrier Integrity (25%)
=
l i .
l f inspection Bases i
e Inspection supports cornerstones because it can assess operator performance adequacy j in responding to events. This inspection evaluates operator performance in mitigating the consequences of events. Poor operator i performance results in increase risk due to the human performance factors terms, and assumed operator recovery rates and i personnelinduced common cause error rates assumed in the facilities IPEs.
1
. I l
l lNSPECTION AREA VERIFIES:
I o Procedure quality and human performance which are both key attributes of the Mitigating Systems cornerstone for which there are no performance indicators.
, o Human performance which is also a key 1 attribute of the Barrier Integrity cornerstone
! for which there are no performance l indicators.
i J
l l
f l
l
<l l
\
i l l I I !
i
!- PROCESS OUTUNE i i i i i I
MW i
Meim, eymem k
i
- e- --- ,
gw
_~ f,kL-- .ie ws -h d
- w ===e m )
mnu a g~ ..
i w .me g g_ _ ~& ~'=}=
1
_L
,a -J
, -q l
. , . - .. . .. : .' . 'A l
i l
l l
l
~
l
~.
e-e er
FY 2000 REGION D EXAMIN ATION SCHEDULE Revnect Autuu 6 1o99 Dat. Facihty Number of Type of Activity Chef Examiner Exanunanon Author Docket Nn C8"dtdPas 9/27/99 Catawba 3RO Retake R. Baldwin Licensee 50-413 1SROU 10/4/99 Hatch Irunal Prep C. Payne 50-321 10/18/99 Hatch 10 SRO! Irunal C. Payne NRC / Licensee il/l/98 50-32l 2 SROU 11/8'99 Crystal River Requal Inspection G. Hopper 50-302 11/6/99 Browns Ferry Requal Inspecnon C. Payne 50-260 11/29/99 Sequoyah Requal Inspection L. Mellen 50-327 11/29/99 Vogtle Ininal Prep R. Baldwin 50-424 12/6/99 St. Lucie Requal Inspection G. Hopper 50-335 12/13/99 Vogtle i RO Initial R. Baldwin NRC 50-424 3 SROI 2 SROU 1/10 2/14/00 Farley Requal Inspection TBD 50-M8 1/10-2n/00 Turkey Point Requal Inspection TBD 50 280 1/24/00 St Lucie Initial Prep TBD 50-335 1/31/00 Brunswick inidal Prep G. Hopper 50-325 2n/00 St Lucie 5RO Retake TBD 50-335 1SROI 2 SROU 2/- 3/00 North Anna Requal Inspection TBD 50-338 -
2/14/00 Brunswick 12 RO laitial G. Hoppe r NRC 2/21/00 50-325 4 SROf 4/24/00 Farley Inidal Prep M. Ernstes 50-348 4/24/00 McGuire inical Prep C. Payne 50-369 _
5/8/00 Farley 6RO Irunal M. Ernstes Licensee 5/22/00 50-348 6 SROI 5/8/00 McGuire 6 RO Inidal C. Payne Licensee SC2/00 50-369 2 SROI 5SROU 5/29/00 Browns Ferry Irutial Prep L. Mellen 50-259 6/12-7/14/00 McGuire Requal Inspection TBD 50-369 1
l .
D t2 Fac!hty Number of Type of Activity Chief Examiner Examination Author Docket No Candedstes 6/12/00 Browns Ferry 10 RO initial L. Mellen NRC 6/26/00 .50-259 3 SROI 3 SROU 6/26/00 Oconee Initial Prep G. Hopper w?4o 7/10/00 Oconee 8RO Initial G. Hopper Licensee 7/17/00 50-269 2 SROI 3 SROU 7/24/00 Sumrner Inidal Prep M. Ernstes 50-395 7/21./00 Sequoyah Initial Prep C. Payne 50-377 8/00 Hatch Reaual inspection TBD 8n/00 Summer 8 SROU Initial M. Ernstes NRC 50 395 8/7/00 Sequoyah 5 RO Initial C. Payne Licensee / NRC
. 50-327 4 SROU 3 SROI 8/14/00 Crystal River trutial Prep TBD 50-302 8/28/00 Crystal River 3RO Initial TBD Licensee 9/11/00 50-302 3SROI 3 SROU 8/28/00 North Anna laitial Prep R. Aiello 50-338 8/28/00 Sorry initial Prep R. Baldwin 50-280 9/18/00 North Anna 7 RO Initial R. Aiello Licensee / NRC 9/25/00 50-338 i SROI 3SROU 9/18/00 Surry 8RO Initial R. Baldwin Licensec / NRC 9/25/00 50-280 2 SROI 3 SROU FY2001 11/13/00 St. Lucie . Irunal Prep C. Payne 50-335 11/13/00 Turkey Point Initial Prep G. Hopper 50 250 11/27/00 Harris Ininal Prep M. Ernstes 50MD 12/4/00 St. Lucic 4 SROI trurial C. Payne Licensee 54335 $ SROU 12/4/00 Turkey Point 16 Initial G. Hopper NRC 12/18/00 50 250 l 12/11/00 Harris 3RO Irutial M. Ernstes Licensee
)
50-400 2 SROI 3 SROU f
3/26/0P Robinson 7RO Initial TBD TBD 50-261 5SROU l
l l
L
{ l l
D:t:a Facihty Number of Type of Actrvity l Chief Examiner Examination Author Docket No Candidates 4/01 Vogtle 16 Initial TBD NRC 50 424 4/01 Catawba 18 Initial TBD Licensee 50 413 5/01 Watts Bar 7 RO Initial TBD Licensee 50-390 3 SROI 6SROU l
I I
I l
l e
Y t
, i
~.
l I
l
4 TRAINING MANAGER CONFERENCE
~
August 1213,1999 COMMENTS / QUESTIONS A. Written Examination Questions:
- 1. The most common issue falsed by Hot Ucense Candidates and Requal license
, holders. surround the issue of " trick questions" and operator written exams not being a fair test of operator knowledge.
- 2. If INPO creates a national initial licensed operator exam bank, will the NRC consider the INPO bank to be current questions that cannot be used as new questions on the exam to be developed? I
- 3. Do not feel that the written exam is a discriminatory tool. How many people do poorly on the written exam that are not weak on the operating test? Let us use !
our process to take care of the written with our audit exam.
- 4. The utilities should.b_lQT be the ones to develop the sample plan. This should be developed by the NRC for all examinations administered in the region.
- 5. NRC needs to understand that increased difficulty of exam process is a negative motivator and could be a distraction to competent Board Operators -
" Recommend Survey to Understand Scope and Potential Impact on Safe Plant i Operations".
- 6. Evaluate changing initial exam grading to a curve for pass / fail.
- 7. Exam difficulty his gone beyond reason and is impacting the Requal program.
People are not willing to put up with the hassle and it does not result in better Operators, it is impossible to meet question standards and avoid " Tricky" questions, very knowledgeable operators can appear less that competent based on complexity of question rather than a test of knowledge.
- 8. The NRC Exam has become an exercise in exam taking skills instead of a knowledge assessment.
- 9. Would you comment on the following proposal ? Have a " team" from the utility come to the region and work directly with the chief Examiner to develop the written exam. I would propose that a team of experienced utility instructions could bring the exam bank and associated reference material and they, with the chief, could produce the written exam in less than 40 hours4.62963e-4 days <br />0.0111 hours <br />6.613757e-5 weeks <br />1.522e-5 months <br />.
1 Enclosure 3 l
L
l 2
l Benefits - lower man hours cost, reduced security concerns (less time on site),
- fever negative exam report corrects.
1
- 10. If the utility is producing the written exam, when (how may days / weeks) is your expectation for the chief to get the sample plan to the utility? The point is - getting the sample plan in accordance with NUREG 1021 will not work.
I
~
- 11. In light of the NRC's new goals of reducing unnecessary regulatory burden and increasing efficiency and effectiveness, would it be possible to allow a licensee to build an initial license exam entirely from the bank (rather than 50% new questions), assuming the bank was an appropriate size and security concems could be solved.
12 The examine process seems to be getting harder as compared to a few years ago.
13 Once we use a comprehensive level question does it become a knowledge base questions the next time we use it.
- 14. We may want to have an exam writing workshop.
B. Operatina Examination Quertions:
- 1. The continuous racheting of expectations is bypassing the SAT process. Example -
Cannot use a high importance JPM because it is perceived to be too easy, and operators are trained and tested on it.
- 2. Current subjectivity on what is a discriminatory JPM with the removal of the questions.
. 3. Need Region Workshops to calibrate us on future JPM direction.
- 4. Why can't the selection of JPM's for the Ucense exam be driven by the SAT process and K/A value? " Low discriminatory valve" is a euphemism for "too easy" and as a result, the difficulty of the exam is racheting up to an unreasonable level. This is contrary to the NRC stated goals.
- 5. Open Reference Tech Spec. -its too complicated to memorize. Tech Specs should be open reference or better yet covered by Operating Exams (JPM). We do not want our Operators to spend valuable time memorizing ITS, nor do we want them to operate from memory.
- 6. Operatina Exam - Section "A" Admin. (Catecorvt This " category " of the new exam process needs to be integrated ~into the written and JPM (walk thru) segments, and l eliminated as a separate entity- only a couple of areas are examined, with no margin for l l error! An individual can scope high on the written exam, do excellent on the simulator, Enclosure 3 I
l
3 and pass all of the systems JPM's yet fail to get licensed due to not passing a couple of admin " questions"- the knowledge and/or abilities could easily be included with other exam segments.
C. Licensed Operator Experience Questions:
- 1. What aie experience requirements for SRO/RO?
- 2. For a SAT-based program, what and where are the requirements for " responsible power plant" experience?
3
- 3. Question- Experience Requirements 3 years 1 year 6 months on site What are the real requirements if you have SAT based program?
- 4. " Responsible" Dower plant experience e This issue needs to be resolved e INPO, NRC,' NEl need to determine the specifics and let us know.
e We need to know without reservation that SRO-Instant Candidates meet this ambiguous " experience" requirements prior to them entering a license class.
D. SAT Proaram Questions:
- 1. What is/where do I find my " Commission Approved" Training program?
- 2. How familiar are, and what kind of training have the examiners received on the SAT process? How familiar (knowledgeable) are the headquarters management on the SAT process? What kind of training have they received?
E. Reactivity Manipulation Questions:
- 1. 10 CFR 55.59 - the use of SAT based program vice Regulatory based programs. Why do you have to track individual control manipulations if you have a SAT based program?
- 2. " Control Manioulations" in Reaual - a prior guidance from previous NRC meeting clearly indicated bean counting control manipulation from the Denton letter was a thing of the past - SAT based requal training would naturally contain a large portion of the annual / biennial tasks and evolutions, therefore, program participants would be involved during simulator training / evaluation, and/or annual Op. Eval. JPM's; " individuals simulator critical tasks" went away and " crew critical tasks" were required.
Enclosure 3
n 4
Teamwork / communications command s control /by the team was the most important.
Bottom line - the implied expectation expressed on 8/12/99 is not congruent with that
- provided in 1989 by T. Peebles, S. Lawyer, and others who provides us guidance it appears that we are retuming to the middle to early 80's again.
- 3. Reactivity Manipulations: 1) For ILO training what is the status of allowing simulator manipulations. (when unable to perform In-plant): also, define (What constitutes a control manipulation); why is a rod operability surveillance ok at one plant but not another?
What constitutes a large change? 2) For LOCT - INPO's policy for tracking manipulation seems to be in conflict w/NRC requirement (INPO doesn't require tracking on individual basis).
F. GFES Questons or Concerns:
- 1. 2000 GFES Dates: Licensee have developed schedules and allocated resources to participate in a April GFES. Changing to a February, June, October schedule would be disruptive, perhaps a April, June schedule for 2000 would allow for a smooth transition (others Licensees made some comment).
- 2. In order to facilitate transition to administering 3 GFE/ year, is it possible to consider administering exams in April, June and October during year 2000? This would minimize the impact on utilities that already have an exam scheduled. If implementation occurs in FY 2000 and exams are given in February, June and October (as proposed),
unnecessary burden on these utilities could result.
G. Miscellaneous Questions:
- 2. When evaluating SRO success in " Classifying the REP" during the operating exam, what criteria do the examiners use for, when to start the 15 minute clock (expectation)? (15 minute from event to classification)
- 3. Use of instructors is still an issue. The use of an instructor, who is on the exam security I agreement, can't teach candidates attending the Requal program. This is an unnecessary burden on resource restrictions.
- 4. is there some way to do a better distribution of clarifications / rulings from one site in the !
region to another? This would help all of us meet your expectations.
l l
l
., Enclosure 3 L