ML20196G901
| ML20196G901 | |
| Person / Time | |
|---|---|
| Issue date: | 12/01/1998 |
| From: | Grobe J NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION III) |
| To: | Caldwell J NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION III) |
| References | |
| NUDOCS 9812080146 | |
| Download: ML20196G901 (33) | |
Text
_ - - _ - - - _
- . - . . - . . - - ._ _ = . - - . . -
+
i December 1, 1998 i
MEMORANDUM TO: James L. Caldweil, Acting Regional Administrator FROM: John A. Grobe, Director, Division of Reactor Safety
SUBJECT:
PRESENTATION TO MIDWEST NUCLEAR TRAINING ASSOCIATION On October 27,1998, Mei/yn Leach, Cbief, Operator Licensing Branch, gave a presentation at the Eleventh Annual Midwest Nuclear Training Association Instructor Workshop in Columbus, !
Ohio. The presentation was entitled
- Operations and Operator Licensing." The topics !
addressed included: why the operator training program and licensing process is important, the ;
l current status of changes to the licensing examination process, the need for operator training l to reflect performance expectations, and some attributes of an effective operator training l program. Within the area of an effective operator training program, the validation process for questions and a question with obvious design flaws were discussed.
The presentation was attended by a cross-section of representatives from nuclear plant :
l licensees both from within and outside Region 111. The presentation slides are enclosed.
i
Enclosure:
As stated cc w/ encl: R. M. Gallo, NRR j PUBLIC IE-42 :
CONTACT: M. Leach, DRS l (630) 829-9705 I
/I
(
l
- DOCUMENT NAME
- G:DRS\ TRAINING.WPD
- v. . .m. - m c . c ~ .n c . c . --* r . c.
OFFICE Rill E Rlli F l
- NAME Leach
- jp /MV4 Grobe A DATE 12///98 12/I/98 OFFICIAL RECORD COPY 9812000146 981201 ,
, PDR MISC '
9812000146 PDR i
- I
Operations and Operator Licensing Melvyn Leach, Chief Operator Licensing Branch Region Ill 4 O - - - - -- - -- -----
Topics
= Why the operator training program and licensing process is important
= Current status of changes to the licensing examination process
= The need for operator training to reflect performance expectations Some attributes of an effective
- operator training program
Importance of operator training and licensing We believe all reactor operators must have a firm understanding of conservative decision making and
a proper regard for reactor safety.
o This understanding is not importa "'
just during response to a crisis but is important during every shift of routine operations. _
Probabilistic Risk Analyses show:
= Avoiding a potential initiating event poses less risk than dealing with the event.
= Terminating the event early through
- the use of abnormal procedures poses less risk than allowing it to develop into a reactor trip.
.l Why NRC involvement in operator licensing?
= Licensed operators are part of defense-in-depth
= Atomic Energy Act of P "
- 1954 requires the NRC ,_~
to prescribe uniform L)
- licensing conditions u -
I ')
_ _ _ _ _ _ _ - _ _ _ _ _ - _ _ _ _ _ _ _ _ _ _ _ _ _ _ - _ _ _ _ _ _ _ - _ - _ _ _ ____ -__ - - - ?
~
Change in the examination
= If approved
-facility licensees prepare examination
-submit to NRC for review and approval
- NRC administer operating test
- facility licensees administer written examination
- CRGR raised backfit question
.i Examination process transition
= Facility licensees and the NRC may have underestimated the challenge without affecting
- quality
- difficulty
- consistency
= NRC has worked with NEl and facility licensees to refine the process
b Public and NRC staff comments include:
= Personnel restrictions for examination developers should be reduced
= More guidance for level of difficulty
= Crew composiiton should be the same as normal operations Systematic outline process Time limit increased for written examination ~
. t I;I! : Ij1l i l 1l1ll : I!
i .
s -
n _
e
_ i o _
t
_ a -
i n .
m -
_ a /
/ ,
x z/ /
_ E .
7'x:
_ t o e o /4~
l r i
P mid s
f o s gs sa l
eyn n nv s cl i obaivioeoy t -
pr aiaeaa t t t l
l r n l u i s amieiinc e pi r nl e b mc l
m b m n R a osixaea x c h VCdeWet e i
=
Examination difficulty Some facility-prepared examinations were more difficult than others
= Variation due to a combination of
-differences among NRC examiners
-level of difficulty of the submitted examination
= Some examples of examinations which lack requirements for plant specific knowledge and have a low difficulty or cognitive level _ _
L l
l Examination Preparation l Workshops Assist utilities in the development of e appropriate -
examinations [
P
= Region 111 workshop in '
May 1998
1 .
l Operator Skills ,
= More than Requires
-Technical ability - Firm
- Procedure understanding of coordination conservative ,
1 decision making
- Proper regard for reactor safety
I BWR reactor vessel leak test
= Nuclear heat used to bring reactor coolant system up to temperature and pressure
= Contrary to 10 CFR Appendix G
= Support organizations responsible for the decision
= Operators agreed to this non-conservative action - significant violation of regulations
.l Operators at a PWR decided to repair a control rod at power
= A unit supervisor tagged out control power to all rods at 80% power.
= Failed to follow procedures
- = Maintenance outside scope l = Operators questioned available contingencies
= Operators did not sufficiently
- challenge the decision -
j
Consistent standards
= Operators should be evaluated to the same standards both in training and day-to-day operations
=
Performance in the simulator should look like everyday operations e-=-*w .w-*-
t
-i NRC inspection focus
= Protecting public health and !
safety ,
= Joint resident inspector and examiner evaluations of operations Greater emphasis on operator performance ,
= Improved ability to assess overall operational an l performance 3H sis #
%am& ;
{
e 4 Effective Operator Training Program Selection
= Training Evaluation
= Feedback
= Exam Preparation l
l l
- 1 r i ,. i i, ;i ! ;l, !f !i f?: I :I?!I : ; jlI : Iti; O
_ , h 7 -
4 3 .
- 5 8 ,
9 _
N ,
_ I
~
+
- s
~
d.;
y
_ n s t
_ i o i l
i t b
_ c i g
_ e i l
l e e S s
_ i
_ t e s h
c a r oh i
d t cw i
d af n f o a ye n n C a o M -
_ l ,
~
m.m.
IN 98-37, ELIGIBILITY OF ,
LICENSED OPERATOR CANDIDATES,10/1/98
= 10CFR55.31(a)(4) - may accept Commission approved SAT based program w- - - _ _ _ _ - - - - _ ---_. --_.- s
. .---. --- +-.-.%-- . . - ~__.- .. ,- _. ,, . _ .
___m___
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR
, CANDIDATES,10/1/98 Revised eligibility criteria discussed in 3/28/1980 letter
= NUREG 0737, l.A.2.1, Immediate Upgrading of RO & SRO Training &
l Qualifications w .-ww.,4--
. i l .
j l
IN 98-37, ELIGIBILITY OF ]
l LICENSED OPERATOR CANDIDATES,10/1/98
= Commission Policy Statement,2/7/85
- - endorsed accreditation process
- accreditation guidance was consistent with 1980 letter
__ :1i _ __ ^1
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98 ,
- i
= Part 55 revised in 1987 i
- R.G.1.8 Rev 2
- ANSI 3.1,1981 i
- - SOC - industry accreditation an
! acceptable alternative ,
i i
i l
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98
= Commission-approved experience baseline has not changed since 1980 National Academy for Nuclear Training modified guidelines in 1991
= Interim guidance issued July 8,1998 l
- 1 - - n - - - -
-.--.... _ .- -l
- . Training- GFES Results
= BWR Average Score {%)
- RI - 90.0
- Ril - 91.2
- Rlli - 89.3
- RIV - 90.2
- ALL - 90.2
~-- - -.----.-~~ -- ~ - -o -.nn- -+ -
Training- GFES Results l
= PWR Average Score (%)
- RI - 91.3
- Rll - 90.3
- Rlli - 91.7
- RIV - 91.1
- ALL - 91.1 1
.[
Training- GFES Results
= Combined Failure Rates (%'j
- RI - 4.2
- Rll - 4.3
- Rlli - 5.1
- RIV - 3.6
- ALL - 4.3 !
l
e 4
~ - ~ -
Average Written Exam Scores Region Ill FY 98 -
= RO - 81.4 ;
= SRO - 86.4 i
i
EFFECTIVE EVALUATION l
l = Weekly and periodic exams - how i are scores combined?
= What is the cognitive level of tests?
l = What indicators are available -
l individual and class?
= Are mentors used?
- = Who owns the program?
~
y i
Level of Difficulty vs Cognitive Level
= Higher order questions are more operationally oriented ;
= Higher order questions are not '
necessarily more difficult
___-__..._.m_ - - _ _ - _ _ - _ . _ _ _ - _ _ . . _ , - _ _ . - _ - _ _ _ _ _ _ _ _ - _ _ _ _ ---m -w- - w--w- + w- vwv T-- ---
,ll l ll l l l l!l l il ,t n
i o -
t s -
e u
S -
i r d s o i l
a O ;
R i
t a d v e r i l y S r a
p adl vl i l
a &
i t
n x.
e yviacr s e P
r l l
aye t O R
w oam r l
nl ::
- ee m et i co es t i v
ar anh c wtan er i
i xar Epeh c yid e i m
ep r ot e s pead vimtsa l
o x P - - - RVAPe
= = =
G O
-.s_.- _ , . .
l Which of the following turbine l back-pressures will cause a reactor trip?
= 4 in. Hg
= 6 in. Hg I
= 8 in. Hg
= 10 in. Hg
Scheduling Issues
= Long term Exam peak did exist in late 99 Changes and delays solved ,
problem Currently scheduling mid 2000 One exam scheduled May 2001
- Exam Discuss written exam prior to prep week -
u-- _- - . m ----- - -