ML20196G901
| ML20196G901 | |
| Person / Time | |
|---|---|
| Issue date: | 12/01/1998 |
| From: | Grobe J NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION III) |
| To: | Caldwell J NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION III) |
| References | |
| NUDOCS 9812080146 | |
| Download: ML20196G901 (33) | |
Text
_ - - _ - - -
-. -.. -.. - -._ _ =
+
i December 1, 1998 i
MEMORANDUM TO:
James L. Caldweil, Acting Regional Administrator FROM:
John A. Grobe, Director, Division of Reactor Safety
SUBJECT:
PRESENTATION TO MIDWEST NUCLEAR TRAINING ASSOCIATION On October 27,1998, Mei/yn Leach, Cbief, Operator Licensing Branch, gave a presentation at the Eleventh Annual Midwest Nuclear Training Association Instructor Workshop in Columbus, Ohio. The presentation was entitled
- Operations and Operator Licensing." The topics addressed included: why the operator training program and licensing process is important, the l
current status of changes to the licensing examination process, the need for operator training l
to reflect performance expectations, and some attributes of an effective operator training l
program. Within the area of an effective operator training program, the validation process for questions and a question with obvious design flaws were discussed.
The presentation was attended by a cross-section of representatives from nuclear plant l
licensees both from within and outside Region 111. The presentation slides are enclosed.
i
Enclosure:
As stated cc w/ encl:
R. M. Gallo, NRR j
PUBLIC IE-42 CONTACT:
M. Leach, DRS l
(630) 829-9705 I
/I
(
l DOCUMENT NAME: G:DRS\\ TRAINING.WPD v.
.m.
- m c. c ~.n c. c.
r.
c.
OFFICE Rill E
Rlli F
l NAME Leach:jp /MV4 Grobe A DATE 12///98 12/I/98 OFFICIAL RECORD COPY 9812000146 981201 PDR MISC 9812000146 PDR i
I l
i Operations and Operator Licensing i
Melvyn Leach, Chief Operator Licensing Branch j
Region Ill
?
O l
4
Topics
= Why the operator training program and licensing process is important
= Current status of changes to the licensing examination process j
= The need for operator training to reflect performance expectations Some attributes of an effective operator training program
Importance of operator training and licensing We believe all reactor operators must have a firm understanding of conservative decision making and j
a proper regard for reactor safety.
=
=
o This understanding is not importa just during response to a crisis but is important during every shift of routine operations.
Probabilistic Risk Analyses j
show:
l l
= Avoiding a potential initiating event poses less risk than dealing with the i
event.
= Terminating the event early through the use of abnormal procedures poses less risk than allowing it to j
develop into a reactor trip.
i
.l Why NRC involvement in operator licensing?
= Licensed operators are part of defense-in-depth
= Atomic Energy Act of P
1954 requires the NRC
,_~
to prescribe uniform L) licensing conditions u
i I ')
f i
- - - ?
~
Change in the examination
= If approved 1
-facility licensees prepare examination
-submit to NRC for review and approval
- NRC administer operating test
- facility licensees administer written examination
- CRGR raised backfit question
.i Examination process transition
= Facility licensees and the NRC may have underestimated the challenge without affecting
- quality
- difficulty l
- consistency
= NRC has worked with NEl and facility licensees to refine the process
b Public and NRC staff comments include:
= Personnel restrictions for examination developers should be reduced
= More guidance for level of difficulty
= Crew composiiton should be the same as normal operations Systematic outline process Time limit increased for written examination
~
t I;I!
Ij1l i
l 1l1ll I!
i s
e n
o i
t a
n i
m a
/
/
x z/
E
/
'x
.7
/4~
t o
e r
l o
iP mid s
f l
s gs sa o
eyn n
nv s
cl t
i obaivioeoy t
l r
a n t
t lu pr iaeaa l
i amieiinc nl se e
pi m b m n l
r b
mc h
R aea c
a osix x
VCdeWet i
e
=
=
=
.l l
Examination difficulty Some facility-prepared examinations were more difficult than others
= Variation due to a combination of
-differences among NRC examiners
-level of difficulty of the submitted examination
= Some examples of examinations which lack requirements for plant specific knowledge and have a low difficulty or cognitive level _
L l
l Examination Preparation l
Workshops Assist utilities in the development of e
appropriate
[
examinations P
= Region 111 workshop in May 1998
1 l
Operator Skills f
More than Requires
=
-Technical ability
- Firm
- Procedure understanding of conservative coordination decision making 1
- Proper regard for reactor safety I
I BWR reactor vessel leak test Nuclear heat used to bring reactor
=
coolant system up to temperature j
and pressure I
Contrary to 10 CFR Appendix G
=
Support organizations responsible
=
for the decision j
Operators agreed to this
=
non-conservative action - significant violation of regulations
.l Operators at a PWR decided to j
repair a control rod at power
= A unit supervisor tagged out control power to all rods at 80% power.
1
= Failed to follow procedures j
= Maintenance outside scope l
= Operators questioned available contingencies
= Operators did not sufficiently challenge the decision j
Consistent standards
= Operators should be evaluated to the same standards both in training and day-to-day operations
= Performance in the simulator should look like everyday operations e-=-*w
.w-*-
t
-i NRC inspection focus
= Protecting public health and safety j
= Joint resident inspector and j
examiner evaluations of operations 1
Greater emphasis on operator i
performance
= Improved ability to assess j
overall operational an
%am& sis #
performance 3H
{
e 4
Effective Operator Training Program Selection
= Training Evaluation
= Feedback
= Exam Preparation l
l l
1 r
i,.
i i, ;i
- l,
!f
!i f?:
I
- I?!I jlI Iti; O
h 7
4 3
5 8
9 N
I
~
+
s d.;
~
n y
s t
o i
l i
i t
b c
ig e
i l
e e
l S
s i
e h
t s
c r
a i
oh d
cw t
i d
af n
f o
a ye n
C n
a o
M l
- \\
.l l
~
m.m.
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98
= 10CFR55.31(a)(4) - may accept Commission approved SAT based program w-s
+-.-.%--
.. - ~__.-..,- _.
___m___
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98 Revised eligibility criteria discussed in 3/28/1980 letter
= NUREG 0737, l.A.2.1, Immediate Upgrading of RO & SRO Training &
Qualifications l
w
.-ww.,4--
i l
j l
f IN 98-37, ELIGIBILITY OF
]
l LICENSED OPERATOR CANDIDATES,10/1/98
= Commission Policy Statement,2/7/85
- endorsed accreditation process 1
- accreditation guidance was consistent with 1980 letter
__ :1i _ __
^1 t
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98 i
= Part 55 revised in 1987 i
- R.G.1.8 Rev 2 i
- ANSI 3.1,1981 i
- SOC - industry accreditation an acceptable alternative i
}
i i
l
IN 98-37, ELIGIBILITY OF LICENSED OPERATOR CANDIDATES,10/1/98
= Commission-approved experience baseline has not changed since 1980 National Academy for Nuclear Training modified guidelines in 1991
= Interim guidance issued July 8,1998 l
- 1 - - n
l
-.--.... _.- -l Training-GFES Results j
BWR Average Score {%)
=
- RI - 90.0
- Ril - 91.2
- Rlli - 89.3
- RIV - 90.2 i
- ALL - 90.2 i
~--
-.----.-~~ -- ~ -
-o
-.nn-
-+ -
Training-GFES Results l
PWR Average Score (%)
=
- RI - 91.3
- Rll - 90.3
- Rlli - 91.7
- RIV - 91.1
- ALL - 91.1 1
.[
l Training-GFES Results Combined Failure Rates (%'j
=
- RI - 4.2
- Rll - 4.3
- Rlli - 5.1
- RIV - 3.6
- ALL - 4.3 l
l i
(
e 4
~ - ~ -
Average Written Exam Scores Region Ill
- FY 98 RO - 81.4
=
= SRO - 86.4 i
i l
EFFECTIVE EVALUATION l
l
= Weekly and periodic exams - how i
are scores combined?
= What is the cognitive level of tests?
l
= What indicators are available -
l individual and class?
= Are mentors used?
= Who owns the program?
~
i y
Level of Difficulty vs l
Cognitive Level Higher order questions are more j
=
operationally oriented Higher order questions are not
=
necessarily more difficult
....m
---m
-w-w--w-
+
w-vwv T--
,ll l
ll l
l l
l!l l
il
,t n
o i
ts e
u S
ir d
s O
o i
la i
a d
v R
t S
e i
y r
r x.
l a
adl i
l t
n p
vl a
iac s
e e
yvi O
r l
r l
t P
aye R
w nl r
loam ee m
t i
et co es v
i ar anh wt i
e i
xar c
e an r
Epeh yid m
i s vimtsa c
ep e
l r
ot pead o x P
- RVAPe
=
=
=
=
=
l l
l l
G O
-.s_.-
l Which of the following turbine l
back-pressures will cause a reactor trip?
= 4 in. Hg
= 6 in. Hg I
= 8 in. Hg
= 10 in. Hg
Scheduling Issues j
Long term
=
Exam peak did exist in late 99 Changes and delays solved problem j
Currently scheduling mid 2000 One exam scheduled May 2001 Exam Discuss written exam prior to prep week u--
m
-