ML20058B659
| ML20058B659 | |
| Person / Time | |
|---|---|
| Issue date: | 10/23/1990 |
| From: | Shankman S Office of Nuclear Reactor Regulation |
| To: | Tipton T NUCLEAR ENERGY INSTITUTE (FORMERLY NUCLEAR MGMT & |
| References | |
| NUDOCS 9010300373 | |
| Download: ML20058B659 (20) | |
Text
...
h 4
OCT 2 31990 I
l Mr. Tom Tipton i
Director, OMSS Division i
NUMARC l
1776 1 Street, N.W.
Washington, DC 20006
Dear Tom:
As we discussed, we are tasked *ith conducting an assessment of the possit,le causes of operator stress durt NRC adalinistered requalification s
examinations.
Enclosed are the draf t plan, interview questions, observation 4
guidt, and survey instrument proposed for use in our evaluation.
We would appreciate any cournents so that our assessment will include-I expressed utility concerns.
If you have any questions, please do not i
hesitate to call me at (301)4921014.
Sincerely, 1
Chief Susan F. Shankman,ining Section Procedures and Tra Human factors Assessrent Branch Division of Licensee Performance and Quality Evaluation
Enclosures:
1.
Draft P16n 2.
Interview Questions 3.
Observation Guide 4.
Survey Instrument Distribution LHFB/RF Central Files
$$hankman JWermiel CThomas JRoe CThompson DLange
- PDR 0FC
- LHFB/DL
- L pQ NAME
- SS
- ge
- JW iel DATE
- 10/'2b90 10/23 /90 OFFICIAL RECORD COPY.
..s Document Name:
INTER 1[lEWgESTIONS FR OPER
,/
(
$l~" fr j
c,,, L
/vomac fs gV5 NRC d.E CENTER COPY X dm -TS
&/
/
DFoI
-~
a n.
Sut,my Instrutnent DRAFT ouestionnaire The following cuestions address the stress associtted with the structure cod p'/ocess of requalification, consequences of failing requalification, and the efforts telen to reduce stress, i
l'6ny of the questions ask you to use a 1-7 rating scale.
These questions will also provide space for any further discutsion or corrents you rey have. The i
remaining questions require e brief response.
When you have completed this short questionnaire, return the forn to the resident inspectors. All responses will remain anonymous.
Therefore, do not put your name on the form. Thank you for your time.
l i
i Cuestionnaire DRAFT
- r. umber of years as an operator.
(checkone) failed requalifications passed requalifications The following questions eddress the structure and process of requalifications.
1.
Using the following scale, rate the following factors on their impact on the level of stress during the examination process.
1 2
3 4
5 6
7 significantly significantly decreases the increases the stress level stress level securitypractices(segregating,escortingtorestroom,etc.)
a.
1 2
3 4
5 6
7 b,
physical environment (lighting, noise, etc.)
1 2
3 4
5 6
7 c.
length of the exam (1 week or 2 weeks) 1 2
3 4
5 6
7 l
l d.
scheduleandstructureoftheexam(formatofquestions,between scenario caucus time, etc.)
I j
1 2
3 4
5 6
7 l
l e.
family pressure l
l 1
2 3
4 5
6 7
i f.
peer pressure l
1 2
3 4
5 6
7
14,
C "k j
Questicnnaire
.t i
2 g,
management pressure
)
?
3 4
5 6
7 h.
examiner pressure 1
2 3
4 5
6 7
l Additional Comments:
2.
How much uncertainty about passing the requalification exam does the exam process create (i.e., not due to your knowledge and ability)?
1 2
3 4
5 6
7 very little a great deal uncertainty of uncertainty Additional Comments:
3.
What contributes the most to this uncertainty?
4.
How much stress and pressure do you feel in the weeks before the requalification exam?
1 2
3 4
5 6
7 very little a great deal stress
'of stress Additional Coments:
5.
Whatcontributesthesosttothislevelofstress?(Seequestion1forsome examples) 6.
How much stress do you have on the job as an operator?
1 2
3 4
5 6
7 very little a great deal stress of stress
4
.s, Cu stionnaire h
7.
How does this stress compare to the stress operienced during requalification?
The folicwino questions address recualification failure.
B.
How accountable would you feel for requalification failure?
1 2
3 4
5 6
7 not very very accountable accountable Additional Coments:
9.
How much pressure does this factor place on you to pass the requalification exam?
1 2
1 4
5, 6
7 very little a great deal pressure of pressure Additional Coments:
- 10. How important to you is the loss of your licensing bonus?
1 2
3 4
5 6
7 not very very important important Additional Coments:
- 11. How much pressure does this factor place on you to pass the requalification exam?
1 2
3 4
5 6
7 very little a great deal pressure of pressure Additional Coments:
4
{! D' *..,. m i
g Ouestior.r. aire 4
- 12. How much stignia is associated with an un-sat requalification program?
1 2
3 4
5 6
7 very little a great deal l
stigma of stigma Additional Coments:
j i
- 13. How much pressure does this factor place on you to pass the requalification exam?
1 2
3 4
5 6
7 very little a great deal pressure of pressure Additional Comments:
- 14. How much impact does requalification failure have on your family and personel life?
I 2
3 4
5 6
7 very little a great deal impact of impact Additional Coments:
- 15. How much pressure does this f actor place on you to pass the requalification exam?
1 2
3 4
5 6
7 very little a great deal pressure of pressure Additional Comtng:
- i-Ys 5-l
- 16. How much impact does requalification failure have on your career and professional life?
1 2
3 4
5 6
7 very little a great deal 3
impact of inipact l
Additional Comments:
- 17. How much pressure does this factor place on you to pass the recualification exam?
1 2
3 4
5 6
7 very little a great deal pressure of pressure i
Additional Comments:
- 18. How well does training prepare you for requalification?
1 2
3 4
5 6
7 l
not very very well well Additional Comments:
The following questions address stress reduction and the overall contribution l
of stress to requalification failures.
- 19. How much effort does your management and the plant examiners take to reduce stress during requalification?
1 2
3 4
5 6
7 very little a great deal effort of effort Additional Comments:
l 1
e-L
\\
Questionnaire
\\;... v ~ " 20. How much effort does the NRC take to reduce stress during requalifications?
1 2
3 4
5 6
7 very little a great deal effort of effort Additional Coments:
f
- 21. Briefly describe management efforts to reduce stress.
- 22. What additional efforts could management take to reduce stress?
23.
Briefly describe the NRC's efforts to reduce stress.
24 What additional efforts could the NPC take to reduce stress?
- 25. Overall, how much does stress contribute to requalification failure?
1 2
3 4
5 6
7 l
very little a great deal Additional Connents:
- 26. What factors, other than stress, may lead to requalification failure?
- 27. What changes would you make in the requalification process to reduce stress?
1
/..
- f.p"C' 1*!, =Ti.~.. L.
c.
Observat'9n Guide The following guide is to be used during observations made during the For the different areas observed, note the requalification process.
coriditions, processes, and interactions, and whether they are approprfate and Based on these observations, also note any areas where effecthe.
improvements could be made to reduce the levels of stress.
l l
l l
l l
f 1
e DRAFT Ot,servation Guide t
Written Examin6 tion physical environment lighting noise number of individuals in room other security precautions timing / scheduling / structure interactions between:
e operators and evaluators frequency duration quality / inter.sity evaluators and NRC frequency duration quality / intensity other i
l l
1 v
l])llljgll"["
Simulator physical environnent lighting noise number of individuals in room other security precautions timing / scheduling / structure interactions between:
operators and evaluators frequency duration quality / intensity evaluators and NRC frequency duration quality / intensity other 1
6 hhf['s gg, physical tovironment lighting noise number of individuals in room other security precautions timing / scheduling / structure interactions between:
operators and evaluators frequency duration quality / intensity evaluators and NRC frequency duration quality / intensity other l
I
(
l Interview Ouestions for Operators The following questions address the structure and process of requalification.
Describe how the following factors incrcase or decrease stress during the 1.
examinttion process:
a.
security practices
- segregating
- escorting to restroom, etc.
b, physical environment
- lighting, noise, etc.
c.
length of the exam
. I week vs. 2 weeks d.
schedule and structure of the exam
- multiple choice questions
- intent and necessity of static simulator
- between scenario caucus tine 2.
Describe the relationships between operations, training and the NRC during the requalification process.
How are these relationships different (e.g.,
more strained, more relaxed) from other times during the year?
I l
3.
Describe the frequency, duration, and quality of interactions between I
operators and examiners and during the examination process. Do these interactions lead to increased or decreased stress and pressure?
4.
Describe how the presence and actions of the NRC during the examination process increases or decreases stress.
5.
Describe your confidence level and certainty / uncertainty of passing requals. What factors influence your confidence level the most?
6.
Describe the level of stress and aressure experienced in the weeks prior to requal. What contributed to tiis level of stress the most? Overall, for how many weeks did you experience a heightened level of stress?
7.
Describe how you studied for requalifications. That is, did training provide time for study during class? Did you study on your own at home?
8.
How adequately did training prepare you for the requalification process?
9.
Describe the level of stress and pressure you have on your job as an operator. How does this stress level compare to stress during requalification?
- 10. Describe the level of pressure and/or support you receive from your family, peers, and management / examiners.
11.
Is the stress level different among the NRC and facility administered examinations? What factors contribute to this difference in stress level?
u
.r...;. p r.
i-' l e b E' ?
Interview Questions 2
i
- 12. How does the prevention of STAS from their normal functions during dynamic simulator increase or decrease stress?
I The following questions address requalification failure, 1.
How accountabit would you feel for the plant being shutdown?
Is this a i
significant source of pressure to pass requalification?
2.
Describe the importance and impact of the loss of the licensing bonus, is this a significant source of pressure to pass requelification?
3.
How much stigma is associated with an un-sat program?
Is this a significant source of pressure to pass requalification?
1 4
Describe the impact and effect requalification failure has on your family and personal life.
Is this a significant source of pressure to pass requalification?
5.
Describe the impact and effect requalification failure has on your career and professional life.
Is this a significant source of pressure to pess requalification?
The following questions address stress reduction, coping skills and the overall contribution of stress to requalification failures.
1.
Describe any sianagement/ examiners efforts and actions taken to reduce stress during requalification. Are these efforts effective? What other actions could be taken to reduce stress?
2.
Describe your own efforts and efforts of peers to reduce stress during requalification. Ate these efforts effective?
3.
Describe any NRC efforts and actions taken to reduce stress during requalifica t ion. Are these efforts effective? What other actions could be taken?
4 Overall, how much does stress contribute to requalification failure?
5.
What factors, other than stress, may lead to requalification failure?
6.
What changes would you make in the requalification process to reduce stress?
DRAFT Additional Sp(cific questions for Examiners and NFC Evaluators l
Ir, addition to rewording the previous questions as appropriate for Examiners and HRC eyeluators, ask these additional specific questics.s.
In reference to the length of time between NUREG-1021 revisions out for 1.
comment and subsequent imp 1(mentation, is 90 day lead time sufficient to change training ano guarantee practice tine for operators?
What are the procedures to ensure '.
Eten test and scenarios are review (d j
?.
by the region and returned to the $stes to ensure sufficient time for making changes before giving the actual exam?
3.
What is the necessity of having examiners pulling " double duty", that is, to examine operators 6nd perforn inspections at the same time? How distracting is this to the operator?
4.
What is the effect on the operator of having two evaluators for each operatcr during the dynamic simulator?
i i
4
i 4 *.
Draft Pla_n I
ENCLOSURE l
Evaluation of Operator Stress During Recualification l
Since December 1988, 10 requalification programs have been declared unsatisf actory, 68 have been declared satisf actory and 15 evaluated.
Furthermore. 193 operators have failed requal ich is approximately a 141 failure rate. The industry is concerned that it e failures may be due, in part, to the stress of the requalification process.
LHFB has agreed to conduct an independent assessment of the issue of o>erator stress during requalification. This evaluation will consist of four p1ases and utilize three methods.
I Phases:
1.
Unsatisfactory prograns: A human factors specialist will spend two Tays at three of the sites where the requalification program has been declared unsatisfactory.
During these two days the human factors specialist will interview the licensee examiners and operators who have taken the requalification examination.
Questionnaires will also be corpleted by operators during the site i
visit. These questionnaires will be administered by the human factors specialist.
2.
Satisfactery prograns:
A human factors specialist will spend two days at three of the sites where~ the requalification program has been declared satisfactory. During these two days the human factors specialist will interview the licensee examiners and operators who have taken the requalification examination.
Questionnaires will also be completed by operators during the site visit. These questionnaires will be administered by the human factors specialist.
3.
Programs under evaluation: One or two human factors specialists will spend one week at five to eight of the remaining sites during the requalification process. During this week, observations of all aspects of the examination process will be conducted. Approximately two weeks later, a human factors specialist will return to the site and conduct interviews with the licensee examiners, and with operators who have taken the requalification examination.
Interviews will also be scheduled with the NRC evaluators.
4 Facility administered examinations:
A human factors specialist will spend one week at two sites during facility administered examinations.
During this week, observations of all aspects of-the examination process will be conducted.
Interviews with operators and examiners will also be conducted. Questionnaires will be administered.
This evaluation will provide a comparison of examination processes, with and without the effects and presence of the NRC.
i
i*,,
Enclosure
- :. - i, Ij.![ }
Methodology:
1.
Intervievis:
Interviews will be conducted with operators who have eitter passeo or failed the requalific6 tion exam, and with licensee
,i and NRC cvaluators. These interviews will use a structured questionneire and address the exter.t of stress, both cognitive and physical, ard the subsequent efftct on exam performance.
j Interviews will be used to evaluate programs that have already been cor.sidered unsatisf actory and satisfactory. They will also be used at sitet where the requalification program is currently under evaluation.
2.
Observaties: A human factors specialist will observe all aspects of the requIlification examination such *
writ'. ens, JPMs, and simulator.
During these observations,.
'rver will use a sunnary sheet to note such issues as 1) ths.
Acturi of the examination process, ?) the physical environment suci as noise, lighting, crowding, and 3) general frequency, duratio1, and intensity of interactions between operators and licen ee and NRC evaluators.
3.
Questionnaires: Operators and evaluators will be given a questionnaire to complete. Questions will address the issues discussed above. A Likert scale will be used for many of the questions to facilitate ease of individual response and ease of data l
sumary. Other questions will require a short response. All questionnaires will be anonymous.
Questionnaires will be adininistered at sites which have already been declared satisfactory or unsatisf actory and at sites where the regulification program is under evaluation. Questiormaires will be administered by the human factors specialist af ter shif t turnover, or at his convenience. The questionnaire should take approximately 5-10 minutes to complete.
Areas to be addressed:
1.
Examination structure and process and timing of components) procedures, exam components, schedu logisticsandstructure(
security practices seclusion of groups, limited interactions between individuals perceived relationship (s between operations, training and the NRC physical environment lighting, noise, crowding) frequency, duration and quality cf interactions between operators, examiners, and NRC evaluators specific licensee actions that increase stress specific NRC actions that increase stress peer /factly/ management and examiner pressure
~.
-~
Enclosure
, -~
t.
1ength and duration of examination confidence level /uncerteinty of passing requals stress /presssure during weeks prior to exams stress / experience on '" 'i as an operatot' difference between Ni facility administered examinations j
l study time, habits, at
- titudes adequate training for requalificction intent and necessity of static simulator appropriate length of time between NUREG-1021 revisions out for l
J coment and subsequent implementation appropriate time for regional review of written test and scenarios intent of blocking STAS from normal functions during dynamic 1
simulator necessity of having examiners examine operators and perform inspections at same time necessity of two evaluators per operator during exams 2.
Consequences of failing requalifications accountability for plant shutdown-loss of licensing bonus stigma of program being unsatisfactory effect/ impact on family and personal life effect/ impact on career and professional life 3.
Stress reduction and coping skills management and eriminers' efforts and actions to reduce stress individual efforts and actions to reduce stress NRC efforts and actions to reduce stress Evaluation Report:
The final report will address sources of stress during requalification and strategies to reduce and manage stress during the examination process. This report will be for internal distribution.
i 1
l
s.
f Enclosure DRAFT
-4 Sample Plan November 4 - 9 Sundcy:
Travel Monday:
Zion (unsat program) administer questionnaires 1
interview Tuesday:
Zion administer questionnaires interview Wednesday:
Travel Thursday:
PointBeach(unsatprogram) administer questionnaires l
interview Friday:
Point Beach administer questionnaires interview travel home December 11 - 16 Sunday:
Travel Monday:
McGuire(requalexams) observe Tuesday:
McGuire observe l
Wednesday:
McGuire observe Thursday:
McGuire observe Friday:
McGuire observe travel home i
January 6 - 8 l
Sunday:
Travel l
i Monday:
McGuire interview administer questionnaires Tuesday:
McGuire interview administer questionnaires travel home j
l i
s
~. - _,
,e e
.y..
i J
n r -w g., yn; d2EI' 4 E L* L i
Enclosure i
5 1
Developmental Plan I
September and October,1990: Develop questionnaire, interview questions arid observation checklist. Materials reviewed by LOLB a
and LHFB.
November,1990 throuch April,1991:
Conduct evaluations.
May, 1991: Prepare a final report on operator stress during i
requalification examinations.
Staff Tire Approximately 15 person weeks of on-site time will be required.
i i
6
..a.w-,
.v-