ML20028B942

From kanterella
Jump to navigation Jump to search
NRC Integrated Human Factors Program Plan
ML20028B942
Person / Time
Issue date: 11/30/1982
From:
Office of Nuclear Reactor Regulation
To:
Shared Package
ML20027C148 List:
References
FOIA-82-555 NUDOCS 8212280528
Download: ML20028B942 (64)


Text

s NUCLEAR REGULATORY COMMISSION INTEGRATED HUMAN FACTORS PROGRAM PLAN NOVEMBER,1982 l

l t

t n iu s opq p\\ )

e

-w.;

-e-.*

w e

=+esw-----


..---.-.--w--.

<=w--.,,

y..e----

m-

TABLE OF CONTENTS 1.

INiRODUCTION.......................

1 II. SPECIAL ISSUES......................

7 III.

PROGRAM ELEMENTS.....................

9 1.

Staffing and Qualifications 9

2.

Training....................... 13 3.

Li cen si ng Exami nati on s................ 15 4.

Procedures and Testing................ 19 5.

Man-Machine Interface 24 6.

Management and Organization 33 IV. LONG RANGZ RESEARCH 37 APPENDIX A.

TMI ACTION PLAN STATUS

..............A-1 APPENDIX B.

HUMAN FACTORS SOCIETY RECOMMENDATIONS AND THEIR CORRELATION WITH STAFF PRO-GRAMS IN HUMAN FACTORS

..............B-1 APPENDIX C.

PROGRAM ELEMENT SCHEDULES............. C-1 APPENDIX D.

GLOSSARY

.....................D-1

  1. ..r-_,...,....__.~_..--.

NRC INTEGRATED HUMAN FACTORS PROGRAM PLAN 1.

INTRODUCTION PURPOSE The purpose of the NRC Integrated Human Factors Program Plan is to ensure that proper consideration is given to human factors in the design, operation, and maintenance of nuclear facilities.

This initial plan addresses nuclear power plants (NPP) and describes (1) the technical assistance and research activities planned to provide the technical bases for the resolution of the remaining htsnan factors related tasks described in NUREG-0660, "The NRC Action Plan Developed as a Result of the THI-2 Accident,"and NUREG-0737," Clarification of TMI Action Plan Requirements, and (2) the additional human factors efforts identified during impl.snentation of the Action Plan that should receive NRC

~

attention. The plan represents a systematic and comprehensive approach for addressing human factors concerns important to nuclear power plant safety j

in the FY-83-85 time frame.

l BACKGROUND A thorough understanding of functions, capabilities, and limitations of the personnel involved must be included to evaluate the safety of nuclear power pl ants.

The accident at Three Mile Island Unit 2 (TMI-2), identified the need to bring human factors consideration into the mainstream of nuclear 1

power plant regulation and operation. NUREG-0660 described a number of tasks to be perfomed by the nuclear industry and the U.S. Nuclear Regulatory Commission. A significant number of these tasks were aimed at improving l

nuchar power plant safety through increased attention to the human element.

Considerable progress has been made on many of these Action Plan items.

Appendix A tabulates those Action Plan items that have been or are being i

implemented, and those items that are in the process of being resolved as part of this plan.

L CURRENT ACTIVITIES In June and December 1980, the Commission issued Policy Statements augmenting j

the Commission's regulations with the requirements in NUREG-0737, " Clarification l

of TMI Action Plan Requirements." To date, over twenty licensing reviews have been completed with increased attention having been given to the following human t

L factors areas.

o review of NPP staffing to ensure that the numbers, functions, and qualifica-tions of personnel are adequate for safe operation o review of training programs for both licensed and nonlicensed NPP staff to ensure that personnel are able to meet existing job perfomance requirements I

a s

o review of procedures and startup testing programs to ensure their adequacy and effectiveness o review of NPP control rooms and remote shutdown panels to ensure that they are designed to facilitate the man-machine interface o review of utility management and organization to ensure its adequacy to support safe NPP operation The Commission has also recognized the need to codify the need for human factors involvement in nuclear power plant design, construction and opcration. Three proposed 10 CFR Part 50 Appendix A General Design Criteria have been drafted and are currently being reviewed by the staff.

The three criteria, proposed GDC 65, 66 and 67, address human factors engineering; operability, surveillance and maintainability; and organi-zation and management.

More recently, the Commission approved SECY-82-111, " Requirements for Emergency Response Capability." This action applies important human factors requirements to operating plants, prinrily in the areas of man-machine interface (MMI), upgraded procedures, and related training.

This effort will be the major focus for human factors activities for operating plants during the next three years. The schedule for accomplishing these activities will be established through negotiation between the NRR Project Manager and the utilities.

PROGRAM PLAN AND RESOURCES The Human Factors Program Plan is structured as follows:

Section II describes a number of special issues which either affect all o

aspects of the program or require involvement of more than one program element for their resolution.

I Section III addresses the six major program elements to be addressed in o

FY-83 through FY-85; Staffing and Qualifications Training Licensing Examinations Procedures and Testing Man-Machine Interfaces Management and Organization Activities planned for these program elements will provide the technical l

bases for developing guidance for the nuclear industry and will improve the capability of the staff to perfonn licensing activities effectively. They i

will also support decisions regarding the degree of regulation required to i

( l

j resolve the technical issues. If the results of the programs indicate that new requirements should be promulgated, such proposals will undergo the nomal review process, including review by the Committee for the Review of Generic Requirements (CRGR).Section III incorporates both licensing j

(NRR) and research (RES) activities and tasks discussed in the six pregram elements.

4 i

Figure I-1 shows the resource allocation to each of the six program elements for FY-83/84. The program is balanced in that approximately one half of the resources address the huan element in design aspects (MMI and procedures),

i and the other half address the human element in operational aspects.

g o Section IV describes RES planning for potential programs in support of NRC i

i human factors user needs that could be applied beyond FY-85.

o Appendix B provides the staff's initial response to the recommendations j

provided by the Human Factors Society in NURE0/CR-2833, " Critical Human Factors Issues in Nuclear Power Regulation and a Recommended Comprehensive 4

j Human Factors Long-Range Plan."

o Appendix C provides the schedule of activities for each of the six program elements. Activities are those either planned or underway for the Offica of j

Nuclear Reactor Regulation (NRR) and Office of Nuclear Regulatory Research (RES) and related major activities initiated at the Institute of Nuclear Power Operations (INP0), the Electric Power Research Institute (EPRI), the Edison Electric Institute (EEI), and the Halden project.

o A glossary is provided in Appendix D.

2

]

PROGRAM MANAGEMENT, COORDINATION AND INTEGRATION The success of this human factors program plan relies on effective inter-actions within the NRC and between the NRC and industry. The systems approach taken in this plan is intended to provide assurance that NRC

]

human factors activities are appropriat2ly integrcted and that adequate and accurate human factors infoma*. ion is developed. The plan recognizes that activities initiated within INN, EPRI, EEI, Owners' Groups, and individual

[

utilities often provide essential infomation to complement the activities described. To assure that available information is effectively and efficiently L

used, these activities, and those at other Federal Agencies and in foreign countries, will be coordinated and integrated with those described in this plan.

Interaction between NRR, RES, other NRC Offices, NRC contractors and the industry is also recessary to ensure program success. Beginning in the second quarter FY-33, working level meetings will be held as outlined below to ensure that the programs identified in this plan are fulfilling the objectives of this plan.

These meetings will provide a mechanism to i

enhance the integration of all interactions. It is anticipated that the Human Factors Program Plan will be updated, fomally, once a year. Thi s L

will be prior to the initiation of the annual budget cycle.

Speci fically,

the following program management activities are envisioned:

I o Three program reviews will be conducted each year at approximately four month intervals: October, February, and June.

l g..,_

n ~ - - -..

(14)

MGMT (11)

(14)

PROC TEST TRAINING EXAM MAN / MACH STAFF i

INTERFACE QUAL (35)

(21) i 4

FY 1983(%)

I (13)

(9)

MGMT (14)

PROC ORG TEST TRAINING EXAM I7I i

MAN / MACH STAFF INTERFACE 3

QUAL (40)

(17)

FY 1984(%)

Figure I-1.

Distribution of Developmental Resources 4_

4

o Branch Chiefs will be tasked to present the status of their respec-tive programs.

o The October review will be the yearly updating of projects accomplished during the prior fiscal year.

The status of ongoing projects and current plans for the next fiscal year, consistent with available budget and resources, will be presented.

o The February review will be a status update and will include a dis-cussion of any identified requirements for new or revised projects for future fiscal years.

The results of this review will be the annual revision of the Human Factors Program Plan.

o The June review will emphasize accomplishments and will finalize information and data needed to update the Human Factors Program Plan for the upcoming fiscal year.

o The principal program plan reviewers will be the Director, Division of Human Factors Safety and the Director, Division of Facility Operations.

Senior staff members will be included.

o Industry representatives with programs relevant to the plan (e.g., INP0 and EPRI) will be invited to attend and participate.

They will be asked to report the status of their programs such as job / task analyses, main-tenance programs, accreditation of training, and management and organiza-tion practices.

J Figure I-2 depicts program element interrelationships and how they relate to industry operations.

This Figure illustrates the special interrelationships between the Staffing and Qualifications Training and Licensing Examinations elements, and between Training, Licensing Examination and Procedures and Testing elements.

In addition, there are element-to-elenent interrelation-ships between the Training and Licensing Examination elements and the Procedures and Testing and Man-Machine Interface elements.

L l

The Director, Office of Nuclear Reactor Regulation has overall responsibility for assuring that the NRC Integrated Human Factors Program Plan is properly l

executed.

To assist the Director in his responsibilities a Human Factors l

Review Group (HFRG) will be established.

The HFRG will be chaired by the l'

Director, DHFS and will include the Director, DF0, and representatives of the Office of Nuclear Reactor Regulation, the Office of Nuclear Regulatory Research, the Office of Nuclear Material Safety and Safeguards, the Regional Office, and the Office of Resource Management.

The Director, Office of Nuclear Reactor Regulation is responsible for implementing the plan for nuclear power plants.

Implementation of the plan for fuel cycle facilities is the responsibility of the Director, Office of Nuclear Material Safety and Safeguards.

The human l

factors research program required to meet user needs is the responsibility of the Director, Division of Facility Operations.

The research will be carried out in accordance with the February 3,1982 established procedures for the NRC research process.

An annual report on the staff's success in executing this plan will be provided by the HFRG in December of each year beginning in December 1983.

PrOgrcm Plan Nucinar Industry Elements Utility I^ " ' ent and

(

Management and Organization Orgs za io e Oesign and Construction Personnel /

[ Personnel / Selection Interface Selection

/

[ Start up Start up Interface 8

1 '

/

.e

[ Operation and Maintenance Operation and Interface Maintenance Staffing and Personnel /

Qualifications s

Selection Operation and m

Maintenance

50""'I#

Training

?

Selection l'

2 Start up l

l Operation and Maintenance

+1 l

l l

Examinations 7

Personnel /

Selection

=>

Start up e

Operation and l

Maintenance Procedures and L

Start up Testing k'

Operation and e

". Maintenance if Interface

~

Design and Man-Machine Construction Operation and Maintenance Figure I-2.

Program Plan Element Integration '-'

. =_ -.-

i II. SPECIAL ISSUES Several substantive concerns and issues have been identified and are discussed below. These issues will have varying degrees of impact on all the programs described in Section III.

A.

Regionalization 5

The regionalization process for the human factors area has been initiated for operator licensing examinations.

Additional technical review activities will be implemented by the regions during FY-85 and beyond, including reviews of procedures, modified training programs snd management.

NRC Headquarters will retain the responsibility for developing policy guidance for human factors issues, and will issue guidance to ensure consistency of reviews among Regions, conduct generic audits, and train regional reviewers.

Once policy guidance has been developed, sufficient time must be provided to allow adequate training of appropriate regional personnel and, to the extent needed, human factors j

professionals added to the regional staffs.

It is probable that except for operator licensing and emergency operating procedure (E0P) reviews, no major changes in human factors reviews will take place during the FY-83 through

~,

FY-85 time frame.

The actual number of reviews to be done by the regions will he determined based on timing of regionalization and the resources available to the regions to develop a review plan responsive to headquarters policy 2

guidance.

B.

" Hardware" vs " Training / Procedures" Solutions to Problems Frequently, solutions to design-related human factors problems in operating i

NPP's are based on people-oriented changes, e.g., modifications to operator training or procedures. While this may be an appropriate resolution of some issues, overuse of this approach may overload both operators and operator training programs.

Any decisions to adopt training as a solution to a safety l

issue instead of a design modification must recognize and incorporate the continuing cost of expanded training, increase of crew size, and increase in number of shifts in the cost / benefit evaluation.

C.

Maintenance The primary issue in the maintenance area is one of determining the need for and extent of regulatory involvement by NRR.

Risk studies, maintenance assessment activities, and incidents at NPP'S have established the importance of mainter.ance to safety.

Program plan activities will address design for maintain.bility, maintenance procedures and documentation, maintenance personnd qualifications and training, preventive maintenance, maintenance work authorization and control, outage planning and management, inventory control, and management of maintenance activities.

Results of these activities will indicate the extent to which regulatory attention should be focused on maintenance.

Design criteria when developed will be evaluated for use as part of rulemaking, or as a part of regulatory guidance..

.-,T

D.

Simulators Simulators are used throughout the industry for training operators.

Recently, simulator examinations have been required for initial and requali-fication examinations at sites with plant-specific simulators.

However, a clear regulatory position on the rcle of simulators, and their required level of fidelity to control room and plant design for training purposes, has not been established.

Such a position including regulatory guidance on the use of simulators in training, plant drills, and examinations will be developed on the basis of the activities of the program plan addressing simulators.

E.

Probabilistic Risk Assessment (PRA)

Human reliability data on specific nuclear power plant operations are limited.

Where such data exist in other fields, (e.g., military, aerospace), their applicability or adaptability to the nuclear power industry are uncertain, and difficult to verify. Although RES has ongoing and planned research to produce human reliability data, it is a long-tem effort.

Few sub-stantial improvements in the confidence of the human error rate assumptions used in probabilistic risk assessment (PRA) can be expected in the FY-83 through FY-85 time frame.

F.

Advanced Technologies Existing nuclear plant designs are currently being modified to make use of advanced technologies.

Additional modifications are expected to be intro-duced, based on these and on developing technologies.

For example, SECY 82-111 requires that a safety parameter display system (SPDS) be provided in plant control rooms. Most of the SPDS designs are based on computer technology and cathode-ray tube (CRT) display techniques.

Since these technologies are being introduced into existing MPF d2 signs, it is anticipated that these expanded data and infomation management capabilities will be applied to other plant processes. As these new control and display technologies are being developed, guidance pertinent to the interface between them and the operator will be developed.

G.

Other NRC Human Factors This plan does not include all NRC human factors activities, especially those of a unique circumstance such as the psychological effects of THI-1 restart or the activities in the Office of Nuclear Material Safety and Safeguards (NMSS). Future revisions to the plan will incorporate additional htman factors activities within the NRC and reflect the experience and lessons l

learned from the application of this plan.

Future revisions will also provide details of the programs, including research in human reliability, to support PRA.,..

4 1'

III.

PROGRAM ELEMENTS A major purpose of this Human Factors Program Plan is to develop the technical basis for establishing human performance criteria to support regulatory decisions. The NRC, EPRI, EEI, INPO, Department of Energy (D0E), organizations in foreign countries, and individual utilities are all collecting data and infonnation that will be useful. This section describes the NRC efforts for FY-83 through FY-85 to develop the technical bases for regulatory review of NPP Staffing and Qualifications Training, Licensing Examinations, Procedures and Testing, Man-Machine Interface, and Management and Organization.

If results of the programs indicate that new requirements should be promulgated, such proposals will be carefully considered and subjected to all regulatory review processes. Schedules for the six program elements are shown in Appendix C.

The numbering system of this Section corresponds to that of Appendix C.

1. Staffing and Qualifications The goal of this element is to ensure that staffing is adequate for safe operation and support of nuclear power plants.

This goal will be met by i

developing guidelines and regulatory requirements addressing (1) the numbers and functions of NPP staff needed to safely perfonn all required plant operations, maintenance, and technical support activities for each operational mode; (2) the minimum qualifications of plant personnel, in j

terms of education, skill, knowledge, training, and fitness for duty; and j

(3) appropriate limits and conditions for shift work including overtime, shift duration, and shift rotation.

The benefits which result from accomplishing the goal are:

o reduced risk to the public by reducing hunan error based on improved operating personnel qualifications for responding to unanticipated events o reduced risk to the public by reducing hunan error based on improved work scheduling activities o better definition of what operators are expected to do in light of the perception that safety issues are being resolved by training / procedures modifications The issues in this element are:

o the possible impact on safety due to the lack of sufficiently qualified individuals o the need for a technical basis for developing rcquirements for training, experience, and education, e.g., need for college degrees.

l l..

1.1 NPP Staffing Requirements In order to determine the appropriate minimum shift staffing require-ments for NPP personnel, the following activities will be perfomed:

o survey current staffing practices of both domestic and foreign utilities to provide data required to evaluate current practices and regulations and correlate staffing levels with variables such as plant size, control room size, and plant / control room layout (NRR/RES) o evaluate the need for engineering expertise on shift through deter-mination of the functions and duties required, using results from job / task analysis and evaluation of the current shift technical advisor experience (NRR) o develop manpower projection and allocation models for operations, maintenance, and support functions through development of job perfor-mance measures, and collection and evaluation of job / task analysis data to provide a prediction method for future changes in requirements or plant design and simulator experimentation (NRR/RES) 1.2 NPP Personnel Qualifications Requirements The implementation of SECY 82-162A "An Integrated Plan on Shift Crew Qualifications" will integrate industry and NRC efforts to detemine the appropriate minimum training, education, and experience requirements for shift operating crews. The results of the following activities will address the overall issue of NPP staff qualifications:

o evaluate job / task analyses data to detemine knowledges, skills and abilities needed to perfom jobs and establish minimum qualifications requirements (RES and Industry) o conduct simulator experiments that will yield job perfomance measures and crew interaction results applicable to curriculum developnent (RES) o assess the relationship between education, training and experience requirements, and job perfomance to identify the trade-offs among these related factors (NRR/RES) o evaluate the feasibility and value of licensing or certifying NPP personnel other than licensed operators (NRR/RES) l o conduct studies of human performance and reliability to identify l

minimum levels of acceptable perfomance (RES) o conduct studies to establish a technical basis for fitness for duty requirements (RES) l l I

1.3 Guidance on Limits and Conditions of Shift Work In ordar to determine the appropriate limits and conditions of shift work, activities are planned (1) to detennine the effects of varying shift duration using nuclear power plant simulators (RES); and (2) to survey and assess experience of other industries with job requirements similar to the nuclear industry with regard to shift arrangements and rotations (NRR/RES). This effort will allow the NRC to establish trade-offs among factors affecting shift work and overall safe perfonnance requirements. At this time the effects of different shift rotation schedules have not been identified as a significant cause of perfonnance decrement or unique human error. A specific research project to evaluate shift rotation effects will be planned if shift rotation is found to be a source of serious human factor problems.

1.4 Industry Activities INP0's surveys of industry staffing levels and its program on job / task analysis for operating and support personnel provide a data source for developing criteria for staffing levels and qualifications of personnel.

EEI has completed work on selection testing instruments for NPP Operators which will be used in NRC efforts on qualifications.

Industry committees (ANS 3.1) are also developing recommendations on staffing and qualifications.

1.5 End Products The products of the activities outlined in this element are:

o a rule on licensed operator staffing at r.uclear power plants (FY-83) o a rule on fitness for duty (FY-83) o a rule on minimum qualifications of shift crews (FY-84) l o a rule revising 10 CFR Parts 50 and 73 (FY-83) o proposed revisions to ANSI /ANS 3.1, " Selection, Qualifications and Training of Personnel for Nuclear Power Plants" (FY-85) o revision of Regulatory Guide 1.8, " Personnel, Selection, and Training" (FY-85)

Figure 111-1 describes the sequence of activities leading to-these end products.

1.6 Responsibility The responsibility for implementation of the activities described in this program element is divided. The Chief, Licensee Qualifications Branch (LQB),

l NRR, is responsible for the conduct of all NRR activities listed in Sections 1.1,1.2 and 1.3, identifying research and standards needs to assist in implementing the regulatory process, identifying required dates for products from research the for standards, and managing the NRR technical assistance program. The Chief, Human Factors Branch, RES is responsible for developing,

v-

=,

=

n a

n n

.s 1

s

=

t t

i i

1 1

1 m

3 W

X I

.a f

I, E

i e

m e

2

=

1

=

s

,s u

e a

n

.E4

_ __ g_.3 _ _ ".

_ __ _ _._ g ____________o_.____

=

3 1

3 i

s m

=

[

d.'.=

\\

i d

t l

i

_I 1

r

=

2

=

1 3

.1 i

t i !

a e a e 1

o 4

3 1

e 8

1 2

o W

4 3

1 -0 O I i

i O

a 8

s i

=

g i

N.

4 5

h i

t e 3

=

3 j

s i

i O

i

!- ! 4 I i.

e

-l

=.

.i s E

-l 4

c.

3

=

o a r a

3 a

z.

3 3

I I

E E.l.g i.

~a a

3 v

s s

S 1

s

=

=

3 g

-y 3 3 u. o a.

E

)_: _ __j _..; - _o _ __ _c

_o_j

)_ j

., _._ __. jj_y o

< s. o.

l.

-I 1

s

()

o r

i r

~

l j Ei i

i d

i F

l g

2 j

S e i. s

=

a I

I

.I

[

()

i i

i g

3 e

t

=

l-

}

R I.

=

2 5

I.

i e

1 l

o

()

J.

8.'

=

o,

=

a t

=

e a

m d'

l i

{ f l

2 g

3

{

i 5

i i

M

= ! l W

s

[

s 3

a r

a

=

s e

.! a g

J t

i I

= =*

- 1 s

.)

= -

8

{

i i

,s i

=

=

3 I

E 8

-v E

=

s e

i s 1 3 -

u. 1 8

-B s

s. g i e

3 3

3 i

$ g a!

i I.

I s

3 i 50

}

i EI I

?

i 5

a s-i i

I s

y

= e c i

s a m

a 2

3 2 w -

5' 1

1

  • I i

i 3

=

iN I 3y l

3 O*

E 3

i i Jl 3

j O

t is j =i C

1 'i 1

1 t e-2 2

5 1

2 i ss i

=

8 3

i t

~2

=,i 4

a i

z 2

e 5

~

ga 3

s 1 4a i

2

{ { z.

{

2 2

g t

i t!

i e'

1 ?

i.

g s

a.

i. f s i

e i

3 a

> a-g

- g b 5b iE I

a i

s E

E bi 1

E S u 0 b

i b EE N

-- -O-O- -O- -O- -O-- )

g

- - --O- )

l Figure III-1. Staffing and Qualifications Activity Sequence.

. w

and managing the research to meet NRR require ments and to deliver the products in a timely manner consistent with quality and programmatic con-straints.

The research will be carried out in accordance with the February 3, 1982 established procedures for the NRC research process.

2. Training The goal of this element is to provide means for ensuring that personnel are able to meet job performance requirements, that training properly accounts for pertinent safety issues, and that a mechanism exists for upgrading and assuring the quality of training programs. This goal will be met by (1) developing training guidance and criteria; and (2) developing and implementing reliable and objective procedures for use by NRR and Regional Offices in assessing the adequacy and effectiveness of training prograns.

The benefits which result from accomplishing this goal are:

o reduced human errors during operation and maintenance o increased licensed operator's knowledges, skills and abilities to respond to unexpected events o improved effectiveness and efficiency of licensed and non-licensed training programs o focusing the utility training programs to the knowledges, skills and abilities required to operate the NPP safely The issues in this element are:

o extent to which accreditation can lead to reduced regulatory activities o need for a syr :ematic approach to the development of current utility training programs o quality and effectiveness of training as a function of number of hours of instruction.

2.1 Training Guidance and Criteria INP0 has developed general guidelines for improving the quality of NPP training and has recently initiated an effort to accredit utility train-ing programs. However, this program is voluntary, and in order to ensure that NRC has the ability to more effectively evaluate utility training programs and have assurance that the training requirements are sufficient to meet NRC licensing evaluation, additional training criteria need to be developed. The training program evaluation criteria will be derived through the investigation or application of: 1 e

g

o a systems approach to training ensuring integration within training programs such as the Instructional Systems Development (ISD) process (NRR/RES) o needs assessments, from INP0 and RES such as knowledges, skills and abilities and results of Task Analyses that will lead to curriculum development for licensed and nonlicensed training programs (NRR/RES) o the role of simulators, and their requisite fidelity and type, in train-ing programs (NRR/RES) o the relative effectiveness of differing training methodologies to the extent they are detennined uniquely different (RES) 2.2 NRC Training Assessment Procedures In order to provide adequate criteria and procedures for perfonning consistent and objective reviews of NPP training programs, the following activities will be performed:

o develop audit criteria based on a systems approach (NRR) o pilot test the audit criteria on training programs conducted by nuclear steam supply system (NSSS) vendors and selected licensees to verify the adequacy of the guidance (NRR) o modify audit criteria based on pilot test results (NRR) o publish final criteria for use by NRR (NRR) o develop improved training inspection modules for use by Regional Offices to remedy current deficiencies and be responsive to new applications (NRR/01E) 2.3 Industry Activities INP0 has undertaken a major program to ensure the adequacy of utility training programs. This effort has established an accreditation process that will serve to enhance utility training programs.

INP0 has also developed technical reports presenting guidelines and criteria for training and qualifications for both licensed and nonlicensed NPP personnel.

Their job / task analysis will identify knowledges and skills to be used as the foundation for the development of curriculum for training programs for licensed and selected nonlicensed personnel.

EPRI has initiated a review of uses of simulators and task trainers for developing diagnostic skills.

2.4 End Products The products of this program element will include:

o criteria for evaluating industry training programs for licensed personnel (FY-83) (NRR) o criteria for evaluating industry training programs for nonlicensed personnel (FY-84) (NRR) o modifications to 10 CFR Part 55 and Regulatory Guide 1.8 (FY-85) (RES) o revision of ANSI /ANS 3.1 (FY-85) (RES) o revised Chapter 13.2 of NUREG-0800, " Standard Review Plan" (SRP), (FY-84)

(RES) o improved Office of Inspection and Enforcement (0IE) inspection modules (FY-84/85) (NRR/RES)

Figure III-2 describes the sequence of activities leading to these end products.

2.5 Responsibility The responsibility for implenentation of the activities described in this progran element is divided. The Chief, Licensee Qualifications Branch (LQB),

NRR, is responsible for the conduct of all NRR activities listed in Sections 2.1 and 2.2, identifying research and standards needs to assist in implementing the regulatory process, identifying required dates for products from research and for standards, and managing the NRR technical assistance program. 0IE is responsible for the development of modified Inspection Modules based on input from NRR. The Chief, Human Factors Branch, RES, is responsible for developing and managing the research to meet NRR requirements and to deliver the products in a timely manner consistent with quality and programmatic constraints.

The research will be carried out in accordance with the February 3,1982 established

' procedures for the NRC research process.

3. Licensing Examinations There are two major goals of this element 1) to develop valid and reliable reactor operator (RO) and senior reactor operator (SRO) licensing examin-ations to ensure the adequacy of training and the capability of candidates to safely operate NPP; and (2) to develop and implement a standardized examining process that will ensure consistency, reliability and efficiency across examiners, facilities, and regions.

The benefits which result from accomplishing this goal are:

o improved confidence that individuals that are licensed have those knowledges, skills and abilities required to perform on the job o better focused utility training programs o reduced licensee and NRC resource requrements to prepare aad administer the operator licensing examinations.

O O

~

~

C I

1u a

't j

e g

s 3

s 1

E 1

4 1

3 E

t

}

5 z

o 5

a 3

c g

E 3

e i.

.t.

i.

3

=

=

5 1--

C. --G - _ -

- - - - -- --(ey- - - -.

--e

--o 1

a 1.;s i

a l

a o

3 e

=

E a

a o

1

)

2 i

E 2

3 E

I 1

i 7

2 s

u u

.i 3 4

E F

gl m

4

=

2 g

g E

j

[ 3 u z 5

E a

' A b

a

()

)

-=-

1 O

O a

e

(*

O

(

5 I

i w

s

.I o

a e

j 5

3 a

i e

i I Y v

1 2 l

I I t

__ -}g

.(e)

GT _

E 3

I i

l.

o e

a 2

7 I

5 S

E 5

1 3 I I i

a 5

i

}

'I 3

g e

i s

i a

g o

a 5

-l j

A I J

B i

t

.l c 3 t

t e.

s a

z 8

g 2 i a

3 l

.I 2

J.

a E

s s

l I

M m

o 1 o

1 j

3 5

3 4

1

.e

.s a

a e

3 0

s s

1 t

X I

a I

i a

o o

g a

s 5

E

=

2 i

t i

3 t

,I

-[

=g 3

gi s i

-8 3

z E

i a

a a

! lIt i

g 1

2 2

3 1

$ i] j'[

I I

]

'}

I I

j d

I i

I

'I 5 !.

1 1

o e

t s

j.

i t

3 5

e 1

en s

i o u.e 2

i s

ts

,t

.z o

a cl a

l i

I l

l l

l l

1 i

Figure III-2.

Training Activity Sequence 16 -

I r-

The issues of concern in this element are:

o modifying the examination process without unnecessary impact to current license candidates and training programs o the need to ensure that the licensing examination is a valid measure of the operator's ability to perform necessary tasks and functions o the need to correlate the licensing examination with improved training programs o the need for more consistent examinations and examining practices by NRC examiners o obtaining objective performance measures to assess examination validity.

3.1 The Examination Content In order to identify the proper content of R0 and SR0 licensing examina-tions, the following activities will be perfomed:

o identify the R0 and SR0 tasks and duties and required knowledges, skills and abilities necessary for safe perfomance using INP0 and RES generic job / task analyses and to the extent available, plant specific analyses.

(NRR/RES) o develop objective and subjective measures of on-the-job perfomance through the use of job / task analyses to measure learned skills and knowledges and to assess the ability of the examination to predict the cmpetence of operators (NRR/RES) o develop and update a computerized bank of examination questions and l

examination scores for use in test validation, and use the computerized question and test score files to perform item analyses on examination results, focusing on reliability, difficulty, and discriminability of examination items (NRR) o perform content analysis of existing examination questions by subject matter experts to ensure that the appropriate types and levels of knowledges and skills are being included in examinations (NRR) o elicit training program information from utilities on specific content, learning objectives, and internal examinations for incorporation into the computerized examination bank (NRR) o determine the relationship between perfomance on the examination and subsequent job perfomance (NRR/RES) 1 l

3.2 The Examir.ing Process New examining procedures will be evaluated to increase the efficiency, reliability, and validity of the licensing examination process. The following activities will be perfomed:

o assess the problems and issues involved in the current examination process from examiner, candidate, and utility perspectives (NRR) o review examination practices in other applicable organizations (e.g.,

FAA, airlines, D0D, NASA, Coast Guard, and Educational Testing Service)

(NRR) o identify optimal format and procedures for each examination component, including:

- written (e.g., open-ended vs objective questions)

- simulator (e.g., generic vs plant-specific)

- oral (e.g., standardized vs individualized questions) to provide a model for evaluating proposed changes to the current examination process (NRR/RES) o develop standardized examination practices and guidelines, and train axaminers on test development, administration and grading techniques to assure consistency and reliability (NRR) o assess the impact of regionalization on examining procedure.:, practices and resources (NRR/01E) 3.3 Long-Tem Efforts

'A long-tem effort will be undertaken in FY-84 to identify state-of-the-art advances in testing, measurement, licensing and validation applicable to NPP operator examinations.

New strategies of licensing such as FAA's

" check-pilot concept" will be explored, and better training audit procedures will be used to assure candidate capability. Technological advances in operator licensing (e.g., computerized testing systems) will be evaluated.

Objective measures of on-the-job perfomance will be used to evaluate the perfomance-based validity of any new system selected, if available.

3.4 Industry Activities INP0's generic R0 and SRO job / task analysis will be a major input in the development of content valid examinations and will provide a basis for attempting to establish operator perfomance criteria. Pl ant-speci fic job / task analysis performed at individual sites will be used to the extent ~~

+

available. Utility training programs will be monitored to ensure con-sistency between training program curriculum and objectives, and the content and level of knowledge assessed in NRC examinations.

Subject-matter experts from utility operating staffs will also be used in the development of content valid examinations.

I 3.5 End Products The products of this program element include:

i o short-term modifications to existing examinations (FY-83/84) i o an improved examining process including examiner guidelines (FY-83/84) f o long-term improved examinations (FY-85)

I o modifications to 10 CFR Part 55 (FY-85) o recommended revisions to ANSI /ANS 3.5 " Nuclear Power Plant Simulators for Use in Operator Training" (FY-85) o revision of Regulatory Guide 1.149 " Nuclear Power Plant Simulators for use in Operator Training"(FY-85)

Figure III-3 depicts the sequence of activities leading to these end products.

3.6 Responsibility l

The responsibility for implenentation of the activities described in this program element is divided.

The Chief, Operator Licensing Branch (0LB),

NRR, is responsible for assuring regulatory requirements for the near term improvements in examinations and the examination process, for identifying research and standards needs to assist in implementing the regulatory process of examinations identifying required dates for products from research and for l

standards, and managing the NRR technical assistance program.

The Chief,

{

Human Factors Branch, EE3, is responsible for developing and managing the research to meet NRR requirements and to deliver the products in a timely manner consistent with quality and programmatic constraints.

The research will be carried out in accordance with the February 3,1982 established procedures for the NRC research process.

4. Procedures and Testing 1

The goal of this element is to ensure the adequacy and effectiveness of procedures and plant test programs.

Achievement of this goal will allow operators to maintain plant safety functions under all conditions, including the ability to control upset conditions without first having to diagnose the specific initiating events.

This goal will be met by:

(1) developing guidelines for preparing, and criteria for evaluating, emergency operating, operating, and 1

4 "1

~i

.____.____m

. _ _ _., -. ~,..

..,.m

.u

...m_

i

?

I l Re s wv..h a i,s. h.p.e.

c.,,,,. o,,,,,3,,,,,,...nc.

l 1

\\

in~'-C- ~~a O

l l

,~,o

\\

M s.e.s o..

pm.nt

...m.n..

. e iO.,.< t... Sei t...'

C 'V 88'.d.*.e *"

+

J.b.,7.sk l

h s.s R.s input IPWRI Od.atifv RO, ERO T..hs o

6., On 1'h. Job Cent.es.n R.I.e.d I semen.h.n V.kd.eeen 2'

....e

. i e d

..a s..s te.e WRi M..s.e.s o

i C

INPO J.bif.sh Analyses identdy Es tf.nty tap....W R,

~ _1.ss..n.

h.m C.nt.nl n

4.dg.s Sh.s ed

.nd Abate.s pe An.tyses.I V. led.te.n 68W R. PW RB w

Cues.no O

E se.nsn.se.n C.ntinu. h.m An.,vess.ad Cant.at V.hd.te.n (a3 ed.ntsfy Cuee.no.nd Opteen.8 R.I..f

(.ch E s.enen.se.n C mp.n.aq M. defy Es.m.nete

.ad Es.nien.to.n Pr.c.se 9.npr

.d Es. men.ts.n.

n a

enduste, inpue V

Y n

l o

...m tv

.d... - t

,e

.s.

fD scoustry Input Ve,e..t......_

4#9

.s ss ms.n.,ss e

,d.n i

.ith Cuev.at t s.msn.taan d

te.n.

R.c.mm.nd R.vi.i.n. t. ANSItANS 31 l

p.y En.m and 0

)(

Es.m Pe.c.ss l

g, R

4.. E e. men.te.n g

R.wis. Regel.a.ry Guede 1149

,vect.s ot e

_s o,..

..t e

OP g

lo p...

md.do d

.ed o-.

1, ne 3

Te.enmg 9.e Esemwi.es t/5

>o Inows te n C.mpee.ees.d t

R

s.,0 C.R. t..s.pp.

t.

g

...~.t..s o

g Pe.g.o. Re.tse.no I.

N 10 C.R Poet Sib r

i

.O C

fD E.t.btesh.ad M.snt.en C.snowe.nekd f a. men.te.n 3

O

' Fil Including industry input fr.m (D

Swt4.ca M.st.e Eap.ets I

I I

l I

I I

FY 83 l

FY 84 l

FY 85 l

other procedures which affect plant safety; and (2) upgrading the procedures, training the operators in their use, and implementing the upgraded procedures.

In aadition, the adequacy of the initial test program, to demonstrate that the facility will perform as predicted, will be reassessed.

The benefits which result from accomplishing this goal are:

o reduced risk to public health and safety through use of procedures which increase operator's ability to control upset conditions, including degraded core conditions.

o provide a framework for evaluating and integrating procedural fixes pro-posed as the resolution to unresolved safety issues into current procedures without introducing potential error in the other procedures areas.

4.1 Procedures Guidance and Criteria This effort will provide guidance to improve emergency operating procedures (E0Ps), abnormal operating procedures ( A0Ps), operating procedures (0Ps),

maintenance procedures (MPs), and procedures for emergency plan implementa-tion, refueling, auministration, safeguards, and security. It is anticipated that the methods employed in the generation of NUREG-0899, " Guidelines for the Preparation of Emergency Operating Procedures" will be followed in developing guidance for other procedures.

If required, industry will develop generic technical guidelines and the NRC and industry will coordinate the development of human factors guidelines.

NRR and 0IE are jointly developing inspection modules for use by the regions in auditing E0Ps.

Similar inspection modules will be developed for other procedures when guidelines for their upgrading are developed. The following activities are planned:

o develop guidelines for implementing revisions to E0Ps (NRR) o develop an inspection module and associated training for Regional j

audit of procedures (01E/NRR) l o develop guidelines for preparation of operating and maintenance procedures (NRR) o develop programs for upgrading other procedures (NRR) o develop methodologies / criteria for evaluating technical gui,delines and procedures (RES) o develop methodologies / criteria for human factors evaluation of procedures (e.g., readability, comprehensibility) (RES) o develop methods and evaluate alternative techniques and formats for presenting procedures (e.g., computerized CRT presentation) (RES) o develop methods and evaluate the in-plant effectiveness and impact ofupgradedprocedures(NRR/RES) !

i

4.2 Development of Test Program NRC has completed the short-term testing objective of verifying that maximum opportunity for operator training for off-normal events is made during the initial test program. The need for reassessing the adequacy of the initial test programs and revising Regulatory Guide 1.68, " Initial Test Programs for Water Cooled Nuclear Power Plants," will be determined in FY-84.

4.3 Industry Activities Owners' Groups, supported by the vendors, have developed generic E0P technical guidelines.

INP0 and industry have prepared a detailed writer's guide for licensees and applicants to use when preparing E0Ps.

EPRI has worked to ensure that efforts regarding the safety parameter display system (SPDS) are fully integrated with the symptom-based E0Ps.

4.4 End Products The products of this effort will be:

o the development of guidance similar to NUREG-0899 to be used by the industry to prepare upgraded MPs, AOPs, ops, and other procedures o the development of inspection modules for use by the Regional Offices for evaluating E0Ps (FY-83) and A0Ps, ops, MPs, and other procedures, as necessary (FY-85) o a review and evaluation of the adequacy of current initial test program requirements (FY-84) o the development of methology for evaluation of generic E0Ps Figure III-4 describes the sequence of activities leading to these end products.

4.5 Responsibility The responsibility for implementation of the activities described in this i

program element is divided.

The Chief, Procedures and Test Review Branch (PTRB), NRR, is responsible for the conduct of all NRR activities listed l

in Sections 4.1 and 4.2, identifying research and standards n'eeds to assist in implementing the regulatory process, identifying required dates for products from research and for standards, and managing the NRR technical assistance program. The Chief, Human Factors Branch, RES is responsible for developing and managing the research to meet NRR requirements and to deliver the products in a timely manner consistent with quality and programmatic constraints. The research will be carried out in accordance with the February 3,1982 established procedures for the NRC research process.

i -

_m l

I I

8 l oe.e op e.en Me R.

e e. A of f.o R

se.cee.. fe, A.d

e. iOP.

g 3 GOPs ENRR 08th

} Dovette Methods Cetterte for Heemes*

[

i I

I

,.c,...

en.f.OP.

P..,

4 0 ~,OP._

n..e.en O-e

.ve.e.M._... -. _

x..e

{ :

.e o

..~. - o e

Effectawenese end 0.npact of Upgeoded LOPS i

I l

.n l

C Rev.ow Cueeene MP. OP and AOP Pressec.s C,

t l

i Reveew Appacehae Sienderde f. MPe. ope and AOPe g

1 l

Review Cureens Messeech Lieneerwe en MPe. ops and AOPs Decaseest en Reguieteey Action with T

a**a ci '* ***. or= =n* aor=

Roweew Seaected Piene MPs. ope and AOPs y

I O

l n

l g

hseemene Appus etnehev et EOP Propeesseen Guedehnee INUmf G cegu Dewetop Gwide.enee for Propeession. Use.nd Devotes Requieterv Guidee l

to MP. OP and AOP Preparee6en Geddelenee Centree of MPs. OPo end AOPs l

l e

l 8

N ladustry Inpu, Develos Methodertrieeres fee Technical and E.a)

Human f actere Evalwetaan of MPs. ops and AOPs Of

. NEST I

e O

beispecteen Moduces fee R.
  • Aed.e of Trean Regiones Snepectore for U

Devesep MothederCreteese for tweauettne MPs. ops sad AOPs thRR/OtEt Aed6e of MPs. ops and AOPe l TOP Techmeel Guedesence (RE$)

e. Pro f u e 0,

Pr.

.. f de.

c e.,

l

'a" l

l

- l o=

l I

l l'

>o M.

l 4

Devese, Meehed fee Eweauseeae Ahernesewe Evoluese Tec' and,oreiste for Presenting Precedeseos (RES) 1.

e.

.e,n

.e fe. Presen Peece r.

Re,

i T

l I

l e+

g l

j g

osv e. R.v.s

.RP C p.

u. f.

d o

ARe.

1-n

.n.. n e f., e.e.a Prece e

l l

l C.

o g

g o

e.~,. Re.co.se -... P.e n A e.ec.

I I

l l

l l

2 t

l I

l l

i FY 83 I

FY 84 i

FY 85 I

i

5. Man-Machine Interface (MMI)

The goal of this element is to ensure the adequacy of the MMI in all aspects of NPP operation and maintenance relative to the safe performance of the man-machine system. This goal will be met by developing (1) htsnan factors engineering guidelines for correcting man-machine interface problems; and (2) regulatory guidance to assure that human factors engineering is appropriately integrated into new designs and incorporated into advanced technological improvements to existing designs.

The benefits which will result from accomplishing this goal are:

o significant reduction in htsnan errors through improvements in control rooms and plant design o efficient and effective job performance by operational personnel through improvements in control room design o enhanced (cost-efficient) operational performance and/or improved allocation of functions to man and machine o increased plant availability and safety thru effective maintenance activities The issues in this element are:

o extent to which regulatory positions should be developed for MMI issues beyond the control room o need for regulatory guidance on the use of advanced technologies A significant concern within this element is the issue of backfitting.

It is the position of the staff that SECY 82-111 be impicmented for all licensees.

Other MMI issues identified in this program plan are directed at providing evaluation tools for (1) the next generation of plants and (2) changes expected to be proposed by licensees such as upgraded systems for managing information and data and improved annunciator systems.

Also, these efforts will signi-ficantly improve the capability of the staff to evaluate reactor incidents j

involving man-machine interface errors and provide capability to evaluate advanced designs for the next generation of plants.

i 5.1 MMI Guidance for Existing Designs l

To date, regulatory attention has been primarily limited to those interfaces that exist in the control room and at the remote shutdown panel. Further guidance is needed regarding:

(1) maintenance; (2) local control stations and auxiliary operator interfaces; and (3) emergency response facilities and preparedness. Additional guidance may also be needed in the area of improve-ments to existing annunciator systems.

Maintenance l

l Activities dealing with the human factors approach to maintenance are designed l

to characterize the areas of emphasis and direction the staff should follow.

l The significant areas are: t i-

- -,c

,--, r -.-

e r--

o monitor and coordinate NRC activities related to maintenance, such as those addressing maintenance precedures, maintenance personnel qualifi-cationsandtraining,andMMIinmaintenanceactivities(NRR/RES) o monitor maintenance improvement activities of the nuclear industry, for example, INP0's efforts on reliability-centered maintenance and EPRI's work in preventive maintenance and job perfomance aids (NRR) o determine the appropriate extent of NRC's role in NPP maintenance (NRR) o davelop an additional General Design Criterion addressing hunan factors issues in maintenance (RES) o develop design-for-maintainability guidance for selected maintenance areas (NRR) o develop Regulatory Guides addressing maintainability guidelines and the application of human factors principles to the general issue of NPP i

maintenance (NRR/RES)

Local Control Stations and Auxiliary Operator Interfaces Information is required to enable the NRC to detemine if guidance on local control staticn design and auxiliary operator interfaces with these stations should be developed. This infomation will be developed through the following activities:

o conduct job / task analyses of control room crew activities to identify and describe communications and control links between the control room and auxiliary control stations (RES) o analyze auxiliary personnel functions based on control room crew task analyses to estimate the potential impact of errors to plant safety (NRR/RES) l Emergency Response Facilities and Preparedness l

To meet the intent of emergency preparedness requirements, several activities are planned:

o support OIE in developing emergency response facility (ERF) review procedures (NRR) o develop a criteria manual for emergency preparedness at fuel cycle facilities (NMSS/RES) t o analyze interfaces between licensees and Federal, State, and Local emergency t

j preparedness agencies to identify and correct potential weaknesses (RES) o evaluate the human factors considerations in licensee emergency notification and provide guidance as required (RES) -

~ v T C ~ T - -~'

T :5 X T L

~'

Improvements to Existing Annunciator Systems NUREG-0700, " Guidelines for Control Room Design Reviews" provides a " standard of quality" for annunciator systems which, if incorporated, should minimize the potential for human error associated with these systems.

However, some of these standards will be difficult to apply to existing control rooms except as long-term design modifications.

Also, an assessment of the impact of the NUREG-0700 guidelines on operating control rooms is needed to identify possible revisions to the guidelines.

The following activities are planned:

o develop guidance for near-tem annunciator improvements which adress techniques for implementing the quality standards of NUREG-0700 (NRR) o assess the impact on operating NPP control rooms of incorporating the features required to meet NUREG-0700 (NRR) o determine the feasibility of an operational aid system based on a combination of generalized annunciator alam prioritization and procedures (NRR/RES)

5. 2 MMI Guidance for Designs Based on Advanced Technologies Existing human engineering guidelines for NPP control rooms primarily address control, display, and infomation concepts and technologies which are now being used in process control systems. While these guidelines are adequate for assessing and upgrading the MMIs in the current generation of NPP's, they may not be sufficient for assessing advanced and developing technologies that may be introduced into existing and future generation designs. This concern will be addressed through investigation in the areas listed below.

Computers Presently, no NRC guidance is available concerning the management of data and infomation in the NPP control rocia during abnomal events, transients, and accidents.

During FY-83, NRR will develop a technical report on the uses of digital computers in control room operations.

The report will define functional uses of computers and rank these uses with regards to plant safety.

Based on the report, a program plan will be developed to evaluate important safety problems.

The program plan will be developed as a joint effort between NRR and RES.

Products of the program will include guidelines on control room infomation management during severe transients and accidents, Regulatory Guides on infomation management, and a regulatory position on the use of digital computers in control rooms.

Advanced Controls and Displays Presently 10 CFR Part 50.34(f), " Additional TMI-Related Requirements," requires each applicant for a light-water-reactor construction permit or manufacturing license to provide, for NRC review, a control room design that reflects state-of-the-art human factor principles.

To provide staff guidance pertinent to the Interface betwer new control and display techniques and the human operator, the following activities are planned:,,,

o develop evaluation methods and design criteria related to visual displays (NRR/RES) o establish criteria needed for regulatory assessment of advanced control room concepts (RES) o initiate a program to track new and developing technologies that have potential for application in NPP control rooms (NRR/RES) o investigate the feasibility and desirability of installing audio-visual recording systems in control rooms (NRR) o identify control and display requirements for crew response needs subsequent to seismic events (RES)

Function Allocation An integrated program plan for investigating function allocation will be developed to determine:

o the NPP functions involving a human component (NRR/RES) o whether current function allocations (especially in control rooms) permit reliable performance of functions assigned to humans (RES) o identify design changes which enhance function performance (NRR/RES) o the need to reallocate functions between the human and machine components of the NPP system (NRR/RES) o which functions should be reallocated (NRR/RES) o the feasibility /desirabilty of applying cognitive workload measurement techniques to a selected list of operator functions (RES)

The implementation of this program will provide data necessary for establish-ing a regulatory position on function allocation and the appropriate roles of the human components.

Advanced Annunciator Systems Advanced technologies are expected to be utilized in the development of improved NPP annunciator systems.

A regulatory position on longer-term annunciator improvements will be developed based on an evaluation of results from EPRI, RES, Halden, and other advanced concept activities at Seabrook and Savannah River. NRR will develop the regulatory position.

Safety Status Indication Based on a current project investigating means for monitoring and verifying operations, tests, and maintenance activities, the staff will make a preliminary determination concerning: _ _....

l i

o the adequacy of operational systems designed to be in conformance with Regulatory Guide 1.47 (NRR) 1 o the comparative adequacy of status monitoring in plants that do not have automaticmonitoringsystems(NRR) o the development of long-term improvement guidance addressing the feasi-bility and value/ impact of instrumentation backfits and the application of state-of-the-art logic schemes (NRR/RES) 5.3 Industry Activities The nuclear industry has several efforts devoted to MMI issues. INP0 and EPRI programs in the area of maintenance and EPRI's work on backfitting

~

annunciator improvements, control room enhancement, and display research for the safety parameter display system are all contributing significantly to the resolution of human factors concerns in the control room.

5.4 End Products i'

The products of this element include:

o a technical report addressing design-for-raaintainability (FY-84) (NRR) i o regulatory position addressing local control stations and auxiliary operation interfaces (FY-84) (NRR) o emergency response facilities (ERF)(NRR/RES) review procedures (FY-83) and ERF review reports (through FY-85)

I.

o a technical report addressing near-tem annunciator improvement (FY-83) and long-tem improvement (FY-84) (NRR) o a technical report on control room information management during severe transients and accidents (FY-84) (RES) o a technical report on the use of computers for data and infomation management in control rooms (FY-84) (RES) o a Regulatory Guide on information management methods (FY-85) (RES) o a report on the means for investigating function allocation (FY-84) (RES) o a Regulatory Guide on advanced annunciator design and opera' tion (FY-85) (RES) o a technical report addressing safety system status monitoring (FY-85) (NRR) l o report on the need for automatic system status monitoring systems (FY-84) o revision to Regulatory Guide 1.47 (FY-85) (RES).

Figure III - 5 describe the sequences of activities leading to these end products. l:: L.

L ~ '

LC

'r 7

~ ~ ~ ~

T 2

I e

l M AINTENANCE I

u.m..n. c. P -.ou...

l

]

tadu.vey Input Gued. n..,nput

.g

..m..n.nc. P....an.,

l 3

R ech it.meng input O

'"P"'

M.mt.n.nc. P.t..an.4

[

FV 82 Pe.ge.m st.ffsag input h

7 P..a sapus l

,ui o. e.

n..m.,,,,t.o,e...

o-ison Nac. a w.

ns. u.m c.

l is 3

o.v.8.p R.gul.t.rv Guld..n M.,nt.n.nc.

3 9g Pene C.n.e.4 D. sign Cett.ri. Adde...mg Hu.n.n F.ct.e.

s

.n..m..n.n..

.n.u.

4........_........

_.n.

t. c.n
n..

l o[

M.an..n.ac. (RE SS R

ech tnput ;

I l

l

{

g go

c...

.c. iansi a

I 3

g 8

M CD 0

l%3 "1.g EPRt. (NPO. Indo.try M. ins.n.ac.,mpe.vem.no Acetwit...

l y

g De 2

t O

(D 3*

l a

toCAL CONTROL STATIONS I

e '

4

.a C,Ans.s..e Poe i.s Ps.ne s.v.tv smp-e from A.isi.evA y

v o.t.rmin. N d v.e R. gut. tory

,s w

7

,,,,,,,,,,,,,,,c,,,,,,,,,,,,,

I y,

o ign/Austh.ry Op.e.;or le t.tfun l

<D

.Oe i

g v 6 ans,.i..e c unic.r.n.ico.s iinn. e. m..n coni..

o....p ound.ne..n toc. coners si.ei.n o ign g

n toc., con..

s,.. n... s.

I ID O

D INPO JoblT h An.s.a.

.n v

~~*

o 1

l b

w I

i I

I I

FY 83 l

FY 84 P/ 85

l EMERGENCY RESPONSE FACILITIES l

l l

l

~

l

_ iD

.R.

c c

-t.m

..n.. R _..

At. R

,se.

I

,,-ed.,ee e,

t I

I (D

l w

'l De.ete Re.

..ee, pee.t.ene Ad e.e.n.

7 g_

.m

.._ y..t.t._

e l ANNUNCIATORS E

m.

I i

7

.n.,uste..

t i

i n

T l

l 2

-

  • Publesh Update Sect 6en 6 3 of NUREG OMO A

Publish Deeft Guidelinee for Advanced e

l Sheet Term Y

e Annunciater Systems im.

mer,t M

Technical Report Revise SAP Chaptoe 18 9

(D "z

Technical Report Addressing Advanced Develop Regulatory Posetion on leeue Regulatory Guide on Annuncletor O

Annunciato# Systems Annunc.atee System impeovements N

System Design and Operst6cn 8

Industry input 3=

l t

n l

1 d

l I

Reneerch input l

.c 1

.a.

d Develop and Demonstrate Ateem Price 6tenecion Methode s

.ct i

C l

(D l

s O

l (D

i

?

n o

I J.

l Cp O

e

~

O I

I l

FY 83 l

FY 84 i

FY 85

~

1

)

a

+

j l

l

'E ADVANCED CONTROLS AND DISPLAYS l

i l

t lI fD o

s.e o ign C,6t.n. f.,

Ad..nc.d ve on.ps.v.

l

...T-.

.=

i l

l l

y

[ o i i n c,i l

cj

=

v o..

I x,

e i

n l

E

o. ii., c, e., n....., a.

m.n..,

o w owman s

    • .nc.4 4

g

~

...n.

c..

a,.m.

c

..Iamc-T. mw. in.

s 1

e e

to 3

T,.ch N nd o...l. ping T.chn y

f f

g a

o c...

,o..

C

.n,,c.n

.nooi.,i.,n w.

e.,c, io m

.g n

se soi i s.i.

es inesi f(, o

n. F i sii,., a.46. vi.

yn. conn.

c.

n_.

&v FUNCTION ALLOCATION v.

<D

.O C

to=

id.ntif, Ps.no F. net 6.n. in..s.ing id.nsity sy.e.m Ch ng Which WlH Enh.nc. F.n.tl.n P.,f m.nc.

gg H.m.n comp.a.nt.

l n

Hom.n R.ii.hdit, inp.t l

o

.e. R.gui.e.ry v

ce P 6te.n n Femett.n

'g o i., c,s

...i a

n.,,.

s.m.,. i.. m

==..*,n l

u..,,,,-.

i ao i-0,,

l ooo so

,in N

in.-i

.. co.

. Wo.mi. u

...m.n. v hn o

, conn, ming r.n.

a n.

o.es.i.n u d.s svelo.iion snoon

[

l

.n..ii.w.,..

LER Stod, FY 83 I

FY 84 I

FY 85 o

I SAFETY STATUS INDICATION l

-l to C

7 (D

Develop Ouldennes for improvement of Safety System Develop Ouldeunes for Advanced Revise Regulatory Guide f.47 M

Status Monitors safety System Status Monetore N*

i w

1 O

t.FI e

Inweestgete Need for Automatic Status g

Monsterme Systems 3

i>

g Evoluete Effectivenese of Automatic and n7

' Non Automatic Systeme a

3*

I

~

COMPUTERS 8

(D laduatey input N

Ar O

I (D

.3m Propero Tecimical Report on (Joe of Develop Detailed Program Plan for Evolueting O

(g g

s*

s ct Computere in Control Roome Control Room Data and information Requiremente

.,s.

s d

Develoo GuideHnes for Control Room infeemetion Management pur:ng Severe Transeents and Acckfeats

(.4 (D

Develop Regulatory Guides on taformotion l

g M.n.g.,r..at o

CD ev Develop Regulatory Poeltton on Use

,1 Ar so of Computers in Control Roome CD 1

I O

b v

t l5 I

FY 83 FY 84 I

FY 85 i

'I

.1 i,

=.

=

i I

5.5 Responsibility The responsibility for implementation of the activities described in this program element is divided. The Chief, Human Factors Enginering Branch (HFEB), NRR, is responsible for the conduct of all NRR activities listed in Sections 5.1 and 5.2, identifying research and standards needs to assist in implementing the regulatory process, identifying required dates for products from research and for standards, and managing the NRR technical assistance program. Tne Chief, Human Factors Branch, RES, is responsible for developing and managing the research to meet NRR requirements and to deliver the pro-ducts in a timely manner consistent with quality and programmatic constraints.

The research will be carried out in accordance with the February 3,1982 established procedures for the NRC research process.

6.

Management and Organization The goal of this element is to ensure the adequacy of utility management and organizational design for safe nuclear power plant operation. This goal will be met by accomplishment of the following objectives: (1) develop management and organization guidelines for ensuring acceptable management and organizational practices during plant design, construction, and operation; (2) develop and implement reliable, objective performance evaluation procedures for use by the staff in assessing the effectiveness of management and organiza-tional functions, such as operations, security, technical support, and safety review committees, and characteristics such as communications and attitudes toward safety; and (3) develop in coordination / cooperation with INP0 a training program for prospective plant managers, and other appropriate managers.

The benefits which will result from accomplishing this goal are:

o reduction of the number and. severity of issues that could lead to unsafe NPP conditions o a better focused, safety sensitized organization with resources to support technical issues o a management and organizational design which is responsive to resolution of technical issues, and allocates resources and responsibility to ensure public health and safety The issues of concern in this element are:

o lack of objective measures to assess management and organization o sensitivity of industry to regulation of their management 6.1 Management and Organization Guidelines Revised guidelines will be developed that emphasize the responsibility of the utilities to develop and justify management and organization plans.

These revised guidelines will be revised through accomplishment of the following activities: ?.

~;:. _ - _L. _ _

J L :,~ : * ~~W w "W

o analyze current industry efforts in management and organization planning by reviewing Safety Analysis Reports, by reviewing selected management and planning documents from utilities, and by reviewing related industry practices to provide a standard set of descriptors (NRR) o determine which management and organizational elements (e.g., individuals, safety review groups, communications throughout the utility, and overall corporate structure) relate directly or indirectly to safety.

This task wi"1 be done by reviewing existing documentation and applicable literature, incorporating the views of management and organization subject matter specialists, incorporating the views of nuclear industry specialists, and by analyzing available data on elements related to management and organization and data related to indicators of safety (NRR/RES) o establish safety performance standards by deriving empirically the relation-ships between organizational and management practices and safety related perfonnance outcomes symptomatic of general olant safety, nuclear safety, and plant security.

Research is currently underway investigating alternative approaches for accomplishing this task (RES) o identify innovative ways in which organization and management can be structured to optimize plant and public safety. This will be accomplished through analysis and enhancement modeling of organization and management functions and roles, in conjunction with subject matter experts from NRC licensing and inspection activities, and from the nuclear industry (RES) o identify those management and organization elements which are appropriate to regulation (NRR/RES) o conduct industry reviews, advisory panel meetings, and several pilot tests of applicants and selected licensees (NRR) o working with industry, assess the appropriate licensing or certification program for key utility employees (e.g., Prospective Plant Superintendents, Maintenance Managers, etc) (NRR/RES)

6. 2 NRC Assessment Procedures Results of the management and organization guidelines effort will be used to revise assessment procedures and modify the SRP.

Two tasks are involved in developing assessment procedures or review documents tc be used by the NRC in judging the adequacy of utility management and organization.

These are (1) a review document containing criteria to be used to assess utility written submissions on their management and organization plans, and (2) a review document with protocols for site visits or incident reviews by the NRC.

In addition, technical reviewers will be trained to improve interview capabilities.

This will involve training workshops on the use of the revised SRP and developing a reviewer handbook for use while conducting onsite reviews.

m._ ~,.__,,

6.3 Industry Activities As approved by the Commission, the number of Performance Appraisal Team (PAT) inspections has been reduced in recognition of similar plant evaluations conducted by INP0.

NRC review of INP0 effectiveaess in this program has been arranged through a NRC-INP0 coordination plan.

INP0 has also initiated a program to evaluate utility management for plants under construction.

To date this is accomplished by self-initiated evaluations by the utilities using criteria supplied by INPO, but INP0 may conduct on-site evaluations at a later date.

INP0 has also started a program of workshops for utility managers to assure that they are committed to quality work in conformance with applicable guides and regulations.

6.4 End Products NRR has developed draft guidelines that will be pilot tested and revised in FY-84, with interim guidelines being published in FY-85.

The interim guidelines will be used by the industry and NRC until experience using i

the guidance or new information generated by RES efforts is available.

At that time, the interim guidelines will be changed or finalized as appropriate.

In addition, Chapters 13.1 and 13.4 of the SRP will be revised (FY-84).

Figure III-6 describes the sequence of activities that lead to these end products.

6.5 Responsibility The responsibility for implementation of the activities described in this program element is divided.

The Chief, Licensee Qualifications Branch (LQB),

NRR, is responsible for the conduct of all NRR activites listed in Sections 6.1 and 6.2, identifying research and standards needs to assist in implementing the regulatory process, identifying required dates for products from research and for standards, and managing the NRR technical assistance program.

The Chief, Human Factors Branch, RES, is responsible for develcping and l-managing the research to meet NRR requirements and to deliver the products in a timely manner consistent with quality and programmatic constraints.

t The research will be carried out in accordance with the Febraury 3,1982 established procedures for the NRC research process.

1 l i

-+a---

J L JL Jk l

=

u CO 33 l

3 8'

1o a

E l

9 3

.E t

8

= a a

t t

-O N

s.

3

()

e 1

I h

1 i

c 2

g i

i.

i.

I 2

5 E

q

?

E b

i i

M 5

?

i t.

i m

e a

j s

2 5

i

}

E j

I

=

}

e f

I i

i t

l

(

j }

f 2

e r

a 1

I I

5 I*

- -(. - -

i 3

a

-.J..

]

i k 1 2 2

d I

2 f

2 g

a 1 i

c u:

-g i

a i n

]

}

}

T i

=

]

3 g

g l

6 3

aj i 1

2 4

1 1

e l g

3 f

g

}

=

a g

c o 3

g g

2 1

E 6

F l

j 1

3 I

2

  • 3

.x o

j ii I

I i

o O.

t s.

i i

=

u.

g>

3 8

2 C **

'O i

j e

e 3

o i

l 4

5 E

e 3

8 f

.f

.M,a e

1 2 2 8

i j

s r i

=

3 g Eg y

3 w

e o

r= 3a o 8

a i e !

e i

sa 3 i5 2 s :e

-i 3

]

i l

3 3

7 o

3 at 3 fi

[

A

    • 5

?

I..

t u

3o5 s
  1. I E

2 3

5 i

J 4

E i

i.

=

je g 1

1. 4 I. *t j *[

-4 5 I

3 o

a l

--.(3

  • _ _~. _ ~

__ iy

/3

~c

~

l I

I I

I l

l Figure III-6. Management and Organization Activity Sequence 36 -

g. y_,... _ _ _

.,3.... g

IV. LONG RANGE RESEARCH A.

Introduction The human factors research program elements described in Section III of this program plan were developed to meet the NRC's short-tenn (FY-83 through FY-85) objectives and are aimed primarily at developing data to address current regulatory issues involving commercial NPP's.

The purpose of this Section is to provide a general description of research efforts that RES is planning in anticipation of requests by user offices for long-term (beyond FY-85) research in human factors.

B.

Program Elements The six program elements of the anticipated long-term hunan factors research program will address applicable human factors needs for five general types of licensed facilities. These are: advanced Light Water Reactor (LWR) nuclear power plant design concepts, non-LWR nuclear power plants, test reactors, fuel cycle facilities, and unresolved human factors needs for current LWR nuclear power plants.

1.

Staffing and Qualifications Research Research beyond FY-85 is in preliminary planning to address staffing and qualification needs for each of the five general types of licensed facilities discussed above.

The research methods and techniques developed through FY-85 are expected to be generally applicable; however, the unique or different technology requirements for non-LWR power reactors such as the liquid metal fast breeder reactor (LMFBR) and fuel cycle facilities such as reprocessing plants may necessitate the development of new ways to assess staffing and

. qualifications of personnel.

An example of.an area of anticipated concern is that over the next decade p

the increasing demand for operators may result in a significant change in i

the population requirements. This change will be driven by both the increased need for operators which may overtax traditional sources and the change in the nature of the operator's job as control rooms move towards advanced technology applications in new display and control concepts, greater computerization, and automation. Research may be needed to detennine what effect, if any, these changes will have on staffing and qualification requi rements.

2.

Training Research I

Just as new technology and naw applications may require changes in staffing ano qualifications, so they may also have impact on training and retraining.

FY-86 through FY-89 research for training is in preliminary planning to estab-l lish criteria which can be used to determine the adequacy of training programs for the five general areas.

Examples of anticipated research projects are:

development of valid and reliable operator performance measures, collection of job / task analysis data, and development of the operator examination data 1

l !_.

5 i

7 ba k.

Additionally, anticipated changes in control room design, specifi-cally, increased computerization and incorporation of advanced control and display systems, can be expected to require research to develop new training 4

evaluation data and methods.

3.

Examination Research 4

Current research in the area of operator examination is focused on assuring that the R0 and SR0 examinations reliably and validly measure the operator's ability to safely operate the plant. The effectiveness of the examination i

process for reactor operators may need to be investigated in light of the anticipated change in the population of reactor operators due to the i

changing nature of the job (e.g., automation and computerization in advanced control rooms) and the rapidly increasing demand for operators caused by both the increasing ntsnber of operating NPP's and the requirements for more operators on shift.

l Research on non-LWR power plants and fuel cycle facilities is in preliminary planning to determine which positions should be licensed or certified and what i

are the most effective methods for examination including determination of examiner qualifications.

i 4.

Procedures Research l

Long-term research is in preliminary planning to address procedures and job i

aids for the five general areas. The interaction of increased information availability, personnel information requirements, and computerized / job aios are expected to create new procedure requirements. Anticipated effects of j

computerized large data base management systems and memories may require research to evaluate the adequacy of the then-existing regulations and guide-lines for procedures. The research program on procedures will provide the I

technical basis for appropriate regulatory actions, with particular emphasis

[

in the area of maintenance procedures.

I

(

5.

Man-Machine Interface Research beyond."Y-85 should be directed toward assuring an adequate base for regulation of new MMI design concepts which can be expected in the next decade.

The new concepts will arise from several sources: applications of technologies such as video display terminals, artificial intelligence, l

or synthetic voice interaction between computer and user. Automation t

of many control room functions can be expected in future design concepts.

l Research plans to provide the technical data base for criteria, Regulatory i

Guidelines, and standards for such topics as: effects of automation on manual backup operations; supervisory control systems, computerization and display of procedures, and analysis of cognitive data management systems.

Research will be continued on the effects of severe stress (e.g., severe seismic events) on human perfonnance with respect to safe operations.

38 -

'**ge***esN 4=ie ey e-

-+re-e

= -

g=

mow-.

, w#

p-

=,

e

- e e-g p.

-m39-

.,s4.--.

ogg== s es e*gm y g y my,qase m

6.

Management and Organization The near-term focus in management and organizational research is on manage-ment and organizational functions (operations and safeguards) for current LWR power plant operations. While these human factors activities address, in general, NRC immediate and short-term requirements and respond to Human Factors Society recommendations in the management area, they do not address other important nuclear industry organization and management responsibilities that affect the public safety.

Research is in preliminary planning to develop a better understanding of the full range of management roles in LWRs relative to public safety and to provide a technical basis for appropriate regulatory action in this area.

Human factors research on management and organization is in preliminary planning to address the four other general areas of interest.

Considerable differences in management structure and objectives, particularly for fuel cycle facilities, likely will be identified.

The methods and information gained in FY-83 through FY-85 will be appropriately applied to those concerns of interest.

C.

Human Reliability Integration The six elements are supported by human factors research for the development of human reliability data, data storage and retrieval methods and human reliability models.

The principal hunan reliability research emphasis in FY-86 through FY-89, will be refinement of the human performance data bank which was developed in FY-82 through FY-85, applications of the maintenance perfnrmance model developed in the same time period; and, verification of the cognitive models and error analysis techniques which were initiated in late FY-84.

Lessons learned through application of these human reliability products in NPPs probabilistic risk assessments will provide valuable feedback to determine the adequacy of data and models.

r L

L l

I l

l L

r

.. ~

APPENDIX A TMI ACTION PLAN STATUS The two tables of this Appendix present the status of the TMI Action Plan items (NUREG-0660/0737). Table A-1 provides the staff review status for those items that have been or are in the process of being implemented.

The status applies to operating reactors. For OL applicants, the status is " continuing" for all items. Staff developmental efforts for these items are essentially complete; however, some items have been resolved on the basis of a short-tenn solution, and staff efforts to improve the technical quality of these solutions will continue. Tnese efforts are described in the individual program elements and are also repeated in Table A-2.

Table A-2 identifies those Action Plan items' which are still under develop-ment, or which require additional staff action to provide technical improve-ment. References are to the program element schedules given in Appendix C.

The schedules for completing these items have been compared with the recommended prioritization plan described in NUREG-0933, "A Prioritization of Generic Safety Issues." The NUREG-0933 priorities are shown in parentheses after the title of the Action Item.

The prioritization coding is as follows:

HIGH - Strong efforts to achieve practical resolution are appropriate.

MED - The potential for safety improvement may be substantial and worthwhile.

LO

- Safety deficiency is minor and does not merit substantial attention. Little or no prospect for substantial / worth-while improvement.

TBD - Priority not yet established.

TMI - Implementation mandated by NUREG-0737.

LI

- Licensing improvement issue - not prioritized.

The staff's estimated completion dates have taken into account these priorities, along with considerations of the additional time required to resolve the individual action items, and available staff resources.

A-1 f-.,-,.--..

-:~----

- -, ~ -

w~~~~~

T

OPERATING PRIMARY REACTOR REFERENCE REVIEW ITEM TITLE DOCUMENT STATUS:

1. A.I.1 Shift Technical Advisor NUREG-0737 Complete I.A.1.A Shift Supervisor Administrator Duties NUREG-0660 Compl ete I.A.1.3 Shift Manning NUREG-0737 Compl ete I.A.2.1 Immediate Upgrading of Reactor Operator NUREG-0737 Complete and Senior Reactor Operator Training and Qualifications I.A.2.3 Administration of Training Prograns NUREG-0737 Complete I.A.3.1 Revise Scope and Criteria for Licensing NUREG-0737 Continuing Examinations I

I. A. 4.1 Initial Simulator Improvement NUREG-0660 Compl ete I.B.l.2 Independent Safety Engineering Group NUREG-0737 N/A I.C.1 Guidance for the Evaluation & Develop-NUREG-0737 Continuing ment of Procedures for Transients and Accidents I.C.2 Shift and Relief Turnover Procedures NUREG-0660 Complete

[

I.C.3 Shift Supervisor Responsibilities NUREG-0660 Complete I.C.4 Control Room Access NUREG-0660 Compl ete 2

I.C.5 Procedures for Feedback of Operating NUREG-0737 Complete Experience to Plant Staff I.C.6 Guidance on Procedures for Verifying NUREG-0737 Complete Correct Performan e of Operating Activities I.C.7 NSSS Vendor Review of Procedures NUREG-0660 N/A I.C.8 Pilot Monitoring of Selected Emergency NUREG-0660 N/A Procedures for NT0L Applicants j

I.D.1 Control Room Design Reviews SECY 82-111 In process l

1.D.2 Plant Safety Parameter Display Console SECY 82-111 In process II.B.4 Training for Mitigating Core Damage NUREG-0737 In process Table A-1.

TMI Action Plan Status - Implementation A-2

._s,.

APPENDIX C ESTIMATED ITEM TITLE REFERENCE COMPLETION DATE l

1. A.l.1 Shift Technical Advisor (TMI) 1.2 4QFY83 I. A.1.3 ShiftManning(TMI) 1.2,1.4 FY84
1. A.l.4 Long-term Upgrade of Operating 1.3, 1.4 FY85 Personnel and Staffing (TBD)

I.A.2.2 Training & Qualifications of Operational Personnel 1.3, 2.1 4QFY84 (HIGH)

I.A.2.3 Administration of Training Programs (TMI) 2.2 4QFY84 I.A.2.4 NRR Participation in Inspector Training (LI) 4QFY84 1.A.2.5 Plant Drills (LO) 2QFY83 I.A.2.6 Long-term Upgrading of Training & Qualifications 1.1, 2.1 3QFY84 (TBD)

I.A.2.7 Accreditation of Training Institutions (MED) 2.2 4QFY85 I.A.3.1 Revise Scope & Criteria for Licensing Examinations 3.1 4QFY83 (T!!I')

1.A.3.2 Operator Licensing Program Changes (MED) 3.1, 3.2 4QFY84

~

I.A.3.3 Requirements for Operator Fitness (TBD) 1.3 FY84 I.A.3.5 Establish Statements of Understanding with Continuing INP0 & DOE (LI)

I. A.4.1 Initial Simulator Improvement (TBD) 2.1 4QFY83 1.A.4.2 Long-Term Training Simulator Upgrade (TBD) 2.1 FY85 I. B.l.1 Organization & Managment Long-Term Improvements 6.1 3QFY83 j

(MED)

I.B.l.2 Evaluatin of Organization & Management Improvements 6.1, 6.2 4QFY83 3

(TMI)

I.C.6 Guidance on Procedures for Verifying Correct 4.1 -

4QFY83 Performance of Operating Activities (TMI)

I.C.9 Long-Tenn Program Plan for Upgrading of Procedures 4.1 4QFY84 (MED) 1.D.3 Safety System Status Monitoring (MED) 5.2.5 4QFY85 I.D.4 Control Room Design Standard (TBD) 5.1, 5.2 4QFY84 I.D.5 Improved Control Room Instrunentation Research (TBD)S.2 4QFY89 II.B.4 Training for Mitigating Core Damage (TMI) 4QFY83 Table A-2.

TMI Action Plan Status - Developnent A-3

>-e x-Nv

APPENDIX B HUMAN FACTORS SOCIETY RECOMMENDATIONS AND THEIR i

CORRELATION WITH STAFF PROGRAMS IN HUMAN FACTORS INTRODUCTION The findings of the THI-2 Lessons Learned Task Force emphasized the importance of human performance in nuclear power plant safety. Subsequently, the NRC contracted with the Human Factors Society (HFS) to develop a long range program plan which could serve as a basis for incorporating human factors considerations into NRC regulation and research activities.

Beginning in December 1980, a Working Group of selected members of the Society reviewed human factors activities in the NRC and throughout the nuclear industry. A three-volume Final Report, " Critical Human Factors Issues in Nuclear Power Plant Regulations and Recomended Comprehensive Human Factors Long-Range Plan," NUREG/CR-2833, was published and issued by the NRC in August 1982.

This appendix sunmarizes and compares the 51 major recommendations from the HFS report along with the staff's program of human factors regulatory and research activities.

NRC or industry activities (either completed or now underway) address 40 of these 51 recommendations. Six of the recommendations are under active consideration. Activities to implenent these recanmendations have not yet been initiated.

The staff finds another 2 recommendations as not being human factors activities that are applicable to this plan, and disagrees in part with 3 of the recanmendations. The staff disagreements relate to the Safety Parameters Display System (SPDS) and to the proper consideration of human error in Probabilistic Risk Assessment (PRA). The HFS recommends that a systems analysis be conducted to determine the need for a SPDS.

The staff does not agree, and believes that the SPDS requirements as given in SECY 82-111 are appropriate.

In the first of the remaining two disagree-ments, the HFS recanmends reduction in the level of research being conducted relative to human error assessment.

The plan continues research support in this area, primarily to develop an adequate data base so that human reliability (and error) can be more effectively considered in PRA.

Revised approaches to human reliability in PRA are also being investigated.

In the second disagreement, the HFS recommends that research emphasis should be shifted from error modeling and risk assessment to design analysis.

The staff believes both human error risk assessment and design analysis to be important; both are included in the plan.

Using the Appendix A catalog of the human factors recommendations are provided on the following pages. These recommendations are cross-referenced with corresponding staff activities.

The explanation of the headings used to present each HFS recommendation are as follows:

Para.

Page - The Society's Report, Volume 2, contains the detailed recommendations.

Paragraph and page references are listed for each recanmendation.

The title of the Recommendation as used in the Society's Topic Report.

- B -.,,

v.

Following the title, these symbols are used:

High importance rank is recanmended by the Society for H

action by the NRC Medium importance rank is recommended by the Society for M

action by the NRC Low importance rank is recanmended by the Society for L

action by the NRC Recommendation should be following immediately; or 1

The number of years within which the effort should be (nunber) undertaken according to the Society.

The status refers to the NRC current or planned action in Status response to the Society's recommendation:

The Recommendation is under consideration at this time Pending In Place The Recommendation has been followed and the needed i

action has been completed.

The Recommendation is being accomplished by one or Underway more programs in NRR and/or RES.

Part or all of the staff do not concur with the i

Disagree Recommendation.

Resolution of the disagreement may take some time.

W B-2

Activity Para. Page Topic Status Reference

  • 4.2 General Human Factors Problem Areas 4.2.1 292 Professional Human Factors Quali-In Place fications in Nuclear Power (H;I) 4.2.2 293 NRCOrganization(H;I)

Modified Action Underway 4.2.3 294 System Integration (H;6-10)

Modified Action Underway 4.2.4 296 Safety Related E Underway 5.2.2 Classification (quipnent H;I) 4.2.5 297 Ar.alysis and Evaluation Underway of Operational Data (H;1-2) 4.2.6 298 The Human's Role in Increasingly Underway Section Automated Systems 111.5.2 4.2.7 299 Risk Assessment and Human Di sagree Reliability - reduce current high level of research 4.2.8 300 Evaluation Criteria (H;I)

Underway 3.1 4.2.9 302 System Engineering of the Underway Regulatory Requirements (H;I) 4.3 Human Engineering Problem Areas 4.3.1 304 Design Induced Error

  • References are to Appendix C unless otherwise noted.

B-3 j

_. w..., ~

__~.,

Activity Para. Page Topic Status Reference a.

305 Implement NUREG-0700 as a Modi fied SECY 82-111 Requirement; Prepare Maintain-Action 5.1.1 ability Equivalent (H;I)

Underway b.

306 Guidelines for Emergency Underway 5.1. 2 Shutdown Panel Design (M; 3-5) c.

306 Guidelines for Local Control Underway 5.1. 2 Stations (M; 3-5) d.

306 Color coding study (M; 6-10)

Underway 5.2.2 e.

307 Advanced display technology Underway 5.2.2 research(M;l-3) 4.3.2 307 Inconsistent Control Room Pending and Plant Design 4.3.3 308 Annunciators and Alanns a.

308 Require adherence to Section Modified Action 6.3 of NUREG-0700 (H;I)

Underway b.

309 Standard or specification for Underway 5.1. 4

' traditional' annunciators (H;l-2) c.

309 Issue alarm requirements for Underway 5.1. 4

' traditional' annunciators l

(H;l-2)

I f

d.

310 Expand system status verification Underway 5.2.5 guidelines research (H; l-3) 1

+

B-4

Activity Para. Page Topic Status Reference 4.3.4 310 Design for Maintainability a.

310 Research emphasis should be Disagree -

Section shifted from error modeling/

both activities II.G risk assessment to design are important.

analysis Both are under-way now.

b.

311 Publish engineering design Underway 5.1.1 criteria guidelines for main-tenance (H; 1-2) c.

311 Sponsor studies for better pro-Pending Section tective clothing, tools and 111.5.1 instruments (M;3-5) 4.3.5 311 Design Freeze - Relative merits Pending 5.1. 2 vs current ratchet process (H;1-2) 4.4 Problems in Procedures and Job l

Performance Aids 4.4.1 314 Specifications for Procedures Underway 4.1 Development - NRC to assume responsibility for non plant-specific specifications (H; 1-3) i 4.4.2 314 Procedure Development Process -

Underway 4.1 Utilities to develop plant-specific guidelines, NRC to review for compliance (H; 3-5) 4.4.3 315

. lob Performance Aids - Establish Underway 4.1 the requirements for hard copy, electronic and computer based JPAs (H; 3-5) i B-5 e

Activity Para. Page Topic Status Reference 4.4.4 316 Formats for Procedures and JPAs Underway 4.1

- Develop guidelines for accept-able JPA fomats (H; 1-3) 4.4.5 317 Procedure Implementation and Underway 4.1 Revision - Detemine effective process for implementing and revising 0&M procedures (L; 6-10) l 4.4.6 318 Performance Verification - Study Underway

5. 2. 5 l

development of an automatic system status monitoring device (M; 6-10) 4.4.7 318 Change of Shift Procedures -

Underway 1.1 Establish criteria for accom-plishing effective change-of-shift procedures (H; 1-2) 4.5 Personnel and Staffing Problems 4.5.1 321 Selection - Practices and Standards a.

321 Validation of current and new Industry effort 1.4 selection procedures (H) underway.

Not i

a NRC function.

I b.

322 Research on Performance Under Underway Sections Stress (H; 1-2) 111.5.1 l

f IV.5 L

c.

322 Monitor & evaluate behavioral Pending 1.2 reliability program (M) d.

322 Research new technology testing Underway 1.2 L

procedures (L;6-10) 9 B-6

~,.... - -.

Activity Pa ra. Page Topic Status Reference 4.5.2 323 Operator Certification and Licensing a.

324 Develop objective performance Underway 1.2 standards (H; 1-2) b.

324 Research to develop specific Underway 1.2 qualification requirements for non-licensed pcesonnel (H; 1-2) c.

325 Develop methods to assess and Underway 2.2 track in-plant training programs (L; 6-10) d.

325 Experience requirements Underway 1.2 for qualification of R0s, SR0s and SSs, and bases for trading experience and education (M; 1-2) 4.5.3 325 Staffing and Organizational Underway 1.2 Characteristics - Develop criteria for assessnent of staffing and organizational variables effects (M; 3-5) 4.5.4 327 Shift Duration & Rotation Pending 1.3

- Determine whether and under what conditions operator performance deteriorates.

Identi fy sensitive variables. Add to LER system (H; 1-2)

B-7

Activity Para. Page Topic Status Reference 4.5.5 330 Factors Affecting Job Industry effort 1.4 Satisfaction - Establish unde rway. Not recent turnover rates, a NRC function.

and, if excessive, identify causes and changes needed to reduce them (H; I) 4.6 Problem areas in training

4. 6.1 333 Instructional System Development a.

335 Establish NRC coordinator In Place for training-related R&D NRR/DHFS/LQB efforts (H; I)

Section Leader b.

335 Publish a Regulatory Guide Underway 2.2 for Instructional System Development (ISD) procedures (H; 1-2) c.

336 Research in retention of Underway Section critical skills and knowledges 111.2.1 i

(H; 3-5) 4.6.2 336 Licensed Personnel Training -

In Place Sections Adopt the recanmendations 111.2.1 of NUREG/CR-1750, Section 111.2.2 2.10 (H; I) 4.6.3 338 Non-Licensed Personnel Training Underway 2.1

- Adopt the recommendation of NUREG/CR-1750, Section 2.10 for non-licensed personnel (H; I) e B-8

-~,

Activity Para. Page Topic

_ Status Reference 4.6.4 340 Training Equipment - Publish a Pending 2.2 Regulatory Guide for certifi-cation of training simulators and other training devices (H; 1-2) 4.7 Incident Response Plan and NRC Facilities 4.7.1 343 Incident Response Plan - Conduct Underway 5.2.3 a systems analysis to identify (partial) 5.2.5 behavioral and human factors issues affecting planning for response t s emergencies (M; 1-2) 4.7.2 346 NRC Headquarters Operations Underway Center and Regional Facilities -

by OIE Systems analysis to derive htnan perfonnance requirements for incident response need and facilities (H;1-2) 4.7.3 347 Utility Emergency Response Underway 5.1. 3 Facilities - Conduct systems by OIE analysis to determine human factors needs for ERFs (H; 1-2) i l

4.7.4 350 Safety Parameter Display System l

a.

352 Conduct systems analysis to Di sagree SECY 82-111 determine the need for a SPDS Required i

SPDS(H;I) by SECY 82-111 l

B-9

~:7~ ~

o.

APPENDIX C PROGRAM ELEMENT SCHEDULES 1.0 Staffing Qualifications C-2 2.0 Training C-3 3.0 Licensing Examinations C-4 4.0 Procedures and Testing C-5 5.0 Man-Machine Interface C-6 6.0 Management and Organization C-8 2

i i

I l

C-1 l

~

~ ~ ~ ~ ~ ~

- - - ~

... ~.. -

PROGRAM PLAN 1

nn Wu WM WM responsible office Q3 Q4 Q1 02 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 03 Q4 1.0 STAFFING A*dD QUALIFICATIONS 1.1 St.if t Staf fing Requirements Identify current practices and assess adequacy of shift staffing and functional allocation.

RES Develop manpower projectton models.

NRR/RES j

RES

  • Determine role of engineering expertise on shift.

NR8 j

Evaluate maintenance staffing and qualifications requirements.

NRR l.2 Minimum Quellfication Pequirements and Fitness for Outy a

  • Apply simulator emperiments and job task analyses to establish revised minimum qualification requirements or to conf fra current regulations.

RES Assess relationships between education, training and emperience requf rements and job performance.

RES/NRR Evaluate benef f ts/ feasibility of licenssng or certifying personnel n

e other than licensed operators and senior licensee of ficials.

NRR N

?

Conduct human performant e and reliability studies.

RES Estabitsh technical bases for fitness for duty requirements.

RES/NRR Prepare proposed rule on shif t crew qualifications.

NRR/RES Implement revistons to 10 CFR Part 55 and Reg. Guide 1.8.

NRR/RES Prepare a proposed fitness for duty rule.

RES Establish technical basis for access authortration rule.

RES l

Revise 10 CFR Part 50.54 to include fitness for duty and revise 10 CFR Parts 50 and 70 with respect to access authorization, pat down search, vital area designation, key and lock control, and psychological assessment (" Insider

  • Rule).

RES 1.3 Limits ved Conditions of Shift Work Eva'uatetheeffectsofshiftduratid,shiftarrangementsand shift rotation on operator performance.

NRR/RES 4

Prepare policy statement on Ifmits and conditions of shif t work.

NRR/RES l

1.4 Industry Sctivities j

Industry staffing practices survey.

INPO Job / Task analyses.

INPO

=

t Selection criterta for NPP operators.

eel Qualtffcations guidelines and criteria.

INPO j

i l I i,

j

'O e'

I t

PRHERAM PLAN

=

FY82 FY83 FY84 FY 86 i

2.0 TRAINING s

?

respoastble off tce Q3 04 Q1 02 03 04 Q1 02 03 04 Q1 Q2 03 04 t

a 2.1 Research Programs Related to Tratning Develop a systematic approach for NRC assessment of utt11ty personnel selection procedures and training effectiveness.

NRR/RES pevise 10 CFR Part % to implement minimum training requirements for NPP operators.

RES Revise ANS!/ANS 3.1 and Reg. Guide 1.8 to incorporate revised afnimum training requirrwents.

RES Conduct training and job skills research for non-operating personnel.

RES Conduct simulator emperiments to support a regulatory position with respect to the use of simulators in training, and evaluate j

the optimum uses of simulators in NPP operator training.

RES I

l 2.2 Development of NRC Tratning Assessment Procedures

- Field test draf t training guidance and evaluation criteria. and develop final traintng methodology and evaluation guideltnes.

NRR I

p a.

Licensed personnel W

b.

Non-Licensed personnel

  • Develop a revised IE inspection module.

NRR/0!E 1

a.

Licensed personnel b.

Non-Licensed personnel Establish a regulatory position with respect to the use of simulators in training.

NRR

- Estatifsh a regulatory position witt respect to accreditation as a means of raising trafatng standards.

NRR 2.3 Industry Activities Estabitsh and implement an accreditation program.

INPO Conduct job task analyses.

INPO e

,I Curricu1We develogunent for licensed and non.llcensed personnel.

INP0

?

~

i

i e

PROGRAM PLAN FY S2 FY83 FY84 FY SE 3.0 LICENSING EXAMINATIONS responsible office Q3 04 Q1 02 03 04 Q1 02 Q3 G4 Q1 02 Q3 04 3.1 The Examination Content Apply job task analyses to content and sit 11s analysts of examination items.

NRR Develop on the job perfomance indices.

NRR/RES Develop. update and maintain computertzed question and examination score banks, f4RR i

- Conduct content analysis and validation of examination questions.

NRR Industry input on training programs (content, objectives, internal examinations).

NRR Examinatfon item analysts.

NRR l

i Valfdation of modified exa,aination.

NRR i

3.2 The Examining process Assess problems and fssues of current examinations.

MRR

+

n Review examination practices in related organizations.

NRR 3

s A

Identify optimal format and procedures for each examination component.

NRR Develop standardtzed guidelines and examiner training.

NRR Modify examination a'nd examin' tion process.

6 a

NRR I

3.3 Long-Term taamination Development and Validation NRR c.

3.4 Industry Activities 1

Conduct job task analyses INPO l

Conduct plant-spectffc job task analyses.

INDUSTRY i

I 1

l l

l i

i 4

6

. =,

i1i 4

Q 3

E Q

S Y

F 2

G e

1 Q

4 Q

30 45 Y

F 20 1

Q 4

Q 3

3 Q

2 1

Q 4

2 Q

8 Y

e F

3 Q

e ic f

R S

R E

R S

S R

0 I

E R

E R

R E

E R

P R

N P

f 0

N R

N 0

N R

R N

I E

o

/

/

/

E R

R e

R R

R N

N N

lb isno p

ser

.s s

r r

o o

t t

t c

f c

s e

o l

d a

e p

f a

n f

t s

t o

n a

n c

o n

t s

a n

i a

l ig e

m a

p o

l m

r e

u u

l a

q h

p n

i t

r

. i n

s o

d o

i e n d

l n

a e

d r

d e

ia n

c r

h n

ig a

a u c a

i r

s n

t e

t l

it it n

e n

r v

ic In r

s a

c a

a e

d o e e

ta

. e s

a p

it h

o 0

s n

f P

r r

s v

u t

s r a c

E C

t e

it e

e n.

t c

d n

e y

d d

i e o

lu t

es a

e c

n h

r n

n l

G e s i f

it o

lt e r u

. a a

a e

f d

o s

d r

o q

e c e u

r i

t c ia a

id b

e a

m g

au f

e n

d d

NI d

d n

a.

p c

g p

t s e

n l

g e

a n

ee u n a

u t

p o

d g

o N

S u m it at e

p lur e.

s it e

a ao r

i o o u

r it r

s s

T c

'r n

l)

E G

a ie s

n a

vn r

p u

vg rr s

e u

A T

e o t

eal f

n r

i

/d e

i h

o s

en cu a

t f

r n

L D

u it e

dp i

f nn gc w

t o

dt ye r

r d

c m

n-s P

N e e e

ani i

O s

s loo o

i e

P ae c

p l

n r

t s d w

A o

s p

s(

m se op r

n a

d l

d a

dr d

d ie e

S S

P i

t hP d. a. o t r t

n it l

O os e

n r

op of e

i P

M g

h ho e

a E

f P

P t0 iS v

t S

R o

0 O

eE uP Ps r

eo en s

i e

A U

t d

o i

a imr

[

(

m gO Mr p

mf mo m

e.

t d

e ns c

t n

p p

pe pd pt p

ps pt r

m A

e a

R D

e le e

er le ep lo lot loa g

a r

r o

o od on oc m

l l a a

l e a

u o

y a

g E

p e

em el r

eg r

p e

G C

l D

D D u DM Df D

Df De t

Dp u

P I

v va P

t o t

e t

o v

v vg vs vs v

e e ep eP en e eo ev er s

r n

O e

O v

s d

R e

e n

P D

T I

R 0

P 4

1, 2

3 4

4 4

i neu

..i i

ei g

I t

1 s

i5 t P f

$1; 3

i I

+

e

,8 e

3 3

4Q i,

3 3

Q N

2 Q

1 Q

40 s

c M

l W

20 1

Q 4

Q 3

Q u

n 2Q 1

Q 4

Q u

n

)

Q I

e S

5 S

R S

R R

R R

R R

3 S

S S

ic f

E E

R E

R R

R R

R R

E E

C E

f R

l.

R N

R N

N N

N N

N F

R R

R

/ /

/

/

o

/ /

R R

E R

R E

R R

e R

R 0

N N

M N

O lb es is ig n

o o

p l

t o

s d

n n

e ia c

t m

r h

a e

s e

a e

+

it sn 1e n.

s ld T

d g

e y

r e an a

t o

g in na d

m n

n o

e o

a e

iv

'C i

's it Ma t

i l

in c

o m

m 1

Rt s

e t o n

r e

h.

C a

ee a r

t ai a

n g

n e

s d

c r

u d

t rt v

1 o

a i-ea d

n c

R hp t

n o

g pz A

r it a

r N

w.

to n

o p

oi t

a m

e t

t n

n m

s e.

a es o

it r

n ni o

o r. on n

c e

g rn gd r

g n

s n

co nn f

a e

ar c

o a

e i

a t

w m

o d

f s is n

r is mt is t

s ie e

gi e

s int it g

D t

y e

on eg a

l v

o inr s

n a

e e

s oc sn c v

p a

t e m t

r ru ri p

o e

r l

B t

ed r

s s

a i d

f ds m

r r

p l

s a

ti o

g e

la i

d l

de i t

n i m a

ol ad n

. e i

t a.

s u

oc f

m ar n

l n

l rc In g'

it l

a.

l a

b re y

o r

sl s v

s e n a

n t n nn t

c s

a r

inat is es od n

d o

n o

nn oo e e

p o

n t

iu e

ia t

cs tt a

a s

u r tc i

r f m os e a

i oo ii f

l r

e t

da e

t rn o

a f el D

rn ta E

r a

s f e st o

ie d

p ozp oe n

s, t

i r

ia s

c g

d.

e d

o y

L o

op os t.

l it c

d n

yl g o

e ct iu E

f lt G

ta p

p ns l

p n

lb et r

mr ea r o n u

t an f

n-r n

r a

n t ri ai ne w

sy l

ar n

ic s

a ns c.

pq s

C e

l y /

y.

s sa rr pr er yo l o o i et e

l u ot G

A c

i r

e re e

sn y

n b

o c

oc n

yl ot r

s a

w w i gn e

N E

id ia la a

aa at ao a

n i

ie nr s

e F

a a

t n

t n it ns l c i n il s

e e t

eor ld a

nr o

o li t n l e e f

e R

n n

l n e

v v

e an rn it t

A u

u e ue a

au u

t a u

go a

T G

t g

t gt t

a gl nm e

n r

v f

o G

oi lee l

n e n en S

k ea eu d

o r

df rt dr u

L I

e ia ri se rc th p

F F

a ee e

pa ie g

N R

ia a

l az o o iu s

R R

e t ss c

m uv e

E f

e r

ly al pl g

e E

E s n aae

'a ar ge R.

P ca m a m am o

t N

e n o o

igbr f

o s

e R

r r

c p

p t

pn t

ta pn en p

p t

o p

u r

pf p

ps M

I t

a l

lo c

oi n

cn oi zn o

y o

c t

l t md e s on log od u

l o

ua l

yo l

c l

u a

see t

r li n

l o H

n n

e e d ee C

d ee l s e

n e

d i e et c n

e e ei eh e

v v

n vl nd vl ar v

e v

n c

v vso I

t vd vr vt C

I t

e e

o eo l

on eo ne e

g e o n e Inyr u en eu ee A

e n

D D

C Dr a Ca Dr Ap D r '

C u

D sp e.

p Da Dd Dm

)

A n

ia o

m n

t m

c e

n i

o R

M i

M L

E A

h C

h c

c a

G N

M 1

2 3

4 M

1 a

A n

2 O

M 1

1 1

1 n

a aM 5

5 5

5 M

5

. R 0

P 5

1 2

5 5

phc 4

1 ii,.

s4

l PROGRAM PLAN W 32 R 83 n 34 W 86 5.0 MAN-MACHINE INTERFACE ressoasible office Q3 04 Q1 Q2 03 04 Q1 02 03 04 Q1 G2 03 04 5.2.2 Advanced Controls and Displays t

- Provide data on evaluation methods and destga criteria l

related to visual displays.

RE$

Establish criteria and guidelines needed for regul. tory assessment of advanced control room concepts.

RES

- Identify control /dtsplay requirements for crew needs subsequent to severe seismic events.

RES Provide NRC support for the Halden reactor project.

RES 5.2.3 Function Allocation Establish criteria for function allocation.

RES Identify functions which should be -n11ncated.

PES Develop a regulatory position on t.nction allocation.

RES

- Investigate cognitive workload measurement techniques.

RES O

e 5.2.4 Annunciators N

Develop guidelines for long-term annunctator improvement.

RES Prepare and issue a Regulatory Gufde addressing annunciator j

system design and operation.

RES 5.2.5 Safety Systae Status Indication

- Evaluate effectfveness of current practices.

NRR Develop guideltnes for short-term improvement of Safety system status monitors.

NRR

- Investigate need for automatic status monitoring systems.

MRR

- Develop gulielines for long-term improvement of safety systaa status monitor,.

NRR

- Revise Regulatory Guide 1.47.

NRR/RES f

5.3 Industry Activities Annunciator research.

EPRl/ INDUSTRY /HALDEN Maintenance research.

[PRI/INPO Csntrol rons enhancement.

EPR1

- Advanced display researth.

EPRI I

t t

PROGRAM PLAN nu nu nu nu 8.0 MANAGEMENT AND ORGANIZATION respoasible of f 8ce G3 04 Q1 Q2 03 04 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 6.1 Deve1osment of Management and Orgrnization Guidelines

- Review current industry pre.ttces in management and organization planning.

NRR

- Identify managment and organization elements telch relate to safety.

NRR Identify management anel organfzation elements appropriate to regulatton.

NRR

- Assess safety review systems and evaluate 15tG.

NRR Estabitsh technical basis for organtration and management functions and roles.

RES Ptiot-test draft guidelines and conduct industry reviews.

NRR

  • Establish safety performance standards by assessing relationships between management and organtration elements and safety-related performance indicators.

RES

- Develop and test performance standards.

RES o

Develop and pubitsh final guidelines.

  • aR e

M

- Revise standard format and content document.

NRR 6'. 2 C*velopment of MRC Assessment Procedures

  • Tvaluate entsting NRC review practices.

NRR t

  • Develop revised assessment procedures.

NRR

  • Revise SRP Chapters 13.1 and 13.4.

NRR Train technical reviewers and regional personnel.

NRR 6.3 Industry Activities Evaluation program for plant and corporate management.

INP0 Develop prospective plant manager training program.

INP0 t

O r

l APPENDIX D GLOSSARY ANS American Nuclear Society ANSI American National Standards Institute A0P Abnormal Operating Procedure BWR Boiling Water Reactor CFR Code of Federal Regulations CRGR Committee for the Review of Generic Requirements CRT Cathode Ray Tube DF0 Division of Facility Operations DHFS Division of Human Factors Safety DOE Department of Energy ED0 Executive Director for Operations EEI Edison Electric Institute E0P Emergency Operating Procedure EPRI Electric Power Research Institute ERF Emergency Response Facility EXAM Examination FAA Federal Aviation Agency FY Fiscal Year HFB Human Factors Branch HFEB Human Factors Engineering Branch HFRG Human Factors Review Group HFS Human Factors Society INP0 Institute for Nuclear Power Operation ISD Instructional System Development ISEG Independent. Safety Evaluation Group D-1

(

1 JPA Job Performance Aid LER Licensee Event Report LMFBR Liquid Metal Fast Breeder Reactor LQB Licensee Qualifications Branch LWR Light Water Reactor MAN / MACH Man-Machine MGMT & ORG Management and Organization MMI Man-Machine Interface MP Maintenance Procedure NASA National Aeronautics and Space Agency NMSS Office of Nuclear Material Safety and Safeguards NPP Nuclear Power Plant NRC Nuclear Regulatory Commission NRES Office of Nuclear Regulatory Research NRR Office of Nuclear Reactor Regulation NSSS Nuclear Steam Supply System OIE Office of Inspection and Enforcement O&M Operations and Maintenance OL Operating License OP Operating Procedure OR Operating Reactor PAT Performance Appraisal Team l

PRA -

Probabilistic Risk Assessment PROC & TEST Procedures and Testing PTRB Procedures and Test Review Branch PWR Pressurized Water Reactor D-2

+

f 4

R&D Research and Development RES Human Factors Branch, DF0 R0 Reactor Operator SALP Systematic Appraisal of License Performance SAT Systems Approach to Training SPDS Safety Parameters Display System SRO Senior Reactor Operat n.-

SRP Standard Review Plan SS Shift Supervisor STAFF & QUAL Staffing and Qualifications ii

)

~

D-3

,