ML20154L796

Simulation Facility Plan for Big Rock Point to Meet 10CFR55.45(b)

ML20154L796
Person / Time
Site:	Big Rock Point File:Consumers Energy icon.png
Issue date:	05/26/1988
From:	CONSUMERS ENERGY CO. (FORMERLY CONSUMERS POWER CO.)
To:
Shared Package
ML20154L732	List: ML20154L730 ML20154L796
References
PROC-880526, NUDOCS 8806010066
Download: ML20154L796 (36)

Text

, g. .

11 .

. s ,

i ATTACHMENT Consumers Power Company Big Rock Point Plant Docket 50-155 J

SIMULATION FACILITY PLAN FOR BIG ROCK POINT TO MEET 10CFR55.45(b)

May 26, 1988 ,

60gggggjo 5 35 Pages OC0588-0109-NLO4

b l i

, . 1 1

SIMULATION FACILITY PLAN FOR BIG ROCK POINT TO MEET 10CFR55.45(b)

MIO388-1630A-NT03-NLO4

, s a SIMULATION FACILITY PLAN TABLE OF CONTENTS Page List of Tables 111 List of Figures 111 List of Examples iii Foreword iv 1.0 Introduction 1 1.1 Definitions 1 1.2 Acronyms 3 2.0 Criteria 4 2.1 Human Factors 4 2.2 Procedures 6 2.3 Steady State and Transient Models 7 2.4 Performance Testing 7 2.5 Operating Test Methodology 7 3.0 Development of Big Rock Point Simulation Facility 9 3.1 System Function / Task Analysis (SFTA) 12 3.2 Cue Analysis 18 3.3 Fidelity Evaluation 18 3.4 Simulation Device Integration 22 3.5 Simulation Facility Application 23 3.6 Implementation 23 3.7. Multi Disciplinary Review Team 23 3.8 Configuration Management Program 24 MIO388-1630A-NT03-NLO4 i

. s a Pgg3 4.0 Simulation Devices 24 4.1 Non Plant Referenced Simulator Dresden 25 4.1.1 Human Factors 25 l 4.1.2 Procedures BRP Specific 25 4.1.3 Steady State and Transient Models 25 4.1.4 Performance Testing 26 4.1.5 Operating Test Methodology 26 4.2 Control Room Mock-up 27 4.2.1 Human Factors 27 4.2.2 Procedures 28 4.2.3 Steady State and Transient Models 28 4.2.4 Performance Testing 28 4.2.5 Operating Test Methodology 28 4.3 Reduced Scope Simulator 28 4.4 Part Task Simulator 29 4.5 Reference Plant 29 4.5.1 Human Factors 29 4.5.2 Procedures 29 4.5.3 Steady State and Transient Models 30 4.5.4 Performance Testing 30 l

4.5.5 Operating Test Methodology 30 5.0 Implementation Schedule 30 l

MIO388-1630A-NT03-NLO4 11

. s ,

LIST OF TABLES TABLE PAGE 1 Human Factors Considerations 5 2 Simulation Facility Development Process Steps 11 3 System Function / Task Analysis Steps and Process 13 4 System Function / Task Analysis Criteria 15 5 Fidelity Evaluation Criteria 20 LIST OF FIGURES FIGURE PAGE 1 Simulation Facility Development Process Flow 10

< 2 Fidelity Evaluation 19 1,IST OF EXAMPLES EXAMPLE PAGE 1 Breakdown of an Operator Task 17 MIO388-1630A-NT03-NLO4 iii

FOREWORD This report presents Consumers Power Company's plans to meet the new requirements set forth in 10CFR55.45(b) for the Big Rock Point Nuclear Generating Station. These plans are intended to assess the simulation needs for training and testing the plant operators and to develop a simu-lation facility to meet those needs. The guidance presented in the Utility Simulation Facility Group Document will be used in the implementation of this plan.

Because of the vintage and size of this plant, an exact replica plant specific simulator is neither available nor within our means to construct.

However, we recognize with certainty that because even non-plant specific simulators are such valuable training tools, we do not want to forfeit their use while attempting to meet the intent cf the new requirements. It is anticipated that it will be necessary for us to continue to modify the non-plant specific simulator (the Dresden Unit) as well as construct and validate reduced scope simulators to satisfy these requirements and provide a good facility for the testing of operators.

Criteria are established for the degree of simulation and, as the program is more fully developed, if any particular scenario cannot be reasonably or realistically duplicated a request for relief or exemption when evalu-ated against other options, will be filed at that time.

We are confident that the program will be effective and will be a benefit to the operator training, operator qualification examinations and to the Commission in conducting independent examinations of operators of this facility.

I MIO388-1630A-NT03-NLO4 iv

i

1.0 INTRODUCTION

1.01 Purpose This document delineates the process to be used to develop the Big Rock Point Simulation Facility. This plan provides a schedule for completion of the Big Rock Point Simulation Facility Application along with the criteria to be used for each simulation device to be incorporated into BRP Simulation Facility.

It is the intention of Big Rock Point to first evaluate existing available simulation devices and then to pursue the development of new simulation devices as the need arises.

Big Rock Point will follow the USFG guidance document with exceptions as indicated in this plan.

1.1 Definitions Best Estimate - Reference plant response data based upon engineering evaluation or operational assessment. -

Candidate - An individual being evaluated for a reactor operator or senior reactor operator license.

Controller - An individual responsible for clarifying deviations between a simulation device and the reference plant.

Critical Parameters - 1) Those parameters that require direct and contin-uous observation to operate a nuclear power plant under manual control.

2) Input parameters to nuclear power plant safety systems.

Cue - Information available for use in evaluating plant status.

Deviation - An identified difference between a simulation device and the reference plant.

Deficiency - A deviation that the fidelity evaluation identifies as a "need-to-fix" item.

Examiner - An NRC representative who conducts operating tests.

Fidelity - Reference plant replication in either system model, physical appearance or system function.

Instructor - A utility representative responsible for the operation of the simulation device.

Mult1 disciplinary Review - Review by disciplines of appropriate background and experience.

MIO388-1630A-NT03-NLO4 1

s .

Operational Cue Analysis - An analysis to determine the cues available on a simulation device and the cues required by the referenced plant operating procedures.

Operator - An individual who possesses a reactor operator or senior reactor operator license.

Potential to Confuse - Deviation potential to perplex the operator and disrupt his mental and physical actions.

Potential to Errot - Deviation potential to lead the operator to not perform any action or to perform an incorrect action.

Potential to Impede - Deviation potential to delay or hinder significantly the operator's correct response.

Procedures - Reference plant normal operating procedures, abnormal operat-ing procedures, emergency operating procedures, and emergency plan implementing procedures that an operator or candidate would be required to implement. When plant procedures are referenced to throughout this document, it is assumed that they are "controlled copies" of the procedures, unless other-wise specified.

Procedure Performance Time - The realistic or actual time for a candidate to perform a procedure or task in the refer-ence plant control room.

Real Time - Computer simulation of dynamic performance in the same time base relationships, sequences, durations, rates and accelera-tions as the dynamic performance of the reference plant.

Reference Plant - The specific nuclear power plant from which a simulation facility's control room configuration, system control arrangement, and design data are derived.

Simulation Device - A component of a Simulation Facility that simulates a portion or all of the reference plant.

Simulation Facility - One or more of the following simulation devices, alone or in combination, used for the conduct of operating tests:

1) Non-Plant Referenced Simulator

2) Control Room Mock-Up

3) Reduced Scope Simulator

4) Part Task Simulator

5) CRT Simulator

6) Reference Plant MIO388-1630A-NT03-NLO4 2

o e

• I a System Function / Task Analysis - A systematic analysis of the reference

- plant procedures that yield the cue and I6C requirements.

Task - A unit of control room operator work which may require plant information collection, systems operation, or both.

Task Element - A unit of. human activity comprising a task.

Task Statement -

An independent unit of control room operator work.

1.2 Acronyms BRP - Big Rock Point Plant CFR - Code of Federal Regulations CRDR - Control Room Design Review CRT - Cathode Ray Tube CRM - Control Room Mock-Up HF - Human Factors I&C - Instrumentation and Control NPRS - Non-Plant Referenced Simulator NRC - Nuclear Regulatory Commission PRS - Plant Referenced Simulator PTS - Part-Task Simulator RO - Reactor Operator RSS - Reduced Scope Simulator SFTA - System Function / Task Analysis i

SME - Subject Matter Expert SRO - Senior Reactor Operator l

USFG - Utility Simulation Facility Group l l

MIO388-1630A-NT03-NLO4 3

2.0 CRITERIA The following section provides generic criteria to be upplied in the evaluation and use of the Simulation Facility. All or part of each of these criteria is applied to specific simulation devices in the manner described in Sections 3 and 4.

Big Rock Point's intention is to continuously evaluate the feasibility of new simulation devices available throughout the industry.

2.1 Human Factors Human factors addresses the comparability of the Simulation Facility with the reference plant in the areas of control room and panel layout, I6C configuration and ambient operating environment. The primary human factor consideration in a plant referenced simulator (PRS) is for the simulator to have fidelity with the reference plant. PRS fidelity means duplication in physical appearance, physical layout, system function and system model.

For a simulation device other than a PRS, 100% fidelity may not be achiev-able in system model and physical layout. Therefore, the only highly achievable fidelity component would be duplication in system function. A.

simulation device has to meet a high degree of duplication in system func-tion criteria to be considered to be viable for the conduct of an operating test.

The degree to which a deviation does not meet physical / functional fidelity becomes a human factors concern. In a Simulation Facility, the principle goal of human factors is to assure fidelity deviations have no negative impact on operator task performance. Deviations that hinder the operator will be documented and evaluated in a systematic fashion. Cognitive and behavioral operator actions should be considered. Operator perceptions (color, mimics, patterns, etc) are to be considered if essential to task pe rfo rmance . Other human factors considerations deal with the specific components in Table 1. The Simulation Facility will contain controls, instruments, alarms and other man-machine interfaces for the operator to demonstrate his capability to safely operate the Big Rock Point Plant.

The ambient environment in the Simulation Facility will be replicated to the extent possible. To the extent practicable, the following generic criteria are applied to the Simulation Facility. The specific applica-tion of this generic criteria to each simulation device is discussed in Section 4.

Control Room and Panel Lavout The Big Rock Point Simulation Facility should approximate the Big Rock Point Plant. The Simulation Facility will be the same physical size although reduced scale reproductions may be acceptable provided the SFTA (described in Section 3) determines that the reduction does not signifi-cantly detract from the ability to conduct operating test.

The operator's station and other working space will be evaluated. Devi-ations frem the Big Rock Point Plant will be addressed.

MIO388-1630A-NT03-KLO4 4

- , a HUMAN FACTORS CONSIDERATIONS Major Area Components Control Room Layout -

Physical Orientation Operator Station Panel Layout -

Systems Orientation Control Panels Annunciator Panel Mimics Instruments and Controls -

Displays Controls Instrument Range Instrument Accuracy Engineering Units Ambient Operating Environment -

Normal and Emergency Lighting Humidity -

Temperature Noise Communications Auditory Signals

'l 4

Table 1 MIO388-1630A-NT03-NLO4 5

The control panels should be positioned on the Simulation Facility in the same physical location as the Big Rock Point Plant. The systems orienta-tion within the panel should replicate the Big Rock Point Plant. Devia-tions from the plant panel layout will be evaluated as discussed in Section 3.

I&C Configuration The Simulation Facility controls, indications, etc, on the control panels should approximate the same physical location as in the Big Rock Point Plant. The instrument displays, controls, range, accuracy and units should replicate the plant. Deviations from the plant I&C configuration will be evaluated as discussed in Section 3.

Ambient Operating Environment The ambient operating environment shall permit the operator to perform his duties. The ambient operating environment factors to be considered are lighting, humidity, temperature, noise and communication. Significant deviations from the Big Rock Point Plant environment will be evaluated as discussed in Section 3.

2.2 Procedures The procedure considerations are: 1) the scope, 2) the manner of use and,

3) methods of modifying the procedures used in the administration of operating tests. Controlled copies of Big Rock Point Plant procedures will be used in the conduct of operating tests. Procedures performed on the Simulation Facility allow candidates to demonstrate their "ability to perform" the operations required by those procedures. The following generic criteria are applied when Big Rock Point Plant procedures are used during the course of an operating test on the Simulation Facility described herein. The specific application of theue criteria to each simulation device is discussed in Section 4.

Procedure Scope Types of procedures exercised on the Simulation Facility include:

Normal Operating Procedures, Abnormal Operating Procedures.

Emergency Operating Procedures, and Emergency Plan Implementing Procedures.

The scope of procedures to be exercised on any simulation device shall be determined using the methods discussed in Section 3.

Procedure Use Controlled copies of Big Rock Point Plant procedures will be used on the Simulation Facility. As determined by the SFTA results, the Big Rock Point Plant may be used to exercise the ' Normal Operating Procedures' that can be performed as part of normal operations. Those procedures or tasks requiring control room interaction will be performed on a single simulation device (or appropriately integrated simulation devices).

MIO388-1630A-NT03-NLO4 6

. . 1 <

Procedure Modifications The data obtained during the SFTA vill identify any deficiencies between the simulation device and the procedures that will be used on that simu-lation device. An attempt will then be made to modify the simulation device (hardware and/or software) to accommodate use of the controlled procedure. If no simulation device modification resolves the deficiency as identified by further cue analysis, an attempt to resolve the defi-ciency through the use of a controller will be attempted. If the use of a controller is not successful in resolving the deficiency, other existing simulation devices will be evaluated utilizing the steps identified for evaluation of the initial device selected.

2.3 Steady State and Transient Models The steady state and transient modeling used as part of the Simulation Facility will adequately model the operating behavior of the Big Rock Point Plant. The following generic criteria will be applied, as applic-able, to any simulation device. The specific application of this criteria to each simulation device is discussed in Section 4.

Scope Simulation Facility output will approximate and display expected plant responses. The responses will be based upon plant operating data or best estimate analyses, as appropriate.

Fidelity The models will be cf a level of sophistication necessary to assure the adequacy of the output information being presented to the operator.

Time The Simulation Facility will approximate real time.

2.4 Performance Testing Perfornance testing is conducted to verify the Simulation Facility per-formance as compared to actual or predicted Big Rock Point Plant perform-ance. The initial performance testing will serve to verify and validate the adequacy of the completed Simulation Facility. The specific applica-tion of performance testing criteria to each simulation device is discussed in Section 4.

Performance testing will be conducted on a schedule consistent with 10CFR55.45.

2.? Operating Test Methodology This section provides a generic process for conducting examinations on the Simulation Facility for the purpose of evaluation of operators / candidates in accordance with 10CFR55.45(a). The following generic criteria vill be implemented, as applicable, on any simulation device. The specific appli-cation of this criteria to each simulation device is discussed in Section 4.

MIO388-1630A-NT03-NLO4 7

6

. t s Those portions of the operating test conducted on each simulation device will be limited to the procedure scope determined by the Operational Cue Analysis (described in Section 3.2) for that simulation device.

Examinations should be conducted in accordance with NUREG-1021, "Operator Licensing Examiner Standards."

Procedure Performance Time on the Simulation Facility will be followed as closely as possible during operating tests.

During the conduct of the operating test, Controllers may be required to mitigate simulation devir.e deficiencies. The use of Controllers will follow the guidelines described below.

Guidelines foLC ontroller Interaction The cole of the Controller is to provide an added dimension to the Simuls-tion Facility to enable a device to more closely approximate the reference plant during the conduct of operating tests. In this sense, Controller usage is similar in nature to those activities conducted by utility instructors who, during conduct of operating tests on Plant Reference -

Simulators, provide information as outside operators, I&C technicians, etc. In this case the Controller is used to augment the simulation devices. Therefore, the purpose of the Controller is to provide, under direction, those cues unavailable from a device that may Fm needed to carry out actions during the performance of the operating cest.

Contro11ere used during implementation of operating tests on various simulation devices shall follow specific guidelines established herein.

Additionally, the Controllers shall be limited to any other guidelines set up by agreements between individual examiners and the Simulation Facility management.

Examination Integrity Examination integrity is paramount to the success of the operating test. The Controller should not compromise examination integrity.

Controller actions shall be conducted under the direct supervision and control of the Simulation Facility operator.

Controllers shall not prompt the operators in the performance of their duties. Prompting may result in the invalidation of the operating test.

Controller Qualification Controllers shall be trained on their duties and responsibilities.

Oualifications and trainir.g of controllers:

1) Controllers shall be employed by Consumers Power Company or as a vendor under contract to Consumers Power Company.

MIO388-1630A-NT03-NLO4 8

c

~

2) Controllers shall possess the level of training and qualifications required for Simulation Facility instructors.

3) Controllers sball hold or have held an SRO license or certifica-tion on the BRP Plant.

4) Controllers shall be knowledgeable on the simulation devices on which the operating test is conducted.

5) Controllers shall receive additional training on the conduct of operating tests.

Controller Functions Controllers shall function to provide cues to the operators that are not available from the Simulation Facility.

Controllers shall provide cues only as answers to specific questions from the operators or as directed in the operating test scenario.

These cues are only for the purpose of providing information not available from the Simulation Facility.

Controllers shall perform other actions as identified and directed by the examiner during the conduct of the operating test.

3.0 DEVELOPMENT OF BIG ROCK POINT SIMULATION FACILITY This section provides the methodology used to develop a Simulation Facility to meet 10CFR55.45(b)(1)(1) using one or more of the simulation devices descrfbed in Section 4. The purpose of the Simulation Facility is to enhance the conduct of operating tests.

It is recognized that operating tests are better performed on devices that promote an active man / machine interface, such as Non-Plant Reference Simu-lators, Reduced Scope Simulators, or Part Task Simulators. This interface facilitates evaluation of the individual (s) in an actual operating environ-ment. However, in cases where there is limited implementation of an active man / machine interface, adequate qualifications can be demonstrated by alternate devices. These alternate devices may include Control Room Mock-ups, CRT Simulation or the Reference Plant alone or in combination.

Big Rock Point will use the existing Consumers Power Company Systematic Approach to Training Manual to develop its Simulation Facility. This manual was written to meet INFO accreditation criteria. The SFTA process flow and steps identified in the USFG guidance docueent (see Figure 1 and Table 2) will be incorporated into Big Rock Point's systematic approach to training process.

The rigorous implementation of this simulation development methodology will assure the appropriate use of a particular simulation device for the con-duct of operating tests. Conversely, implementation may provide indication that a currently used simulation device is inappropriate to meet the needs of an operating test. The goal of the Big Rock Point Simulation Facility development MIO388-1630A-NT03-NLO4 9

~

. 1 1-SIMULATION FACILITY DEVELOPMENT PROCESS FLOW J

Analysis of reference plant procedures to deduce cue and I&C information requirements.

SFTA Comparison of simulation device with information requirements.

Evaluation of fidelity deviations between simulation device and the 3r reference plant.

SIMULATION DEVICE 1P

1. NPRS

2. CRM FIDELITY

3. RSS EVALUATION

4. PTS

5. CRT SIM.

6. REF. PLANT 4 Selection of simulation device to satisfy information/ fidelity requirements.

Integration of simulation device (s) 1P into a Simulation Fscility.

SIMULATION Utility Plan of simulation devices FACILITY used to meet 10CFR55.45 rule.

Figure 1 ,

MIO388-1630A-NT03-NLO4 10 I

SIMULATION FACILITY DEVELOPMENT e

PROCESS STEPS System Function / Task Analysis

1. Task Identification

2. Task Element Identification

3. Cue Information Requirements

4. I&C/ Physical Characteristics Simulation Device Comparison and Selection

1. Comparison of SFTA/ Reference Plant with Simulation Device

2. Refer Deviation to Fidelity Evaluation F,idelity Evaluation

1. Identification of Deviation

2. Assessment of Deviations

3. Disposition of Deviations Simulation Facility Plan

1. Description of Simulation Devices

2. Match Procedures with Devices Table 2 MIO388-1630A-NT03-NLO4 11 i

methodology is to provide an appropriate Simulation Facility, considering both existing and new simulation devices that could be of the types dis-cussed in Section 4.

3.1 System Function / Task Analysis (SFTA)

The SFTA is a systematic analysis of the reference plant procedures that yield the cue and I&C characteristics. From the reference plant control room instrumentation, the operator obtains the required cues to help him in performing his tasks. The systematic determination of these man / machine interface characteristics provides a basis for evaluating the adequacy of a simulation device to support the conduct of operating tests. Tables 3 and 0 detail the SFTA steps and process and SFTA criteria respectively.

The method is characterized as a top-down analysis which begins with the Big Rock Point Plant procedures. The prctudures are partitioned into units of activities identified as tasks. A task is a unit of control room oper-ator work which may require information collection, systems operation, or both. A task is characterized by being a relatively small unit of work which is comprised of approximately the same sequence of elementary human actions regardless of the operational sequence in which the task appears.-

The main criterion for the identification of a task is that the task should define the information and/or control functions needed by the operator to perform that unit of work.

Each task is further partitioned into the units of human activity, called task elements, which need to be sequentially accomplished in order to execute the talk. The main criterion for identifying these task elements is that each should further refine and identify the information requirements needed by the operator to execute the task in the context of all the operational sequences in which the task appearc.

A set of cues is developed from the task element requirements. The cue in this context is defined as the significant informat, ion acquired by the control room operator that prompts him to act. The cue is taken directly from the task element, taking into account the information required from the specific system.

A set of characteristics describing the functional requirements for each task element is identified. The task element may be associated with a specific instrument. In that case, the characteristics include range and units. The physical requirements will be specified if the particular characteristic is critical to performing the task. In cases where only one type of equipment will satisfy the physical and functional requirement, the specific manufacturer and component will be identified. Example 1 shows the breakdown of an operator task.

The SFTA will be conducted by a Multidisciplinary Review Team composed of subject matter experts (SMEs) of appropriate background and whose responsi-bilities are discussed below. The SMEs will utilize their expertise to process the task breakdown. The SFTA process steps will be documented and supported with appropriate sources.

MIO388-1630A-NT03-NLO4 12

n;

. 1 ..

SYSTEM FUNCTION / TASK ANALYSIS STEPS AND PROCESS STEPS PROCESS I. Task Identification A. Select Statien Procedure - Select one station procedure at a time to process.

i B. Breakdown Station Procedure - Breakdown the procedure according to operators actions (task).

II. Task Element Identification A. Breakdown Operator Task - Breakdown the operator tasks into small units of work (task element).

B. Identify Cognitive / - Associate task element with Behavioral Action operator's cognitive and behavioral actions.

III. Cue Information Requirements A. Specify Task Element - Determine information operator Information needs to do task elements.

B. Specify Perceptual - Determine information operator Information Required is cognizant about before, after and during task element performance.

C. Identify Time Dependency - Determine information that Requirements will assist operator in performing the task element.

- Determine information that is very critical relative to operator actions.

Table 3 MIO388-1630A-NT03-NLO4 13 L

, />

iRll

• s \ .

a SYSTEM FUNCTION / TASK ANALYSIS STEPS AND PROCESS STEPS PROCESS IV.  !&C/ Physical Characteristics

'A. Identify I&C -

Deduce the functional I&C Characteristics characteristics required to carry out the task.

B. Identify Physical -

Identify physical charac-Characteristics teristics if required to

. perform task element and function.

Specify type and model of component, if one-of-a-kind.

l f

Table 3 (Continued)

MIO388-1630A-NT03-NLO4 14

SYSTEM FUNCTION / TASK ANALYSIS CRITERIA Task Identification

1. A task is a unit of control room work that can be clearly identified.

2. A task completion is independent of the preceding or following task.

3. A task is comprised of a limited number of human action units (elements).

Task Element Identification

1. Task elements are elementary human actions needed to accomplish a particular task.

2. Task elements can be divided into cognitive and behavioral divisions.

3. Each task element refers to information or control requirements.

4. Task elements are written only for operator actions which require control room information or control function.

Cue Information Requirements

1. The cues required enable operator task performance.

2. The cues assist the operator in assessing the control room status relative to the immediate tasks.

3. The cues are a perceptual process that include audio, visual and sensory inputs.

4. Cues that are time dependent must denote the time window required.

Table 4 MIO388-1630A-NT03-NLO4 15

(

SYSTEM FUNCTION / TASK ANALYSIS CRITERIA I&C Physical Characteristics

1. The I&C characteristics must specify the:

- Display required.

- Range required.

- Units of the quantity.

2. State physical requirements, if critical to performing the immediate task and function.

Table 4 (Continued)

MIO388-1630A-NT03-NLO4 16

BREAKDOWN OF AN OPERATOR, TASK Operation Procedure - E0P XXX Task Statement - Determine if RCPs are operating Task Element - Read RCP ON/0FF Status, System - RCP Read RCP current, System - RCP Read RCP flow, System - RCP Read RCP Delta P, System - RCS Read Voltage to RCP, System - RCP Read RCP Speed, System - RCP Read RCP Electric Power, System - EDS v

Cue Information - RCP Speed > 500 rpm Annunciator Window Off No Annunciator Audio Alarm ir I&C/ Physical Requirement - Display Value Range, 0-1200 Units, RPM Accuracy, N/A Display on Control Room Panel 56 Abbreviations RCP - Reactor Coolant Pump EDS - Electrical Distribution System Example 1 MIO388-1630A-NT03-NLO4 17

a.

SFTA Philosphy The System Function / Task Analysis (SFTA) is a logical link to the other analyses that have been conducted to support training programs. The starting point for SFTA is the procedures which were also the basis for the job analysis previously done for the training programs. The job analysis provides the skills and knowledge requirements needed for the operator to perform his job. The task analysis provides the task infor-mation requirements for the operator to perform his tasks. The system function analysis provides the functional operator controls requirements needed to perform procedural steps.

3.2 Operational Cue Analysis The Operational Cue Analysis consists of the SFTA and the simulation device comparison and selection process. An I&C inventory will be con-ducted on each simulation device. The I&C inventory will include a list-ing of the presence both static and dynamic cues, each type of cue being important to the operational cue analysis. As shown in Figure 1, the I&C inventory is then compared to the SFTA results to identify the I&C set and cues available to execute the reference plant procedure set, Each proce--

dure task listing is evaluated to determine the ability to adequately perform the procedure on the simulation device. This process yields a procedure set applicable for examination on that particular simulation device. Procedures that cannot be implemented on any other simulation device can be examined on the Big Rock Point Plant. Accordingly, it is expected that all procedures can be examined on the Simulation Facility.

The process of collecting data for the Operational Cue Analysis will be i similar to that identified in NUREG-1258, Appendix B. The data fields to be evaluated will be determined by the SFTA. The discrepancies between the Big Rock Point Plant and the simulation device will be dispositioned by the Multidisciplinary Review Team using the process identified in Section 3.3.

3.3 Fidelity Evaluation Af ter a simulation device goes through the SFTA comparison process, a fidelity evaluation will be performed. The purpose of the fidelity evalu-ation is to identify and essess the deviations of a simulation device from the Big Rock Point Plant. The fidelity evaluation process and criteria that will be used is detailed in Figure 2 and Table 5. The fidelity evaluation identifies the potential areas where comparability deviations could cause an operator difficulties in performing procedure tasks. Devi-ations are identified from three different sources: 1) the SFTA results,

2) the control room as noted in Table 1 and 3) the Simulation Facility Development process. The evaluation process will consist of identifying the deviation, assessing the deviation, and dispositioning the deviation.

The evaluation process will be done by the Mult1 disciplinary Review Team.

MIO388-1630A-NT03-NLO4 18

p

. 1 i

FIDELITY EVALUATION h

$ SFTA Reference Plant Simulation Facility E (Table 1) Development 4

M h

H M

O if Identify Deviations i r d b

$ 1r 05 Evaluate 0 and Rate 4 Deviation

}

1r Modify Device, n Another Device, Controller, Etc h

Sum Rate N Yes

= > 4.00 2

M S No

$ if E Device, Procedure Left "As Is" 1r Figure 2 MIO388-1630A-NT03-NLO4 19

1 FIDELITY EVALUATION CRITERIA Identification of Deviation

1. A deviatius. 1: a physical difference that exists between the simulation device and.th'e reference plant for the areas in Table 1.

2. A deviation is a difference in function between the SFTA and the simulation device.

3. A deviation is any other significant differences found between reference plant and simulation device during the development of the Simulation Facility.

Assessment of Deviation

1. The deviation must not prevent the operator from performing tasks. .

2. The deviation must not confuse the operator to the point of affecting task performance.

3. The deviation must not lead the operator to an error in task performance.

Disposition of Deviation

1. Any modification to the simulation device in question will require approval by the Multidisciplinary Review Team.

2. Any deviation referred to another simulation device for resolution will require feedback through the Fidelity Evaluation process.

3. The selected disposition will require verification.

1 4 Any deviation left "as is" must have all supporting documentation and analysis and an adequate description.

l Table 5 MIO388-1630A-NT03-NLO4 20

~

Deviations vary to degrees of impact on the operator. Three factors will be used to assess the deviation impact: (1) Potential to Impede, (2) Potential to Error, and (3) Potential to Confuse. The Potential to Impede is the potential that the deviation has to delay or hinder signifi-cantly the operators correct response. The Potential to Error is the potential that the deviation has to lead the operator to not perform any action or to perform an incorrect action. The Potential to Confuse is the potential that the deviation has to perplex the operator and disrupt his mental and physical actions, this factor includes the potential for the simulation to enhance the operator's performance by the presentation of information not available in the Big Rock Point Plant. The Potential to Impede is the most important factor since this factor can prevent the operator from performing the tasks. The Potentials to Error and to Confuse are of equal value. The three factors are weighted with the Potential to i Impede having a factor of 0.50 and the Potential to Error and to Confuse l having a factor of 0.25 each.

Each deviation will be rated on each potential from 1-10. A low probability is a measure of 1-3. A medium probability is a measure of 4-7. A high probability is a measure of 8-10. The formula to derive the sum rate is:

Sum Rate = Pg (.50) + P2 (.25) + P3 (.25) where: P g is the Probability to Impede P is the Probability to Error 2

P is the Probability to Confuse 3

The sum rate will determine the degree of deviation impact on the operator and direct the solution to the fix. For example, any sum rate less than or equal to 4.00 may denote the deviation can be left "as is." Conse-quently, any sum rate greater than 4.00 or any single probability greater than 7 vill denote a deviation that must be addressed by modification.

The weighing factor is derived from the D Meister method of assigning weights to criteria factors. The method of assigning 1-10 measurements is derived from the CRDR experience of rating Human Engineering Discrepancies (HEDs) for priority.

It is recognized that the process described above is a subjective one, since the results depend upon the judgment of the personnel evaluating the deviation in their application of the low, medium and high probability values discussed above. The assignation of probability ratings and determination of modifications disposition is the responsibility of the Multidisciplinary Review Team performing the evaluation (s). Therefore, we will utilize the 4.00 rating criteria suggested above. It is the purpose of this rating guidance to specify that this type of rating of deviations be performed to determine the need for modifications and/or justification of existing design. The use of 4.00 allows for the judg-ment that deviations of low probability most likely would not require modification and thac some medium probability deviations should not require upgrade. It is expected that these types of medium probability MIO388-1630A-NT03-NLO4 21

l l

deviations could consist of, but would not be limited to, deviations that l are not frequently encountered by the operator in his duties and, there- i fore, would not be expected to significantly degrade the examination process. This rating acknowledges that the majority of the medium proba-bility deviations and all of the high probability deviations will be addressed and dispositioned unless significant justification is provided to the contrary.

3.4 Simulation Device Integration I i

The integration of the SFTA and the simulation device capabilities is l necessary to ascertain the optimum Simulation Facility for the perform-anne of operating tests. The goal of the selection process is to provide a simulated control room environment that presents the highest level of l active man / machine interface. in which the 31g Rock Point Plant procedures can be exercised. The Simulation Facility will provide the opportunity to I

, test all of the operator responses to the cues identified by the opera-tional cue analysis of the Big Rock Point Plant procedures. The ability of the operator to use controlled copies of the Big Rock Point Plant pro-cedures and produce the desired responses on the simulation device, so as

• to place the plant in the desired operating configuration, shall be a determining factor in selecting the simulation device for the operating test. The simulation device shall be capable of producing the desired response to the operator actions identified in the Big Rock Point Plant procedures to the extent necessary to assure that the operator can deter-mine from the available cues that the plant is responding in the direction predicted in the plant transient analysis.

The process of selecting the simulation device (s) that will make up the Simulation Facility begins by identifying the dr.vice(s) that provides the most active man / machine interface. An I&C inventory will be conducted on the selected simulation device (s). As shown in Figure 1, the I&C inventory is then compared to the SFTA results to identify the I&C set and cues available to execute the reference plant procedures. Each procedure task listing will be evaluated to determine the ability to adequately perform the procedure (s) on the simulation device (s) without consideration of modifications to the device (s).

Following consideration of simulation device modifications, the process would then be repeated. The end result of this process will yield a procedure set applicable for examination on that simulation device and a list of simulation device modifications that are appropriate.

A similar process would be conducted on other simulation devices in descending order of their capabilities for active man / machine interface.

The emphasis during this process is to identify the simulation device that is most useful for examiners and at the same time provides a cost effective simulation device that will provide for effective training. Before any passive simulation device is selected consideration will be given to the use of controllers with the intent of always trying to use the device that promotes the most active man / machine interface.

MIO388-1630A-NT03-NLO4 22

The final selection of devices and the integration into a Simulation Facility is an iterative process. The bencfits of a device that promotes active man / machine interface are continuously evaluated against the nega-tive aspects of the device. Consideration will be given to the intrusion of the controller on the operators activities, human factors issues, etc.

3.5 Simulation Facility The last step of the flow process illustrated in Figure 1, is to describe all the devices that makeup the Simulation Facility. Our plant specific application will describe the procedures to be run on each simulation device. The supporting documentation for our application will include all the dispositioned deviations along with the evaluations and backup information.

3.6 Implementation The development of a Simulation Facility will be undertaken in a syste-matic manner, giving consideration to the benefit of any upgrades to a simulation device. When considering or upgrading any simulation devices, the Operational Cue Analysis (Section 3.2) will be used to assess the significance and importance of the modification. The implementation of the Simulation Facility will give consideration to any device that pro-motes active man / machine interface, net necessarily just those included in this document. It is understood that there are other simulation devices available now or will be available with advancing technology that may be cost effective for particular applications. The intent of this document is to describe a systematic approach to the development of a facility; not to restrict the facility to using any particular simulation device (s). It is important that the Simulation Facility provide the opportunity to examine all of the operator responses to the cues listed in the Operational Cue Analysis.

3.7 Multidisciplinary Review Team Big Rock Point's Multidisciplinary Review Team will consist of a minimum of three members, one of which must hold or have held an SRO license or certification on BRP. Collectively, the Multidisciplinary Review Team will possess expertise in the following areas:

1) Operations

2) Training

3) Engineering This group will include knowledge in transient / accident analysis, human f actors, operator job tasks and instructional methods. One individual may possess expertise in more than one area.

The role of the Multidisciplinary Review Team is to:

- Review the SFTA process and documentation generated by the SFTA.

MIO388-1630A-NT03-NLO4 23

Evaluate the Operational Cue Analysis data and disposition the devia-tions identifie~d in this process.

- Determine the applicability of each procedure to each simulation device.

Recommend the makeup of the Simulation Facility.

3.8 Configuration Management Program Big Rock Point will develop and submit, with the Simulation Facility application, a Configuration Management Program that provides control and continuing management for the BRP Simulation Facility. The Configuration Management Program will perform the following:

1. Identify, document, track and test discrepancies.

2. Identify, document and track deviations between the Simulation Facility and the reference plant.

3. Identify, document and track reference plant changes denoting effects" on operating tests.

The details of the program will be described in BRP's Simulation Facility application and will include the following:

1. An outline of the administrative procedures and responsibilities for maintaining the Simulation Facility current in accordence with the guidelines of this document.

2. A description of the organization (s) responsible for maintaining the j Simulation Facility.

3. The administrative procedures, including time requirements for updating the Simulation Facility upon a plant modification.

4 The administrative procedure (s), including time requirements, for completing, if necessary, a review of the SFTA upon a modification to the Simulation Facility.

5. The administrative procedure (s) for review / evaluation of the perform-ance test baseline data upon, modifications to the plant, modifications to the Simulation Facility or on a periodic bases (ie, once every four years).

4.0 SIMULATION DEVICEE The following sections discuss the various simulation devices used in the conduct of operating tests. These simulation devices are currently

, available simulation technology that can be used in the development of a Simulation Facility. Each section discusses the application of the previously described criteria to each simulation device, the recognized limitations of each simulation device and the advantages of each simula-tion device.

MIO388-1630A-NT03-NLO4 24

4.1 Non-Plant Referenced Simulator (NPRS)

Our initial goal is to utilize the Dresden Simulator as a NPRS simula-tion device for Big Rock Point. The following criteria apply to the I use of the Dresden Simulator as a NPRS simulation device.

4.1.1 Human Factors Control Room and Panel Layout The Dresden Simulator does not replicate Big Rock Point Plant control room and panel layout. Deviations will be evaluated for impact on ,

performance of operator tasks in accordance with Section 3 methodology. i I&C Configuration Hardware and location differences are expected. Plant specific labels, overlays, scaling modifications or other surface enhancements will be used to make the Dresden Simulator controls and panels more closely approximate the BRP Plant. Deviations will be evaluated for impact on performance of operator tasks in accordance with the Section 3 -

methodology.

Ambient Operating Environment The Dresden Simulator does not replicate Big Rock Point Plant control room ambient operating environment. Deviations will be evaluated for impact on performance of operator tasks in accordance with the Section 3 methodology.

4.1.2 Procedures As previously noted, the types of procedures to be exercised on the Dresden Simulator will include:

Normal Operating Procedures Abnormal Operating Procedures Emergency Operating Procedures, and Emergency Plan Implementing Procedures.

The scope of procedures to be used will be determined by the SFTA process described in Section 3. For each procedure performed on the Dresden Simulator, the Procedure Performance Time will be matched as closely as possible. The remainder of the generic Procedures (Section 2.2) criteria applies to the Dresden Simulator.

4.1.3 Steady State and Transient Models Scope The output of the Dresden Simulator approximates BRP Plant response.

However, similarity is limited by considerations such as core size and numbers of redundant or auxiliary systems. As a minimum, the Dresden MIO388-1630A-NT03-NLO4 25

Simulator should be capable of producing the operator cues required to enable implementation of those procedures identified by the process described in 4.1.2. Software and hardware modifications may be imple-mented, as practicable, to achieve full exercise of the procedures on the Dresden Simulator.

Fidelity The steady state values for critical parameters shall be stable and not vary significantly from the initial values over a 60-minute period.

Changes in critical parameters should correspond in direction to those expected from operating data or a best estimate analysis. If parameters deviate significantly and software modeling changes cannot be reasonably pursued, these parameters may exceed the criteria, provided:

They are specifically corrected using a Controller SE Cue cards are substituted for these parameters.

Time The Dresden Simulator operating and transient time responses approximate real time simulation. Any deviations will be handled by the SFTA process described in Section 3.

4.1.4 Performance Testing Scope The Dresden Simulator performance testing will be limited to those pro-cedures identified by the process described in 4.1.2.

Methodology Those procedures identified in 4.1.2 will be performed on the Dresden Simulator after all identified software and hardware modifications have been incorporated. An initial set of data will be collected and evaluated. After review and approval by the Multidisciplinary Review Team, these transient iesults will be the baseline data set for subse-quent performance testit:g evaluation.

Acceptance Criteria l Determination of acceptability of performance test results shall be performed by the Multidisciplinary Review Team.

4.1.5 Operating Test Methodology The Dresden Simulator will permit evaluation in a control room team environment. The operating test conducted on the Dresden Simulator shall be limited to the procedures identified by the process described MIO388-1630A-NT03-NLO4 26

_._ J

in 4.1.2. The generic guidelines for Controller interaction (Section 2.5) shall apply.- Those procedures not accomplished on the Dresden Simulator will be evaluated separately for implementation on another simulation device.

Examiners will be able to select various initial conditions and plant malfunctions to evaluate operators' or candidates' responses. The Dresden Simulator will have the capability to stop and restart simula-tion, as necessary, at any point.

The remainder of the generic Operating Test Methodology (Section 2.5) applies to the Dresden Simulator.

4.2 Control Room Mock-up We also expect to develop a Control Room Mock-up (CRM) for use as a simulation device. It will consist of a display of the Big Rock Point Plant control room panels, including the switches, indications, and alarms. The CRM will consist of photographs, three-dimensional mock-ups or a combination of both. The following criteria apply to the use of the CRM as a simulation device. -

4.2.1 Human Factors Control Room and Panel Layout The CRM will replicate the Big Rock Point Plant physical orientation and appearance. The CRM should be the same physical size as the Big Rock Point Plant although reduced scale reproduction is acceptable provided the CFTA determines that the reduction does not significantly detract from the operating test. Any reduction effort will be limited such that labels, controls, indications, alarms, etc, remain clearly legible. Deviations will be evaluated for impact on performance of operator tasks in accordance with the Section 3 methodology.

I&C Configuration The CRM controls, indications, etc, will be in the same physical loca-tion as in the Big Rock Point Plant control room. They will be repli-cated in sufficient detail to enable the desired operator capabilities to be successfully demonstrated. Functional fidelity of a CRM cannot be achieved due to its passive nature. Deviations will be evaluated for impact on performance of operator tasks in accordance with the Section 3 methodology.

Ambient Operating Environment The CRM may not replicate the ambient operating environment of the Big Rock Point Plant control room. Deviations will be evaluated for impact on performance of operator tasks in accordance with the Section 3 methodology.

MIO388-1630A-NT03-NLO4 27

^

4.2.2 Procedures As previously noted, the types of procedures to be exercised on a CRM will include:

Normal Operating Procedures, Abnormal Operating Procedures.

Emergency Operating Procedures, and Emergency Plan Implementing Procedures The scope of procedures to be used on the CRM will be determined by the SFTA process described in Section 3. For each procedure performed on the CRM, the Procedure Performance Time will be matched as closely as possible. The remainder of the generic Procedures (Section 2.2) criteria applies to the CRM.

4.2.3 Steady State and Transient Models Scope Operator cues required for those procedures identified by the process -

described in 4.2.2 will be given on the CRM using cue cards or by use of a Controller. These cues will be based on Big Rock Point Plant operat-ing data or steady state and transient best estimate analysis data.

Fidelity The CRM will be a representation of the Big Rock Point Plant. Control-1ers or cue cards may be used to enhance procedure usage.

Time CRM usage is not expected to be in real time.

4.2.4 Performance Testing Performance testing to verify a Simulation Facility's performance as compared to actual or predicted reference plant performance is not applicable for a CRM.

4.2.5 Operating Test Methodology Operating tests conducted on a CRM will consist of walkthroughs for each procedure to be tested. Task performance can only be discussed and may require extensive use of Controllers and/or cue cards to provide opera-tional cues. The remainder of the generic Operating Test Methodology (Section 2.5) applies to the CRM.

4.3 Reduced Scope Simulator A Reduced Scope Simulator (RSS) is a simulation device that physically and functionally models significant portions of the major systems of the reference plant. A RSS demonstrates expected plant response to operator input and to normal and transient conditions to which the simulator has MIO388-1630A-NT03-NLO4 28

• ~

been designed to respond. However, the number of initial conditions, normal functionsr and malfunctions available will be less than the stan-dard defined by ANF-3.5-1985. At the present time it is not expected to use a RSS as a part of the Big Rock Point Simulation Facility. How- .

ever, use of a RSS may be needed to resolve deficiencies as the SFTA is  !

completed.  !

4.4 PART TASK SIMULATOR Part Task Simulator (PTS) is a simulation device incorporating detailed modeling of a limited number of specific reference plant components or subsystems. Such a device demonstrates expected response of those com-puters or subsystems. At the present time it is not expected to use a PTS as a part of the Big Rock Point Simulation Facility. However, use of a PTS may be needed to resolve deficiencies as the SFTA is completed.

4.5 CRT Simulators A CRT Simulator is a simulation device that is computer based and CRT displayed. The information presented is a model of the reference plant operating behavior. The Input /Outpac may be limited to a computer --

keyboard and CRT, and the parameter set limited to a specific scope.

At the present time it is not expected to use a CRT as a part of the Big Rock Point Simulation Facility. However, use of a CRT Simulator may be needed to resolve deficiencies as the SFTA is completed.

4.6 Reference Plant i

It is expected the Big Rock Point Plant will be utilized as a simulation device. In this case, evolutions conducted will be limited to those which can be done from the Control Room of the Big Rock Point Plant which do not initiate transients. The following criteria apply to the use of the Big Rock Point Plant as a simulation device.

4.6.1 Human factors

When using the Plant, equipment layout, instrument and control configu-ration, cue scope and environment is exact. Huran factors need only be addressed as applied to the plant operating conditions for the evolution to be examined.

4.6.2 Procedures Use of the Big Rock Point Plant as a simulation device allows usage of all of the procedures. To the extent consistent with existing plant conditions, the operating test may address any or all of these proce-dures to demonstrate familiarity with the plant. Operator tasks which cannot be actually performed should be accomplished through verbal dis- i cussion and a walkthrough of the evolution being examined. The controls and indication needed to perform the evolution should be physically shown to the examiner and accompanied by a description of what occurs when that control is manipulated. Deviations, such as the aoove dis-cussed static operating environrent versus a desired dynamic operating environment, will be evaluated tor impact on the performance of operator tasks in accordance with the Section 3 methodology.  ;

MIO388-1630A-NT03-NLO4 29 1

4.6.3 Steady State and Transient Analysis Models When using the Big Rock Point Plant as a simulation device, secady state and transient models are only applicable to the extent necessary to assure that the examiners and controllers possess appropriate informa-tion regarding expected plant behavior. This information is based upon plant operating data or best estimate data.

4.6.4 Performance Testing Performance testing is not applicable when the plant is utilized as the simulation device.

4.6.5 Operating Test Methodology Operating tests conducted on the Big Rock Point Plant may consist of walkthroughs and/or operation of selected plant evolutions, for each procedure to be tested. Task performance that cannot actually be per-formed vill be discussed and may require extensive use of controllers and/or cue cards to provide operational cues. The remainder of the ,

generic Operating Test Methodology (Section 2.5) applies to the Reference Plant.

5.0 IMPLEMENTATION SCHEDULE Thia Implementation Schedule is a target schedule. As efforts are initiated, a better estimation of the actual duration to complete the identified tasks will evolve. An application for use of the Big Rock Point Simulation Facility developed in accordance with this plan will be submitted for NRC review and approval by the Novecber 26, 1990 required date. .

(1) SFTA June 88 to June 89 (a) Task Analysis (b) Cue Analysis (c) I&C Requirements (2) Simulation Device Comparison Feb 89 to July 89 and Selection.

(3) Fidelity Evaluation (a) Identification / Assessment July 89 to Nov 89 of Deviation (b) Disposition of Deviation July 89 to May 90 (4) Simulation Device Integration Jan 90 to Sept 90 (5.' Performance Testing May 90 to Sept 90 (6) Simulation Facility Application May 90 to Nov 26 90 M10388-1630A-NT03-NLO4 30