ML23160A054

2.3-2 - Operating Test Quality Checklist

ML23160A054
Person / Time
Site:	Dresden
Issue date:	03/16/2023
From:	Constellation Energy Generation
To:	NRC/RGN-III
Gregory Roach
Shared Package
ML22007A046	List: ML23160A052 ML23160A054 SVPLTR 23-0002, 2.3-4 - Written Examination Quality Checklist
References
SVPLTR: #23-0002
Download: ML23160A054 (1)

Text

Form 2.3~2 Operating Test Quality Checklist Facility: Dresden Date of Examination: 4/10/23 Ooeratina Test Number: 2023-301

{Yes/ (N)o General Criteria a b* c#

a. The operating test meets the criteria on the associated test outline. i y GMR

b. There are enough test items so that test items will not be repeated on more than 1 day of the operating test.

y y GMR GMR C. The operating test does not duplicate items from the applicants' audit test(s). '/ y GMR

'/ y

d. Overlap with the written examination and between different parts of the operating test is minimized.

e. It appears that the operating test will differentiate between competent and less-than- GMR competent applicants at the designated license level. '/ 'I Walkthrouah Criteria

f. Each job performance measure (JPM) includes the following, as applicable:

• task standard

• initial conditions

. initiating cues references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical alternate path JPMs are labeled as "alternate pathH operationally important specific performance criteria that include the following:

y 'I GMR

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the JPM task standard

- identification of critical steps and their associated performance standards

- restrictions on the seauence of steos, if aoolicable

g. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations) specified on those forms.

f '( GMR Simulator Scenario Set Criteria for Scenario Numbers: 1 / 2 / 3 / 4 QUALITATIVE ATTRIBUTES

1. The initial conditions are realistic in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. i y GMR

2. The scenarios consist mostly of related events. y y GMR

3. Each event description consists of the following:

• the point in the scenario when it is to be initiated the malfunction(s) or conditions that are entered to initiate the event the symptoms/cues that will be visible to the crew y 'I GMR

• the expected operator actions (by shift position)

• the event termination point (if applicable)

(Y)es / (N)o a b* c#

QUALITATIVE ATTRIBUTES (continued)

The events are valid with regard to physics and thermodynamics. y y GMR The sequencing and timing of events is reasonable and allows the examination team to 4.

observe and evaluate applicant performance. '/

5. GMR

\(

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time 6.

constraints. Cues are given. y y GMR The simulator modeling is not altered. y GMR 7.

8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to e nsure that functional fidelity is maintained while running the planned scenarios.

'/ y GMR Scenarios are new or significantly modified in accordance with ES-3.4. y y GMR

10. Scenarios (as groupe d) allow each applicant to be significantly involved in the minimum 9.

number of transients, events, and evolutions specified on the ve rsion of Form 3.4-1 submitted with the scenario set. '/ y GMR

11. Applicants are evaluated on a similar number of preidentified critical tasks across scenarios, when possible. y y GMR

12. The level of difficulty is appropriate to support licensing decisions for each crew position. y y GMR Actual Attributes by (Y)es / (N)o a b* c#

TARGET QUANTITATIVE ATTRIBUTES per Scenario (See ES-3.4) Scenario No.

1/2/3/4 Malfunctions after emergency operating procedure (EOP) entry (1-2) Y.

1.

2 I 1 / 1 / 1 GMR

'(

Abnormal events (2-4) 'Y '( GMR Major transients (1-2)

2. 3 / 3/ 4 / 4 y y GMR EOPs ente red/requiring substantive actions (1-2)

3. 2/2/2/2 2 I 2 / 2 / 3 V 'I GMR

5. Entry into a contingency EOP with substantive actions 4.

(?. 1 per scenario set; set is the e ntire set of sce narios y y prepared for the sch eduled e xam) 1/1/1/1 GMR Pre identified critical tasks (?. 2) y y 2 I 2 I 2 I 2 GMR 6.

Pri2\LgU/ D e

a. Author Derek Siuda / I k C23

b. Facility Reviewer(') Jonathan Chaoman /

I,.,,,'

1

/1 -i/1,3

h. NRC Reviewer(#)

Gregory M. Roach, Jr.

C/Y Gregory M Roach Jr. 3/14/23 NRC Chief Examiner Gregory M. Roach, Jr. Gregory M Roach Jr. 3/14/23 NRG Supervisor April M. Nguyen Digitally signed by April M. Nguyen Date: 2023.03.16 11:01:08 -05'00'

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRG reviewer performs the steps in column c. This may be the NRC Chief Examiner if he/she did not develop the operating test under review.