ML23079A204

Form 2.3-2 Operating Test Quality Checklist (Quad Cities, 2023)

ML23079A204
Person / Time
Site:	Quad Cities
Issue date:	01/13/2023
From:	NRC/RGN-III/DORS/OB
To:	Exelon Generation Co
Theodore Wingfield
Shared Package
ML22125A064	List: ML23079A203 ML23079A204 ML23079A207
References
Download: ML23079A204 (2)

Text

Form 2.3-2 Operating Test Quality Checklist Facility: Quad Cities Date of Examination: 1/30/22 Operating Test Number: ILT 21-1 (Y)es / (N)o General Criteria a b* c#

a. The operating test meets the criteria on the associated test outline. Y Y Y

b. There are enough test items so that test items will not be repeated on more than 1 day of the operating test. Y Y Y

c. The operating test does not duplicate items from the applicants audit test(s). Y Y Y

d. Overlap with the written examination and between different parts of the operating test is Y Y minimized. Y

e. It appears that the operating test will differentiate between competent and Y Y Y less-than-competent applicants at the designated license level.

Walkthrough Criteria

a. Each job performance measure (JPM) includes the following, as applicable:

• task standard

• initial conditions

• initiating cues

• references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical

• alternate path JPMs are labeled as alternate path Y Y Y

• operationally important specific performance criteria that include the following:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the JPM task standard

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item Y Y Y distribution, bank use, repetition from the last two NRC examinations) specified on those forms.

Simulator Scenario Set Criteria for Scenario Numbers: 1 / 2 / 3 / 4 QUALITATIVE ATTRIBUTES

1. The initial conditions are realistic in that some equipment and/or instrumentation may be Y Y Y out of service, but it does not cue the operators into expected events.

Y Y Y

2. The scenarios consist mostly of related events.

3. Each event description consists of the following:

the point in the scenario when it is to be initiated Y Y Y the malfunction(s) or conditions that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

(Y)es / (N)o QUALITATIVE ATTRIBUTES (continued) a b* c#

Y Y

4. The events are valid with regard to physics and thermodynamics. Y

5. The sequencing and timing of events is reasonable and allows the examination team to Y observe and evaluate applicant performance. Y Y

6. If time compression techniques are used, the scenario summary clearly so indicates.

Y Y Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.

Y

7. The simulator modeling is not altered. Y Y Y

8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator Y Y Y performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

9. Scenarios are new or significantly modified in accordance with ES-3.4. Y Y Y

10. Scenarios (as grouped) allow each applicant to be significantly involved in the minimum number of transients, events, and evolutions specified on the version of Form 3.4-1 Y Y Y submitted with the scenario set.

11. Applicants are evaluated on a similar number of preidentified critical tasks across Y Y Y scenarios, when possible.

12. The level of difficulty is appropriate to support licensing decisions for each crew position. Y Y Y Actual Attributes by (Y)es / (N)o TARGET QUANTITATIVE ATTRIBUTES per Scenario (See ES-3.4) Scenario No.

1 / 2 /3 / 4 a b* c#

1. Malfunctions after emergency operating procedure (EOP) 2 / 1 / 1 / 2 Y Y entry (1-2) Y

2. Abnormal events (2-4) 4 / 4 / 4 / 4 Y Y Y

3. Major transients (1-2) 1 / 1 / 1 / 1 Y Y Y

4. EOPs entered/requiring substantive actions (1-2) 2 / 1 / 2 / 2 Y Y Y

5. Entry into a contingency EOP with substantive actions 1 / 1 / 2 / 1

(> 1 per scenario set; set is the entire set of scenarios Y Y Y prepared for the scheduled exam) 2 / 4 / 3 / 2 Y Y

6. Preidentified critical tasks (> 2) Y Printed Name/Signature Date

a. Author Sean Sullivan

______________________________________________________________ 11/11/22

b. Facility Reviewer (*) Matt Seeley

______________________________________________________________ 11/11/22

c. NRC Reviewer (#) Theodore V. Wingfield Digitally signed by Theodore V. Wingfield Date: 2023.01.13 13:03:10 -05'00' NRC Chief Examiner Theodore V. Wingfield Digitally signed by Theodore V. Wingfield Date: 2023.01.13 13:03:37 -05'00' NRC Supervisor April M. Nguyen Digitally signed by April M. Nguyen Date: 2023.01.17 13:58:02 -06'00'

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs the steps in column c. This may be the NRC Chief Examiner if he/she did not develop the operating test under review.