ML24173A155

Ile Form 2.3-2 Operating Test Quality Checklist

ML24173A155
Person / Time
Site:	Quad Cities
Issue date:	05/14/2024
From:	NRC/RGN-III/DORS/OB
To:	Exelon Generation Co
Bryan Bergeon
Shared Package
ML22251A228	List: ML24173A155 ML24173A156 SVP-24-018, Ile Proposed Exam Submittal Letter
References
Download: ML24173A155 (1)

Text

Form 2.3-2 Operating Test Quality Checklist

Facility: Date of Examination: Operating Test Number:

General Criteria (Y)es / (N)o a b* c #

a. The operating test meets the criteria on the associated test outline. Y

b. There are enough test items so that test items will not be repeated on more than 1 day of Y the operating test.

c. The operating test does not duplicate items from the applicants audit test(s). Y

d. Overlap with the written examination and between different parts of the operating test is Y minimized.

e. It appears that the operating test will differentiate between competent and Y less-than-competent applicants at the designated license level.

Walkthrough Criteria F

a. Each job performance measure (JPM) includes the following, as applicable:

• task standard

• initial conditions

• initiating cues

• references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical

• alternate path JPMs are labeled as alternate path Y

• operationally important specific performance criteria that include the following:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the JPM task standard

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item Y distribution, bank use, repetition from the last two NRC examinations) specified on those forms.

Simulator Scenario Set Criteria for Scenario Numbers: / /

QUALITATIVE ATTRIBUTES (r 02pFyiycyoCF 3ihycy3inFoepFepoCyncy FyiFc2ocFn3tpFpEgyOtpicFoih13eFyincegtpicocy3iFtoUF-p Y 3gcF3aFnpe/y pfF-gcFycFh3pnFi3cF gpFc2pF3Opeoc3enFyic3FpVOp cphFp/picnr Gr 02pFn pioey3nF 3inyncFt3ncCUF3aFepCocphFp/picnr Y

Br mo 2Fp/picFhpn eyOcy3iF 3inyncnF3aFc2pFa3CC3kyiSN the point in the scenario when it is to be initiated Y the malfunction(s) or conditions that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

QUALITATIVE ATTRIBUTES (continued) (Y)es / (N)o a b* c#

4. The events are valid with regard to physics and thermodynamics. Y

5. The sequencing and timing of events is reasonable and allows the examination team to Y observe and evaluate applicant performance.

6. If time compression techniques are used, the scenario summary clearly so indicates. Y Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.

7. The simulator modeling is not altered. Y

8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator Y performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

9. Scenarios are new or significantly modified in accordance with ES-3.4. Y

10. Scenarios (as grouped) allow each applicant to be significantly involved in the minimum Y number of transients, events, and evolutions specified on the version of Form 3.4-1 submitted with the scenario set.

11. Applicants are evaluated on a similar number of preidentified critical tasks across Y scenarios, when possible.

12. The level of difficulty is appropriate to support licensing decisions for each crew position. Y

Actual Attributes by (Y)es / (N)o TARGET QUANTITATIVE ATTRIBUTES per Scenario (See ES-3.4) Scenario No.

/ / a b* c#

1. Malfunctions after emergency operating procedure (EOP) 2 / /

entry (1-2) Y

2. Abnormal events (2-4) / / 44 Y

3. Major transients (1-2) / / Y

4. EOPs entered/requiring substantive actions (1-2) / / 2 Y

5. Entry into a contingency EOP with substantive actions / /

(> 1 per scenario set; set is the entire set of scenarios Y prepared for the scheduled exam)

6. Preidentified critical tasks (> 2) / / 33 Y

Printed Name/Signature Date

a. Author ______________________________________________________________

b. Facility Reviewer (*) ______________________________________________________________

c. NRC Reviewer (#) ________________________________________________________________

NRC Chief Examiner _________________________________________________________________

NRC Supervisor _________________________________________________________________

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs the steps in column c. This may be the NRC Chief Examiner if he/she did not develop the operating test under review.