ML23200A185

Form 2.3-2 Operating Test Quality Checklist

ML23200A185
Person / Time
Site:	Fermi
Issue date:	06/02/2023
From:	NRC/RGN-III/DORS/OB
To:	Detroit Edison, Co
Bryan Bergeon
Shared Package
ML22007A057	List: ML23200A184 ML23200A185 ML23200A186
References
Download: ML23200A185 (1)

Text

Fonn 2.3-2 Operating Test Quality Checklist Facilitv: Fermi Date of Examination: 6/19/2023 Operating Test Number:2023-1 (Y)es / (No General Criteria a b* d'

a. The operating test meets the criteria on the associated test outline. y y y II There are enough test items so that test items will not be repeated on more than 1 day of y y y b.

the operating test. II C. The operating test does not duplicate items from the applicants' audit test(s). y y y

! d.

Overlap with the written examination and between different parts of the operating test is minimized.

y y y II It appears that the operating test will differentiate between competent and y y y 11 e. less-than-competent applicants at the designated license level. II Wak I through C riteri a

a. Each job performance measure (JPM) indudes the following, as applicable: y y y

.. task standard initial conditions

... initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical

.. alternate path JPMs are labeled as "alternate path" operationally important specific performance criteria that include the following:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the JPM task standard

- identification of critical steps and their associated performance standards

- restrictions on the sP.nuence of stens, If aoolicable

b. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) y y y have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations) specified on those forms.

Simulator Scenario Set Criteria for Scenario Numbers* 1 / 2 / 3 / 4 II QUALITATIVE ATTRIBUTES The initial conditions are realistic in that some equipment and/or instrumentation may be y y y 1.

out of service, but it does not cue the operators into expected events.

y I 2. The scenarios consist mostly of related events. y y

3. Each event description consists of the following: y y y

• the point in the scenario when it is to be initiated

• the malfunction(s) or conditions that are entered to initiate the event

• the symptoms/cues that will be visible to the crew

• the expected operator actions (by shift position)

• the event termination point (if applicable)

Cf es I N)o QUALITATIVE ATTRIBUTES (conti nued) a b* elf.

y y y ics.

4. The events are valid with regard to physics and thermodynam y y y and allows the examination team to

~ 5. The sequencing and timing of events is reasonable observe and evaluate applicant performance.

y y y rio summary clearty so indicates.

6. If time compression techniques are used, the scena activities without undue time Operators have sufficient time to carry out expected constraints. Cues are given.

y y y

7. The simulator modeling is not altered.

y y y CFR 55.46(d), any open simulator

8. The scenarios have been validated. Pursuant to 1O the refere nced plant have been evaluated to performance deficiencies or deviations from nal fidelity Is mainta ined while runnin g the planned scenarios.

ensure that functio y y y ES-3.4 .

9. Scenarios are new or significantly modified in accordance with y y y

10. Scenarios (as grouped) allow each applicant to be significantly Involved in the minimum numbe r of transients, events, and evolutions specif ied on the version of Form 3.4-1 submitted with the scena rio set.

y y y

11. Applicants are evalua ted on a simila r numbe r of scenarios, when possib le.

preidentified critical tasks across I

12. The level of difficulty is appropriate to support licensi ng decisions for each crew position.

y y y I

Actual Attributes by (Y)es /{N)o (See ES-3.4) Scenario No.

TARGET QUANTITATIVE ATTRIBUTES per Scenario 1 / 2 / 3 / 4 a b* elf.

y y y 2 I 2 I 1 I 1

1. Malfunctions after emergency operating procedure (EOP) entry (1-2) y 3 I 3 I 6 I 5 y y I2. Abnormal events (2-4) y y y 1 I 1 I 1 I 1

3. Major transients (1-2) y

/ 1 I 2 y y 2 I 2

4. EOPs entered/requiring substantive actions (1-2) y y y s 1 I O / 1 / 1

5. Entry into a contingency EOP with substantive action e 1 per scenario set; set is the entire set of scena rios prepared for the scheduled exam) y y y

6. Preidentified critical tasks e 2) 2 / 3 / 2 / 2 Date

~ Printed Name/S;gnalme

a. Autho r Facilit y Revie wer(*) /fl . ~\,i8_.i,~ "' ~

~,~t}  ::z. s

b. -1 ..::::;z. 05/1/2023 Bryan A Bergeon I ~ )

C. NRC Revie wer(# )

ofo/o')./J.oJ..'~

Bc':!t\." t-. ~ <~t.er-. /" *~ ~....

NRC Chief Examiner Apr il M. Ngu yen

- Digitally signed by April M. Nguyen Date: 2023.06.02 13:08:07 -05'00' NRC Supervisor NRG-developed tests.

• The facility licensee signature is not applicable for in column c. This may be the NRC Chief Examiner if he/she

1. An indepe ndent NRC review er perfor ms the steps did not develop the ooeratinq test under review.