ML23199A153

Form 2.3-2 Operating Test Quality Checklist

ML23199A153
Person / Time
Site:	Point Beach
Issue date:	02/03/2023
From:	NRC/RGN-III/DORS/OB
To:	Point Beach
Jim Nance
Shared Package
ML22007A027	List: ML23199A153 ML23199A155
References
Download: ML23199A153 (1)

Text

Form 2.3-2 Operating Test Quality Checklist Facility: Point Beach Date of Examination: Feb 13, 2023 Operating Test Number: 2023 (Y)es / (N)o General Criteria a b* c#

a. The operating test meets the criteria on the associated test outline.

Y N/A Y

b. There are enough test items so that test items will not be repeated on more than 1 day of the operating test. Y N/A Y

c. The operating test does not duplicate items from the applicants audit test(s). Y N/A Y

d. Overlap with the written examination and between different parts of the operating test is minimized. Y N/A Y

e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level. Y N/A Y Walkthrough Criteria

a. Each job performance measure (JPM) includes the following, as applicable:

• task standard

• initial conditions

• initiating cues

• references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical

• alternate path JPMs are labeled as alternate path Y N/A Y

• operationally important specific performance criteria that include the following:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the JPM task standard

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations) specified on those Y N/A Y forms.

Simulator Scenario Set Criteria for Scenario Numbers: 027E / 028E / 029E / 030E QUALITATIVE ATTRIBUTES

1. The initial conditions are realistic in that some equipment and/or instrumentation may be Y N/A Y out of service, but it does not cue the operators into expected events.

2. The scenarios consist mostly of related events. Y N/A Y

3. Each event description consists of the following:

• the point in the scenario when it is to be initiated

• the malfunction(s) or conditions that are entered to initiate the event Y N/A Y

• the symptoms/cues that will be visible to the crew

• the expected operator actions (by shift position)

• the event termination point (if applicable)

(Y)es / (N)o QUALITATIVE ATTRIBUTES (continued) a b* c#

4. The events are valid with regards to physics and thermodynamics. Y N/A Y

5. The sequencing and timing of events is reasonable and allows the examination team to Y N/A Y observe and evaluate applicant performance.

6. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.

7. The simulator modeling is not altered. Y N/A Y

8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to Y N/A Y ensure that functional fidelity is maintained while running the planned scenarios.

9. Scenarios are new or significantly modified in accordance with ES-3.4. Y N/A Y

10. Scenarios (as grouped) allow each applicant to be significantly involved in the minimum number of transients, events, and evolutions specified on the version of Form 3.4-1 Y N/A Y submitted with the scenario set.

11. Applicants are evaluated on a similar number of preidentified critical tasks across Y N/A Y scenarios, when possible.

12. The level of difficulty is appropriate to support licensing decisions for each crew position. Y N/A Y Actual Attributes by (Y)es / (N)o TARGET QUANTITATIVE ATTRIBUTES per Scenario (See Scenario No.

ES-3.4) 027E / 028E / 029E / 030E a b* c#

1. Malfunctions after emergency operating procedure 1/1/1/2 Y N/A Y (EOP) entry (1-2)

2. Abnormal events (2-4) 4/3/3/3 Y N/A Y

3. Major transients (1-2) 1/2/1/1 Y N/A Y

4. EOPs entered/requiring substantive actions (1-2) 1/2/1/1 Y N/A Y

5. Entry into a contingency EOP with substantive actions 0/1/0/1

(> 1 per scenario set; set is the entire set of scenarios Y N/A Y prepared for the scheduled exam)

6. Preidentified critical tasks (> 2) 2/2/3/2 Y N/A Y Printed Name/Signature Date

a. Author Troy Henning / Troy J. Henning_and_Jeff Correll / Jeffrey A. Correll__2/2/2023

b. Facility Reviewer (*) N/A ___________________________________________________________

c. NRC Reviewer (#) Randal Dean Baker / ______________________2/2/2023 NRC Chief Examiner James C. Nance / Janes C. Nance _____________________________2/2/2023 NRC Supervisor April Nguyen / ___________________________________________________ 2/3/2023

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs the steps in column c. This may be the NRC Chief Examiner if he/she did not develop the operating test under review.