ML24149A121

Form 2.3-5 Written Exam Review Worksheet (Fermi 2024 Ile - Final)

ML24149A121
Person / Time
Site:	Fermi  (NPF-043)
Issue date:	03/13/2024
From:	NRC/RGN-III/DORS/OB
To:
Travis Iskierka-Boggs
References
NRC-24-0023
Download: ML24149A121

Text

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1 F

2 M

S Note 1: tie to Tier 1 (1) 2 F

H 3

X N

M E

S Note 1: tie to Tier 1 (1)(3)

NRC:

1)

Is it RO knowledge to know the basis of specific steps in the AOP as described in question pedigree and distractor analyses?

2)

Distractors are written in a different tense than the correct answer. A and B have actions that will occur, D has an action that is occurring, and C has an action that has occurred which is different than the other three potentially leading to cueing.

3)

In order to resolve issue in #2, change the stem to state, Due to the loss of Bus 72R 4)

Change distractors for A and B to have drifted open; D to have failed open 5)

Would the valves in D drift open similar to A and B or do they fail in the opened position?

Facility:

1)

The objective that the question is tied to relates to applying notes and cautions of the AOP more than the bases. The bases information referenced in the distractor write-ups is for the incorrect response, so is not necessary to answer

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

the question correctly. Also, the information located in the bases supports systems knowledge that the candidate should be able to recall that will also help to eliminate the incorrect responses.

2)

Made change to stem in recommendation 3 below to help with tense issue.

3)

Made change in stem as recommended.

4)

Changed Distractors A and B as recommended and changed Distractor D as recommended, which, along with revising the stem, will correct the tense issue with these distractors.

5)

The valves in D have what is known as Stay-Put relays in their actuators, causing them to fail as-is. IF the valves were open at 100% power, they would fail open but since they are normally closed at 100% power, the fact that they fail as-is makes this distractor incorrect.

NRC:

Changes incorporated result in SAT question.

NRC:

1)

Originally submitted question has been changed out for 75-day submittal.

Modified question submitted for review.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

This question does not count towards early look submittal.

2)

Newly submitted, modified question is SAT.

3 H

3 N

E/S?

S Note 1: tie to Tier 1 (1)(4)

NRC:

1)

This question appears to be a systems question in which the power supply knowledge can be applied to answer where to send an NO to investigate.

2)

Are applicants provided control power supplies to busses during systems training?

Facility:

1)

Response to ARPs referenced in the question, 1D7 & 2D29, specifically to the fact that the alarms come in and clear for a loss of DC control power to Bus 72C, is taught during Operating Characteristics & Procedures (OC&P),

specifically in Scenario SS-OP-802-200-1.

2)

Control power supplies to specific busses is not covered during systems training. The importance of the impact of loss of Control Power to Bus 72C, since it results in swap of MCC 72CF and entry into LCO 3.0.3, is covered in OC&P, including the need for prompt response to allow exiting the S/D LCO,

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

thus Fermi 2 believes this to be a valid Tier 1 question.

NRC: Based upon further information provided, Question is SAT.

4 H

3 X

X N

U S

Note 1: tie to Tier 1 (1)

NRC:

1)

Two-part question in which two of the distractors are the same for the first part and the other two are different. This leads to potential cueing.

2)

The second part of the question can be answered without needing to know the first part and still come to a correct answer.

3)

Distractor C has incorrect procedure number for Plant Fires. It is currently listed as 22.000.02, Plant Fires. The reference provided is 22.000.22, Plant Fires. Incorrect procedure number is referenced again in the answer explanation for the correct answer, and in the reference information section.

Facility:

1)

Changed Distractor D to include the same Part (1) as the correct response. A new Part (2) for Distractor D also needed to be created to be plausible.

2)

Revised procedure numbering throughout question and explanation section.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

3)

Changed LOK to High.

NRC: Question is SAT.

5 F

2 N

E S

Note 1: tie to Tier 1 (1)

NRC:

1)

The premise of the question is Sat along with answers/distractors. However, to closely align the question more to Tier 1 it would be best to format the question in which there are conditions given that a SCRAM has just occurred. Then ask the candidates how they would verify all control rods are inserted; and requirements of rod status associated with IRMs/SRMs in accordance with the Notes in 20.000.21, Reactor Scram AOP.

Facility:

1)

Changes made as recommended.

NRC: Question is SAT.

6 H

3 B

E S

Note 1: tie to Tier 1 (1)

Reference provided. Reactor Cooldown Saturated Table NRC:

1)

Distractor analysis discusses 100F/hr cooldown limit as a potential plausible distractor. Where is this cooldown limit required? If there is another procedurally required cooldown of 100F/hr, then recommend asking without exceeding administrative cooldown iaw 20.000.19.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

2)

Changing the stem to state, The CRS has directed you to start a cooldown at the RSD in accordance with 20.000.19, Shutdown from Outside the Control Room, would make the question better and help address the concern in item 1.

Facility:

1)

The 100F/hr cooldown limit is plausible because that is the TS cooldown rate limit. This can be seen in GOP 22.000.05, Pressure/Temperature Monitoring During Heatup and Cooldown, P&L 3.1, which states The reactor is administratively limited to

<90F/Hr heatup or cooldown to avoid exceeding the 100F/Hr heatup or cooldown rate of TS Section 3.4.10, RCS Pressure and Temperature (P/T)

Limits.

2)

The original version of the question was worded as recommended by the NRC.

However, during validation this wording was recommended because it emphasizes the ADMINISTRATIVE limit, which is terminology used and understood by licensed operators.

NRC: Question is SAT based upon facility feedback.

7 H

3 B

S Note 1: tie to Tier 1 (1)

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

8 H

3 B

S Note 1: tie to Tier 1 (1)

PREVIOUS 2 EXAMS (2021) 9 H

3 N

E S

Note 1: tie to Tier 1 (1)

NRC:

1)

Is it expected practice to re-enter scram procedure in these conditions? I ask the question because a candidate may argue that the crew would not enter the procedure as the plant is in Mode 4 already and no actions would be taken in the scram procedure, therefore being no correct answers available.

2)

Change distractor D to state 2 and 3 ONLY rather than all of the above.

Update distractor analysis.

Facility:

1)

The plant was in MODE 4 with SDC in operation. At that time, there would not be a scram condition present. Given the conditions in the stem, a scram would occur, and conditions would require entering the AOP for reactor scram as well as the AOP for loss of SDC. The scram AOP would include actions to reset the scram (once the condition was clear) and reset isolations that have occurred, such as Drywell Sumps that also isolate at Level 3 (when SDC isolates).

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

2)

Changed Distractor D per direction from the CE.

NRC: Distractor D needs to be lowercase and Facility: made and lowercase in Distractor D.

NRC: Question is SAT.

10 F

3 N

S Note 1: tie to Tier 1 (4)

NRC:

1)

Question is SAT overall.

2)

Recommend making slight change to the question asked such that it reads, Which of the following actions is required to be performed in accordance with Technical Specifications?

Facility:

1)

Made change to wording of the question as recommended.

NRC: Changes incorporated. Q is still SAT.

11 F

H 3

X B

U S

NOTE 1 - No Tie to Tier 1 NRC:

1)

Initial conditions of the question put the applicant in an abnormal condition.

However, the basis of the question stems from information provided as systems level knowledge and backed by the TSBs. This question does not tie into any of the four required items of the NUREG to meet Tier 1. See NOTE 1.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

2)

Without procedures provided as reference, I cannot check to validate if this pressure requirement is provided in 29.100.01 Sheet 2 to test for information in an AOP/EOP.

3)

Question is marked UNSAT for Q-K/A for not meeting Tier 1 requirements.

Facility:

1)

Agree that this question is not Tier 1. It was sent as early review for that reason, to see if a Bank Question previously used on an NRC exam for the same K/A would still meet the K/A requirements with the new Tier focus.

2)

A new question version has been written to be a better Tier 1 match.

NRC:

Changes incorporated result in SAT question.

Two-part questions are inherently High Cognitive and LOK has been updated accordingly.

12 H

3 B

S NOTE 1 - Tie to Tier 1 (4)

NRC:

1)

Two-part question in which there are different distractors for three of the four part two distractors leading to cueing.

There is no requirement to avoid these types of questions, but these types of questions will receive a great deal of negative comments from chief examiner depending on how they are worded. See

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

the other questions on this exam that are in this format.

2)

Regulator No. (2) pushbutton as a distractor, recommend removing the ()

around the regulator number unless this is exactly part of the component nomenclature.

Facility:

1)

Noted.

2)

Removed the () parenthesis from around Regulator No. (2) as this does not match nomenclature in the procedure.

NRC: Question is SAT.

13 H

3 N

S NOTE 1 - Tie to Tier 1 (1)

NRC:

1) 14 H

3 B

S NOTE 1 - Tie to Tier 1 (1)

NRC:

15 H

3 B

S NOTE 1 - Tie to Tier 1 (1)

NRC:

16 H

3 B

S NOTE 1 - Tie to Tier 1 (1)

NRC:

17 F

3 N

E S

NOTE 1 - Tie to Tier 1 (1)

NRC:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

LOK identified as high. Candidate is only required to recall one piece of information from the EOPs and is therefore a LOK Fundamental/Low.

2)

Is stating that the parameter needs to be monitored with SRVs being closed necessary? It feels slightly like cueing.

Drywell Pressure is the only primary containment parameter in the FSL-OR1 and the question should be answerable without providing this statement.

3)

If it is necessary to make the SRV statement, I suggest changing to, Which of the following Primary Containment parameters should be monitored in conjunction with the SRVs being closed to determine when to STOP lowering RPV level? as the way it is now is awkward.

Facility:

1)

LOK changed to Fund.

2)

The statement was added during validation review because the validators stated that DW Pressure, by itself, is not used to determine when to stop lowering RPV level. The standard communication from the CRS always includes monitoring DW Pressure and SRV status together.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

3)

Kept SRV statement and changed wording as recommended.

NRC: Question is SAT.

18 H

3 X

X N

U S

NOTE 1 - Tie to Tier 1 (1)

NRC:

1)

Two-part question in which there are different distractors for three of the four part one distractors leading to cueing.

2)

To make it a true 2x2 there should be a choice of two choices for part 1 and two choices for part 2.

3)

Correct distractors for the first part are lengthier and provide an additional reason for why they can be started (they are for areas outside of secondary containment). This additional statement is also cueing for the verbiage and makes the first part of these two significantly longer than the other two options. Question is considered Unsat due to the cueing in Distractors C and D Part 1. Removing this additional reasoning will result in the question becoming SAT. The fault of 2x2 will be overlooked since an applicant must determine the first part correctly as well as the second one without simply guessing one part to get the correct outcome.

Facility:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

Changed C and D part (1) as directed.

This should address all 3 comments above.

NRC: Changes incorporated result in Question being SAT.

19 F

3 B

S NOTE 1 - Tie to Tier 1 (1)

NRC:

20 H

3 B

E S

NOTE 1 - Tie to Tier 1 (1)

NRC:

1)

LOK changed to High 2)

Answer analysis states for Part 2, If Main Generator Frequency is <57.8 Hz and Reactor Power is >30%, Trip the Turbine and enter AOP for Turbine/Generator Trip. Yet the annotated correct answer and the AOP state to Place Reactor Mode Switch in Shutdown. Answer analysis needs to be updated to reflect the correct answer.

Facility:

1)

Changed LOK to High.

2)

Corrected answer analysis to reflect the correct actions taken (Mode Switch in S/D) as specified in the correct response.

21 H

3 N

S NOTE 1 - Tie to Tier 1 (1)

NRC:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

22 F

3 N

S NOTE 1 - Tie to Tier 1 (1)

NRC:

23 H

3 X

X N

U S

NOTE 1 - Tie to Tier 1 (1)

NRC:

1)

Question is Unsat due to the formatting of the answer selections. Using 4 options and trying to have multiple options to chose from is not possible without cueing.

2)

Suggest keeping the question the same and if possible make the four answer choices the four procedures provided.

Since Reactor Scram is the only procedure directly entered, and the other three have direct entry criteria, then there is no issue having them as distractors by themselves.

Facility:

1)

New question version written per CE suggestion, which will address both 1) and 2) above.

NRC: Changes result in Question being SAT.

24 H

3 N

S NOTE 1 - Tie to Tier 1 (1)

NRC:

25 F

3 X

N E

S NOTE 1 - Tie to Tier 1 (1)

NRC:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

See NUREG-1021, ES-4.2, Section D.3.

Use of None of the above is not allowed for a valid distractor. Selection A is None. Replace with another plausible distractor.

2)

If another plausible distractor is not available, then make question 2x2 asking which system will isolate for first part and have RWCU and HPCI as two options, and then ask what the isolation setpoint temperature is for the area that was isolated. Remove Main Steam Tunnel from stem of question if taking this approach.

Facility:

1)

Replaced Distractor A, which was previously None, with RCIC.

2)

Updated answer explanations accordingly.

NRC: Question is SAT.

26 F

3 M

E S

NOTE 1 - Tie to Tier 1 (1)

NRC:

1)

Question too closely overlaps with Q R11. Since R08 description stated there are only 2 direct questions from previous 2 NRC exams on RO section, I recommend using the previous question that this question was modified from on this exam instead.

Facility:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

Replaced question with BANK question that was mentioned in the question explanation. However, the replacement was Question R25 of the 2020 NRC exam, NOT the 2023 NRC exam, therefore the question is BANK but NOT PREVIOUS 2.

NRC: Updated Previous 2 count on NRC tracking form. Replacement Question is SAT.

27 T2/

G1 F

3 N

S NRC:

1)

LOK changed to High due to question requiring the candidates to process more than one piece of knowledge to determine power source available.

Facility:

1)

Changed LOK to High.

28 F

3 B

S 29 F

3 X

B E

S NRC:

1)

Annotated correct answer is a form of all of the above which is not allowed as previously described.

Facility:

1)

A new distractor was developed to include a valve that could plausibly go closed for the conditions given, but is not included in the correct response, thus

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

eliminating the all of the above concern.

NRC: Question is SAT.

30 H

3 B

S 31 H

3 B

S 32 H

4 N

S NRC:

1)

Two-part question in which there are different distractors for three of the four part one distractors leading to cueing.

2)

Determination from the first part is needed to properly make the correct selection on the second part of this question. Q is marked as Sat for this reason.

33 F

3 M

S 34 H

3 B

M S

NRC:

1)

Question is identified as Bank with explanation for why it is not modified.

Question is significantly modified in that the distractors have been changed to match Fermi and do not directly match the GFE bank item. Changed categorization to Modified question.

Facility:

1)

Changed question source to Modified.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

35 F

3 B

S 36 H

3 B

S 37 H

3 B

S 38 H

3 B

S NRC:

1)

Add, ONLY to end of answer C. Add a comma following blocked and prior to ONLY in B.

Facility:

1)

Added ONLY to end of Distractor C.

Added common before ONLY for both Answer B and Distractor C.

39 H

3 N

S 40 F

3 N

S NRC:

1)

LOK changed to Fundamental as candidates are only required to recall one piece of knowledge from the ARP procedures.

Facility:

1)

Changed LOK to Fund.

41 H

3 M

S

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

42 F

3 X

N E

S NRC:

1)

The concept being tested in this question is sound and is a great way to test the knowledge. However, the format to this question could use improving.

Candidates do not need to know anything about RPS A/B effects as choice 1 is in all answers. Additionally, B is all of the above which is also not allowed per the NUREG as described with None of the above mentioned earlier.

Facility:

1)

Maintained original question format but revised all distractors. Responses now include two with only 1 option and two with three options, for consistency and to remove the all of the above possibility that is not allowed by NUREG-1021. This also causes RPS to be included in only 2 responses to address the first part of the comment above.

NRC: Question is SAT.

43 F

2 X

X N

U S

NRC:

1)

Early look question R11 provides justification as to why Tech Spec Basis are questioned on an RO exam and how it meets RO level of knowledge.

This question also utilizes TSB as the

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

reference to answering the question and there is no justification as to how this meets RO LOK. Provide reference to answer that meets RO LOK.

2)

Question is Unsat due to the stem providing teaching in the first portion.

Giving this information not only cues the applicant, but also provides information to the applicant that they should already be aware of and is not necessary.

Remove this statement.

3)

Reword the question to remove to do what Facility:

1)

Statement added to question justification.

2)

The statement that provided unnecessary cueing has been removed from the question.

3)

Question re-worded to remove to do what NRC:

Changes incorporated result in SAT question 44 F

3 X

B E

S NRC:

1)

Questionable distractor of -38 using one slide from training in which there is an image showing that the Vent header discharges at -38 into Torus

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

2)

Is there any other reference that can support this distractor other than an image in a training slide?

Facility:

1)

-38 is also covered during training on 29.100.01 Sheet 6, EOP Cautions, Curves & Calculations training as well as Sheet 2, Primary Containment Control Training. These were not listed as references, however, due to this question being on Tier 2 of this exam.

These references can be added, if the CE believes this is necessary, however, the Fermi 2 exam team believes that the listed Systems reference, and associated Objective Link to the related Systems training material is acceptable.

NRC: Question is SAT. There is no need to add the references to this answer analysis. The question was asked for more concrete supporting evidence that this is trained rather than one slide only.

45 H

3 N

S NRC:

1)

LOK changed to High due to need of candidate to assess plant conditions and determine results of system based on changes in system parameters.

Facility: No response necessary

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

46 H

3 N

S NRC:

1)

Do all of the loads on bus 64B receive a sequencing signal and get closed into the bus in this condition?

Facility:

1)

No, only safety related loads required for the LOCA/LOOP condition specified in the stem of the question. The question itself has been revised to ask how breakers that supply Safety Related loads on Bus 64B will respond as the CEs comments brought attention to a possible problem with the question having no correct responses with the original wording.

NRC: Change made is SAT and addresses CEs concern.

47 H

3 N

S 48 H

3 N

S NRC:

1)

LOK changed to High due to assessment of multiple conditions to come to correct answer Facility: No response necessary 49 H

3 X

N E

S NRC:

1)

Distractor C is partially correct in that there is a malfunction with DGSW Pump D, and an approved action is to swap to

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

DGSW Pump C but because the timeliness of taking this action MAY be longer than 3 minutes, the answer analysis states it is incorrect. This is not solid enough to determine that C is not also a correct answer.

2)

Another plausible distractor needs to be made for choice C.

Facility:

1)

Fermi 2 exam team agrees that starting a DGSW pump in the same division could be argued to be a correct response since that pump could supply DGSW to EDG 14. However, the distractor explanation for C was incorrect. Upon review of the FOS for DGSW, it was determined that Pump C is actually in Division 1 and could NOT be aligned to supply EDG 14, making it an incorrect response.

2)

Information was added to the explanation for Distractor C explaining further why Distractor C is incorrect.

NRC: Correction to distractor analysis makes Question SAT.

50 H

5 3

X X

N U

S NRC:

1)

This question is far too detailed for the distractors and reads like an in-plant JPM.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

2)

Question is Unsat due to: Actions asked of the applicant appear to be minutia and are deep in the 23.129 procedure steps for recovering system response.

3)

Distractors are too lengthy and are testing multiple items per each distractor. Distractors could easily be rewritten to remove follow on actions and get to the crux of the question at hand.

Recommend rewriting the question with the ICs given, and provide an additional bullet stating, Actions are being performed per 23.129, Section 7.9 CAC Return to Standby Following Auto Start. It may be good to then ask the applicants pertinent information from the procedure such as the pressure interlock that needs to be met prior to opening F441 and tying it to proper response to getting pressure within this range, such as loading the proper CAC.

Facility:

1)

Removed detail from the question and distractors.

2)

Refocused question on system interlocks and removed detail from deep in the procedure that caused it to test minutia.

3)

Shortened distractors and incorporated comments from item 3) above to focus

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

the question and remove testing minutia as recommended.

51 F

3 N

E S

NRC:

1)

Is the action performed in choice D performed in the control room?

2)

Reword Choice C to state, Direct the TB Rounds Operator to make manual temperature adjustments locally.

3)

Reword Choice D to state, Place the N RFPT Oil Cooler in manual to make temperature adjustments remotely.

4)

The North Reactor Feed Pump Turbine is referenced in three different styles for this question. Pick a format and use throughout the question and distractors.

Facility:

1)

Yes, this action is performed using the controller in the MCR.

2)

Added temperature to Choice C.

3)

Reworded D as recommended.

However, the word controller was left in D since this is more accurate (it is the controller that is taken to manual, not the cooler). D now reads Place the N RFPT Oil Cooler controller in manual to make temperature adjustments remotely.

4)

Standardized use of N RFPT throughout the question.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

NRC:

Changes incorporated result in SAT question.

52 H

3 N

U E

S Reference Provided: Frazile Ice Determination NRC:

1)

Two-part question in which there are different distractors for three of the four part one distractors leading to cueing.

2)

Question marked as Unsat due to a candidate being able to come to the correct answer based on given choices without knowing the reason for the second part as significant negative is only offered one time and is the correct answer.

Facility:

1)

Re-wrote question with 4 different possible responses. Although it is still a two-part question, with 4 different part 2s, the Fermi 2 exam team believes that each part 2 is plausible given the conditions in the stem of the question and the corresponding part 1s for each response.

2)

New question version written.

NRC: Add a semi-colon after the number in the distractors.

Facility: Added semi-colons to each distractor.

NRC: Question is SAT.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

53 T2/

G2 H

3 B

S NRC:

1)

Two-part question in which there are different distractors for three of the four part one distractors.

2)

Question is marked as Sat since there are two options of reset the reactor scram that cannot lead candidates to the correct answer. The different options for opening and closing the CRD flow control valves aligns with the reasoning from part 1.

Facility:

54 H

3 N

S NRC:

1)

Question is SAT. Prefer to see the distractors ordered such that A.

Both will trip B.

Neither will trip C.

Only A will trip D.

Only B will trip Facility:

1)

Changed order of distractors as recommended.

55 F

2 X

N E

S NRC:

1)

Selection A is none of the above.

Change distractor A to ONLY 1 and 3.

2)

Rearrange distractors such that they are:

A.

1, 2, AND 3 B.

ONLY 1 and 2 C.

ONLY 1 and 3

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

D.

ONLY 2 and 3 Facility:

1)

The Fermi 2 exam team disagrees that this is an example of a None of the above response. Per NUREG-1021 ES-4.2 Page 11 of 29 Paragraph 3, it states that None of the above responses should not be used with best answers multiple-choice questions.

This is not the case for this question as it is not a best answer question and clearly only has one correct response.

Due to the nature of the RR flow function provided by the APRMs, there is clearly only one correct response for failure of ARRM #4. In other words, it is not possible for None of the listed flow indicators to be impacted since loss of APRM #4 affects two of them.

2)

Since the question can be re-written such that None is a correct response for failure of 2 of the 4 APRMs (i.e.,

failure of APRMs 2 or 3) the Fermi 2 exam team recommends leaving this question as-is.

NRC: Based upon facilitys description of system operation and use of none for this question, NRC has determined that using none for this question is adequate and does not meet none of the above for this question. Question is SAT.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

56 F

H 3

X N

E S

NRC:

1)

Distractor A is a subset of correct answer B and needs to be swapped out for another credible distractor.

2)

Is the statement if it is fully OPERABLE, necessary to answer the question? The candidates will be briefed on ES-1.2, Section B.8 which states in part, When answering a question, do not make assumptions about conditions that are not specified in the question unless they occur as a consequence of other conditions that are stated in the question. Therefore, the candidates should not need to be told that a system is operable based on the conditions provided in the stem of this question give no indication to the contrary.

Facility:

1)

A new credible distractor could not be written. A new question version is being submitted.

2)

The new question version will not contain the phrase above.

NRC: New question is SAT. LOK is now H.

57 H

2 X

N U

S NRC:

1)

Question is considered Unsat due to the teaching that is presented in the first line of the conditions for the stem. The information that the PRM is used to

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

detect a leak from the RHR System should be known to the applicants already.

2)

Replace the first sentence with the following, [Rad monitor number and noun name inserted here], is being placed in service per 23.208, Section 5.3, DIV 1 RHR Service Water Startup.

(The rest of the stem can be used as written along with the question to make the overall question SAT).

Facility:

1)

Removed the first sentence to eliminate cueing (teaching).

2)

Replaced first sentence as recommended with one difference.

Instead of stating the Rad Monitor is placed in service IAW 23.208, instead referenced the SOP that is used to place the Rad monitor in service, 23.626, since 23.626.

NRC:

Changes incorporated result in SAT question.

58 H

3 B

S NRC:

1)

Add component nomenclature to F028A similar to the other two valves.

2)

Remove the additional space(s) between pushbutton and for on each items 2,3,4 of stem.

Facility:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

Added nomenclature for F028A.

2)

Removed additional spaces.

59 H

3 X

N E

S NRC:

1)

Distractors A, B, and D are all written in such that the condition has the potential to occur and are not definitive outcomes for the conditions given. The question is asking how the system will be impacted.

Because of this, the question has the potential for multiple correct answers.

Facility:

1)

Removed passive language from distractors A, B and D. Also added commas, before the which in each distractor, to be consistent and grammatically correct.

NRC: Question is SAT.

60 F

2 N

S NRC:

1)

Change the punctuation from period to a question mark after if Instrument Air is lost Facility:

1)

Changed punctuation 61 H

3 N

S 62 H

3 N

S NRC:

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

1)

Is the format in which the Isolation Dampers listed in the question 1 standard formatting?

Facility:

1)

Changed nomenclature for isolation dampers to be consistent with how they are shown in the SOP, 23.426.

63 H

3 N

S 64 T3 F

2 X

N E

S NRC:

1)

Distractor D is the only mention of item

4. Remove Item 4 from the stem and distractors. It is not necessary. An additional, plausible distractor can be 1 AND 3 ONLY in its place.

2)

Good Tier 3 question.

Facility:

1)

Removed item 4 and changed distractor to 1 AND 3 ONLY. Re-ordered distractors for consistency.

2)

Thank you for that feedback. This was a tough K/A for Tier 3. We worked hard on this version and are glad it hit the mark for a valid Tier 3 question.

NRC: Question is SAT.

65 F

3 N

S

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

66 F

2 B

S 67 H

3 B

S 68 F

2 B

S PREVIOUS 2 EXAMS (2021) 69 F

2 M

S 70 T4 H

3 B

S 71 H

3 B

S 72 H

3 X

N U

S NRC:

1)

K/A is to explain the difference between coefficients and defects. Question asked is to calculate each of the two which does not meet the intent of the K/A.

Question is unsat for Q-K/A mismatch.

2)

It appears that there are distractors for the first part located in the second part and vice versa. Both choices for Part 1 should be -0.0001 and -0.0010. There should not be any -0.0060 or -0.0600 in the first part. Just as there should not be any -0.0010 nor -0.0001 in the second part.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

3)

It appears that part 1 and 2 are swapped for choices C and D. Changing these will fix the issue identified above.

Facility:

1)

A new K/A has been requested for this question. Please see Form 4.1-1.

NRC: K/A swapped. Facility will replace this question.

NRC: New Question submitted is SAT and meets K/A.

73 H

3 B

S NRC:

1) 74 H

3 N

S NRC:

1)

Question is changed significantly enough using 2x2 that this question is now considered a New question.

Facility: No response required.

75 F

3 B

S 76 T1 H

3 N

S NOTE 1 - tie to Tier 1 (1)(4) 77 H

3 X

B U

S NOTE 1 - tie to Tier 1 (1)

Imbedded Image of Pilot Valve Solenoids NRC:

1)

Question is marked Unsat for being conditions that an RO should be able to

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

assess and determine that this is entry criteria for a Reactor Scram.

Additionally, ROs should be able to determine if the conditions given require entry into the AOP. See ES 4.2, Section E.3.e, page 23 of 29.

2)

K/A provided for this exam may be too difficult to get an SRO-level question developed. Would entertain the idea of swapping out this K/A if an SRO-level question cannot be developed without too much effort devoted to it.

Facility:

1)

New K/A requested for this question.

Please see Form 4.1-1.

NRC: New K/A selected. Facility will replace this question.

NRC: New Question is SAT and meets K/A.

78 H

3 N

S NOTE 1 - tie to Tier 1 (1)(4) 79 H

3 B

S NOTE 1 - tie to Tier 1 (1) 80 H

3 N

S NOTE 1 - tie to Tier 1 (1)(4)

NRC:

1)

Changed LOK to High.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

81 H

3 B

S 82 F/H 3

N S

NOTE 1 - tie to Tier 1 (1)(3)

NRC:

1)

Question LOK changed to High cognitive due to assessment of plant conditions and making determination of actions to perform requiring more than one assessment.

2)

There is a potential for questions from the applicants on the exam pertaining to what is meant by Immediate Actions.

Does the term used here refer to Scram Immediate Actions, or Fire Response immediate actions? Should it be clarified to remove this confusion to applicants or should they know what is meant from these conditions?

Facility:

1)

Changed LOK to High.

2)

There should not be any confusion since the actual question asks which of the following action(s) will you perform/direct from 20.000.22, Plant Fires The statement You will direct performing Immediate Actions is included to remove this statement from each of the answer choices to reduce

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

the overall number of words in the question.

NRC:

Question remains SAT 83 H

3 B

S NOTE 1 - tie to Tier 1 (1)(4) 84 F/H 3

N S

NOTE 1 - weak tie to Tier 1 (4)

NRC:

1)

Question asks information contained in the TS basis document for Water Level Trip Instrumentation Safety Analysis.

This has a weak tie to the assessment of integrated plant response to abnormal situation. The tie is considered acceptable for the question and K/A.

2)

LOK changed from Fundamental to High Cognitive. NUREG-1021, Appendix A states, in part, Similarly, if a test item elicits a mental demand that requires a why or how response such that the examinee must derive the correct explanation, prediction, or action, the item is testing at the comprehension or application level.

Comprehension/application level test items require the examinee to recall stored knowledge and understand the relationships between two or more pieces of data (such as events or

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

conditions) given in the stem of the test item. In sum, HCL [High-cognitive level]

test items require multiple mental processing steps Facility:

1)

Changed question LOK to High.

2)

No response required. Information provided for facility benefit.

NRC:

Question remains SAT.

85 H

3 N

S NOTE 1 - tie to Tier 1 (1)(4) 86 T2 H

3 X

N U

S NRC:

1)

There is not enough information provided in the stem to properly assess the conditions for the given RPV levels when assessed independently.

2)

Asking the applicants to assess each case independently results in multiple correct answers. Since the level at point 1 is correct, when assessing this condition by itself makes choice A correct. Choice B is a correct assessment but requires the applicants to assess RPV water levels at multiple positions and is not in accordance with the instructions of assessing each case independently.

3)

The concept being tested in this question is a great one to meet the

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

generic K/A tied to this system at SRO level, the stem just needs to be reworded to remove the ability to get to multiple correct answers.

Facility:

1)

Question re-worded to attempt to keep the concept being tested (per 3 above) and address the concerns mentioned in

1) and 2).

2)

See 1) above.

3)

See 1) above.

NRC:

Changes incorporated result in SAT question.

87 H

3 N

S NRC:

1)

Remove the second period in the third statement.

2)

Provide a trend to the reactor pressure when it is 1047 psig.

Facility:

1)

Second period has been removed.

2)

Added trend of and steady to the stem for 1047 psig.

88 H

3 M

S 89 F

3 X

N E

S NRC:

1)

Distractor analysis for A states that there is a shutdown statement that is the reasoning for plausibility of the distractor. LCO 3.8.7, Condition D states

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

to Enter LCO 3.0.3 which does not have a 12 hour1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> requirement.

2)

Distractor A is not plausible by the reasoning provided. Change wording in choice A to incorporate entering LCO 3.0.3 for higher plausibility.

Facility:

1)

Revised distractor A to incorporate entering LCO 3.0.3.

2)

Updated distractor analysis for A.

NRC: Question is SAT.

90 H

3 N

S 91 H

3 X

B E

S NRC:

1)

Part 2 of Distractors B and D have Reactor Water Cleanup and Part 2 of Distractors A and C have RWCU listed prior to the parameter being asked about, flow versus temperatures. Make these two match whether it is RWCU or spelling it out.

2)

Improper use of 2x2 Qs.

3)

Mitigate this by making the change below:

A.

(1) keep same (2)Direct STA/SNE to insert a substitute IPCS point value for RWCU Inlet Flow.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

4)

In order to reduce the amount of verbiage in the distractors, Question (2) can be changed to the following:

In addition to a Backwash and Precoat of RWCU F/D A, you should direct the STA/STE to ___(2)___.

Facility:

1)

Changed B and D part 2 to state RWCU for consistency.

2)

Corrected part (2) of A as directed.

3)

Corrected part (2) of A as directed.

4)

Revised wording of part (2) to read In addition to a Backwash and Precoat of RWCU F/D A the CRS should direct the STA/SNE to insert a substitute IPCS point value for which parameter(s)? to reduce verbiage even further.

NRC: Changes made result in Question being SAT.

92 F

2 N

S 93 H

2 M

S Reference Provided: Enclosure C and TRM 94 T3 H

3 B

E S

PREVIOUS 2 EXAMS (2021)

NRC:

1)

Distractors B and C use the 2 hour2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> restoration time limit and incorporate time 1715 where distractor D uses 1730.

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

To align with distractor analysis, and the other distractors, change 1730 to 1715.

Facility:

1)

Changed time in Distractor D to 1715.

NRC: Question is SAT.

95 H

3 B

S Reference Provided: EP-547 96 F

2 N

S 97 H

3 B

S NRC:

1)

LOK changed to H due to assessing given information compared to limits and making determination being more than simple recall of limits.

2)

Is it required knowledge to know that MFLCPR limit is 1.00? Is this documented in the COLR only? IF a candidate asks for the COLR on this question, would it be fair game to give the COLR?

Facility:

1)

Changed LOK to High.

2)

It is required knowledge that all ratios (MFLCPR, MAPRAT and MFLPD) are required to be <1.0. The COLR would give actual values for the limits themselves (MCPR, APLHGR and LHGR) but not the ratios. TS LCO 3.2.1,

Form 2.3-5 Written Examination Review Worksheet Facility: Fermi Power Plant Exam Date: October 16-21, 2023

3. Psychometric Flaws

4. Job Content Flaws

5. K/A Use Flaws Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

1. /Units Logic Q-K/A License Level

6.

Source (B/M/N)

7.

Status (U/E/S)

8.

Explanation General Comments:

NOTE 1: For Tier 1 questions, does it test:

(1) information from the AOPs/EOPs; (2) diagnosis of procedures to be used to address the situation; (3) the progression of an event; OR (4) the assessment of integrated plant response to emergency or abnormal situations crossing several plant systems and/or safety functions?

MNGP NOTE 1: From NUREG 1021 - Several ways of achieving this objective include, but are not limited to: and under (1) AOPs, EOPs and their associated bases documents:

NOTE 2: For Tier 3 questions, does it test: plant-wide generic information - and not simply become an extension of Tier 2, plant systems?

NOTE 3: For SRO-only questions, select K/As tied to 10 CFR 55.43.

3.2.2 and 3.2.3 require that all limits be less than the value in the COLR (i.e., all ratios be <1.0). So knowledge of the actual limit in the COLR is not required, only that the ratios should be <1.0. If an examinee asks for the COLR, as the proctor I would state that they have all information necessary to answer the question, but I do not believe this is likely.

98 H

2 B

S 99 H

3 B

S Reference Provided: EP-101, Enclosure A 100 H

3 X

B E

S NRC:

1)

Change distractor D to 1, 4, and 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> reports 2)

Change Distractor C to 4 and 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> reports ONLY 3)

Licensee Event Reports is only in one distractor and is cueing in this format.

Facility response:

1)

Made the above changes. D is now the correct response.

NRC: Question is SAT.

Exam Date: October 16-21, 2023 Form 2.3-5 Written Examination Review Worksheet Facility:Fermi Power Plant Form 2.3-5 Instructions for Written Examination Review Worksheet Refer to ES-4.2 for the definitions of terms used in this worksheet for the written examination. Review each question (Q) as submitted and as subsequently revised and document the following in the associated worksheet columns:

1.

Enter the level of knowledge (LOK) as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) from 1 (easy) to 5 (difficult); mark direct lookup questions (applicant can directly determine the answer from the provided reference) as LOD 1. A question is (U)nsatisfactory if it is LOD 1 or LOD 5.

3.

Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks enough focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). This is an (U)nsatisfactory question.

Cues: The stem or one or more answer choices contains cues (e.g., clues, specific determiners, phrasing, length). This is an (U)nsatisfactory question.

T/F: All of the answer choices are a collection of unrelated true/false statements. This is an (U)nsatisfactory question.

Cred. Dist.: The distractors are not credible; single implausible distractors require (E)nhancement, and more than one noncredible distractor in the same question results in an (U)satisfactory question.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem). This is an (U)nsatisfactory question.

4.

Check the appropriate box if a job content flaw is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid knowledge or ability (K/A) but, as written, is not operational in content). This is an (U)nsatisfactory question.

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory). This is an (U)nsatisfactory question.

1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). This is an (U)nsatisfactory question.

Logic: The question requires backward or reverse logic or application compared to the job requirements. This is an (U)nsatisfactory question.

5.

Check the first box if a K/A mismatch flaw exists. Check the second box if the question is flawed because it is written at the wrong license level. Either condition results in an (U)nsatisfactory question.

6.

Enter the questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-4.2.

7.

Based on the review performed in steps 2-5, mark the question as (U)nsatisfactory, in need of (E)nhancement, or (S)atisfactory.

8.

Fully explain the reason for any (U) in column 7 (e.g., how the psychometric attributes are not being met).

9.

Save the initial review comments and detail subsequent comment resolution so that each exam-bound question is marked by an (S) on this form.