ML23160A174

From kanterella
Jump to navigation Jump to search
2.3-5 Written Examination Review Worksheet
ML23160A174
Person / Time
Site: Dresden  
Issue date: 05/18/2023
From:
NRC/RGN-III/DORS/OB
To:
Constellation Energy Generation
Gregory Roach
Shared Package
ML22007A051 List:
References
Download: ML23160A174 (1)
v • d • e


Text

Form 2.3-5 Written Examination Review Worksheet

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 1

H 3

B E

S Meets Tier 1 requirements per ES-4.2 because the question addresses the assessment of the integrated plant response to emergency or abnormal situations crossing several plant systems or safety functions, or both.

NRC: Remove following the transient from the question stem as the sentence starts with After the transient,.

Response: Removed following the transient 2

F 2

X B

E S

Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

NRC: Distractor D has a low plausibility as it is unlikely that an applicant would assume that an MOV would cause an EDG to overload.

Response: Changed Distractor D 3

F H

2 B

E S

Does not meet Tier 1 requirements. The question as written, just requires the applicant to be able to recall how the IA system automatically responds to a lowering air pressure with no operator action.

Response: Replaced question with High Cog question 2019 NRC EXAM Q72 After the NRC review, there are now 36 High Cog questions on the RO portion of the exam. There MUST be 38-45 High Cog questions on the RO exam. When addressing the comments, at least 2 of the questions now deemed to be memory should be modified to a High Cog question.

Three questions have been replaced with High Cog questions. There are now a total of 39 High Cog questions on the RO exam.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 4

F 3

B S

GFE Question 5

H 2

B S

Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

2015 NRC EXAM Q27 6

H 2

N S

Meets Tier 1 requirements per ES-4.2 because the question addresses the assessment of the integrated plant response to emergency or abnormal situations crossing several plant systems or safety functions, or both.

7 H

2 B

E S

Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

PREVIOUS 2 EXAM: 2021 NOVEMBER NRC EXAM Q69 NRC: Add a period at the end of sentence in the stem that starts with After approximately 10 minutes Response: Added period 8

H 3

B S

2019 NRC EXAM Q9 9

F 4

B E

S NRC: Answer justification for C and distractor D are swapped. Correct answer is C, justifications indicate D. Swap the justification statements for C and D to correct.

Response: Swapped C & D answer explanations 10 H

2 B

S 11 H

2 B

S 12 H

2 B

S 2020 NRC EXAM Q8 13 F

2 B

S 2019 NRC EXAM Q25 14 H

4 N

S 15 H

3 B

S

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 16 F

2 B

S 2015 NRC EXAM Q48 17 F

2 N

E S

GFE Question NRC: For distractor C analysis, it should say Parts 1 and 3 are correct.

Response: Corrected answer explanation 18 F

3 B

S 2019 NRC EXAM Q58 19 H

3 B

E S

Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

NRC: In distractor analysis C, it should read upon not up.

Response: Changed up to upon 20 H

3 X

B N

U S

Meets Tier 1 requirements per ES-4.2 because the question addresses the assessment of the integrated plant response to emergency or abnormal situations crossing several plant systems or safety functions, or both.

NRC: Distractors B and C do not appear to be plausible. How would a half scram be received with a loss of power to both divisions or a full scram be received with a loss of power to only one division?

Response

Provided new question.

21 H

2 N

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

22 F

2 X

B E

S Meets Tier 1 requirements per ES-4.2 because the question addresses the assessment of the integrated plant response to emergency or abnormal situations crossing several plant systems or safety functions, or both.

NRC: Distractor A is not plausible that drywell pressure would lower with an ERV lifting into containment.

Response

Revised distractor A, and slightly revised stem to make answer more credible.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation NRC: Ask about ECCS pumps, would they be running? May need to slightly reword distractor.

Response

Revised distractor B to include would rise 23 F

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition.

24 F

2 N

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

25 F

2 B

S FREE SAMPLE Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

26 H

2 B

E S

REFERENCE PROVIDED: TRM 3.3.a and TS 3.3.1.1 NRC: Justification for Distractor D seems incorrect.

The analysis should end with how a Full Scram is plausible not that it would not occur.

Distractor C would be more plausible if the total core flow and percent of total flow were adjusted to be more likely to challenge both setpoints.

Response: Enhanced stem to make distractors more plausible.

27 H

3 N

S 28 F

3 B

E S

NRC: This question is a fundamental knowledge question just requiring the applicant to recall the limits for closing the cross-tie breakers.

Response: Changed from High Cog to Memory level question 29 F

2 N

S 30 F

3 B

S 2019 NRC EXAM Q49 31 F

3 N

E S

NRC: This question is a fundamental knowledge question just requiring the applicant to recall the auto start pressure of the 2/3 DFP.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Response: Changed from High Cog to Memory level question 32 H

3 B

S 2008 NRC EXAM Q18 33 F

3 B

S 34 H

F 3

B U

S FREE SAMPLE NRC: This question does not meet the Tier 3 requirement of ES 4.2 which states in part, Ensure that Tier 3 questions focus on plant-wide generic K/As and not system-specific knowledge or knowledge of specific emergency/abnormal plant evolutions. This question is a Tier 1 question which requires knowledge of operator actions under abnormal operating conditions.

I recommend testing requirements in the license itself or testing LCO/SR 3.0 (Motherhood TS knowledge) to meet the Tier and KA requirements.

Response: Replaced question with one from 2012 QC exam which tests the definition of operability from section 1 of the technical specifications.

2012 QUAD CITIES NRC EXAM Q69 35 F

2 B

S FREE SAMPLE GFE Question 36 H

2 B

E S

Meets Tier 1 requirements per ES-4.2 because the question addresses the operator response to an abnormal plant condition per the EOPs.

REFERENCE PROVIDED: EP-AA-1004 Addendum 3 EAL Charts NRC: Limit provided reference to the EAL chart associated with RU1-RG1.

Response: Will limit provided references to ROs to the EAL chart associated with RU1-RG1 37 F

3 N

S

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 38 H

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses the operator response to an abnormal plant condition.

39 H

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

REFERENCE PROVIDED: DEOP 100 with entry conditions redacted 40 H

2 X

N U

S NRC: It is not clear how the question meets the KA to test EOP icons. The example provided is a caution for using the HPCI system, but the subsequent piece for using the CST and whether you can bypass isolations which is knowledge the applicant can discern based on the plant conditions provided. It is not testing the knowledge of what the icon means.

Response: Replaced question REFERENCE PROVIDED: DEOP 100 with entry conditions redacted and DEOP 400-06 41 H

2 X

N U

E S

NRC: This question does not test the applicants knowledge of design features and interlocks of the SBGT system which provide for radioactive particulate filtration. All answer and distractors include an indication that the SBGT system is running based on the high rad alarm. Knowledge needed surrounds the power supply to the SBGT trains. Testing what the HEPA filter does versus the charcoal filter would be a better way to test the KA.

Response: Replaced question NRC: Distractor analysis indicates that C is correct answer. Need to fix the analyses for B and C and show B is the correct answer.

Response: B is correct answer, justifications corrected.

42 H

2 N

S 43 F

2 N

S FREE SAMPLE 44 F

H 3

X X

N U

S NRC: I recognize DOP 1000-01 clearly states why SDC is drained and vented prior to use. It appears that an applicant can make an educated argument for why Distractor B can also be considered a correct

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation answer. Especially if it is indicated elsewhere that systems connected to the RPV could lead to a loss of RPV level if not properly filled prior to interfacing with the RPV.

I am also struggling with the plausibility of the RWCU system as it will be continuously connected to the RPV when the reactor is operating and being shutdown so why it would be necessary to fill and vent is not clear nor plausible.

Response: Replaced question with High Cog question 45 F

H 3

N E

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the AOPs.

NRC: This question is a fundamental knowledge question which only requires recall of the slow leak thumb rule.

Provide greater detail for the plausibility statements for distractors B, C, D. I recognize there are multiple thumb rules which could confuse the applicant. It just does not appear clear to me how they incorrectly come up with one of the distractors using the wrong thumb rule.

Response: Wrote new question to make it High Cog and expanded on the plausibility statements 46 H

3 N

E S

NRC: Distractors C and D would have greater plausibility if their Part 1 was 2/3 EDG is carrying Bus 23-1. In order to do this you would have to change part 2 to just ask what the expected lineup would be after the subsequent rise in drywell pressure on Unit

2. I am ok with testing knowledge that the EDG starts but does not load on a LOCA unit if offsite power is available but when you add the wrinkle of a LOOP on Unit 2, a much more plausible distractor and a better LOD would be to have 23-1 as being the bus energized. Then you are truly testing the LOCA interlock. I recognize the second part would have to be reworded to avoid cueing but just asking the alignment after the subsequent condition would avoid that. I am open to discussion on this question.
3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Response: Replaced question 47 F

2 N

S 48 H

2 X

N U

S Meets Tier 1 requirements per ES-4.2 because the question addresses the progression of an event.

Please try to avoid Tier 1 questions which include the phrase, with no operator action.

NRC: What does this question have to do with how LPCI operates under ATWS conditions? This question tests how LPCI Loop Select Logic and LPCI injection valves operate with a 2# signal present. The fact that APRM downscales are not lit appears to be window dressing to meet the KA.

Response: Per discussion with NRC Chief Examiner K/A has been changed to 295037.K2.02 and it is a different question Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the AOPs.

49 H

3 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

2015 NRC EXAM Q14 50 H

2 X

N B

U E

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

REFERENCE PROVIDED: DEOP 200-1 with entry conditions removed.

NRC: This question is a KA mismatch as the KA is supposed to test the inter relation between high DRYWELL temperature and reactor pressure. The question actually tests TORUS temperature vs.

reactor pressure. DEOP 200-1 has a high drywell temperature leg which results in ED. Therefore, there is a pathway to test drywell temperature conditions leading to an emergency reduction in reactor pressure.

Response: Replaced question REFERENCE PROVIDED: DEOP 100 with entry conditions redacted

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation NRC: REFERENCE PROVIDED not indicated in the question stem.

Response: REFERENCE PROVIDED added to stem 51 H

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

REFERENCE PROVIDED: DEOP 100 with entry conditions redacted 2019 NRC EXAM Q27 52 F

2 B

S 2017 NRC EXAM Q37 53 F

3 X

X X

B U

S NRC: The KA specifically asks for how IRM rod blocks are automatically bypassed. The stem focuses on the scram function. If one IRM gives a HI HI condition, then a half scram and rod block will occur. The stem should be worded to give a scenario where a single IRM fails HI HI and then focus on how the rod would be auto bypassed.

Distractor B is a subset of answer A. If distractor B is correct then so would answer A which is not permissible, so the applicant can eliminate distractor B.

Distractor C seems like a partial correct answer as once the mode switch is in RUN then the rod block would be bypassed.

Response: Replaced question 54 F

2 N

S 55 H

2 B

S 2015 NRC EXAM Q57 56 H

2 N

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

57 F

2 X

B E

S NRC: Distractor B is implausible with no action for how the rod settles. In the correct answer the settle valve (120) has to reposition. In Distractors C and D there is a system response (incorrect one) that at least attempts to indicate how the system settles the control

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation rod. Distractor B can be modified to include the settle valve when it says the drive settles.

Response: Made recommended change to Distractor B. Added noun names throughout answers that werent there and swapped Distractors C & D for psychometrics.

58 F

2 N

S 59 F

3 X

N E

S FREE SAMPLE GFE Question NRC: DOS 0250-02 requires as a prerequisite that reactor power be < 50% when performing this surveillance. Having power at 60% in the question stem is not operationally valid.

Response: Power lowered to 40%.

60 F

2 B

S 2017 NRC EXAM Q67 61 F

2 X

N E

S Meets Tier 1 requirements per ES-4.2 because the question addresses the basis for operator response to an abnormal plant condition per the EOPs.

NRC: Distractor B is not worded like the other 3 answer choices. Wording is not grammatically correct with question stem can be easily disregarded.

Response: Corrected wording on Distractor B NRC: Word B, To limit primary containment pressure so that ADSVs can be opened and remain open. This will have two answers starting with To ensure and two with To limit Response: All answer choices now start with To ensure the. Which was moved to the stem.

62 H

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

63 F

2 B

S GFE Question 64 H

3 N

S

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 65 H

3 N

S 66 H

2 N

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the EOPs.

67 F

3 B

S 68 H

2 N

S 69 F

2 B

E S

FREE SAMPLE GFE Question NRC: Reword the second part of the question so that ensure proper operation of is in the question stem since it appears in all four answer choices.

Response: Added ensure proper operation of to the question stem.

70 F

2 B

S GFE Question 71 F

2 B

S 2009 NRC EXAM Q40 72 F

2 X

N U

S NRC: This question does not match the KA which requires managing maintenance activities. This question only requires the applicant to know when PA announcements are required. This would be an acceptable question for KA 2.1.14.

Response: Per discussion with NRC Chief Examiner K/A has been changed to Generic 2.2.12 and it is a different question 73 H

3 N

S GFE Question 74 H

3 N

E S

FREE SAMPLE NRC: Add keylock switches to question stem following the first blank. Add Sprays following Torus and Drywell in distractors B and D.

I assess this as a KA match in that it tests plant conditions impact on Torus Spray based on nuclear boiler instrumentation readings.

Response: Changes made as recommended.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 75 F

3 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

2020 NRC EXAM Q60 76 H

3 B

S 77 H

2 B

S 78 H

2 B

S FREE SAMPLE REFERENCE PROVIDED: TS 3.1.7 with < 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> required action times redacted 79 F

3 B

S 2012 NRC EXAM Q99 80 F

2 X

X M

B U

S 2020 NRC EXAM Q79 NRC: This is a modified bank question due to a significant change to the stem (medical vs security) and a significant change to the correct answer.

The correct answer is cued as the stem includes a report to site medical and the correct answer is the only event concerning a medical event.

The KA specifically calls out an event which effects system operation/status. A medical event does not affect system operation/status.

Response: Replaced Question 81 F

2 X

N E

S NRC: Distractor B is not plausible as classifying events prior to transfer of command and control is the most fundamental of Shift Manager responsibilities when executing the EP. It is not plausible that this would not be included as a required responsibility. I recommend replacing Distractor B with 1, 2, 3, 4.

Add for this specific event to the stem just before, the Shift Manager will do I am concerned you will get a sea lawyer who will argue that PARs are the responsibility of the SM at this point and the PAR is just none.

Spell out Protective Action Recommendations before PARs in bullet 4.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Response: Added 1 to Distractor B and moved it into the D spot for psychometrics.

Added for this specific event to stem Spelled out Protective Action Recommendations 82 H

3 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

2020 NRC EXAM Q98 83 H

2 X

X N

U S

Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the EOPs.

NRC: On the RO exam we provided DEOP 100 and DEOP 200-1 to the applicants. They will be able to use these references to cue towards the correct answer.

Distractor B is a possible second correct answer.

Since the Distractor uses the word Continue it can be assumed that it means keep injecting with the systems that are injecting in the stem which is a partially correct answer.

Response

Revised question to improve plausibility of distractors and to address potential cuing.

Additional plant conditions were added, which place the ECCS pumps in a condition where NPSH is threatened, making answer A more credible.

Answer B was revised to remove continuing, in order to address the concern noted above.

Additionally, it was clarified that HPCI would be required for injection in that distractor.

The information required to answer this question is more than what is available in DEOP 100, since the student must understand what the adequate core cooling strategy is. Currently, only two LPCI and one CS pump are available, out of all the potential Detail L3 pumps in DEOP 100.

Additionally, CS and LPCI are restoring level to above TAF without the use of HPCI injection.

Therefore, HPCI is not needed for adequate core cooling, and would be secured. With level below TAF, all available LPCI and CS injection is required.

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation 84 H

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

2019 NRC EXAM Q85 85 H

3 X

B E

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the EOPs.

NRC: The stem of this question could be considered confusing as the IC steam leak into the reactor building would not by itself cause the DW pressure isolation and probably would not lead to a low RPV level isolation. More detail may need to be added to indicate why those conditions exist.

Response: Added bullet stating there is leak into the Drywell.

86 H

1 2

N U

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

REFERENCE PROVIDED: TS 3.4.9 with 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or less action statements redacted NRC: With the reference provided this is a direct look up question. The loop differential and bottom head to active loop temperature requirements are clearly listed as surveillance requirements in the reference provided. Without this reference it would be a higher LOD but reasonable memory question.

Response: Removed Provided Reference 87 H

3 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

88 H

3 B

S 89 H

3 X

X B

U S

FREE SAMPLE REFERENCES PROVIDED: TS 3.8.6 and TRM 3.8.b NRC: KA mismatch as it is not apparent that pre or post maintenance conditions exist by which battery operability is being assessed. I am willing to discuss this further.

Distractor B is not plausible as we are providing the TS/TRM and ensuring Category B Limits within 24

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation hours is not listed as a required action for any battery condition. If we did not provide the references then the justification analysis provided would have been adequate for plausibility if the applicant was only working from recall.

Response: Question stem has been modified to include maintenance operations affecting the operability of the 250 VDC Battery. Distractors B and C were changed to include conditions within the reference provided to ensure they can be properly assessed as plausible.

90 H

2 N

S 91 H

3 B

S 92 H

2 N

S 93 F

2 X

B U

S 2010 NRC EXAM Q83 NRC: This question is a cue to question 86 or with 86 in its present form cues the answer to this question.

Both questions test the knowledge that to recover an idle RCS loop differential temperature must be < 50F.

In addition, this is a tier 3 question which can be directly answered through system specific knowledge.

Reactor coolant system knowledge would provide the answer to this question. I recommend testing the basis for a safety limit or a motherhood LCO (3.0).

Response: Replaced question with a basis of a safety limit question 94 F

H F

3 X

X B

N B

U S

2010 NRC EXAM Q37 NRC: This question previously appeared on an NRC exam as an RO level of knowledge question. What has changed to be considered an SRO level of knowledge on this exam?

Distractor B is not plausible as written as the stem indicates that the new reactor period is already stable.

Withdrawing the rod to obtain a stable period does not make sense.

Response: Replaced question with High Cog question

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation REFERENCE PROVIDED: DEOP 100 with entry conditions removed and DEOP 400-5 NRC: This is a Tier 1 question not a Tier 3 question.

Not acceptable, we can look at changing the KA if needed.

Provided references are inappropriate. SRO and frankly RO candidates should be able to assess the general strategy of EOPs. This is answerable from understanding the procedures without a reference provided.

Response: Replaced question and replaced K/A.

PREVIOUS 2 EXAMS: Dresden April 2021 Exam Q91 95 H

2 N

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the Emergency Plan.

REFERENCE PROVIDED: EP-AA-1004-ADDENDUM 3 96 F

2 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the AOPs.

97 H

3 B

S Meets Tier 1 requirements per ES-4.2 because the question addresses operator response to an abnormal plant condition per the EOPs.

2020 NRC EXAM Q78 REFERENCE PROVIDED: EP-AA-1004-ADDENDUM 3 and ODCM Figure 1-2 98 F

2 N

S 99 H

2 X

N E

S REFERENCE PROVIDED: Tech Spec. 3.3.2.1, Tech Spec 3.3.1.3, DAN 902(3)-5 A-7 NRC: With the references provided, Distractor B is not plausible. If you removed the references, then I would be ok with the distractor. Why would an applicant confuse RBM/OPRM TS actions if we give them the TS for RBM. They would not. In addition, what purpose does it serve to give them the DAN? I recommend only giving the TS with its table and changing distractor B or keeping the question as is and not giving any reference which should be well within their knowledge capability to answer this question without it,

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws Dresden, April 2023 Q#
1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Response: Deleted references except for TS 3.3.2.1. Revised distractor B.

REFERENCE PROVIDED: TS 3.3.2.1 with 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or less blanked out 100 H

2 N

E S

FREE SAMPLE REFERENCE PROVIDED: EP-AA-1004-ADDENDUM 3, EP-AA-111-F-04 Meets Tier 1 requirements per ES-4.2 because the question addresses operator responses to an emergency plant condition per the EPIPs.

NRC: Answer justification for Distractors B and C are swapped. Distractor B is to Shelter which is attributed to the PAR being made outside the control room. In this case, the PAR is determined from the control room. Justification statements for B and C need to be swapped.

The entirety of Addendum 3 does not need to be provided as a reference. Only the Hot and Cold Matrices will do.

Response: Answer justifications corrected.

Form 2.3-5 Instructions for Written Examination Review Worksheet Refer to ES-4.2 for the definitions of terms used in this worksheet for the written examination.

Review each question (Q) as submitted and as subsequently revised and document the following in the associated worksheet columns:

1. Enter the level of knowledge (LOK) as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) from 1 (easy) to 5 (difficult); mark direct lookup questions (applicant can directly determine the answer from the provided reference) as LOD 1. A question is (U)nsatisfactory if it is LOD 1 or LOD 5.
3. Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks enough focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). This is an (U)nsatisfactory question.

Cues: The stem or one or more answer choices contains cues (e.g., clues, specific determiners, phrasing, length). This is an (U)nsatisfactory question.

T/F: All of the answer choices are a collection of unrelated true/false statements. This is an (U)nsatisfactory question.

Cred. Dist.: The distractors are not credible; single implausible distractors require (E)nhancement, and more than one noncredible distractor in the same question results in an (U)satisfactory question.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem). This is an (U)nsatisfactory question.

4. Check the appropriate box if a job content flaw is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid knowledge or ability (K/A) but, as written, is not operational in content). This is an (U)nsatisfactory question.

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory). This is an (U)nsatisfactory question.

  1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). This is an (U)nsatisfactory question.

Logic: The question requires backward or reverse logic or application compared to the job requirements. This is an (U)nsatisfactory question.

5. Check the first box if a K/A mismatch flaw exists. Check the second box if the question is flawed because it is written at the wrong license level. Either condition results in an (U)nsatisfactory question.
6. Enter the questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-4.2.
7. Based on the review performed in steps 2-5, mark the question as (U)nsatisfactory, in need of (E)nhancement, or (S)atisfactory.
8. Fully explain the reason for any (U) in column 7 (e.g., how the psychometric attributes are not being met).
9. Save the initial review comments and detail subsequent comment resolution so that each exam-bound question is marked by an (S) on this form.
Retrieved from "https://kanterella.com/w/index.php?title=ML23160A174&oldid=5471218"