ML21327A401
| ML21327A401 | |
| Person / Time | |
|---|---|
| Site: | Fermi  |
| Issue date: | 06/16/2021 |
| From: | Joseph Demarshall NRC/RGN-III/DRS/OLB |
| To: | DTE Energy |
| Demarshall J | |
| Shared Package | |
| ML20055D900 | List: |
| References | |
| NRC-21-0039 | |
| Download: ML21327A401 (5) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: FERMI NUCLEAR POWER STATION Exam Date: May 24 - June 2, 2021 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
T/F: The answer choices are a collection of unrelated true/false statements.
Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 5 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation NRC developed exam. ES-401-9 used only for statistical / metrics documentation.
Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
F 3
B S
2 H
3 M
S 3
F 3
B S
NRC 2017 Fermi ILE 4
H 2
N S
5 H
3 N
S 6
F 3
B S
NRC 2019 Fermi ILE 7
F 3
N S
8 H
3 M
S 9
F 3
N S
10 H
3 B
S NRC 2009 Fermi ILE
ES-401 2
Form ES-401-9 Facility: FERMI NUCLEAR POWER STATION Exam Date: May 24 - June 2, 2021 Page 2 of 5 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation NRC developed exam. ES-401-9 used only for statistical / metrics documentation.
Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 11 F
3 B
S NRC 2019 Fermi Retake Exam (previous 2 NRC Exams) 12 H
3 N
S 13 H
3 B
S Reference provided: 29.100.01, Sheet 6, Curves, Cautions, and Tables (WITHOUT CAUTIONS & RPV SATURATION TEMPERATURE CURVE) 14 H
3 N
S 15 F
2 N
S 16 F
3 B
S 17 H
3 N
S 18 F
3 B
S 19 F
2 B
S 20 F
2 B
S 21 F
2 N
S 22 F
3 N
S 23 H
3 B
S NRC 2018 Fermi ILE 24 H
3 N
S 25 H
3 B
S 26 F
3 N
S 27 H
3 B
S 28 H
3 N
S 29 H
3 B
S NRC 2013 Fermi ILE 30 F
3 B
S NRC 2019 Fermi ILE 31 H
3 N
S 32 H
4 N
S 33 H
3 B
S 34 F
3 B
S
ES-401 3
Form ES-401-9 Facility: FERMI NUCLEAR POWER STATION Exam Date: May 24 - June 2, 2021 Page 3 of 5 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation NRC developed exam. ES-401-9 used only for statistical / metrics documentation.
Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 35 F
2 B
S NRC 2019 Fermi ILE 36 H
3 N
S 37 F
2 B
S 38 F
3 B
S 39 H
3 N
S 40 H
3 N
S 41 F
2 B
S Embedded Graphic: MCR panel status lights associated with the Primary Containment Isolation System (PCIS).
42 F
3 N
S 43 H
3 N
S 44 H
3 N
S 45 H
3 N
S 46 H
3 N
S 47 H
3 M
S 48 H
3 N
S 49 H
3 B
S 50 H
3 N
S 51 F
3 B
S 52 H
4 N
S 53 H
3 N
S 54 F
3 N
S 55 H
3 B
S 56 H
3 B
S 57 H
3 N
S 58 H
3 B
S
ES-401 4
Form ES-401-9 Facility: FERMI NUCLEAR POWER STATION Exam Date: May 24 - June 2, 2021 Page 4 of 5 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation NRC developed exam. ES-401-9 used only for statistical / metrics documentation.
Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 59 H
3 B
S 60 H
3 N
S 61 H
3 B
S 62 H
3 N
S 63 H
4 N
S 64 H
3 B
S 65 F
3 N
S 66 F
2 M
S Reference Provided: Safety Handbook Table 21-2, Wet Globe Temperature -
Stay Times, will be provided with this question (NOTE: Section 21, Hot and Cold Environments / Temperature Extremes, to be provided in its entirety).
67 F
3 N
S 68 F
3 B
S 69 F
3 B
S 70 F
3 B
S NRC 2019 Fermi ILE 71 F
2 B
S NRC 2015 Fermi ILE 72 F
3 N
S 73 F
3 N
S 74 F
2 B
S NRC 2019 Fermi ILE 75 F
3 B
S NRC 2019 Fermi ILE
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: FERMI NUCLEAR POWER STATION Exam Date: May 24 - June 2, 2021 Page 5 of 5 RO TOTALS:
B= 35 F= 33 E= N/A Additional Notes: NRC developed exam. ES-401-9 used only for statistical /
metrics documentation.
M= 4 H= 42 U= N/A N= 36
GENERAL COMMENT
S:
- 1. There are 3 (RO questions with references/attachments provided.
- 2.
RO Questions from the previous 2 NRC Exams: __1__
- 3.
RO Exam Average difficulty is _2.88_