ML21293A218
| ML21293A218 | |
| Person / Time | |
|---|---|
| Site: | Millstone  (NPF-049) |
| Issue date: | 09/21/2021 |
| From: | Dominion Nuclear Connecticut |
| To: | Thomas Setzer Operations Branch I |
| Setzer T | |
| Shared Package | |
| ML20275A100 | List: |
| References | |
| EPID L-2021-OLL-0005 | |
| Download: ML21293A218 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred.
Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 1
F 2.5 N
E Changed stem to a discharge occurs, and also added a statement that the plant is stable at 100% power.
2 H
2.5 N
E Ran event on the simulator. Actual time required to reach the specified conditions was six minutes. Changed question time sequence to state, Six minutes later, conditions are as follows 3
H 2.5 B
S 4
F 2.5 B
S 5
F 3.0 M
S 6
F 3.5 N
E Potential subset issue exists with the distractors. Also, need to clarify that the action is taken to avoid a governor malfunction, to better match the KA.
Changed question to ask for the minimum time. Also added to prevent causing a malfunction of the TDAFW Pump automatic speed control circuit to the stem.
7 F
2.0 N
S 8
F 3.0 X
B U
Subset issue exists with the distractors.
Changed question to ask What is the minimum time after the loss of power Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3.
Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
Cues: The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
T/F: The answer choices are a collection of unrelated true/false statements.
Cred. Dist.: The distractors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).
- 4.
Check the appropriate box if a job content flaw is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
Backward: The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only. (K/A and license-level mismatches are unacceptable.)
- 6.
Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.
- 7.
Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 9
H 3.0 B
S 10 F
3.0 B
S 11 H
3.0 B
S 12 H
3.5 X
B U
Question is SRO level.
Removed the procedure transition decision from the distractors and focused the question on the requirements per the notes and cautions of the procedure.
13 H
3.0 B
S 14 F
3.0 B
S 15 H
3.0 N
S 16 H
3.5 N
S 17 H
3.0 M/B E
Question may not meet the threshold of being a modified question.
Changed the Question Source from Modified to Bank 18 H
3.0 N
S 19 F
2.5 X
B U
The refueling topic is SRO level.
Redrew the KA. Replaced the question.
20 H
2.5 X
N U
The refueling topic is SRO level.
Redrew the KA. Replaced the question.
21 H
3.0 N
S 22 H
2.0 N
E Removed the word approximately from the question where it says Tcold will approximately indicate.
ES-401 3
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 23 H
2.5 N
S 24 H
3.0 N
S 25 H
2.5 N
E Potential subset. Changed The CHARG PP FLOW HI/LO annunciator is received at the point when Charging Pump flow decreases below to The flow at which the CHARG PP FLOW HI/LO annunciator is expected to be received is when Charging Pump flow decreases below.
26 F
3.0 N
S 27 H
3.5 N
S 28 H
2.5 B
S 29 F
2.5 M
E Replaced The US desires to continue implementing applicable steps with The US continues implementing applicable steps 30 F
2.5 B
E Added component IDs to distractors A and B.
31 H
2.5 B
S 32 H
2.5 B
S 33 F
2.0 N
S 34 H
3.0 M
S 35 F
2.0 B
S 36 H
3.0 B
S 37 H
2.5 B
S 38 F
3.0 N
E Added step numbers in stem (1, 2, 3)
ES-401 4
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 39 H
2.5 B
S 40 F
3.0 B
S 41 H
3.0 B
E Simplified distractors - Deleted the second sentence from each distractor.
42 F
3.0 N
S 43 F
3.0 B
S 44 F
2.5 B
S 45 F
3.0 B
S 46 H
3.0 N
S 47 H
3.5 B
S 48 F
3.0 N
S 49 F
3.0 N
E Removed quickest from the question and changed distractor A to involve a breaker manipulation that is not in accordance with the procedure.
50 H
3.0 B
S 51 H
4.0 N
E Added the meter designator from the Main Board to the question.
52 F
3.0 B
E Changed distractor A to if a step.
53 F
3.0 B
S Emergency Dose.
55 H
2.5 B
S 56 H
3.0 B
S
ES-401 5
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 57 H
3.0 B
S 58 F
3.0 B
S 59 H
3.0 B
S 60 H
3.0 N
S 61 F
3.0 B
S 62 H
3.0 B
S 63 H
3.0 B
E Changed question to how the A Train will automatically respond 64 F
2.5 N
E Removed Assuming there is a delay from the question, and underlined as quickly as possible.
65 H?
2.5 B
E Updated question to reference new procedure SY-AA-119, Protected Area Access Control 66 F
3.0 N
S 67 H
3.0 B
E Changed optimal ECCS lineup in the question to procedurally directed lineup.
68 H
3.0 B
S 69 H
2.5 N
E Added a bullet stating The RCS is stable at no-load temperature and pressure. Also combined items 1 and 2 into the statement in the stem.
70 F
3.0 B
S 71 F
3.0 B
E Oversample of Fire Systems and Fire procedures on the exam.
Redrew the KA. Replaced the question.
72 H
3.0 M
S 73 H
3.0 B
S
ES-401 6
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 74 F
3.0 B
S 75 F
4.0 X
N E
Testing specific DC control power power supply appears to be testing minutia. Redraw KA.
Redrew the KA. Replaced the question.
76 H
3.0 X
B U
Question is not SRO level. KA is double jeopardy with SRO question #94, which also tests the Loss of Service Water AOP.
Redrew the KA. Replaced the question.
77 F
2.5 B
S 78 F
2.5 B
S 79 H
3.0 N
S 80 H
3.0 B
E Changed justification to requires knowledge of Tech Spec actions based on specific power level 81 H
3.0 X
N U
Question appears to be testing minutia. KA is not conducive to writing a discriminating question.
Redrew the KA. Replaced the question.
82 H
3.0 B
E Added per ES-0.4 to the question.
83 H
3.0 B
E Did a significant re-write of the distractors. Changed the flag for a specific reference to a general statement about Using the attached references. Also, added another Tech Spec (3/4.7.4) to the supplied references.
84 F
2.0 B
S 85 H
3.0 N
S 86 H
3.0 B
S 87 F
2.5 B
S 88 H
3.0 B
E Added a bullet in the stem about Control Room habitability, and clarified that distractor C allows further steps to be taken in the Control Room, and D does not.
ES-401 7
Form ES-401-9 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
Source (B/M/N)
- 7.
Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred
. Dist Partial Job-Link Minutia
- /Units Backward Q -
K/A SRO Only 89 H
3.5 B
S 90 F
3.0 N
S 91 H
3.0 B
S 92 H
3.0 N
S 93 H
3.0 N
S 94 H
3.0 N
S 95 H
3.0 B
S 96 H
2.5 B
S 97 H
3.0 M
E The phrase The operators were too slow is too vague.
Changed The operators were too slow to to The operators did NOT meet the Operator Credited Action Time assumed in the FSAR to.
98 F
2.0 N
S 99 H
2.5 M
E Changed Using the attached Rod Worth and Boron Worth curves, to Using the attached references. Also, added the associated Tables to the list of allowed references, along with the Miscellaneous Core Data Sheet from the Curve Book.
100 H
3.0 N
S