ML15100A031
| ML15100A031 | |
| Person / Time | |
|---|---|
| Site: | Limerick  |
| Issue date: | 01/12/2015 |
| From: | Peter Presby Operations Branch I |
| To: | Ruffe R Exelon Generation Co |
| Shared Package | |
| ML14245A223 | List: |
| References | |
| TAC U01892 | |
| Download: ML15100A031 (5) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
Q#
LOK LOO (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 1
F 3
x N
E Low discriminatory value distractors. Modified distractors to improve discriminatory value.
2 H
2 x
N u
No correct answer. Modified Q to ensure correct answer.
3 F
3 N
E Minor choice rewording to improve answer symmetry.
4 H
3 B
s 5
F 3
B u
Two correct answers. Rewrote question and choices.
6 F
3 N
s 7
H 3
B s
8 H
B E
Minor stem modifications to ensure no cueing.
9 H
1 N
u Too low LOO. Replaced with a higher cognitive level new Q.
10 H
3 B
E Clarified Q to ensure only one correct answer.
11 H
2 x
B E
Reworded to improve symmetry and distractor discriminatory value.
12 H
3 N
E Minor wording change in stem.
13 H
3 x
B E
Info in stem too leading. Removed imbedded graph and made minor changes to stem and choices.
14 F
3 N
E Minor wording changes to avoid cueing and better balance the choices.
15 F
3 x
N E
Q modified to improve KA match.
16 H
3 N
s 17 H
3 N
s Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 18 H
3 N
s 19 H
3 N
s 20 F
3 N
s 21 H
3 x
N E
Minor wording changes to stem and choices to improve clarity.
22 H
3 N
E Modified stem and choices to improve distractor plausibility.
23 H
3 B
s 24 F
3 N
s Corrected typo in Choice A.
25 F
3 N
s 26 H
3 N
E Minor choice wording change.
27 H
3 N
s 28 H
3 N
s 29 F
3 N
s 30 H
3 N
E Modified to ensure no overlap with 010 and to reduce word count.
31 F
3 N
E Modified stem wording to ensure answer fully technically correct.
32 F
3 N
u Overlap with op-test. Q replaced.
33 F
3 B
E Modified distractors to improve plausibility.
34 F
3 N
s 35 H
3 N
E Minor stem wording change.
36 F
3 N
s 37 H
3 x
B E
Minor stem wording change to align choices with Q.
38 F
3 B
s Page 2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 39 F
3 B
E Corrected minor typo.
40 F
3 B
s 41 F
3 N
s 42 H
3 B
s 43 H
3 N
s 44 H
3 x
N u
Revised two implausible distractors.
45 H
3 N
s 46 H
3 N
s 47 L
3 N
s 48 H
3 N
s 49 H
3 N
s 50 F
3 N
E Reworded to eliminate repetitive information in choices.
51 H
3 N
E Modified Q to raise LOO.
52 F
3 N
E Is Choice B plausible, given the division separation (RHR 'A' vs a 'B' UPS)?
53 F
3 B
s Used on 2012 NRC Exam (Q#10) 54 F
3 N
s 55 F
3 B
E Modified stem to eliminate possibility of 2"d correct answer.
56 H
3 B
E Modified choice wording for symmetry.
57 F
3 B
s Used on 2012 NRC Exam (Q#73) 58 H
3 x
B u
Non-credible distractors. Replaced the Q.
Page 3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 59 H
3 B
s 60 F
3 x
N u
Wrote a new Q to match the KA.
61 F
3 N
s 62 H
3 B
E Reworded choices to improve symmetry.
63 H
3 N
s 64 F
3 N
E Moved repetitive information from choices into stem.
65 F
3 B
s 66 H
3 N
s 67 F
3 N
E Removed unnecessary information from stem.
68 H
3 B
s 69 H
3 M
E Minor clarification to stem conditions.
70 H
3 B
E Moved repetitive information from choices to stem. Reworded choices to improve symmetry and plausibility of distractors.
71 H
3 N
s 72 F
3 N
s 73 H
3 B
E Modified distractors to improve plausibility. Added conditions to stem for clarity.
74 F
3 N
s 75 F
3 B
s 76 F
2 N
E Reworded choices to improve distractor plausibility.
77 F
2 x
B u
Not SRO-only. Too low LOO. Wrote a new Q 78 H
3 N
E Minor choice wording changes to remove unnecessary information.
79 F
3 N
E Modified Q stem for clarity.
Page4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 80 H
2.8 N
E Modified a choice to improve symmetry.
81 F
3 N
s 82 H
3 B
E Modified choice wording to ensure SRO-only.
83 H
3 x
N u
Weak KA match. Overlap with audit exam. Replaced Q.
84 F
3 N
E Corrected typo in stem.
85 F
3 B
s Re-categorized as memory level.
86 H
3 N
s 87 H
3 B
s 2012 NRC Exam Q#77.
88 H
3 B
s 89 F
3 N
s 90 H
3 N
s 91 H
3 N
s 92 H
2 N
E Low LOO. Subset issue. Replaced Q due to excessive number TS Q on exam.
93 H
4 N
s 94 F
3 N
s 95 H
3 x
B u
Minutia. Replaced Q.
96 F
3 N
E Minor reworded for clarity.
97 F
3 B
s 98 F
3 B
s 99 H
3 M
s Modified 2012 NRC Exam Q#96.
100 F
3 N
s Page 5