ML17069A417
| ML17069A417 | |
| Person / Time | |
|---|---|
| Site: | Limerick  |
| Issue date: | 01/16/2017 |
| From: | Peter Presby Operations Branch I |
| To: | Exelon Generation Co |
| Shared Package | |
| ML16076A445 | List: |
| References | |
| U01940 | |
| Download: ML17069A417 (5) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only Minor stem and choice rewording for clarification. Fixed answer 1
H 2.5 N
E explanations. Fixed KIA number on pedigree page. Corrected source info on pedigree.
2 F
2.0 B
u Modified stem to make 2"d correct answer wrong.
3 F
2.0 N
E Deleted one column from the choices to improve Q structure.
4 F
2.0 B
s 5
H 3.0 N
E Modified stem to improve distractor plausibility. Modified choice for symmetry.
6 F
2.0 x
B u
Changed categorization to memory level. Modified stem to establish credibility of distractors.
7 H
3.0 B
E Modified stem and choices for clarity and credibility.
8 F
3.0 B
E Minor stem modification to eliminate cueing.
9 H
3.0 M
u Modified to eliminate two correct answers and to improve stem clarity.
10 H
2.0 B
u Direct lookup with reference. Removed reference. Modified stem and choices.
11 H
2.8 B
s 12 H
3.0 x
N u
KIA mismatch. Replaced Q.
13 H
3.0 N
s 14 F
3.0 B
s 15 H
2.0 N
E Reworded stem and choices to better align choices with information provided.
16 H
2.5 M
E Minor stem and choice rewording to improve clarity.
17 F
3.0 M
E Minor stem change to prevent cueing.
Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 18 H
3.0 B
E Minor changes to improve clarity.
19 F
3.0 N
E Minor stem clarification.
20 H
3.0 N
E Minor re-ordering of stem information for clarity.
21 H
3.0 N
E Typo and minor stem clarification.
22 F
3.0 B
E Modified stem to raise discriminatory value.
23 F
3.0 N
E Modified two distractors to improve plausibility.
24 F
3.0 N
s 25 H
2.5 B
E Modified stem to provide comparison basis for choices.
26 F
3.0 B
E Modified stem slightly to improve clarity.
27 H
3.0 N
s 28 H
4.0 B
s 29 H
3.0 B
s 30 H
2.5 B
E Changed distractors to improve discriminatory value.
31 H
3.0 B
s 32 F
2.0 B
s 33 H
3.5 N
E Re-wrote the Q to ensure less ambiguity in the choices.
34 F
3.0 N
s 35 H
2.0 B
s 36 H
4.0 N
E Minor stem change to ensure no cueing.
37 H
3.5 N
s 38 F
2.0 B
s Page2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 39 F
3.0 M
s 40 H
3.0 N
s 41 F
2.2 x
B u
Not sufficiently discriminating 42 H
2.0 B
E Wording changes to clarify the information that is asked.
43 F
3.0 M
E Added information to support distractor plausibility.
44 H
3.0 N
E Modified stem and distractors to improve clarity 45 H
3.0 N
E Minor edit 46 F
2.5 N
E Minor edits 47 F
3.0 M
s 48 H
2.0 B
s 49 H
3.0 M
E Minor stem modification to improve clarity 50 H
2.5 B
s 51 F
2.0 B
s 52 F
2.4 B
s Used on 2015 NRC Exam.
53 F
2.0 x
N u
2 non-credible distractors. Distractors modified.
54 F
3.0 B
E Modified to remove cueing from stem and improve choices 55 F
3.5 N
s 56 H
3.0 N
E Minor changes to improve stem readability.
57 F
2.0 B
s 58 F
3.0 N
s 59 H
3.0 N
s Page 3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 60 H
3.0 M
s 61 F
3.0 N
E Modified stem for improved clarity.
62 F
3.0 B
E Changed stem condition to improve distractor discriminatory value.
63 F
3.5 B
s 64 H
3.0 N
s 65 H
3.0 M
s 66 F
3.0 x
N u
Replaced Q with one that appropriately tests the KIA knowledge 67 H
3.0 N
u Replaced Q with one that appropriately tests the KIA knowledge 68 F
3.0 M
E Minor rewording to improve clarity.
69 F
2.5 N
s 70 F
2.5 B
E Modified one implausible distractor 71 H
2.5 B
E Minor wording change for clarity 72 F
3.0 B
s Used on 2015 NRC Exam.
73 F
3.0 N
s 74 F
3.0 B
s 75 H
3.0 B
E Minor stem wording change to ensure no overlap with another Q.
76 H
3.0 N
E Modified to improve distractors 77 H
3.0 N
s 78 H
4.0 N
E Modified two distractors to improve plausibility.
79 H
3.0 N
E 43.2. Modified distractors to ensure Q is SRO only.
80 H
3.0 N
E Modified choices to improve discriminatory value.
81 H
3.0 N
s Page4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 82 H
3.0 N
E Modified Q to ensure SRO-only 83 F
3.0 x
N u
Modified Q to match KIA 84 H
4.0 N
E Modified Q to ensure technically accurate and to enhance discriminatory value 85 H
4.0 B
s 86 H
3.0 x
N u
Direct lookup. 2 non-credible distractors. Q and distractors modified.
87 H
3.0 N
E Modified distractors to improve plausibility.
88 H
3.0 N
E Modified Q to raise LOO and enhance distractor plausibility.
89 H
3.0 N
E Minor modification to improve clarity 90 H
4.0 N
s 91 H
3.0 M
E Minor modification to ensure accuracy.
92 H
3.0 N
s 93 H
3.0 N
s 94 F
2.0 N
E Modified stem and choices to improve plausibility of distractors.
95 H
3.0 M
E Modified stem and choices to ensure no cueing.
96 H
3.0 x
N u
Non-credible distractors. Replaced the Q.
97 H
4.0 x
M u
Replaced Q to match the selected Tier 3 KIA.
98 H
3.0 x
N u
More than one correct answer. Question replaced.
99 H
2.0 B
s 100 H
2.0 N
E Minor editorial changes.
Page 5