ML15169A651
| ML15169A651 | |
| Person / Time | |
|---|---|
| Site: | Peach Bottom  |
| Issue date: | 04/11/2015 |
| From: | Peter Presby Operations Branch I |
| To: | Reiner R Exelon Generation Co |
| Shared Package | |
| ML14254A311 | List: |
| References | |
| TAC U01911 | |
| Download: ML15169A651 (6) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
0#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 1
H 3
B E
Swapped locations of draft 01 and 039 on the final exam. Minor enhancements to stem.
2 H
2.5 N
E Modified stem and distractors to enhance plausibility 3
F 2
N u
Overlaps with op-test JPM. 0 replaced.
4 H
1.5 N
u Low LOD. Wrote a new 0.
5 H
2.5 N
E Minor stem rewording for clarity.
6 H
3 N
E Rewording to clarify 0.
7 F
3 N
E Weak distractors. Reworded stem to enhance distractor plausibility.
8 H
3 B
E Reword choices to remove unnecessary information.
9 H
3 M
E Modify stem conditions to avoid op-test overlap.
10 F
2 B
u Overlap with op-test JPM. Replaced with a bank 0.
11 F
2.5 B
E Minor rewording to improve operational validity.
12 H
2.5 B
E Fixed typos.
13 H
2 N
E Minor stem wording change to ensure answer is correct.
14 H
2 N
E Minor stem wording change to clarify choices.
15 H
3.5 N
E Minor stem modification.
16 H
3 N
s 17 F
3 B
E Minor wording change to ensure no subset concern.
Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 18 H
3 B
E Added initial condition to stem.
19 F
2.5 N
s 20 H
3 N
E Minor Q modification to enhance distractor plausibility.
21 H
3 B
E Minor changes to improve distractor plausibility. Used on 2011 NRC Exam (0#55).
22 F
2 B
E Implausible distractor. Replaced with different bank Q.
23 H
2.5 N
E Modified a stem condition to improve distractor plausibility.
24 H
2 B
E Modify use of "only."
25 H
3 B
E Low discriminatory value distractors. Replaced with bank Q.
26 F
2.5 N
E Minor rewording to improve distractor plausibility.
27 H
2.5 N
E Minor distractor rewording and removal of imbedding drawing.
28 F
2 N
E Modified Q to raise LOD.
29 H
3 N
E Minor changes to fix plausibility of one distractor and to improve discriminatory value of Q.
30 F
2 B
E Modified Q wording to raise LOD.
31 F
2.5 B
E Corrected typo in stem. Modified Q to improve choice plausibility.
32 F
2 N
E Modified distractors to improve plausibility.
33 H
3 N
E One implausible distractor. Modified distractor.
34 H
3 N
E Modified distractors to improve plausibility.
35 F
3 N
E Minor typos.
36 F
3 B
s 37 H
3 B
u Q not sufficiently discriminating. Reselected KA. Replaced Q.
Page 2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 38 H
2.5 N
s Minor typos.
39 H
2 x
8 u
Swapped locations of draft 01 and 039 on the final exam. Two non-credible distractors. Replaced draft 01 (the new 039) with bank 0.
40 H
2.8 B
E Minor changes to improve discriminatory value.
41 F
3 8
E Minor editorial changes.
42 F
3 N
s Swapped locations of draft 042 and 075 on the final exam.
43 H
3 M
E Clarified stem 0.
44 H
3 N
E Reworded 0 for clarity.
45 H
3 8
s 46 H
2 8
s 47 F
2.5 8
E Modifications to improve distractor plausibility and fix T/F issue.
48 H
3 N
E Restructured the 0 to improve clarity and changed one implausible distractor.
49 H
3 8
E Minor wording changes.
50 H
2.5 N
s Minor wording change to stem.
51 H
2.5 N
E Rewrote to improve discriminatory value.
52 H
3 N
E Minor wording changes for clarity.
53 H
3 N
s 54 H
1 B
u Low LOD, minutia. Replaced the 0.
55 F
2 x
N u
KA mismatch. Replaced with bank 0.
56 H
2.5 N
E Minor rewording to improve discriminatory value.
57 H
3 B
s Page3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 58 F
3 B
E Modified choices and stem to reduce word count and improve distractors.
59 H
3 x
B u
KA mismatch. Reselected KIA and replaced with bank 0.
60 H
2.5 x
B u
Implausible distractors. Overlaps with op-test. Replaced 0.
61 H
2.5 N
E Overlap with 052.
62 F
2 N
E Fundamental, not higher order. Implausible distractor.
63 H
2 N
E Modified 0 and choices to improve distractor plausibility.
64 F
3 B
E Low plausibility distractor. Reworded distractors.
65 F
3 B
s 66 F
3 B
E Reworded to address T/F concern.
67 F
3 x
B u
Reselect KA, Tier 3 generic overlaps with system tiers.
68 F
3 x
N u
Job-link. Replaced with new 0.
69 F
3 N
u Job-link. Replaced with new 0.
70 F
3 B
s 71 F
2 B
E Minor wording change to distractor.
72 F
2.5 B
E Tested knowledge is not appropriate at RO level. 0 replaced at CE discretion.
73 F
3 N
E Modified distractor to improve plausibility.
74 H
3.5 N
E Minor stem wording change.
75 F
3 B
E Swapped locations of draft 042 and 075 on the final exam. Fixed plausibility of one distractor on draft 042 (the new 075).
76 H
2.5 B
E (SRO #1) Modified one distractor to ensure no subset issue.
77 H
2.5 N
E (SRO #2) Weak distractors. Modified 0 and choices.
Page4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 78 H
2.5 B
E (SRO #3) Implausible distractor 79 H
2.5 N
s (SR0#4) 80 H
2.5 x
B u
(SRO #5) Not SRO-only. Replaced Q.
81 F
3.5 B
s (SR0#6) 82 H
2.5 B
E (SRO #7) Modified stem to improve discriminatory value. Corrected for unit specific components.
83 H
2 N
E (SRO #8) Modified to increase LOD.
84 H
3 N
E (SRO #9) Modified time is stem to improve distractor plausibility.
85 H
2.5 N
s (SRO #10) 86 H
3 B
E (SRO #11) Minor distractor wording change for clarity.
87 H
2.5 N
E (SRO #12) Minor rewording to improve discriminatory value.
88 H
2.5 N
E (SRO #13) Modified Q and one distractor to improve discriminatory value.
89 H
3 x
B u
(SRO #14) Not SRO-only.
90 H
3 x
N u
(SRO #15) Not SRO-only. Reworded Q and choices.
91 H
2.5 B
E (SRO #16) Modified Q and distractors to improve plausibility.
92 H
2.5 B
E (SRO #17) Minor wording change to Q.
93 H
3 N
s (SRO #18) 94 F
3 N
E (SRO #19) Replaced one low plausibility distractor.
95 H
3 N
E (SRO #20) Modified to include procedure numbers and to improve discriminatory value.
96 H
2 x
B u
(SRO #21) Not SRO-only. Replaced with a bank Q.
97 H
3 N
E (SRO #22) Reworded one distractor.
Page 5
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 98 F
2 B
u (SRO #23) Low discriminatory value. Replaced Q.
99 H
3 B
s (SRO #24) 100 H
3 B
E (SRO #25) At CE direction, replaced Q to better match the Tier 3 KA.
Page 6