ML15355A241
| ML15355A241 | |
| Person / Time | |
|---|---|
| Site: | Beaver Valley |
| Issue date: | 12/18/2015 |
| From: | Peter Presby Operations Branch I |
| To: | Gibson D FirstEnergy Nuclear Operating Co |
| Shared Package | |
| ML15161A011 | List: |
| References | |
| U01906 | |
| Download: ML15355A241 (6) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 1
B 3
B s
2 M
3 x
M u
Non-discriminating distractors. Potential for no correct answer. Revised Q.
3 B
3 B
s 4
N 3
N E
Removed some information from stem to ensure no cueing and improve distractor plausibility.
5 N
3 N
E Minor stem modification to ensure validity of key answer.
6 N
3 x
N u
2 implausible distractors. Q rewritten.
7 N
3 N
E Replaced one distractor.
8 B
3 B
s 9
N 3
x N
u Non-credible. Rewrote Q.
10 N
3 N
s 11 N
2 N
s 12 B
3 B
E Modified stem to improve distractor plausibility and to address inconsistent given data.
13 N
3 N
E Minor changes to improve discriminatory value.
14 N
3 N
s 15 N
3 N
E Minor stem structural change to improve distractor plausibility.
16 N
3 N
E Replaced an implausible distractor. Minor stem changes.
17 B
3 x
B u
Implausible distractors. Replaced Q.
Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 18 M
3 M
E Minor stem wording change to ensure key answer validity.
19 B
3 B
s 20 N
3 N
E Fixed typo.
21 B
3 B
E Reworded choices for improved symmetry.
22 N
3 N
E Modified conditions to improve distractor plausibility.
23 N
3 N
E Changed stem conditions to support distractor plausibility.
24 M
3 x
M u
Reselected KIA and replaced Q.
25 B
2 B
s 26 M
3 M
E Minor stem modification to better match key answer.
27 B
3 B
E Minor punctuation change.
28 N
2 N
s 29 N
2 N
E Minor stem re-organization.
30 M
3 M
s 31 B
3 B
s 32 N
3 N
s 33 B
3 B
E Q replaced with a better Q at CE discretion.
34 N
3 N
E Reworded Q to improve clarity.
35 B
3 B
s 36 B
3 B
s 37 B
3 B
s 38 B
3 B
s Page2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 39 N
3 N
s 40 M
3 M
E Minor changes to improve discriminatory value.
41 N
3 N
s 42 M
1 x
M u
LOD=1, KIA mismatch. Reselected KIA and replaced 0.
43 B
3 B
s 44 N
3 N
E Minor stem change.
45 N
3 N
E Modified stem and distractors to improve discriminatory value.
46 N
3 N
E Good 0. Changed KIA at CE discretion to better match tested information.
47 B
3 x
B u
2 non-credible distractors. Revised 0.
48 N
3 N
E Modified 0 and distractors to improve discriminatory value.
49 N
3 N
s 50 N
3 N
s 51 B
3 B
E Moved common language from choices into stem.
52 B
3 B
s 2011 NRG Exam 053.
53 B
3 B
s 2012 NRG Exam 053.
54 N
3 N
s 55 N
3 N
E Changed 1 implausible distractor.
56 N
3 N
s 57 N
3 N
E Reduced number of options in each choice.
58 M
3 M
E Modified 0 and choices to ensure key answer correct under all conditions.
Page 3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 59 N
3 N
E Minor change to distractors to improve plausibility.
60 N
2 N
E Reselected KIA and replaced Q at CE discretion to increase LOD.
61 B
3 x
B u
Non-credible distractors. Rewrote the Q.
62 B
3 B
E Added proc reference to stem and modified given conditions to improve tie between conditions and the question.
63 B
3 B
E Modified Q and choices to improve discriminatory value.
64 N
3 N
s 65 N
2 N
E Wrote a new Q at CE discretion to raise LOD.
66 M
3 M
s 67 B
3 B
E Added qualifying information to stem to ensure only one correct answer.
68 N
3 N
E Reworded to improve credibility of choices.
69 M
3 M
E Reworded to ensure Q is not cueing.
70 B
3 B
71 B
3 B
72 N
3 N
73 B
3 B
74 N
3 N
75 B
3 B
76 N
3 N
E Added qualifier statement to stem.
77 N
3 N
E Modified Q and distractors to improve discriminatory value.
78 B
3 B
s 79 N
3 N
s Page4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 80 M
3 M
E Minor modifications to enhance plausibility of distractors.
81 B
3 B
s 82 N
3 N
E Modified stem and choices to ensure key answer accuracy and improve discriminatory value.
83 M
3 M
E Minor stem changes for clarity.
84 M
3 M
s 85 M
3 M
E Added stem information and changed key answer to improve distractor plausibility.
86 N
3 N
s 87 N
3 N
E Minor stem changes for clarity.
88 N
3 N
E Revised to clarify stem and improve distractors.
89 N
3 N
E Minor stem and choice changes to improve clarity.
90 N
3 N
E Reworded to improve structure and discriminatory value.
91 M
3 M
E 2011 NRC Exam 093 (modified). Modified to enhance distractor plausibility.
92 N
3 x
N u
Modified to ensure 0 is SRO-only.
93 N
3 N
E Deleted unnecessary stem statement to prevent confusion.
94 N
3 N
E Minor wording changes to better align 0 to reference materials.
95 B
3 B
s 96 B
2 B
s 97 N
3 N
E Modified to improve distractors and clarify 0.
98 B
3 B
s 2012 NRC 098 99 B
3 B
E Replaced with better 0 at CE discretion.
Page 5
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 100 B
3 B
E Modified stem to improve plausibility of distractors.
Page 6
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 1
B 3
B s
2 M
3 x
M u
Non-discriminating distractors. Potential for no correct answer. Revised Q.
3 B
3 B
s 4
N 3
N E
Removed some information from stem to ensure no cueing and improve distractor plausibility.
5 N
3 N
E Minor stem modification to ensure validity of key answer.
6 N
3 x
N u
2 implausible distractors. Q rewritten.
7 N
3 N
E Replaced one distractor.
8 B
3 B
s 9
N 3
x N
u Non-credible. Rewrote Q.
10 N
3 N
s 11 N
2 N
s 12 B
3 B
E Modified stem to improve distractor plausibility and to address inconsistent given data.
13 N
3 N
E Minor changes to improve discriminatory value.
14 N
3 N
s 15 N
3 N
E Minor stem structural change to improve distractor plausibility.
16 N
3 N
E Replaced an implausible distractor. Minor stem changes.
17 B
3 x
B u
Implausible distractors. Replaced Q.
Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 18 M
3 M
E Minor stem wording change to ensure key answer validity.
19 B
3 B
s 20 N
3 N
E Fixed typo.
21 B
3 B
E Reworded choices for improved symmetry.
22 N
3 N
E Modified conditions to improve distractor plausibility.
23 N
3 N
E Changed stem conditions to support distractor plausibility.
24 M
3 x
M u
Reselected KIA and replaced Q.
25 B
2 B
s 26 M
3 M
E Minor stem modification to better match key answer.
27 B
3 B
E Minor punctuation change.
28 N
2 N
s 29 N
2 N
E Minor stem re-organization.
30 M
3 M
s 31 B
3 B
s 32 N
3 N
s 33 B
3 B
E Q replaced with a better Q at CE discretion.
34 N
3 N
E Reworded Q to improve clarity.
35 B
3 B
s 36 B
3 B
s 37 B
3 B
s 38 B
3 B
s Page2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 39 N
3 N
s 40 M
3 M
E Minor changes to improve discriminatory value.
41 N
3 N
s 42 M
1 x
M u
LOD=1, KIA mismatch. Reselected KIA and replaced 0.
43 B
3 B
s 44 N
3 N
E Minor stem change.
45 N
3 N
E Modified stem and distractors to improve discriminatory value.
46 N
3 N
E Good 0. Changed KIA at CE discretion to better match tested information.
47 B
3 x
B u
2 non-credible distractors. Revised 0.
48 N
3 N
E Modified 0 and distractors to improve discriminatory value.
49 N
3 N
s 50 N
3 N
s 51 B
3 B
E Moved common language from choices into stem.
52 B
3 B
s 2011 NRG Exam 053.
53 B
3 B
s 2012 NRG Exam 053.
54 N
3 N
s 55 N
3 N
E Changed 1 implausible distractor.
56 N
3 N
s 57 N
3 N
E Reduced number of options in each choice.
58 M
3 M
E Modified 0 and choices to ensure key answer correct under all conditions.
Page 3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 59 N
3 N
E Minor change to distractors to improve plausibility.
60 N
2 N
E Reselected KIA and replaced Q at CE discretion to increase LOD.
61 B
3 x
B u
Non-credible distractors. Rewrote the Q.
62 B
3 B
E Added proc reference to stem and modified given conditions to improve tie between conditions and the question.
63 B
3 B
E Modified Q and choices to improve discriminatory value.
64 N
3 N
s 65 N
2 N
E Wrote a new Q at CE discretion to raise LOD.
66 M
3 M
s 67 B
3 B
E Added qualifying information to stem to ensure only one correct answer.
68 N
3 N
E Reworded to improve credibility of choices.
69 M
3 M
E Reworded to ensure Q is not cueing.
70 B
3 B
71 B
3 B
72 N
3 N
73 B
3 B
74 N
3 N
75 B
3 B
76 N
3 N
E Added qualifier statement to stem.
77 N
3 N
E Modified Q and distractors to improve discriminatory value.
78 B
3 B
s 79 N
3 N
s Page4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD 0#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-O=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 80 M
3 M
E Minor modifications to enhance plausibility of distractors.
81 B
3 B
s 82 N
3 N
E Modified stem and choices to ensure key answer accuracy and improve discriminatory value.
83 M
3 M
E Minor stem changes for clarity.
84 M
3 M
s 85 M
3 M
E Added stem information and changed key answer to improve distractor plausibility.
86 N
3 N
s 87 N
3 N
E Minor stem changes for clarity.
88 N
3 N
E Revised to clarify stem and improve distractors.
89 N
3 N
E Minor stem and choice changes to improve clarity.
90 N
3 N
E Reworded to improve structure and discriminatory value.
91 M
3 M
E 2011 NRC Exam 093 (modified). Modified to enhance distractor plausibility.
92 N
3 x
N u
Modified to ensure 0 is SRO-only.
93 N
3 N
E Deleted unnecessary stem statement to prevent confusion.
94 N
3 N
E Minor wording changes to better align 0 to reference materials.
95 B
3 B
s 96 B
2 B
s 97 N
3 N
E Modified to improve distractors and clarify 0.
98 B
3 B
s 2012 NRC 098 99 B
3 B
E Replaced with better 0 at CE discretion.
Page 5
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOO Q#
(F/H)
(1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 100 B
3 B
E Modified stem to improve plausibility of distractors.
Page 6