ML15355A241
| ML15355A241 | |
| Person / Time | |
|---|---|
| Site: | Beaver Valley |
| Issue date: | 12/18/2015 |
| From: | Peter Presby Operations Branch I |
| To: | Gibson D FirstEnergy Nuclear Operating Co |
| Shared Package | |
| ML15161A011 | List: |
| References | |
| U01906 | |
| Download: ML15355A241 (6) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 1 B 3 B s 2 M 3 x M u Non-discriminating distractors. Potential for no correct answer. Revised Q.
3 B 3 B s N 3 N E Removed some information from stem to ensure no cueing and improve 4
distractor plausibility.
5 N 3 N E Minor stem modification to ensure validity of key answer.
6 N 3 x N u 2 implausible distractors. Q rewritten.
7 N 3 N E Replaced one distractor.
8 B 3 B s 9 N 3 x N u Non-credible. Rewrote Q.
10 N 3 N s 11 N 2 N s B 3 B E Modified stem to improve distractor plausibility and to address 12 inconsistent given data.
13 N 3 N E Minor changes to improve discriminatory value.
14 N 3 N s 15 N 3 N E Minor stem structural change to improve distractor plausibility.
16 N 3 N E Replaced an implausible distractor. Minor stem changes.
17 B 3 x B u Implausible distractors. Replaced Q.
Page 1
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 18 M 3 M E Minor stem wording change to ensure key answer validity.
19 B 3 B s 20 N 3 N E Fixed typo.
21 B 3 B E Reworded choices for improved symmetry.
22 N 3 N E Modified conditions to improve distractor plausibility.
23 N 3 N E Changed stem conditions to support distractor plausibility.
24 M 3 x M u Reselected KIA and replaced Q.
25 B 2 B s 26 M 3 M E Minor stem modification to better match key answer.
27 B 3 B E Minor punctuation change.
28 N 2 N s 29 N 2 N E Minor stem re-organization.
30 M 3 M s 31 B 3 B s 32 N 3 N s 33 B 3 B E Q replaced with a better Q at CE discretion.
34 N 3 N E Reworded Q to improve clarity.
35 B 3 B s 36 B 3 B s 37 B 3 B s 38 B 3 B s Page2
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO 0# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- O= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 39 N 3 N s 40 M 3 M E Minor changes to improve discriminatory value.
41 N 3 N s 42 M 1 x M u LOD=1, KIA mismatch. Reselected KIA and replaced 0.
43 B 3 B s 44 N 3 N E Minor stem change.
45 N 3 N E Modified stem and distractors to improve discriminatory value.
46 N 3 N E Good 0. Changed KIA at CE discretion to better match tested information.
47 B 3 x B u 2 non-credible distractors. Revised 0.
48 N 3 N E Modified 0 and distractors to improve discriminatory value.
49 N 3 N s 50 N 3 N s 51 B 3 B E Moved common language from choices into stem.
52 B 3 B s 2011 NRG Exam 053.
53 B 3 B s 2012 NRG Exam 053.
54 N 3 N s 55 N 3 N E Changed 1 implausible distractor.
56 N 3 N s 57 N 3 N E Reduced number of options in each choice.
58 M 3 M E Modified 0 and choices to ensure key answer correct under all conditions.
Page 3
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 59 N 3 N E Minor change to distractors to improve plausibility.
60 N 2 N E Reselected KIA and replaced Q at CE discretion to increase LOD.
61 B 3 x B u Non-credible distractors. Rewrote the Q.
B B E Added proc reference to stem and modified given conditions to 62 3 improve tie between conditions and the question.
63 B 3 B E Modified Q and choices to improve discriminatory value.
64 N 3 N s 65 N 2 N E Wrote a new Q at CE discretion to raise LOD.
66 M 3 M s B B E Added qualifying information to stem to ensure only one correct 67 3 answer.
68 N 3 N E Reworded to improve credibility of choices.
69 M 3 M E Reworded to ensure Q is not cueing.
70 B 3 B 71 B 3 B 72 N 3 N 73 B 3 B 74 N 3 N 75 B 3 B 76 N 3 N E Added qualifier statement to stem.
77 N 3 N E Modified Q and distractors to improve discriminatory value.
78 B 3 B s 79 N 3 N s Page4
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD 0# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- O= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 80 M 3 M E Minor modifications to enhance plausibility of distractors.
81 B 3 B s N 3 N E Modified stem and choices to ensure key answer accuracy and 82 improve discriminatory value.
83 M 3 M E Minor stem changes for clarity.
84 M 3 M s M 3 M E Added stem information and changed key answer to improve 85 distractor plausibility.
86 N 3 N s 87 N 3 N E Minor stem changes for clarity.
88 N 3 N E Revised to clarify stem and improve distractors.
89 N 3 N E Minor stem and choice changes to improve clarity.
90 N 3 N E Reworded to improve structure and discriminatory value.
M 3 M E 2011 NRC Exam 093 (modified). Modified to enhance distractor 91 plausibility.
92 N 3 x N u Modified to ensure 0 is SRO-only.
93 N 3 N E Deleted unnecessary stem statement to prevent confusion.
94 N 3 N E Minor wording changes to better align 0 to reference materials.
95 B 3 B s 96 B 2 B s 97 N 3 N E Modified to improve distractors and clarify 0.
98 B 3 B s 2012 NRC 098 99 B 3 B E Replaced with better 0 at CE discretion.
Page 5
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 100 B 3 B E Modified stem to improve plausibility of distractors.
Page 6
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 1 B 3 B s 2 M 3 x M u Non-discriminating distractors. Potential for no correct answer. Revised Q.
3 B 3 B s N 3 N E Removed some information from stem to ensure no cueing and improve 4
distractor plausibility.
5 N 3 N E Minor stem modification to ensure validity of key answer.
6 N 3 x N u 2 implausible distractors. Q rewritten.
7 N 3 N E Replaced one distractor.
8 B 3 B s 9 N 3 x N u Non-credible. Rewrote Q.
10 N 3 N s 11 N 2 N s B 3 B E Modified stem to improve distractor plausibility and to address 12 inconsistent given data.
13 N 3 N E Minor changes to improve discriminatory value.
14 N 3 N s 15 N 3 N E Minor stem structural change to improve distractor plausibility.
16 N 3 N E Replaced an implausible distractor. Minor stem changes.
17 B 3 x B u Implausible distractors. Replaced Q.
Page 1
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 18 M 3 M E Minor stem wording change to ensure key answer validity.
19 B 3 B s 20 N 3 N E Fixed typo.
21 B 3 B E Reworded choices for improved symmetry.
22 N 3 N E Modified conditions to improve distractor plausibility.
23 N 3 N E Changed stem conditions to support distractor plausibility.
24 M 3 x M u Reselected KIA and replaced Q.
25 B 2 B s 26 M 3 M E Minor stem modification to better match key answer.
27 B 3 B E Minor punctuation change.
28 N 2 N s 29 N 2 N E Minor stem re-organization.
30 M 3 M s 31 B 3 B s 32 N 3 N s 33 B 3 B E Q replaced with a better Q at CE discretion.
34 N 3 N E Reworded Q to improve clarity.
35 B 3 B s 36 B 3 B s 37 B 3 B s 38 B 3 B s Page2
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO 0# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- O= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 39 N 3 N s 40 M 3 M E Minor changes to improve discriminatory value.
41 N 3 N s 42 M 1 x M u LOD=1, KIA mismatch. Reselected KIA and replaced 0.
43 B 3 B s 44 N 3 N E Minor stem change.
45 N 3 N E Modified stem and distractors to improve discriminatory value.
46 N 3 N E Good 0. Changed KIA at CE discretion to better match tested information.
47 B 3 x B u 2 non-credible distractors. Revised 0.
48 N 3 N E Modified 0 and distractors to improve discriminatory value.
49 N 3 N s 50 N 3 N s 51 B 3 B E Moved common language from choices into stem.
52 B 3 B s 2011 NRG Exam 053.
53 B 3 B s 2012 NRG Exam 053.
54 N 3 N s 55 N 3 N E Changed 1 implausible distractor.
56 N 3 N s 57 N 3 N E Reduced number of options in each choice.
58 M 3 M E Modified 0 and choices to ensure key answer correct under all conditions.
Page 3
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 59 N 3 N E Minor change to distractors to improve plausibility.
60 N 2 N E Reselected KIA and replaced Q at CE discretion to increase LOD.
61 B 3 x B u Non-credible distractors. Rewrote the Q.
B B E Added proc reference to stem and modified given conditions to 62 3 improve tie between conditions and the question.
63 B 3 B E Modified Q and choices to improve discriminatory value.
64 N 3 N s 65 N 2 N E Wrote a new Q at CE discretion to raise LOD.
66 M 3 M s B B E Added qualifying information to stem to ensure only one correct 67 3 answer.
68 N 3 N E Reworded to improve credibility of choices.
69 M 3 M E Reworded to ensure Q is not cueing.
70 B 3 B 71 B 3 B 72 N 3 N 73 B 3 B 74 N 3 N 75 B 3 B 76 N 3 N E Added qualifier statement to stem.
77 N 3 N E Modified Q and distractors to improve discriminatory value.
78 B 3 B s 79 N 3 N s Page4
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD 0# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- O= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 80 M 3 M E Minor modifications to enhance plausibility of distractors.
81 B 3 B s N 3 N E Modified stem and choices to ensure key answer accuracy and 82 improve discriminatory value.
83 M 3 M E Minor stem changes for clarity.
84 M 3 M s M 3 M E Added stem information and changed key answer to improve 85 distractor plausibility.
86 N 3 N s 87 N 3 N E Minor stem changes for clarity.
88 N 3 N E Revised to clarify stem and improve distractors.
89 N 3 N E Minor stem and choice changes to improve clarity.
90 N 3 N E Reworded to improve structure and discriminatory value.
M 3 M E 2011 NRC Exam 093 (modified). Modified to enhance distractor 91 plausibility.
92 N 3 x N u Modified to ensure 0 is SRO-only.
93 N 3 N E Deleted unnecessary stem statement to prevent confusion.
94 N 3 N E Minor wording changes to better align 0 to reference materials.
95 B 3 B s 96 B 2 B s 97 N 3 N E Modified to improve distractors and clarify 0.
98 B 3 B s 2012 NRC 098 99 B 3 B E Replaced with better 0 at CE discretion.
Page 5
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 100 B 3 B E Modified stem to improve plausibility of distractors.
Page 6