ML17069A417

From kanterella
Jump to navigation Jump to search
NRC Comments on Draft Licensee-Developed Written Exam (Folder 2)
ML17069A417
Person / Time
Site: Limerick  Constellation icon.png
Issue date: 01/16/2017
From: Peter Presby
Operations Branch I
To:
Exelon Generation Co
Shared Package
ML16076A445 List:
References
U01940
Download: ML17069A417 (5)


Text

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only Minor stem and choice rewording for clarification. Fixed answer 1 H 2.5 N E explanations. Fixed KIA number on pedigree page. Corrected source info on pedigree.

2 F 2.0 B u Modified stem to make 2"d correct answer wrong.

3 F 2.0 N E Deleted one column from the choices to improve Q structure.

4 F 2.0 B s H 3.0 N E Modified stem to improve distractor plausibility. Modified choice for 5

symmetry.

F 2.0 x B u Changed categorization to memory level. Modified stem to establish 6

credibility of distractors.

7 H 3.0 B E Modified stem and choices for clarity and credibility.

8 F 3.0 B E Minor stem modification to eliminate cueing.

9 H 3.0 M u Modified to eliminate two correct answers and to improve stem clarity.

H 2.0 B u Direct lookup with reference. Removed reference. Modified stem and 10 choices.

11 H 2.8 B s 12 H 3.0 x N u KIA mismatch. Replaced Q.

13 H 3.0 N s 14 F 3.0 B s H 2.0 N E Reworded stem and choices to better align choices with information 15 provided.

16 H 2.5 M E Minor stem and choice rewording to improve clarity.

17 F 3.0 M E Minor stem change to prevent cueing.

Page 1

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOO Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 18 H 3.0 B E Minor changes to improve clarity.

19 F 3.0 N E Minor stem clarification.

20 H 3.0 N E Minor re-ordering of stem information for clarity.

21 H 3.0 N E Typo and minor stem clarification.

22 F 3.0 B E Modified stem to raise discriminatory value.

23 F 3.0 N E Modified two distractors to improve plausibility.

24 F 3.0 N s 25 H 2.5 B E Modified stem to provide comparison basis for choices.

26 F 3.0 B E Modified stem slightly to improve clarity.

27 H 3.0 N s 28 H 4.0 B s 29 H 3.0 B s 30 H 2.5 B E Changed distractors to improve discriminatory value.

31 H 3.0 B s 32 F 2.0 B s 33 H 3.5 N E Re-wrote the Q to ensure less ambiguity in the choices.

34 F 3.0 N s 35 H 2.0 B s 36 H 4.0 N E Minor stem change to ensure no cueing.

37 H 3.5 N s 38 F 2.0 B s Page2

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 39 F 3.0 M s 40 H 3.0 N s 41 F 2.2 x B u Not sufficiently discriminating 42 H 2.0 B E Wording changes to clarify the information that is asked.

43 F 3.0 M E Added information to support distractor plausibility.

44 H 3.0 N E Modified stem and distractors to improve clarity 45 H 3.0 N E Minor edit 46 F 2.5 N E Minor edits 47 F 3.0 M s 48 H 2.0 B s 49 H 3.0 M E Minor stem modification to improve clarity 50 H 2.5 B s 51 F 2.0 B s 52 F 2.4 B s Used on 2015 NRC Exam.

53 F 2.0 x N u 2 non-credible distractors. Distractors modified.

54 F 3.0 B E Modified to remove cueing from stem and improve choices 55 F 3.5 N s 56 H 3.0 N E Minor changes to improve stem readability.

57 F 2.0 B s 58 F 3.0 N s 59 H 3.0 N s Page 3

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 60 H 3.0 M s 61 F 3.0 N E Modified stem for improved clarity.

62 F 3.0 B E Changed stem condition to improve distractor discriminatory value.

63 F 3.5 B s 64 H 3.0 N s 65 H 3.0 M s 66 F 3.0 x N u Replaced Q with one that appropriately tests the KIA knowledge 67 H 3.0 N u Replaced Q with one that appropriately tests the KIA knowledge 68 F 3.0 M E Minor rewording to improve clarity.

69 F 2.5 N s 70 F 2.5 B E Modified one implausible distractor 71 H 2.5 B E Minor wording change for clarity 72 F 3.0 B s Used on 2015 NRC Exam.

73 F 3.0 N s 74 F 3.0 B s 75 H 3.0 B E Minor stem wording change to ensure no overlap with another Q.

76 H 3.0 N E Modified to improve distractors 77 H 3.0 N s 78 H 4.0 N E Modified two distractors to improve plausibility.

79 H 3.0 N E 43.2. Modified distractors to ensure Q is SRO only.

80 H 3.0 N E Modified choices to improve discriminatory value.

81 H 3.0 N s Page4

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOO Q# (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 82 H 3.0 N E Modified Q to ensure SRO-only 83 F 3.0 x N u Modified Q to match KIA H 4.0 N E Modified Q to ensure technically accurate and to enhance 84 discriminatory value 85 H 4.0 B s 86 H 3.0 x N u Direct lookup. 2 non-credible distractors. Q and distractors modified.

87 H 3.0 N E Modified distractors to improve plausibility.

88 H 3.0 N E Modified Q to raise LOO and enhance distractor plausibility.

89 H 3.0 N E Minor modification to improve clarity 90 H 4.0 N s 91 H 3.0 M E Minor modification to ensure accuracy.

92 H 3.0 N s 93 H 3.0 N s 94 F 2.0 N E Modified stem and choices to improve plausibility of distractors.

95 H 3.0 M E Modified stem and choices to ensure no cueing.

96 H 3.0 x N u Non-credible distractors. Replaced the Q.

97 H 4.0 x M u Replaced Q to match the selected Tier 3 KIA.

98 H 3.0 x N u More than one correct answer. Question replaced.

99 H 2.0 B s 100 H 2.0 N E Minor editorial changes.

Page 5