ML102670391
| ML102670391 | |
| Person / Time | |
|---|---|
| Site: | Calvert Cliffs  |
| Issue date: | 05/18/2010 |
| From: | Peter Presby Operations Branch I |
| To: | Mark Draxton Constellation Energy Nuclear Group |
| Hansell S | |
| Shared Package | |
| ML100560028 | List: |
| References | |
| TAC U01770 | |
| Download: ML102670391 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401*9
- 8.
Q# I LOK I LOD I Explanation I I I F
I 2.0 I I
I I
I I
I I
B E
Modified answer choices to raise level of difficulty.
2 I F
I I
I I
I X I I
I I
I I
I I N U
Implausible distracters. Modified stem and replaced two distracters.
3 I F
I I
I I
I I
I I
I I
I I
I B E
Took out extraneous stem information.
4 I H I I
I I
I I
I I
I I
I I
I B E
Added plant status information to stem. Modified answers.
5 I H I 1.8 I I
I I
I I
I I
I I
I I B U
LDD < 2, replaced with another bank question.
6 F
B E
Minor modifications to choices.
7 H
B S
Minor choice wording changes.
8 H
B E
Changed parts of each choice to improve plausibility of distracters.
I I
I I
I I
I I
,I 9 I H I
I I
I I
I I
I I
I I
I B E
I Modified stem wording.
Modified stem 0 reqUire analysis of conditions. Reworded correct 10 I F
I I
I I
I I
I I
I I
I I
I B E
answer. Question now higher order.
11 I H I
I I
I I
I I
I I
I I X I N I N U
KIA mismatch. Replaced with bank question.
12 I H I I
I I
I X I I
I I
I I
I I M U
2 implausible distracters. Modified all answer choices.
13 I H I I
I I
I I
I I
I I
I I
I M
S 14 F I 2 I I I I X I I I I I I I I B E
11 implausible distractor. LOD = 2. Wrote new question.
I I
I I
I I
I I
I I
I I
I F
I 15 16 H
I I
I I
I I
I I
I I
I I
I N
S Minor stem modification.
B S
Reworded question and answer choices for readability.
B B
S M
U 13 Imp'o""bI. ",bact"". Modffied "em ood "'0'. Now LOK-H.
I I
Page 1
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 22 F
X B
U 3 implausible distracters. Modified stem and choices.
23 F
B S
24 H
X B
U 3 implausible distracters. Modified question and answer choices.
25 H
M E
Modified choices to ensure they are mutually exclusive.
26 H
1.5 B
U LOD=1.5. Modified stem and choices. Now a modified question.
27 H
B E
Added information to stem to improve dlstractor plausibility.
28 F
B S
29 F
B E
Rewrote choices to improve plausibility.
30 F
X N
E 1 implausible distractor. Modified stem and choices. Changed to LOK=H.
31 H
B S
Minor stem modification.
32 F
X B
E 1 implausible distractor. Modified distracters.
33 F
X N
E 1 implausible distractor. Modified distracters.
34 F
X N
N U
KIA mismatch. Revised question. Changed to LOK=H.
35 F
N E
Weak distracters. Modified question. Changed to LOK=H.
36 F
N N
E Reworded stem to enhance tie to KIA.
37 H
X N
E 1 implausible distractor. Replaced distractor. Minor stem changes.
38 H
B S
Minor choice wording changes.
39 F
X N
E 1 implausible distractor. Replaced distractor.
40 F
X B
E 1 implausible distractor. Replaced distractor. Minor choice changes.
41 H
X B
U 2 implausible distracters. Replaced question with modified bank.
42 H
N S
Page 2
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LaD Q#
(FtH)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- t Back-Q=
SRO B/M/N UlEtS Explanation Focus Dist.
Link units ward KIA Only 43 H
M S
44 F
X N
E 1 implausible distractor. Replaced distractor. Reworded choices.
45 H
X N
N U
KIA mismatch. Modified question and answer choices.
46 H
X N
B E
1 implausible distractor. Modified question and one distractor.
47 H
N S
48 F
X N
N U
Poor KIA match, low operational validity. Reselected KIA and wrote new question.
49 H
B E
Reworded question to clarify.
50 F
N E
Minor wording changes.
51 F
X M
U 2 implausible distractors. Replaced with new question.
52 F
X X
N U
2 implausible distracters. Rewrote question and choices. LOK=H.
53 F
X N
B U
KIA mismatch. Modified question to match KIA.
54 F
B E
Minor wording changes.
55 H
N S
56 H
B S
57 F
X M
E 1 implausible distractor. Modified question and distracters.
58 H
N S
Minor wording changes.
59 F
X N
M U
KIA mismatch. Replaced with new, higher order question.
60 H
X N
E 1 implausible distractor. Replaced distractor. Minor wording chgs.
61 F
1.9 M
U LaD < 2. Reselected KIA. Replaced with bank question.
62 F
X B
U 2 correct answers. Rewrote one distractor. Other minor chgs.
63 F
X N
U Not operationally valid. Reworded the question and 2 distractors.
Page 3
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N utE/S Explanation Focus Oist.
Link units ward KIA Only 64 F
X B
U 2, possibly 3 correct answers. Resampled and replaced w/bank.
65 F
X N
B U
KIA mismatch. Wrote new question. LOK=H.
66 F
X B
U SRO only. Replaced with new question.
67 F
1.9 B
U LOO<2. Reselected KIA. Replaced w/bank question. LOK=H.
68 H
B E
Changed some numbers in stem to enhance distractor plausibility.
69 F
B E
1 implausible distractor. Rewrote distracters. Minor stem change.
70 F
1.9 B
U LOO<2. Replaced w/bank. LOK=H.
71 H
B E
Restructured distracters to improve readability.
72 F
N E
Modified stem wording to improve distractor plausibility.
73 H
X B
U 3 implausible distracters. Reselected KIA and replaced w/bank.
74 F
X N
U 2 implausible distracters. Modified question and choices.
75 H
N B
U KIA mismatch. Replaced w/another bank question.
76 H
X N
E 1 implausible distractor. Modified distracters.
77 H
X B
E 1 implausible distractor. Modified stem to enhance plausibility.
78 H
B S
79 H
M S
Minor distractor modifications.
80 H
N E
Modified stem and distracters.
81 F
X N
N U
Not SRO only. KIA mismatch. Replaced question.
82 H
B E
Minor stem wording change.
83 H
N S
Minor stem change.
84 H
N S
85 H
Y Y
N B
U KIA mismatch. Reselected KIA. Replaced wlbank.
Page 4
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
- 8.
LOK LOD Q#
(F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q= SRO BIMIN U/E/S Explanation Focus Dist.
Link units ward KIA Only 86 F
N U
Not discriminating. Replaced wlbank. LOK=H.
87 F
N N
E Weak KIA match. Modified to better target KIA.
88 H
X N
N U
KIA mismatch. Replaced w/bank. LOK=F.
89 F
N U
2 flawed distractors. Referenced documents do not exist. Modified distracters.
90 H
X N
M U
KIA mismatch. Resampled, replaced w/new question.
91 F
N S
92 H
X N
E 1 implausible distractor. Replaced distractor.
93 H
B S
94 H
N S
95 H
N S
96 F
X B
E 1 implausible distractor. Modified distractor.
97 F
X N
E Minor enhancements.
98 H
N S
99 F
B S
100 F
B S
Page 5
Calvert Cliffs August 2010 Exam NRC Comments on Draft Licensee-Developed Operating Test Admin JPMs
- 1. RO A2 should have opscalc not available, such that calc must be done manually.
- 2. SRO A5. Not clear how to implement this time critical JPM. Typically time starts after applicant reads cue. Also, need to declare this as a time critical JPM on the applicant cue sheet.
Control Roomlln-plant JPMs
- 1. S3 shown as JPM 'd' on outline, S4 shown as JPM 'c' on outline. Recommend JPM numbering follow outline order.
- 2. Replace JPM 'dr. Similar to simulator scenario event.
- 3. Replace JPM 'j'. Would have to simulate cabinet actions without opening or viewing interior.
CCNPP 2010 LOI NRC Exam Scenario Changes Common to all:
- Shaded CT boxes
- Bolded actual critical steps
- Added conclusion steps to applicable events
- Added ERPIP calls
- Fixed typographical errors
- Added detail to Tech Spec calls
- 1
- Changed event 7 from Major to Component failure (needed to ensure bean count for SRO I 1,2,3,4)
- 2
- No major changes
- 3
- No major changes
- 4
- No major changes