ML030510290
| ML030510290 | |
| Person / Time | |
|---|---|
| Site: | Grand Gulf  |
| Issue date: | 08/23/2002 |
| From: | Gody A NRC Region 4 |
| To: | Eaton W Entergy Operations |
| References | |
| 50-416/02-301, ES-401-9 50-416/02-301 | |
| Download: ML030510290 (9) | |
Text
GRAND GULF WRITTEN EXAM, COMMON, AUGUST 2002 ES-401 Written Examination Form ES-401-9 (R8, S1)
Review Worksheet Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
S 2
S 3
X U
C not credible. Revised 4
S 43.5 Ref. not correct. Deleted 5
S 6
S 7
S 8
S 9
E Edit Stem. Revised 10 S
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needles The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
More than one distractor is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted b 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be k The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question i The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level 6.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhanc 7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 11 S
12 S
13 S
14 S
15 S
16 E
Is B credible? Yes it is.
17 S
18 S
19 S
20 U
DL with reference provided. Reference w 21 U
DL with reference provided. Not a DL.
22 S
23 S
24 S
25 S
26 S
27 S
28 S
29 S
30 S
ES-401 3
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 31 S
32 S
33 S
34 S
35 S
36 S
37 S
38 S
39 S
40 S
41 S
42 X
X U
B & D not credible. B & D Modified 43 S
44 S
45 E
Edit Stem. Stem modified 46 S
47 S
48 S
49 S
50 S
ES-401 4
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 51 S
52 S
53 S
54 S
55 S
56 S
57 S
58 S
59 S
60 S
61 S
62 S
63 S
64 S
65 S
66 S
67 S
68 S
69 S
70 S
ES-401 5
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 71 S
72 S
73 S
74 S
75 S
GRAND GULF INITIAL WRITTEN EXAM, RO ONLY, AUGUST 2002 ES-401 6
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H
)
2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/
S 7.
Explanat Ste m
Foc us Cu es T/F Cred Dist.
Parti al Jo b-Lin k
Minut ia
- /
unit s
Bac k-ward Q=
K/A SR O
Onl y
76 S
77 S
Edit as no 78 X
E Modify as noted. Modified 79 S
Edit as Noted.
80 S
81 U
Replace or modify. Modified 82 S
83 S
84 S
85 S
86 S
87 S
88 S
Edit as noted. Edited 89 S
90 S
91 S
Edit as noted. Edited 92 S
93 S
94 S
95 S
ES-401 7
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 96 S
97 S
98 S
99 S
100 S
GRAND GULF WRITTEN EXAM, SRO ONLY, AUGUST 2002 ES-401 8
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 76 S
77 S
78 S
79 S
80 S
Edit as noted. edited 81 S
82 S
83 S
84 S
Answer is not worded like ref. proc. Rev 85 S
86 S
87 S
88 S
89 S
90 S
( 91 S
92 S
93 S
94 S
95 S
ES-401 9
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanatio Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 96 E
Edit Distractors A & B as noted. Edited 97 E
Modify Stem as noted. Modified 98 E
Modify Distractors as noted. Modified 99 S
100 S