ML041030309
| ML041030309 | |
| Person / Time | |
|---|---|
| Site: | Grand Gulf  |
| Issue date: | 09/16/2003 |
| From: | NRC Region 4 |
| To: | Entergy Nuclear Operations |
| References | |
| 50-416/04-301 50-416/04-301 | |
| Download: ML041030309 (8) | |
Text
ES-401 GG 2/2004 Written Examination Form ES-401-9 (R8, S1)
Review Worksheet Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
H 3
S 2
H 2
X U
C also correct; Change A and C to say SRVs remain closed throughout transient.
Corrected 3
H 3
X X
X U
Does not match K/A; Stem does not clearly indicate that RCIC isolation conditions are met, which makes C a possible correct answer; add phrase peaked at 285 degrees F 5 minutes into the accident to clarify that Tunnel Temp. has been >180 for >30 min. K/A relates to condition 4
H 2
S 5
H 2
E Change C from...rise; however Drywell... to read...rise. Drywell... EDITED 6
F 2
X U
Distractors B and D are too similar and neither A, B or D seem very credible. EDITED 7
H 2
E Two out of the four photos provided are too blurry. REPLACED PHOTO 8
F 3
S 9
F 2
S 10 F
2 S
11 F
2 E
Change stem from...Feedwater on Startup Level... to...Feedwater with Startup Level...
EDITED 12 H
3 S
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
More than one distractor is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 13 H
3 S
14 F
2 S
15 H
4 E
Change the stem from...following identifies adequate core cooling? to...following identifies the state of core cooling? EDITED 16 H
3 X
U Does not match K/A; attachment 1 of 05-1-02-II-1 was not provided with key. OK-/ATT Provided 17 F
3 X
X U
Does not match K/A; distractors C and D are not plausible (they do not address the question).
REVISED 18 F
2 S
19 H
3 S
20 H
3 S
21 F
2 S
22 H
3 E
Change distractor A from Close two the four... to Close two of the four... EDITED 23 H
3 X
U Distractors B and C are not mutually exclusive. REVISED 24 H
3 S
25 F
3 S
26 H
3 X
X U
Does not match K/A; dont understand the justification for C as correct answer; NA Different Conds.
27 H
3 E
Missing punctuation at end of first stem sentence; EDITED 28 F
3 E
Change A to read All ADS valves... and change B to read All ADS valves and All Low-Low Set valves for consistency EDITED 29 H
3 E
distractor A is not credible; EDITED 30 F
3 S
31 H
3 X
E Change stem to Control rod 20-05 is at position 24 and the Auxiliary Building Operator has reported its associated accumulator pressure is... EDITED 32 H
2 E
Change stem to Which one of the following is true regarding RPV level indication?; change true to reliable in B and C; change D to There are no reliable level indications under these conditions EDITED 33 H
3 S
34 H
3 E
Change - to : in stem for existing conditions; EDITED
ES-401 2
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 35 F
3 X
U Does not match K/A EDITED 36 F
2 S
37 H
2 S
38 F
3 S
39 H
3 E
Change stem to...following describes the movement of control rods...; change distractor A to
...constraints of the Rod Pattern Controller; as long as... EDITED 40 H
3 S
41 F
3 S
42 F
3 X
U Can which is most probable have only one correct answer? Changed Stem 43 F
3 S
44 F
2 S
45 F
2 S
46 H
4 S
47 F
3 X
X U
Does not match K/A; answers are not mutually exclusive. Corrected 48 F
2 X
U Answers are not mutually exclusive (B and D are inclusive). Corrected 49 F
2 X
U Answer D includes answers A and B. Corrected 50 F
3 S
51 F
2 S
52 H
3 X
U The stem states that the valve is open, and the correct answer states that the valve is closed -
doesnt make sense. Corrected 53 H
3 X
E Answer D sounds like nonsense (Main Steam Bypass Control Valves?) Corrected 54 H
3 S
55 F
3 X
X U
Does not match K/A; answers B and C are not mutually exclusive. Corrected 56 F
4 E
All distractors are too long - should be limited to a couple of breakers each EDITED 57 H
3 X
X U
Dont use best actions in stem. EDITED
ES-401 2
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 58 F
3 X
U Does not match K/A; Corrected 59 H
3 S
60 H
3 S
61 H
3 S
62 F
3 X
U Does not match K/A; this is the 3rd RWCU system leak resulting in room high temperatures type question on this exam - too much? EDITED 63 F
2 X
U Answers A, B, and D are not credible.
64 F
2 X
U Does not match K/A; EDITED Chgd answer 65 F
3 X
U Dont use most likely in stem question. EDITED 66 F
3 X
U Why isnt B also correct? EDITED 67 H
3 E
Question sheet lists K/A 234000 for this question, which is not correct per the sample plan.
Changed 68 F
3 S
69 H
3 X
U Answers are not mutually exclusive. Changed 70 F
2 S
71 F
2 S
72 F
2 S
73 F
3 S
74 H
3 X
U dont use probable cause in stem question. EDITED 75 F
3 S
76 H
2 S
77 H
1 U
according to stem, TS 3.5.2 is supposed to be provided, but not included with key; consider not providing TS 3.5.1, otherwise question is too easy. EDITED 78 H
3 S
79 H
3 S
80 H
2 E
change stem from...Permits would allow a liquid... to...Permits would properly allow a liquid...
EDITED
ES-401 2
Form ES-401-9 (R8, S1)
Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
U/E/S 7.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 81 H
2 X
U Do not provide Bases 3.5.2 - it cues the answer. EDITED 82 H
2 X
U Do not provide Bases 3.5.1 or TS 3.0 or SR 3.0 - it cues the answer. EDITED 83 F
1 U
Just too easy. Ok 84 F
3 S
85 F
2 S
86 H
3 S
87 F
1 X
X U
Does not match K/A; this is not an SRO-only question. Replaced 88 H
3 S
89 H
3 X
U Answer C cues itself as correct answer EDITED 90 H
2 S
91 H
3 X
U Do not provide TS Bases - too much info. EDITED 92 H
3 S
93 F
2 X
X U
Does not match K/A; answer C is cued by stem EDITED 94 H
3 E
Remove the phrase No actions required from A and B; change A to The General Operations RWP is sufficient with no other requirements EDITED 95 H
3 S
96 F
3 E
Change stem to...normal complement of licensed operators: 3 SROs... EDITED 97 F
2 S
98 H
3 E
Change stem to A fire in the Turbine Building resulted in a loss of power...; EDITED 99 H
2 E
Change A to...this task under current RWPs with no additional monitoring required.; change B to...technician can provide the required radiological...; change C to...prior to performing this task, with no additional monitoring required. EDITED 100 F
2 S