ML19346E372
| ML19346E372 | |
| Person / Time | |
|---|---|
| Site: | Hope Creek  |
| Issue date: | 08/12/2019 |
| From: | NRC Region 1 |
| To: | Public Service Enterprise Group |
| Shared Package | |
| ML19007A361 | List: |
| References | |
| EPID L-2019-OLL-0016 | |
| Download: ML19346E372 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only With provided reference the question is a direct lookup. Also 1
F 1
N u
makes it fundamental instead of listed higher cog. Replaced with bank Question.
2 F
3 N
s 3
H 2
B s
4 F
3 N
s 5
F 2
B s
6 F
3 N
s 7
H 2
N s
B is a second correct answer. Per AB.BOP-006 these are the 8
H 3
X N
u actions. Stem needs to be more specific. Asks what actions are required. B is partially correct and the stem says you entered BOP-6. Chanqed B to be incorrect.
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3.
Check the appropriate box if a psychometric flaw is identified:
"Stem Focus": The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
"Cues": The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
"T/F": The answer choices are a collection of unrelated true/false statements.
"Cred. Dist.": The distr.actors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.
"Partial": One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).
- 4.
Check the appropriate box if a job content fiaw is identified:
"Job Link": The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
"Minutia": The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
#/Units": The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
"Backward": The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved.KIA and those KIAs that are designated "SRO-only." (KIA and license-level mismatches are unacceptable.)
- 6.
Enter question's source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.
- 7.
Based on the reviewer's judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any "U" status ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only Backward logic. Forward would be to give conditions and say the operator opens F031 b, What happens. Also we say things are not 9
H 3
X M
E out of position, so distractors A and b ;,ire assuming that the valves are out of position and then they are closed. Distractor says incorrect because already closed. Trying to trick the person instead of testing knowledge... Changed question to be forward logic. Asked what happens when B recirc valve is opened.
10 F
2 B
s 11 H
2 B
s 12 H
3 B
s 13 H
3 X
N u
B correct as written. Changed b distractor to be incorrect.
This is a SRO only question. RO doesn't need to know the 14 H
4 B
u procedure in this detail. Also A and care not plausible if the curve has safe and unsafe marked. Can easily look at curve and determine can't sorav. Reolaced with a bank auestion.
15 F
4 N
s 16 H
3 B
s D is partially correct. In the explanation for why C is correct it states that high water level may cause a trip of the turbine 17 F
4 X
B E
and a trip of rpv injection systems. It further states if they trip the transient may require ED and operation of less desirable rpv injection sources. Changed C to agree with bases.
Chanaed d to be incorrect.
18 F
3 B
s B. C, D not plausible. Not plausible that on a spurious hpci 19 H
2 X
B u
start I am going to keep it running. Replaced with a bank auestion.
20 H
3 M
s 21 F
3 N
s
ES-401 3
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOO Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only A is not plausible. Nothing in stem says inerting. At 100%
22 H
3 X
B E
power may be adding nitrogen, but not inerting. Changed a to lock the mode switch to shutdown.
23 F
3 8
s 24 H
2 N
s 25 H
3 N
s 26 H
3 8
s 27 H
3 8
s 28 H
2 8
s 29 H
2 8
s 30 F
3 8
s 31 F
3 N
s B answer description says shutoff head is 380 psig. Stem says at 300 psig. Check what flow would be at 300 psig. The 32 F
3 8
E answers all sound like design flow for a dba loca i.e. 0 psig.
Changed answers to pump combinations running instead of flows.
33 H
2 8
s 34 F
2 8
s 35 H
3 N
s 36 F
3 8
s 37 F
3 8
s
ES-401 4
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 38 F
2 B
s 39 H
4 N
s 40 H
3 B
s
/
41 F
2 B
s 42 F
3 B
E D, add the word only to the end of the sentence. Made change.
43 H
3 B
s 44 F
3 B
s 45 H
2 B
E No explanation for b and c incorrect or plausibility. Added statement for why incorrect.
KA Mismatch. Q does not test knowledge of loss or 46 H
3 X
B u
malfunction of SGTS. Randomly selected new ka same system. Reolaced with a bank question.
All answers have 2 parts but question only asks what A RHR 47 H
2 B
E is powered from.. Add a second part to question to ask second oar!. Added second oart.
48 F
2 N
s 49 H
3 B
s 50 H
3 N
s 51 H
3 B
s 52 H
3 N
s 53 F
3 B
s 54 F
2 B
s
ES-401 5
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOO Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 55 H
3 B
s B answer description about why correct states failure of the 56 F
3 B
E pipe does not compromise the ability to have two thirds core coverage. Reword to clarify that it does effect core coverage.
Used suaaested fix.
57 H
3 B
s 58 H
3 N
s 59 F
3 B
s 60 H
3 N
s 61 H
3 B
s 62 H
3 B
s 63 H
3 B
s 64 H
3 B
s 65 H
3 B
s 66 H
3 B
s 67 F
2 X
B E
The question states The desired plant lineup requires... "
Need to define what plant lineup. Added at 100% power.
68 F
2 B
s 69 F
3 B
s 70 F
2 B
s
ES-401 6
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only KA Mismatch. MSL rad monitors are a separate system in ka 71 F
2 B
u catalogue. This is a tier 3 ka is talking about use of rad monitors. Replaced with bank.
72 F
3 N
s 73 F
3 B
s 74 F
2 B
s 75 F
3 B
s 76 H
3 N
s Not SRO only. Can answer purely with system knowledge.
77 H
3 B
u MSIV's close and CRD valves fail closed. Can't use crd or condenser. Changed all answers to make SRO knowledae.
78 H
2 X
N E
Need to say in stem assuming heat up rate remains constant.
Fixed.
Stem says at 100% power. Also says irradiated fuel is being 79 F
3 X
B E
moved into the fuel pool. Where did this fuel come from? Do you mean fuel is being moved in the fuel pool? Used suaaested fix.
80 H
2 M
s 81 F
2 B
s 82 H
3 M
s KA mismatch. Does not test the ability to detenmine reactor 83 H
2 X
B u
power as it applies to high pressure. Replaced with a bank auestion.
84 H
2 X
B E
C not plausible. Why would I open turbine bypass valves when controlling with SRV's. changed C to srvs.
85 H
3 X
B E
B is partially correct. It is a subset of C. changed B distractor.
86 H
2 B
s
ES-401 7
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOO Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 87 H
3 B
s 88 H
3 M
s 89 H
3 B
s 90 H
3 B
s 91 H
3 B
s 92 H
3 B
s 93 H
2 B
s 94 F
2 B
s 95 F
3 B
s 96 F
2 B
s 97 F
3 M
s 98 H
3 B
s 99 F
2 B
s 100 F
2 B
s