ML041470492
| ML041470492 | |
| Person / Time | |
|---|---|
| Site: | Prairie Island  |
| Issue date: | 04/23/2004 |
| From: | Lanksbury R NRC/RGN-III/DRS/OLB |
| To: | Nuclear Management Co |
| Shared Package | |
| ML041280237 | List: |
| References | |
| 50-282/04-301, 50-306/04-301 | |
| Download: ML041470492 (9) | |
Text
ES-401-9 FOR THE NRC COMMENTS ON THE WRITTEN EXAM FOR THE PRAIRIE ISLAND RETAKE EXAMINATION - APR 2004
ES-401 Written Examination Form ES-401-9 Review Worksheet Prairie Island April 2004 Exam The first 20 RO questions and first 10 SRO questions were selected for the initial review. All questions were reviewed.
S S
S
- 7.
Explanation New.
New.
Modified. Not memory, higher skill required. Agree - changed cog level.
New.
New.
1 New.
Modified. Not a memory question :requires analysis. Disagree left as is.
1 No ana/ysis required, on/y recognition of conditions.
New
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
- 2.
- 3.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information)
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated truelfalse statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (Le., the question has a valid KIA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 4.
- 5.
6 Check questions that are sampled for conformance with the approved WA and those that are desiclnated SRO-only (KIA and license level mismatches are unacceptable).
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
v ) w W
v ) w V
N x
I -4 x
1 Ix N
plp:
- 1. I 2. 1 3i Psychometric LOK LOD
- FIH)
(1-5)
Stem Cues Focus Flaws
- 4. Job Content Flaws
- 5. Other I 6.
- 7.
3ack- -
TIF -
>red.
Dist. -
X 7
Job-
-ink -
X Explanation New. Distractor D not plausible. RO Knowledge? Per training -
required RO knowledge. Distractor d. replaced.
GE E
E E
S S
E S
S S
E S
E E
X -
X New.
evacuation on a failed LOW rad monitor). Changed distractor c.
Distractor C is NOT plausible (to require SFP area Bank.
Distractor D is NOT plausible, since it is hard to believe that the design would limit charging pump speed to minimum. Change to:
"Controlled from the Train B Hot Shutdown Panel." Changedper suggestion.
New.
ensure that the question is referring to the RHR alignment of Attachment D of IES-1.1.
Small Break LOCA in IES-1.1, one train of RHR is to aligned for shutdown cooling while leaving the other train of RHR aligned for injection. Which RHR train is aligned for shutdown cooling and why?
Change the stem to get rid of lof 2 taken 2x. Changedstem.
In the question stem, change the wording as shown below to Change the stem to: "When responding to a Unit 1 New.
New.
Bank.
is incorrect. Changed distractor d. to ensure incorrect.
Make distractor d and c look the same. Ensure distractor d.
Modified.
New.
New.
New. Attempt to add a procedure use to complete the WA. All disfractors lead to the same procedure - no value to add, left question as is.
X -
X -
X New.
Bank.
concentration decrease with RCS water going to containment).
Reworded distractor c.
Bank.
flow trip is specific to a certain type of event (i.e., RCP trip). Replace with: "Pressurizer high pressure." [only correct answer has power in it]
Fixed per comment.
Distractor C is NOT plausible (to have containment hydrogen Distractor A is NOT plausible, since the single loop RCS low
W W
W W
3 X
X I
X X
X m
m Y
L L
0 0
3 m
N I
L I
I 3
t B
I I
I
r-'
I
=
t f
I
~
- 3. Psychometric Flaws
- 5. Other 16.
- 4. Job Content Flaws
- 7.
TIF Stem
-0cus -
Back.
ward -
- I mits Link I X
Cred Dist -
Explanation Bank.
New. Distractor D is not plausible. Consider changing the 2nd part of the distractor to: allow power to decrease to avoid using control rods.
Agree - distractor replaced.
Bank.
Distractor B could also be considered incorrect, since the time clock should start at the time it is recognized that the valve will NO1 stroke closed (NOT when the Shift Supervisor is informed, which may bc 5 minutes later). This is not a good way to present this information to the applicant. They may think B is correct after the exam, not realizing the notification to the SS was immediate. Is this RO required knowledge? Station agrees possible negative training, but question was not unsat as wnffen per their procedure. Question reworked to eliminate negative training.
Modified. In the question stem, change the word should to is required to. Capitalize START & CLOSE in the distractors. Agree -
modifications made to question.
Bank.
3ank.
Uew.
Distractor C is NOT plausible, since it implies that there is 3ank.
VO purpose for the Power Range Trip - Low Setpoint (if this trip always Iecomes blocked when needed). Agree - distractor c. reworked.
3ank.
Uew.
qew.
- 1) In the question stem, delete the word slowly from the
- ondition RCS pressure is 850 psig and slowly decreasing, since RCS Iressure may decrease faster than slowly with a PZR PORV open even with the RCS saturated). Agree - modified per suggestion.
dew.
o 10,000 gallons of water in the CST. Not a MEMORY question or a kequence of TIF statements if stem not needed. Agree not a memory iuestion. Did not change to IO, 000 gallons based on feedback from iuestion validators. Examiner agrees.
dew.
mter from C15 to E-4. Agree - made change to distractor b.
sank.
To make distractor B more plausible, change 20,000 gallons To make distractor B more plausible, change the procedure to S
E UE E
S S
S E
S x
s X
E x
u X
E x
s H
F F
3 2
3 -
H -
F F -
2 -
2 2 -
H 3
F 2
H -
F -
3 -
2
- 3. Psychometric Flaws I
- 4. Job Content Flaws
- 7.
- 5. Other 3#
81 82 83 84 85 86 87 88 89 -
90 -
91 -
'OCUS I X
- I Back-inits I ward Explanation Link New.
"Which SG(s) is (are) preferred for cooldown and why?".
distractors B and D, delete the phrase: "should be used" and add a comma instead. Agree - fixed per suggestion.
- 1) In the question, delete the word "should" and reword to:
- 2) In H
H F
New. 1) Add the following condition to the stem: "All safeguards equipment is operable." 2) Change distractor A to have Sump B level at 50% instead of 10%. Stem change made. Leff distractor A, sump level problems are from a seldom used procedure not required to be memorized. Left at 70%.
New.
make the distractors more plausible:
- Rod C7 at 208 steps
- RodG11 at218steps
- Bank demand at 180 steps Agree. Modified per suggestions.
In the question stem, change the conditions to the following to
~
~
~~
~
Modified. Not a memoty question. Station agrees, Reclassified.
H H
H 3
2 3
X X -
New.
New.
X New.
( Le., "12 SG level is 53% WR and lowering'). Agree - question modified In the question stem, add the words "level is" after "12 S G H
H -
2 3 -
X X -
X -
X -
New.
New.
2ECA-0.1 has just occurred with RCS pressure at 2005 psig and lowering slowly. Based on this, the crew would start a Charging Pump in step 4 of 2ECA-0.1 which could increase PZR level (and thus also cause RCS pressure to stabilize or increase). If RCS pressure is stable or increasing, the crew would NOT enter step 9 (RNO) for RCS pressure decreasing, and then block automatic SI, manually actuate Containment Isolation, and go to 2ECA-0.2. Thus distractor A may NOT be correct.
- 2) Delete the word "immediately" in distractor B. 3) In the question stem change the given RCS pressure from 2005 psig to 1950 psig to agree with the RCS pressure at which SI is normally blocked. Agree.
Changes made to question New. 1) Typo in stem: "occured should be occurred. 2) In distractor D delete the words "should be made." Agreed. Changes incorporated.
New.
( Le., Emergency Diesel Generator). Agreed. Description added.
- 1) In the question stem, it is stated that the transition to
- 1) In the question stem, give a description of what "DI" is H -
H 2 -
3 -
It I
I I
- 7.
Explanation New. Not a memory question Station disagrees - only recognition is required. Examiner agrees. Left as memoty level.
New.
service with RCS pressure at 1725 psig ). Agree. - Distractor reolaced.
Distractor C is NOT plausible ( to place the RHR system in New.
current power). Change distractor D. 2) Distractor C could also be considered correct. Not a memoty question. Agree - question rewritten.
Modified.
Distractor D is NOT plausible ( i.e., that a deviation from the EOPs is NOT allowed under any conditions). Disagreed. Based on comment from regional administrator. Acceptable as written.
Bank.
- 1) Distractors B and D are basically the same (Le., maintain New. Not a memory question Agreed - reclassified.
Modified.