ML041470492
| ML041470492 | |
| Person / Time | |
|---|---|
| Site: | Prairie Island  |
| Issue date: | 04/23/2004 |
| From: | Lanksbury R NRC/RGN-III/DRS/OLB |
| To: | Nuclear Management Co |
| Shared Package | |
| ML041280237 | List: |
| References | |
| 50-282/04-301, 50-306/04-301 | |
| Download: ML041470492 (9) | |
Text
ES-401-9 FOR THE NRC COMMENTS ON THE WRITTEN EXAM FOR THE PRAIRIE ISLAND RETAKE EXAMINATION - APR 2004
ES-401 Written Examination Form ES-401-9 Prairie Island April 2004 Exam Review Worksheet The first 20 RO questions and first 10 SRO questions were selected for the initial review. All questions were reviewed.
7.
Explanation New.
New.
Modified. Not memory, higher skill required. Agree - changed cog level.
- S New.
S New.
S 1 New.
Modified. Not a memory question :requires analysis. Disagree left as is.
1 No ana/ysis required, on/yrecognitionof conditions.
New
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. -
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information)
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated truelfalse statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements(Le., the question has a valid KIA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformancewith the approved WA and those that are desiclnated SRO-only (KIA and license level mismatches are unacceptable).
6 Based on the reviewersjudgment, is the question as written (U)nacceptable(requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
v ) w W v ) w x
I -4 x
1 Ix V N N plp:
1.
LOK
- FIH)
I 1 2.
LOD (1-5) 3i Psychometric Flaws Stem Cues TIF >red.
7 Job-
- 4. Job Content Flaws 3ack-
- 5. Other I 6. 7.
Explanation Focus -
Dist. -
-ink X X GE New. Distractor D not plausible. RO Knowledge? Per training -
required RO knowledge. Distractor d. replaced.
X E New. Distractor C is NOT plausible (to require SFP area
- evacuation on a failed LOW rad monitor). Changed distractor c.
X E Bank. Distractor D is NOT plausible, since it is hard to believe that the design would limit charging pump speed to minimum. Change to:
"Controlledfrom the Train B Hot Shutdown Panel." Changedper
- suggestion.
E New. In the question stem, change the wording as shown below to ensure that the question is referring to the RHR alignment of Attachment D of IES-1.1. Change the stem to: "When responding to a Unit 1 Small Break LOCA in IES-1.1, one train of RHR is to aligned for shutdown cooling while leaving the other train of RHR aligned for injection. Which RHR train is aligned for shutdown cooling and why?
Change the stem to get rid of l o f 2 taken 2x. Changedstem.
S New.
S New.
E Bank. Make distractor d and c look the same. Ensure distractor d.
is incorrect. Changed distractor d. to ensure incorrect.
S Modified.
S New.
S New.
E New. Attempt to add a procedure use to complete the WA. All disfractors lead to the same procedure - no value to add, left question as is.
- X S New.
X E Bank. Distractor C is NOT plausible (to have containment hydrogen concentration decrease with RCS water going to containment).
- Reworded distractor c.
X E Bank. Distractor A is NOT plausible, since the single loop RCS low flow trip is specific to a certain type of event (i.e., RCP trip). Replace with: "Pressurizer high pressure." [only correct answer has power in it]
Fixed per comment.
W W 3 W W X X I X X X I
m Y - N m I L L L I
B I 0 3
I 0
m I
3 t
r-'
tI f
I
=
~
- 3. Psychometric Flaws 4. Job Content Flaws
-- 5. Other 16. 7.
-Stem
-0cus TIF Cred Dist
- I Link
- I mits -
Back.
ward S Bank.
Explanation E New. Distractor D is not plausible. Consider changing the 2nd part of the distractor to: allow power to decrease to avoid using control rods.
Agree - distractor replaced.
X UE Bank. Distractor B could also be considered incorrect , since the time clock should start at the time it is recognized that the valve will NO1 stroke closed (NOT when the Shift Supervisor is informed, which may bc 5 minutes later). This is not a good way to present this information to the applicant. They may think B is correct after the exam, not realizing the notification to the SS was immediate. Is this RO required knowledge? Station agrees possible negative training, but question was not unsat as wnffen per their procedure. Question reworked to eliminate negative training.
E Modified. In the question stem, change the word should to is required to. Capitalize START & CLOSE in the distractors. Agree -
modifications made to question.
H 3 S Bank.
F 2 S 3ank.
F 3 S Uew.
H 2 E 3ank. Distractor C is NOT plausible, since it implies that there is VO purpose for the Power Range Trip Low Setpoint (if this trip always
-- Iecomes blocked when needed). Agree - distractor c. reworked.
F 2 S 3ank.
F 2 x s Uew.
H 3 X E qew. 1) In the question stem, delete the word slowly from the
- ondition RCS pressure is 850 psig and slowly decreasing, since RCS Iressure may decrease faster than slowly with a PZR PORV open even with the RCS saturated). Agree - modified per suggestion.
F 2 x u dew. To make distractor B more plausible, change 20,000 gallons o 10,000 gallons of water in the CST. Not a MEMORY question or a kequence of TIF statements if stem not needed. Agree not a memory iuestion. Did not change to IO, 000 gallons based on feedback from iuestion validators. Examiner agrees.
H 3 X E dew. To make distractor B more plausible, change the procedure to mter from C15 to E-4. Agree - made change to distractor b.
F
- 2 x s sank.
- 3. Psychometric Flaws I 4. Job Content Flaws 5. Other 7.
3#
81 I
'OCUS Link I#I Back-inits ward New.
Explanation
- 1) In the question, delete the word "should" and reword to:
"Which SG(s) is (are) preferred for cooldown and why?". 2) In distractors B and D, delete the phrase: "should be used" and add a comma instead. Agree fixed per suggestion.
82 H New. 1) Add the following condition to the stem: "All safeguards equipment is operable." 2) Change distractor A to have Sump B level at 50% instead of 10%. Stem change made. Leff distractorA, sump level problems are from a seldom used procedure not required to be memorized. Left at 70%.
83 H New. In the question stem, change the conditions to the following to make the distractors more plausible:
- Rod C7 at 208 steps
- RodG11 at218steps
- Bank demand at 180 steps Agree. Modifiedper suggestions.
-- ~ ~~ ~ ~
Modified. Not a memoty question. Station agrees, Reclassified.
84 F 85 H 3 X New.
X New.
86
- H 2
87 H 3 X New. In the question stem, add the words "level is" after "12 S G
( Le., "12 SG level is 53% WR and lowering'). Agree question modified 88 H 2
X New.
89 H 3 X X New. 1) In the question stem, it is stated that the transition to 2ECA-0.1 has just occurred with RCS pressure at 2005 psig and lowering slowly. Based on this, the crew would start a Charging Pump in step 4 of 2ECA-0.1 which could increase PZR level (and thus also cause RCS pressure to stabilize or increase). If RCS pressure is stable or increasing, the crew would NOT enter step 9 (RNO) for RCS pressure decreasing, and then block automatic SI, manually actuate Containment Isolation, and go to 2ECA-0.2. Thus distractor A may NOT be correct.
- 2) Delete the word "immediately" in distractor B. 3) In the question stem change the given RCS pressure from 2005 psig to 1950 psig to agree with the RCS pressure at which SI is normally blocked. Agree.
Changes made to question 90 H 2 X New. 1) Typo in stem: "occured should be occurred. 2) In distractor D delete the words "should be made." Agreed. Changes incorporated.
91 H 3 X New. 1) In the question stem, give a description of what "DI" is
- - - ( Le., Emergency Diesel Generator). Agreed. Descriptionadded.
It I I I 7.
Explanation New. Not a memory question Station disagrees - only recognition is required. Examiner agrees. Left as memoty level.
New. Distractor C is NOT plausible ( to place the RHR system in service with RCS pressure at 1725 psig ). Agree. - Distractor reolaced.
New. 1) Distractors B and D are basically the same (Le., maintain current power). Change distractor D. 2) Distractor C could also be considered correct. Not a memoty question. Agree - question rewritten.
Modified. Distractor D is NOT plausible ( i.e., that a deviation from the EOPs is NOT allowed under any conditions). Disagreed. Based on comment from regional administrator. Acceptable as written.
Bank.
New. Not a memory question Agreed - reclassified.
Modified.