ML050200021
| ML050200021 | |
| Person / Time | |
|---|---|
| Site: | Kewaunee  |
| Issue date: | 11/16/2004 |
| From: | Hampton K Nuclear Management Co |
| To: | NRC/RGN-III |
| Shared Package | |
| ML050190172 | List: |
| References | |
| 50-305/04-302 50-305/04-302 | |
| Download: ML050200021 (22) | |
Text
2004 Kewaunee RO Proposed Written Retake Exam Submittal I of 2
- Proposed Rev.8 Written Examination (g:\\oldata\\2004 Kewaunee Written Retake Exam\\Origina1\\04-09-08 Original Proposed Exam)
- ES-401-7 Written Examination Quality Checklist
ES-401 Written Examination Form ES-401-7 Quality Checklist Facility:
Date of Exam:
Exam Level: ROlSRC I
I
. Initial.
Item Description
- 1.
- 2.
Questions and answers technically accurate and applicable to facility
- a. NRC KlAs referenced for all questions
- b. Facility leaminq objectives referenced as available
- 3.
- 4.
ROlSRO overlap is. no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401 Question selection and duplication From the last two NRC licensing exams appears consistent with a systematic sampling process
- 5.
Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed: or
- he audit exam was completed before the license exam was started: or d
the examinations were developed independently; OT the licensee certifies that there is no duplication; or other (explain) percent from the bank at least 10 percent new, and the rest modified); enter the actual question distribution at riaht
- 6.
Bank use meets limits (no more than 75 Bank Modified New
- a. Author
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor
- b. Facility Reviewer C) 1-21-q Note:
The facility reviewets initialslsignature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c;' chief examiner concurrence required.
NUREG-1021, Revision 8, Supplement 1 42 of 46
2004 Kewaunee RO Proposed Written Retake Exam Submittal 2 of 2
- Licensee Letter Transmitting Proposed Exam to NRC
- Proposed Rev.9 Written Examination (g:\\oldata\\2004 Kewaunee Written Retake Exam\\Second\\04-10-28 Second Proposed Exam)
- ES-401-6 Written Examination Quality Checklist
- ES-401-9 Written Exam Review Worksheet with written exam comments
Committed to Kewaunee Nuclear Power Plant Operated by Nuclear Management Company, LLC October 15,2004 NRC-04-121 1 OCFR 55.40 Regional Administrator, Region Ill U.S. Nuclear Regulatory Commission Attn: Mr. Dell McNeil 2443 Warrenville Road, Suite 21 0 Lisle, IL 60532-4352 Kewaunee Nuclear Power Plant Docket 50-305 License No. DPR-43 Reactor Operator Written Examination Materials for Mr. Jason F. Crowley In accordance with the guidelines NUREG 1021, Operating License Examination Standard for Power Reactors Draft Revision 9, we are providing you with the Reactor Operator written examination materials for the re-examination of Mr.
Jason Crowley, scheduled for the week of November 15,2004. This package contains the 75-question written examination, the reference material supporting the distracters, and Form ES-401-6. Also included are the updated checklist, outlines, and record of rejected WAS (Forms ES-201-2, ES-401-2, ES-401-3 and ES-401-4).
NUREG 1021 physical security requirements state that the enclosed examination materials shall be withheld from public disclosure until after the examination is complete.
Please direct any questions or comments regarding this material to Mr. Stephen Johnson at 920-388-8723.
Thomas Coutu Site Vice President, Kewaunee Nuclear Power Plant Nuclear Management Company, LLC Enclosures (7) cc:
Senior Resident Inspector, Kewaunee, USNRC w/o enclosures N490 Highway 42 Kewaunee, Wisconsin 54216-9510 Telephone: 920.388.2560
ES-401 Written Examination Form ES-401 -?f3 Quality Checklist
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor 11 Note:
- The facility reviewers initialskignature are not applicable for NRC-developed examinations.
I
- Independent NRC reviewer initial items in Column k; chief examiner concurrence required.
NUREG-1021, Draft Revision 9 30 of 34
Written Examination Review Worksheet Form ES-401-9 ES401
- 3. Psychometric Flaws Dist.
4 f
W P
t t
2 e
- 4. Job Content Flaws I 5. Other [ 6. I
- 7.
Explanation Instructions iefer to Section D of ES-401 and Appendix B for addtional information regarding each of the following concepts.]
, Enter the level of-knowledge (LO4 of each question as either (F)undamental or (H)igher cognitive level
. Enter the level of difficulty (LOD) of each question using a I - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated truelfalse statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
. Check the appropriate box if a job content error is identified:
. Check questions that are sampled for conformance with the approved WA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
- 1. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactor)/l
. At a minimum, explain any 'U" ratings (e.g., how the Appendix 8 psychometric attributes are not being met).
Page 1 of 16
- 4. Job Content Flaws
- 5. Other
- 7.
Explanation
- 3. Psychometric Flaws -
- red.
Dist. -
Modified. 1) To make distractor B, C, and D more plausible, change the initial conditions so that the reactor power is less than the P-8 set point (e.g., state that the reactor is critical at 10-8 amps). Changedinitialpower level to make distractors more plausible.
New.
H -
H 2.0 -
3.0 S -
U F
- F -
3.0 -
2.0 -
2.5 New. Question is a memory question. (Normal alt-dilute positiondloss of air failure positions) Station agrees, reclassified as fundamental.
New. Change distractor C to state: "to maintain conductivity within required limits." Enhancement made.
E H
E -
E S
Bank. 1) It appears distractor D should be listed as the correct answer.
Distractor D incorrectlv listed as correct answer - fixed. 1 1
Modified. 1) Distractor B is not plausible (that having a different RCP running would affect the mixing of the RCS). Change distractor to say to commence a normal boration per the normal boration procedure to add negative reactivity. 2) Distractor C says to start the 'B" train RHR and secure "A" train RHR to re-establish pre-event conditions. However, the initial conditions do not state that the RHR trains were swapped. Question reviewed, changes made to correct distracton.
H 2.0 H -
2.0 -
Page 2 of 16
=
- 1.
LOK
- FIH) -
H
~~
- 4. Job Content Flaws
- 7.
Explanation
- 5. Other
- 3. Psychometric Flaws
- ues
~
~~
~
~~
Modified. 1) In the question stem, change "FLow to "Flow." 2) In the question stem, fully capitalize the word "INITIAL." Question rewritten.
Modified. Does not appear to have a correct answer as written. Question re-written.
Resubmitted Question Review:
New.
New. Question re-written Resubmitted Question Review:
New.
H H
2.0 2.0 8
4 2 F
F -
F H
1.o 3.0 -
2.0 2.5
~
Bank. Distractor B could also be considered correct, since running an RCP does continue to maintain a two phase mixture level above the break longer (since stopping RCPs would cause the two phase mixture to settle out into separate phases for the liquid and the steam, and would cause level in the liquid phase to decrease below that of the two phase level).
Distractor 0 was 8cceDtable. but revised to ensure not correct.
S -
t) -
U S
Bank.
Modified. Required to know from memory or is there a hand-out? This is a direct lookup from the Table that was supplied. Question rewritten.
Resubmitted Question Review:
New.
4 12
+z tt -
H H
433 -
1.o 2.0 Page 3 of 16
- 2.
LOD (1 -5) -
1.o 2.0 2.0 -
2.0
- 6.
UIEIS -
U E
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other Cred.
Dist. -
X
- ues TIF I Explanation Bank. I)
Distractors A and B are not plausible (that the CS pumps would be OFF during a large break LOCA. 2) Distractor C is also correct, since the RHR pumps will be running for a large break LOCA.
Resubmitted Question Review:
New. Add the term "required" to "... status of the ECCS pumps..." in the stem.
units I@=
r/
J J
r/
d 3
3 3
3 3
E -
E -
U S
Bank. To make distractor C more plausible, change distractor C from P-7 to p-I 3. Enhancement incorporated.
Modified. 1) Delete the work "major in the question stem, this word implies that a Safety Injection has occurred. Deleted "major" from stem.
Modified. 1) Distractors C and D are not plausible, since there is no reason a PZR PORV would open on a low PZR pressure condition.
Resubmitted Question Review:
New.
15 20 H
H -
H 2.0 2.0 -
2.5 2 s -
S 6
tt Bank.
26
- Page 4 of 16
8 G n
n I
n n
1 I
I I N
2 0
0 N
A 0
b 2 r Oh:
B o x
x I
x I
x r o "
% F E
5 I'
3 9
9 f
t t
v
)
c v) c c
I i
x N
E b
A 0
X 9
9 FBlv t - t -
T I
t t
t c
(51 E
E v) v)
II) c v) crn 3
9..
I.
- 2.
LOK LOD (FIH)
(1-5) f S
F 2.0 2.5
!=
2.5 H
H 1.0 H
3.0 H
2.5 H
3.0 units e
- 3. Psychometric Flaws
- 4. Job Content Flaws Stem Focus lack-
- 5. Other rc I/
I/
t r/
d
~~
- 6.
J/E/S
- 7.
Explanation tl S -
U -
U
~~
~
~
Bank.
New. Question requires higher skill to answer - not memory. Changed to bigber skM
~~
New. Question is memory. Changed to rlmdamental.
U S -
U Modified. In the question stem, to increase the question difficulty, state the beginning and final main steamline pressures instead of the temperatures (thus requiring the use of steam tables to determine a heatup rate).
Identify an RCS cooldown of 8O'F (say from 520'F to 44O'F) and make distractor D the correct answer.
, Resubmitted Question Review:
Bank.
New. EOP transition decisions are made by SROs. This question is an SRO level question. Distractor D could also be considered correct, since the question stem does not state whether or not SI termination is in progress. If SI termination is in progress, then distractor D is the correct answer.
Resubmitted Question Review:
New. EOP procedure transition is an SRO not RO function.
Question requires recognition of EOP entry conditions for E-2 which is an RO function. Will change "Transition" term to "Enter" on answer A and distractor 6.
Page7of 16
- 1.
- 2.
I
- 3. Psychometric Flaws I
- 4. Job Content Flaws I 5. Other
- 6. I
- 7.
- I Back-Q= SRO rnits ward WA Only I
VF Cred. I Dist.
UIEIS Explanation Link a s 1 New.
T i S
U S -
U I New.
Modified.
Resubmitted Question Review:
New.
Bank. Memory question, not higher. The importance factors for the ROlSRO should be 4.3/4.6 (not 4.W4.3). Distractor D is not plausible that a void would cause a loss of PZR level. Delete "and subsequent loss of Pressurizer level." Re-classfried as memory level, other change requests incorporated.
~
3 PageSof 16
=
- 1.
LOK
[FIH) -
F H
- 2.
LOD (1 -5) -
1.o 2.0 -
1.o -
2.0 2.0 1.o -
2.0
- 6.
UIEIS -
U S
~~
- 3. Psychometric Flaws
~
~
- 4. Job Content Flaws
- 7.
Explanation
- 5. Other 3ack- - -
SRO Only -
- I inits
=
vlinutia -
Modified. Q f WA. The WA is associated with the principle of cooling by natural convection, whereas the question is only related to the allowable cooldown rate during natural circulation. Question rewritten.
Resubmitted Question Review:
New.
Modified. Q + WA. The WA is associated with the principle of cooling by natural convection, whereas the question is only related to the allowable cooldown rate during natural circulation.
F -
H H
H -
H U -
S S
U -
S U -
S Modified. Could a Rapid Power Reduction be required (and thus distractor D also be correct) due to not enough condensate pumps running (since Condensate Pump 'A' is tripped)? Distractor d was not correct, however, modified stem to ensure dpiausible, but false. Question rewritten.
Resubmitted Question Review:
Bank.
Modified. Not higher skill - memory. Distractors A, B, and D are not plausible (that the FW Pumps would have an autostart feature or that the Unit could remain at 45% power with no FW pump running).
Resubmitted Question Review:
New..
F H
F -
H -
1.o 2.0 1.o -
Resubmiied Question Review:
New.
U -
(t
~~
New.
K Page 9 of 16
x I
)1 9
9 3
t a
Q C
U c
c I
t urn rn t
C
- 4. Job Content Flaws I 5. Other
- 3. Psychometric Flaws
- 7.
TIF -
- red. -
hinutia -
Explanation Bank. Re-arrange the rad monitors in numerical order. Enhancement ncorporated.
Bank, Not memory - some comprehension & analysis is done. Agree. Q changed to higher cognitive level.
Modified. Q
- WA. The WA is associated with a knowledge of annunciator alarms for the Process Rad Monitor System, while the question is associated with an alarm for the Area Rad Monitor System.
Station uses an ARM in the PRM - question correct as wfien. Question replaced.
Resubmitted Question Review:
New.
w -
52
.7$.
H f
?2 f -
F F
2.0 2.0 53 w
?4 54 75 55 tt H
H
+e 2.0 2.0 S
Bank.
S -
E -
S -
Bank.
New. Delete the first sentence, capture the valve numbers in the stem.
The first sentence states the valves are supplied by a safety-related bus.
Enhancements incorporated.
New.
56
?6 F
2.0 57
?? -
F -
2.0 -
Page 12of 16
- 1.
LOK FIH) -
F F
- 2.
-0 D
11 -5) -
1.o 2.0
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 7.
Explanation
'artial
=
lack- -
dinutia -
G r Modified. For clarity in the question stem, add the following words after "fully isolated": "from the instrument air system." To make distractor A more plausible, change to 75 psig. Then re-arrange distractors in top down numerical order.
Resubmiid Question Review:
Modified. NRC comments were incorporated.
z%
2.0 -
2.0 2.0 -
2.6 -
~
Modified, 1) This question should be classified at the Higher cognitive level instead of at the memory level, since one needs to look at three pieces of information (containment pressure and the status of Containment isolation and the MSIVs) to determine the correct answer. 2) There is not enough information supplied to verify that it takes 2 of 2 containment isolation pushbuttons depressed to actuate containment isolation. 3) to make the incorrect distractors more plausible, change the questiin stem to have containment pressure at 15 psig instead of 5 pig. 4) To make distractor A more plausible, change the second part of distractor A to be like the second part of distractor D (i.e., "and do NOT close the MSIVs).
Reclassified et higher cognilive levef.
Resubmiied Question Review:
The recommended change to Item 3) was modified based on the trip range; the recommended Item 4) was not made because It would have made distractor A a correct answer.
X New. 1) Distractor C is not plausible. To make the distractor more plausible, delete "until a safely evaluation can be performed." 2) Distractor D is not plausible, since the LCO entered may not have anything to do with core operating limits. 3) To make distractor B more plausible, change the "six hours" to "two hours."
Resubmiied Question Review:
New. NRC comments incorporated.
Page 13 of 16
B
$ g
$ 8 I
n X n A
2 c
b 8:
n n
X n 8
c 2
9 9
t 0
c c
Q: I " I "
5,
T/F Cred. I Dist.
X X
Minutia lw
- 5. Other I 6. I
- 7.
Explanation I
E
+4 Modified. Distractors B and C are not plausible. Determined difficulty level 2.0 after discussion. Distractor c. was plausible. ReclasuiSed as Enhancement, distractor b. reworked.
Resubmitted Question Review:
S Bank.
E Bank. Distractor C is not plausible to go to FR-S.1 for an ATWS on a loss of all AC power. Distractor c. was reworked.
Bank, Change distractor A to have a dropped rod instead of a misaligned rod. In distractor D, add the word 'ONLY" at the beginning.
Enhancements incorporated.
E UMedified:
U Modified. Not higher cognitive level, distractors A and D are not plausible.
Reclassilied at fundamental sM1 level.
Resubmitted Question Review:
S Bank.
S Bank.
Page 15 of 16
I I 1. 1 2. IFmusj.
Psychometric Q#
LOK LOD (FIH)
(1-5)
Stem Cues 72 9?
F 2.0 H
2.5 73 98 F
2.0 H
2.5 74 99
$88 SRO Only Flaws UIUS Explanation Bank. Distractor B is not plausible. Change the second part of the distractor to "prior to isolating the SI pumps." Distractor C is not plausible.
Change to: "To determine if the SI accumulators can be isolated to allow depressurization of the RCS." Incorporated suggested changes.
- 4. Job Content Flaws I 5. Other I 6.. I
- 7.
U Minutia Modified. Not RO responsibility. SRO reads graph, makes this decision.
Need to see the Kewaunee ECA-1.I to see if the procedure allows local throttling of SI pump flow (since this action is not generic to the WOG-generically one throttles flow by the startinglstopping of ECCS pumps).
Resubmitted Question Review:
Bank. Flowrates for B, C, and D ere changed. Licensee referenced lesson plant learning objective RodQ41W22.002 to support question as an RO responsibility.
Bank. Not a higher cognitive level question. Memory only. Distractor B is not plausible (that SG blowdown could not be used if t, was above d
d d
d Modified. This question is at the SRO level (assessment of facility conditions and selection of appropriate procedures). Distractor C is not plausible (to lower the RCS cooldown rate). Change to: "Maintain the present cooldown rate and transition to FR-1.3, "Response to Voids in the Reactor Vessel," if a void in the reactor vessel upper head is detected."
Resubmitted Question Review:
New.
I I W'F). Reclassified at the memory level, modified d i s k o r b.
- Resubmitted questions as part of Rev.9,75 question RO written retake exam.
Page 16 of 16