ML070230570
| ML070230570 | |
| Person / Time | |
|---|---|
| Site: | Byron  |
| Issue date: | 01/22/2007 |
| From: | Palagi B NRC/RGN-III/DRS/OLB |
| To: | |
| Shared Package | |
| ML062260233 | List: |
| References | |
| 50-454/06-301, 50-455/06-301 | |
| Download: ML070230570 (16) | |
Text
NRC COMMENTS TO THE PROPOSED WRITTEN EXAMINATION, ES-401-9, FOR THE BYRON INITIAL EXAMINATION - JUNE 2006
ES-401 Written Examination Review Worksheet Form ES-401-9 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 LOD (1-5) Stem Cues T/F Cred Partial Job- Minutia #I Back- Q= SRO UIEIS Explanation Focus Dist Link units ward WA Only 3 x X E New With a Period of 80 6 seconds, the MINIMUM additional time expected would be 12 37 minutes, which would make distractor C the correct answer Suggest changing the question stem to ask Which of the following is the MINIMUM additional time , and then changing the distractors to A) 5 to 7 minutes, 8)11 to 13 minutes, C) 14 to 16 minutes, and D) 17 to 19 minutes (with B the correct answer)
RESOLUTION Comment incorporated 3 X S New I 3 X E New Add a sentence to the question stem stating that RCP Trip Criteria have not been reached RESOLUTION Comment incorporated 3 X S New
.. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
b The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 1. Check the appropriate box if a job content error is identified:
0 The question is not linked to the job requirements (i.e., the question has a valid WA but, as written, is not operational in content).
0 The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
A + in the Y2#column indicates that question was reviewed as part of the representative sample of 30 questions.
17
- I Back- Q=
inits ward WA X
Explanation New. Change from Fundamental to Higher Cognitive Level, since in the second part of the question, one must reason that a drop in CC Surge Tank level would indicate an increased system demand, with a corresponding rise in CCW discharge flowrate.
RESOLUTION: Comment incorporated.
X New X E Bank. 1) Since all the distractors isolate AF to the 16 SG, put this information into the question stem instead of in all the distractors.
- 2) Distractor D could also be considered correct, since 31% is greater than 10%. Add the word earliest to the question stem. 3) Change distractor B such that it says to isolate AF when the 1B SG NR level is
-10% (not at 10%) to agree with the EOP.
RESOLUTION: Comments incorporated.
X E Bank. 1) One could argue from the question stem that there is no correct answer (i.e., without making assumptions on the rate of drop in SG 1C pressure). 2) To make distractor B more plausible that low SG level would cause auto steamline isolation, change the question stem such that 1C SG is at 16% NR level instead of 25% NR level.
RESOLUTION: 1) In the question stem, added 2 minutes after the trip to designate when the plant parameters are as given. 2) Comment
- incorporated.
X E New. 1) The second part of distractor D that states that 1A AF Pump should be stopped (the correct answer) does not answer the question (i.e., What is the IMPACT on CONTINUED operation ...). Change the second part of distractor D to say 1A will be damaged. 2) Change the second part of distractor 8 to 16 will be damaged, for distractor symmetry and because there is no AF pump trip on high bearing temperature.
RESOLUTION: Comments incorporated.
I 1
X X X rn I rn C D
I
1I 7
Explanation 3ank. Distractor C is not plausible that the transition to BCA-1.1 is nade in order to re-verify that all automatic actions have been
- ompleted.
I 3ESOLUTION: Changed distractor C to To attempt alternate methods or break isolation.
3ank. In the question stem, change the phrase should be RUNNING
- o are required to be RUNNING.
RESOLUTION: Comment incorporated.
VOTE: Question requires a reference.
Bank. The question stem states that one is sent to E-1 or ES-1.3.
However, step 1.a (RNO) of FR-H.1 says to RETURN TO procedure and step in effect.
RESOLUTION: Changed the question stem to reflect that step 1.a (RNO) of FR-H.l says to return to procedure and step in effect.
Bank. Distractor C is not plausible that a LOOP would ensure all rods are fully inserted.
RESOLUTION: Replaced distractor C with a plausible distractor.
Bank.
Modified. Editorial: In distractors A and C, add O A before Blowdown Monitor tank. RESOLUTION: Comment incorporated.
New. In the question stem, change to indicate ERRONEOUSLY to 70 be unreliable. RESOLUTION: Comment incorporated.
Bank.
Bank.
P n U PI I
NI "
-+
X X X rn C $- rn m
- 4. Job Content Flaws I 5. Other 7.
>red.
Dist.
Ainutia Explanation Bank. The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e.. it is not required to be known from memory), unless there is a Learning Objective related to this.
RESOLUTION: There is a Lesson Plan objective related to knowing this
- information.
-51 S Bank 52 X E New. All the subsequent operator actions from the ARM should not be listed, since the applicants would not be expected to know these from memory.
- - - RESOLUTI0N:The number of actions in the distractors was reduced.
53+ X E Modified. 1) The question requires the recall of timing knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory), unless there is a Learning Objective related to this. 2) Suggest changing distractor A to delete 5 seconds and changing distractor C to delete 1 0 seconds.
RESOLUTION: 1) There is a Lesson Plan objective related to knowing this information. 2) Comment incorporated, 54 X E Bank 1) In the question stem, delete the phrase for the next 30 minutes, since the PZR PORVs may not reach their setpornt in only 30 minutes 2) In distractor D,delete the second part of the distractor due to loss of letdown and the rise in charging flow, to prevent giving the applicant hints at overall plant operation
- RESOLUTION Comments incorporated 55 E New. Editorial: In the question stem, change this indication to rhese
- - indications. RESOLUTION: Comment incorporated.
56+ S New.
57 S Bank. Unless there is a learning Objective for the RO to know this the reason for not starting an RCP under the stated conditions (Le., to prevent an RCS overpressurization event), this question is at the SRO level as a Tech Spec Bases question per 10CFR55,43(b)(2).
RESOLUTION: Question is satisfactory, since there is an RO Learning
- Objective related to this question.
58 E New. In the question stem, change AFTER 5 minutes to AFTER 10 minutes to provide more time for PZR conditions to stabilize.
- RESOLUTION: Comment incorporated.
- 1. I 2. I 3. Psychometric Flaws 4. Job Content Flaws I 5. Other 7.
I lob- Minutia
-ink X
Explanation New For distractor B (DRPI Data A OR B failure), one could interpret that the OR is being used in the inclusive sense (I e , it could mean an and) In this case, distractor B could also be considered correct Suggest changing distractor B to Data A failure RESOLUTION Comment incorporated X Bank.
X U Bank. 1) Distractor D (correct answer) could be considered incorrect, since an entry into FR-C.l is a beyond design basis event in which the peak clad temperature limit of 10CFR50, Appendix K limit of 2200°F could already have been exceeded. 2) Distractor B could be considerec correct, since with the beyond basis inadequate core cooling event in progress, there could be some hydrogen generation due to some amount of the Zirc-Water reaction (even the design basis LOCA has a 10CFR50, Appendix K limit of 1% Zirc-Water reaction). Change distractor B to say prevent the hydrogen generation from the zircaloy-water reaction.
RESOLUTION: 1) Changed distractor D to Provide core cooling to mantain a coolable qeometrv. 2) Comment incorporated.
62 X S Bank.
63+ X E Bank. Editorial: Fully capitalize the word Both in distractors A and B, and fully capitalize the word only in distractor D.
- - ~~
RESOLUTION: Comment incorporated.
~ ~ ~~ ~
64 H 2 X E Bank Editorial In distractor C, fully capitalize the word only RESOLUTION Comment incorporated 65 F 3 X S New.
66+ H 3 X S Bank.
67 F 3 X S New 68 F 3 X E Bank. Editorial: Divide the question stem into two sentences.
- RESOLUTION: Comment incorporated.
7
- 3. Psychometric Flaws
- 4. Job Content Flaws 5. Other Ainutia sack-Explanation Bank. 1) This question is at the SRO level per 10CFR55.43(b)(2), since it is a Tech Spec Bases question, unless there is an RO Learning Objective related to this. 2) Distractor B (correct answer) states that the answer is that the dose received will not exceed 10CFRlOO limits.
However, a more correct answer is that the dose received will not exceed a small fraction of 10 CFRlOO limits. Suggest adding the phrase "a small fraction" to the question stem.
RESOLUTION: 1) There is an RO Learning Objective related to this Question. 2) Comment incorporated.
S Bank.
71 E Bank. Change distractor A to "unless waived by the Radiation Protection Manager." RESOLUTION: Comment incorporated.
Bank 72 S 73+ X E New. 1) To make distractor D more plausible, change the second part to "1, 5", so that one could (incorrectly) assume that once the containment radiation level went below 1.O E5 Whr, that one could go back to using NORMAL containment values. 2) Editorial: In the distractors, use parentheses around the numbers to make them look like the question stem. 3) Change from Fundamental to Higher Cognitive Level, since one must evaluate plant conditions to arrive at the correct answer.
RESOLUTION: Comments incorporated.
New.
-74 S 75 U Bank. This question has excessive overlap with an Administrative JPM that has a time critical step related to this question.
RESOLUTION: Replaced question with a different one (New, F, 3).
76+ X E New. 1) In distractor D (incorrect answer), it should say that there is no specific Tech Spec that addresses the inoperabilit\L(not "operability") of a PZR PORV. 2) Also, in distractor D, instead of saying to place the unit in MODE 3 within 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br />, say to enter General Tech Spec 3.0.3 (since otherwise it could be a cue that distractor D is incorrect, since we do not require candidates to know Tech Spec action statements of 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> from memory). RESOLUTION: Comments incorporated.
- 4. Job Content Flaws I 5. Other 7
- red. Explanation Dist.
X X New. 1) If one only knows that 2FWOO2C is not a containment isolation valve, then one gets distractor D as the correct answer right away.
Suggest changing distractor A to 2FW043D ONLY. 2) Fully capitalize the word only in the distractors.
- RESOLUTION: Comments incorporated.
X X E New. In the question stem, change the wording for PR channel N44 such that it is clear that the channel subsequently was placed in a tripped condition. RESOLUTION: Comment incorporated.
90 X
-X S New.
~
91 X X U Bank 1) Do the Tech Spec 3 9 3 Bases require an audible count rate t(
both the Control Room and the Containment during fuel moves in Containment in Mode 67 Otherwise, the requirement is in Attachment C, step 2 of the Source Range Channel failure procedure, and may not be required to be known from memory 2) In distractor D, add the word ONLY after Control Room RESOLUTION 1) There IS no requirement to have a SR audio count rate available i f an ICRR is being performed Distractor C (correct answer) was changed to reflect that an ICRR IS being performed and both Source Range channels are OPERABLE 2) Comment
- -- incorporated
~~ ~~ ~
92 X X E New Change distractor A to mention to preclude water induction into the turbine on a High level in the associated heaters to provide more balance in the distractors RESOLUTION Comment incorporated NOTE This question requires a reference 93+ X X S Bank. Would applicants be expected to know the actions stated from memory (this question is a Bank question from LORT, where the test is an open book exam)? Is there a Learning Objective to know these actions from memory.
RESOLUTION: Question is satisfactory, since there is a Learning Objective related to this question.
-94 X
- X S Bank.
-95 X X S New 96+ X
- X S New
COMMENTS ON BYRON 2006 INITIAL OPERATING EXAM JMP: Admin 1.a (RO & SRO) Perform Shutdown Margin Calculation Comment 1. TASK CONDITIONS 7 and 8 are unnecessary delete them.
Comment 2. Per procedure PREREQUISITES: provide a signed/dated Data Package Cover Sheet Comment 3. In the answer key for each parameter proved both the value that would be determine by interpellation and the value determined by choosing a bounding value per thenoteon page 150f 1BOSR 1.1.1-1 Comment 4. Make all the steps 3 through 11 of the JPM critical.
JPM: Admin A.l .b (SRO only) Minimum Shift Staffing Comment 1. Remove procedure reference from the cue.
Comment 2. SRO should also check EP requirements met needs 2 RP and 1 Chemist?
Change INITIATING CUE to Determine if the crew meets minimum staffing requirements. so T.S. and EP staffing is evaluated.
Comment 3. Add what corrective actions should be taken and why. (For control room staffing, for Fire Brigade, for E plan, etc.
JMP: Admin 3 Determine Dose Rates and Contamination Areas Comment 1. Ask for a few things not available in the LEGEND such as how the area should be posted, something about the CCNIO area, what type of clothing should be worn, etcetera.
JMP: Admin 4. (RO only) Perform Offsite Notification (NRS......
Comment 1. Per EP-MW-114-100 step 4.2.1 8.It appears Illinois REAC should also be called to complete the JPM task?
JPM: (a) Remove Excess Letdown from Service Comment 1. In step 7 of the JPM the Cue should be F.l .d was performed or the action will not be taken per procedure step F.2.g. Change Cue to Seal Return Flow was not redirected to the VCT Spray Nozzles.
JPM (d) Respond to High RCP Seal Leakoff Flow Comment I . Verity that it is reasonable to believe a RO would be called on to carry out the actions of this JPM without step by step direction from an SRO.
Comment 2. Need to determine how long candidate can stay in step 6 on page 7 of procedure before acting to trip reactor.
JPM: (f) Drain the PZR Relief Tank Comment 1. JPM will need to b e set-up so that which ever pump (1REO1PA or B) the candidate starts first it falls to start.
Comment 2. There is not enough decision making in this JPM to grade as an alternate path.
JPM: (9) Synchronize a DIG to a Bus and Load to 5400 KW Comment 1. Need to set an unsat time limit for the D/G Synced but not loaded.
JPM: (h) Response to a Power Range NI Failure Comment 1. Verity that it is reasonable to believe a RO would be called on to carry out the actions of this JPM without step by step direction from an SRO.
Comment 2. In step 11. Of the JPM remove cue that an extra NSO will place the remaining point in test.
JPM: (I) Locally Open SX to AF Pump Suction Valve Comment 1. Verify that an unassigned cubicle will be available for conducting this JPM.
Comment 2. Change the TASK STANDARD to, take actions to locally electrically operate an MOV, and when that fails manually open the valve.
Comment 3, The cue for step 10 needs to be changed to indicate what the operator would actually see at the valve if it was in the closed position (probably Yhe valve is in the condition that vou see it now).
RESOLUTION: All comments were addressed during the Examination Validation Week and all necessary changes incoporated.
COMMENTS ON BYRON 2006 INITIAL EXAM SCENARIOS Remove the note to have the SRO evaluate the event classification from the end of each of the scenarios.