ML061950377
| ML061950377 | |
| Person / Time | |
|---|---|
| Site: | Arkansas Nuclear  |
| Issue date: | 01/12/2006 |
| From: | Gody A Operations Branch IV |
| To: | Forbes J Entergy Operations |
| References | |
| 50-313/06-301, ES-401, ES-401-9, NUREG-1021, Rev 9 50-313/06-301 | |
| Download: ML061950377 (5) | |
Text
ES-401ANO1-12-2005 Written ExaminationReview Worksheet Q#1.LOK(F/H)2.LOD (1-5)3. Psychometric Flaws4. Job Content Flaws5. Other6.U/E/S 7.ExplanationStemFocusCuesT/FCred.Dist.PartialJob-LinkMinutia#/unitsBack-ward Q=K/ASRO Only 1BH2X-ENeed to link post-accident instruments on these panels in Notes sectionin order to satisfy K/A.
2MH3X-SPrevious review by Mark Haire - possible GFES question.
3BH3XXXERemove the word "best" from the stem. For "B" to be incorrect, needmore info in stem to clue operator that RCP's were secured within the 2 minute time frame. Need EOP bases (for ICC?) to validate.
4BH3XX-URemove the words "which of the following is true" from the stem-true false not allowed.Restructure distractors so that it isn't a collection of True false statements. "D" distractor is notcredible. 5BF2-S 6BH1XX-ESubstitute question due to error in original question. Reword stem toremove "between" from the stem.7H3-S 8BF2 SInstructions[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] 1.Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). 3.Check the appropriate box if a psychometric flaw is identified:The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).The answer choices are a collection of unrelated true/false statements.One or more distractors is (are) not credible.One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4.Check the appropriate box if a job content error is identified:The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).The question requires reverse logic or application compared to the job requirements. 5.Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable). 6.Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 7.At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). 33 of 34 ES-401 2 Q#1.LOK(F/H)2.LOD (1-5)3. Psychometric Flaws4. Job Content Flaws5. Other6.U/E/S 7.ExplanationStemFocusCuesT/FCred.Dist.PartialJob-LinkMinutia#/unitsBack-ward Q=K/ASRO Only 9BH4XX-UNeed inches for units added to stem. Need reference for SG's forisolation to validate distractor "B".
10BF2XX -EModify stem to make distractors more credible, stem more operationallybased with alarms.11F4X-UStartup and low load block valves also close on reactor trip. Removefrom stem.
12BH3-SMinor edit to stem to increase understanding of battery discharge rate.
13BF2-S14H3X-U"C" is not credible since instrument does not fail midscale. Remove mid-scale.15BH2X-UNeed references to validate distractors. Change "B" distractor toread"...D01" to make it credible.16H2X-EMinor stem edit to include "HPI P-36B is aligned to A4 bus." This is aswing pump that can be aligned to two diff. buses.
17MH3X-ENeed references for "C" and "D" distractors.
18MF2-SSystem Title on exam incorrect (says excessive, should be inadequate),point value is also wrong on outline, should be 3.4.
19BH3X-U"D" is a poor distractor. Consider "Align RPI with API" as substitute.
20BH3-EMinor distractor edit for "D" for clarity on stabilizing power.
21BH3-S 22BH3X-U"B" is a poor distractor. Consider "Reset RE-4830 and Notify NuclearChem."23H4-S 24F2-S34 of 34 ES-401 2 Q#1.LOK(F/H)2.LOD (1-5)3. Psychometric Flaws4. Job Content Flaws5. Other6.U/E/S 7.ExplanationStemFocusCuesT/FCred.Dist.PartialJob-LinkMinutia#/unitsBack-ward Q=K/ASRO Only 25BH2 X- E"A" distractor-should Tcold have "leg" after it? Outline is incorrect(changed KA from EA1.17 to EK1.03 in exam, not outline).26H3X-UModify distractors and answer to include total feed flow because flow isre-ratioed on 1 RCP trip. Also consider removing temps from distractors because too similar to question 52.27H3-S 28BH3-S 29MH3-S30H3X-EPut equipment/valve numbers with noun descriptions.
31BH3-ENeed description of connectivity of buses, preferential trips, etc. Labelpump "B" P-34B in stem.
32BH2X-Ereference is weak in supporting only 1 answer.
33BH3X-U"D" distractor is not credible-change from maximize to minimize letdownflow.34H3-S 35H3X-EAnswer "D" is actually incorrect for plant conditions in stem. Heaterswould be off because of the cooldown in progress.36H3-S 37BF2-S 38BH3-S 39BF2-S 40BF2X-E(S)references weak in supporting the correct answer.41H3-Ereferences weak in supporting the correct answer.
42BF2XEWrong K/A was described for question. Recommend modifying the stemto include the procedure step where MSR stm valves are closed.34 of 34 ES-401 2 Q#1.LOK(F/H)2.LOD (1-5)3. Psychometric Flaws4. Job Content Flaws5. Other6.U/E/S 7.ExplanationStemFocusCuesT/FCred.Dist.PartialJob-LinkMinutia#/unitsBack-ward Q=K/ASRO Only 43BF3-EMinor edit of "B" and "D" distractors-remove HI load limit and changesetting values in same distractors to increase credibility.
44BH4-S 45BH4X-EMinor edit to stem to lower temp/pressure to ensure only answer iscorrect and distractors credible without providing SCM graph.
46MH3X-UEdit stem to include degraded power such that RCP's are secured (req'dfor thumb rule in question).
47MH4X-UIs B6 downstream of A4, no guidance on B6 restoration in the providedreference? Yes, auto pickup of B6 when A4 renergized.
48BH4X-EMove "if the auto transformer...service" to stem for all four selections.Place "is" between equipment and operable in the stem.49H3X-ENeed references to confirm all distractors will not cause a trip.
50BF4-S 51BH3-S 52MF2-EChange distractor "B" since it is also correct. Also need references toconfirm distractors.
53BF3X-ENeed references to tie B62 to answer.
54MH3X-EChange stem pressure from 48psig to 50 psig (actual setpointinprocedure for action). Also need to review entire procedure for distractor credibility.
55BF2X-EOutline pt value is wrong at 2.8* (it is actually 3.9).
56BF2-S 57BH3X-U(S)Too similar to question 26 - modify distractors accordingly.
58BH3X-UNeed more references for answer completeness and distractors.
59MH4-S 60BH4-S 61BH2-S 62BH4-S34 of 34 ES-401 2 Q#1.LOK(F/H)2.LOD (1-5)3. Psychometric Flaws4. Job Content Flaws5. Other6.U/E/S 7.ExplanationStemFocusCuesT/FCred.Dist.PartialJob-LinkMinutia#/unitsBack-ward Q=K/ASRO Only 63BF2-S 64MF2-S 65MF2-S 66BH3-S 67BF2X-UDistractors "A" and "D" do not seem credible. Are cell phones availablefor other comm used in CR extension?
68BH3-USubstitute question because...
.Also need references for distractors.Outline pt value is wrong-should be 3.4, not 2.8. Remove the word "for" in distractor "C".
69BF2X-UDistractor "A symmetry - It should read "verification of the associated tripactions of all logic elements for the channel." "B" distractor-replace "known values" with " a known standard." For the "D" distractor - replace "proper response" with "Operability."
70BF3-S 71BF3-S 72BH3-S 73BH3X-U Why can't "B"distractor also be correct?
74BH2-S 75BF2XXX-UPoor question for discriminatory validity. Stem focus on distractor makesit too easy. Outline pt value is wrong-should be 2.9, not 3.3.34 of 34