ML113350201
| ML113350201 | |
| Person / Time | |
|---|---|
| Site: | 05000363 |
| Issue date: | 09/30/2011 |
| From: | Peter Presby Operations Branch I |
| To: | Armstrong L Dominion Nuclear Connecticut |
| JACKSON D RGN-I/DRS/OB/610-337-5306 | |
| Shared Package | |
| ML102850247 | List: |
| References | |
| TAC U01834 | |
| Download: ML113350201 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will H M E demonstrate understanding of the why if they correctly determine 2
downstream temperature. Question data modified to better match expected RCS conditions.
3 F B S 4 F M S F N S Adjusted capitalization of "Bleedoff Flow" in the choices for 5
consistency.
6 H B S Clarified how the Q matches the KIA in the justification section.
7 H M S 8 H X N U Multiple correct answers. Rewrote the question.
Reworded one distractor to make plausible.
9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses).
10 H X M U Implausible distractor wording changed to make distractors plausible.
H N E Added to Q, "procedurally required per EOP2534". Removed extra 11 line between Choices A and B.
12 F M S Question did not match KA for demonstrating knowledge of the 13 H X X M E reasons and two choices were implausible. Choices expanded to include the "why" and modified to make plausible.
14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility.
16 H X N U KA mismatch. Question replaced.
Page 1
ES*401 Written Examination Review Worksheet Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
00 LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 17 H X B E Choice B implausible. Choice replaced.
H N E Reworded question and choices to improve clarity and eliminate 18 cueing.
H N E Changed stem conditions and distractors to ensure only one correct 19 answer.
20 F B S Added to justification to explain how KA "metroscope" is matched.
F N E Modified stem and choices to improve KA match and support 21 plausibility of choices.
22 H B E Choice D modified to eliminate overlap with Choice C.
23 F B E Added to justification to explain KIA match.
24 F M E Minor modification to stem to better support the distractors.
25 F N E Rewrote question to improve clarity and better match the KA.
F M E Added current EOP to the stem, corrected procedure names and 26 made other editorial changes.
H X 8 U Changed choices to eliminate the second correct answer.
27 Recategorizd as higher order.
II -- I
?R F X X X N U Question re-written to match KA, enhance distractor credibility and Iremove cues.
I I I I I I I I I I I I I I Page 2
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD 0# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back 0= SRO B/M/N UtE/S Explanation Focus Dist. Link units ward KIA Only 29 H M E Modified stem and choices for clarity.
F N E Reworded stem and distractors. Added valve numbers. Modified 30 key answer wording to match the reference document.
31 H X N U KIA mismatch and backward logic. Replaced with new question.
H N E Modified question to require assessment of VA-10 loss 32 consequences.
33 H N S F B E Reworded distractor to ensure plausibility. Other minor editorial 34 X changes.
35 F M S 36 F N E Reworded distractors to improve balance.
37 H N S 38 F X M E Reworded choices to improve distractor plausibility.
H X M E Minor modification to stem and editorial changes to choices to 39 eliminate cueing for 0#40.
40 H M E Modified choices for symmetry.
F N E Changed choice wording for symmetry and to ensure wrong choices 41 are defensibly wrong.
42 H N E Modified Choice 0 to ensure distractor is wrong.
43 F M S 44 H X N E Modified choices to improve plausibility.
45 F M S 46 H X M E Modified distractors to improve balance, plausibility.
Page 3
- 1. 2. 3. Psychometric Flavvs 4. Job Content Flavvs 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist Link units ward KiA Only H M E Recategorized as higher order. Modified choices to improve 47 plausibility.
48 H X N E Reworded Choices A and C to prevent cueing.
49 F N E Corrected units in two choices.
50 F N S 51 H B S 52 H N E Removed unnecessary information in stem and streamlined choices.
53 F B S Corrected grammer in Choice B.
54 H B E Clarified question in stem to require sequential actions.
55 H N E Reworded choices to ensure they are mutually exclusive.
56 F B S 57 H N S 58 F N S Minor editorial changes.
I 59 H I I I I I I M E Modified several distractors to clarify and to make wrong answers wrong H B E Changed restoration time in stem from 6 days to 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> to ensure 60 RWST could absorb the heat of the S FP.
H X N U Modified stem and choices to clarify conditions and ensure plausible 61 distractors.
H N S Annotated question pedigree data to indicate reference to be 62 provided for the question.
H B E Corrected valve name and designator and modified choice wording to 63 enhance symmetry.
H M E Added ARP to list of question references. Modified Choice C to 64 enhance symmetry.
4
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Oist. Link units ward KIA Only Modified stem question statement to match syntax of the first three 65 H N E choices and modified the wording of Choice 0 to match the syntax of the other three choices.
66 H M S 67 H X B U KIA mismatch. Replaced with a bank question.
I H M E Modified Q and choices to improve plausibility and ensure it is not a 68 direct lookup.
69 H B S 70 F X M U Modified choices to ensure choices are mutually exclusive.
71 F X M U Question had two correct answers. Modified question and choices.
72 F B E Reworded choices to eliminate psychometric flaws.
F X N U Correct answer too obvious. Stem setup not valid for plant 73 conditions. Could not repair. Replaced question.
F X B U Question tested minutia, was poor KIA match, had low operational 74 validity and correct answer was cued. Replaced question.
I 75 F X N E Added to justification to better explain sequence of actions in stem. i I
76 H N E Question modified to ensure technicai accuracy and Clarity.
Reworded question and choices to make distracters credible and to 77 F X X N U meet SRO-only criterion of cannot be answered solely with RO system knowledge.
F X X M U Modified the question and the answer choices to address the 78 implausibility of 2 distractors.
79 H X N U Implausible distractors. Rewrote question.
KIA mismatch. Implausible distractors. Question and choices rewritten.
80 F X X N U New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call.
Page 5
ES*401 2 Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues TtF Credo Partial Job- Minutia #t Back- Q= SRO B/MIN UlEtS Explanation Focus Dist. Link units ward KIA Only H X N U NOT SRO-only. Could be answered by application of system 81 knowledge. Replaced with bank question.
F X X N U Implausible distractors and no correct answer. Question and choices 82 modified.
F X X N U Implausible distractor. and 3 correct answers. Modified stem and 83 distractors to improve plausibility.
84 H X N U NOT SRO-only. Rewrote the question and the choices.
85 H X X M U NOT SRO-only. modified stem and choices.
86 H X N E Reworded stem and Choice B to enhance plausibility.
87 H X B U Multiple correct answers. Question replaced.
88 H N E Minor typographical corrections. Added to distractor justification.
Implausible distracters and not SRO-only. Could be answered with 89 F X X N U system knowledge of battery function. Modified stem and choices to make SRO-only and to make distracters plausible.
90 H X X N U Reworded distracters to make plausible.
91 H M E Reworded stem and choices to improve diScriminatory value.
F X X N U KIA mismatch. Q was not related to NNI system. Distractor C was not 92 a logical choice. Replaced with new question Multiple correct answers. Based on Q wording ("should"), applicant 93 F X N U could make a case for all choices as correct answers. Developed new question to improve distractor plausibility.
94 H B E Reworded stem and choices to improve plausibility.
95 H X X B U Replaced question, original did not match the KIA.
96 H X B U Question had correct answers. Rewrote stem and distractor.
H X N U Question was not SRO-only. Could be answered with RO system 97 knowledge. Replaced the question.
Page 6
--_._._--- ---_._ _ .. .......... _-- --- ~--.- .. -.......--- - --_._._ _
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LaD Q# (F/H) (1-5) Stem Cues T/F Credo Partial JOb-J::Utia #1 Back- Q= SRO B/M/N utEtS Explanation Focus Dist. Link units ward KIA Only I F X N U Question was not SRO-only. Could be answered based on 98 application of system knowledge. Replaced question. !
99 H X B E Reworded implausible distractor.
I 100 F X B E Reworded choices to improve plausibility.
- Page 7