ML113350201: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
(4 intermediate revisions by the same user not shown) | |||
Line 2: | Line 2: | ||
| number = ML113350201 | | number = ML113350201 | ||
| issue date = 09/30/2011 | | issue date = 09/30/2011 | ||
| title = | | title = NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2) | ||
| author name = Presby P | | author name = Presby P | ||
| author affiliation = NRC/RGN-I/DRS/OB | | author affiliation = NRC/RGN-I/DRS/OB | ||
| addressee name = Armstrong L | | addressee name = Armstrong L | ||
Line 9: | Line 9: | ||
| docket = 05000363 | | docket = 05000363 | ||
| license number = DPR-065 | | license number = DPR-065 | ||
| contact person = JACKSON D | | contact person = JACKSON D RGN-I/DRS/OB/610-337-5306 | ||
| case reference number = TAC U01834 | | case reference number = TAC U01834 | ||
| package number = ML102850247 | | package number = ML102850247 | ||
Line 19: | Line 19: | ||
=Text= | =Text= | ||
{{#Wiki_filter:ES-401 Written Examination Review Worksheet Form ES-401-9 i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will | {{#Wiki_filter:ES-401 Written Examination Review Worksheet Form ES-401-9 | ||
Question data modified to better match expected RCS conditions. | : i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | ||
3 F B S 4 F M S | Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will H M E demonstrate understanding of the why if they correctly determine 2 | ||
6 H B S Clarified how the Q matches the KIA in the justification section. 7 H M S 8 H X N U Multiple correct answers. Rewrote the question. | downstream temperature. Question data modified to better match expected RCS conditions. | ||
3 F B S 4 F M S F N S Adjusted capitalization of "Bleedoff Flow" in the choices for 5 | |||
consistency. | |||
6 H B S Clarified how the Q matches the KIA in the justification section. | |||
7 H M S 8 H X N U Multiple correct answers. Rewrote the question. | |||
Reworded one distractor to make plausible. | Reworded one distractor to make plausible. | ||
9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses). 10 H X M U Implausible distractor wording changed to make distractors plausible. | 9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses). | ||
10 H X M U Implausible distractor wording changed to make distractors plausible. | |||
Removed extra line between Choices A and B. 12 F M S | H N E Added to Q, "procedurally required per EOP2534". Removed extra 11 line between Choices A and B. | ||
Choices expanded to include the "why" and modified to make plausible. | 12 F M S Question did not match KA for demonstrating knowledge of the 13 H X X M E reasons and two choices were implausible. Choices expanded to include the "why" and modified to make plausible. | ||
14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility. | 14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility. | ||
16 H X N U KA mismatch. | 16 H X N U KA mismatch. Question replaced. | ||
Question replaced. | Page 1 | ||
Page 1 | |||
ES*401 Written Examination Review Worksheet Form ES*401*9 | |||
: | : 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | ||
00 LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 17 H X B E Choice B implausible. Choice replaced. | |||
H N E Reworded question and choices to improve clarity and eliminate 18 cueing. | |||
H N E Changed stem conditions and distractors to ensure only one correct 19 answer. | |||
20 F B S Added to justification to explain how KA "metroscope" is matched. | |||
F N E Modified stem and choices to improve KA match and support 21 plausibility of choices. | |||
22 H B E Choice D modified to eliminate overlap with Choice C. | |||
Other | 23 F B E Added to justification to explain KIA match. | ||
24 F M E Minor modification to stem to better support the distractors. | |||
N E | 25 F N E Rewrote question to improve clarity and better match the KA. | ||
F M E Added current EOP to the stem, corrected procedure names and 26 made other editorial changes. | |||
H X 8 U Changed choices to eliminate the second correct answer. | |||
27 Recategorizd as higher order. | |||
II -- I | |||
?R F X X X N U Question re-written to match KA, enhance distractor credibility and Iremove cues. | |||
I I I I I I I I I I I I I I Page 2 | |||
Modified | ES-401 2 Form ES-401-9 | ||
M | : 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | ||
LOK LOD 0# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back 0= SRO B/M/N UtE/S Explanation Focus Dist. Link units ward KIA Only 29 H M E Modified stem and choices for clarity. | |||
F N E Reworded stem and distractors. Added valve numbers. Modified 30 key answer wording to match the reference document. | |||
31 H X N U KIA mismatch and backward logic. Replaced with new question. | |||
H N E Modified question to require assessment of VA-10 loss 32 consequences. | |||
33 H N S F B E Reworded distractor to ensure plausibility. Other minor editorial 34 X changes. | |||
35 F M S 36 F N E Reworded distractors to improve balance. | |||
37 H N S 38 F X M E Reworded choices to improve distractor plausibility. | |||
H X M E Minor modification to stem and editorial changes to choices to 39 eliminate cueing for 0#40. | |||
KIA | 40 H M E Modified choices for symmetry. | ||
F N E Changed choice wording for symmetry and to ensure wrong choices 41 are defensibly wrong. | |||
42 H N E Modified Choice 0 to ensure distractor is wrong. | |||
43 F M S 44 H X N E Modified choices to improve plausibility. | |||
45 F M S 46 H X M E Modified distractors to improve balance, plausibility. | |||
Page 3 | |||
ES-401 2 Form ES-401-9 | |||
: 1. 2. 3. Psychometric Flavvs 4. Job Content Flavvs 5. Other 6. 7. 8. | |||
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist Link units ward KiA Only H M E Recategorized as higher order. Modified choices to improve 47 plausibility. | |||
48 H X N E Reworded Choices A and C to prevent cueing. | |||
49 F N E Corrected units in two choices. | |||
50 F N S 51 H B S 52 H N E Removed unnecessary information in stem and streamlined choices. | |||
53 F B S Corrected grammer in Choice B. | |||
54 H B E Clarified question in stem to require sequential actions. | |||
55 H N E Reworded choices to ensure they are mutually exclusive. | |||
56 F B S 57 H N S 58 F N S Minor editorial changes. | |||
I 59 H I I I I I I M E Modified several distractors to clarify and to make wrong answers wrong H B E Changed restoration time in stem from 6 days to 36 hours to ensure 60 RWST could absorb the heat of the S FP. | |||
H X N U Modified stem and choices to clarify conditions and ensure plausible 61 distractors. | |||
H N S Annotated question pedigree data to indicate reference to be 62 provided for the question. | |||
H B E Corrected valve name and designator and modified choice wording to 63 enhance symmetry. | |||
H M E Added ARP to list of question references. Modified Choice C to 64 enhance symmetry. | |||
4 | |||
ES-401 2 Form ES-401-9 | |||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
LOK LOO Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Oist. Link units ward KIA Only Modified stem question statement to match syntax of the first three 65 H N E choices and modified the wording of Choice 0 to match the syntax of the other three choices. | |||
66 H M S 67 H X B U KIA mismatch. Replaced with a bank question. | |||
I H M E Modified Q and choices to improve plausibility and ensure it is not a 68 direct lookup. | |||
69 H B S 70 F X M U Modified choices to ensure choices are mutually exclusive. | |||
71 F X M U Question had two correct answers. Modified question and choices. | |||
72 F B E Reworded choices to eliminate psychometric flaws. | |||
F X N U Correct answer too obvious. Stem setup not valid for plant 73 conditions. Could not repair. Replaced question. | |||
F X B U Question tested minutia, was poor KIA match, had low operational 74 validity and correct answer was cued. Replaced question. | |||
I 75 F X N E Added to justification to better explain sequence of actions in stem. i I | |||
Page 7}} | 76 H N E Question modified to ensure technicai accuracy and Clarity. | ||
Reworded question and choices to make distracters credible and to 77 F X X N U meet SRO-only criterion of cannot be answered solely with RO system knowledge. | |||
F X X M U Modified the question and the answer choices to address the 78 implausibility of 2 distractors. | |||
79 H X N U Implausible distractors. Rewrote question. | |||
KIA mismatch. Implausible distractors. Question and choices rewritten. | |||
80 F X X N U New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call. | |||
Page 5 | |||
ES*401 2 Form ES*401*9 | |||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
LOK LOD Q# (F/H) (1-5) Stem Cues TtF Credo Partial Job- Minutia #t Back- Q= SRO B/MIN UlEtS Explanation Focus Dist. Link units ward KIA Only H X N U NOT SRO-only. Could be answered by application of system 81 knowledge. Replaced with bank question. | |||
F X X N U Implausible distractors and no correct answer. Question and choices 82 modified. | |||
F X X N U Implausible distractor. and 3 correct answers. Modified stem and 83 distractors to improve plausibility. | |||
84 H X N U NOT SRO-only. Rewrote the question and the choices. | |||
85 H X X M U NOT SRO-only. modified stem and choices. | |||
86 H X N E Reworded stem and Choice B to enhance plausibility. | |||
87 H X B U Multiple correct answers. Question replaced. | |||
88 H N E Minor typographical corrections. Added to distractor justification. | |||
Implausible distracters and not SRO-only. Could be answered with 89 F X X N U system knowledge of battery function. Modified stem and choices to make SRO-only and to make distracters plausible. | |||
90 H X X N U Reworded distracters to make plausible. | |||
91 H M E Reworded stem and choices to improve diScriminatory value. | |||
F X X N U KIA mismatch. Q was not related to NNI system. Distractor C was not 92 a logical choice. Replaced with new question Multiple correct answers. Based on Q wording ("should"), applicant 93 F X N U could make a case for all choices as correct answers. Developed new question to improve distractor plausibility. | |||
94 H B E Reworded stem and choices to improve plausibility. | |||
95 H X X B U Replaced question, original did not match the KIA. | |||
96 H X B U Question had correct answers. Rewrote stem and distractor. | |||
H X N U Question was not SRO-only. Could be answered with RO system 97 knowledge. Replaced the question. | |||
Page 6 | |||
ES-401 2 Form ES-401-9 | |||
--_._._--- ---_._ _ .. .......... _-- --- ~--.- .. -.......--- - --_._._ _ | |||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
LOK LaD Q# (F/H) (1-5) Stem Cues T/F Credo Partial JOb-J::Utia #1 Back- Q= SRO B/M/N utEtS Explanation Focus Dist. Link units ward KIA Only I F X N U Question was not SRO-only. Could be answered based on 98 application of system knowledge. Replaced question. ! | |||
99 H X B E Reworded implausible distractor. | |||
I 100 F X B E Reworded choices to improve plausibility. | |||
* Page 7}} |
Latest revision as of 20:51, 6 February 2020
ML113350201 | |
Person / Time | |
---|---|
Site: | 05000363 |
Issue date: | 09/30/2011 |
From: | Peter Presby Operations Branch I |
To: | Armstrong L Dominion Nuclear Connecticut |
JACKSON D RGN-I/DRS/OB/610-337-5306 | |
Shared Package | |
ML102850247 | List: |
References | |
TAC U01834 | |
Download: ML113350201 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will H M E demonstrate understanding of the why if they correctly determine 2
downstream temperature. Question data modified to better match expected RCS conditions.
3 F B S 4 F M S F N S Adjusted capitalization of "Bleedoff Flow" in the choices for 5
consistency.
6 H B S Clarified how the Q matches the KIA in the justification section.
7 H M S 8 H X N U Multiple correct answers. Rewrote the question.
Reworded one distractor to make plausible.
9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses).
10 H X M U Implausible distractor wording changed to make distractors plausible.
H N E Added to Q, "procedurally required per EOP2534". Removed extra 11 line between Choices A and B.
12 F M S Question did not match KA for demonstrating knowledge of the 13 H X X M E reasons and two choices were implausible. Choices expanded to include the "why" and modified to make plausible.
14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility.
16 H X N U KA mismatch. Question replaced.
Page 1
ES*401 Written Examination Review Worksheet Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
00 LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 17 H X B E Choice B implausible. Choice replaced.
H N E Reworded question and choices to improve clarity and eliminate 18 cueing.
H N E Changed stem conditions and distractors to ensure only one correct 19 answer.
20 F B S Added to justification to explain how KA "metroscope" is matched.
F N E Modified stem and choices to improve KA match and support 21 plausibility of choices.
22 H B E Choice D modified to eliminate overlap with Choice C.
23 F B E Added to justification to explain KIA match.
24 F M E Minor modification to stem to better support the distractors.
25 F N E Rewrote question to improve clarity and better match the KA.
F M E Added current EOP to the stem, corrected procedure names and 26 made other editorial changes.
H X 8 U Changed choices to eliminate the second correct answer.
27 Recategorizd as higher order.
II -- I
?R F X X X N U Question re-written to match KA, enhance distractor credibility and Iremove cues.
I I I I I I I I I I I I I I Page 2
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD 0# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back 0= SRO B/M/N UtE/S Explanation Focus Dist. Link units ward KIA Only 29 H M E Modified stem and choices for clarity.
F N E Reworded stem and distractors. Added valve numbers. Modified 30 key answer wording to match the reference document.
31 H X N U KIA mismatch and backward logic. Replaced with new question.
H N E Modified question to require assessment of VA-10 loss 32 consequences.
33 H N S F B E Reworded distractor to ensure plausibility. Other minor editorial 34 X changes.
35 F M S 36 F N E Reworded distractors to improve balance.
37 H N S 38 F X M E Reworded choices to improve distractor plausibility.
H X M E Minor modification to stem and editorial changes to choices to 39 eliminate cueing for 0#40.
40 H M E Modified choices for symmetry.
F N E Changed choice wording for symmetry and to ensure wrong choices 41 are defensibly wrong.
42 H N E Modified Choice 0 to ensure distractor is wrong.
43 F M S 44 H X N E Modified choices to improve plausibility.
45 F M S 46 H X M E Modified distractors to improve balance, plausibility.
Page 3
- 1. 2. 3. Psychometric Flavvs 4. Job Content Flavvs 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist Link units ward KiA Only H M E Recategorized as higher order. Modified choices to improve 47 plausibility.
48 H X N E Reworded Choices A and C to prevent cueing.
49 F N E Corrected units in two choices.
50 F N S 51 H B S 52 H N E Removed unnecessary information in stem and streamlined choices.
53 F B S Corrected grammer in Choice B.
54 H B E Clarified question in stem to require sequential actions.
55 H N E Reworded choices to ensure they are mutually exclusive.
56 F B S 57 H N S 58 F N S Minor editorial changes.
I 59 H I I I I I I M E Modified several distractors to clarify and to make wrong answers wrong H B E Changed restoration time in stem from 6 days to 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> to ensure 60 RWST could absorb the heat of the S FP.
H X N U Modified stem and choices to clarify conditions and ensure plausible 61 distractors.
H N S Annotated question pedigree data to indicate reference to be 62 provided for the question.
H B E Corrected valve name and designator and modified choice wording to 63 enhance symmetry.
H M E Added ARP to list of question references. Modified Choice C to 64 enhance symmetry.
4
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOO Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Oist. Link units ward KIA Only Modified stem question statement to match syntax of the first three 65 H N E choices and modified the wording of Choice 0 to match the syntax of the other three choices.
66 H M S 67 H X B U KIA mismatch. Replaced with a bank question.
I H M E Modified Q and choices to improve plausibility and ensure it is not a 68 direct lookup.
69 H B S 70 F X M U Modified choices to ensure choices are mutually exclusive.
71 F X M U Question had two correct answers. Modified question and choices.
72 F B E Reworded choices to eliminate psychometric flaws.
F X N U Correct answer too obvious. Stem setup not valid for plant 73 conditions. Could not repair. Replaced question.
F X B U Question tested minutia, was poor KIA match, had low operational 74 validity and correct answer was cued. Replaced question.
I 75 F X N E Added to justification to better explain sequence of actions in stem. i I
76 H N E Question modified to ensure technicai accuracy and Clarity.
Reworded question and choices to make distracters credible and to 77 F X X N U meet SRO-only criterion of cannot be answered solely with RO system knowledge.
F X X M U Modified the question and the answer choices to address the 78 implausibility of 2 distractors.
79 H X N U Implausible distractors. Rewrote question.
KIA mismatch. Implausible distractors. Question and choices rewritten.
80 F X X N U New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call.
Page 5
ES*401 2 Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD Q# (F/H) (1-5) Stem Cues TtF Credo Partial Job- Minutia #t Back- Q= SRO B/MIN UlEtS Explanation Focus Dist. Link units ward KIA Only H X N U NOT SRO-only. Could be answered by application of system 81 knowledge. Replaced with bank question.
F X X N U Implausible distractors and no correct answer. Question and choices 82 modified.
F X X N U Implausible distractor. and 3 correct answers. Modified stem and 83 distractors to improve plausibility.
84 H X N U NOT SRO-only. Rewrote the question and the choices.
85 H X X M U NOT SRO-only. modified stem and choices.
86 H X N E Reworded stem and Choice B to enhance plausibility.
87 H X B U Multiple correct answers. Question replaced.
88 H N E Minor typographical corrections. Added to distractor justification.
Implausible distracters and not SRO-only. Could be answered with 89 F X X N U system knowledge of battery function. Modified stem and choices to make SRO-only and to make distracters plausible.
90 H X X N U Reworded distracters to make plausible.
91 H M E Reworded stem and choices to improve diScriminatory value.
F X X N U KIA mismatch. Q was not related to NNI system. Distractor C was not 92 a logical choice. Replaced with new question Multiple correct answers. Based on Q wording ("should"), applicant 93 F X N U could make a case for all choices as correct answers. Developed new question to improve distractor plausibility.
94 H B E Reworded stem and choices to improve plausibility.
95 H X X B U Replaced question, original did not match the KIA.
96 H X B U Question had correct answers. Rewrote stem and distractor.
H X N U Question was not SRO-only. Could be answered with RO system 97 knowledge. Replaced the question.
Page 6
--_._._--- ---_._ _ .. .......... _-- --- ~--.- .. -.......--- - --_._._ _
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LaD Q# (F/H) (1-5) Stem Cues T/F Credo Partial JOb-J::Utia #1 Back- Q= SRO B/M/N utEtS Explanation Focus Dist. Link units ward KIA Only I F X N U Question was not SRO-only. Could be answered based on 98 application of system knowledge. Replaced question. !
99 H X B E Reworded implausible distractor.
I 100 F X B E Reworded choices to improve plausibility.
- Page 7