ML113350201: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
Line 19: Line 19:


=Text=
=Text=
{{#Wiki_filter:ES-401 Written Examination Review Worksheet Form ES-401-9 i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will 2 H M E demonstrate understanding of the why if they correctly determine downstream temperature.
{{#Wiki_filter:ES-401                                               Written Examination Review Worksheet                                                         Form ES-401-9
Question data modified to better match expected RCS conditions.
                  ----                                                                                                                                        ---
3 F B S 4 F M S 5 F N S Adjusted capitalization of "Bleedoff Flow" in the choices for consistency.
: i. 2.       3. Psychometric Flaws         4. Job Content Flaws     5. Other 6. 7.                                     8.
6 H B S Clarified how the Q matches the KIA in the justification section. 7 H M S 8 H X N U Multiple correct answers. Rewrote the question.
Q# LOK   LOD (F/H) (1-5) Stem Cues T/F     Credo Partial Job- Minutia #1     Back- Q= SRO B/M/N UlEtS                               Explanation Focus             Dis!.       Link         units ward KIA Only 1   H                                                                             B   S Deleted 2nd part of question and answers. Applicants will H                                                                             M   E   demonstrate understanding of the why if they correctly determine 2
downstream temperature. Question data modified to better match expected RCS conditions.
3   F                                                                             B   S 4   F                                                                             M   S F                                                                             N   S   Adjusted capitalization of "Bleedoff Flow" in the choices for 5
consistency.
6   H                                                                             B   S   Clarified how the Q matches the KIA in the justification section.
7   H                                                                             M   S 8   H                                   X                                         N   U   Multiple correct answers. Rewrote the question.
Reworded one distractor to make plausible.
Reworded one distractor to make plausible.
9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses). 10 H X M U Implausible distractor wording changed to make distractors plausible.
9   H                                                                             M   E   Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses).
11 H N E Added to Q, "procedurally required per EOP2534".
10   H                             X                                               M   U   Implausible distractor wording changed to make distractors plausible.
Removed extra line between Choices A and B. 12 F M S 13 H X X M E Question did not match KA for demonstrating knowledge of the reasons and two choices were implausible.
H                                                                             N   E   Added to Q, "procedurally required per EOP2534". Removed extra 11 line between Choices A and B.
Choices expanded to include the "why" and modified to make plausible.
12   F                                                                             M   S Question did not match KA for demonstrating knowledge of the 13    H                              X                                    X        M    E  reasons and two choices were implausible. Choices expanded to include the "why" and modified to make plausible.
14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility.
14   H                                                                             N   S   Minor editorial change 15   F                                                                             N   E   Modified choice wording to improve distractor plausibility.
16 H X N U KA mismatch.
16   H                                                                   X         N   U   KA mismatch. Question replaced.
Question replaced.
Page 1
Page 1
 
-------ES*401 Written Examination Review Worksheet Form ES*401*9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 00 LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N utE/S Focus Dist. Link units ward KIA Only 17 H X B E 18 H N E 19 H N E 20 F B S 21 F N E 22 H B E 23 F B E 24 F M E 25 F N E 26 F M E 27 H X 8 U I ?R F X X X N U II --I I I I I I I I I I I I I I I
ES*401                                                     Written Examination Review Worksheet                                                           Form ES*401*9
: 8. Explanation Choice B implausible.
: 1.     2.         3. Psychometric Flaws           4. Job Content Flaws     5. Other   6. 7.                                     8.
Choice replaced.
00   LOK   LOD (F/H)   (1-5)   Stem Cues T/F     Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S                                         Explanation Focus             Dist.         Link           units ward KIA Only 17     H                                 X                                                   B   E   Choice B implausible. Choice replaced.
Reworded question and choices to improve clarity and eliminate cueing. Changed stem conditions and distractors to ensure only one correct Added to justification to explain how KA "metroscope" is Modified stem and choices to improve KA match and plausibility of Choice D modified to eliminate overlap with Choice Added to justification to explain KIA Minor modification to stem to better support the Rewrote question to improve clarity and better match the Added current EOP to the stem, corrected procedure names made other editorial Changed choices to eliminate the second correct Recategorizd as higher Question re-written to match KA, enhance distractor credibility I remove cues. Page 2 ES-401 2 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other LOK LOD 0# (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 0= SRO Focus Dist. Link units ward KIA Only 29 H 30 F 31 H X 32 H 33 H 34 F X 35 F 36 F 37 H 38 F X 39 H X 40 H 41 F 42 H 43 F 44 H X 45 F 46 H X 6. 7. 8. B/M/N UtE/S Explanation M E Modified stem and choices for clarity. N E Reworded stem and distractors.
H                                                                                       N   E   Reworded question and choices to improve clarity and eliminate 18 cueing.
Added valve numbers. Modified key answer wording to match the reference document.
H                                                                                       N   E   Changed stem conditions and distractors to ensure only one correct 19 answer.
N U KIA mismatch and backward logic. Replaced with new question.
20    F                                                                                      B   S   Added to justification to explain how KA "metroscope" is matched.
N E Modified question to require assessment of VA-10 loss consequences.
F                                                                                       N   E   Modified stem and choices to improve KA match and support 21 plausibility of choices.
N S B E Reworded distractor to ensure plausibility.
22    H                                                                                      B   E   Choice D modified to eliminate overlap with Choice C.
Other minor editorial changes. M S N E Reworded distractors to improve balance. N S M E Reworded choices to improve distractor plausibility.
23     F                                                                                       B   E   Added to justification to explain KIA match.
M E Minor modification to stem and editorial changes to choices to eliminate cueing for 0#40. M E Modified choices for symmetry.
24    F                                                                                      M   E   Minor modification to stem to better support the distractors.
N E Changed choice wording for symmetry and to ensure wrong choices are defensibly wrong. N E Modified Choice 0 to ensure distractor is wrong.
                                                                                                            -------
M S N E Modified choices to improve plausibility.
25     F                                                                                       N   E   Rewrote question to improve clarity and better match the KA.
M S M E Modified distractors to improve balance, plausibility.
F                                                                                       M   E   Added current EOP to the stem, corrected procedure names and 26 made other editorial changes.
Page 3 
H                                       X                                             8   U   Changed choices to eliminate the second correct answer.
--2 Form ES-401-9 6. 7. B/M/N U/E/S 1. 2. 3. Psychometric Flavvs LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Focus Dist 47 H 48 H X 49 F 50 F 51 H 52 H 53 F 54 H 55 H 56 F 57 H 58 F I 59 H I I I 60 H 61 H X 62 H 63 H 64 H 4. Job Content Flavvs 5. Other Job-Minutia #1 Back-Q= Link units ward KiA I 8. Explanation Recategorized as higher order. Modified choices to Reworded Choices A and C to prevent Corrected units in two Removed unnecessary information in stem and streamlined Corrected grammer in Choice Clarified question in stem to require sequential Reworded choices to ensure they are mutually Minor editorial Modified several distractors to clarify and to make wrong answers wrong Changed restoration time in stem from 6 days to 36 hours to ensure RWST could absorb the heat of the S FP. Modified stem and choices to clarify conditions and ensure plausible distractors.
27 Recategorizd as higher order.
Annotated question pedigree data to indicate reference to be provided for the question.
II -- I
Corrected valve name and designator and modified choice wording to enhance symmetry.
  ?R     F                     X           X                                       X           N   U   Question re-written to match KA, enhance distractor credibility and Iremove cues.
Added ARP to list of question references.
I      I       I     I   I       I     I     I       I     I     I     I     I   I Page 2
Modified Choice C to enhance symmetry.
 
M N N N B N B B N B N N M B N N B M E E E S S E S E E S S S E E U S E E ES-401 2 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. LOK LOO Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/MIN U/E/S Explanation Focus Oist. Link units ward KIA Only Modified stem question statement to match syntax of the first three 65 H N E choices and modified the wording of Choice 0 to match the syntax of the other three choices. 66 H M S 67 H X B U KIA mismatch.
ES-401                                                                        2                                                                Form ES-401-9
Replaced with a bank question.
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
I 68 H M E Modified Q and choices to improve plausibility and ensure it is not a direct lookup. 69 H B S 70 F X M U Modified choices to ensure choices are mutually exclusive.
LOK  LOD 0#  (F/H) (1-5) Stem Cues T/F      Credo Partial Job- Minutia #1 Back    0= SRO B/M/N UtE/S                              Explanation Focus              Dist.        Link          units ward KIA Only 29    H                                                                            M    E  Modified stem and choices for clarity.
71 F X M U Question had two correct answers. Modified question and choices. 72 F B E Reworded choices to eliminate psychometric flaws. 73 F X N U Correct answer too obvious. Stem setup not valid for plant conditions.
F                                                                            N    E  Reworded stem and distractors. Added valve numbers. Modified 30 key answer wording to match the reference document.
Could not repair. Replaced question.
31    H                                                                    X        N    U  KIA mismatch and backward logic. Replaced with new question.
74 F X B U Question tested minutia, was poor KIA match, had low operational validity and correct answer was cued. Replaced question.
H                                                                            N    E  Modified question to require assessment of VA-10 loss 32 consequences.
I 75 F X N E Added to justification to better explain sequence of actions in stem. i 76 H N E Question modified to ensure technicai accuracy and Clarity. I 77 F X X N U Reworded question and choices to make distracters credible and to meet SRO-only criterion of cannot be answered solely with RO system knowledge.
33    H                                                                            N    S F                                                                            B    E  Reworded distractor to ensure plausibility. Other minor editorial 34                                  X                                                      changes.
78 F X X M U Modified the question and the answer choices to address the implausibility of 2 distractors.
35    F                                                                             M    S 36    F                                                                            N    E  Reworded distractors to improve balance.
79 H X N U Implausible distractors. Rewrote question.
37    H                                                                             N    S 38    F                             X                                              M    E  Reworded choices to improve distractor plausibility.
KIA mismatch.
H                 X                                                         M    E  Minor modification to stem and editorial changes to choices to 39 eliminate cueing for 0#40.
Implausible distractors.
40    H                                                                             M    E  Modified choices for symmetry.
Question and choices rewritten.
F                                                                             N    E  Changed choice wording for symmetry and to ensure wrong choices 41 are defensibly wrong.
80 F X X N U New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call. Page 5 ES*401 2 Form ES*401*9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. LOK LOD Q# (F/H) (1-5) Stem Cues TtF Credo Partial Job-Minutia #t Back-Q= SRO B/MIN UlEtS Explanation Focus Dist. Link units ward KIA Only 81 H X N U NOT SRO-only.
42    H                                                                             N    E  Modified Choice 0 to ensure distractor is wrong.
Could be answered by application of system knowledge.
43   F                                                                             M    S 44   H                             X                                             N    E  Modified choices to improve plausibility.
Replaced with bank question.
45   F                                                                             M    S 46   H                             X                                             M   E   Modified distractors to improve balance, plausibility.
82 F X X N U Implausible distractors and no correct answer. Question and choices modified.
Page 3
83 F X X N U Implausible distractor.
 
and 3 correct answers. Modified stem and distractors to improve plausibility.
ES-401                                                                        2                                                                Form ES-401-9
84 H X N U NOT SRO-only.
: 1. 2.       3. Psychometric Flavvs        4. Job Content Flavvs  5. Other 6. 7.                                    8.
Rewrote the question and the choices. 85 H X X M U NOT SRO-only.
LOK  LOD Q# (F/H) (1-5) Stem Cues T/F      Credo Partial Job- Minutia #1 Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist          Link          units ward KiA Only H                                                                            M   E   Recategorized as higher order. Modified choices to improve 47 plausibility.
modified stem and choices. 86 H X N E Reworded stem and Choice B to enhance plausibility.
48  H                  X                                                          N   E   Reworded Choices A and C to prevent cueing.
87 H X B U Multiple correct answers. Question replaced.
49  F                                                                            N   E   Corrected units in  two choices.
88 H N E Minor typographical corrections.
50  F                                                                            N    S 51  H                                                                            B    S 52  H                                                                            N   E   Removed unnecessary information in stem and streamlined choices.
Added to distractor justification.
53  F                                                                            B    S   Corrected grammer in Choice B.
89 F X X N U Implausible distracters and not SRO-only.
54  H                                                                            B    E   Clarified question in stem to require sequential actions.
Could be answered with system knowledge of battery function.
55  H                                                                            N    E  Reworded choices to ensure they are mutually exclusive.
Modified stem and choices to make SRO-only and to make distracters plausible.
56  F                                                                            B   S 57  H                                                                            N    S 58  F                                                                            N   S   Minor editorial changes.
90 H X X N U Reworded distracters to make plausible.
I 59  H I I I I I                                          I    M    E  Modified several distractors to clarify and to make wrong answers wrong H                                                                             B    E  Changed restoration time in stem from 6 days to 36 hours to ensure 60 RWST could absorb the heat of the S FP.
91 H M E Reworded stem and choices to improve diScriminatory value. 92 F X X N U KIA mismatch.
H                             X                                             N    U  Modified stem and choices to clarify conditions and ensure plausible 61 distractors.
Q was not related to NNI system. Distractor C was not a logical choice. Replaced with new question 93 F X N U Multiple correct answers. Based on Q wording ("should"), applicant could make a case for all choices as correct answers. Developed new question to improve distractor plausibility.
H                                                                             N    S  Annotated question pedigree data to indicate reference to be 62 provided for the question.
94 H B E Reworded stem and choices to improve plausibility.
H                                                                             B    E  Corrected valve name and designator and modified choice wording to 63 enhance symmetry.
95 H X X B U Replaced question, original did not match the KIA. 96 H X B U Question had correct answers. Rewrote stem and distractor.
H                                                                             M    E  Added ARP to list of question references. Modified Choice C to 64 enhance symmetry.
97 H X N U Question was not SRO-only.
                                      --
Could be answered with RO system knowledge.
4
Replaced the question.
 
Page 6  
ES-401                                                                          2                                                                  Form ES-401-9
------------ES-401 2 Form ES-401-9 --_._._---
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws    5. Other  6. 7.                                      8.
---_._.. _..........
LOK  LOO Q#  (F/H) (1-5) Stem Cues T/F      Credo Partial Job- Minutia #1      Back- Q=    SRO B/MIN U/E/S                                 Explanation Focus              Oist.         Link          units ward  KIA  Only Modified stem question statement to match syntax of the first three 65    H                                                                                N    E  choices and modified the wording of Choice 0 to match the syntax of the other three choices.
_-----.. -.......------_._._.. _....... -1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. LOK Q# (F/H) (1-5) Stem Cues T/F SRO B/M/N utEtS Credo Partial JOb-J::Utia
66    H                                                                                M    S 67    H                                                                      X          B    U  KIA mismatch. Replaced with a bank question.
#1 Back-Q= Focus Dist. Link units ward KIA Only I Question was not SRO-only.
I H                                                                                M     E  Modified Q and choices to improve plausibility and ensure it is not a 68 direct lookup.
Could be answered based on 98 F X N U application of system knowledge.
69    H                                                                                B     S 70    F                                    X                                            M     U  Modified choices to ensure choices are mutually exclusive.
Replaced question.
71    F                                    X                                            M     U   Question had two correct answers. Modified question and choices.
! 99 H X B E Reworded implausible distractor.
72    F                                                                                B    E  Reworded choices to eliminate psychometric flaws.
I *100 F X B E Reworded choices to improve plausibility.
F                  X                                                              N    U  Correct answer too obvious. Stem setup not valid for plant 73 conditions. Could not repair. Replaced question.
F                                                   X                            B    U  Question tested minutia, was poor KIA match, had low operational 74 validity and correct answer was cued. Replaced question.
I 75    F                 X                                                              N    E  Added to justification to better explain sequence of actions in stem. i I
76    H                                                                                 N     E   Question modified to ensure technicai accuracy and Clarity.
Reworded question and choices to make distracters credible and to 77    F                             X                                             X    N    U   meet SRO-only criterion of cannot be answered solely with RO system knowledge.
F                             X                                            X   M     U   Modified the question and the answer choices to address the 78 implausibility of 2 distractors.
79    H                              X                                                 N     U   Implausible distractors. Rewrote question.
KIA mismatch. Implausible distractors. Question and choices rewritten.
80    F                             X                                       X          N    U   New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call.
Page 5
 
ES*401                                                                        2                                                                Form ES*401*9
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
LOK  LOD Q#  (F/H) (1-5) Stem Cues TtF      Credo Partial Job- Minutia #t Back-    Q= SRO B/MIN UlEtS                              Explanation Focus              Dist.         Link          units ward KIA Only H                                                                          X  N    U  NOT SRO-only. Could be answered by application of system 81 knowledge. Replaced with bank question.
F                              X                                          X  N    U  Implausible distractors and no correct answer. Question and choices 82 modified.
F                              X    X                                        N    U  Implausible distractor. and 3 correct answers. Modified stem and 83 distractors to improve plausibility.
84    H                                                                         X  N    U  NOT SRO-only. Rewrote the question and the choices.
85    H                             X                                          X M    U   NOT SRO-only. modified stem and choices.
86    H                              X                                              N    E  Reworded stem and Choice B to enhance plausibility.
87    H                                    X                                       B    U   Multiple correct answers. Question replaced.
88    H                                                                            N   E  Minor typographical corrections. Added to distractor justification.
Implausible distracters and not SRO-only. Could be answered with 89    F                              X                                          X  N    U  system knowledge of battery function. Modified stem and choices to make SRO-only and to make distracters plausible.
90    H                             X    X                                       N   U   Reworded distracters to make plausible.
91    H                                                                            M    E  Reworded stem and choices to improve diScriminatory value.
F                              X                                     X       N    U   KIA mismatch. Q was not related to NNI system. Distractor C was not 92 a logical choice. Replaced with new question Multiple correct answers. Based on Q wording ("should"), applicant 93    F                                   X                                       N   U   could make a case for all choices as correct answers. Developed new question to improve distractor plausibility.
94    H                                                                            B    E  Reworded stem and choices to improve plausibility.
95    H                             X                                     X       B    U   Replaced question, original did not match the KIA.
96    H                                   X                                        B    U  Question had correct answers. Rewrote stem and distractor.
H                                                                          X N   U   Question was not SRO-only. Could be answered with RO system 97                                                                                          knowledge. Replaced the question.
Page 6
 
ES-401                                                                        2                                                                        Form ES-401-9
                                                            --_._._--- ---_._ _  .. .......... _--  --- ~--.-     .. -.......---                   - --_._._ _
                                                                                                                                                              .. ....... _ -- -
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other              6. 7.                                 8.
LOK  LaD Q#  (F/H) (1-5) Stem Cues T/F      Credo Partial JOb-J::Utia #1 Back-    Q=    SRO B/M/N utEtS                                    Explanation Focus              Dist.         Link          units ward KIA Only                                                                                              I F                                                                            X            N  U  Question was not SRO-only. Could be answered based on 98                                                                                                      application of system knowledge. Replaced question.                     !
99    H                              X                                                          B  E  Reworded implausible distractor.
I 100  F                                   X                                                    B  E  Reworded choices to improve plausibility.                              *
                                                          -------                                            -----
Page 7}}
Page 7}}

Revision as of 12:17, 12 November 2019

NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
ML113350201
Person / Time
Site: 05000363
Issue date: 09/30/2011
From: Peter Presby
Operations Branch I
To: Armstrong L
Dominion Nuclear Connecticut
JACKSON D RGN-I/DRS/OB/610-337-5306
Shared Package
ML102850247 List:
References
TAC U01834
Download: ML113350201 (7)
v • d • e


Text

ES-401 Written Examination Review Worksheet Form ES-401-9

---

i. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 1 H B S Deleted 2nd part of question and answers. Applicants will H M E demonstrate understanding of the why if they correctly determine 2

downstream temperature. Question data modified to better match expected RCS conditions.

3 F B S 4 F M S F N S Adjusted capitalization of "Bleedoff Flow" in the choices for 5

consistency.

6 H B S Clarified how the Q matches the KIA in the justification section.

7 H M S 8 H X N U Multiple correct answers. Rewrote the question.

Reworded one distractor to make plausible.

9 H M E Regarding KA match, the proportional heaters are powered from vital (emergency) buses. The backup heaters are powered from non-vital (non-emergency buses).

10 H X M U Implausible distractor wording changed to make distractors plausible.

H N E Added to Q, "procedurally required per EOP2534". Removed extra 11 line between Choices A and B.

12 F M S Question did not match KA for demonstrating knowledge of the 13 H X X M E reasons and two choices were implausible. Choices expanded to include the "why" and modified to make plausible.

14 H N S Minor editorial change 15 F N E Modified choice wording to improve distractor plausibility.

16 H X N U KA mismatch. Question replaced.

Page 1

ES*401 Written Examination Review Worksheet Form ES*401*9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

00 LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 17 H X B E Choice B implausible. Choice replaced.

H N E Reworded question and choices to improve clarity and eliminate 18 cueing.

H N E Changed stem conditions and distractors to ensure only one correct 19 answer.

20 F B S Added to justification to explain how KA "metroscope" is matched.

F N E Modified stem and choices to improve KA match and support 21 plausibility of choices.

22 H B E Choice D modified to eliminate overlap with Choice C.

23 F B E Added to justification to explain KIA match.

24 F M E Minor modification to stem to better support the distractors.

25 F N E Rewrote question to improve clarity and better match the KA.

F M E Added current EOP to the stem, corrected procedure names and 26 made other editorial changes.

H X 8 U Changed choices to eliminate the second correct answer.

27 Recategorizd as higher order.

II -- I

?R F X X X N U Question re-written to match KA, enhance distractor credibility and Iremove cues.

I I I I I I I I I I I I I I Page 2

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD 0# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back 0= SRO B/M/N UtE/S Explanation Focus Dist. Link units ward KIA Only 29 H M E Modified stem and choices for clarity.

F N E Reworded stem and distractors. Added valve numbers. Modified 30 key answer wording to match the reference document.

31 H X N U KIA mismatch and backward logic. Replaced with new question.

H N E Modified question to require assessment of VA-10 loss 32 consequences.

33 H N S F B E Reworded distractor to ensure plausibility. Other minor editorial 34 X changes.

35 F M S 36 F N E Reworded distractors to improve balance.

37 H N S 38 F X M E Reworded choices to improve distractor plausibility.

H X M E Minor modification to stem and editorial changes to choices to 39 eliminate cueing for 0#40.

40 H M E Modified choices for symmetry.

F N E Changed choice wording for symmetry and to ensure wrong choices 41 are defensibly wrong.

42 H N E Modified Choice 0 to ensure distractor is wrong.

43 F M S 44 H X N E Modified choices to improve plausibility.

45 F M S 46 H X M E Modified distractors to improve balance, plausibility.

Page 3

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flavvs 4. Job Content Flavvs 5. Other 6. 7. 8.

LOK LOD Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist Link units ward KiA Only H M E Recategorized as higher order. Modified choices to improve 47 plausibility.

48 H X N E Reworded Choices A and C to prevent cueing.

49 F N E Corrected units in two choices.

50 F N S 51 H B S 52 H N E Removed unnecessary information in stem and streamlined choices.

53 F B S Corrected grammer in Choice B.

54 H B E Clarified question in stem to require sequential actions.

55 H N E Reworded choices to ensure they are mutually exclusive.

56 F B S 57 H N S 58 F N S Minor editorial changes.

I 59 H I I I I I I M E Modified several distractors to clarify and to make wrong answers wrong H B E Changed restoration time in stem from 6 days to 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> to ensure 60 RWST could absorb the heat of the S FP.

H X N U Modified stem and choices to clarify conditions and ensure plausible 61 distractors.

H N S Annotated question pedigree data to indicate reference to be 62 provided for the question.

H B E Corrected valve name and designator and modified choice wording to 63 enhance symmetry.

H M E Added ARP to list of question references. Modified Choice C to 64 enhance symmetry.

--

4

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOO Q# (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Oist. Link units ward KIA Only Modified stem question statement to match syntax of the first three 65 H N E choices and modified the wording of Choice 0 to match the syntax of the other three choices.

66 H M S 67 H X B U KIA mismatch. Replaced with a bank question.

I H M E Modified Q and choices to improve plausibility and ensure it is not a 68 direct lookup.

69 H B S 70 F X M U Modified choices to ensure choices are mutually exclusive.

71 F X M U Question had two correct answers. Modified question and choices.

72 F B E Reworded choices to eliminate psychometric flaws.

F X N U Correct answer too obvious. Stem setup not valid for plant 73 conditions. Could not repair. Replaced question.

F X B U Question tested minutia, was poor KIA match, had low operational 74 validity and correct answer was cued. Replaced question.

I 75 F X N E Added to justification to better explain sequence of actions in stem. i I

76 H N E Question modified to ensure technicai accuracy and Clarity.

Reworded question and choices to make distracters credible and to 77 F X X N U meet SRO-only criterion of cannot be answered solely with RO system knowledge.

F X X M U Modified the question and the answer choices to address the 78 implausibility of 2 distractors.

79 H X N U Implausible distractors. Rewrote question.

KIA mismatch. Implausible distractors. Question and choices rewritten.

80 F X X N U New question is KA match because knowledge of AOP actions applied to determine system alignment as reflected by TS operability call.

Page 5

ES*401 2 Form ES*401*9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LOD Q# (F/H) (1-5) Stem Cues TtF Credo Partial Job- Minutia #t Back- Q= SRO B/MIN UlEtS Explanation Focus Dist. Link units ward KIA Only H X N U NOT SRO-only. Could be answered by application of system 81 knowledge. Replaced with bank question.

F X X N U Implausible distractors and no correct answer. Question and choices 82 modified.

F X X N U Implausible distractor. and 3 correct answers. Modified stem and 83 distractors to improve plausibility.

84 H X N U NOT SRO-only. Rewrote the question and the choices.

85 H X X M U NOT SRO-only. modified stem and choices.

86 H X N E Reworded stem and Choice B to enhance plausibility.

87 H X B U Multiple correct answers. Question replaced.

88 H N E Minor typographical corrections. Added to distractor justification.

Implausible distracters and not SRO-only. Could be answered with 89 F X X N U system knowledge of battery function. Modified stem and choices to make SRO-only and to make distracters plausible.

90 H X X N U Reworded distracters to make plausible.

91 H M E Reworded stem and choices to improve diScriminatory value.

F X X N U KIA mismatch. Q was not related to NNI system. Distractor C was not 92 a logical choice. Replaced with new question Multiple correct answers. Based on Q wording ("should"), applicant 93 F X N U could make a case for all choices as correct answers. Developed new question to improve distractor plausibility.

94 H B E Reworded stem and choices to improve plausibility.

95 H X X B U Replaced question, original did not match the KIA.

96 H X B U Question had correct answers. Rewrote stem and distractor.

H X N U Question was not SRO-only. Could be answered with RO system 97 knowledge. Replaced the question.

Page 6

ES-401 2 Form ES-401-9

--_._._--- ---_._ _ .. .......... _-- --- ~--.- .. -.......--- - --_._._ _

.. ....... _ -- -

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

LOK LaD Q# (F/H) (1-5) Stem Cues T/F Credo Partial JOb-J::Utia #1 Back- Q= SRO B/M/N utEtS Explanation Focus Dist. Link units ward KIA Only I F X N U Question was not SRO-only. Could be answered based on 98 application of system knowledge. Replaced question.  !

99 H X B E Reworded implausible distractor.

I 100 F X B E Reworded choices to improve plausibility. *

-----

Page 7

Retrieved from "https://kanterella.com/w/index.php?title=ML113350201&oldid=2109387"