ML15303A149
| ML15303A149 | |
| Person / Time | |
|---|---|
| Site: | Dresden  |
| Issue date: | 04/30/2015 |
| From: | Randy Baker Operations Branch III |
| To: | |
| Shared Package | |
| ML14337A759 | List: |
| References | |
| Download: ML15303A149 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 1 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1+
H 2
B S
2 H
3 B
E S
NRC: What directs restarting loads one-at-a-time to locate the ground fault as a required action and states what this action protects?
LIC: Required action per DAN 902-8 D-4. Question is S as written.
3 F
2 B
S 4+
H F
3 B
E NRC: Distractor D is not plausible for conditions given in stem. This is still a memory question since knowledge of U3 flowpath is not required to answer question. No history given.
LIC: Distractor D is plausible since the valve is normally closed.
Agreed LOK is F from the bank. Question is now S.
5 F
2 B
S 2011 CERT Exam 6
F 3
B E
NRC: Remove Subset possibility from distractors. (Raise all by 5 psig?)
LIC: Agreed - Changed values on 3 of 4 distractors. Question is now S.
7+
F 3
B E
S NRC: Distractor B may not be plausible.
LIC: Distractor B is plausible based upon system logic. Question is S as written.
8 H
2 B
S 9
F 2
B S
NRC: Corrected rationale for justification provided.
10+
F H
3 B
E NRC: Which event is the applicant taking action to mitigate? (Maybe reword or delete that part of question.)
LIC: Removed the words Several minutes later from the stem to clarify the annunciator response actions. Question is now S.
11 H
3 X
N U
E NRC: No correct answer as written. Change distractor D from DW penetrations (GR II) to CS pumps.
LIC: Changed stem to read which system(s) will have had and changed distractor C to HPCI, EDGs, SDC. Question required E (not U) and is now S.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 2 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 12 H
3 N
E S
NRC: Need to understand why RPV pressure is higher when operating on the bypass valves than the turbine.
LIC: Due to bias in the Bypass Valve Control Circuit. Question is S as written.
13+
H 3
B S
14 H
3 N
S 15 F
2 N
S 16+
F 2
B S
2013 CERT Exam 17 F
2 B
S 18 F
3 B
E NRC: Reword part of stem for clarity.
LIC: Agreed - Changed wording to charger is operating. Question is now S.
19+
H 3
B S
1 out of 2 20 H
3 B
S 2010 NRC Exam 21 H
3 N
S 22+
H 3
B E
NRC: Should the time given in the stem question be 02:44:00?
LIC: Agreed - Changed time to 02:44:00 vs 02:45:00. Question is now S.
23 H
3 N
S 24 F
3 N
E NRC: Consider lower temps for distractors C and D.
LIC: Agreed - Changed distractors C/D to 200/210. Question is now S.
25+
F 2
N S
26 H
3 B
S 27 H
3 N
E NRC: Distractor D is inconsistent and not plausible.
LIC: Agreed - Changed the wording on two distractors and reordered them. Question is now S.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 3 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 28+
H 3
N S
29 H
2 B
S NRC: Use consistent capitalization.
LIC: Agreed - Changed to CAN in distractor A. Question was S.
30 H
3 B
S 2011 CERT Exam 31+
H 3
B S
2011 CERT Exam 32 F
3 B
S 2010 NRC Exam 33 F
2 B
S 2011 CERT Exam 34+
F 3
B S
NRC: Distractor C may be more correct if add the word ALL before low pressure ECCS pumps in PTL.
LIC: Agreed - Added the word ALL to distractor C. Question is S.
2011 CERT Exam (2008 NRC Exam)
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
A + in the Q# column indicates that question was reviewed as part of the representative sample of 30 questions.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 4 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 35 H
3 B
S 36 H
3 B
S NRC: Verify this is really listed in the bank as High cog.
LIC: Verified. Question is S as written.
37+
H 3
N S
38 F
2 B
S 39 H
2 B
S 40+
H 3
B S
ILT 11-1 NRC Exam (2012) 41 F
2 B
S 42 H
3 B
S 2013 CERT Exam (Different question from #31) 43+
H 3
B S
NRC: Correct wording of distractor C.
LIC: Agreed - Changed wording to then.
44 H
3 X
B U
E NRC: As worded, may have more than 1 correct answer. (B and C)
LIC: Agreed - Changed stem wording to actions is required.
Question is now S.
45 H
3 B
S 46+
F 3
B S
ILT 11-1 NRC Exam (2012) 47 F
2 B
S 48 F
2 B
S NRC: Reword stem 3 turns CLOSED from FULL OPEN for clarity.
LIC: Agreed - Reworded stem to system is being returned to service. Question is S.
49+
H 2
N S
50 F
3 B
S 51 H
3 B
S 52 H
3 N
S
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 5 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 53+
F 1
B U
NRC: Direct power supply question.
LIC: Replaced question using the same K/A. Question is now S.
54 H
3 B
S ILT 11-1 NRC Exam (2012) 55 F
3 N
S 56+
F 3
B E
NRC: Reword the stem to clarify required actions.
LIC: Agreed - Removed the words and reset the alarms. Question is now S.
2013 CERT Exam 57 H
3 N
S (DOP 1300-03.)
58 F
3 N
S 1 out of 2.
59 H
3 N
S 1 out of 2.
60 F
3 B
S NRC: Corrected rationale for justification provided.
61 F
3 N
S 62+
F 3
N S
63 H
F 3
N E
NRC: LOK is memory, F.
LIC: Agreed - Changed LOK to F. Question is now S.
64 H
3 N
S 65 H
3 N
S 66+
F H
3 B
E NRC: This appears to be High cog. Verify from Bank.
LIC: Agreed - Verified that bank LOK is High. Question is now S.
67 F
3 B
S NRC: Possibly use a higher contamination level?
LIC: Agreed - Raised contamination level to 150 dpm/100cm2.
Question is S.
68 H
2 B
S ILT 11-1 NRC Exam (2012) 69 F
3 B
S 2013 CERT Exam
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 6 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 70+
H 3
B S
2013 CERT Exam 71 H
3 B
S 2013 CERT Exam 72 F
3 N
S 73 H
3 B
S 1 out of 2.
2011 CERT Exam 74 H
3 N
S 75+
H 3
B S
NRC: How does the reference support the question/answer?
LIC: Agreed - Provided new reference. Question is S.
For RO portion of Exam: New = 24Q, Modified = 0Q, Bank = 51Q (68.0%): LOK: F = 32 (42.7%), H= (57.3%)
76 H
3 Y
B S
2010 NRC Exam 77 F
3 Y
B S
78 H
3 Y
B S
79+
H 3
Y B
S 1 out of 2.
80 H
3 Y
B S
1 out of 2.
ILT 11-1 NRC Exam (2012) 81 H
3 Y
B S
82 H
3 Y
N S
83+
H 3
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to different unit and changed one distractor. Question is now S.
84 H
3 Y
B S
2013 CERT Exam 85 F
3 Y
B S
2011 CERT Exam 86 F
3 Y
N S
87 H
3 Y
B S
2012 NRC Exam (MNS)
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 7 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 88+
H 2
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to make different distractor the correct answer. Question is now S.
89 F
3 Y
N S
90+
F 3
Y B
S ILT 11-1 NRC Exam (2012) 91 H
3 Y
N S
92 H
3 Y
B S
93 H
3 Y
N S
94 H
2 Y
B S
95+
H 3
Y N
S 96 F
3 Y
B S
97+
F 3
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to make different distractor the correct answer. Question is now S.
98 F
2 Y
B S
1 out of 2.
2013 CERT Exam 99 H
3 Y
N S
100+
H 2
Y B
S For SRO portion of Exam: New = 7Q, Modified = 3Q, Bank = 15Q (60.0%): LOK: F = 8 (32.0%), H= (68.0%)
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 1 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1+
H 2
B S
2 H
3 B
E S
NRC: What directs restarting loads one-at-a-time to locate the ground fault as a required action and states what this action protects?
LIC: Required action per DAN 902-8 D-4. Question is S as written.
3 F
2 B
S 4+
H F
3 B
E NRC: Distractor D is not plausible for conditions given in stem. This is still a memory question since knowledge of U3 flowpath is not required to answer question. No history given.
LIC: Distractor D is plausible since the valve is normally closed.
Agreed LOK is F from the bank. Question is now S.
5 F
2 B
S 2011 CERT Exam 6
F 3
B E
NRC: Remove Subset possibility from distractors. (Raise all by 5 psig?)
LIC: Agreed - Changed values on 3 of 4 distractors. Question is now S.
7+
F 3
B E
S NRC: Distractor B may not be plausible.
LIC: Distractor B is plausible based upon system logic. Question is S as written.
8 H
2 B
S 9
F 2
B S
NRC: Corrected rationale for justification provided.
10+
F H
3 B
E NRC: Which event is the applicant taking action to mitigate? (Maybe reword or delete that part of question.)
LIC: Removed the words Several minutes later from the stem to clarify the annunciator response actions. Question is now S.
11 H
3 X
N U
E NRC: No correct answer as written. Change distractor D from DW penetrations (GR II) to CS pumps.
LIC: Changed stem to read which system(s) will have had and changed distractor C to HPCI, EDGs, SDC. Question required E (not U) and is now S.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 2 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 12 H
3 N
E S
NRC: Need to understand why RPV pressure is higher when operating on the bypass valves than the turbine.
LIC: Due to bias in the Bypass Valve Control Circuit. Question is S as written.
13+
H 3
B S
14 H
3 N
S 15 F
2 N
S 16+
F 2
B S
2013 CERT Exam 17 F
2 B
S 18 F
3 B
E NRC: Reword part of stem for clarity.
LIC: Agreed - Changed wording to charger is operating. Question is now S.
19+
H 3
B S
1 out of 2 20 H
3 B
S 2010 NRC Exam 21 H
3 N
S 22+
H 3
B E
NRC: Should the time given in the stem question be 02:44:00?
LIC: Agreed - Changed time to 02:44:00 vs 02:45:00. Question is now S.
23 H
3 N
S 24 F
3 N
E NRC: Consider lower temps for distractors C and D.
LIC: Agreed - Changed distractors C/D to 200/210. Question is now S.
25+
F 2
N S
26 H
3 B
S 27 H
3 N
E NRC: Distractor D is inconsistent and not plausible.
LIC: Agreed - Changed the wording on two distractors and reordered them. Question is now S.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 3 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 28+
H 3
N S
29 H
2 B
S NRC: Use consistent capitalization.
LIC: Agreed - Changed to CAN in distractor A. Question was S.
30 H
3 B
S 2011 CERT Exam 31+
H 3
B S
2011 CERT Exam 32 F
3 B
S 2010 NRC Exam 33 F
2 B
S 2011 CERT Exam 34+
F 3
B S
NRC: Distractor C may be more correct if add the word ALL before low pressure ECCS pumps in PTL.
LIC: Agreed - Added the word ALL to distractor C. Question is S.
2011 CERT Exam (2008 NRC Exam)
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
A + in the Q# column indicates that question was reviewed as part of the representative sample of 30 questions.
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 4 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 35 H
3 B
S 36 H
3 B
S NRC: Verify this is really listed in the bank as High cog.
LIC: Verified. Question is S as written.
37+
H 3
N S
38 F
2 B
S 39 H
2 B
S 40+
H 3
B S
ILT 11-1 NRC Exam (2012) 41 F
2 B
S 42 H
3 B
S 2013 CERT Exam (Different question from #31) 43+
H 3
B S
NRC: Correct wording of distractor C.
LIC: Agreed - Changed wording to then.
44 H
3 X
B U
E NRC: As worded, may have more than 1 correct answer. (B and C)
LIC: Agreed - Changed stem wording to actions is required.
Question is now S.
45 H
3 B
S 46+
F 3
B S
ILT 11-1 NRC Exam (2012) 47 F
2 B
S 48 F
2 B
S NRC: Reword stem 3 turns CLOSED from FULL OPEN for clarity.
LIC: Agreed - Reworded stem to system is being returned to service. Question is S.
49+
H 2
N S
50 F
3 B
S 51 H
3 B
S 52 H
3 N
S
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 5 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 53+
F 1
B U
NRC: Direct power supply question.
LIC: Replaced question using the same K/A. Question is now S.
54 H
3 B
S ILT 11-1 NRC Exam (2012) 55 F
3 N
S 56+
F 3
B E
NRC: Reword the stem to clarify required actions.
LIC: Agreed - Removed the words and reset the alarms. Question is now S.
2013 CERT Exam 57 H
3 N
S (DOP 1300-03.)
58 F
3 N
S 1 out of 2.
59 H
3 N
S 1 out of 2.
60 F
3 B
S NRC: Corrected rationale for justification provided.
61 F
3 N
S 62+
F 3
N S
63 H
F 3
N E
NRC: LOK is memory, F.
LIC: Agreed - Changed LOK to F. Question is now S.
64 H
3 N
S 65 H
3 N
S 66+
F H
3 B
E NRC: This appears to be High cog. Verify from Bank.
LIC: Agreed - Verified that bank LOK is High. Question is now S.
67 F
3 B
S NRC: Possibly use a higher contamination level?
LIC: Agreed - Raised contamination level to 150 dpm/100cm2.
Question is S.
68 H
2 B
S ILT 11-1 NRC Exam (2012) 69 F
3 B
S 2013 CERT Exam
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 6 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 70+
H 3
B S
2013 CERT Exam 71 H
3 B
S 2013 CERT Exam 72 F
3 N
S 73 H
3 B
S 1 out of 2.
2011 CERT Exam 74 H
3 N
S 75+
H 3
B S
NRC: How does the reference support the question/answer?
LIC: Agreed - Provided new reference. Question is S.
For RO portion of Exam: New = 24Q, Modified = 0Q, Bank = 51Q (68.0%): LOK: F = 32 (42.7%), H= (57.3%)
76 H
3 Y
B S
2010 NRC Exam 77 F
3 Y
B S
78 H
3 Y
B S
79+
H 3
Y B
S 1 out of 2.
80 H
3 Y
B S
1 out of 2.
ILT 11-1 NRC Exam (2012) 81 H
3 Y
B S
82 H
3 Y
N S
83+
H 3
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to different unit and changed one distractor. Question is now S.
84 H
3 Y
B S
2013 CERT Exam 85 F
3 Y
B S
2011 CERT Exam 86 F
3 Y
N S
87 H
3 Y
B S
2012 NRC Exam (MNS)
ES-401 Written Examination Review Worksheet Form ES-401-9 DRESDEN Station [April 2015] Exam 7 of 7 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 88+
H 2
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to make different distractor the correct answer. Question is now S.
89 F
3 Y
N S
90+
F 3
Y B
S ILT 11-1 NRC Exam (2012) 91 H
3 Y
N S
92 H
3 Y
B S
93 H
3 Y
N S
94 H
2 Y
B S
95+
H 3
Y N
S 96 F
3 Y
B S
97+
F 3
Y B
M E
NRC: ILT 11-1 NRC Exam (2012) Therefore need to Modify question.
LIC: Agreed - Changed stem to make different distractor the correct answer. Question is now S.
98 F
2 Y
B S
1 out of 2.
2013 CERT Exam 99 H
3 Y
N S
100+
H 2
Y B
S For SRO portion of Exam: New = 7Q, Modified = 3Q, Bank = 15Q (60.0%): LOK: F = 8 (32.0%), H= (68.0%)