Letter Sequence Draft Other |
|---|
|
Results
Other: ML18074A052, ML18074A053, ML18074A054, ML18074A055, ML18134A128, ML18134A137, ML18149A494, ML18323A272, ML18323A273, ML18323A274, ML19038A054, ML19038A101, ML19038A126, ML19045A271, ML19045A343, ML19045A424, ML19065A224, ML19065A230, ML19066A204, ML19066A214, ML19092A047, ML19217A267, ML19217A268, ML19217A269, ML19217A272, ML19217A273, ML19217A274, ML19298B558, ML19298B559, ML19302E287, ML19302F311, ML19302F437, ML19302F487, ML19330E279, ML19330E366, ML20020A001, ML20020A002, ML20022A259, ML20022A260, ML20022A261, ML20022A262, ML20055D883, ML20055E009, ML20057E559, ML20057E560, ML20087G852, ML20087H514, ML20184A247, ML20184A248, ML20240A318... further results
|
MONTHYEARML18135A3332017-12-11011 December 2017
Draft Operating Test (Section a, Section B, Section C) (Folder 2)
Project stage: Draft Other
ML18323A2722018-01-29029 January 2018
Final Operating Test (Parts a, B and C) (Folder 3)
Project stage: Other
ML18323A2742018-01-29029 January 2018
Post Exam Comments and Resolution, and Technical References
Project stage: Other
ML18323A2732018-01-31031 January 2018
Final Written Examination with Answer Key (401-5 Format)(Folder 3)
Project stage: Other
ML18134A1282018-03-0909 March 2018
Final Qa/Related Forms (Forms 1)
Project stage: Other
ML18074A0522018-03-0909 March 2018
Final Written Examination and Operating Test Outlines (Folder 3)
Project stage: Other
ML18074A0552018-03-0909 March 2018
Final Operating Test (Section a, B, and C) (Folder 3)
Project stage: Other
ML18074A0532018-03-0909 March 2018
Final Written Examination with Answer Key (401-5 Format) (Folder 3)
Project stage: Other
ML18074A0542018-03-0909 March 2018
Handouts to Applicants (Folder 3)
Project stage: Other
ML18149A4942018-03-0909 March 2018
Final Qa/Related Forms - Form ES-401-6 RO (Folder 1)
Project stage: Other
ML18134A1372018-03-0909 March 2018
Final Qa/Related Forms - Form ES-401-6 SRO (Folder 1)
Project stage: Other
ML18135A2252018-03-20020 March 2018
Draft Written Examination and Operating Test Outlines (Folder 2)
Project stage: Draft Other
ML19050A3742018-04-25025 April 2018
NRC Comments on Draft Licensee-Developed Written Exam (Folder 2)
Project stage: Draft Other
ML18135A3012018-05-15015 May 2018
NRC Comments on Draft Licensee-Developed Operating Test (Folder 2)
Project stage: Draft Other
ML18135A2162018-05-15015 May 2018
NRC Comments on Draft Licensee-Developed Written Exam (Folder 2)
Project stage: Draft Other
ML18135A2482018-05-21021 May 2018
Draft Written Examination (Folder 2)
Project stage: Draft Other
ML19217A2712019-02-0101 February 2019
TMI - Draft Written Examination and Operating Test Outlines (Folder 2)
Project stage: Draft Other
ML19038A1262019-02-0707 February 2019
Post Exam Comments and Technical References (Folder 1)
Project stage: Other
ML19038A0542019-02-0707 February 2019
Final Operating Test (Sections a, B, and C)(Folder 3)
Project stage: Other
ML19038A1012019-02-0707 February 2019
Final Written Examination with Answer Key (401-5 Format)(Folder 3)
Project stage: Other
ML19044A5862019-02-13013 February 2019
Draft Written Examination (Folder 2)
Project stage: Draft Other
ML19044A6062019-02-13013 February 2019
NRC Comments on Draft Licensee-Developed Written Exam (Folder 2)
Project stage: Draft Other
ML19045A4162019-02-14014 February 2019
Draft Written Examination and Operating Test Outlines (Folder 2)
Project stage: Draft Other
ML19045A4242019-02-14014 February 2019
Final Written Examination and Operating Test Outlines (Folder 3)
Project stage: Other
ML19045A3432019-02-14014 February 2019
Final QA Related Forms (Folder 1)
Project stage: Other
ML19045A2712019-02-14014 February 2019
Handouts to Applicants (Folder 3)
Project stage: Other
ML19050A3652019-02-19019 February 2019
Draft Written Examination and Operating Test Outlines (Folder 2)
Project stage: Draft Other
ML19065A2302019-03-0606 March 2019
Final Qa/Related Forms (Folder 1)
Project stage: Other
ML19065A2242019-03-0606 March 2019
Post Exam Comments Resolution References (Folder 1)
Project stage: Other
ML19065A0662019-03-0606 March 2019
Draft Written Examination (Folder 2)
Project stage: Draft Other
ML19065A0772019-03-0606 March 2019
Draft Operating Test (Section a, Section B, Section C)(Folder 2)
Project stage: Draft Other
ML19066A2142019-03-0707 March 2019
Final Written Examination and Operating Test Outlines (Folder 3)
Project stage: Other
ML19066A2042019-03-0707 March 2019
Final QA Related Form - Form ES-401-6 (Folder 1)
Project stage: Other
ML19092A0472019-04-0202 April 2019
Handouts to Applicants (Folder 3)
Project stage: Other
ML20055E0202019-04-22022 April 2019
Draft Operating Test (Section a, Section B, Section C) (Folder 2)
Project stage: Draft Other
ML19217A2722019-07-0202 July 2019
TMI - Final Written Examination with Answer Key (401-5 Format) (Folder 3)
Project stage: Other
ML19217A2692019-07-15015 July 2019
TMI - Post Exam Comments and NRC Resolution (Folder 1)
Project stage: Other
ML19330E3662019-07-17017 July 2019
Final Qa/Related Form - Form ES-401-6 (Folder 1)
Project stage: Other
ML19302F6342019-07-23023 July 2019
Draft Operating Test (Section a, Section B, Section C) (Folder 2)
Project stage: Draft Other
ML19302F5982019-07-23023 July 2019
Draft Written Examination (Folder 2)
Project stage: Draft Other
ML19217A2732019-07-26026 July 2019
TMI - Handouts to Applicants (Folder 3)
Project stage: Other
ML19217A2742019-07-26026 July 2019
TMI - Final Operating Test (Sections a, B, and C) (Folder 3)
Project stage: Other
ML19217A2672019-07-26026 July 2019
TMI - Final Qa/Related Forms (Folder 1)
Project stage: Other
ML19217A2682019-07-26026 July 2019
TMI - Final Qa/Related Form - Form ES-401-6 (Folder 1)
Project stage: Other
ML19298B5582019-08-26026 August 2019
Final Written Examination with Answer Key (401-5 Format) (Folder 3)
Project stage: Other
ML19298B5592019-08-26026 August 2019
Final Operating Test (Sections a, B, and C) (Folder 3)
Project stage: Other
ML19302F4872019-09-13013 September 2019
Final Operating Test (Sections a, B, and C) (Folder 3)
Project stage: Other
ML19302E2872019-09-13013 September 2019
Final Written Examination and Operating Test Outlines (Folder 3)
Project stage: Other
ML19302F3112019-09-13013 September 2019
Final Written Examination with Answer Key (401-5 Format) (Folder 3)
Project stage: Other
ML19302F4372019-09-27027 September 2019
Handouts to Applicants (Folder 3)
Project stage: Other
2019-02-07
[Table View] |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 NMP2 DEC 2019
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
H LOK LOO Source Status
- 8. Explanation Q
(F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 1
H 2.0 N
s 2
H 2.0 N
s 3
F 2.5 B
s 4
F 3.0 N
s 5
H 3.0 M
s 6
H 3.5 B
s 7
F 3.0 B
s 8
F 3.5 B
s Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty {LOO) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3.
Check the appropriate box if a psychometric flaw is identified:
"Stem Focus": The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
"Cues": The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
"T/F": The answer choices are a collection of unrelated true/false statements.
"Cred. Dist.": The distractors are not credible; single implausible*distractors should be repaired, and more than one is unacceptable.
"Partial": One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).
- 4.
Check the appropriate box if a job content flaw is identified:
"Job Link": The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
"Minutia": The question requires the recall of knowledge that is too specific for the closed-reference test mode {i.e., it is not required to be known from memory).
#/Units": The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
"Backward": The question requires reverse logic*or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved KIA and those KIAs that are designated "SRO-only." (KIA and license-level mismatches are unacceptable.)
- 6.
Enter question's source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.,
- 7.
Based on the reviewer's judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any "U" status ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401) 2 Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem*
Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 9
F 2.5 N
s 10 H
3.0 B
s 11 F
3.0 B
s 12 H
2.5 B
s 13 F
3.5 B
s 14 H
1.0 B
s 15 H
3.0 N
s 16 F
3.0 B
s 17
-H 2.5 B
s 18 H
3.5 B
s 19 F
4.0 B
s 20 H
3.0 N
s 21 H
3.0 N
s 22 F
3.5 N
s 23 H
3.0 N
s 24 F
3.0 B
s 25 F
3.5 B
s
ES-401 3
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 26 H
3.0 M
s 27 H
3.0 N
s 28 F
2.5 B
s 29 H
2.0 N
s 30 H
2.0 B
s 31 H
3.0 B
s 32 H
1.0 N
u L0D=1; wrote new Q 33 H
3.0 B
s 34 H
3.0 B
s 35 F
3.0 N
s 36 F
2.5
'~
B s
37 H
3.0 N
s 38 H
3.5 B
s 39 H
4.0 M
s 40 H
3.0 N
s 41 H
3.0 B
s 42 F
3.5 N
s
ES-401 4
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-MinuUa
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 43 H
3.0 N
s 44 H
3.0 B
s 45 H
3.0 M
s 46 H
3.0 B
s 47 F
3.5 N
s 48 H
3.5 B
s 49 F
3.5 N
s 50 F
3.0 N
s 51 F
3.0 B
s 52 H
2.5 B
s 53 F
2.5 B
s 54 F
3.0 B
s 55 H
2.5 N
s 56 H
3.0 M
s 57 H
2.5 B
s 58 F
3.0 B
s 59 H
3.5 B
s
ES-401 5
Form ES-401-9
,J
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOO Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 60 H
3.5 B
s 61 H
2.5 N
s 62 H
3.0 B
s 63 F
3.0 B
s 64 F
2.5 B
s 65 H
2.5 B
s 66 H
2.0 B
s 67 F
2.5 B
s 68 F
1.0 N
s 69 F
2.5 B
s 70 H
3.0 B
s 71 F
2.0 B
E Wrote new Q to reduce number of questions from last 2 NRG exams 72 F
3.0 B
s 73 F
3.5 N
E Added KIA justification statement 74 H
3.5 M
s 75 F
2.0 B
s 76 H
2.5 B
s I
ES-401 6
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOO Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
Focus Dist Link KIA Only 77 H
2.5 M
s 78 H
4.0 B
s 79 H
3.0 M
s 80 H
3.0 B
s 81 H
3.0 B
s 82 H
3.0 N
s 83 H
2.0 B
s 84 H
3.5 N
s 85 H
2.5 N
s 86 H
3.5 M
s 87 H
3.5 M
s 88 H
3.0 B
s 89 H
3.5 B
s 90 H
3.5 M
s 91 H
3.5 B
s 92
s 93 H
2.5 X
B u
C also correct; two correct answers. Revised wording of C and D
ES-401 7
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q LOK LOD Source Status
- 8. Explanation (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /Units Backward Q-SRO (B/M/N)
(U/E/S)
'Focus Dist Link KIA Only 94 F
2.0 B
s 95 F
2.0 M
s 96 H
3.0
\\
N s
97 F
3.5 B
s 98 H
2.0 B
s 99 H
3.5 M
E Question contained SSI; wrote new Q to prevent possible SSI spillage.
10 F
3.5 B
s 0
/
