|
---|
Category:License-Operator
MONTHYEARIR 05000483/20233012023-11-0909 November 2023 NRC Examination Report 05000483-2023301 ML23305A0942023-10-0202 October 2023 10-CW-2023-09 Post-Exam Submittal ML23319A3902023-09-20020 September 2023 11-CW-2023-09 Public Forms ML23240A7572023-08-31031 August 2023 NRC Initial Operator Licensing Examination Approval 05000483/2023301 IR 05000483/20223012022-04-12012 April 2022 NRC Examination Report 05000483/2022301 ML22081A1292022-02-23023 February 2022 CW-2022-02-Post Exam Comments ML22105A0022022-02-23023 February 2022 CW-2022-02-Public Forms ML21067A5392021-03-0808 March 2021 Notification of NRC Initial Operator Licensing Examination 05000483/2022301 ML20276A1522020-09-0909 September 2020 1-CW-2020-08 Draft Outlines ML20276A1532020-09-0909 September 2020 2-CW-2020-08 Draft Outline Comments ML20276A1552020-09-0909 September 2020 4-CW-2020-08 Written Exam Comments Final 8-25-2020 ML20276A1542020-09-0909 September 2020 3-CW-2020-08 Draft Written Exam ML20276A1582020-09-0909 September 2020 7-CW-2020-08 Outlines Final ML20276A1562020-09-0909 September 2020 5-CW-2020-08 Draft Operating Test ML20276A1572020-09-0909 September 2020 6-CW-2020-08 Operating Test Comments - Final BC Comments.Pdf ML20276A1592020-09-0909 September 2020 8-CW-2020-08 Written Exam Final ML20276A1602020-09-0909 September 2020 9-CW-2020-08 Operating Test - Final ML20276A1362020-09-0909 September 2020 10-CW-2020-08 Post-Exam Comments ML20276A1372020-09-0909 September 2020 11-CW-2020-08 Public Forms ML19011A3712019-01-10010 January 2019 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2019 ML18143B4542018-04-25025 April 2018 Operator Licensing Examination Data ML18009A9852018-01-0808 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17270A1662017-09-20020 September 2017 2017-09-DRAFT Op Test Comments ES-301-7 ML17270A1672017-09-20020 September 2017 2017-09-DRAFT Op Test ML17270A1682017-09-20020 September 2017 2017-09-DRAFT Outline Comments ML17270A1692017-09-20020 September 2017 2017-09-DRAFT Outlines ML17270A1702017-09-20020 September 2017 2017-09-Draft Written Exam Comments ES-401-9 ML17270A1712017-09-20020 September 2017 2017-09-DRAFT Written Exam ML17270A1722017-09-20020 September 2017 2017-09-FINAL Op Test ML17270A1732017-09-20020 September 2017 2017-09-FINAL Outlines ML17270A1742017-09-20020 September 2017 2017-09-Final Written Exam ML17270A1752017-09-20020 September 2017 2017-09-Post Exam Comments ML17296A0262017-09-20020 September 2017 2017-09-Public Forms ML17118A1822017-04-17017 April 2017 Submittal of NRC Form 536 Operator Licensing Examination Data ML17058A0822017-02-27027 February 2017 Notification of NRC Initial Operator Licensing Examination 05000483/2017301 ML17013A5482017-01-13013 January 2017 Generic Fundamentals Section of the Written Operator Licensing Examination Scheduled for 2017 ML16196A2392016-06-28028 June 2016 Submittal of Operator Licensing Examination Data ML16158A4692016-06-0101 June 2016 2016-06 Final Outlines ML16179A1772016-06-0101 June 2016 2016-06 Public Forms ML16158A4782016-06-0101 June 2016 2016-06 Post-Examination Analysis and Comments ML16158A4752016-06-0101 June 2016 2016-06 Final Operating Test ML16158A4632016-06-0101 June 2016 2016-06 Draft Operating Test Comments ML16158A4612016-06-0101 June 2016 2016-06 Draft Operating Test ML16158A4602016-06-0101 June 2016 2016-06 Draft Written Examination Comments ML16158A4532016-06-0101 June 2016 2016-06 Draft Outline Comments ML16158A4572016-06-0101 June 2016 2016-06 Draft Written Examination ML16158A4492016-06-0101 June 2016 2016-06 Draft Outlines ML16139A3282016-05-18018 May 2016 NRC Initial Operator Licensing Examination Approval 05000483/2016301 ML16089A0712016-03-29029 March 2016 Generic Fundamentals Examination Results for March 9, 2016 ML15351A0282015-12-17017 December 2015 Generic Fundamentals Section of the Written Operator Licensing Examination Scheduled for 2016 2023-09-20
[Table view] Category:Part 55 Examination Related Material
MONTHYEARIR 05000483/20233012023-11-0909 November 2023 NRC Examination Report 05000483-2023301 ML23305A0942023-10-0202 October 2023 10-CW-2023-09 Post-Exam Submittal ML23319A3902023-09-20020 September 2023 11-CW-2023-09 Public Forms ML23240A7572023-08-31031 August 2023 NRC Initial Operator Licensing Examination Approval 05000483/2023301 IR 05000483/20223012022-04-12012 April 2022 NRC Examination Report 05000483/2022301 ML22081A1292022-02-23023 February 2022 CW-2022-02-Post Exam Comments ML22105A0022022-02-23023 February 2022 CW-2022-02-Public Forms ML20276A1522020-09-0909 September 2020 1-CW-2020-08 Draft Outlines ML20276A1532020-09-0909 September 2020 2-CW-2020-08 Draft Outline Comments ML20276A1552020-09-0909 September 2020 4-CW-2020-08 Written Exam Comments Final 8-25-2020 ML20276A1542020-09-0909 September 2020 3-CW-2020-08 Draft Written Exam ML20276A1582020-09-0909 September 2020 7-CW-2020-08 Outlines Final ML20276A1562020-09-0909 September 2020 5-CW-2020-08 Draft Operating Test ML20276A1572020-09-0909 September 2020 6-CW-2020-08 Operating Test Comments - Final BC Comments.Pdf ML20276A1592020-09-0909 September 2020 8-CW-2020-08 Written Exam Final ML20276A1602020-09-0909 September 2020 9-CW-2020-08 Operating Test - Final ML20276A1362020-09-0909 September 2020 10-CW-2020-08 Post-Exam Comments ML20276A1372020-09-0909 September 2020 11-CW-2020-08 Public Forms ML18143B4542018-04-25025 April 2018 Operator Licensing Examination Data ML18009A9852018-01-0808 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17270A1662017-09-20020 September 2017 2017-09-DRAFT Op Test Comments ES-301-7 ML17270A1672017-09-20020 September 2017 2017-09-DRAFT Op Test ML17270A1682017-09-20020 September 2017 2017-09-DRAFT Outline Comments ML17270A1692017-09-20020 September 2017 2017-09-DRAFT Outlines ML17270A1702017-09-20020 September 2017 2017-09-Draft Written Exam Comments ES-401-9 ML17270A1712017-09-20020 September 2017 2017-09-DRAFT Written Exam ML17270A1722017-09-20020 September 2017 2017-09-FINAL Op Test ML17270A1732017-09-20020 September 2017 2017-09-FINAL Outlines ML17270A1742017-09-20020 September 2017 2017-09-Final Written Exam ML17270A1752017-09-20020 September 2017 2017-09-Post Exam Comments ML17296A0262017-09-20020 September 2017 2017-09-Public Forms ML17118A1822017-04-17017 April 2017 Submittal of NRC Form 536 Operator Licensing Examination Data ML17058A0822017-02-27027 February 2017 Notification of NRC Initial Operator Licensing Examination 05000483/2017301 ML16196A2392016-06-28028 June 2016 Submittal of Operator Licensing Examination Data ML16158A4492016-06-0101 June 2016 2016-06 Draft Outlines ML16158A4532016-06-0101 June 2016 2016-06 Draft Outline Comments ML16158A4572016-06-0101 June 2016 2016-06 Draft Written Examination ML16158A4602016-06-0101 June 2016 2016-06 Draft Written Examination Comments ML16158A4612016-06-0101 June 2016 2016-06 Draft Operating Test ML16158A4632016-06-0101 June 2016 2016-06 Draft Operating Test Comments ML16158A4692016-06-0101 June 2016 2016-06 Final Outlines ML16158A4752016-06-0101 June 2016 2016-06 Final Operating Test ML16158A4782016-06-0101 June 2016 2016-06 Post-Examination Analysis and Comments ML16179A1772016-06-0101 June 2016 2016-06 Public Forms ML16139A3282016-05-18018 May 2016 NRC Initial Operator Licensing Examination Approval 05000483/2016301 ML16089A0712016-03-29029 March 2016 Generic Fundamentals Examination Results for March 9, 2016 ML15351A0282015-12-17017 December 2015 Generic Fundamentals Section of the Written Operator Licensing Examination Scheduled for 2016 ML15140A1262015-05-18018 May 2015 2015-05-FINAL Written Exam ML15146A0482015-05-18018 May 2015 2015-05-Public Forms ML15140A2892015-05-18018 May 2015 2015-05-Draft Written Exam Comments Rev 1 2023-09-20
[Table view] |
Text
ES-401 Written Examination Form ES-401-9 (R8, Si)
Review Worksheet CALLAWAY 7/2002
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK (F/H)
LOD (1-5) Stem II Cues T/F ICred. 1 Partial Job- Minutia I°
- / Back- Q= SRO UIE/S Explanation Focus Dist. Link units I ward K/A IOnly R1 F 2 S t R2 F 2 S R3 F 3 S R4 F 3 S t R5 H 3 S R6 F 3 S R7 H 3 S R8 H 3 S R9 F 3 S R10 H 3 S Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
More than one distractor is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 7. At a minimum, explain any "U"ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 6
ES-401 2 Form ES-401-9 (R8, Si)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only R11 H 3 S R12 H 3 S R13 H 3 S R14 H 3 S t Ri15 F 3 S R16 F 3 S R17 F 3 S R18 F 3 S R19 H 3 S R20 H 3 5 t R21 F 2 S R22 F 2 S R23 F 4 S t R24 F 3 S R25 F 3 S S1 F 3 S S2 F 3 S Reference in stem should be to step 5 of FR-S.1 S3 F 3 S t S4 F 3 S S5 H 3 S S6 H 3 S t S7 F 3 V E Provide a lower RWST level for Distractor D Page 2 of 6
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 88 F 3 S t S9 F 3 S S10 H 3 S S11 H 3 S S12 F 3 S S13 F 3 S 814 H 3 S S15 H 4 S t 816 F 3 S S17 F 3 S t S18 F 3 S 819 F 3 S S20 H 3 S S21 F 3 S s22 F 3 S S23 F 3 S 824 H 3 S 825 F 2 S B1 H 3 S B2 F 3 S B3 H 3 S t B4 H 3 S B5 H 3 S B6 F 3 S B7 H 3 S B8 H 2 S Page 3 of 6
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only B9 H 3 S B10 H 3 1 S t Where is expectation that students know battery capacity?
B1l F 3 S B12 F 3 S B13 H 3 S B14 F 3 S B15 F 3 S B16 F 3 S B17 H 3 S It B18 H 3 S B19 H 3 S B20 H 3 S t B21 H 3 S t B22 F 3 S B23 F 3 S B24 H 3 S B25 H 3 S B26 H 3 S B27 H 3 S t B28 H 3 S t B29 H 3 S B30 F 3 S 831 F 3 S B32 H 3 S B33 H 3 S B34 H 3 S t Page 4 of 6
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only B35 H 3 E Clarify Distractor C and Answer D to indicate this alarm comes in after subsequent inward rod movement. One is led to believe that the alarm is recieved as a result of the rod recovery.
B36 H 3 S B37 H 3 S t B38 H 4 S t B39 H 3 S B40 H 3 S 841 H 3 S B42 H 3 S B43 H 3 S B44 H 3 S t 845 H 2 S B46 F 3 S B47 F 2 S B48 F 3 S t B49 H 3 S 850 F 3 S 851 H 3 S B52 H 4 S t B53 H 4 E t Containment pressure @ 10 psig and increasing 1 psig per minute does not appear to be consistent with CSAS @ 27 psig. Clarify initial conditions and subsequent pressure increase.
854 F 3 S 855 H 3 S t B56 H 3 S B57 H 3 S B58 H 3 S Page 5 of 6
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only B59 F 3 S B60 H 3 S B61 F 2 S t B62 H 3 S t B63 F 3 S B64 F 2 S B65 H 3 S t B66 F 2 S t B67 F 3 S B68 F 2 S B69 F 3 S B70 F 2 S B71 F 2 S t B72 F 3 S B73 H 3 S B74 H 3 S B75 H 3 S tReviewed as part of initial 30 question sample Page 6 of 6