|
---|
Category:License-Operator
MONTHYEARIR 05000275/20253012024-10-0303 October 2024 Notification of NRC Initial Operator Licensing Examination 05000275/2025301; 05000323/2025301 DCL-24-079, DC-2024-07 Post Exam Comments Analysis2024-08-0202 August 2024 DC-2024-07 Post Exam Comments Analysis ML24250A0182024-08-0202 August 2024 DC-2024-07 Public Forms ML24190A0812024-07-10010 July 2024 NRC Initial Operator Licensing Examination Approval 05000275/2024301; 05000323/2024301 DCL-24-042, Response to NRC Regulatory Issue Summary 2024-01, Preparation and Scheduling of Operator Licensing Examinations2024-04-17017 April 2024 Response to NRC Regulatory Issue Summary 2024-01, Preparation and Scheduling of Operator Licensing Examinations ML23236A4682023-08-24024 August 2023 Notification of NRC Initial Operator Licensing Examination 05000275/2024301; 05000323/2024301 IR 05000275/20213012023-08-0909 August 2023 Errata for Diablo Canyon Power Plant, Units 1 and 2 - NRC Examination Report 050002752021301 and 050003232021301 ML22342B2442022-12-13013 December 2022 DC-2023-07 Corporate Notification Letter ML21075A2312021-02-12012 February 2021 DC-2021-01 Public Forms ML21075A2222021-02-12012 February 2021 DC-2021-01 Draft Outline Comments ML21075A0882021-02-12012 February 2021 DC-2021-01 Final Written Exam ML21075A2252021-02-12012 February 2021 DC-2021-01 Draft Written Exam ML21075A2262021-02-12012 February 2021 DC-2021-01 Final Outlines ML21075A2212021-02-12012 February 2021 DC-2021-01 Draft Op Test DCL-21-017, DC-2021-01 Post Exam Comments Analysis2021-02-12012 February 2021 DC-2021-01 Post Exam Comments Analysis ML21075A2202021-02-12012 February 2021 DC 2021-01 Draft Op Test Comments ML21075A0872021-02-12012 February 2021 DC-2021-01 Final Op Test DCL-20-073, DC-2021-01 Draft Outlines2021-02-12012 February 2021 DC-2021-01 Draft Outlines ML21075A2242021-02-12012 February 2021 DC-2021-01 Draft Written Comments DCL-20-017, 2020-02-Post-Exam Comments2020-03-18018 March 2020 2020-02-Post-Exam Comments ML20097A4462020-03-0606 March 2020 2020-02-FINAL Operating Test ML20106E2762020-03-0606 March 2020 2020-02-Public Forms ML20106E4672020-03-0606 March 2020 2020-02-DRAFT Written Exam Comments ML20106F1862020-03-0606 March 2020 2020-02-Form ES-403-1-Written Examination Grading.Pdf ML20106E4652020-03-0606 March 2020 2020-02-Draft Outline Comments ML20106E4662020-03-0606 March 2020 2020-02-DRAFT Outlines ML20106E4702020-03-0606 March 2020 2020-02-FINAL Outlines ML20106E4612020-03-0606 March 2020 2020-02-DRAFT Operating Test Comments ML20106E4632020-03-0606 March 2020 2020-02-DRAFT Operating Test ML20106E4682020-03-0606 March 2020 2020-02-DRAFT Written Exam ML20097A4502020-03-0606 March 2020 2020-02-FINAL Written Exam IR 05000275/20203012020-02-19019 February 2020 NRC Initial Operator Licensing Examination Approval 05000275/2020301; 05000323/2020301 DCL-19-027, Supplement to Request for Exemption from Operator Written Examination and Operating Test2019-04-0303 April 2019 Supplement to Request for Exemption from Operator Written Examination and Operating Test ML19050A4872019-01-25025 January 2019 DC 2019-01 Draft Operating Test ML19050A4942019-01-25025 January 2019 DC 2019-01 Post Examination Comments ML19050A4952019-01-25025 January 2019 DC-2019-01 Draft Operating Test Comments ML19050A4892019-01-25025 January 2019 DC 2019-01 Draft Outlines ML19050A4922019-01-25025 January 2019 DC 2019-01 Final Outlines ML19050A4912019-01-25025 January 2019 DC 2019-01 Final Operating Test ML19050A4902019-01-25025 January 2019 DC 2019-01 Draft Written Examination Comments ML19078A1252019-01-25025 January 2019 DC-2019-01 Public Forms ML19050A4882019-01-25025 January 2019 DC 2019-01 Draft Outline Comments ML19050A4932019-01-25025 January 2019 DC 2019-01 Final Written Examination ML19050A4962019-01-25025 January 2019 DC-2019-01 Draft Written Examination ML19011A3712019-01-10010 January 2019 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2019 ML19007A1132019-01-0303 January 2019 NRC Initial Operator Licensing Examination Approval 05000275/2019301; 05000323/2019301 DCL-18-039, Response to NRC Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations2018-05-14014 May 2018 Response to NRC Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations ML18064A3562018-02-27027 February 2018 DC 2018-01 Post Examination Analysis ML18064A3482018-02-0909 February 2018 DC 2018-01 Draft Operating Test Comments ML18064A3502018-02-0909 February 2018 DC 2018-01 Draft Outline Comments 2024-08-02
[Table view] Category:Part 55 Examination Related Material
MONTHYEARIR 05000275/20253012024-10-0303 October 2024 Notification of NRC Initial Operator Licensing Examination 05000275/2025301; 05000323/2025301 DCL-24-079, DC-2024-07 Post Exam Comments Analysis2024-08-0202 August 2024 DC-2024-07 Post Exam Comments Analysis ML24250A0182024-08-0202 August 2024 DC-2024-07 Public Forms ML24190A0812024-07-10010 July 2024 NRC Initial Operator Licensing Examination Approval 05000275/2024301; 05000323/2024301 DCL-24-042, Response to NRC Regulatory Issue Summary 2024-01, Preparation and Scheduling of Operator Licensing Examinations2024-04-17017 April 2024 Response to NRC Regulatory Issue Summary 2024-01, Preparation and Scheduling of Operator Licensing Examinations ML23236A4682023-08-24024 August 2023 Notification of NRC Initial Operator Licensing Examination 05000275/2024301; 05000323/2024301 IR 05000275/20213012023-08-0909 August 2023 Errata for Diablo Canyon Power Plant, Units 1 and 2 - NRC Examination Report 050002752021301 and 050003232021301 ML22342B2442022-12-13013 December 2022 DC-2023-07 Corporate Notification Letter ML21075A2212021-02-12012 February 2021 DC-2021-01 Draft Op Test ML21075A2222021-02-12012 February 2021 DC-2021-01 Draft Outline Comments ML21075A2262021-02-12012 February 2021 DC-2021-01 Final Outlines ML21075A2242021-02-12012 February 2021 DC-2021-01 Draft Written Comments ML21075A2202021-02-12012 February 2021 DC 2021-01 Draft Op Test Comments ML21075A2252021-02-12012 February 2021 DC-2021-01 Draft Written Exam DCL-21-017, DC-2021-01 Post Exam Comments Analysis2021-02-12012 February 2021 DC-2021-01 Post Exam Comments Analysis ML21075A0882021-02-12012 February 2021 DC-2021-01 Final Written Exam DCL-20-073, DC-2021-01 Draft Outlines2021-02-12012 February 2021 DC-2021-01 Draft Outlines ML21075A2312021-02-12012 February 2021 DC-2021-01 Public Forms ML21075A0872021-02-12012 February 2021 DC-2021-01 Final Op Test DCL-20-017, 2020-02-Post-Exam Comments2020-03-18018 March 2020 2020-02-Post-Exam Comments ML20106E4672020-03-0606 March 2020 2020-02-DRAFT Written Exam Comments ML20106E4662020-03-0606 March 2020 2020-02-DRAFT Outlines ML20106E4652020-03-0606 March 2020 2020-02-Draft Outline Comments ML20097A4462020-03-0606 March 2020 2020-02-FINAL Operating Test ML20106E4682020-03-0606 March 2020 2020-02-DRAFT Written Exam ML20106E4612020-03-0606 March 2020 2020-02-DRAFT Operating Test Comments ML20097A4502020-03-0606 March 2020 2020-02-FINAL Written Exam ML20106E4702020-03-0606 March 2020 2020-02-FINAL Outlines ML20106E2762020-03-0606 March 2020 2020-02-Public Forms ML20106F1862020-03-0606 March 2020 2020-02-Form ES-403-1-Written Examination Grading.Pdf ML20106E4632020-03-0606 March 2020 2020-02-DRAFT Operating Test IR 05000275/20203012020-02-19019 February 2020 NRC Initial Operator Licensing Examination Approval 05000275/2020301; 05000323/2020301 DCL-19-027, Supplement to Request for Exemption from Operator Written Examination and Operating Test2019-04-0303 April 2019 Supplement to Request for Exemption from Operator Written Examination and Operating Test ML19050A4952019-01-25025 January 2019 DC-2019-01 Draft Operating Test Comments ML19050A4912019-01-25025 January 2019 DC 2019-01 Final Operating Test ML19050A4882019-01-25025 January 2019 DC 2019-01 Draft Outline Comments ML19050A4932019-01-25025 January 2019 DC 2019-01 Final Written Examination ML19078A1252019-01-25025 January 2019 DC-2019-01 Public Forms ML19050A4942019-01-25025 January 2019 DC 2019-01 Post Examination Comments ML19050A4902019-01-25025 January 2019 DC 2019-01 Draft Written Examination Comments ML19050A4872019-01-25025 January 2019 DC 2019-01 Draft Operating Test ML19050A4892019-01-25025 January 2019 DC 2019-01 Draft Outlines ML19050A4962019-01-25025 January 2019 DC-2019-01 Draft Written Examination ML19050A4922019-01-25025 January 2019 DC 2019-01 Final Outlines ML19007A1132019-01-0303 January 2019 NRC Initial Operator Licensing Examination Approval 05000275/2019301; 05000323/2019301 DCL-18-039, Response to NRC Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations2018-05-14014 May 2018 Response to NRC Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations ML18064A3562018-02-27027 February 2018 DC 2018-01 Post Examination Analysis ML18064A3522018-02-0909 February 2018 DC 2018-01 Draft Written Examination Comments ML18064A3512018-02-0909 February 2018 DC 2018-01 Draft Outlines ML18064A3492018-02-0909 February 2018 DC 2018-01 Draft Operating Test 2024-08-02
[Table view] |
Text
ES-401 DC-2012-01 Written Examination Review Worksheet Form ES-401-9 Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 5 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
H 3
N S
2 H
3 X
X N
ES Remove 25% from stem Removed 3
F 2
N S
4 H
3 X
N ES Add valve name; A&B explanations backward Valve name added, A&B revised 5
H 3
X X
N ES Add stem focus; make B&C more credible Stem and B&C modified 6
H 3
X X
B ES Add stem and distracter focus Added 7
H 2
X N
ES A not credible Replaced A 8
H 2
X N
US C only answer plausible Modified Q to make distracters more plausible 9
H 2
X N
ES Add stem focus Moved to Q 34 - Replaced with new Q 10 H
2 X
X N
US Got correct answer w/o reading Q Modified distracters to remove problem
ES-401 DC-2012-01 2
Form ES-401-9 Page 2 of 5 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 11 H
3 X
N US Two correct answers Modified Q to ensure only one correct answer 12 H
2 X
X M
ES Modify all distracters to make Q plausible Distracters modified 13 F
2 X
N ES Modify D&C to be consistent with A&B Modified 14 H
2 X
N ES Modify stem Modified 15 H
2 X
X N
ES Modify stem and distracters Modified 16 H
2 X
M ES Get rid of unnecessary info in stem Modified stem 17 H
2 X
B ES Add the in stem Added 18 F
3 N
S 19 H
3 X
N ES Modify stem Modified 20 F
3 X
M ES D not an action (replace D) Replaced D 21 F
3 N
S 22 F
3 X
X N
ES Modify stem; add second half to A Modified Stem and distracter A 23 F
2 X
N ES Modify stem Modified 24 F
2 X
B S
25 F
2 B
S 26 F
2 X
B ES Modify stem to include info in all four distracters Modified 27 F
2 X
B ES Change stem to make B correct Changed stem 28 F
2 B
S 29 H
3 X
N ES Modify stem Modified 30 H
2 N
S 31 H
3 B
S 32 F
3 X
N US A &C not credible Replaced 33 F
3 X
N ES Change D to average Changed 34 F
3 X
N US Three of four distracters can be eliminated with partial knowledge Replaced Q 35 F
2 X
N ES Modify stem Modified
ES-401 DC-2012-01 3
Form ES-401-9 Page 3 of 5 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 36 F
3 X
X N
ES Modify stem; add info to C&D Modified stem; C&D info added 37 F
3 X
N ES Add caps to only and and in all distracters Added 38 H
3 X
N ES Modify stem; change will to should Modified stem, change made 39 F
3 X
B ES Add actual temp in stem Added 40 H
2 X
N ES Get rid of steam table reference Removed 41 H
2 X
N ES Modify stem Modified 42 H
2 N
S 43 H
3 N
S 44 F
3 X
B ES Modify stem Modified 45 F
3 X
X N
ES Modify stem; C contradicts info in stem (change) Modified stem, Changed C 46 H
2 X
N ES Add clarification to all distracters Added 47 H
2 X
N US Two non credible distracters Replaced distracter A 48 F
3 X
X N
ES Change EDGs to 11 and 12 (change correct answer) Changed 49 H
3 X
N ES A none of the above (replace) Replaced A 50 H
3 X
X N
ES Modify stem; fix A to ensure not cueing correct answer Modified stem and distracter A 51 H
2 X
X N
ES Modify stem; change temps in distracters to off exact setpoint Modified stem & temps 52 H
2 X
M US Too similar to Q 27 (replace) Replaced Q 53 H
3 X
B ES Modify stem Modified 54 F
2 B
S 55 H
3 N
S 56 H
2 X
B US A&C not credible Replaced Q 57 H
2 N
S 58 H
2 X
M ES Remove turbine load info from stem Replaced Q 59 H
2 X
N ES Remove no effect from A Removed 60 H
3 X
B ES Capitalize only in stem Capitalized only
ES-401 DC-2012-01 4
Form ES-401-9 Page 4 of 5 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 61 H
2 X
N ES Capitalize maximum in stem Maximum capitalized 62 F
2 X
X N
ES Modify stem; revise A,B,&C Modified stem, revised A,B,&C 63 H
3 X
X N
ES Modify stem; verify A incorrect Modified stem and distracter A 64 H
3 X
B ES Modify stem Modified 65 H
3 X
N ES Modify stem Modified 66 F
2 B
S 67 F
2 N
S 68 H
3 N
S 69 F
2 X
B ES Modify stem to ensure only one correct answer Modified 70 F
2 N
S 71 F
3 X
N ES Modify stem Modified 72 F
3 X
B ES Modify stem Modified 73 F
2 X
N S
74 F
2 X
X N
ES Modify stem to ensure only one correct answer Modified 75 H
3 B
S 76 F
3 X
X N
ES Replace directs with considers in stem Revised stem 77 H
3 X
X N
ES Modify stem Modified 78 H
3 X
X N
ES Revise B&C Revised 79 H
3 X
X N
ES Ensure D incorrect Replaced D 80 H
3 X
X M
ES Modify stem, ensure B incorrect Modified stem and ensured B incorrect 81 F
2 X
X N
ES Modify A Replaced A 82 H
3 X
N S
83 H
3 X
B S
84 F
2 X
N S
85 F
3 X
X N
ES Modify stem Modified
ES-401 DC-2012-01 5
Form ES-401-9 Page 5 of 5 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 86 H
3 X
X N
ES Modify stem Modified 87 H
2 X
N S
88 H
2 X
X N
US A&B not credible - modify stem to have PZR level at 12% Modified A,B, & stem 89 H
2 X
X N
ES Add power level to stem - get rid of unnecessary info Added and revised 90 F
2 X
X X
N S
91 H
3 X
X N
ES Supplement D Supplemented 92 H
3 X
X N
ES Modify A Modified A 93 H
3 X
X N
ES Add additional words to C to make it consistent with other distracters Modified C 94 F
2 X
X B
ES Modify C Modified 95 F
2 X
X B
ES Modify stem Modified 96 F
2 X
X N
ES Put required in caps in stem Modified stem 97 F
3 X
X N
ES Modify stem Modified 98 F
3 X
X X
N ES Replace D; remove if at all from stem Modified stem, Replaced D 99 H
3 X
X B
ES Add where explosion occurred in stem Added 100 H
2 X
X N
ES Modify stem Modified