|
---|
Category:License-Operator
MONTHYEARML24164A2582024-05-0909 May 2024 10-PV-2024-04 Post-Exam Comments ML24170B0072024-05-0909 May 2024 11-PV-2024-04 Public Forms ML24128A2702024-05-0707 May 2024 Docket Nos. Stn 50-528/529/530 - Response to NRC Regulatory Issue Summary (RIS) 2024-01, Preparation and Scheduling of Operator Licensing Examinations IR 05000528/20243012024-04-22022 April 2024 NRC Initial Operator Licensing Examination Approval 05000528/2024301, 05000529/2024301, and 05000530/2024301 ML23145A2772023-05-17017 May 2023 10-PV-2023-05 Post-Exam Comments ML23151A6492023-05-11011 May 2023 11-PV-2023-05 Public Forms ML23108A0342023-04-18018 April 2023 NRC Initial Operator Licensing Examination Approval 05000528/2023301; 05000529/2023301; 05000530/2023301 ML22196A3782022-07-15015 July 2022 Notification of NRC Initial Operator Licensing Examination 05000528/2023301; 05000529/2023301; 05000530/2023301 ML22143A9892022-05-19019 May 2022 PV-2022-05-Post Exam Comments ML22178A1772022-04-12012 April 2022 PV-2022-05-Public Forms ML23193A8502022-04-12012 April 2022 PV-2022-05-Form 2.3-1 Examination Outline Quality Checklist ML22070A1382022-03-10010 March 2022 Response to Regulatory Issue Summary (RIS) 2022-01, Preparation and Scheduling of Operator Licensing Examinations IR 05000528/20213012021-06-21021 June 2021 NRC Initial Examination Report 05000528/2021301, 05000529/2021301, and 05000530/2021301 ML21160A0832021-06-21021 June 2021 NRC Initial Examination Report 05000528/2021301, 05000529/2021301, and 05000530/2021301 ML21147A5452021-05-0606 May 2021 04 Public Forms ML21147A5442021-05-0606 May 2021 04 Post Examination Analysis ML21106A3042021-04-16016 April 2021 Response to Regulatory Issue Summary (RIS) 2021-01, Preparation and Scheduling of Operator Licensing Examinations ML21106A2842021-04-14014 April 2021 Generic Fundamentals Examination Results March 2021 ML21020A1032020-12-10010 December 2020 11 Post Examination Analysis ML21020A1042020-12-10010 December 2020 11 Public Forms ML21020A0952020-12-10010 December 2020 11 Final Operating Test ML21020A0982020-12-10010 December 2020 2020-11 Draft Operating Test Comments ML21020A0932020-12-10010 December 2020 11 Draft Written Examination Comments ML21020A0962020-12-10010 December 2020 11 Final Outlines ML21020A0942020-12-10010 December 2020 11 Draft Written Examination ML21020A0902020-12-10010 December 2020 11 Draft Operating Test ML21020A0972020-12-10010 December 2020 11 Final Written Examination ML21020A0912020-12-10010 December 2020 11 Draft Outline Comments ML21020A0922020-12-10010 December 2020 11 Draft Outlines ML20325A3682020-11-20020 November 2020 NRC Initial Operator Licensing Examination Approval 05000528/2020301; 05000529/2020301; 05000530/2020301 ML20199M3832020-07-17017 July 2020 Response to Regulatory Issue Summary (RIS) 2020-01, Preparation and Scheduling of Operator Licensing Examinations ML20003E2762019-10-11011 October 2019 PV-2019-10 Post Exam Comments and Analysis ML19273C8072019-09-30030 September 2019 NRC Initial Operator Licensing Exam Approval Letter 05000528/529/530/2019301 ML19135A3352019-05-15015 May 2019 Response to Regulatory Issue Summary (RIS) 2019-02, Preparation and Scheduling of Operator Licensing Examinations ML20042C1192019-03-12012 March 2019 PV-2019-10 Public Forms ML19045A3732019-02-12012 February 2019 March 2019 GFE Cover Letter Riv ML19011A3712019-01-10010 January 2019 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2019 ML18284A4942018-09-25025 September 2018 NRC Retake Initial Operator Licensing Examination Approval 05000528/2018302, 05000529/2018302 and 05000530/2018302 ML18184A3552018-06-29029 June 2018 Response to Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations - Update ML18122A3722018-05-0101 May 2018 Response to Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations ML18086B0842018-02-16016 February 2018 Facility Cover Letter - Riv - March 2018 - GFE ML18009A9852018-01-0808 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17124A2082017-05-0404 May 2017 Response to Regulatory Issue Summary (RIS) 2017-03, Preparation and Scheduling of Operator Licensing Examinations ML17013A5482017-01-13013 January 2017 Generic Fundamentals Section of the Written Operator Licensing Examination Scheduled for 2017 ML16321A4722016-11-0303 November 2016 10 Draft Written Exam Pedigree ML16321A4652016-11-0303 November 2016 Palo VERDE-2016-10 Final Operating Test ML16321A4692016-11-0303 November 2016 2016-10-DRAFT Outline Comments Rev 2 with PVNGS Response ML16321A4632016-11-0303 November 2016 Palo VERDE-2016-10 Final Written Exam ML16321A4682016-11-0303 November 2016 2016-10 Draft Outlines ML16321A4662016-11-0303 November 2016 Palo VERDE-2016-10 Post-Exam Comments 2024-05-09
[Table view] Category:Part 55 Examination Related Material
MONTHYEARML24164A2582024-05-0909 May 2024 10-PV-2024-04 Post-Exam Comments ML24170B0072024-05-0909 May 2024 11-PV-2024-04 Public Forms ML24128A2702024-05-0707 May 2024 Docket Nos. Stn 50-528/529/530 - Response to NRC Regulatory Issue Summary (RIS) 2024-01, Preparation and Scheduling of Operator Licensing Examinations IR 05000528/20243012024-04-22022 April 2024 NRC Initial Operator Licensing Examination Approval 05000528/2024301, 05000529/2024301, and 05000530/2024301 ML23145A2772023-05-17017 May 2023 10-PV-2023-05 Post-Exam Comments ML23151A6492023-05-11011 May 2023 11-PV-2023-05 Public Forms ML23108A0342023-04-18018 April 2023 NRC Initial Operator Licensing Examination Approval 05000528/2023301; 05000529/2023301; 05000530/2023301 ML22196A3782022-07-15015 July 2022 Notification of NRC Initial Operator Licensing Examination 05000528/2023301; 05000529/2023301; 05000530/2023301 ML22143A9892022-05-19019 May 2022 PV-2022-05-Post Exam Comments ML22178A1772022-04-12012 April 2022 PV-2022-05-Public Forms ML23193A8502022-04-12012 April 2022 PV-2022-05-Form 2.3-1 Examination Outline Quality Checklist ML22070A1382022-03-10010 March 2022 Response to Regulatory Issue Summary (RIS) 2022-01, Preparation and Scheduling of Operator Licensing Examinations ML21160A0832021-06-21021 June 2021 NRC Initial Examination Report 05000528/2021301, 05000529/2021301, and 05000530/2021301 IR 05000528/20213012021-06-21021 June 2021 NRC Initial Examination Report 05000528/2021301, 05000529/2021301, and 05000530/2021301 ML21147A5452021-05-0606 May 2021 04 Public Forms ML21147A5442021-05-0606 May 2021 04 Post Examination Analysis ML21106A3042021-04-16016 April 2021 Response to Regulatory Issue Summary (RIS) 2021-01, Preparation and Scheduling of Operator Licensing Examinations ML21020A0922020-12-10010 December 2020 11 Draft Outlines ML21020A0912020-12-10010 December 2020 11 Draft Outline Comments ML21020A0932020-12-10010 December 2020 11 Draft Written Examination Comments ML21020A0942020-12-10010 December 2020 11 Draft Written Examination ML21020A0952020-12-10010 December 2020 11 Final Operating Test ML21020A0972020-12-10010 December 2020 11 Final Written Examination ML21020A0902020-12-10010 December 2020 11 Draft Operating Test ML21020A0982020-12-10010 December 2020 2020-11 Draft Operating Test Comments ML21020A1032020-12-10010 December 2020 11 Post Examination Analysis ML21020A1042020-12-10010 December 2020 11 Public Forms ML21020A0962020-12-10010 December 2020 11 Final Outlines ML20325A3682020-11-20020 November 2020 NRC Initial Operator Licensing Examination Approval 05000528/2020301; 05000529/2020301; 05000530/2020301 ML20199M3832020-07-17017 July 2020 Response to Regulatory Issue Summary (RIS) 2020-01, Preparation and Scheduling of Operator Licensing Examinations ML20003E2762019-10-11011 October 2019 PV-2019-10 Post Exam Comments and Analysis ML19273C8072019-09-30030 September 2019 NRC Initial Operator Licensing Exam Approval Letter 05000528/529/530/2019301 ML19135A3352019-05-15015 May 2019 Response to Regulatory Issue Summary (RIS) 2019-02, Preparation and Scheduling of Operator Licensing Examinations ML20042C1192019-03-12012 March 2019 PV-2019-10 Public Forms ML18284A4942018-09-25025 September 2018 NRC Retake Initial Operator Licensing Examination Approval 05000528/2018302, 05000529/2018302 and 05000530/2018302 ML18184A3552018-06-29029 June 2018 Response to Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations - Update ML18122A3722018-05-0101 May 2018 Response to Regulatory Issue Summary (RIS) 2018-02, Preparation and Scheduling of Operator Licensing Examinations ML18009A9852018-01-0808 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17124A2082017-05-0404 May 2017 Response to Regulatory Issue Summary (RIS) 2017-03, Preparation and Scheduling of Operator Licensing Examinations ML16321A4682016-11-0303 November 2016 2016-10 Draft Outlines ML16321A4652016-11-0303 November 2016 Palo VERDE-2016-10 Final Operating Test ML16321A4632016-11-0303 November 2016 Palo VERDE-2016-10 Final Written Exam ML16321A4862016-11-0303 November 2016 Palo VERDE-2016-10 Draft Operating Test Comments ML16340B6372016-11-0303 November 2016 Palo VERDE-2016-10 Public Forms ML16321A4662016-11-0303 November 2016 Palo VERDE-2016-10 Post-Exam Comments ML16321A4692016-11-0303 November 2016 2016-10-DRAFT Outline Comments Rev 2 with PVNGS Response ML16321A4882016-11-0303 November 2016 Palo VERDE-2016-10 Final Outlines ML16321A4832016-11-0303 November 2016 Palo VERDE-2016-10 Draft Operating Test ML16321A4722016-11-0303 November 2016 10 Draft Written Exam Pedigree ML16321A4792016-11-0303 November 2016 2016-10 Draft Written Exam Comments 2024-05-09
[Table view] |
Text
ES-401 PV-2009-11 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C41.10 1 H 3 N S Agree D41.4 Answer states that the switch needs to be placed in START; however, the E
2 H 2 N reference says place the switch in AUTO.
S Agree - Stem was revised to correct wording.
E D41.7 Reformat the answers without all the bullets.
3 F 2 N S Agree A41.10 May clue that question 1, distractors A and B are incorrect.
4 F 2 M S OK as written.
5 H 3 N S D41.3 E B41.7 See markup 6 H 3 N S Comment was corrected.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
$ The answer choices are a collection of unrelated true/false statements.
$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
$ The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met). Page 1 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 2 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only E B41.4 See markup 7 H 3 N S Markup was corrected.
8 H 2 B S B41.3 9 F 2 N S D41.1 E C41.10 See markup 10 F 3 B S Markup was corrected.
11 F 2 N S B41.5 12 F 2 N S A41.5 13 H 3 N S D41.5 14 H 2 M S D41.10 15 F 2 B S B41.7 16 H 3 N S C41.5 17 F 3 N S B41.4 18 H 2 M S D41.5 C41.6, 43.2 See markups.
U 19 F 2 U N Agree - TS bases makes it an SRO question.
S The TS bases was removed from the question.
20 F 3 N S B41.5, 10 21 H 3 M S B41.7 E D41.5 See markup.
22 H 3 M S Markup was revised.
23 F 2 B S C41.7 24 H 3 N S C41.10 25 F 3 B S A41.11 26 H 3 N S B41.10 27 H 3 N E D41.10 VERIFY that PBB-S04 cannot be energized based on given information. Page 2 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 3 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S It would seem distractor B could be argued as also correct.
Distractor B was revised.
E A41.5 See markup.
28 F 2 N S Markup was corrected.
29 H 2 M S A41.7 30 H 3 N S D41.7 31 F 3 B S D41.4 32 H 2 N S B41.7 33 H 3 N S B41.5 E D41.5 See markup.
34 H 2 M S Markup was corrected.
35 F 2 N S A41.10 36 H 2 N S A41.7 E C41.5 See markup.
37 F 3 B S Markup was corrected.
38 H 3 N S C41.7 39 F 3 N S D41.7 40 F 3 N S C41.7 41 F 3 N S A41.4 42 H 3 N S C41.7 NOT true/false because knowledge of mini-flow ops is required to answer.
E C41.7 See markup.
43 H 3 N S Markup was corrected.
44 H 3 N S A41.7 45 H 2 M S C41.7 46 H 3 N S A, 41.7 47 F 2 N S A, 41.10 Page 3 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 4 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 H 3 M S A, 41.7 49 H 3 B S A, 41.7 50 H 3 B S A, 41.7 51 F 2 B S B, 41.7 52 H 3 N S C, 41.11 53 H 3 N S B, 41.7 54 F 2 B S A, 41.7 55 H 3 N S C, 41.7 56 H 3 N S A, 41.5 57 F 2 M S B, 41.2 58 F 2 N S A, 41.7 59 F 2 N S D, 41.2 60 H 2 B S A, 41.7 A, 41.10 - This question could be argued to have no correct answer since it does not E
61 F 3 N address the conditions as presented in the LOCA EOP (step 66). FIX S
The question was revised to correct the stem.
62 H 3 N S A, 41.7 63 H 3 M S B, 41.5 64 F 2 N S B, 41.4 65 H 3 N S C, 41.7 66 F 2 N S B, 41.10 D, 41.7 - This is a KA mismatch because Tier 3 questions are meant to have generic U
67 H 3 U M implications and not system specific.
S This question was revised.
68 F 3 B S C, 41.10 D, 41.3 - Not sure the question is correct. The TS limits may not be the same as the 69 F 3 N E design criteria. CAF. Page 4 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 5 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S This question is ok as written.
70 H 3 N S A, 41.10 71 F 3 N S B, 41.10 72 H 3 N S B, 41.12 73 F 2 N S B, 41.12 E D, 41.10 - Clean up the stem.
74 H 3 N S The stem was redone to fix the formatting.
75 F 2 N S C, 41.10 - Could not locate the referenced picture.
76 H 3 N S B, 43.5 77 H 3 N S C, 43.5 78 H 3 M S D, 43.5 79 H 3 M S D, 43.5 80 H 2 B S A, 43.5 D, 41.10 - This is an RO question because it tests on specific actions taken by the U
81 H 3 U M operator.
S This question was revised.
82 H 3 M S C, 43.5 83 H 3 N S A, 43.5 84 H 3 M S A, 43.5 E B, 43.2 - Not sure why this is a memory question. CAF 85 F 3 M S This question is supported by a learning objective.
86 F 2 N S D, 41.10 87 H 3 N S D, 43.5 88 H 3 N S B, 41.10 89 H 4 N S A, 43.5 90 F 3 M S A, 43.5 Page 5 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 6 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 91 H 3 N S A, 43.5 92 H 3 B S A, 43.5 93 H 3 N S B, 43.2 D, 41.10 - This is RO knowledge since it can be answered without doing a procedure U
94 H 3 U N selection.
S This question is ok as written.
95 F 3 N S A, 41.10 E B, 43.2 - Not sure SROs need to have all the 3.0.3 entry specs memorized. CAF 96 F 3 B S OK as written.
97 H 3 N S C, 43.5 U C, 41.10 - This is RO knowledge since it tests on specific operator actions.
98 H 3 U N S This question is ok as written.
U B, 41.10 - Procedure usage is RO knowledge.
99 F 2 U N S This question was replaced.
E B, 41.10 - Not sure this is a valid memory question.
100 F 3 E N S This question is supported by a learning objective.
B= F= E=
RO TOTALS: M= H= U= Additional Notes:
N=
B= F= E=
SRO TOTALS: M= H= U= Additional Notes:
N=
S:
- 1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N.
- 2. Chief Examiner comments are indicated in blue.
- 3. Average difficulty is __ ___ on the RO exam and ___ on the SRO exam. Page 6 of 7 OBDI 202 - IOLE Process
ES-401 PV-2009-11 7 Form ES-401-9
- 4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 43.1 =
41.2 = 43.2 =
41.3 = 43.3 =
41.4 = 43.4 =
41.5 = 43.5 =
41.6 = 43.6 =
41.7 = 43.7 =
41.8 =
41.9 =
41.10 =
41.11 =
41.12 =
41.13 =
41.14 =
- 5. The answer distribution is: RO / SRO A = 13 (17%) / 6 (24%)
B = 16 (22%) / 7 (28%)
C = 21 (28%) / 5 (20%)
D = 25 (33%) / 7 (28%)
- 6. There are questions with attachments provided. Page 7 of 7 OBDI 202 - IOLE Process