|
|
Line 3: |
Line 3: |
| | issue date = 10/06/2010 | | | issue date = 10/06/2010 |
| | title = NRC Comments on Draft Licensee-Developed Exam (Written & Operating Tests) (Folder 2) | | | title = NRC Comments on Draft Licensee-Developed Exam (Written & Operating Tests) (Folder 2) |
| | author name = Dean R J | | | author name = Dean R |
| | author affiliation = Constellation Energy Nuclear Group, LLC | | | author affiliation = Constellation Energy Nuclear Group, LLC |
| | addressee name = Fish T H | | | addressee name = Fish T |
| | addressee affiliation = NRC/RGN-I/DRS/OB | | | addressee affiliation = NRC/RGN-I/DRS/OB |
| | docket = 05000220 | | | docket = 05000220 |
Revision as of 02:36, 11 July 2019
Letter Sequence Draft Other |
---|
|
|
|
|
---|
Category:License-Operator
MONTHYEARML24213A1412024-07-31031 July 2024 Requalification Program Inspection ML24002B0852024-01-0202 January 2024 FY24 NMP2 Final QA Forms ML23347A0632023-12-13013 December 2023 NMP1 Retake FY23 Examination Files ML23257A1732023-09-14014 September 2023 Requalification Program Inspection ML23220A0262023-08-0808 August 2023 Licensed Operator Positive Fitness-for-Duty Test ML23186A1642023-07-0606 July 2023 Operator Licensing Retake Examination Approval RS-23-077, Response to NRC Regulatory Issue Summary 2023-01, Preparation and Scheduling of Operator Licensing Examinations2023-06-16016 June 2023 Response to NRC Regulatory Issue Summary 2023-01, Preparation and Scheduling of Operator Licensing Examinations ML23135A1562023-05-15015 May 2023 Final Qa/Related Forms IR 05000410/20233022023-05-15015 May 2023 Initial Operator Licensing Examination Report 05000410/2023302 ML23123A0582023-05-0303 May 2023 Final Qa/Related Forms ML23109A0332023-04-19019 April 2023 Senior Reactor and Reactor Operator Initial License Examinations RS-22-045, Constellation Energy Generation, LLC, Response to NRC Regulatory Issue Summary 2022-01, Preparation and Scheduling of Operator Licensing Examinations2022-03-25025 March 2022 Constellation Energy Generation, LLC, Response to NRC Regulatory Issue Summary 2022-01, Preparation and Scheduling of Operator Licensing Examinations ML21258A3552021-09-16016 September 2021 Requalification Program Inspection ML21137A1602021-05-17017 May 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21137A2402021-05-17017 May 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21137A1692021-05-17017 May 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21133A2422021-05-13013 May 2021 Handouts to Applicants (Folder 3) ML21133A1472021-05-13013 May 2021 Final Qa/Related Forms (Folder 1) ML21131A1892021-05-11011 May 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21123A1982021-05-0303 May 2021 Draft Operating Test (Section a, Section B, Section C) (Folder 2) ML21123A1892021-05-0303 May 2021 Draft Written Examination (Folder 2) ML21123A2242021-04-19019 April 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML21123A2412021-04-19019 April 2021 Final Operating Test (Sections a, B, and C) (Folder 3) ML21034A4742021-02-0303 February 2021 Handouts to Applicants (Folder 3) ML21034A4762021-02-0303 February 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21033A7962021-02-0202 February 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21033A5382021-02-0202 February 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21032A2812021-02-0101 February 2021 Final Qa/Related Forms (Folder 1) ML21032A3232021-02-0101 February 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21027A2592021-01-27027 January 2021 Draft Operating Test (Section a, Section B, Section C) (Folder 2) ML21012A2692021-01-12012 January 2021 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2021 ML21008A3322021-01-0808 January 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML21008A3542021-01-0808 January 2021 Final Operating Test (Sections a, B, and C) (Folder 3) ML20350B7852020-12-11011 December 2020 Modified Question Source Information (Post 2020 Audit) (Folder 3) ML20120A5582020-04-30030 April 2020 Senior Reactor and Reactor Operator Initial License Examinations ML20105A1762020-04-15015 April 2020 March 4, 2020, NRC Generic Fundamentals Examination Results for Nine Mile Point Nuclear Station, Unit 1 (Cover Letter Publicly Available, Enclosures Withheld from Public) ML20055D8832020-01-15015 January 2020 Final Qa/Related Forms (Folder 1) ML20055E0092020-01-15015 January 2020 Final Q/A Related Form - Form ES-401-6 (Folder 1) ML19352D6572019-12-16016 December 2019 Announcement 0f Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2020 ML19337A5342019-11-29029 November 2019 Operator Licensing Examination Approval ML20055E0122019-10-28028 October 2019 NRC Comments on Draft Licensee-Developed Operating Test ML20055E0172019-10-28028 October 2019 Nile Mile Point Unit 2 - Draft Written Examination (Folder 2) ML20055E0152019-10-28028 October 2019 Draft Written Examination and Operating Test Outlines (Folder 2) ML19289D0132019-10-15015 October 2019 September 4, 2019, NRC Generic Fundamentals Examination Results for Nine Mile Point Nuclear Station, Unit 1 (Cover Letter Publicly Available, Enclosures Withheld from Public) ML20055E0132019-10-15015 October 2019 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) NMP1L3288, Fitness-for-Duty Response to Request for Information2019-07-0101 July 2019 Fitness-for-Duty Response to Request for Information ML19154A5672019-06-0303 June 2019 Senior Reactor and Reactor Operator Initial License Examinations ML19151A8132019-05-31031 May 2019 Licensed Operator Positive Fitness-For-Duty Test RS-19-053, Response to NRC Regulatory Issue Summary 2019-02, Preparation and Scheduling of Operator Licensing Examinations2019-05-16016 May 2019 Response to NRC Regulatory Issue Summary 2019-02, Preparation and Scheduling of Operator Licensing Examinations ML20055E0202019-04-22022 April 2019 Draft Operating Test (Section a, Section B, Section C) (Folder 2) 2024-07-31
[Table view] Category:Part 55 Examination Related Material
MONTHYEARML24002B0852024-01-0202 January 2024 FY24 NMP2 Final QA Forms ML23347A0632023-12-13013 December 2023 NMP1 Retake FY23 Examination Files ML23186A1642023-07-0606 July 2023 Operator Licensing Retake Examination Approval RS-23-077, Response to NRC Regulatory Issue Summary 2023-01, Preparation and Scheduling of Operator Licensing Examinations2023-06-16016 June 2023 Response to NRC Regulatory Issue Summary 2023-01, Preparation and Scheduling of Operator Licensing Examinations ML23135A1562023-05-15015 May 2023 Final Qa/Related Forms IR 05000410/20233022023-05-15015 May 2023 Initial Operator Licensing Examination Report 05000410/2023302 ML23123A0582023-05-0303 May 2023 Final Qa/Related Forms ML23109A0332023-04-19019 April 2023 Senior Reactor and Reactor Operator Initial License Examinations RS-22-045, Constellation Energy Generation, LLC, Response to NRC Regulatory Issue Summary 2022-01, Preparation and Scheduling of Operator Licensing Examinations2022-03-25025 March 2022 Constellation Energy Generation, LLC, Response to NRC Regulatory Issue Summary 2022-01, Preparation and Scheduling of Operator Licensing Examinations ML21137A1692021-05-17017 May 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21137A2402021-05-17017 May 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21137A1602021-05-17017 May 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21133A1472021-05-13013 May 2021 Final Qa/Related Forms (Folder 1) ML21133A2422021-05-13013 May 2021 Handouts to Applicants (Folder 3) ML21131A1892021-05-11011 May 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21123A1892021-05-0303 May 2021 Draft Written Examination (Folder 2) ML21123A1982021-05-0303 May 2021 Draft Operating Test (Section a, Section B, Section C) (Folder 2) ML21123A2242021-04-19019 April 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML21123A2412021-04-19019 April 2021 Final Operating Test (Sections a, B, and C) (Folder 3) ML21034A4762021-02-0303 February 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21034A4742021-02-0303 February 2021 Handouts to Applicants (Folder 3) ML21033A5382021-02-0202 February 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21033A7962021-02-0202 February 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21032A2812021-02-0101 February 2021 Final Qa/Related Forms (Folder 1) ML21032A3232021-02-0101 February 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21027A2592021-01-27027 January 2021 Draft Operating Test (Section a, Section B, Section C) (Folder 2) ML21012A2692021-01-12012 January 2021 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2021 ML21008A3542021-01-0808 January 2021 Final Operating Test (Sections a, B, and C) (Folder 3) ML21008A3322021-01-0808 January 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML20350B7852020-12-11011 December 2020 Modified Question Source Information (Post 2020 Audit) (Folder 3) ML20120A5582020-04-30030 April 2020 Senior Reactor and Reactor Operator Initial License Examinations ML20105A1762020-04-15015 April 2020 March 4, 2020, NRC Generic Fundamentals Examination Results for Nine Mile Point Nuclear Station, Unit 1 (Cover Letter Publicly Available, Enclosures Withheld from Public) ML20055E0092020-01-15015 January 2020 Final Q/A Related Form - Form ES-401-6 (Folder 1) ML20055D8832020-01-15015 January 2020 Final Qa/Related Forms (Folder 1) ML19352D6572019-12-16016 December 2019 Announcement 0f Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2020 ML19337A5342019-11-29029 November 2019 Operator Licensing Examination Approval ML20055E0122019-10-28028 October 2019 NRC Comments on Draft Licensee-Developed Operating Test ML20055E0152019-10-28028 October 2019 Draft Written Examination and Operating Test Outlines (Folder 2) ML20055E0172019-10-28028 October 2019 Nile Mile Point Unit 2 - Draft Written Examination (Folder 2) ML20055E0132019-10-15015 October 2019 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML19151A8132019-05-31031 May 2019 Licensed Operator Positive Fitness-For-Duty Test RS-19-053, Response to NRC Regulatory Issue Summary 2019-02, Preparation and Scheduling of Operator Licensing Examinations2019-05-16016 May 2019 Response to NRC Regulatory Issue Summary 2019-02, Preparation and Scheduling of Operator Licensing Examinations ML20055E0202019-04-22022 April 2019 Draft Operating Test (Section a, Section B, Section C) (Folder 2) ML18333A0182018-11-25025 November 2018 Initial Operator Licensing Operating Test Approval ML18088A7262018-05-21021 May 2018 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML18117A2102018-04-26026 April 2018 Senior Reactor and Reactor Operator Initial License Examinations RS-18-057, Response to NRC Regulatory Issue Summary 2018-02, Preparation and Scheduling of Operator Licensing Examinations2018-04-25025 April 2018 Response to NRC Regulatory Issue Summary 2018-02, Preparation and Scheduling of Operator Licensing Examinations ML18088A7212018-03-29029 March 2018 Final Qa/Related Forms - Form ES-401-6 (Folder 1) NMP1L3120, Draft - Outlines (Folder 2), (Facility Letter Dtd - 12/6/20162018-03-29029 March 2018 Draft - Outlines (Folder 2), (Facility Letter Dtd - 12/6/2016 ML18088A7232018-03-29029 March 2018 Final Qa/Related Forms (Folder 1) 2024-01-02
[Table view] |
Text
Written Examination Review Worksheet Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (1-5) Stem Cues TtF Credo Partial Job-Minutia #1 Back-Q= SRO BtMtN UtEtS Focus Dist. Link units ward KiA 1 3 Y B S 2 3 Y M S 3 2 Y N S 4 3 Y N S 5 4 Y N S 6 3 Y N S 7 2 Y B S 8 2 Y N S
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following
- 1. Enter the level of knowledge (LOK) of each question as either {F)undamental or {H)igher cognitive level. 2. Enter the level of difficulty (LOO) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, The answer choices are a collection of unrelated truelfalse The distractors are not credible; single implausible distractors should be repaired, more than one is One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by
- 4. Check the appropriate box if a job content error is The. question is not linked to the job requirements (i.e., the question has a valid KiA but, as written, is not operational in
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in The question requires reverse logic or application compared to the job
- 5. Check questions that are sampled for conformance with the approved KiA and those that are designated SRO-only (KiA and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section 0.2.f. 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2 Form ES-401*9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues TtF Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UtEtS Explanation Focus Dist. Link units ward KIA Only 9 F 3 Y N S 10 H 3 Y N S 11 H 3 Y N S 12 H 4 Y N S 13 F 2 Y M S 14 H 2 Y N S 15 H 3 Y M S Meets part (b) of KIA 16 H 3 Y B S 17 H 4 Y N S 18 F 3 Y B S 19 F 4 Y B S 20 F 4 Y N S 21 F 2 Y N S 22 H 3 Y N S 23 H 4 Y N S 24 H 3 Y N S 25 F 3 Y N S 26 H 2 Y B S 27 H 3 Y N S 28 H 3 Y B S ES-401 3 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws
- 5. Other 6. 7. 8. Q# LOK LaD (F/H) (1-5) Stem Cues TtF Credo Partial Job-Minutia #I Back-Q= SRO B/M/N UtEtS Explanation Focus Dist. Link units ward KIA Only 29 H 2 Y M S 30 F 2 Y N S 31 H 3 Y N S 32 H 3 Y N S 33 H 2 Y N S 34 H 2 Y B S 35 H 2 Y B S 36 H 3 Y N S 37 F 4 Y N S 38 F 4 Y N S 39 H 3 Y N S 40 H 2 Y N S 41 H 2 Y N S 42 F 2 Y N S 43 H 3 Y N S 44 H 3 Y N S 45 F 2 Y N S 46 F 2 Y N S 47 F 3 Y N S 48 H 3 Y N S
4 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N utE/S Focus Dist. Link units ward KIA 49 3 Y N S Y 50 H 2 N S Y 51 F 2 B S Y 52 H 2 N S Y 53 H 3 N S Y 54 F 3 N S Y 55 H 2 M S Y 56 H 2 B S Y 57 H 2 N S Y 58 H 3 B S Y 59 F 3 N S Y 60 H 3 B S Y 61 F 2 N S Y 62 H 2 N S Y 63 H 2 B S Y 64 F 2 N S Y 65 F 3 N S Y 66 F 2 B S Y 67 F 2 B S Y 68 3 N S ES-401 5 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK (F/H) LOD (1-5)
T/F Focus Credo Dist. Partial Job-Link Minutia #1 units ward Q= KIA SRO Only B/M/N U/EIS Explanation 69 _. F _._. 2 ,. '--. y N S 70 F 3 Y B S 71 F 2 Y N S 72 F 3 Y N S 73 H 3 Y M S 74 H 2 Y M S 75 H 2 Y B S 76 H 3 Y Y N S 77 H 3 Y Y B S At NMP 1, loss of battery charger equals loss of DC power 78 H 2 Y Y B S 79 F 2 Y Y B S 80 F 2 Y Y M S 81 H 3 Y Y N S 82 H 3 Y Y M S 83 F 2 Y Y N S 84 H 2 Y Y N S 85 H 2 Y Y N S 86 H 2 Y Y M S 87 H 2 Y Y N S 88 H 2 Y Y N S ES401 6 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UlE/S Explanation Focus Dist. Link units ward KIA Only 89 H 2 Y Y B S 90 H 3 Y Y N S 91 H 3 Y Y N S 92 H 3 Y Y N S 93 F 2 Y Y N S 94 H 2 Y Y B S 95 H 2 Y Y B S 96 H 2 Y Y N S 97 F 2 Y Y N S 98 F 2 Y Y N S 99 F 2 Y Y B S 100 H 3 Y Y B S Post-submittal changes to Nine Mile Point Unit 1 NRC exam In-Plant .IPMs P-l: Added information to examiner notes in step 3; added cue to step 3 P-2: Added cues to steps 5 and 7; changed cue in step 8 to require additional actions; added steps 9-16 P-3: Changed steps 14 and 19 from non-critical to critical Simulator JPMs $-1: Condensed standard for step 8; edited wording in standard for step 10 $-2: Added indication to check in standard steps 4 and 16; added clarification on standard for steps 6 and 10; added examiner note to step 12 $-3: Added new initial condition 6; added third sentence to initiating cue; added sentence to cue after step $-4: Edited to use new procedure section (accomplishes same task) $-5: Added new initial condition 2 to require two additional critical steps; change part of step 16 from non-critical to critical $-6: Added one word to standard for step 9 $-7: Added new initial condition 4 $-8: Added cues to steps 6 and 10; fixed typo in step 10 Simulator Scenarios #1: Added detail to operator actions on page 24; added short delay time to trigger 23 in event 8 #2: Added detail to operator actions on pages 20 and 25 #3: Added "0R" to operator action on page 14; added detail to operator actions on pages 23 and 24; added examiner note to page 24 #4: Added second sentence to last examiner note on page 16; added sentence to role play on page 24; added detail to operator action on page 25 RO Admin JPMs COOl: Added examiner note to step 7 C002: Added second sentence to initiating cue; added worksheet for candidate to complete EC: No change EP: Added examiner note to steps 7 and 8 SRO Admin JPMs COOl: Changed steps 4 and 5 from critical to non-critical; added ranges to values in step 4; edited standard for step 8; added examiner note and cue to step 8 C002: Changed part of step 5 from non-critical to critical; added examiner note to step 5 EC: Balded part of initiating cue in body of JPM only RC: No change EP: Deleted examiner note in step 5; edited terminating cue; edited format of data on the bottom of the cue sheet