|
|
Line 2: |
Line 2: |
| | number = ML12111A188 | | | number = ML12111A188 |
| | issue date = 03/01/2012 | | | issue date = 03/01/2012 |
| | title = Hope Creek - NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2) | | | title = NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2) |
| | author name = Fish T H | | | author name = Fish T H |
| | author affiliation = NRC/RGN-I/DRS/OB | | | author affiliation = NRC/RGN-I/DRS/OB |
Revision as of 15:16, 4 April 2019
Letter Sequence Draft Other |
---|
|
|
|
|
---|
Category:License-Operator
MONTHYEARML24197A0552024-07-15015 July 2024 Requalification Program Inspection NTD-24-027, Response to RIS 2024-01, Preparation and Scheduling of Operator Licensing Examinations2024-05-20020 May 2024 Response to RIS 2024-01, Preparation and Scheduling of Operator Licensing Examinations NTD-23-038, Response to RIS 2023-01, Preparation and Scheduling of Operator Licensing Examinations2023-05-11011 May 2023 Response to RIS 2023-01, Preparation and Scheduling of Operator Licensing Examinations ML23121A1412023-05-0101 May 2023 Senior Reactor and Reactor Operator Initial License Examinations ML22312A4352022-10-0303 October 2022 Exam Form 1.3-1 ML23055A3812022-07-31031 July 2022 Exam Forms 2.3-1, 2.3-2, 3.4-1 ML22003A0042022-01-0303 January 2022 Senior Reactor and Reactor Operator Initial License Examinations ML21117A0842021-04-0909 April 2021 Final Q/A Related - Forms (Folder 1) ML21076A0622021-03-0909 March 2021 Draft Operating Test (Section a, Section B, Section C)(Folder 2) ML21076A0662021-03-0909 March 2021 Final Operating Test (Section a, B, and C) (Folder 3) ML21075A1052021-03-0909 March 2021 Draft Written Examination (Folder 2) ML21075A1032021-03-0909 March 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21075A1022021-03-0909 March 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21075A1042021-03-0909 March 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21076A0632021-03-0909 March 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21076A0642021-03-0909 March 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML21032A1022021-02-0101 February 2021 Operator Licensing Examination Approval ML21117A0832021-01-28028 January 2021 Final Q/A Related Form ES-401-6 (Folder 1) ML21012A2692021-01-12012 January 2021 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2021 NTD-20-014, Response to RIS 2020-01, Preparation and Scheduling of Operator Licensing Examinations2020-03-18018 March 2020 Response to RIS 2020-01, Preparation and Scheduling of Operator Licensing Examinations ML19352D6572019-12-16016 December 2019 Announcement 0f Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2020 ML21041A1732019-10-0101 October 2019 Original Question for Modified Question 80 ML19219A1022019-08-0606 August 2019 Operator Licensing Examination Approval ML19302F9902019-01-0808 January 2019 NRC Corporate Notification Letter (Folder 1) ML18311A1572018-07-24024 July 2018 Operating Test Retake - Examination Approval Letter (Folder 1) ML18311A1562018-07-14014 July 2018 NRC Corporate Notification Letter (Folder 1) NTD-18-044, Response to RIS 2018-02, Preparation and Scheduling of Operator Licensing Examinations2018-04-26026 April 2018 Response to RIS 2018-02, Preparation and Scheduling of Operator Licensing Examinations IR 05000354/20183012018-04-0303 April 2018 Initial Operator Licensing Examination Report 05000354/2018301 ML18086B0252018-02-16016 February 2018 Facility Cover Letter - Ri - March 2018 - GFE ML18005A4202018-01-0303 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17178A3092017-06-22022 June 2017 Senior Reactor and Reactor Operator Initial License Examinations LR-N17-0098, Response to RIS-2017-03, Preparation and Scheduling of Operator Licensing Examinations2017-05-0505 May 2017 Response to RIS-2017-03, Preparation and Scheduling of Operator Licensing Examinations ML17034A1062017-02-0202 February 2017 December 7, 2016, NRC Generic Fundamentals Examination Results for Hope Creek Generating Station (Cover Letter Publicly Available, Enclosures Withheld from Public) ML17018A2822017-01-17017 January 2017 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2017 ML16293A1232016-10-18018 October 2016 September 7, 2016, NRC Generic Fundamentals Examination Results for Hope Creek Generating Station (Cover Letter Publicly Available, Enclosures Withheld from Public) ML16295A0562016-10-11011 October 2016 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML16295A0552016-10-10010 October 2016 Post Exam Comments and Resolution (Folder 1) ML16295A0572016-10-0101 October 2016 Final Operating Exam (Sections a, B, and C) (Folder 3) ML17186A1212016-08-16016 August 2016 Final Qa/Related Forms (Folder 1) ML17186A1452016-08-14014 August 2016 Final Outlines (Folder 3) ML17186A2442016-07-28028 July 2016 Draft - Outlines (Folder 2) ML17186A2372016-07-28028 July 2016 Facility Comments on Draft Facility-Developed Exam (Written) (Folder 2) LR-N16-0125, Response to RIS 2016-09, Preparation of Scheduling of Operator Licensing Examination2016-07-0808 July 2016 Response to RIS 2016-09, Preparation of Scheduling of Operator Licensing Examination ML16053A1032016-02-22022 February 2016 Senior Reactor and Reactor Operator Initial License Examinations - Hope Creek Generating Station ML15163A2462015-12-17017 December 2015 Draft Operating Exam (Sections a, B, and C) (Folder 2) ML15163A2452015-12-17017 December 2015 Draft Written Exam (Folder 2) ML15198A2332015-07-14014 July 2015 June 10, 2015, NRC Generic Fundamentals Examination Results for Hope Creek Generating Station (Cover Letter Publicly Available, Enclosures Withheld from Public) ML15163A2412015-06-10010 June 2015 Final Outlines (Folder 3) ML16145A2442015-03-31031 March 2015 Final Qa/Related Forms (Folder 1) ML15091A2402015-03-30030 March 2015 March 4, 2015, NRC Generic Fundamentals Examination Results for Hope Creek, (Cover Letter Publicly Available, Enclosures Withheld from Public) 2024-07-15
[Table view] Category:Part 55 Examination Related Material
MONTHYEARNTD-24-027, Response to RIS 2024-01, Preparation and Scheduling of Operator Licensing Examinations2024-05-20020 May 2024 Response to RIS 2024-01, Preparation and Scheduling of Operator Licensing Examinations NTD-23-038, Response to RIS 2023-01, Preparation and Scheduling of Operator Licensing Examinations2023-05-11011 May 2023 Response to RIS 2023-01, Preparation and Scheduling of Operator Licensing Examinations ML23121A1412023-05-0101 May 2023 Senior Reactor and Reactor Operator Initial License Examinations ML22312A4352022-10-0303 October 2022 Exam Form 1.3-1 ML23055A3812022-07-31031 July 2022 Exam Forms 2.3-1, 2.3-2, 3.4-1 ML22003A0042022-01-0303 January 2022 Senior Reactor and Reactor Operator Initial License Examinations ML21117A0842021-04-0909 April 2021 Final Q/A Related - Forms (Folder 1) ML21075A1032021-03-0909 March 2021 NRC Comments on Draft Licensee-Developed Operating Test (Folder 2) ML21075A1022021-03-0909 March 2021 NRC Comments on Draft Licensee-Developed Written Exam (Folder 2) ML21075A1042021-03-0909 March 2021 Draft Written Examination and Operating Test Outlines (Folder 2) ML21076A0632021-03-0909 March 2021 Final Written Examination and Operating Test Outlines (Folder 3) ML21076A0642021-03-0909 March 2021 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML21076A0622021-03-0909 March 2021 Draft Operating Test (Section a, Section B, Section C)(Folder 2) ML21075A1052021-03-0909 March 2021 Draft Written Examination (Folder 2) ML21076A0662021-03-0909 March 2021 Final Operating Test (Section a, B, and C) (Folder 3) ML21032A1022021-02-0101 February 2021 Operator Licensing Examination Approval ML21117A0832021-01-28028 January 2021 Final Q/A Related Form ES-401-6 (Folder 1) ML21012A2692021-01-12012 January 2021 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2021 NTD-20-014, Response to RIS 2020-01, Preparation and Scheduling of Operator Licensing Examinations2020-03-18018 March 2020 Response to RIS 2020-01, Preparation and Scheduling of Operator Licensing Examinations ML19352D6572019-12-16016 December 2019 Announcement 0f Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2020 ML21041A1732019-10-0101 October 2019 Original Question for Modified Question 80 ML19219A1022019-08-0606 August 2019 Operator Licensing Examination Approval ML19302F9902019-01-0808 January 2019 NRC Corporate Notification Letter (Folder 1) ML18311A1572018-07-24024 July 2018 Operating Test Retake - Examination Approval Letter (Folder 1) ML18311A1562018-07-14014 July 2018 NRC Corporate Notification Letter (Folder 1) NTD-18-044, Response to RIS 2018-02, Preparation and Scheduling of Operator Licensing Examinations2018-04-26026 April 2018 Response to RIS 2018-02, Preparation and Scheduling of Operator Licensing Examinations IR 05000354/20183012018-04-0303 April 2018 Initial Operator Licensing Examination Report 05000354/2018301 ML18005A4202018-01-0303 January 2018 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2018 ML17178A3092017-06-22022 June 2017 Senior Reactor and Reactor Operator Initial License Examinations LR-N17-0098, Response to RIS-2017-03, Preparation and Scheduling of Operator Licensing Examinations2017-05-0505 May 2017 Response to RIS-2017-03, Preparation and Scheduling of Operator Licensing Examinations ML17018A2822017-01-17017 January 2017 Announcement of Generic Fundamentals Examination Section of the Written Operator Licensing Examination for 2017 ML16293A1232016-10-18018 October 2016 September 7, 2016, NRC Generic Fundamentals Examination Results for Hope Creek Generating Station (Cover Letter Publicly Available, Enclosures Withheld from Public) ML16295A0562016-10-11011 October 2016 Final Written Examination with Answer Key (401-5 Format) (Folder 3) ML16295A0552016-10-10010 October 2016 Post Exam Comments and Resolution (Folder 1) ML16295A0572016-10-0101 October 2016 Final Operating Exam (Sections a, B, and C) (Folder 3) ML17186A1212016-08-16016 August 2016 Final Qa/Related Forms (Folder 1) ML17186A1452016-08-14014 August 2016 Final Outlines (Folder 3) ML17186A2442016-07-28028 July 2016 Draft - Outlines (Folder 2) ML17186A2372016-07-28028 July 2016 Facility Comments on Draft Facility-Developed Exam (Written) (Folder 2) ML16053A1032016-02-22022 February 2016 Senior Reactor and Reactor Operator Initial License Examinations - Hope Creek Generating Station ML15163A2452015-12-17017 December 2015 Draft Written Exam (Folder 2) ML15163A2462015-12-17017 December 2015 Draft Operating Exam (Sections a, B, and C) (Folder 2) ML15198A2332015-07-14014 July 2015 June 10, 2015, NRC Generic Fundamentals Examination Results for Hope Creek Generating Station (Cover Letter Publicly Available, Enclosures Withheld from Public) ML15163A2412015-06-10010 June 2015 Final Outlines (Folder 3) ML16145A2442015-03-31031 March 2015 Final Qa/Related Forms (Folder 1) ML15100A0422015-03-0606 March 2015 Final Operating Exam (Sections a, B, and C) (Folder 3) ML15100A0412015-03-0606 March 2015 Handouts to Applicants (Folder 3) ML15100A0402015-03-0303 March 2015 Final Written Examination with Answer Key (401-5 Format) (Folder 2) ML15163A2442015-02-17017 February 2015 Draft - Outlines (Folder 2) ML15163A2432015-02-17017 February 2015 NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2) 2024-05-20
[Table view] |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Credo Dis!. Partial Job-link Minutia #/ units ward Q= KIA SRO Only 1 H 3 Y N S 2 H 3 Y N S 3 H 3 Y B S 4 F 2 N B U KIA mm; replaced Q 5 H 3 Y B S 6 H 3 Y M S 7 F 2 Y B S 8 H 3 Y B S 1. 2. 3. 4. 5. 6. 7. 8. Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (Le., the question has a valid KIA but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- The question requires reverse logic or application compared to the job requirements.
Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.1. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2 Form ES-401-9 Q# 1. lOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues TlF Credo Dist. Partial Job-Link Minutia #1 units ward Q= SRO KIA Only 9 H 2 Y B S 10 F 2 Y B S 11 H 3 Y B S 12 H 3 Y B S 13 H 3 Y B S 14 H 3 Y N S 15 H 3 Y N S 16 H 3 Y N S 17 H 3 Y N S 18 H 3 Y B S 19 H 4 Y B S 20 F 2 Y B S 21 H 3 Y B S 22 H 2 Y N S 23 H 3 Y N S 24 F 2 Y N S 25 F 2 Y M S 26 H 3 Y N S 27 F 2 Y B S 28 H 3 Y B S ES-401 3 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UlE/S Explanation Focus Dis!. Link units ward KIA Only 29 H 3 Y B S 30 F 2 Y B S 31 H 3 Y B S 32 H 3 Y B S 33 F 2 Y B S 34 H 3 Y M S 35 H 3 Y B S 36 H 3 Y N S 37 H 3 Y N S 38 H 3 Y N S KA met: loss of feed, depending on severity, requires EOP entry 39 F 2 Y B S 40 F 2 Y B S 41 F 1 X Y N U GFE Q; LOD 1; minimal op validity.
Replaced KA and Q 42 F 2 Y N S 43 F 2 Y N S 44 H 3 Y N S 45 F 2 Y B S 46 F 2 Y B S 47 F 2 Y B S 48 F 2 Y M S ...
ES-401 4 Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. BIM/N 7. utE/S 8. Explanation Stem Focus Cues T/F Credo Partial Dist
- 1 Back-Link units ward Q= KIA SRO Only 49 H 3 Y N S 50 F 2 Y B S 51 H 3 Y B S 52 F 2 Y B S 53 H 3 Y N S 54 F 2 Y N S 55 F 2 Y N S 56 F 2 Y B S 57 H 3 Y B S 58 F 2 Y B S 59 H 3 Y B S 60 H 3 Y N S 61 F 2 Y N S 62 F 2 Y N S 63 H 3 Y N S 64 F 2 Y B S 65 H 3 Y N S 66 F 2 Y B S 67 F 2 Y B S 68 F 2 Y N S ES-401 5 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F *Partial J.fnbd Minutia #1 Back-Q= SRO B/M/N UlE/S Explanation Focus Dist. Link units ward KIA Only 69 F 2 Y N S 70 F 2 Y B S 71 F 2 Y B S 72 F 2 Y M S 73 F 2 Y N S 74 F 1 X X Y B U LOD 1; GFE; doesn't discriminate between LO/NLO. Replaced KA & Q. 75 H 3 Y B S 76 H 3 Y Y N S 77 H 3 Y Y N S 78 H 3 Y N N U System knowledge eliminates 3 choices. Replaced Q 79 H 3 Y Y N S 80 H 3 Y Y M S 81 H 3 Y Y M S 82 H 3 Y Y N S 83 H 3 Y Y N S 84 H 3 Y Y M S 85 H 3 Y Y N S 86 H 3 Y Y N S Part (b) of KA met 87 F 2 Y Y M S
- 1. I 2.Q# I LOK LOD lr---.--.---.---.---+--.----.---.---+--.r--; (F/H) (1-5) 6. I 7. 8. U/E/S Explanation ES-401 6 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UtEtS Explanation Focus Dis!. Link units ward KIA Only 89 F 2 Y Y M S 90 H 3 Y Y N S Part (b) of KA met 91 H 3 Y N N U Part (b) of KA met; system knowledge eliminates three choices. worded choices to eliminate system knowledge cues. 92 H 3 Y Y N S 93 H 3 Y Y B S 94 F 2 Y Y B S 95 F 2 Y Y N S 96 F 2 Y Y N S 97 F 2 Y Y N S 98 H 3 Y Y N S 99 F 2 Y Y M S 100 F 2 Y Y N' S