ML23115A356

11-CGS-2023-02 Public Forms

ML23115A356
Person / Time
Site:	Columbia
Issue date:	03/09/2023
From:	Heather Gepford NRC/RGN-IV/DORS/OB
To:	Energy Northwest
References
05000397/2023301
Download: ML23115A356 (1)

Text

EXAM ASSIGNMENT TICKLER Chief: Kirkland Facility: CGS Date of Written Exam: 3/9/2023 U/I: Start of Op Test: 2/20/2023 End of Op Test: 2/24/2023 Written Exam Developed By: NRC / Facility Operating Test Developed By: NRC / Facility Due Date Description Date Complete Initials Notes For NRC prepared exams, arrangements made for 6/20/2022 Examination administration date confirmed 4/20/2022 the facility to submit reference materials 7/25/2022 NRC examiners and facility contact assigned 4/20/2022 7/25/2022 Facility contact briefed on security and other requirements 4/20/2022 9/19/2022 Reference material due for NRC prepared exams n/a n/a ES-2.1.F 7/25/2022 Corporate Notification Letter sent 5/3/2022 Letter 2.1-1 produced by CE 8/8/2022 NRC developed written examination outline sent to facility contact 4/20/2022 Forms 4.1-BWR/PWR and COMMON 9/19/2022 Operating test outline(s) and other checklists due 9/19/2022 NH Forms 1.3-1, 2.3-1, 3.2-1, 3.2-2, 3.4-1, 3.3-1 Operating test outline(s) reviewed by NRC and feedback provided 10/3/2022 to facility licensee 10/3/2022 NH Form 2.3-1 signed by CE & BC NRC-prepared examinations approved by the NRC supervisor and 11/14/2022 forwarded for facility licensee review n/a n/a Proposed exams, outlines, supporting documentation, and 12/5/2022 reference materials due.

12/7/2022 NH Dec 9th due to licensee manpower 12/19/2022 Peer review of written exam complete 12/15/2022 NH Form 2.3-5 1/2/2023 Written exam and operating test reviews completed 1/6/2023 NH Document review on Forms 2.3-3 and 2.3-5 1/16/2023 Feedback approved by Branch Chief 1/13/2023 NH Examination review results discussed between NRC and facility 1/16/2023 licensee 1/18/2023 NH Provided 1/13/23. Meeting 1/18/2023 1/23/2023 On-site validation & 10% audit of license applications 1/23/2023 NH 1/23/2023 Preliminary license applications & waiver/excusal requests due 1/17/2023 NH NRC Forms 398/396 1/30/2023 Preliminary license applications and waivers reviewed 1/19/2023 NH 2/6/2023 Final license applications & waiver/excusal requests due 2/2/2023 NH Form 2.2-1 2/13/2023 Written exams and operating tests approved by Branch Chief 2/13/2023 NH Facility licensee management feedback on the examination 2/13/2023 requested by the NRC supervisor 2/13/2023 NH Final applications reviewed and audited; exam approval and 2/13/2023 waiver/excusal letters sent 2/14/2023 NH BC signs Exam Approval Letter (Form 2.3-1)

Proctoring/written exam administration guidelines reviewed with 2/13/2023 facility licensee 1/23/2023 NH 2/13/2023 Approved scenarios and JPMs distributed to examiners 2/14/2023 NH 2/20/2023 Administer Operating Test 2/20/2023 NH 3/10/2023 Examiner's document op test results on ES 303's 3/17/2023 NH 3/29/2023 Post exam comments and graded exams received 3/21/2023 NH Post exam written comments reviewed and incorporated and NRC 4/6/2023 grading completed 4/10/2023 NH Post exam operating test comments reviewed and ES-303-1 4/6/2023 updated 3/22/2023 NH Chief examiner review of operating test and/or written exam 4/13/2023 grading completed 4/12/2023 NH Signed ES 303's to BC 4/20/2023 Branch Chief review of exam results completed 4/19/2023 NH 4/27/2023 Waivers/deferrals reviewed for impact on licensing decision n/a 4/27/2023 License/Proposed Denial letters mailed; Facility notified of results 4/19/2023 NH 4/27/2023 RPS/IP number of examinees updated 4/14/2023 NH print Report-21 5/18/2023 Final Denial Letters mailed (if no request for informal review) TBD 21 days after proposed denial letters mailed.

5/25/2023 Examination Report Issued TBD produced by CE 6/1/2023 Ref Mat'l Returned after Final Resolution of Appeals TBD Replaces NUREG-1021, Revision 12, Forms 2.1-1 and 5.1-1 Rev. 12

Form 2.3-1 Examination Outline Quality Checklist Facility: Date of Examination:

(Y)es / (N)o Item Task Description a b* c#

a. The outline was systematically and randomly prepared in accordance with the z

w I-I-

instructions in Section B of ES-4.1, and all knowledge and ability (KIA) categories are appropriately sampled. y Y s: b. The outline does not overemphasize any systems, evolutions, or generic topics. IV V Y

c. Justifications for deselected or rejected KIA statements are acceptable. IV y Y

a. Using Form 3.4-1, Events and Evolutions Checklist, verify that the proposed scenario Y

y y set contains the required number of normal evolutions, reactivity evolutions, instrument and component failures, manual control evolutions, technical specifications, and major transients.

0:::

b. There are enough scenarios (and spares) for the projected number and mix of y

y I- applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity. Ensure that scenarios will not be repeated on Y subsequent days.

C. Ensure that all scenarios are new or significantly modified in accordance with ES-3.4 and that no scenarios are duplicated from the applicants' audit test(s). y y Y y y

d. To the extent possible, assess whether the outline(s) conforms with the qualitative and quantitative simulator set criteria specified on Form 2.3-2.

Y

a. Verify that the administrative outline meets the criteria specified in the instructions on Form 3.2-1 and that no tasks are duplicated from the applicants' audit test(s). y y Y

b. Verify that the control room and in-plant systems outline meets the criteria specified in en the instructions on Form 3.2-2 and that no tasks are duplicated from the applicants' audit test(s).

y y Y y y Determine whether the number of job performance measures (JPMs) and JPM types is Y

C.

sufficient for the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

a. Assess whether the appropriate exam sections cover plant-specific priorities (including probabilistic risk assessment and individual plant examination insights). y V Y

...J

b. Assess whether the 10 CFR 55.41, 10 CFR 55.43, and 10 CFR 55.45 sampling is appropriate y Y

w z

c. Check whether KIA importance ratings (except for plant-specific priorities) are greater than or equal to 2.5. y '-( (

Y w

Cl d. Check for duplication and overlap across the exam and with the last two NRC exams. 'l \ Y

e. Check the entire exam for balance of coverage. y V Y

f. Assess whether the exam fits the appropriate job level (reactor operator or senior reactor operator). '< 'I Y l

==;vt P,i,ledNam Date

a. Author fTIZll '( b * $1 1.."2..

b. Facility Reviewer (*) l', .J r _,. (" 1/ i r l-7--z_

C. NRC Reviewer (#) Nicholas Hernandez 10/3/2022 NRC Chief Examiner Nicholas Hernandez 10/3/2022 NRC Supervisor Heather Gepford 10/3/2022

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRG reviewer performs the steps in column "c." This may be the NRG Chief Examiner if he/she did not develop the outline under review.

ES-2.3, Page 9 of 19

Form 2.3-4 Written Examination Quality Checklist Facility: Columbia Date of Exam: 2/20/2023 Exam Level: RO IX] SRO IX]

(Y)es /(N)o Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference.

y y Y l2. a. All questions reference NRC knowledge and abilities(KIAs) requirements.

b. Facility learning objectives are referenced as available. y Y

c. All questions include an explanation of the correct answer explanation and a distractor analysis.

')

3. Senior reactor operator(SRO) questions test at the SRO license level. y 'I Y

14. The sampling process was random and systematic. (If more than four reactor operator(RO) or two y

SRO questions were repeated from the last two NRC licensing exams, including full(100-question) Y y

retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing prooram office.)

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_.lL The audit exam was systematically and randomly developed.

_ The audit exam was completed before the license exam was started.

_ The examinations were developed independently.

y y Y

_ The licensee certifies that there is no duplication.

Other (explain):

6. Bank use meets limits(no more than 75% from the bank, at least 10% Bank Modified New new(at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution> 22 /4 3/1 50 / 20 y y Y

7. Between 38 and 45 questions of the questions on the RO exam and at Memory C/A least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution> 31/ 8 44/ 17 y '7 Y

8. References/handouts provided do not give away answers or aid in the elimination of distractors. y y Y

9. Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the KIA statements' assigned tier; deviations are justified.

y y Y

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. y

'I Y

11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.

y y Y Printed Name/Signature Date

a. Author 12.[of3/

b. Facility Reviewer(*) ,/J..J...

C. NRC Reviewer (#)

Nicholas Hernandez 2/9/2023 NRC Chief Examiner Nicholas Hernandez 2/9/2023 NRC Regional Supervisor Heather Gepford 2/9/23

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Y

Y Nicholas Hernandez 2/9/2023 Nicholas Hernandez 2/9/2023 Heather Gepford 2/13/23

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Crew #1 SROU-1: RO-1: RO-2:

Facility: Columbia Generating Station Date of Exam: 02/20/23 Operating Test No.:1 A E Scenarios P V T M P E 4- I L N 1 2 3 O I T Spare T N I

C A POSITION POSITION POSITION POSITIO M A T L N U N Y M(*)

T P S A B S A B S A B S A B E R T O R T O R T O R T O R I U O C P O C P O C P O C P RO RX 5 1 2 1 1 0 SRO-I NOR 1 - 1 1 1 1 U1 I/C 4,8,9 2,3,7 6 4 4 2 SRO-U MAJ 6 4,6 3 2 2 1 Man. Ctlr - - 0 1 1 0 TS 2,3 1,2 4 0 2 2 RO RX 5 - 1 1 1 0 SRO-I NOR 1 - 1 1 1 1 R1 I/C 7,8 1,3,5,7 6 4 4 2 SRO-U MAJ 6 4,6 3 2 2 1 Man. Ctlr - 5 1 1 1 0 TS 0 2 2 RO RX - 1 1 1 1 0 SRO-I NOR 1 - 1 1 1 1 R2 I/C 3,4 2,3,8 7 4 4 2 SRO-U 8,9 MAJ 4,6 4,6 4 2 2 1 Man. Ctlr 9 8 2 1 1 0 TS 0 2 2

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Crew #2 SROU-2: RO-3: RO-4:

Facility: Columbia Generating Station Date of Exam: 02/20/23 Operating Test No.:1 A E Scenarios P V T M P E 4- I L N 1 2 3 O I T Spare T N I

C A POSITION POSITION POSITION POSITIO M A T L N U N Y M(*)

T P S A B S A B S A B S A B E R T O R T O R T O R T O R I U O C P O C P O C P O C P RO RX 1 - 1 1 1 0 SRO-I NOR - - ** 1 1 1 U2 I/C 2,3,7 1,4,7 6 4 4 2 SRO-U MAJ 4,6 5 3 2 2 1 Man. Ctlr - - 0 1 1 0 TS 1,2 1,2 4 0 2 2 RO RX 1 - 1 1 1 0 SRO-I NOR - - ** 1 1 1 R3 I/C 2,3,8 1,6,7 6 4 4 2 SRO-U MAJ 4,6 5 3 2 2 1 Man. Ctlr 8 6 2 1 1 0 TS 0 2 2 RO RX - - ** 1 1 0 SRO-I NOR - - ** 1 1 1 R4 I/C 1,3,5,7 3,4,7 7 4 4 2 SRO-U MAJ 4,6 5 3 2 2 1 Man. Ctlr 5 3 2 1 1 0 TS 0 2 2

(**) I/C malfunction substituted for normal evolution and/or Reactivity manipulation on a one-for-one basis per NUREG 1021 Rev12

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Crew #3 SROI-1: SROI-2: RO-5:

Facility: Columbia Generating Station Date of Exam: 02/20/23 Operating Test No.:1 A E Scenarios P V T M P E 4- I L N 1 2 3 (With Crew 5) O I T Spare T N I

C A POSITION POSITION POSITION POSITIO M A T L N U N Y M(*)

T P S A B S A B S A B S A B E R T O R T O R T O R T O R I U O C P O C P O C P O C P RO RX 5 1 - 2 1 1 0 SRO-I NOR 1 - - 1 1 1 1 I1 I/C 4,8,9 2,3,8 1,4,7 9 4 4 2 SRO-U MAJ 6 4,6 5 4 2 2 1 Man. Ctlr - 8 - 1 1 1 0 TS 2,3 1,2 4 0 2 2 RO RX - 1 1 1 1 0 SRO-I NOR 1 - 1 1 1 1 I2 I/C 3,4 2,3,7 7 4 4 2 SRO-U 8,9 MAJ 4,6 4,6 4 2 2 1 Man. Ctlr 9 - 1 1 1 0 TS 1,2 2 0 2 2 RO RX 5 - 1 1 1 0 SRO-I NOR 1 - 1 1 1 1 R5 I/C 7,8 1,3,5,7 6 4 4 2 SRO-U MAJ 6 4,6 3 2 2 1 Man. Ctlr - 5 1 1 1 0 TS 0 2 2

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Crew #4 SROI-3: SROI-4: RO-6:

Facility: Columbia Generating Station Date of Exam: 02/20/23 Operating Test No.:1 A E Scenarios P V T M P E I

L N 1 2 3 4-Spare O N

I T T I

C A POSITION POSITION POSITION POSITION M A T L U N Y S A B S A B S A B S A B M(*)

T P R T O R T O R T O R T O E O C P O C P O C P O C P R I U RO RX 5 - 1 1 1 0 SRO-I NOR 1 - 1 1 1 1 I3 I/C 4,8,9 3,4,7 6 4 4 2 SRO-U MAJ 6 5 2 2 2 1 Man. Ctlr - 3 1 1 1 0 TS 2,3 2 0 2 2 RO RX - - ** 1 1 0 SRO-I NOR 1 - 1 1 1 1 I4 I/C 3,4 1,4,7 7 4 4 2 SRO-U 8,9 MAJ 4,6 5 3 2 2 1 Man. Ctlr 9 - 1 1 1 0 TS 1,2 2 0 2 2 RO RX 5 - 1 1 1 0 NOR 1 - 1 1 1 1 R6 SRO-I I/C 7,8 1,6,7 5 4 4 2 SRO-U MAJ 6 5 2 2 2 1 Man. Ctlr - 6 1 1 1 0 TS 0 2 2

(**) I/C malfunction substituted for Reactivity manipulation on a one-for-one basis per NUREG 1021 Rev12

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Crew #5 Surrogate CRS RO-7: RO-8:

Facility: Columbia Generating Station Date of Exam: 02//23 Operating Test No.:1 A E Scenarios P V T M P E I

L N 1 2 3 4-Spare O N

I T T I

C A POSITION POSITION POSITION POSITION M A T L U N Y S A B S A B S A B S A B M(*)

T P R T O R T O R T O R T O E O C P O C P O C P O C P R I U RX NOR Surrogate CRS I/C Surr MAJ Man. Ctlr TS RO RX 1 - 1 1 1 0 SRO-I NOR - - ** 1 1 1 R7 I/C 2,3,8 1,6,7 7 4 4 2 SRO-U MAJ 4,6 5 3 2 2 1 Man. Ctlr 8 6 2 1 1 0 TS 0 2 2 RO RX - - ** 1 1 0 SRO-I NOR - - ** 1 1 1 R8 I/C 1,3,5,7 3,4,7 7 4 4 2 SRO-U MAJ 4,6 5 3 2 2 1 Man. Ctlr 5 3 2 1 1 0 TS 0 2 2

(**) I/C malfunction substituted for normal evolution and/or Reactivity manipulation on a one-for-one basis per NUREG 1021 Rev12

ILC 25 Rev 12 Form 3.4-1 Events and Evolutions Checklist Rev 11/19/22 Form 3.4-1 Instructions for the Events and Evolutions Checklist

1. Mark the applicant license level for each simulator operating test number.

2. For the set of scenario columns, fill in the associated event number from Form 3.3-1, Scenario Outline, to show the specific event types being used for the applicant while in the assigned crew position for that scenario.

• Minimums are subject to the instructions in Section C.2, License Level Criteria.

KEY: RX = Reactivity Manipulation; NOR = Normal Evolution; I/C = Instrument/Component Failure; MAJ = Major Transient; Man. Ctrl = Manual Control of Automatic Function; TS = Technical Specification Evaluation; RO = Reactor Operator; SRO-I or I = Instant Senior Reactor Operator; SRO-U or U = Upgrade Senior Reactor Operator; SRO = Senior Reactor Operator; ATC = At the Controls; and BOP = Balance of Plan

IP 21 Operator Licensing Exam Schedule From 10/01/2022 to 09/30/2023 Phase Code: 2 - Construction, 5 - Operational Region: 4 By Date # Candidates Exam Staart Exam End Site Docket # Insp Rpt Cac # RO LSRO SROI SROU Type Exam Chief Examiner

1. Author Examiner 1/22/2023 1/28/2023 Columbia 05000397, 2023301 000956 0 0 0 0 FB-OR-ONSITE Hernande Kirkland, John; Generating 05000460 VALIDATION z, Nick You, David; Station OF INITIAL Hernandez, LICENSE Nick; EXAMINATION Demarshall, (OV) Joseph; Murphy, Kevin 2/19/2023 2/25/2023 Columbia 05000397, 2023301 000500 7 0 4 2 FB-OR-INITIAL NFF Hernande Kirkland, John; Generating 05000460 LICENSE EXAM z, Nick You, David; Station ADMINISTRATI Hernandez, ON (EXAD) Nick; Demarshall, Joseph; Murphy, Kevin Sites: CGS Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV Prepared on 4/26/2023 11:32:30 AM

IP 21 Operator Licensing Exam Schedule Region/Site Summary RO SROI SROU LSRO Total 4 7 4 2 0 13 Exam Date/Site Summary RO SROI SROU LSRO Total 2/19/2023 7 4 2 0 13 Region/Docket Summary RO SROI SROU LSRO Total 4 7 4 2 0 13 Exam Date/Docket Summary RO SROI SROU LSRO Total 2/19/2023 7 4 2 0 13 Sites: CGS Orgs: ALL Exam Author: ALL Activity Codes: EXAD, NEXAD, NOV, OV Prepared on 4/26/2023 11:32:30 AM