ML24330A044

Adams 2B Exam Administrative Items

ML24330A044
Person / Time
Issue date:	11/25/2024
From:	NRC/RGN-II
To:
References
Download: ML24330A044 (1)

Text

Operating Exam Date 9/23/2024 Written Exam Date 10/10/2024 This schedule assumes that the exit meeting occurs before the administration of the written exam and the receipt of facility post-exam comments.

Form 2.1-1 Description Calc Target Reference / Forms Examination Planning 1

Examination Administration Date Confirmed 1/27/2024 ES-2.1 A.1-5 mnk 2

NRC Examiners and Facility Contact Assigned 2/26/2024 ES-2.1 C.1 mnk 3

Facility contact briefed on exam security 2/26/2024 ES-2.1 D.4 ES-4.1 A.1 ES-4.1 B.2 mnk 3

Facility submits prescreend K/A elimination list 2/26/2024 ES-2.1 C.4.j mnk 4

Reference Material Due for NRC prepared exams 2/26/2024 ES-2.1 F mnk 5

Send Corporate Notification Letter 2/26/2024 ES-2.1 A.5 mnk 5

Contact Facility (210 Day Phone Call) 2/26/2024 ES-2.1 C.4.j mnk Examination Development 6

NRC-Developed Written Examination Outlines sent to facility (exam security established) 3/12/2024 ES-2.1 B.2 ES-4.1 A.1.b ES-4.1 A.2.a mnk 11/15/23 7

Develop Operating Test Outlines (B.6) 4/26/2024 ES-2.1 B.6 1.3-1, 2.3-1, 3.2-1, 3.2-2, 3.3-1, 3.4-1 mnk 8

Outlines Reviewed / Feedback Provided to Facility 5/10/2024 ES-2.3 mnk 9

Exam prepared by NRC Approved by supv and forwarded to Facility Licensee for review 6/15/2024 ES-2.3 NA 10 Draft Examination due (written, JPMs, and senarios) updated forms 7/10/2024 1.3-1, 2.3-1, 2.3-2, 2.3-4, 3.4-1 mnk 10 Reference Material Due for licensee prepaired exam 7/10/2024 mnk Examination Preparation 11 Preliminary waiver/excusal requests due 7/25/2024 ES-2.2 E.1 mnk 12 Written and operating test review completed 8/4/2024 ES-2.3 mnk 12 NRC supervisor authorization to proceed with facility review 8/4/2024 ES-2.3 D mnk 13 Exam review results discussed with NRC and facility 8/4/2024 ES-2.1 B.14 mnk 14 Prep week 8/19/2024 ES-2.1 I mnk 15 Preliminary License Applications Due and waiver/excusal request 8/24/2024 ES-2.2 C.1 mnk 16 Final License Applications Due and waiver/excusals 9/9/2024 ES-2.2 C and E 2.2-1 mnk 17 Exam approved by NRC supervisor 9/16/2024 ES-2.1 C.9 mnk 18 NRC supervisor Request facility feedback on exam 9/16/2024 ES-2.1 C.10 mnk 19 Final Applications Approved (10% Audit to confirm qualifications) 9/16/2024 ES-2.2 G mnk 19 Exam approval letter 9/16/2024 2.3-1 mnk 19 Waiver/excusal letters sent out 9/16/2024 mnk 20 Review exam admin guidelines with facility 9/16/2024 ES-2.1 D.14 mnk 21 Distribute approved scenarios and JPMs to examiners 9/16/2024 ES-2.1 D.12 mnk Examination Administration Administer Operating Exam 9/23/2024 mnk Administer Written Exam 10/10/2024 mnk Conduct Exit Meeeting 11/3/2023 Post-Examination Activities Actual date post exam comments received:

Receive Facility Post-Examination Comments 10/30/2024 ES-4.4 B.7 10/7/2024 Notify applicants of exam results 11/6/2024 ES-5.1 D mnk Issue Exam Report 12/21/2024 OLMC 510 mnk ADAMS record submitted 2/4/2025 OLMC 520 mnk Contact NRR for concurrence if written and operating exams will be administered more than 30 days apart.

11/13/2024 1 of 1

Form 2.3-1 Examination Outline Quality Checklist Facility: Catawba Date of Examination: August 19, 2024 Item Task Description (Y)es / (N)o a

b*

c#

WRITTEN

a. The outline was systematically and randomly prepared in accordance with the instructions in Section B of ES-4.1, and all knowledge and ability (K/A) categories are appropriately sampled.

X X

b. The outline does not overemphasize any systems, evolutions, or generic topics.

X X

c. Justifications for deselected or rejected K/A statements are acceptable.

X X

SIMULATOR

a. Using Form 3.4-1, Events and Evolutions Checklist, verify that the proposed scenario set contains the required number of normal evolutions, reactivity evolutions, instrument and component failures, manual control evolutions, technical specifications, and major transients.

b. There are enough scenarios (and spares) for the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity. Ensure that scenarios will not be repeated on subsequent days.

c. Ensure that all scenarios are new or significantly modified in accordance with ES-3.4 and that no scenarios are duplicated from the applicants audit test(s).

d. To the extent possible, assess whether the outline(s) conforms with the qualitative and quantitative simulator set criteria specified on Form 2.3-2.

JPMS

a. Verify that the administrative outline meets the criteria specified in the instructions on Form 3.2-1 and that no tasks are duplicated from the applicants audit test(s).

b. Verify that the control room and in-plant systems outline meets the criteria specified in the instructions on Form 3.2-2 and that no tasks are duplicated from the applicants audit test(s).

c. Determine whether the number of job performance measures (JPMs) and JPM types is sufficient for the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

GENERAL

a. Assess whether the appropriate exam sections cover plant-specific priorities (including probabilistic risk assessment and individual plant examination insights).

b. Assess whether the 10 CFR 55.41, 10 CFR 55.43, and 10 CFR 55.45 sampling is appropriate.

c. Check whether K/A importance ratings (except for plant-specific priorities) are greater than or equal to 2.5.

d. Check for duplication and overlap across the exam and with the last two NRC exams.

e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (reactor operator or senior reactor operator).

Printed Name/Signature Date

a. Author

_Shane Battenfield/_________________________________________________

b. Facility Reviewer (*)

___________N/A_________________________________________________

c. NRC Reviewer (#)

Michael Kennard/__________________________________________________

NRC Chief Examiner _Michael Kennard/__________________________________________________

NRC Supervisor Tom Stephen_____________________________________________________

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs the steps in column c. This may be the NRC Chief Examiner if he/she did not develop the outline under review.

SIGN SIGN SIGN

Form 2.3-2 Operating Test Quality Checklist a.

Each job performance measure (JPM) includes the following, as applicable:

task standard initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if the facility licensee deems it to be time critical alternate path JPMs are labeled as "alternate path"

\\)

. operationally important specific performance criteria that include the following:

y I

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the JPM task standard identification of critical steps and their associated performance standards restrictions on the seauence of steos, if annficable b.

Ensure that any changes from the previously approved JPM outlines (Forms 3.2-1 and 3.2-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item y y distribution, bank use, repetition from the last two NRC examinations) specified on those forms.

Simulator Scenario Set Criteria for Scenario Numbers:

112/314 QUALITATIVE ATTRIBUTES 1.

The initial conditions are realistic in that some equipment and/or instrumentation may be r y out of service, but it does not cue the operators into expected events.

2.

The scenarios consist mostly of related events.

y I/

3.

Each event description consists of the following:

the point in the scenario when it is to be initiated

,; y the malfunction(s) or conditions that are entered to initiate the event I

the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

QUALITATIVE ATTRIBUTES (continued)

(Y)es I (N)o a

b" c#

4.

The events are valid with regard to physics and thermodynamics.

y y 5.

The sequencing and timing of events is reasonable and allows the examination team to y,Y observe and evaluate applicant performance.

6.

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time

( y constraints. Cues are given.

7.

The simulator modeling is not altered.

i V 8.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator y y performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

9.

Scenarios are new or significantly modified in accordance with ES-3.4.

1 y y

y y

y y

y y

y y

y y

10. Scenarios (as grouped) allow each applicant to be significantly involved in the minimum number of transients, events, and evolutions specified on the version of Form 3.4-1 I/ y submitted with the scenario set.

I 11, Applicants are evaluated on a similar number of preidentified critical tasks across

{ y scenarios, when possible.

12. The level of difficulty is appropriate to support licensing decisions for each crew position.

( 7 Actual Attributes by (Y)es I (N)o TARGET QUANTITATIVE ATTRIBUTES per Scenario (See ES-3.4)

Scenario No.

1/2/3/4 a

b*

c#

1.

Malfunctions after emergency operating procedure (EOP) 3/2/2/2 V y entry (1-2) 2.

Abnormal events (2-4) 4/5/414

.y

'{

3.

Major transients (1-2) 1/1/1/2 IV y 4.

EOPs entered/requiring substantive actions (1-2) 2/2/2/2

'( 'Y 5.

Entry into a contingency EOP with substantive actions 1/1/0/1 y y (c: 1 per scenario set; set is the entire set of scenarios prepared for the scheduled exam) 6.

Preidentified critical tasks (c: 2) 3/2/2/2 y' 'I P

inte e/Signature Date oc,/tJu/2cf a.

Author Rustv Miller/

77./,J,,V" f/_

b.

Facility Reviewer (*)

Charlie James I L bJO'f'/.11{

C.

NRC Reviewer (#)

NRC Chief Examiner NRC Supervisor

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRC reviewer perfonms the steps in column c. This may be the NRC Chief Examiner if he/she did not develon the ooeratinq test under review.

y y

y y

y y

y y

y Michael Kennard/

9/6/2024 Michael Kennard /

9/6/2024

Form 2.3-4 Written Examination Quality Checklist Facility:Catawba Nuclear Station Date of Exam: 09/23/2024 Exam Level:

RO © SRO Item Description (Y)es / (N)o a

b*

c#

1.

Questions and answers are technically accurate and applicable to the facility. Each question

<< b-includes a technical reference.

2.

a. All questions reference NRG knowledge and abilities (KIAs) requirements.

b. Facility learning objectives are referenced as available.

CJ

c. All questions include an explanation of the correct answer explanation and a distractor

{3(1 analvsis.

3.

Senior reactor operator (SRO) questions test at the SRO license level.

fly\\ 

4.

The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRG licensing exams, including full QI\\

(100-question) retake examinations, consult the NRG Office of Nuclear Reactor Regulation operator licensinQ proqram office.)

5.

Question duplication from the licensee screening/audit exam was controlled as indicated below (checbe item that applies) and appears appropriate:

The audit exam was systematically and randomly developed.

¬

_ The audit exam was completed before the license exam was started.

/JYI

_ The examinations were developed independently.

...a(The licensee certifies that there is no duplication.

Other (explain):

6.

Bank use meets limits (no more than 75% from the bank, at least Bank Modified New

/1,,,

10% new (at the comprehension/analysis level), and the rest new or IY \\ (.,.r modified); enter the actual RO/SRO-only question distribution >

35113 16, 6 2416 7.

Between 38 and 45 questions of the questions on the RO exam and Memory CIA w

at least 13 of the questions on the SRO-only portion of the exam

(),.j\\

are written at the comprehension/analysis level; enter the actual

• v RO/SRO-only question distribution >

32 I 10

3115 1/

8.

References/handouts provided do not give away answers or aid in the elimination of distractors.

J;)/1 9.

Question content conforms to specific KIA statements in the previously approved examination t..r outline and is appropriate for the KIA statements' assigned tier; deviations are justified.

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2.

/J1 l.r

11. The exam contains the required number of one-point, multiple-choice items; the total is correct

/ri -

and agrees with the value on the cover sheet.

Printed Na

/

e: sZ/C2 Dai a.

Author Rv

+-.. Mill..tr o 2Jl2.oz<f_

C.hQrtrt ..-t,r / 

I

b.

Facility Reviewer(*)

t1x'-]- '-OJ.'-/

C.

NRG Reviewer(#)

NRG Chief Examiner NRG Regional Supervisor

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRG reviewer performs steps in column c. This may be the NRG Chief Examiner if he/she did not develop the written examination under review.

ES-2.3, Page 16 of 19 Y

Y Y

Y Y

Y Y

Y Y

Y Y

Michael Kennard /

9/6/2024 Michael Kennard /

9/6/2024

Form 5.1-1 Postexamination Check Sheet Postexamination Check Sheet Facility: Catawba Dates of Examination: 9/23-26 and 10/3/24 Activity Description Date Complete

1. *Received postexamination package from facility licensee and verified complete. (ES-4.4) 10/7/24

2. *Reviewed and incorporated any necessary facility and applicant written examination comments. NRC grading of written examination completed. (ES-4.4)

N/A

3. *Reviewed and incorporated any necessary facility and applicant operating test comments. NRC grading of operating test completed.

(ES-3.6) 10/30/24

4. *Completed NRC chief examiner review of operating test and written examination grading. (ES-3.6 and ES-4.4) 10/25/24

5. Completed licensing official review.

10/25/24

6. Mailed licenses, preliminary results, and pass letters.

11/13/24

7. Notified facility licensee of results.

11/13/24

8. Issued the examination report (refer to Operator Licensing Manual Chapter (OLMC) 510, Operator Licensing Examination Reports).

11/13/24

9. Returned reference material after final resolution of any informal NRC staff reviews, hearing demands, or both.

11/13/24

10. Performed examination recordkeeping activities (refer to OLMC 520, Operator Licensing Examination Records and Documentation, and Management Directive 3.53, NRC Records and Document Management Program).

11/13/24

• Activity may not be applicable for a retake examination. If this activity does not apply, place an N/A in the Date Complete column.