ML23146A048

Form 2.3-4 Written Examination Quality Checklist

ML23146A048
Person / Time
Site:	Byron
Issue date:	02/27/2023
From:	Constellation Energy Generation
To:	NRC/RGN-III
Bruce Bartlett
Shared Package
ML19121A201	List: BYRON 2022-0064, Letter 2022-0064 Submittal of Byron Integrated Initial License Training Examination Materials(Signed) ML23146A046 ML23146A048
References
Download: ML23146A048 (1)

Text

Form 2.3-4 Written Examination Quality Checklist Facility: Byron Date of Exam: 12/12/2022 Exam Level: RO SRO Item Description (Y)es / (N)o a

b*

c#

1.

Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference.

Y Y

Y

2. a. All questions reference NRC knowledge and abilities (K/As) requirements.

b. Facility learning objectives are referenced as available.

c. All questions include an explanation of the correct answer explanation and a distractor analysis.

Y Y

Y

3.

Senior reactor operator (SRO) questions test at the SRO license level.

Y Y

Y

4.

The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing program office.)

Y Y

Y

5.

Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started.

__ The examinations were developed independently.

__ The licensee certifies that there is no duplication.

__ Other (explain):

Y Y

Y

6.

Bank use meets limits (no more than 75% from the bank, at least 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution>

Bank Modified New Y

Y Y

37/14 5 / 2 33 / 9 Y

Y Y

7.

Between 38 and 45 questions of the questions on the RO exam and at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution >

Memory C/A Y

Y Y

33 / 12 42 / 13 Y

Y Y

8.

References/handouts provided do not give away answers or aid in the elimination of distractors.

Y Y

Y

9.

Question content conforms to specific K/A statements in the previously approved examination outline and is appropriate for the K/A statements assigned tier; deviations are justified.

Y Y

Y

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2.

Y Y

Y

11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.

Y Y

Y Printed Name/Signature Date

a. Author

___Barry Mingus______Barry Mingus /s/____________________________ _09/27/22_

b. Facility Reviewer (*)

___Austin Wilde______Austin Wilde /s/_____________________________ 09/27/22_

c. NRC Reviewer (#)

Bryan Bergeon /s/________________________________________ 11/18/22_

NRC Chief Examiner NRC Regional Supervisor

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.

12/6/22 Bruce L. Bartlett Digitally signed by Bruce L.

Bartlett Date: 2022.12.08 08:19:35

-06'00' April M. Nguyen Digitally signed by April M. Nguyen Date: 2022.12.08 11:45:00 -06'00'