ML23146A048

Form 2.3-4 Written Examination Quality Checklist

ML23146A048
Person / Time
Site:	Byron
Issue date:	02/27/2023
From:	Constellation Energy Generation
To:	NRC/RGN-III
Bruce Bartlett
Shared Package
ML19121A201	List: BYRON 2022-0064, Letter 2022-0064 Submittal of Byron Integrated Initial License Training Examination Materials(Signed) ML23146A046 ML23146A048
References
Download: ML23146A048 (1)

Text

Form 2.3-4 Written Examination Quality Checklist Facility: Byron Date of Exam: 12/12/2022 Exam Level: RO SRO (Y)es / (N)o Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference. Y Y Y

2. a. All questions reference NRC knowledge and abilities (K/As) requirements.

b. Facility learning objectives are referenced as available.

c. All questions include an explanation of the correct answer explanation and a distractor Y Y Y analysis.

3. Senior reactor operator (SRO) questions test at the SRO license level. Y Y Y

4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation Y Y Y operator licensing program office.)

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started. Y Y Y

__ The examinations were developed independently.

__ The licensee certifies that there is no duplication.

__ Other (explain):

6. Bank use meets limits (no more than 75% from the bank, at least Bank Modified New Y Y Y 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution> 37/14 5/2 33 / 9 Y Y Y

7. Between 38 and 45 questions of the questions on the RO exam and at least 13 of the questions on the SRO-only portion of the Memory C/A Y Y Y exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution > 33 / 12 42 / 13 Y Y Y

8. References/handouts provided do not give away answers or aid in the elimination of distractors. Y Y Y

9. Question content conforms to specific K/A statements in the previously approved examination outline and is appropriate for the K/A statements assigned tier; deviations are justified. Y Y Y

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. Y Y Y

11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet. Y Y Y Printed Name/Signature Date

a. Author ___Barry Mingus______Barry Mingus /s/____________________________ _09/27/22_

b. Facility Reviewer (*) ___Austin Wilde______Austin Wilde /s/_____________________________ 09/27/22_

c. NRC Reviewer (#) Bryan Bergeon /s/________________________________________ Digitally signed by Bruce L. 11/18/22_

Bruce L. Bartlett Bartlett 12/6/22 Date: 2022.12.08 08:19:35 NRC Chief Examiner _____________________________________________________________ -06'00' __________

April M. Nguyen Date: 2022.12.08 11:45:00 -06'00' Digitally signed by April M. Nguyen NRC Regional Supervisor _____________________________________________________________ __________

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.