ML23199A155

Form 2.3-4 Written Examination Quality Checklist

ML23199A155
Person / Time
Site:	Point Beach
Issue date:	02/03/2023
From:	NRC/RGN-III/DORS/OB
To:	Point Beach
Jim Nance
Shared Package
ML22007A027	List: ML23199A153 ML23199A155
References
Download: ML23199A155 (1)

Text

Form 2.3-4 Written Examination Quality Checklist Facility: Point Beach Date of Exam: Week of Feb 20, 2023 Exam Level: RO SRO (Y)es / (N)o Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. Each question Y N/A Y includes a technical reference.

2. a. All questions reference NRC knowledge and abilities (K/As) requirements.

b. Facility learning objectives are referenced as available.

Y N/A Y

c. All questions include an explanation of the correct answer explanation and a distractor analysis.

3. Senior reactor operator (SRO) questions test at the SRO license level. Y N/A Y

4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full Y N/A Y (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing program office.)

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started. Y N/A Y

__ The examinations were developed independently.

__ The licensee certifies that there is no duplication.

__ Other (explain):

6. Bank use meets limits (no more than 75% from the bank, at least Bank Modified New 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution > 33/7 11/6 32/12 Y N/A Y

7. Between 38 and 45 questions of the questions on the RO exam Memory C/A and at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution > 37/6 38/19 Y N/A Y

8. References/handouts provided do not give away answers or aid in the elimination of distractors. Y N/A Y

9. Question content conforms to specific K/A statements in the previously approved examination Y N/A Y outline and is appropriate for the K/A statements assigned tier; deviations are justified.

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. Y N/A Y

11. The exam contains the required number of one-point, multiple-choice items; the total is correct Y N/A Y and agrees with the value on the cover sheet.

Printed Name/Signature Date

a. Author Troy Henning / Troy J. Henning_and Jeff Correll / _Jeffrey A. Correll_____ _2/02/2023

b. Facility Reviewer (*) N/A________________________________________________________ __________

c. NRC Reviewer (#) Randal Dean Baker / _________________________ 2/02/2023_

NRC Chief Examiner James C. Nance / James C. Nance ________________________________ _2/02/2023_

NRC Regional Supervisor April Nguyen / ______________________________________________ 2/3/2023

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.