ML23079A207

Form 2.3-4 Written Examination Quality Checklist (Quad Cities, 2023)

ML23079A207
Person / Time
Site:	Quad Cities
Issue date:	01/13/2023
From:	NRC/RGN-III/DORS/OB
To:	Exelon Generation Co
Theodore Wingfield
Shared Package
ML22125A064	List: ML23079A203 ML23079A204 ML23079A207
References
Download: ML23079A207 (1)

Text

Form 2.3-4 Written Examination Quality Checklist Facility: Quad Cities Date of Exam: 1/30/2023 Exam Level: RO SRO (Y)es / (N)o Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference.

Y Y Y

2. a. All questions reference NRC knowledge and abilities (K/As) requirements.

b. Facility learning objectives are referenced as available.

c. All questions include an explanation of the correct answer explanation and a distractor Y Y Y analysis.

3. Senior reactor operator (SRO) questions test at the SRO license level. Y Y Y

4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation Y Y Y operator licensing program office.)

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started. Y Y Y

__ The examinations were developed independently.

__ The licensee certifies that there is no duplication.

__ Other (explain):

6. Bank use meets limits (no more than 75% from the bank, at least Bank Modified New Y Y Y 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution > 12 / 5 1 / 0 62 / 20 Y Y Y

7. Between 38 and 45 questions of the questions on the RO exam and Memory C/A at least 13 of the questions on the SRO-only portion of the exam Y Y Y are written at the comprehension/analysis level; enter the actual 33 / 07 42 / 18 Y Y RO/SRO-only question distribution > Y

8. References/handouts provided do not give away answers or aid in the elimination of distractors. Y Y Y

9. Question content conforms to specific K/A statements in the previously approved examination Y Y outline and is appropriate for the K/A statements assigned tier; deviations are justified. Y

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. Y Y Y

11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet. Y Y Y Printed Name/Signature Date

a. Author Sean Sullivan

_____________________________________________________________ 11/11/22

b. Facility Reviewer (*) Matt Seeley

_____________________________________________________________ 11/11/22

c. NRC Reviewer (#) Travis D. Iskierka-Boggs Digitally signed by Travis D. Iskierka-Boggs Date: 2023.01.12 15:31:19 -05'00' NRC Chief Examiner Theodore V. Wingfield Digitally signed by Theodore V. Wingfield Date: 2023.01.12 15:38:30 -05'00' NRC Regional Supervisor April M. Nguyen Digitally signed by April M. Nguyen Date: 2023.01.13 08:09:37 -06'00'

• The facility licensee signature is not applicable for NRC-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.