SVPLTR 23-0002, 2.3-4 - Written Examination Quality Checklist

2.3-4 - Written Examination Quality Checklist

ML23160A055
Person / Time
Site:	Dresden
Issue date:	03/16/2023
From:	Constellation Energy Generation
To:	NRC/RGN-III
Gregory Roach
Shared Package
ML22007A046	List: ML23160A052 ML23160A054 SVPLTR 23-0002, 2.3-4 - Written Examination Quality Checklist
References
SVPLTR: #23-0002
Download: ML23160A055 (1)

Text

Form 2.3-4 Written Examination Quality Checklist Facility: Dresden Date of Exam: 4/10/23 Exam Level: RO IZI SRO IZI (Y)es / (N)o Item Description a b* c#

1.

2.

Questions and answers are technically accurate and applicable to the facility. Each question includes a technical reference.

a. All questions reference NRG knowledge and abilities (K/As) requirements.

i y GMR y

b. Facility learning objectives are referenced as available.

c. All questions include an explanation of the correct answer explanation and a distractor analysis.

'( GMR

3. Senior reactor operator (SRO} questions test at the SRO license level. 'I 7 GMR

4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensinq proqram office.)

'/ y GMR

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started.

__ The examinations were developed independently.

_X_ The licensee certifies that there is no duplication.

y y GMR Other (explain):

6. Bank use meets limits (no more than 75% from the bank, at Bank Modified New least 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution > 44 / 16 0/0 31/9 y y GMR

7. Between 38 and 45 questions of the questions on the RO exam Memory CIA and at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual RO/SRO-only question distribution > 36/7 39 / 18

'/ '( GMR

8. References/handouts provided do not give away answers or aid in the elimination of distractors. y y GMR

9. Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the KIA statements' assigned tier; deviations are justified. r y GMR

10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. '/ y GMR

11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet. i y GMR Printelld / Date

a. Author Derek Siuda / 1lili

b. Facility Reviewer (*) Jonathan Chaoman I f f]LJ 1/flJ.tl C. NAC Reviewer(#)

Gregory M. Roach, Jr.

(J} Gregory M. Roach, Jr. 3/14/23 NRC Chief Examiner Gregory M. Roach, Jr. Gregory M. Roach, Jr. 3/14/23 NRG Regional Supervisor April M. Nguyen Digitally signed by April M. Nguyen Date: 2023.03.16 11:00:27 -05'00'

• The facility licensee signature is not applicable for NRG-developed tests.

1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.