IR 05000321/2007301

Dec. 2007 Exam 05000321-07-301, 05000366-07-301 Draft Written Exam Quality Checklist ES-401-6

ML080460209
Person / Time
Site:	Hatch
Issue date:	02/14/2008
From:	Michael B Division of Reactor Safety II
To:
References
50-321/07-301, 50-366/07-301
Download: ML080460209 (4)

Text

Draft Submittal (Pink Paper)DRAFT Written Exam Quality Checklist (ES-401-6)

&Written Exam Sample Plan HATCH DECEMBER 2007 EXAM 05000321/2007301 AND 05000366/2007301 DECEMBER3-6, 2007, AND DECEMBER 10, 2007, (WRITTEN)

ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility: Hatch Date of Exam: TBD Exam Level: SRO Initial 4.If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic.

9.Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;deviations are justified.

22 New 16 CIA 3 Modified 9 Memory o Bank Item Description Bruno Caballero Ronald F.Aiello Malcolm T.Widmann NRC KlAs are referenced for all questions.

Facility learning objectives are referenced as available.

a.b.Between 50 and 60 percent of, the questions on the RO exam are written at the comprehension/

analysis level;the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels;enter the actual RO/SRO question distribution(s)

at right.Bank u,se meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified);

enter the actual RO/SRO-only question distribution(s)

at right.7.6.2.3.SRO questions are appropriate in accordance with Section D.2.d of ES-401 1.Questions and answers are technically accurate and applicable to the facility.5.Question duplication from the license screening/audit exam was controlled as indicated helow (check the item that applies)and appears appropriate:

_the'audit exam was systematically and randomly developed audit exam was com pleted before the license exam was started examinations were developed independently licensee certifies that there is no duplication

_other (explain)8.References/handouts provided do not give away answers or aid in the elimination of distractors.

11.The exam contains the required number of one-point, multiple choice items;the total is correct and agrees with the value on the cover sheet.a.Author b.Facility Reviewer (*)c.NRC Chief Examiner (#)d.NRC Regional Supervisor 10.Question psychometric quality and format meet the guidelines in ES Appendix B.Note:*The facility reviewer's initials/signature are not applica Ie for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column"c";chief examiner concurrence require ES-401 Written Examination Quality Checklist Form ES-401-6 DRAFT Facility: Hatch Date of Exam: TBD Exam Level: RO Initial 4.If more than four RO and two SRO questions are repeated from the last two NRC licensing exams, the facility licensee's sampling process was random and systematic.

9.Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;deviations are justified.

3.SRO questions are appropriate in accordance with Section D.2.d of ES-401 65 New 41 CIA 8 Modified Memory 34 2 Bank Item Description NRC KlAs are referenced for all questions.

Facility learning objectives are referenced as available.

a.b.Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/

analysis level;the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels;enter the actual RO/SRO question distribution(s)

at right.Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified);

enter the actual RO/SRO-only question distribution(s)

at right.2.6.7.5.Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies)and appears appropriate:

_the audit examwassystematically and randomly developed_the audit exam was completed before the license exam was started_the'examinations were developed independently

_thelicensee certifies that there is no duplication

_other (explain)1.Questions and answers are technically accurate and applicable to the facility.8.References/handouts provided do not give away answers or aid in the elimination of distractors.

10.Question psychometric quality and format meet the guidelines in ES Appendix B.11.The exam contains the required number of one-point, multiple choice items;the total is correct and agrees with the value on the cover sheet.a.Author b.Facility Reviewer (*)c.NRC Chief Examiner (#)d.NRC Regional Supervisor Bruno Caballero Ron Aiello Malcolm T.Widmann Note:*The facility reviewer's initials/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column H C";chief examiner concurrence required.