ML17109A352
| ML17109A352 | |
| Person / Time | |
|---|---|
| Site: | Salem  |
| Issue date: | 12/12/2016 |
| From: | D'Antonio J Operations Branch I |
| To: | Public Service Enterprise Group |
| Shared Package | |
| ML16076A441 | List: |
| References | |
| U01930 | |
| Download: ML17109A352 (3) | |
Text
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Sol-em Date of Exam: 1z./1q\\1 <o Exam Level:
RO ~ SRO fil Initial Item Description a
b*
c*#
- 1.
Questions and answers are technically accurate and applicable to the facility.
- .J Q..
/}-
- 2.
- a.
NRC K/As are referenced for all questions.
~
Q-"
- b.
Facility learning objectives are referenced as available.
"d
- 3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 A-( ~ ~
4 The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were 4-
'-........./\\
///
__.. r7 repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office).
~
- 5.
Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate
_The audit exam was systematically and randomly developed; or er
_the audit exam was completed before the license exam was started; or A
")/
_the examinations were developed independently; or 0he licensee certifies that there is no duplication; or
_other (explain)
- 6.
Bank use meets limits (no more than 75 percent from the Bank Modified New bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question 4-1115 I I 0 ~3110 ;j_
(},
7 distribution(s) at right
- 7.
Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent ifthe randomly selected Al-K/As support the higher cognitive levels; enter the actual 3~1 10 39 I \\5
(}.
(}"
RO I SRO question distribution(s) at right.
- 8.
References/handouts provided do not give away answers or aid in the elimination of distractors. A-lli.
/Y
- 9.
Question content conforms to specific KJA statements in the previously approved examination fi-
<i
/j/
outline and is appropriate for the tier to which they are assigned; deviations are justified.
- 10.
Question psychometric quality and format meet the guidelines in ES Appendix B. (}.
a-
- 11.
The exam contains the required number of one-point, multiple choice items; the total is correct A-
<}_
- 1/
and agrees with the value on the cover sheet.
Printed Name I Signature Date
- a.
Author r
..,,..,J,.. f cl hcaµ~L I') C\\ AtM A11,uQ~\\
10 /10 I 11.:.
J ID I F/1Mi111/J u~
\\..._)
~t
- b.
Facility Reviewer(*)
- c.
NRC Chief Examiner(#)
- r. o*11 ;V f'>,.j~ I /Jfa..u!Alr 't
~
nE=
\\A I / --
A JI ti.IV. {) ) "F__/
~
"/zz [t6
- d.
NRC Regional Supervisor
./
(
/
Note:
The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Independent NRC reviewer initials items in Column "c"; chief examiner concurrence required~
ES-401, Page 46 of 50
ES-403 Written Examination Grading Quality Checklist Facility: Sct\\e yY\\
Date of Exam: ri/,q/u,, Exam Level:
Item Description
- 1.
Clean answer sheets copied before grading
- 2.
Answer key changes and question deletions justified and documented
- 3.
Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations)
- 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail
- 5.
All other failing examinations checked to ensure that grades are justified
- 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature
- a. Grader c,..,,a,J. Gr.wJ.0 ~.o A~
- b. Facility Reviewer(*) Wr<-<- 'A'""
Mu Ff {c.z.,
c./'\\_../
- c.
NRC Chief Examiner (*) J. j} If,J f~ t-/iv //}1j}a4
- d. NRC Supervisor (*)
'/
De.~.. lJ. f:...bcltsOV\\ //J.a W
Initials a
b c
4-iV ~
A-t,u
/,J
- l LV
/¢ h!-
UJ ~
A
\\}J
~
- .J-
\\Y r:z Date ri..{1qI1 to J.?/;o/c.
I I
Q/ / t./i<>/?
1 /i~/17
(*)
The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 6 of 6
(
(
- b.
After evaluating the examinations, review the grading in detail and complete Form ES-403-1, "Examination Grading Quality Checklist."
- c.
Forward the examination package (i.e., the master examination and answer key, justification for any examination changes, any item analysis that was performed, the applicant's examination cover and answer sheets (the graded original and one clean copy), and Form ES-403-1) to the designated facility representative (if applicable) or to the NRC's chief examiner for review in accordance with ES-501.
E.
Attachments/Forms Form ES-403-1 Written Examination Grading Quality Checklist ES-403, Page 5 of 6