ML22179A331: Difference between revisions
StriderTol (talk | contribs) StriderTol Bot change |
StriderTol (talk | contribs) StriderTol Bot change |
||
| Line 16: | Line 16: | ||
=Text= | =Text= | ||
{{#Wiki_filter:ES-401 Written Examination Quality Checklist | {{#Wiki_filter:ES-401 Written Examination Quality Checklist Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: | ||
Item Description | |||
Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: | : 1. | ||
Questions and answers are technically accurate and applicable to the facility. | |||
Item Description | : 2. | ||
: 3. | |||
4 | |||
: 1. Questions and answers are technically accurate and applicable to the facility. | : 5. | ||
: 6. | |||
: | : 7. | ||
: b. Facility learning objectives are referenced as available. | : 8. | ||
: c. Correct answer explanation and distractor analysis provided (ES-401, D.2.g) | : 9. | ||
: 10. | |||
: 11. | |||
: a. | |||
NRC K/As are referenced for all questions. | |||
: b. | |||
Facility learning objectives are referenced as available. | |||
: c. | |||
Correct answer explanation and distractor analysis provided (ES-401, D.2.g) | |||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office). | |||
Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate. | |||
_ The audit exam was systematically and randomly developed, or | _ The audit exam was systematically and randomly developed, or | ||
_ the audit exam was completed before the license exam was started, or | _ the audit exam was completed before the license exam was started, or | ||
_ the examinations were developed independently, or | _ the examinations were developed independently, or | ||
.K the licensee certifies that there is no duplication, or | .K the licensee certifies that there is no duplication, or | ||
_ other (explain). | _ other (explain). | ||
Bank use meets limits (no more than 75% from the bank, at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right. | |||
Bank Modified New I 1s Between 38 and 45 questions of the questions on the RO exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter the actual RO/SRO-only question distribution(s) at right. | |||
Memory CIA 30 | |||
/ 75 45 References/handouts provided do not give away answers or aid in the elimination of distractors. | |||
I 15 Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. | |||
Question psychometric quality and format meet the guidelines in Appendix B. | |||
The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet. | |||
Printed Name/Signature | |||
: a. | |||
Author | |||
: b. | |||
Facility Reviewer(*) | |||
: c. | |||
NRC Chief Examiner(#) | |||
Form ES-401-6 RO 0 SRO a | |||
Initial b* | |||
c*# | |||
~ ~ | |||
~ | |||
I,)/ I+ | |||
?~ | |||
Date | |||
,-l o -t ! | |||
~-1.1-l~ | |||
: d. | |||
NRC Regional Supervisor ~pcc*..,,.__-'-'=-"-'-''--""..___,....,_..1.:..1CM<-"""'.....,'+----L<"-"--,-ljlo4--'-I-...,_--""'-------- | |||
~/r, /t'o | |||
°i /,7 | |||
'lbl'\\ | |||
Note: | |||
The facility reviewer's initials or signature are not applicable for NRG-developed examinations. | |||
Independent NRC reviewer initials items in Column "c"; chief examiner concurrence is required, ES-401, Page 48 of 52 | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: | |||
RO SRO ~ | |||
Initial Item Description a | |||
b* | |||
c*# | |||
: 1. | |||
Questions and answers are technically accurate and applicable to the facility. | |||
~ | |||
~ ~ | |||
: 2. | |||
: a. | |||
Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: RO SRO ~ | NRC K/As are referenced for all questions. | ||
: b. | |||
Initial Item Description a b* c*# | Facility learning objectives are referenced as available. | ||
: 1. Questions and answers are technically accurate and applicable to the facility. ~ ~ ~ | ~ ~ | ||
: 2. a. NRC K/As are referenced for all questions. | : c. | ||
: b. Facility learning objectives are referenced as available. ~ ~ | Correct answer explanation and distractor analysis provided (ES-401, D.2.g) | ||
: c. Correct answer explanation and distractor analysis provided (ES-401, D.2.g) ~ | ~ | ||
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 k c£ ~ | : 3. | ||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 k | |||
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k ~ ~ | c£ ~ | ||
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k | |||
~ ~ | |||
program office). | program office). | ||
: 5. Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate. | : 5. | ||
Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate. | |||
_ The audit exam was systematically and randomly developed, or | _ The audit exam was systematically and randomly developed, or | ||
_ the audit exam was completed before the license exam was started, or | _ the audit exam was completed before the license exam was started, or | ||
_ the examinations were developed independently, or | _ the examinations were developed independently, or | ||
__25. the licensee certifies that there is no duplication, or | __25. the licensee certifies that there is no duplication, or | ||
_ other (explain). ~ ~ ftl3 | _ other (explain). | ||
: 6. Bank use meets limits (no more than 75% from the bank, Bank Modified New | ~ ~ ftl3 | ||
at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right. X / 25 19 / 25 ~ ~ | : 6. | ||
Bank use meets limits (no more than 75% from the bank, Bank Modified New - | |||
at least 10% new, and the rest new or modified); enter the | |||
: 7. Between 38 and 45 questions of the questions on the RO Memory C/A | ~ | ||
exam and at least 13 questions of the questions on the | / 25 _ -- | ||
SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter 0 / 25 25 I 25 x the actual RO/SRO-only question distribution(s) at right. | f$r-- | ||
: 8. References/handouts provided do not give away answers or aid in the elimination of % ~ | ~~ | ||
distractors. ~ | actual RO/SRO-only question distribution(s) at right. | ||
: 9. Question content conforms to specific KIA statements in the previously approved examination ~ ? ~ | X / 25 19 / 25 | ||
outline and is appropriate for the tier to which they are assigned; deviations are justified. ~ | ~ | ||
: 10. Question psychometric quality and format meet the guidelines in Appendix B. ~ ~- '1::'.A | ~ | ||
t,_,..... | |||
11. The exam contains the required number of one-point, multiple-choice items; the total is 5e' ~ ~ r9) correct and agrees with the value on the cover sheet. | : 7. | ||
Between 38 and 45 questions of the questions on the RO Memory C/A exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the | |||
~ ~,-.0 comprehension/analysis level (see ES-401, D.2.c); enter 0 | |||
/ 25 25 I 25 x | |||
the actual RO/SRO-only question distribution(s) at right. | |||
: 8. | |||
References/handouts provided do not give away answers or aid in the elimination of | |||
% ~ | |||
distractors. | |||
~ | |||
: 9. | |||
Question content conforms to specific KIA statements in the previously approved examination | |||
~ ? ~ | |||
outline and is appropriate for the tier to which they are assigned; deviations are justified. | |||
~ | |||
: 10. | |||
Question psychometric quality and format meet the guidelines in Appendix B. | |||
~ | |||
~- | |||
'1::'.A 11. | |||
The exam contains the required number of one-point, multiple-choice items; the total is 5e' | |||
~ ~ r9) correct and agrees with the value on the cover sheet. | |||
Printed Name/Signature Date | Printed Name/Signature Date | ||
: a. Author /:1),lil/J 0,rV C.S,Li.,,. ij# i-lA:>-Li | : a. | ||
: b. Facility Reviewer (*) ~ 1/4-- -c-:1 e-/ &:-rf t--21-1~ | Author | ||
/:1),lil/J 0,rV C.S,Li.,,. | |||
C. NRC Chief Examiner(#) 7.A ~"ll::,~ l. \\) ~ - ~ /~.J-.J2 ~ ~ 13/1, L1tJ | ij# | ||
i-lA:>-Li | |||
: b. | |||
V Note:. The facility reviewer's initials or signature are not applicable for NRG-developed examinations. | Facility Reviewer (*) | ||
~ | |||
1/4---c-:1 e-/ &:-rf t--21-1~ | |||
ES-401, Page 48 of 52}} | C. | ||
NRC Chief Examiner(#) | |||
7.A~"ll::,~l. \\) ~-~ | |||
/~.J-.J2 ~ | |||
~ 13/1, L1tJ | |||
"':S!> | |||
Q,.\\.rr1 ~ ~t" ~- '-"~ I #JJ/Mf..__" | |||
:}I i:l ~ | |||
i | |||
: d. | |||
NRC Regional Supervisor~ll>fii fl V | |||
Note:. | |||
The facility reviewer's initials or signature are not applicable for NRG-developed examinations. | |||
Independent NRC reviewer initials items in Column "c'; chief examiner concurrence is required 0 ES-401, Page 48 of 52}} | |||
Latest revision as of 16:37, 27 November 2024
| ML22179A331 | |
| Person / Time | |
|---|---|
| Site: | Prairie Island |
| Issue date: | 08/08/2018 |
| From: | Randy Baker NRC/RGN-III/DRS/OLB |
| To: | Nuclear Management Co |
| Baker R | |
| Shared Package | |
| ML17165A322 | List: |
| References | |
| Download: ML22179A331 (2) | |
Text
ES-401 Written Examination Quality Checklist Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:
Item Description
- 1.
Questions and answers are technically accurate and applicable to the facility.
- 2.
- 3.
4
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- a.
NRC K/As are referenced for all questions.
- b.
Facility learning objectives are referenced as available.
- c.
Correct answer explanation and distractor analysis provided (ES-401, D.2.g)
SRO questions are appropriate in accordance with Section D.2.d of ES-401 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office).
Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate.
_ The audit exam was systematically and randomly developed, or
_ the audit exam was completed before the license exam was started, or
_ the examinations were developed independently, or
.K the licensee certifies that there is no duplication, or
_ other (explain).
Bank use meets limits (no more than 75% from the bank, at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right.
Bank Modified New I 1s Between 38 and 45 questions of the questions on the RO exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter the actual RO/SRO-only question distribution(s) at right.
Memory CIA 30
/ 75 45 References/handouts provided do not give away answers or aid in the elimination of distractors.
I 15 Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
Question psychometric quality and format meet the guidelines in Appendix B.
The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.
Printed Name/Signature
- a.
Author
- b.
Facility Reviewer(*)
- c.
NRC Chief Examiner(#)
Initial b*
c*#
~ ~
~
I,)/ I+
?~
Date
,-l o -t !
~-1.1-l~
- d.
NRC Regional Supervisor ~pcc*..,,.__-'-'=-"-'---""..___,....,_..1.:..1CM<-"""'.....,'+----L<"-"--,-ljlo4--'-I-...,_--""'--------
~/r, /t'o
°i /,7
'lbl'\\
Note:
The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Independent NRC reviewer initials items in Column "c"; chief examiner concurrence is required, ES-401, Page 48 of 52
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:
Initial Item Description a
b*
c*#
- 1.
Questions and answers are technically accurate and applicable to the facility.
~
~ ~
- 2.
- a.
NRC K/As are referenced for all questions.
- b.
Facility learning objectives are referenced as available.
~ ~
- c.
Correct answer explanation and distractor analysis provided (ES-401, D.2.g)
~
- 3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 k
c£ ~
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k
~ ~
program office).
- 5.
Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate.
_ The audit exam was systematically and randomly developed, or
_ the audit exam was completed before the license exam was started, or
_ the examinations were developed independently, or
__25. the licensee certifies that there is no duplication, or
_ other (explain).
~ ~ ftl3
- 6.
Bank use meets limits (no more than 75% from the bank, Bank Modified New -
at least 10% new, and the rest new or modified); enter the
~
/ 25 _ --
f$r--
~~
actual RO/SRO-only question distribution(s) at right.
X / 25 19 / 25
~
~
t,_,.....
- 7.
Between 38 and 45 questions of the questions on the RO Memory C/A exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the
~ ~,-.0 comprehension/analysis level (see ES-401, D.2.c); enter 0
/ 25 25 I 25 x
the actual RO/SRO-only question distribution(s) at right.
- 8.
References/handouts provided do not give away answers or aid in the elimination of
% ~
distractors.
~
- 9.
Question content conforms to specific KIA statements in the previously approved examination
~ ? ~
outline and is appropriate for the tier to which they are assigned; deviations are justified.
~
- 10.
Question psychometric quality and format meet the guidelines in Appendix B.
~
~-
'1::'.A 11.
The exam contains the required number of one-point, multiple-choice items; the total is 5e'
~ ~ r9) correct and agrees with the value on the cover sheet.
Printed Name/Signature Date
- a.
Author
/:1),lil/J 0,rV C.S,Li.,,.
ij#
i-lA:>-Li
- b.
Facility Reviewer (*)
~
1/4---c-:1 e-/ &:-rf t--21-1~
C.
NRC Chief Examiner(#)
7.A~"ll::,~l. \\) ~-~
/~.J-.J2 ~
~ 13/1, L1tJ
"':S!>
Q,.\\.rr1 ~ ~t" ~- '-"~ I #JJ/Mf..__"
- }I i:l ~
i
- d.
NRC Regional Supervisor~ll>fii fl V
Note:.
The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Independent NRC reviewer initials items in Column "c'; chief examiner concurrence is required 0 ES-401, Page 48 of 52