ML22179A331: Difference between revisions

From kanterella
Jump to navigation Jump to search
StriderTol Bot change
StriderTol Bot change
 
Line 16: Line 16:


=Text=
=Text=
{{#Wiki_filter:ES-401 Written Examination Quality Checklist Form ES-401-6
{{#Wiki_filter:ES-401 Written Examination Quality Checklist Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:
 
Item Description
Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: RO 0 SRO
: 1.
 
Questions and answers are technically accurate and applicable to the facility.
Item Description Initial
: 2.
 
: 3.
a b* c*#
4
: 1. Questions and answers are technically accurate and applicable to the facility.
: 5.
~ ~
: 6.
: 2. a. NRC K/As are referenced for all questions.
: 7.
: b. Facility learning objectives are referenced as available.
: 8.
: c. Correct answer explanation and distractor analysis provided (ES-401, D.2.g) ~
: 9.
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 I,)/ I+
: 10.
 
: 11.
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office). ?~
: a.
: 5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate.
NRC K/As are referenced for all questions.
 
: b.
Facility learning objectives are referenced as available.
: c.
Correct answer explanation and distractor analysis provided (ES-401, D.2.g)
SRO questions are appropriate in accordance with Section D.2.d of ES-401 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office).
Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate.
_ The audit exam was systematically and randomly developed, or
_ The audit exam was systematically and randomly developed, or
_ the audit exam was completed before the license exam was started, or
_ the audit exam was completed before the license exam was started, or
_ the examinations were developed independently, or
_ the examinations were developed independently, or  
.K the licensee certifies that there is no duplication, or
.K the licensee certifies that there is no duplication, or
_ other (explain).
_ other (explain).
: 6. Bank use meets limits (no more than 75% from the bank, Bank Modified New at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right. I 1s
Bank use meets limits (no more than 75% from the bank, at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right.
: 7. Between 38 and 45 questions of the questions on the RO Memory CIA exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter 30 / 75 45 I 15 the actual RO/SRO-only question distribution(s) at right.
Bank Modified New I 1s Between 38 and 45 questions of the questions on the RO exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter the actual RO/SRO-only question distribution(s) at right.
: 8. References/handouts provided do not give away answers or aid in the elimination of distractors.
Memory CIA 30
: 9. Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
/ 75 45 References/handouts provided do not give away answers or aid in the elimination of distractors.
: 10. Question psychometric quality and format meet the guidelines in Appendix B.
I 15 Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
: 11. The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.
Question psychometric quality and format meet the guidelines in Appendix B.
The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.
Printed Name/Signature
: a.
Author
: b.
Facility Reviewer(*)
: c.
NRC Chief Examiner(#)
Form ES-401-6 RO 0 SRO a
Initial b*
c*#
~ ~
~
I,)/ I+
?~
Date
,-l o -t !
~-1.1-l~
: d.
NRC Regional Supervisor ~pcc*..,,.__-'-'=-"-'-''--""..___,....,_..1.:..1CM<-"""'.....,'+----L<"-"--,-ljlo4--'-I-...,_--""'--------
~/r, /t'o
&deg;i /,7
'lbl'\\
Note:
The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Independent NRC reviewer initials items in Column "c"; chief examiner concurrence is required, ES-401, Page 48 of 52


Printed Name/Signature Date
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:
: a. Author,-l o -t !
RO SRO ~
: b. Facility Reviewer(*) ~-1.1-l~
Initial Item Description a
: c. NRC Chief Examiner(#) r, /t'o
b*
: d. NRC Regional Supervisor ~pcc*..,,.__ -'-'=-"-'-''--"".._ __,....,_..1.:..1CM<-"""'.....,'+----L<"-"--,-ljlo4--'-I-...,_--""'-------- ~/&deg;i /,7 'lbl'\\
c*#
 
: 1.
Note: The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Questions and answers are technically accurate and applicable to the facility.  
# Independent NRC reviewer initials items in Column "c"; chief examiner concurrence is required,
~  
 
~ ~
ES-401, Page 48 of 52 ES-401 Written Examination Quality Checklist Form ES-401-6
: 2.
 
: a.
Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level: RO SRO ~
NRC K/As are referenced for all questions.
 
: b.
Initial Item Description a b* c*#
Facility learning objectives are referenced as available.  
: 1. Questions and answers are technically accurate and applicable to the facility. ~ ~ ~
~ ~
: 2. a. NRC K/As are referenced for all questions.
: c.
: b. Facility learning objectives are referenced as available. ~ ~
Correct answer explanation and distractor analysis provided (ES-401, D.2.g)  
: c. Correct answer explanation and distractor analysis provided (ES-401, D.2.g) ~
~
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 k c&#xa3; ~
: 3.
 
SRO questions are appropriate in accordance with Section D.2.d of ES-401 k
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k ~ ~
c&#xa3; ~
4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k  
~ ~
program office).
program office).
: 5. Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate.
: 5.
 
Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate.
_ The audit exam was systematically and randomly developed, or
_ The audit exam was systematically and randomly developed, or
_ the audit exam was completed before the license exam was started, or
_ the audit exam was completed before the license exam was started, or
_ the examinations were developed independently, or
_ the examinations were developed independently, or
__25. the licensee certifies that there is no duplication, or
__25. the licensee certifies that there is no duplication, or
_ other (explain). ~ ~ ftl3
_ other (explain).  
: 6. Bank use meets limits (no more than 75% from the bank, Bank Modified New - - -
~ ~ ftl3
at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right. X / 25 19 / 25 ~ ~ / 25 _ -- f$r-- ~~,.....
: 6.
 
Bank use meets limits (no more than 75% from the bank, Bank Modified New -
~ t,_
at least 10% new, and the rest new or modified); enter the  
: 7. Between 38 and 45 questions of the questions on the RO Memory C/A -
~
exam and at least 13 questions of the questions on the -- -
/ 25 _ --
SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter 0 / 25 25 I 25 x the actual RO/SRO-only question distribution(s) at right. ~ ~,-.0
f$r--
: 8. References/handouts provided do not give away answers or aid in the elimination of % ~
~~
distractors. ~
actual RO/SRO-only question distribution(s) at right.
: 9. Question content conforms to specific KIA statements in the previously approved examination ~ ? ~
X / 25 19 / 25  
outline and is appropriate for the tier to which they are assigned; deviations are justified. ~
~  
: 10. Question psychometric quality and format meet the guidelines in Appendix B. ~ ~- '1::'.A
~
 
t,_,.....
11. The exam contains the required number of one-point, multiple-choice items; the total is 5e' ~ ~ r9) correct and agrees with the value on the cover sheet.
: 7.
 
Between 38 and 45 questions of the questions on the RO Memory C/A exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the  
~ ~,-.0 comprehension/analysis level (see ES-401, D.2.c); enter 0  
/ 25 25 I 25 x
the actual RO/SRO-only question distribution(s) at right.
: 8.
References/handouts provided do not give away answers or aid in the elimination of  
% ~
distractors.  
~
: 9.
Question content conforms to specific KIA statements in the previously approved examination  
~ ? ~
outline and is appropriate for the tier to which they are assigned; deviations are justified.  
~
: 10.
Question psychometric quality and format meet the guidelines in Appendix B.  
~  
~-
'1::'.A 11.
The exam contains the required number of one-point, multiple-choice items; the total is 5e'  
~ ~ r9) correct and agrees with the value on the cover sheet.
Printed Name/Signature Date
Printed Name/Signature Date
: a. Author /:1),lil/J 0,rV C.S,Li.,,. ij# i-lA:>-Li
: a.
: b. Facility Reviewer (*) ~ 1/4-- -c-:1 e-/ &:-rf t--21-1~
Author  
 
/:1),lil/J 0,rV C.S,Li.,,.
C. NRC Chief Examiner(#) 7.A ~"ll::,~ l. \\) ~ - ~ /~.J-.J2 ~ ~ 13/1, L1tJ
ij#
: d. NRC Regional Supervisor~ll>fii ' fl "':S!> Q,.\\.rr1 ~ ~t" ~- '-"~ I #JJ/Mf..__" :}I i:l ~ i
i-lA:>-Li
 
: b.
V Note:. The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Facility Reviewer (*)  
# Independent NRC reviewer initials items in Column "c'; chief examiner concurrence is required0
~
 
1/4---c-:1 e-/ &:-rf t--21-1~
ES-401, Page 48 of 52}}
C.
NRC Chief Examiner(#)
7.A~"ll::,~l. \\) ~-~  
/~.J-.J2 ~  
~ 13/1, L1tJ  
"':S!>
Q,.\\.rr1 ~ ~t" ~- '-"~ I #JJ/Mf..__"
:}I i:l ~
i
: d.
NRC Regional Supervisor~ll>fii fl V
Note:.
The facility reviewer's initials or signature are not applicable for NRG-developed examinations.
Independent NRC reviewer initials items in Column "c'; chief examiner concurrence is required 0 ES-401, Page 48 of 52}}

Latest revision as of 16:37, 27 November 2024

2018 PI Ile ES-401-6s RO and SRO Written Exam Quality Checklists
ML22179A331
Person / Time
Site: Prairie Island  
Issue date: 08/08/2018
From: Randy Baker
NRC/RGN-III/DRS/OLB
To:
Nuclear Management Co
Baker R
Shared Package
ML17165A322 List:
References
Download: ML22179A331 (2)


Text

ES-401 Written Examination Quality Checklist Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:

Item Description

1.

Questions and answers are technically accurate and applicable to the facility.

2.
3.

4

5.
6.
7.
8.
9.
10.
11.
a.

NRC K/As are referenced for all questions.

b.

Facility learning objectives are referenced as available.

c.

Correct answer explanation and distractor analysis provided (ES-401, D.2.g)

SRO questions are appropriate in accordance with Section D.2.d of ES-401 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL program office).

Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate.

_ The audit exam was systematically and randomly developed, or

_ the audit exam was completed before the license exam was started, or

_ the examinations were developed independently, or

.K the licensee certifies that there is no duplication, or

_ other (explain).

Bank use meets limits (no more than 75% from the bank, at least 10% new, and the rest new or modified); enter the actual RO/SRO-only question distribution(s) at right.

Bank Modified New I 1s Between 38 and 45 questions of the questions on the RO exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level (see ES-401, D.2.c); enter the actual RO/SRO-only question distribution(s) at right.

Memory CIA 30

/ 75 45 References/handouts provided do not give away answers or aid in the elimination of distractors.

I 15 Question content conforms to specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.

Question psychometric quality and format meet the guidelines in Appendix B.

The exam contains the required number of one-point, multiple-choice items; the total is correct and agrees with the value on the cover sheet.

Printed Name/Signature

a.

Author

b.

Facility Reviewer(*)

c.

NRC Chief Examiner(#)

Form ES-401-6 RO 0 SRO a

Initial b*

c*#

~ ~

~

I,)/ I+

?~

Date

,-l o -t !

~-1.1-l~

d.

NRC Regional Supervisor ~pcc*..,,.__-'-'=-"-'---""..___,....,_..1.:..1CM<-"""'.....,'+----L<"-"--,-ljlo4--'-I-...,_--""'--------

~/r, /t'o

°i /,7

'lbl'\\

Note:

The facility reviewer's initials or signature are not applicable for NRG-developed examinations.

Independent NRC reviewer initials items in Column "c"; chief examiner concurrence is required, ES-401, Page 48 of 52

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: PRAIRIE ISLAND Date of Exam: SEP 2018 Exam Level:

RO SRO ~

Initial Item Description a

b*

c*#

1.

Questions and answers are technically accurate and applicable to the facility.

~

~ ~

2.
a.

NRC K/As are referenced for all questions.

b.

Facility learning objectives are referenced as available.

~ ~

c.

Correct answer explanation and distractor analysis provided (ES-401, D.2.g)

~

3.

SRO questions are appropriate in accordance with Section D.2.d of ES-401 k

c£ ~

4 The sampling process was random and systematic. (If more than four RO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRR/NRO OL k

~ ~

program office).

5.

Question duplication from the licensee screening/audit exam was controUed as indicated below (check the item that applies) and appears appropriate.

_ The audit exam was systematically and randomly developed, or

_ the audit exam was completed before the license exam was started, or

_ the examinations were developed independently, or

__25. the licensee certifies that there is no duplication, or

_ other (explain).

~ ~ ftl3

6.

Bank use meets limits (no more than 75% from the bank, Bank Modified New -

at least 10% new, and the rest new or modified); enter the

~

/ 25 _ --

f$r--

~~

actual RO/SRO-only question distribution(s) at right.

X / 25 19 / 25

~

~

t,_,.....

7.

Between 38 and 45 questions of the questions on the RO Memory C/A exam and at least 13 questions of the questions on the SRO-only portion of the exam are written at the

~ ~,-.0 comprehension/analysis level (see ES-401, D.2.c); enter 0

/ 25 25 I 25 x

the actual RO/SRO-only question distribution(s) at right.

8.

References/handouts provided do not give away answers or aid in the elimination of

% ~

distractors.

~

9.

Question content conforms to specific KIA statements in the previously approved examination

~ ? ~

outline and is appropriate for the tier to which they are assigned; deviations are justified.

~

10.

Question psychometric quality and format meet the guidelines in Appendix B.

~

~-

'1::'.A 11.

The exam contains the required number of one-point, multiple-choice items; the total is 5e'

~ ~ r9) correct and agrees with the value on the cover sheet.

Printed Name/Signature Date

a.

Author

/:1),lil/J 0,rV C.S,Li.,,.

ij#

i-lA:>-Li

b.

Facility Reviewer (*)

~

1/4---c-:1 e-/ &:-rf t--21-1~

C.

NRC Chief Examiner(#)

7.A~"ll::,~l. \\) ~-~

/~.J-.J2 ~

~ 13/1, L1tJ

"':S!>

Q,.\\.rr1 ~ ~t" ~- '-"~ I #JJ/Mf..__"

}I i:l ~

i

d.

NRC Regional Supervisor~ll>fii fl V

Note:.

The facility reviewer's initials or signature are not applicable for NRG-developed examinations.

Independent NRC reviewer initials items in Column "c'; chief examiner concurrence is required 0 ES-401, Page 48 of 52