ML14044A028: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
(One intermediate revision by the same user not shown) | |||
Line 16: | Line 16: | ||
=Text= | =Text= | ||
{{#Wiki_filter:2013 DRESDEN NUCLEAR POWER STATION INITIAL LICENSE EXAMINATION PROPOSED EXAM FILES ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: | {{#Wiki_filter:2013 DRESDEN NUCLEAR POWER STATION INITIAL LICENSE EXAMINATION PROPOSED EXAM FILES | ||
Dresden Units 2 & 3 Date of Examination: | |||
10/21/2013 Operating Test Number: Initials 1. General Criteria a b* c# a. The operating test conforms with the previously approved outline; changes are consistent with | ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Dresden Units 2 & 3 Date of Examination: 10/21/2013 Operating Test Number: | ||
: c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.) Of!'? NIA | Initials | ||
: d. Overlap with the written examination and between different parts of the operating test is within | : 1. General Criteria a b* c# | ||
: a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). c.QI1 NIA uv | |||
-system response and other examiner cues -statements describing important observations to be made by the applicant | ~ | ||
-criteria for successful completion of the task -identification of critical steps and their associated performance standards | : b. There is no day-to-day repetition between this and other operating tests to be administered NIA ~\i) during this examination. CiJ"1 | ||
-restrictions on the sequence of steps, if applicable | : c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.) Of!'? NIA ~\!.) | ||
: b. Ensure that any changes from the previously approved systems and administrative walk-through NIA outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance cry criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2. | : d. Overlap with the written examination and between different parts of the operating test is within NIA ~\) | ||
: 3. Simulator Criteria ------The associated simulator operating tests (scenario sets) have been reviewed in accordance with CP7 NIA Form ES-301-4 and a copy is attached. | acceptable limits. !cO? | ||
: e. It appears that the operating test will differentiate between competent and less-than-competent NIA ~\J applicants at the designated license level. I~ | |||
: c. NRC Ch;ef Exam<oo< (#) Raymood Ke(lh 2'2: f.u..1_ ..\.JJt;;- | : 2. Walk-Through Criteria -- -- -- | ||
iO /17['2.0\3 | a. | ||
Each JPM includes the following, as applicable: | |||
initial conditions NIA initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific | |||
* The facility signature is not applicable for NRC-developed tests. # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. | . designation if deemed to be time-critical by the facility licensee ~'W operationally important specific performance criteria that include: | ||
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Units 2 & 3 Date of Exam: October 21, 2013 Scenario Numbers: 1 I 2 I 3 QUALITATIVE ATTRIBUTES Initials a b* c# 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out | - detailed expected actions with exact criteria and nomenclature COJ | ||
- system response and other examiner cues | |||
- statements describing important observations to be made by the applicant | |||
- criteria for successful completion of the task | |||
- identification of critical steps and their associated performance standards | |||
- restrictions on the sequence of steps, if applicable | |||
: b. Ensure that any changes from the previously approved systems and administrative walk-through NIA outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance cry ~w criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2. | |||
: 3. Simulator Criteria -- -- -- | |||
The associated simulator operating tests (scenario sets) have been reviewed in accordance with CP7 NIA ~w Form ES-301-4 and a copy is attached. | |||
Date c e : : r ; m e I :::ure | |||
: a. Author Chuck Zoia/ toLI7/t3 | |||
: b. Facility Reviewer(*) N/A ,1- I | |||
: c. NRC Ch;ef Exam<oo< (#) Raymood Ke(lh I!Jrcvte:rr; 2', 2: k~ f.u..1_:;:::;x: | |||
' ':1,k_~Z | |||
..\.JJt;;- | |||
"ff -h-~ | |||
iO /17['2.0\3 | |||
: d. NRC Supervisor Pl/ | |||
,** -;c.. | |||
(/'<-" | |||
ioJJ/13 r | |||
NOTE: | |||
* The facility signature is not applicable for NRC-developed tests. | |||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. | |||
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 | |||
~sden Units 2 & 3 Date of Exam: October 21, 2013 Scenario Numbers: 1 I 2 I 3 QUALITATIVE ATTRIBUTES Initials a b* c# | |||
: 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. 01'7 N/A ~~\.~ | |||
: 2. The scenarios consist mostly of related events. Clh; N/A ~ | |||
/ | |||
: 3. Each event description consists of N/A | |||
* the point in the scenario when it is to be initiated | * the point in the scenario when it is to be initiated | ||
* the malfunction(s) that are entered to initiate the event | * the malfunction(s) that are entered to initiate the event | ||
~~ | |||
4. | |||
* the symptoms/cues that will be visible to the crew | * the symptoms/cues that will be visible to the crew | ||
* the expected operator actions (by shift position) | * the expected operator actions (by shift position) the event termination point (if applicable) | ||
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. | |||
: 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain | ~ | ||
: 7. If time compression techniques are used, the scenario summary clearly so indicates. | N/A R~ | ||
N/A Operators have sufficient time to carry out expected activities without undue time constraints. | : 5. The events are valid with regard to physics and thermodynamics. I~ N/A ~\,) | ||
: 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. C"J N/A | |||
/ 9. The scenarios have been validated. | ~v | ||
Pursuant to 10 CFR 55.46(d), any open simulator | ~\J | ||
: 10. Every operator will be evaluated using at least one new or significantly modified scenario. N/A '?)-.W All other scenarios have been altered in accordance with Section 0.5 of ES-301. 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 | : 7. If time compression techniques are used, the scenario summary clearly so indicates. N/A Operators have sufficient time to carry out expected activities without undue time constraints. | ||
: 12. Each applicant will be significantly involved in the minimum number of transients and events | Cues are given. diJ | ||
: 13. The level of difficulty is appropriate to support licensing decisions for each crew position. N/A Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes | : 8. The simulator modeling is not altered. I~ N/A ~'J-'w | ||
------1. Total malfunctions (5-8) 51 5 /5 *'! N/A | / | ||
: 2. Malfunctions after EOP entry (1-2) ..:Jf r-lvfii!.Jt t:1l"7 N/A ?-'A'w 3. Abnormal events (2-4) 4/ 3 /3 r;+; N/A 4. Major transients (1-2) 2/ 2 /2 Htl N/A 5. EOPs entered/requiring substantive actions (1-2) | : 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated N/A | ||
: 7. Critical tasks (2-3) 21 5 12 lA? N/A ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | ~w to ensure that functional fidelity is maintained while running the planned scenarios. | ||
DRESDEN UNITS 2 & 3 Date of Exam: 10130/2013 Exam Level: RO X SRO Initial Item Description a b* c# 1. Questions and answers are technically accurate and applicable to the facility. | : 10. Every operator will be evaluated using at least one new or significantly modified scenario. N/A '?)-.W All other scenarios have been altered in accordance with Section 0.5 of ES-301. ~ | ||
ww N/A 2. NRC K!As are referenced for all questions. | : 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). ~ | ||
N/A ww | |||
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 N/A 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions Ri\.J | : 12. Each applicant will be significantly involved in the minimum number of transients and events N/A ~vJ specified on Form ES-301-5 (submit the form with the simulator scefiarios). PfeJ | ||
_the audit exam was systematically and randomly developed; or _the audit exam was completed before the license exam was started; or 1.. the examinations were developed independently; or _the licensee certifies that there is no duplication; or _other (explain) | ~~\)) | ||
: 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest new or modified); | : 13. The level of difficulty is appropriate to support licensing decisions for each crew position. ~ N/A Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- -- | ||
enter the actual RO I SRO-only 17 I 23% 7/9% | : 1. Total malfunctions (5-8) 51 5 /5 *'! N/A ~~I; | ||
analysis level; the SRO exam may exceed 60 percent if the randomly 34 I 45% 41/55% selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. 8. References/handouts provided do not give away answers or aid in the elimination of distractors. | ,~(\'1\W | ||
: 10. Question psychometric quality and format meet the guidelines in ES Appendix B. WvW NIA 11. The exam contains the required number of one-point, multiple choice items; \?iW N/A the total is correct and agrees with the value on the cover sheet. | : 2. Malfunctions after EOP entry (1-2) ..:Jf ~ r - lvfii!.Jt t:1l"7 N/A ?-'A'w | ||
: a. Author Raymond Keith Walton I b. Facility Reviewer(*) | : 3. Abnormal events (2-4) 4/ 3 /3 r;+; N/A ~ | ||
: 4. Major transients (1-2) 2/ 2 /2 Htl N/A ~¥~ | |||
5. | |||
6. | |||
EOPs entered/requiring substantive actions (1-2) | |||
EOP contingencies requiring substantive actions (0-2) 2/ 2 /2 01 2 /2 ,.,""' N/A N/A | |||
\A\J.: | |||
~Z\1~ | |||
: 7. Critical tasks (2-3) 21 5 12 lA? N/A ~w..: | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10130/2013 Exam Level: RO X SRO Initial Item Description a b* c# | |||
: 1. Questions and answers are technically accurate and applicable to the facility. ww N/A ~ | |||
:\i) | |||
~ | |||
: 2. a. NRC K!As are referenced for all questions. N/A | |||
: b. Facility learning objectives are referenced as available. ~ | |||
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 ~\.) N/A ~ | |||
: 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions Ri\.J were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). tk | |||
: 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate: | |||
_the audit exam was systematically and randomly developed; or ~\t\J | |||
_the audit exam was completed before the license exam was started; or ~ | |||
1.. the examinations were developed independently; or | |||
_the licensee certifies that there is no duplication; or | |||
_other (explain) | |||
: 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest 51 I 68% | |||
~w ~ | |||
new or modified); enter the actual RO I SRO-only 17 I 23% 7/9% | |||
question distribution(s) at right. | |||
: 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 34 I 45% 41/55% | |||
~w ~ | |||
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. | |||
: 8. References/handouts provided do not give away answers Ri~ N/A | |||
~ | |||
or aid in the elimination of distractors. | |||
Question content conforms with specific KIA statements in the previously approved N/A | |||
~\I-) | |||
9. | |||
examination outline and is appropriate for the tier to which they are assigned; ~ | |||
deviations are justified. | |||
: 10. Question psychometric quality and format meet the guidelines in ES Appendix B. WvW NIA ~ | |||
: 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. | |||
\?iW N/A | |||
&~ | |||
Printed Nam~ature.., Date | |||
~ w~ ioh1\Zol3 | |||
= . | |||
: a. Author Raymond Keith Walton I DeiiMoNe;l/~ | |||
: b. Facility Reviewer(*) | |||
C. NRC Chief Examiner(#) ~L.ePs | |||
: d. NRC Regional Supervisor /n::.f.'t.'i~~o".... - .\ ~ /flsP Note: | |||
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations. | |||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10/30/2013 Exam Level: RO SROX Initial Item Description a b* c* | |||
: 1. Questions and answers are technically accurate and applicable to the facility. ~\J N/A ~VIA. | |||
: 2. a. | |||
b. | |||
NRC K!As are referenced for all questions. | |||
Facility learning objectives are referenced as available. | |||
R~w N/A ~ | |||
: 3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 lpi\0 N/A ~ | |||
: 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). ~ | |||
: 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate: | |||
_the audit exam was systematically and randomly developed; or | |||
_the audit exam was completed before the license exam was started; or | |||
_ the examinations were developed independently; or fW }W\ | |||
_the licensee certifies that there is no duplication; or | |||
_other (explain) | |||
: 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 1/4% 1/4% 23/92% ~\J ~ | |||
question distribution(s) at right. | |||
: 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 6/24% 19/76% | |||
~~ )>"""- | |||
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. | |||
: 8. References/handouts provided do not give away answers or aid in the elimination of distractors. | |||
((t\0 N/A "J)W\ | |||
: 9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; | |||
\¥\\) N/A | |||
~ | |||
deviations are justified. | |||
: 10. Question psychometric quality and format meet the guidelines in ES Appendix B. ~w N/A ~ | |||
: 11. The exam contains the required number of one-point, multiple choice items; ~w N/A | |||
~ | |||
the total is correct and agrees with the value on the cover sheet. | |||
POoled Nam~""' Date | |||
: a. Author Raymond Keith Walton I _*_ _ ~ Ub~ l()/,7)~o 13 | |||
-=13 | |||
: b. Facility Reviewer(*) | |||
C. NRC Chief Examiner(#) | C. NRC Chief Examiner(#) | ||
DeiiM,Nell_ | |||
~N/ - ~ | |||
: d. NRC Regional Supervisor | |||
/' | |||
/f;xa~k-.. ** ' | |||
/d-~ ~ | |||
* S L '3 Note: | |||
: | * The facility reviewer's initials/signature are not applicable for NRC-developed examinations. | ||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.}} | |||
- | |||
* S | |||
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations. | |||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.}} |
Latest revision as of 23:14, 5 February 2020
ML14044A028 | |
Person / Time | |
---|---|
Site: | Dresden ![]() |
Issue date: | 10/21/2013 |
From: | Walton R NRC/RGN-III/DRS/OLB |
To: | |
Shared Package | |
ML11355A024 | List: |
References | |
Download: ML14044A028 (5) | |
Text
2013 DRESDEN NUCLEAR POWER STATION INITIAL LICENSE EXAMINATION PROPOSED EXAM FILES
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Dresden Units 2 & 3 Date of Examination: 10/21/2013 Operating Test Number:
Initials
- 1. General Criteria a b* c#
- a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). c.QI1 NIA uv
~
- b. There is no day-to-day repetition between this and other operating tests to be administered NIA ~\i) during this examination. CiJ"1
- c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.) Of!'? NIA ~\!.)
- d. Overlap with the written examination and between different parts of the operating test is within NIA ~\)
acceptable limits. !cO?
- e. It appears that the operating test will differentiate between competent and less-than-competent NIA ~\J applicants at the designated license level. I~
- 2. Walk-Through Criteria -- -- --
a.
Each JPM includes the following, as applicable:
initial conditions NIA initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific
. designation if deemed to be time-critical by the facility licensee ~'W operationally important specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature COJ
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through NIA outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance cry ~w criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria -- -- --
The associated simulator operating tests (scenario sets) have been reviewed in accordance with CP7 NIA ~w Form ES-301-4 and a copy is attached.
Date c e : : r ; m e I :::ure
- a. Author Chuck Zoia/ toLI7/t3
- b. Facility Reviewer(*) N/A ,1- I
- c. NRC Ch;ef Exam<oo< (#) Raymood Ke(lh I!Jrcvte:rr; 2', 2: k~ f.u..1_:;:::;x:
' ':1,k_~Z
..\.JJt;;-
"ff -h-~
iO /17['2.0\3
- d. NRC Supervisor Pl/
,** -;c..
(/'<-"
ioJJ/13 r
NOTE:
- The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4
~sden Units 2 & 3 Date of Exam: October 21, 2013 Scenario Numbers: 1 I 2 I 3 QUALITATIVE ATTRIBUTES Initials a b* c#
- 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. 01'7 N/A ~~\.~
- 2. The scenarios consist mostly of related events. Clh; N/A ~
/
- 3. Each event description consists of N/A
- the point in the scenario when it is to be initiated
- the malfunction(s) that are entered to initiate the event
~~
4.
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position) the event termination point (if applicable)
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
~
N/A R~
- 5. The events are valid with regard to physics and thermodynamics. I~ N/A ~\,)
- 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. C"J N/A
~v
~\J
- 7. If time compression techniques are used, the scenario summary clearly so indicates. N/A Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given. diJ
- 8. The simulator modeling is not altered. I~ N/A ~'J-'w
/
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated N/A
~w to ensure that functional fidelity is maintained while running the planned scenarios.
- 10. Every operator will be evaluated using at least one new or significantly modified scenario. N/A '?)-.W All other scenarios have been altered in accordance with Section 0.5 of ES-301. ~
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). ~
N/A ww
- 12. Each applicant will be significantly involved in the minimum number of transients and events N/A ~vJ specified on Form ES-301-5 (submit the form with the simulator scefiarios). PfeJ
~~\))
- 13. The level of difficulty is appropriate to support licensing decisions for each crew position. ~ N/A Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- --
- 1. Total malfunctions (5-8) 51 5 /5 *'! N/A ~~I;
,~(\'1\W
- 2. Malfunctions after EOP entry (1-2) ..:Jf ~ r - lvfii!.Jt t:1l"7 N/A ?-'A'w
- 3. Abnormal events (2-4) 4/ 3 /3 r;+; N/A ~
- 4. Major transients (1-2) 2/ 2 /2 Htl N/A ~¥~
5.
6.
EOPs entered/requiring substantive actions (1-2)
EOP contingencies requiring substantive actions (0-2) 2/ 2 /2 01 2 /2 ,.,""' N/A N/A
\A\J.:
~Z\1~
- 7. Critical tasks (2-3) 21 5 12 lA? N/A ~w..:
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10130/2013 Exam Level: RO X SRO Initial Item Description a b* c#
- 1. Questions and answers are technically accurate and applicable to the facility. ww N/A ~
- \i)
~
- 2. a. NRC K!As are referenced for all questions. N/A
- b. Facility learning objectives are referenced as available. ~
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions Ri\.J were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). tk
- 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate:
_the audit exam was systematically and randomly developed; or ~\t\J
_the audit exam was completed before the license exam was started; or ~
1.. the examinations were developed independently; or
_the licensee certifies that there is no duplication; or
_other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest 51 I 68%
~w ~
new or modified); enter the actual RO I SRO-only 17 I 23% 7/9%
question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 34 I 45% 41/55%
~w ~
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
- 8. References/handouts provided do not give away answers Ri~ N/A
~
or aid in the elimination of distractors.
Question content conforms with specific KIA statements in the previously approved N/A
~\I-)
9.
examination outline and is appropriate for the tier to which they are assigned; ~
deviations are justified.
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
\?iW N/A
&~
Printed Nam~ature.., Date
~ w~ ioh1\Zol3
= .
- a. Author Raymond Keith Walton I DeiiMoNe;l/~
- b. Facility Reviewer(*)
C. NRC Chief Examiner(#) ~L.ePs
- d. NRC Regional Supervisor /n::.f.'t.'i~~o".... - .\ ~ /flsP Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10/30/2013 Exam Level: RO SROX Initial Item Description a b* c*
- 1. Questions and answers are technically accurate and applicable to the facility. ~\J N/A ~VIA.
- 2. a.
b.
NRC K!As are referenced for all questions.
Facility learning objectives are referenced as available.
R~w N/A ~
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). ~
- 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate:
_the audit exam was systematically and randomly developed; or
_the audit exam was completed before the license exam was started; or
_ the examinations were developed independently; or fW }W\
_the licensee certifies that there is no duplication; or
_other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 1/4% 1/4% 23/92% ~\J ~
question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 6/24% 19/76%
~~ )>"""-
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors.
((t\0 N/A "J)W\
- 9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;
\¥\\) N/A
~
deviations are justified.
- 10. Question psychometric quality and format meet the guidelines in ES Appendix B. ~w N/A ~
- 11. The exam contains the required number of one-point, multiple choice items; ~w N/A
~
the total is correct and agrees with the value on the cover sheet.
POoled Nam~""' Date
- a. Author Raymond Keith Walton I _*_ _ ~ Ub~ l()/,7)~o 13
-=13
- b. Facility Reviewer(*)
C. NRC Chief Examiner(#)
DeiiM,Nell_
~N/ - ~
- d. NRC Regional Supervisor
/'
/f;xa~k-.. ** '
/d-~ ~
- S L '3 Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.