ML14044A028
| ML14044A028 | |
| Person / Time | |
|---|---|
| Site: | Dresden  |
| Issue date: | 10/21/2013 |
| From: | Walton R NRC/RGN-III/DRS/OLB |
| To: | |
| Shared Package | |
| ML11355A024 | List: |
| References | |
| Download: ML14044A028 (5) | |
Text
2013 DRESDEN NUCLEAR POWER STATION INITIAL LICENSE EXAMINATION PROPOSED EXAM FILES
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Dresden Units 2 & 3 Date of Examination: 10/21/2013 Operating Test Number:
Initials
- 1. General Criteria a b* c#
- a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). c.QI1 NIA uv
~
- b. There is no day-to-day repetition between this and other operating tests to be administered NIA ~\i) during this examination. CiJ"1
- c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.) Of!'? NIA ~\!.)
- d. Overlap with the written examination and between different parts of the operating test is within NIA ~\)
acceptable limits. !cO?
- e. It appears that the operating test will differentiate between competent and less-than-competent NIA ~\J applicants at the designated license level. I~
- 2. Walk-Through Criteria -- -- --
a.
Each JPM includes the following, as applicable:
initial conditions NIA initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific
. designation if deemed to be time-critical by the facility licensee ~'W operationally important specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature COJ
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through NIA outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance cry ~w criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria -- -- --
The associated simulator operating tests (scenario sets) have been reviewed in accordance with CP7 NIA ~w Form ES-301-4 and a copy is attached.
Date c e : : r ; m e I :::ure
- a. Author Chuck Zoia/ toLI7/t3
- b. Facility Reviewer(*) N/A ,1- I
- c. NRC Ch;ef Exam<oo< (#) Raymood Ke(lh I!Jrcvte:rr; 2', 2: k~ f.u..1_:;:::;x:
' ':1,k_~Z
..\.JJt;;-
"ff -h-~
iO /17['2.0\3
- d. NRC Supervisor Pl/
,** -;c..
(/'<-"
ioJJ/13 r
NOTE:
- The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4
~sden Units 2 & 3 Date of Exam: October 21, 2013 Scenario Numbers: 1 I 2 I 3 QUALITATIVE ATTRIBUTES Initials a b* c#
- 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. 01'7 N/A ~~\.~
- 2. The scenarios consist mostly of related events. Clh; N/A ~
/
- 3. Each event description consists of N/A
- the point in the scenario when it is to be initiated
- the malfunction(s) that are entered to initiate the event
~~
4.
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position) the event termination point (if applicable)
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
~
N/A R~
- 5. The events are valid with regard to physics and thermodynamics. I~ N/A ~\,)
- 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. C"J N/A
~v
~\J
- 7. If time compression techniques are used, the scenario summary clearly so indicates. N/A Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given. diJ
- 8. The simulator modeling is not altered. I~ N/A ~'J-'w
/
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated N/A
~w to ensure that functional fidelity is maintained while running the planned scenarios.
- 10. Every operator will be evaluated using at least one new or significantly modified scenario. N/A '?)-.W All other scenarios have been altered in accordance with Section 0.5 of ES-301. ~
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). ~
N/A ww
- 12. Each applicant will be significantly involved in the minimum number of transients and events N/A ~vJ specified on Form ES-301-5 (submit the form with the simulator scefiarios). PfeJ
~~\))
- 13. The level of difficulty is appropriate to support licensing decisions for each crew position. ~ N/A Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- --
- 1. Total malfunctions (5-8) 51 5 /5 *'! N/A ~~I;
,~(\'1\W
- 2. Malfunctions after EOP entry (1-2) ..:Jf ~ r - lvfii!.Jt t:1l"7 N/A ?-'A'w
- 3. Abnormal events (2-4) 4/ 3 /3 r;+; N/A ~
- 4. Major transients (1-2) 2/ 2 /2 Htl N/A ~¥~
5.
6.
EOPs entered/requiring substantive actions (1-2)
EOP contingencies requiring substantive actions (0-2) 2/ 2 /2 01 2 /2 ,.,""' N/A N/A
\A\J.:
~Z\1~
- 7. Critical tasks (2-3) 21 5 12 lA? N/A ~w..:
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10130/2013 Exam Level: RO X SRO Initial Item Description a b* c#
- 1. Questions and answers are technically accurate and applicable to the facility. ww N/A ~
- \i)
~
- 2. a. NRC K!As are referenced for all questions. N/A
- b. Facility learning objectives are referenced as available. ~
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions Ri\.J were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). tk
- 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate:
_the audit exam was systematically and randomly developed; or ~\t\J
_the audit exam was completed before the license exam was started; or ~
1.. the examinations were developed independently; or
_the licensee certifies that there is no duplication; or
_other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest 51 I 68%
~w ~
new or modified); enter the actual RO I SRO-only 17 I 23% 7/9%
question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 34 I 45% 41/55%
~w ~
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
- 8. References/handouts provided do not give away answers Ri~ N/A
~
or aid in the elimination of distractors.
Question content conforms with specific KIA statements in the previously approved N/A
~\I-)
9.
examination outline and is appropriate for the tier to which they are assigned; ~
deviations are justified.
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
\?iW N/A
&~
Printed Nam~ature.., Date
~ w~ ioh1\Zol3
= .
- a. Author Raymond Keith Walton I DeiiMoNe;l/~
- b. Facility Reviewer(*)
C. NRC Chief Examiner(#) ~L.ePs
- d. NRC Regional Supervisor /n::.f.'t.'i~~o".... - .\ ~ /flsP Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: DRESDEN UNITS 2 & 3 Date of Exam: 10/30/2013 Exam Level: RO SROX Initial Item Description a b* c*
- 1. Questions and answers are technically accurate and applicable to the facility. ~\J N/A ~VIA.
- 2. a.
b.
NRC K!As are referenced for all questions.
Facility learning objectives are referenced as available.
R~w N/A ~
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). ~
- 5. Question duplication from the license screening/audit exam was controlled N/A as indicated below (check the item that applies) and appears appropriate:
_the audit exam was systematically and randomly developed; or
_the audit exam was completed before the license exam was started; or
_ the examinations were developed independently; or fW }W\
_the licensee certifies that there is no duplication; or
_other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New N/A from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 1/4% 1/4% 23/92% ~\J ~
question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA N/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly 6/24% 19/76%
~~ )>"""-
selected K!As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors.
((t\0 N/A "J)W\
- 9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;
\¥\\) N/A
~
deviations are justified.
- 10. Question psychometric quality and format meet the guidelines in ES Appendix B. ~w N/A ~
- 11. The exam contains the required number of one-point, multiple choice items; ~w N/A
~
the total is correct and agrees with the value on the cover sheet.
POoled Nam~""' Date
- a. Author Raymond Keith Walton I _*_ _ ~ Ub~ l()/,7)~o 13
-=13
- b. Facility Reviewer(*)
C. NRC Chief Examiner(#)
DeiiM,Nell_
~N/ - ~
- d. NRC Regional Supervisor
/'
/f;xa~k-.. ** '
/d-~ ~
- S L '3 Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.