ML102870118
| ML102870118 | |
| Person / Time | |
|---|---|
| Site: | Vogtle  |
| Issue date: | 04/12/2010 |
| From: | NRC/RGN-II |
| To: | Southern Nuclear Operating Co |
| References | |
| 50-424/10-301, 50-425/10-301, ES-201-1 | |
| Download: ML102870118 (48) | |
Text
ES-201 Examination Preparation Checklist Form ES-201-l 2/22
Facility:
Vogtle Electric Generating Plant Date of Examination:
3/5/2010 acilitli NRC Examinations Developed by:
Written
/
Operating Test T
Chief arget Task Description (Reference)
Examiners a e Initials
-180 1.
Examination administration date confirmed (C.1.a; C.2.a and b)
-120 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e) x
-120 3.
Facility contact briefed on security and other requirements (C.2 c) xt
-120 4.
Corporate notification_letter_sent_(C.2.d)
[-90]
[5.
Reference material due (C.1.e; C.3.c; Attachment 2)]
4
{-75}
6.
Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES 301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)
{-70}
{7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}
{-45 }
8.
Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-30 1-3, ES-30 1-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 9.
Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; ES-202) 4.J
-14
%f
-14
- 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
-14
- 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
-7
- 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)
,4:2z
-7
- 14. Final applications reviewed; 1 or 2 (if>10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i;_Attachment 4;_ES-202,_C.2.e;_ES-204)
-7
- 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C. 3.k)
-7
- 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prepared by the NRC.
ES-201 Examination Outline Quality Checklist (FINAL)
Form ES-201-2 F
Facility:
Vogtle Date of Examination:
02-22-2010 Initials Item Task Description
1.
a.
Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
w R
b.
Assess whether the outline was systematically and randomly prepared in accordance with I
Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
T c.
Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d.
Assess whether the justifications for deselected or rejected K/A statements are appropriate.
2.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, (f.)
S and major transients.
M b.
Assess whether there are enough scenario sets (and spares) to test the projected number U
and mix of applicants in accordance with the expected crew composition and rotation schedule L
without compromising exam integrity, and ensure that each applicant can be tested using A
at least one new or significantly modified scenario, that no scenarios are duplicated J
T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative R
and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3.
a.
Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form
/
(2) task repetition from the last two NRC examinations is within the limits specified on the form T
(3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria ontheform.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301 -1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
c.
Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
4J*
E b.
Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
c.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
R d.
Check for duplication and overlap among exam sections.
L e.
Check the entire exam for balance of coverage.
f.
Assess whether the exam_fits the_appropriate job_level_(RO_or_SRO).
- a. Author T. N. Thompson!
- b. Facility Reviewer (*)
D. Scukanec/
?-2
)
- c. NRCChiefExaminer(#)
L 1
- /L.
1 72/I
- d. NRC Supervisor AIAUWLr. w(pLLk3F4/r Note:
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines
ES-201 Examination Security Agreement Form ES-201 -3 1.
Pre-Examination I acknowledge that have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 2
0 as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of Vl
. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE! RESPONSIBILITY SIGNATURE (1)
DATE 1.
v.
2.Tha/VThOwpJiJ Ne- /Sav ii9 A/ (4 S:.1 4.
Mpwo( 5 1
uA-
- 5. 7ue A- $A-1i6v
- 6. Th cRZLL
- 7. 3 8.
- 9. /&&i-1O.,Z, 1
rn.v?
u/I. Ask+
1 1r
- 12. A2 t 1
J?,nAJ 13.)cLL
/iL7
- 14. i.kzJ/.(
7-vov
-.-I.
S --
NPo_/_VAtiAT Si.t-pr c vo SIGNATURE(2)
DATE NOTE Rb 1,00
,-4t
/4C 4
0
/sç,
51)u c,w/fW-? C6Q-dlA 5744
/ui-ALc iA
- 15. /1e &,2
,4 r-_
NOTES:
f). O
/atiiui 3 s9 ii Z.-o9 4?J4L(
/(,74
/7/
/
iw=
s/,
35:
- - \\,--
7 L-c---(
a S/I
ES-201,P 27of28
ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 2../.2 z/ 10 as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of
- ° From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME
)
- 3. I<c--
L-Lc 4.
Rci(L
- 5. 3)
- 6. TY1.C. r1YN) 7.
8.
1 O.
11..
12.
13.
14.
15.
NOTES:
JOBTITLE/RESPONSIBILITY G
AT RE(11 t\\
LltT1
--O--c U
L.
Stv(
c44 0
r c
A flC14)
Sc t
DATE SI N
U E(2)
DATE NOTE 4ai
_*I 2 J7!4ib(rQcr 4/hft ES-201,P 27of28
ES-301, Rev. 9 Administrative Topics Outline Form ES-301-1 F,iv L Facility:
Plant Vogtle Date of Examination: 02/22/2010 Examination Level:
RO Operating Test Number: 2010-301 Administrative Topic (see Type Describe activity to be performed Note)
Code*
R, D, P
Title:
Critical Safety Function Status Tree Evaluation
==
Description:==
Students will be provided a listing of plant parameters. This Conduct of Operations will require manually evaluating each status tree to determine the challenges to each tree and identify the highest priority challenge.
K/A: G2.1.7(Ro4.4)
Title:
Perform QPTR Calculation (QPTR)
Conduct of Operations R, N
==
Description:==
Perform Quadrant Power Tilt Ration (QPTR) Calculation, both the top and bottom sections will be out of spec high.
K/A: G2.1.37 (RO 4.3)
Title:
Construct Tagout for Unit 2 # 4 Nuclear Service Cooling Water (NSCW) Pump Equipment Control R, D
==
Description:==
Determine the appropriate hold points and required positions of components to safely isolate NSCW pump 2-1202-P4-004.
Identification of K-2 links to clear control room alarms is not required.
K/A: G2.2.13(R04.1)
Title:
Not applicable.
==
Description:==
Not applicable.
Radiation Control K/A: Not applicable.
Title:
Emergency Recall & Roll Call for Security Emergency Emergency Procedures/Plan S, N
==
Description:==
An emergency recall and roll call is required to be performed for a security emergency. This requires the use of a different recall scenario.
K/A: G2.4.43 (RO 3.2)
NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (<3 for ROs; <4 for SROs & RO retakes)
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1; randomly selected)
ES-301, Rev. 9 Administrative Topics Outline Form ES-301-1 Ps FJ2L, Facility:
Vogtle Date of Examination: 02/22/2010 Examination Level:
SRO Operating Test Number: 2010-301 Administrative Topic (see Type Describe activity to be performed Note)
Code*
R, M, P
Title:
Perform Emergency Boration Flow Path Verification Conduct of Operations
==
Description:==
Mode 4 with the following equipment INOP (tagout): SI pumps common suction valve HV-8806, Charging Pump CCP-1 B, and RCP seal injection control valve HV-0182. The student will be required to evaluate the effect of these tagged components on the required boric acid flow paths. The surveillance will be unsat and TR 13.1.3 condition A will apply.
K/A: G2.1.7 (SRO 4.7)
R, N
Title:
Determine Active License Status
==
Description:==
The SRO will have to evaluate the status of 3 ROs to Conduct of Operations determine their license status for sitting the control board position.
K/A: G2.1.4 (SRO 3.8)
R, D
Title:
Construct Tagout for Unit 2 # 4 Nuclear Service Cooling Water (NSCW) Pump Equipment Control
==
Description:==
Determine the appropriate hold points and required positions of components to safely isolate NSCW pump 2-12O2-P4OO4.
K/A: G2.2.13 (SRO 4.3)
R, N
Title:
Emergency Exposure Limits Calculation and Authorization Radiation Control
==
Description:==
Historical data will be provided for individuals to receive an emergency exposure during a declared event. Data will be provided requiring a calculation to determine the exposure to be received, the student must determine the appropriate dose limit based on the expected dose.
K/A: 02.3.4 (SRO 3.7)
Title:
Upgrade - Emergency Classification (From Alert Emergency Procedures/Plan R, N to Site Area Emergency)
==
Description:==
New data will be provided to the candidate to determine if an upgrade to a declared emergency is required. This will be a time critical JPM. The student will document his declaration on Datasheet 1.
K/A: 02.4.41 (SRO 4.6)
NOTE: All items (5 total) are required for SROs.
RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (<3 for ROs; <4 for SROs & RO retakes)
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1: random lv selected)
ES-301, Rev. 9E Control Roomlln-Plant Systems Outline Form ES-301-2 F,
Facility:
Vogtle Date of Examination: 02/22/2010 Exam Level (circle one): RO Operating Test No.: 201 0-301 Control Room Systems@ (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U, including 1 ESF)
System / JPM Title Type Code*
Safety Function
- a. Dropped Rod Recovery in Model (RO/SRO-l) 5, M, A A dropped rod will be recovered lAW AOP-1 8003-c, Rod Control Malfunction Section A for Dropped Rods in Mode 1. During the recovery, the rod being retrieved will not move. This will require reconfiguring the rod control system back to its previous state prior to attempting the dropped rod recovery.
K/A: 003AA2.01 (RO 3.7 / SRO 3.9)
- b. Respond to Failure of PRZR Level Instrument (RO / SRO-I)
S, D, A 2
A PRZR level instrument will fail low requiring entry into AOP-18001 Section D. After to candidate attempts to place letdown back in service, a letdown isolation valve will NOT open requiring Excess Letdown to be placed into service.
K/A: 028AA1.05 (RO 3.7 / SRO 3.6)
- c. Transfer ECCS Pumps to Hot Leg Recirculation. Multiple Train S, D, A, P 3
A Components Fail to Align (RO / SRO-I)
EN, L During alignment of ECCS to Hot Leg Recirculation, multiple Train A components will fail to align requiring the use of the RNO column.
K/A: 006A4.05 (RO 3.9 / SRO 3.8)
- d. Respond To RHR Pump Trip in Mode 4 (RO / SRO-I) 5, N, A, L 4P An RHR pump will trip in Mode 4 requiring entry into AOP-1 8019, Section A, Loss of RHR Capability in Mode 4. The flow path through the procedure will require the candidate to start an RCP.
K/A: 025G2.4.9 (RO 3.8 / SRO 4.2)
- e. Dilute Containment with Service Air in accordance with 19010-5, D, L 5
C, E-l, Loss of Reactor or Secondary Coolant, Step 29. (RO /
SRO-I)
The student will be required to use SOP 13130-1, section 4.4.2 to align service air to containment to dilute the hydrogen.
K/A: 028A4.01 (RO 4.0 / SRO 4.0)
ES-301, Rev. 9E Control Roomlln-Plant Systems Outline Form ES-301-2
- f. Synchronize Main Generator to the Grid. Field amps not S, D, A, P 6
indicated on one phase requires Main Turbine trip. (RO)
After synchronizing the main generator the student must recognize that one phase does not show any current, requiring opening of the generator output breaker to prevent damage to the generator.
K/A: 062A4.07 (R0 3.1)
- g. Respond to Fuel Handling Building High Radiation (RO/SRO-I)
S, D, A 7
High Radiation will occur due to dropped rod in FHB but auto actuation fails, manual system alignment is required.
K/A: 061AA1.01 (RD 3.6 / SRO 3.6)
- h. Transfer Steam Dumps to Steam Pressure Mode (RO I SRO-i)
S, N, A, L 4S The student will be required to transfer steam dumps to the steam pressure mode using step 14 of A0P 18009-C. The steam dumps will not work, the student must shift the temperature control to the SG ARVs.
K/A: 041A4.08 (RD 3.0 / SR0 3.1)
In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)
- i. Bypass CNMT HI-I Bistables Following Loss of Heat Sink D, E, L, P 7
Bistables must be bypassed using the BTI equipment in order to align a feedwater flow path to the SGs during a loss of secondary heat sink. This will also require knowledge of how / where to obtain multiple BTI keys to bypass 2 trains of equipment (RD / SRD-l)
K/A: 012A4.03 (3.6 / 3.6)
- j. Locally Start the TDAFW Pump D, F, L 8
Following a Control Room evacuation, the TDAFW pump is required to be locally started at Shutdown Panel C. Local transfer switches must be manipulated, the T & T valve checked for proper status, and throttling of AFW flow from the local panel is required using available flow indications.
K/A: 068AA1.02 (RD 4.3 / SRO 4.5)
During a loss of All AC power, the RCP seals are required to be isolated.
Included on Attachment E is opening the breakers to the SG ARVs in preparation for local operation.
K/A: 055G2.4.34 (RD 4.2 / SRO 4.1)
© All control room (and in-plant) systems must be different and serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for RD I SRO-l / S RD-U
ES-301, Rev. 9E Control Room/In-Plant Systems Outline Form ES-301-2 FJ,vi.zL 1
(A)Iternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irectfrombank
<91<81<4 (E)mergency or abnormal in-plant 1 I 1 I? 1 (EN)gineered Safety Feature
- /
I> 1 (control room system)
(L)bw-PowerlShutdown
?1 1>11>1 (N)ew or (M)odified from bank including 1 (A)
> 2 /
2 /
1 (P)revious 2 exams
< 3 / < 3 I < 2 (randomly selected)
(R)CA (S)imulator
ES-301, Rev. 9E Control Room/In-Plant Systems Outline Form ES-301h2 Facility:
Vogtle Date of Examination: 02/22/2010 Exam Level (circle one): SRO-I Operating Test No.: 2010-301 Control Room Systems@(8 for RO; 7 for SRO-l; 2 or 3 for SRO-U, including 1 ESF)
System / JPM Title Type Code*
Safety Function
- a. Dropped Rod Recovery in Mode I (ROISRO-l) 5, M, A A dropped rod will be recovered lAW AOP-1 8003-C, Rod Control Malfunction Section A for Dropped Rods in Mode 1. During the recovery, the rod being retrieved will not move. This will require reconfiguring the rod control system back to its previous state prior to attempting the dropped rod recovery.
K/A: 003M2.01 (RO 3.7 / SRO 3.9)
- b. Respond to Failure of PRZR Level Instrument (RO / SRO-l)
S, D, A 2
A PRZR level instrument will fail low requiring entry into AOP-18001 Section D. After to candidate attempts to place letdown back in service, a letdown isolation valve will NOT open requiring Excess Letdown to be placed into service.
K/A: 028A\\1.05 (RO 3.7 / SRO 3.6)
- c. Transfer ECCS Pumps to Hot Leg Recirculation. Multiple Train S, D, A, P 3
A Components Fail to Align (RO / SRO-l)
EN, L During alignment of ECCS to Hot Leg Recirculation, multiple Train A components will fail to align requiring the use of the RNO column.
K/A: 006A4.05 (RO 3.9 / SRO 3.8)
S, N, A, L 4P An RHR pump will trip in Mode 4 requiring entry into AOP-1 8019, Section A, Loss of RHR Capability in Mode 4. The flow path through the procedure will require the candidate to start an RCP.
K/A: 025G2.4.9 (RO 3.8 / SRO 4.2)
- e. Dilute Containment with Service Air in accordance with 19010-5, D, L 5
C, E-1, Loss of Reactor or Secondary Coolant, Step 29. (RO I SRO-l)
The student will be required to use SOP 13130-1, section 4.4.2 to align service air to containment to dilute the hydrogen.
K/A: 028A4.01 (RO 4.0 / SRO 4.0) f.
N/A N/A N/A
ES-301, Rev. 9E Control Roomlln-Plant Systems Outline Form ES-301-2 P / ii/.4 h
- g. Respond to Fuel Handling Building High Radiation (RO/SRO-l)
S, D, A 7
High Radiation will occur due to dropped rod in FHB but auto actuation fails, manual system alignment is required.
K/A: O61AA1.01 (RO 3.61SR03.6)
- h. Transfer Steam Dumps to Steam Pressure Mode (RD I SRO-I)
S, N, A, L 4S The student will be required to transfer steam dumps to the steam pressure mode using step 14 of AOP 1 8009-C. The steam dumps will not work, the student must shift the temperature control to the SG ARVs.
K/A: 041A4.08 (RO 3.0/ SRO 3.1)
In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)
- i. Bypass CNMT HI-I Bistables Following Loss of Heat Sink D, F, L, P 7
Bistables must be bypassed using the BTI equipment in order to align a feedwater flow path to the SGs during a loss of secondary heat sink. This will also require knowledge of how / where to obtain multiple BTI keys to bypass 2 trains of equipment (RO / SRO-l)
K/A: 012A4.03 (3.6 / 3.6)
- j. Locally Start the TDAFW Pump D, E, L 8
Following a Control Room evacuation, the TDAFW pump is required to be locally started at Shutdown Panel C. Local transfer switches must be manipulated, the T & T valve checked for proper status, and throttling of AFW flow from the local panel is required using available flow indications.
K/A: 068AA1.02 (RO 4.3 / SRO 4.5)
During a loss of All AC power, the RCP seals are required to be isolated.
Included on Attachment E is opening the breakers to the SG ARVs in preparation for local operation.
K/A: 055G2.4.34 (RO 4.2 / SRO 4.1)
© All control room (and in-plant) systems must be different and serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for RD I SRO-l I S RD-U (A)fternate path 4-6 I 4-6 / 2-3 (C)ontrol room (D)irectfrombank
<9/<8/<4 (E)mergency or abnormal in-plant 1 / 1 /
1 (EN)gineered Safety Feature
- /
- I> 1 (control room system)
(L)ow-PowerlShutdown
>11>11>1 (N)ew or (M)odified from bank including 1(A) 2 I 2 /
1 (P)revious 2 exams
< 3 I < 3 / < 2 (randomly selected)
(R)CA (S)imulator
ES-301-3 Operating Test Quality Checklist Facility: Vogtle Date of Examination: 2-22-2010 Operating Test Number: 2010-301 Initials
- 1. General Criteria a.
The operating test conforms with the previously approved oufline; changes are consistent with 4
sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
t::
b.
There is no day-to-day repetition between this and other operating tests to be administered J
during this examination.
c.
The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 a.)
jj IL d.
Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e.
It appears that the operating test will differentiate between competent and less-than-competent 5 %V applicants at the designated license level.
- 2. Walk-Through Criteria a.
Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature
system response and other examiner cues
statements describing important observations to be made by the applicant
criteria for successful completion of the task 1-
identification of critical steps and their associated performance standards
restrictions on the sequence of steps, if applicable b.
Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance I
criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with
/Q,42 Form ES-301-4 and a copy is attached.
Date e-S-io
.2//? /)
O/ZL a.
Author Thad N.
/
b.
Facility Reviewer(*)
c.
NRC Chief Examiner (#)
d.
NRC Supervisor NOTE:
The facility signature is not applicable for NRC-developed tests.
Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301-4 Simulator Scenario Quality Checklist F/IVAJ Facilty: Voqtle Date of Exam: 2-22-2010 Scenario Numbers: 1/2 / 3 / 4 QUALITATIVE ATTRIBUTES 1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
2.
The scenarios consist mostly of related events.
3.
Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable) 4.
No more than one non-mechanistic failure (e.g. pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
5.
The events are valid with regard to physics and thermodynamics.
6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7.
lf time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expectd activities without undue time constraints.
Cues are given.
8.
The simulator modeling is not altered.
9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
10.
Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section D.5 of ES-301.
11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
12.
Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios) 13.
The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)
Actual Attributes 1.
Total malfunctions (58) 7 / 7 / 8 / 5 2.
Malfunctions after EOP entry (12) 2 / 2 / 2 / 2 3.
Abnormal events (24) 4 14 / 5/ 3 4.
Major transients (12) 1 / 1/1 / 1 5.
EOPs entered/requiring substantive actions (12) 2 / 3 / 2 / 2 6.
EOP contingencies requiring substantive actions (02) 0 / 1 / 0 / 0 7.
Critical tasks (23) 3 / 3 / 2 / 3
ES-301-5 Transient and Event Checklist I,vsi Facility: Vogtle Nuclear Plant Date of Exam: 2-22-2010 Operating Test No.: 2010-301 A
E Scenarios
P V
1 2
3(spare) 4 T
M P
E I
L N
CREW CREW CREW CREW T
N I
T POSfl1ON POSfl1ON PI!qN_
I°N A
C S
A B
S A
B S
A B
S A
B L
u A
T R
T 0
R T
0 R
T 0
R T
0 M(*)
N y
0 C
P 0
C P
0 C
P c
C P
T P
R IU E
RX 4
1 1
4 4
110 SRO-I NOR 5
3 4,6 3
5 1
1 1
SRO-U I/C 1,2,3 2,4,5 2,3,5 1,2, 23 4
4 2
,6,8,
,6,8,
,7,8, 6, 7 9
9 10, 11 MAJ 7
7 9
5 4
221 TS 1,2 2,4,5 2,3,5 1,2, 13 0
2 2
,7,8 4
RX 4
1 1
4 4
110 RD NOR 5
3 4,6 3
5 111 SRO-I I/C 1,3,9 2,5, 3,5,8 1,2, 14 4
4 2
8
,10 6,7 MAJ 7
7 9
5 4
221 TS 0
022 RD RX 4
1 1
4 4
110 SRO-l NOR
0111 x
I/C 2,3, 4,6,9 2,7, 1
11 4
4 2
6,8 11 MAJ 7
7 9
5 4
221 TS 0
022 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (SOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.
If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301-6 Competencies Checklist Fiv,Li Facility: Vogtle Date of Examination: 2-22-2010 Operating Test No.: 2010-301 APPLICANTS Competencies RD X
SRO-I X
SCENARIO______
SCENARIO 1
2 3
4 1
2 3
4 Interpret/Diagnose 123 123 123 123456 123 123 1234 123456 Events and Conditions 4 5 6 4 5 6 4 5 6 7
4 5 6 4 5 6 5 6 7 8 7
789 789 789 789 789 91011 10 1011 10 ComplyWithand 123 123 123 123456 123 123 1234 123456 UseProcedures(1) 456 456 456 7
456 456 5678 7
789 789 789 789 789 91011 10 1011 10 Operate Control 1 2 3 1 2 3 1 2 3 1 2 3 4 5 6 Boards(2) 456 456 456 7
789 789 789 10 1011 Communicate 123 123 123 123456 123 123 1234 123456 andlnteract 456 456 456 7
456 456 5678 7
789 789 789 789 789 91011 10 1011 10 Demonstrate 123 123 1234 123456 Supervisory Ability (3) 4 5 6 4 5 6 5 6 7 8 7
789 789 91011 10 Comply With and 123 123 1234 123456 Use Tech. Specs. (3) 4 5 6 4 5 6 5 6 7 8 7
789 789 91011 10 Notes:
(1)
Includes Technical Specification compliance for an RO.
(2)
Optional for an S RD-U.
(3)
Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-401, Rev.9 PWR Examination Outline Form ES-401-2 Facility:
Date of Exam:
RO K/A Category Points SRO-Only Points Tier Group KKKKKKAAAAG A2 G*
Total 1
2 3
4 5
6 1
2 3
4 Total
= = =
=
1.
333 33 3
18 3
3 6
Emergency &
2 T 7 2
2 1
1 9
2 2
4 Abnormal Plant
N/A
N/A
Evolutions Tier Totals
=
27 5
5 10 1
33232323223 28 3
2
[
5 2.
2 1
1 1
11 1
1 101 1
10 2
1 1
Plant
Systems Tier Totals 4
4 3
4 3
4 3
4 2
3 4
38 5
3 8
=
- 3. Generic Knowledge and Abilities 1
2 3
4 10 1
2 3
4 7
Categories 3
3 2
2 2
2 1
2 1.
Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in TIer 3 of the SRO-oniy outline, the Tier Totals in each KJA category shall not be less than two).
2.
The point total for each group and tier in the proposed outline must match that specified in the table.
The final point total for each group and tier may deviate by +/-1 from that specified In the table based on NRC revisions. The final RO exam must total 75 points and the SRO-oniy exam must total 25 points.
3.
Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to ES-401, Attachment 2, for guidance regarding the elimination of inappropriate K/A statements.
4.
Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5.
Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6.
Select SRO topics for TIers 1 and 2 from the shaded systems and K1A categories.
7.
The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system.
8.
On the following pages, enter the K(A numbers, a brief description of each topic, the topics importance ratings (IRS) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note
- 1 does not apply).
Use duplicate pages for RO and SRO-only exams.
9.
For Tier 3, select topics from Section 2 of the K/A catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
ES-401, REV 9 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 007EG2.4.31 Reactor Trip
- Stabilization
- Recovery 4.2 4.1 Knowledge of annunciators alarms, indications or I 1 response procedures OO8AA1.04 PressurizerVaporSpaceAccident/3 2.8 2.5 I3 Feedwaterpumps 009EK2.03 Small Break LOCA / 3 3
3.3 3 Li Li Li Li Li Li Li Li Li S/Gs 011 EG2.2.38 Large Break LOCA /3 3.6 4.5 Li
[]
I Knowledge of conditions and limitations in the facility license.
015AK2.07 RCP Malfunctions / 4 2.9 2.9 Li 1i LI Li Li Li Li Li LI [] [
RCP seals 022AK1.01 Loss of Rx Coolant Makeup / 2 2.8 3.2 Li Consequences of thermal shock to RCP seals 025AA1.19 LossofRHRSystem/4 2.6 2.4 LI Li Block orifice bypass valve controllerand indicators 027AA1.05 Pressurizer Pressure Control System 3.3 3.2 Li Transfer of heaters to backup power supply Malfunction / 3 038EK1.04 Steam Gen. Tube Rupture/3 3.1 3.3 Li Li Li Li LiLiLi Reflux boiling 054AK1.01 Loss of Main Feedwater / 4 4.1 4.3 (
[] []
MFW line break depressurizes the SIG (similar to a steam line break) 055EG2.4.2 Station Blackout/ 6 4.5 4.6 ) Li Li Li Li Li Li Li Li Li [I Knowledge of system set points, interlocks and automatic actions associated with EOP entry conditions.
Page 1 of 2 9/9/2009 8:59AM
Inadequate Heat Transfer - Loss of Secondary Heat Sink /4 Normal, abnormal and emergency operating procedures associated with (Loss of Secondary Heat Sink).
ES-401, REV 9 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME/SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 056AK3.01 Loss of Off-site Power / 6 LI LI LI LI C] LI LI El Ci Order and time to initiation of power for the load sequencer 057AA2.05 Loss of Vital AC Inst. Bus /6 3.5 3.8 C] LI C]
C]
C]
S/G pressure and level meters 062AA2.02 Loss of Nuclear Svc Water / 4 2.9 3.6 LI C] C] C]
C] [J C] C] C]
The cause of possible SWS loss 065AA2.03 Loss of Instrument Air / 8 2.6 2.9 C] C] [] C] C] C] C]
C]
C]
Location and isolation of leaks 077AK3.02 Generator Voltage and Electric Grid 3.6 3.9 C] C]
C] C] C] C]
Actions contained in abnormal operating procedures for Disturbances / 6 voltage and grid disturbances WEO4EK2.2 LOCA Outside Containment / 3 3.8 4.0 C] J [ C] C] C] C] C] C] C] C]
Facilitys heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.
WE05EK3.2 3.7 4.1 LIC]C]C]C]C]C]LIC]LI Page 2 of 2 9/9/2009 8:59 AM
ES-401, REV 9 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION:
IA Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 003AK3.10 Dropped Control Rod/i 3.2 4.2 El El El El El El LI El El []
RIL and PDIL 032AA2.07 Loss of Source Range NI / 7 2.8 3.4 El Maximum allowable channel disagreement 051 AA1.04 Loss of Condenser Vacuum /4 2.5 2.5
[ El El El El
[]
Rod position 060AG2.i.25 AccidentalGaseous Radwaste Rel. /9 3.9 4.2 El El El El El El LI] El El El Ability to interpret reference materials such as graphs, monographs and tables which contain performance data.
061AK2.01 ARM System Alarms / 7 2.5 2.6 El El El El El El El El El El Detectors at each ARM system location 068AK3.02 Control Room Evac. / 8 3.7 4.1 El El El Li LI El Li El El El System response to turbine trip WEO1 EK1.2 Rediagnosis / 3 3.4 4
] []
[]
[]
] El El Normal, abnormal and emergency operating procedures associated with (Reactor Trip or Safety Injection /
Rediagnosis).
WE13EA1.1 Steam Generator Over-pressure /4 3.1 3.3 El El El El El El [] El El El El Components and functions of control and safety systems, including instrumentation, signals, interlocks, failure modes and automatic and manual features.
WE16EK1.i High Containment Radiation / 9 2.7 3.0 El El El El El El El El El El Components, capacity, and function of emergency systems.
Page 1 oIl 9/9/2009 8:59 AM
ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 003G2.4.35 Reactor Coolant Pump 3.8 4.0
[] [] F []
Knowledge 01 local auxiliary operator tasks during emergency and the resultant operational effects 004G2.1.23 Chemical and Volume Control 4.3 4.4 Ability to perform specific system and integrated plant procedures during all modes of plant operation.
004K6.31 Chemical and Volume Control 3.1 35 Seal injection system and limits on flow range 005K2.03 Residual Heat Removal 2.7 2.8 J U RCS pressure boundary motor-operated valves 005K6.03 Residual Heat Removal 2.5 2.6 f UI UI LI LI LI LI LI LI U)
RHR heat exchanger 006K6.02 Emergency Core Cooling 3.4 3.9 U)
U) jj U) U)
Core flood tanks (accumulators) 007K1.03 Pressurizer Relief/Quench Tank 3.0 3.2 U) U)
U) U) U)
U)
RCS 007K4.01 Pressurizer Relief/Quench Tank 2.6 2.9 LI LI LI LI LI U) LI LI LI LI Quench tank cooling 008K2.02 Component Cooling Water 3.0 3.2 LI LI U) U) LI U) U) U) LI LI CCW pump, including emergency backup 010K1.08 Pressurizer Pressure Control 3.2 3.5 LI LI LI LI LI LI LI U) LI LI PZR LCS 01 2K1.05 Reactor Protection 3.8 3.9 LI LI LI U) LI LI U) U) LI LI ESFAS Page 1 of 3 9/9/2009 8:59 AM
ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 012K5.0l Reactor Protection 3.3 3.8 LI LI LI J LI LI LI LI LI LI DNB 013K5.02 Engineered Safety Features Actuation 2.9 3.3 j
Safety system logic and reliability 022A1.01 Containment Cooling 3.6 3.7
[] LI
[]
LI Containment temperature 022A2.03 Containment Cooling 2.6 3.0 ] [] []
Fan motor thermal overload/high-speed operation 026A3.02 Containment Spray 3.9 4.2 LI LI []
] []
L]
j Verification that cooling water is supplied to the containment spray heat exchanger 039A2.01 Main and Reheat Steam 3.1 3.2 j
Flow paths of steam during a LOCA 059A3.02 Main Feedwater 2.9 3.1 LI LI LI LI LI LI LI LI LI LI Programmed levels of the S/G 061A1.01 Auxiliary/Emergency Feedwater 3.9 4.2 LI LI LI LI LI LI ] LI LI fl LI SIG level 06232.1.27 AC Electrical Distribution 3.9 4
LI LI LI LI LI LI LI LI LI LI Knowledge of system purpose and or function.
063K2.O1 DC Electrical Distribution 2.9 3.1 LI LI LI LI LI LI LI LI LI LI Major DC loads 063K4.02 DC Electrical Distribution 2.9 3.2 LI LI LI LI LI LI LI LI LI Breaker interlocks, permissives, bypasses and cross-ties.
Page 2 of 3 9/9/2009 8:59AM
ES-401, REV 9 T2G1 PWR EXAMINATION OUTLINE FORM ES4O1-2 KA NAME I SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 064A2.13 Emergency Diesel Generator 2.6 2.8 Consequences of opening auxiliary feeder bus (EDIG sub supply>
073A4.02 Process Radiation Monitoring 3.7 3.7 Radiation monitoring system control panel 073K3.01 Process Radiation Monitoring 3.6 4.2 LI L} ]
[J
[]
[]
Radioactive effluent releases 076K3.02 Service Water 2.5 2.8
[j
[]
[] } [ [ [J Secondary closed cooling water 078K4.O1 Instrument Air 2.7 2.9 U
Manual/automatic transfers of control 1 03A4.03 Containment 2.7 2.7 J J ESF slave relays Page 3 of 3 9/9/2009 8:59 AM
ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES4O1-2 KA NAME I SAFETY FUNCTION:
IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 0011(2.05 Control Rod Drive 3.1 3.5
[] {) [J [j []
[] [] [] []
M/G sets 002A2.03 Reactor Coolant 4.1 4.3 Loss of forced circulation 01 6K1.08 Non-nuclear Instrumentation 34 3.4 U
fl PZR PCS 0281(5.01 Hydrogen Recombiner and Purge 3.4 3.9 Explosive hydrogen concentration Control 033A1.02 Spent Fuel Pool Cooling 2.8 3.3 U
Radiation monitoring systems 035G2.2.40 Steam Generator 3.4 47 LI U LI U [] LI U LI []
Ability to apply technical specifications for a system.
055K3.01 Condenser Air Removal 2.5 2.7 LI Main condenser 0711(4.06 Waste Gas Disposal 2.7 3.5 j
Sampling and monitoring of waste gas release tanks 079A4.01 Station Air 2.7 2.7 LI LI LI LI LI LI LI LI LI LI Cross-tie valves with lAS 086K6.04 Fire Protection 2.6 2.9 LI LI LI LI LI LI LI LI LI LI Fire, smoke and heat detectors Page 1 of 1 9/9/2009 8:59 AM
G2.l.15 G2.1.3 G2.l.37 G2.2.12 G2.2.13 G2.2.42 G2.3.13
G2.3.6 G2.4.30 G2.4.35 Conduct of operations Conduct of operations Conduct of operations Equipment Control Equipment Control Equipment Control Radiation Control Radiation Control Emergency Procedures/Plans Emergency Procedures/Plans 2.7 3.4 3.7 3.9 4.3 4.6 3.7 4.1 4.1 4.3 3.9 4.6 3.4 3.8 LIDDLILILI 2.0 3.8 2.7 4.1 3.8 4.0 DDDL1 DLI LI L1 DDDEI LI LI LID U DLI U LID LID ID LI LI DDDD LI LI LI LI LID LID RO SRO ES-401, REV 9 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
Knowledge of administrative requirements for temporary management directives such as standing orders, night orders, Operations memos, etc.
Knowledge of shift or short term relief turnover practices.
Knowledge of procedures, guidelines or limitations associated with reactivity management Knowledge of surveillance procedures.
Knowledge of tagging and clearance procedures.
Ability to recognize system parameters that are entry-level conditions for Technical Specifications Knowledge of radiological safety procedures pertaining to licensed operator duties Ability to aprove release permits Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.
Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects Page 1 of 9/9/2009 8:59AM
ES-401, REV 9 KA NAME / SAFETY FUNCTION:
008AA2.28 Pressurizer Vapor Space Accident / 3 011 EG2.4.1 1 Large Break LOCA / 3 025AG2.4.31 Loss of RHR System / 4 056AA2.73 Loss of Oft-site Power /6 065AG2.1.30 Loss of Instrument Air / 8 WEO4EA2.1 LOCA Outside Containment / 3 SRO T1G1 PWR EXAMINATION OUTLINE IR K1K2K3K4K5K6AIA2A3A4G RO SRO 3.3 4.0 4.2 4.2 4.1 3.5 3.6 o
DDDDDDEE1L1LH FORM ES-401-2 TOPIC:
Safety parameter display system indications Knowledge of abnormal condition procedures.
Knowledge of annunciators alarms, indications or response procedures PZR heater on/off Ability to locate and operate components, including local controls.
Facility conditions and selection of appropriate procedures during abnormal and emergency operations.
Page 1 of 1 9)9/2009 8:59AM
ES-401, REV 9 NAME I SAFETY FUNCTION:
003AG2.1.30 Dropped Control Rod/i 028AG2.4.20 Pressurizer Level Malfunction / 2 068AA2.03 Control Room Evac. /8 WE1OEA2.1 Natural Circ. With Seam Void/ 4 SRO T1G2 PWR EXAMINATION OUTLINE IR ki K2 K3 K4 K5 K6 Al A2 A3 A4 G RO SRO 4.0 3.8 4.3 4
4.2 3.2 3.9 FORM ES-401-2 TOPIC:
Ability to locate and operate components, including local controls.
Knowledge of operational implications of EOP warnings, cautions and notes.
T-hot, T-cold and in-core temperatures Facility conditions and selection of appropriate procedures during abnormal and emergency operations.
Page 1 of 1 9/9/2009 8:59AM
ES-401, REV 9 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 003G2.4.41 Reactor Coolant Pump 2.9 4.6 H
Knowledge of the emergency action level thresholds and classifications.
007A2.03 Pressurizer Relief/Quench Tank 3.6 3.9 H H H H H H H H H H Overpressurization of the PZR 010G2.l.20 Pressurizer Pressure Control 4.6 4.6 H H H H H H H H H H Abilityto execute procedure steps.
026A2.03 Containment Spray 4.1 H H H H H H H H H H Failure of ESF 073A2.02 Process Radiation Monitoring 2.7 3.2 H H H H H H H H H H Detector failure Page 1 of 1 9/9/2009 8:59 AM
ES-401, REV 9 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION:
IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 034G2.4.20 Fuel Handling Equipment 3.8 4.3 D
Knowledge of operational implications of EOP warnings, cautions and notes.
072A2.03 Area Radiation Monitoring 2.7 2.9 H H H Blown power-supply fuses 079A2.0l Station Air 2.9 3.2 LI LI U
[] []
[]
Cross-connection with lAS Page 1 of I 919/2009 8:59AM
ES-401, REV 9 KA NAME I SAFETY FUNCTION:
G2.1.35 Conduct of operations G2.1.40 Conduct of operations G2.2.19 Equipment Control G2.2.35 Equipment Control G2.3.5 Radiation Control G2.4.27 Emergency Procedures/Plans G2.4.39 Emergency Procedures/Plans SRO T3 PWR EXAMINATION OUTLINE IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G SRO 3.9 EDDDDIThDEI 3.4 4.5 2.9 3.9 3.8 FORM ES-401-2 RO 2.2 2.8 2.3 3.6 2.9 3.4
3.9 TOPIC
Knowledge of the fuel handling responsibilities of SROs Knowledge of refueling administrative requirements Knowledge of maintenance work order requirements.
Ability to determine Technical Specification Mode of Operation Ability to use radiation monitoring systems Knowledge of fire in the plant procedures.
Knowledge of the ROe responsibilities in emergency plan implementation.
Page 1 of 1 91912009 8:59AM
ES-401 Record of Rejected KIAs
?i,i.
Form ES-401-4 Tier / Group Randomly Reason for Rejection Selected K/A 3 / N/A 2.3.4 Originally selected K/A (2.3.6) had an importance rating less than 2.5 for the RO.
ES-401, Page 27 of 33
ES-401-6 Written Examination Quality Checklist (FINAL)
Facility:
Vogtle Date of Exam:
3-5-2010 Exam Level: RO X SRO X Initial Item Description a
b*
c#
1 Questions and answers are technically accurate and applicable to the facility.
2.
a.
NRC K/As are referenced for all questions.
b.
Facility learning objectives are referenced as available.
rv 3.
SRQ questions are appropriate in accordance with Section D.2.d of ES-401 4
The sampling process was random and systematic (If more than 4 RO or 2 SRD questions were repeated from the last 2 NRC licensing exams, consult the NRR CL program office).
5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6.
Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest newormodified); entertheactual RO/SRO-only 6/2 18/2 51 /21 question_distribution(s)_at_right.
7.
Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly 29! 3 46 / 22 1
tf,,1 selected K/As support the higher cognitive levels; enter the_actual_RO!_SRO_question_distribution(s)_at_right.
8.
References/handouts provided do not give away answers
/<
or aid in the elimination of distractors.
4 9.
Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;
/
.4.fr jJ deviations are justified.
4 10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
11.
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
c.
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor Note:
- The facility reviewers initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
t.J
ES-401 Written Examination Form ES-401-9 Review Worksheet Vogtle 2010-301 RO 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LCD I
(H/F)
(1-5)
Stem Cues TIF Cred Partial Job-Minutia
- 1 Back-Q=
SRO UIEIS Explanation Focus Link units ward K/A Only Dist.
InstructIons
[Refer to Section D of ES401 and Appendix B for additional information regarding each of the following concepts.[
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LCD) of each question using a 1 -5 (easy
- difficult) rating scale (questions in the 2 -4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
i.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO 1
F 1
X X
N U
Use complete sentences in the bullets.
Do not use the word should in the stem. Use must, shall, etc.
CAF: Explain why all the distractors are plausible. MG set configuration is basic knowledge.
The Q is U because of NP distractors.
WROTE NEW QUESTION. MATCHES K/A. NOW DISCUSS POWER SUPPLY TO MG SET. WAS NOT A HARD FIX.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK L0D I
(H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Link units ward KIA Only Dist.
Do not use the word should in the stem. Use must, shall, 2
H 2
X X
N E
etc.
The 2 part of the KA is not met. The applicant must be able to select a procedure in the choices.
This Q is U because all of the KA is not met.
If you can only meet part of an A2 KA, you MUST meet the second part. ADDED SECOND PART TO THE QUESTION.
NEED TO MAKE SURE THAT, AS AN RO QUESTION, IT DID NOT REQUIRE THE APPLICANT TO DETERMINE WHICH PROCEDURE SHOULD BE ENTERED
Psychometrics:
If a SD bank rod would render the RIL H
2 X
X N
UIE monitor ino_perable then for sure one or both of the CB rods will.
I herefore, neither C or D is plausible.
I suggest using the format:
A AB BA BB This will give C and D plausibility.
This Q is U because 2 distractors(C and D) are NP CHANGED STEM AND DISTRACTORS.
U/E Due to hih shaft vibration alarm in. Distractors B and D H
2 X
X N
E are NP. Take out the annunciators and leave all the symptoms like 20.2 mils and let the applicant draw their own conclusions.
This Q is U because B and D are NP. REMOVED ALARM FROM THE STEM AND USED SHAFT VIBRATIONS OF 20.2 MILS.
I sugciest bolding the words increase and decrease in F
2 X
N E
the choices. They are easy to misread.
BOLDED INCREASE. THE WORD DECREASE WAS NOT IN THE QUESTION. MADE OTHER CHANGES (LOTS) TO IMPROVE QUESTION.
The KA states effect of loss or malfunction 6
H 2
X N
E There is no malfunction in this question just a manual.
action.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD
I (H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Link units ward K/A Only Dist.
rhe KA is not matched. Set up the stem to indicate that there is a malfunction. As written only a manual action is taken to adjust seal injection. However, a minor adjustment to the stem will sat this Q. ADDED ONE STATEMENT TO THE STEM A MALFUNCTION HAS RESULTED IN SEAL INJECTION FLOW BEING OUT OF LIMITS Distractors A and B are NP. ALL safety related H
2 X
X N
U equipment requires redundancy as well as power and train separation.
This Q is U because A and B are NP. MODIFIED DISTRACTORS A & B AND ADDED BOTH TO DISTRACTOR C.
If the CD rate is higher, then their bypass flow HAS to be 8
H 2
X X
N U
lower. Consequently if the cooldown rate is lower then the bypass flow has to be higher.
This Q is U because Distractors A and D are NP.
WROTE NEW QUESTION BASED ON LOSS OF INSTRUNMENT AIR AND VALVE POSITION.
QUESTION IS OK.
With no failures present or an indication that a failure might H
2 X
X x
N E
be present, the first part of distractors A and B are NP.
Replace the forst part of A and B.
This question is U because 2 distractors are NP Potential fix:
If you put something in the stem that might lead the applicant to think that the Accum isolation valves might be failed open then A and B would be plausible.
Pressurizer pressure at> or = to 2000 is a common setpoint for P-il.
Secondly, there is no loss or malfunction of the CFT isolation valves because they will open when required.
The valves were inadvertently left closed. The KA is not met either. ADDED 4 TO 5 WORDS TO THE STEM.
CHANGED PRESSURE FROM 2020 TO 2100.
DISTRACTORS UNCHANGED. WE ACCEPTED THE CHANGES.
Since all RCS flow trip 90% bistables are lit AND you tell 10 H
2 X
X N
E them DIRECTLY that 1E and non 1E handswitches red lights are lit, distractors A and B are NP.
Psychometrics:
I RCP under-frequency was the reason the reactor tripped, chances are RCS two loop low flow would be too.
This question is U because 2 distractors (A and B) are NP REVISED STEM (MINOR CHANGES). REMOVED ONE WORD FROM TWO DISTRACTORS.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD I
(H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Link units ward K/A Only Dist.
11 Since it is obvious that LD is isolated, distractor A is NP.
H 2
X X
N E
Replace A Since you did not say or exclude manual operations, RCDT is potentially a correct answer.
This Q is U because of two potentially correct answers and one NP distractor.
I know this Q was approved on the 2007 Seq exam but there are problems with it.
ADDED INFO TO THE STEM.
CHANGED ONE OF THE DISTRACTORS. MINOR.
12 H
2 NS rhere is nothing remotely related to a reactor trip from the 13 H
2 X
X N
E MEW pump trip list in V-LO-PP-18101. Everything is pretty much all secondary with the exception of SI which is common knowledge.
The second part of distractors C and D are NP.
Potential fix: The list does include the turbine exhaust valves not full open. Consider changing C and D second part to condenser vacuum 14.8 inches.
This Q is U because of two potentially correct answers and one NP distractor. EXPLAINED WHY DISTRACTORS ARE PLAUSIBLE. AGREED. ADDED TIME LINE.
14F2 15 F
2 N
S The way the question is written, if you insert backup only 16 H
2 X
X N
E into the sentence, it doesnt make sense. Therefore Distractors A and D are NP.
Restructure the Q to eliminate this issue.
This Q is U because there are two (A and D) NP distractors. CHANGED WORDING IN TWO OF THE DISTRACTORS BACKUP HEATERS ONLY (MINOR CHANGE)
F2 18 H
3 NS
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
(H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Link units ward K/A Only Dist.
Are there too many parts to this question? Appears it can 19 H
3 N
E be worded better. REPLACED DNBR WITH DNB.
Are there too many parts to this question? Pppears it can 20 H
3 N
E be worded better. REMOVED ONE PART OF THE DISTRACTORS. AS WRITTN IT WAS OK. BUT DECIDED TO MAKE IT A 2 PART 21 H
3 N
S 22 H
3 N
S 23 F
2 N
S 24 H
3 X
X N
E Since Containment pressure is> 3.8 psig, the distractor analysis says to shift containment coolers to low speed.
The answer selected states to shift coolers to high speed.
Either the distractor analysis is wrong or the answer is wrong.
This Question is E until this ambiguity is resolved.
State the procedure used for second part of each choice to completely satisfy the KA. MODIFIED STEM/DISTRACTORS (OK) 25 H
3 N
S 26 H
3 N
S 27 F
2 X
X N
E Even though the stem states ALL, I would consider putting the word only in the distractors where applicable, for clarification. MADE CHANGES TO THIS QUESTION BECAUSE IT WAS DIFFICULT TO READ. CHANGES AS SUGGESTED DID NOT HELP THE QUESTION. (OK) 28 H
2 X
X N
E Distractor B is NP. Change to Proportional Heater Bank and Backup Heater Bank D only.
Distractor D is NP either. For distractor D add C to it.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD
(H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Link units ward K/A Only Dist.
This Q is U because of two NP distractors. MODIFIED QU ESTI ONS.
I believe that the retirement of the Post-LOCA hydrogen 29 H
2 X
X N
u recombiners is common knowledge now since it was done in 05 which render distractors A and C NP.
Suggestion: Change it to dilution with service air Change the stem to indicate the PREFERRED order (V LO-PP-29101). Add to stem that containment air pressure is 5.5 lbs.
A will become the correct answer.
Add dilution with service air to A and C.
This Q is U because of two NP (A and C) distractors.
AGREED WITH COMMENTS --- WE SUGGESTED PUTTING IN SERVICE AIR
, WHEN WE STEM STATED THAT SERVICE AIR WAS NOT AVAILABLE.
CHANGED DISTRACTORS.
30 H
3 NS 31 F
2 NS 32 F
2 X
X N
E Even though the stem states ALL, I would consider putting the word only in the distractors where applicable, for clarification.
MADE CHANGES AS SUGGESTED AND OTHER MINOR CHANGES. (OK)
F 2
X N
E The stem is teaching.
Su9gestion: Rewrite the stem and list values that would indicate reflux boilinq rather than defininci it. MODIFIED STEM. USED DISTTACTORS AS PROVIDED. DECIDED THAT AS IS, THIS IS NOT WRITTEN AT AN RO LEVEL.
WILL REVISIT... WEDNESDAY... REWROTE QUESTION. USED PART OF THE DISTRACTORS NEW QUESTION. NOW AN H..
34 H
2 X
X N
E Steam Dumps are NP under these circumstances. A steam line isolation is obvious. Furthermore, the 2 d part of the KA is not met. The applicant must be able to choose a procedure that contains the correct action.
Suggestion: Leave the second part of the choices and replace the first with a procedurally directed action.
The Q is U because of two NP distractors (C and D 1st part)
LOWERED CONTAINMENT PRESSURE IN THE STEM.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q/LOKLOD
I (H/F)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- 1 Back-Q=
SRO U/E/S Explanation Focus Link units ward K/A Only Dist.
THIS CHANGED THE ANSWER INCLUDE STEAM DUMPS. MINOR CHANGES IN STEM ONLY.
35 H
2 X
N E
Deletetheword in inthestem.
Delete the word valid in the stem. This is not needed.
Correct the WOOTF statement (Wwhich).
Fix the periods in the 1 st two bullets.
MADE CHANGES AS SUGGESTED.
Why would SG pressure stabilize after a rupture at the 36 H
2 X
X N
U base of the SG? At least put the break somewhere where the applicant would have to think if it was upstream or downstream of the FWIV.
The 2 part of distractors A and C are NP.
Suggestion: Change the location of the break.
This Q is U because two distractors (A and C) are NP.
CHANGED TWO OF THE DISTRACTOR ??????
H 3
N S
This question is basic thermodynamics and has no 38 H
1 N
U discriminatory value.
Replace the Q.
This question is U because the LOK is a 1. WROTE NEW QUESTION H
3 N
S 40 H
3 N
S
1.
2.
[
- 3. Psychometric_Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
I LOK LOD
I (F/H)
(1-5)
I Stem Cues T/F Cred.
Partial Job-Minutia
- /
Back-Q SRO U/E/S Explanation f__
jFocus Dist.
Link units ward K/A Only 41 F
2 S
Modified Harris 2008-301 dd the acronym (GDT) in the first bullet.
dd the appropriate Unit designator to distractors B and D (i.e. Unit 1, Unit
) before the listed GDT.
Distractor A is implausible. The distractor analysis states that it is plausible because dual unit liquid releases are allowed. However, the supporting locumentation states that releases from more than one Waste Monitor ank are not allowed unless authorization is received the Chemistry Manager. Use of an exception to support that an activity is allowed tretches the point of plausibility, especially when you add in that it is 42 H
3 X
U ssociated with liquid releases not gaseous releases.
Distractor D is implausible. Without knowing anything about the point here a relief valve on a GDT is designed to lift, a quick review of the data hows other tank pressures that are much higher than GDT #4 and stable.
It doesnt follow that the relief valve on GDT#4 has reached its lift setting hiIe these other tanks with higher pressure are stable over the two readings.
LOD. INFORMATION PROVIDED IN THE DISTRACTOR D TELLES HE APPLICANT WHERE TO LOOK FOR PROBLEM. ------MADE SEVERAL CHANGES TO THE DISTRACTORS (OK) 43 H
4 5
Modified Farley 2008 (erb tense in the first bullet needs to be changed from present tense to past tense.
Both Distractors A and C identify the normal system alignment as xpected for this event. This doesnt seem plausible given the actuation of 44 H
X X
U/E hi alarms on two separate radiation monitors.
Both Distractors C and D identify RE-0014 Waste Gas Rad Monitor as xpected to be in alarm. These two systems (FHB ventilation and Waste Gas system) are not in communication with each other under any ircumstances, which makes the addition of RE-0014 rad monitors implausible. MODIFIED THE STEM AND DISTRACTORS. (OK) 45 H
2 5
46 F
2 X
E Re-write stem such that it is a closer match to the K/A. MODIFIED THE STEM 47 F
1/2 X
X U/E Insufficient information to address credibility of the question. REVISED FHE STEM AND DISTRACTOR D (OK)
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK LOD
(F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
Link units ward K/A Only 48 F
1/2 S
LOD It appears that you can immediately disregard two of the distractors 49 H
1 X
X E
and D based on fact that an SI signal is actuated. MODEFIED THE STEM 1 & 2 FORMAT. SHORTENED DISTRACTORS.
LICENSEE EXPLAINED WHY DISTRACTORS WERE PLAUSIBLE.
50 H
2
S Distractor B is not plausible.
It states that steam dumps will control Tave.
51 H
E hen it states that if Tavg drops below 550 F. if it is controlling, why would ne expect it to drop below? MADE CHANGES TO THE STEM AND DISTRACTORS.
(OK) s written it appears that there are two possible answers. Stem ask if 52 F
2 X
X U/S instrument becomes inoperable.
MADE MINOR CHANGES TO THE STEM AND THE DISTRACTORS. (OK) 53 F
1/2 S
LOD DECIDED TO ACCEPT QUESTION AFTER DISCUSSION PPEARS TO BE A 2. (OK)
Distractors A & B do not appear to be plausible.
Is the monitor failed low, 54 H
2 X
U vould one expect the system to isolate? WILL REVISIT AFTER LOOKING AT SRO EXAM. FRIDAY WROTE NEW QUESTION.
Not C/A. Make sure there are not two answers. Prove that A and D are 55 H/F 2
X E
iot correct. ADDED INFORMATION TO THE STEM. CONVENSED US CHAT THERE WERE NOT TWO CORRECT ANSWERS. (OK)
)uestion does not meet the K/A. The K/A requires testing on the knowledge of the reasons for the actions in the abnormal operating procedures for voltage and grid disturbances. The question only tests the ppIicants knowledge of the actions of the abnormal operating procedure.
nd bulleted condition is not necessary since it simply restates an entry ondition for Section A of AOP-18017, which is explicitly stated in the 3rd 56 H
2 X
X U
)ulleted condition.
Distractors A and C Include the entire procedure identifier (i.e. AOP 18017 versus 18017).
Distractors C and D It is implausible that you are going to operate and ie your emergency power source to an unstable power grid. This would e expected knowledge for any competent AO and not discriminating for n RO applicant. WROTE NEW QUESTION (OK)
Nording of the stem does not elicit information contained in each of the 57 F
2 X
E hoices. The question focuses on the location of the controls rather than esting any specific interlock or design feature associated with transfer of ontrol. REWORDED STEM AND DISTRACTORS. (OK) 58 H
2 S
Modified Watts Bar 2008
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK LOD
(F/H)
(1-5)
Stem Cues TIF Cred.
Partial Job-Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
Link units ward KIA Only Need to replace the comma in the first part of the stem with a period. These are two separate sentences.
)uestion does not match K/A The K/A requires testing on the knowledge of how a loss or malfunction of the fire protection system will effect fire, smoke, or heat detectors. The question poses a malfunction of a fire detector, provides the fire protection ystem response, and then asks about the design of specific 59 F
2 x
x u
omponents within the fire protection system (i.e., Sprinkler Type).
The applicant can eliminate all distractors simply by knowing the lifference between a Preaction system and a Wet Pipe system. The term Preaction cues the applicant to the correct system response without knowing anything about the specifics of he system.
WROTE NEW QUESTION (OK) 60 F
3 S
The correct answer (choice B) and distractor C both contain ualifying conditions not addressed in the stem of the question.
Jould recommend providing the applicable conditions in the stem f the question and leave qualifiers out of the choices.
lso, the question stem includes an anticipated time of 30 minutes. Distractors A and D use 30 minutes as the delimiter for ietermining whether a SHORT TERM relief or COMPLETE urnover is required. It would be difficult to say either of these 61 H
3 X
X E
hoices is correct when dealing with an anticipated time that just happens to be the exact same time element used in these two listractors. Therefore, examinee could determine that neither hoice can be right. Would recommend that the wording of these Jistractors be reworked around an unspecified time limit rather han using 30 minutes.
MADE CHANGES TO ADDRESS CONCERNS (OK) WROTE NEW QUESTION. (OK)
)uestion does not match K/A The K/A requires testing on the administrative requirements (e.g., approvals, criteria for use, ime restrictions, etc.) associated with temporary management 62 F
3 X
U iirectives. The question tests the applicants rote memory of the specific contents for a given temporary instruction and the type of emporary instruction based on the title of the temporary instruction. WROTE NEW QUESTION
=1 J
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOKILOD
(F/H)
I i-Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-Q SRO U/E/S Explanation I
jFocus Dist.
Link units ward K/A Only uestion does not match K/A The K/A requires testing on the procedures, guidelines or limitations associate with reactivity management. The question provides the examinee with a specific reactivity management limitation (i.e., 100% Rated Thermal 63 F
2 X
U Power Limit) and determining which activity could exceed this mit. While the question tests the applicants knowledge of which 9ctivity would have a positive reactivity effect on the plant, it does not test the applicants knowledge of the procedures, guidelines o imitations as they relate to reactivity management. WROTE NEW QUESTION Spell out the acronym CIA for its first use.
64 H
2 S
Delete the assumption statement.
MADE CHANGES Please provide additional documentation that supports the requirements concerning the air supply valve. Nothing in the provided reference mentioned the positioning of the air supply 65 F
2
?
alve for an AOV.
PROVIDED PROCEDURE. QUESTION IS OK.
66 H
2 S
Question looks like one of the Admin JPMs. Stem tell the applicant that he has been approved by the ED for the exposure permit.
If he has been approved, why would anyone one say that 67 1
X X
E he would not be able to perform the job for the conditions given?
Immediately remove distractors C and B. AGREE. MINOR CHANGES. REMOVED INFORMATION FROM THE STEM FHAT THE ED APPROVED THE WORK TO BE DONNE. (OK)
LOD. Is there an HP check/control point outside containment? It 68 F
1 U
here is, it would make A correct (two answers).
AGREED MINOR CHANGES FIXED THIS QUESTION.
K/A not addressed. Activities performed/announcements made 69 F
E are not made as a part of and emergency procedure/plan.
CONVENSED US THAT IT DID MATCH THE K/A. MADE SLIGHT MODIFICATION TO QUESTION.
1.
2.
3._Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK LOD I
i (F/H)
(1-5)
Stem ICues TIF Cred.
Partial Job-Minutia
- 1 Back-0 SRO UIEIS Explanation Focusi Dist.
Link unitsiward K/A Only Rewrite question such that it ask what task the operator must perform as the results of the event given. Consider giving values 70 H
2 X
x EIS n the stem.... Oil pressure It appears that you gave the actions... Consider rewriting to make sure that question closely addresses K/A....what actions and the effects of the actions.
71 Is this an RO question. LICENSEE HAS NO PROBLEM WITH rHIS AS AN RO QUESTION.
72 H
3 S
Need to revisit the reason/bases for leaving the RCP running in 73 H
2 X
distractor C. Also look a reason in distractor D. Guidance in the procedure directs maintaining PRZR less than 2000 psig (P-i 1).
REWORDED DISTRACTORS C & D. (OK) 74 H
2 S
75 H
2 X
U/E Explain why you would consider the sample valves being open plausible. MADE A MINOR MODIFICATION. (OK)
ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
LOK LOD (F/H)
(1-5)
U/E/S Explanation Stem Cues T/F Job-Minutia
- /
Back-Q=
SRO Focus Link units ward K/A Only VOGTLE 2010 SRO Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., It is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check cuestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK (F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /
Back-Q SRO U/E/S Explanation Focus Dist.
Link units ward K/A Only 1LOD. With a ROD AT BOTTOM in alarm and H-8 bottom LED lit, why 76 H
I U
[would I go to Misaligned rod section of the procedure? Distractors B and jD do not appear to be plausible. AGREED WITH OUR COMMENTS.
1.
2.
- 3. Psychometric_Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK LOD
(F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- 1 Back-Q SRO U/E/S Explanation Focus Dist.
Link units ward K/A Only CHANGED QUESTIONS. (OK) 77 H
3 5
t appears that this question can be answered with RO level knowledge 78 H
1 E
[Ithough it is directed by procedure. With reference provided, is this not a irect Iookup?
MODIFIED QUESTION (OK).
79 H
3 S
80 H
3 5
81 H
3 X
E Consider rewriting the question such that it requires the applicant to dentify the procedure that is transition to. REVISED QUESTION (OK) t appears that the question can be answered with RO only knowledge.
CHANGED STEM TO ASK AS DIRECTED BY PROCEDURE PROCEDURE DID DIRECT WHICH METHOD SHOULD BE USED.
82 H
X E
LICENSEE THINKS THIS IS LOCATED TOO DEEP IN THE PROCEDURE. THE NRC THINKS THAT THE QUESTION SHOULD BE
,CCEPTED LICENSEE THINKS THE QUESTION HAS A HLD AND SHOULD BE MODIFIED. DECIDED TO USE QUESTION. (OK) 83 H
5 84 H
3 5
Not sure this is a K/A match. Did not see tie to knowledge of operational mplications of EOP warnings, cautions and notes. LICENSEE DID NOT 85 H
2 X
X X
E GREE. THEY DISCUSSED WHY. WE AGREED. MADE MODIFICATIONS TO THE QUESTION. QUESTION WRITTEN FROM A PROCEDURE AND TS REQUIREMENT.
It appears that this question can be answered with system knowledge.
E FTER DISCUSSING THIS QUESTION, MADE CHANGES TO THE WESTION. PROVIDED MORE DIRECT TIES TO SRO LEVEL ONLY QUESTION Not SRO only. AGREED. WROTE NEW QUESTION. NOT SURE IF 87 X
U H15 SHOULD HAVE BE A U IF WE USE OUR OWN DIRECTIONS FOR VRITING SRO QUESTIONS.
88 X
U Does not appear to match K/A WROTE NEW QUESTION (OK) 89 X
U Not SRO only.
It appears that you can answer with question with system knowledge and knowing TS entry conditions. AGREED. WROTE NEW
ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
LOK LOD (F/H)
(1-5)
U/E/S Explanation Stem Cues T/F Job-Minutia
- 1 Back-Q=
SRO Focus Link units ward K/A Only 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#
LOK LOD 1
(F/H)
(1-5)
Stem Cues T/F Cred.
Partial Job-Minutia
- /
Back-Q SRO U/E/S Explanation Focus Dist.
Link units ward K/A Only
)UESTION.
Distractor B is not plausible.
CHANGED DISTRACTOR B AND MADE MINOR CHANGES TO OTHER DISTRACTORS.
COULD NOT AGREE 90 X
E
)N QUESTION. WILL REVISIT.
FRIDAY: MADE CHANGES TO QUESTION. MODIFIED STEM AND DISTRACTORS.
91 S
92 5
LCD 93 H
2 S
It appears that there could be two correct answers, A and C. AGREED 94 H
X U
VITH OUR COMMENTS.
ADDED INFORMATION (TIME) TO THE STEM
- TO ADDRESS TWO ANSWER CONSERNS (OK) 95 H
X lose to RO level knowledge. DETERMINED IS WAS AN SRO QUESTION. MODIFIED QUESTION. (OK) 96 H
3 5
7 LCD. AGREED. ADDED THE REQUIREMENT OT IDENTIFY 9
H/M LCD
U EMERGENCY CLASSIFICATION LCD.
It appears that the first part of the question can be answered with 98 H
1 X
U/E RO only knowledge.
... Who performs the call out? Distractors has two part answer, stem is not written as such. Who is responsible for faxing the notification form? Simple K/A WROTE NEW QUESTION (OK) 99 H
2 S
100 H
3 S
ES-401, Rev. 9 2
Form ES-401-9
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility:
Vogtle Date of Exam: 3-5-10 Exam Level: RO X SRO X Thad N. Thompson / 4?4 iiL Dan Scukanec /
, R
£d
-./tJ.L Item Description 1.
Clean answer sheets copied before grading 2.
Answer key changes and question deletions justified and documented 3.
Applicants scores checked for addition errors (reviewers spot check > 25% of examinations 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5.
All other failing examinations checked to ensure that grades are justified 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature
- a. Grader
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
- d. NRC Supervisor (*)
Date 3-9-io
- I - IQ
£WcfiuLt4 V
(*)
The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.