ML090270082
| ML090270082 | |
| Person / Time | |
|---|---|
| Site: | Brunswick  |
| Issue date: | 11/10/2008 |
| From: | NRC/RGN-II |
| To: | |
| References | |
| Download: ML090270082 (109) | |
Text
ADMINISTRATIVE DOCUMENTS (Yellow Paper) 1.
Exam Preparation Checklist
~....................... ES-201-1
~.
Exam Outline Quality Checklist............................... ES-201-2
~
Exam Security Agreement(s)
ES-201-3 wf.
Administrative Topics Outline (Final)
~.
Control Room Systems & Facility Walk-Thru Test Outline (Final)..... ES-301-2
("f{.
Operating Test Quality Check Sheet ES-301-3
..;:r.
Simulator Scenario Quality Check Sheet ES-301-4
~.
Transient and Event Checklist................................ ES-301-5
'v6 9.
Competencies Checklist ES-301-6 Yf((
Written Exam Quality Check Sheet............................ ES-401-6 vrf:
Written Exam Review Worksheet ES-401-9
~
Written Exam Grading Quality Checklist........................ ES-403-1 v13.
Post-Exam Check Sheet
- . ES-501-1
~
Facility Submittal Letter
[
]
I S n~* %cP--fJ IJA2
£Y ~-5Z
- ~A~1
~ I ~
avl-LjM I
/6 F/M" V'/'- ~
£) fen -
ES-201 Facility:
D.rv~.5 Vwr' (.. (c....
Examination Outline Quality Checklist Date of Examination:
tJo\\J 0 '6 Form ES-201-2 Initials Item Task Description a
b*
c#
1.
W R
I T
T E
N 2.
S I
M U
L A
To R
3.
W
/
T 4.
G E
N E
R A
L a.
Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
b.
Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KIA categories are appropriately sampled.
c.
Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d.
Assess whether the justifications for deselected or rejected KIA statements are appropriate.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.
b.
Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days.
c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
a.
Verify that the systems walk-through outline meets* the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations c.
Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
b.
Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
c.
Ensure that KIA importance ratings (except for plant-specific priorities) are at least 2.5.
d.
Check for duplication and overlap among exam sections.
e.
Check the entire exam for balance of coverage.
f.
Assess whether the exam fits the appropriate job level (RO or SRO).
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Supervisor Note:
- . Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines
ES-201 1.
Pre-Examination Examination Security Agreement Form ES-201-3 I acknowledge that I have acquired specialized knowledge abput the NRC licensing examinations scheduled for the week(s) of '0{21/0 ~
as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the' NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of lo/L,/O&
. From the date that I entered into this security agree'menf until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE
- r~...~c.-'c-arl Ex.~~,twt\\..,.
~.... D-t.u LD~
- t.,,"-~/&~;'
'SIAOJ!JIJY'+
?<h~k=' *()ntHJHrlr<.~
5(2.0 Techfh~~) reVtetAJer
~. >.-".~.
w ". __ *
~~~~IW:~!<<
,~
"~
CJCkfllll\\.
ulJI,l"uYII.~lL_
s Ro
/E~1AIt VAl;t:k1ov (2.0 J£yJ41f") I/ALICWTofl-QO*i 1= J( Q I-Yt 'WJ, It 60. LIh-
?;n7f7E'XAm--~i fAllT1JliFA;'l
~h<;t(' uihf"-
SAn
£10Suf,v,It-H?4rlw! ~., ~~.e,
,.~~
~a..
'M~u /V.*t\\Ll~~\\lO~
f\\0:bC\\
ES-201, Page 27 of 2~
~.~ h/\\\\/vY
ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of \\ I'~ !)3h 2;,
as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been "authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 1111,11)1
. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
- 1. r.::tiI:il.A W. u.<1£ 2.
l.-ea...n n
~een~r
- 3. MI-k.c..
A,NfA-.-r(;>.
- 4. srE-y-E
.G~lJj 14 )
- 5. LIy,JIl.G,.:Jc T>vtJ~
~-=--=~~---:..
--t ~~~~~f4..k_---- ~~ --f-zII'-"'I'-~~""""'----
6.
Je~'&~E'i D(}A1?-.?
7.
-hE~~E1l-\\
(~N~
- 8. £1J(;NI2..A. Ha~
9.
cLtr1i~j2tMlSMA)tf/
10.________
11.--------
12.-------- --------------------------------- ------
13.
14.
15.
NOTES:
ES-201, Page 27 of 28
ES*201 Examination Security Agreement Form ES*201*3 1.
Pre-Examination I acknowledge 'that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of it{.g/OS as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration,.except as specifically noted below and authorized by the NRC (e.g., acting asa simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility Iicensee 1s procedures) and understand that violation of the conditions of this agreement may result in cancellation of the 'examinations and/or an enforcement action against me or the facility Iicensee~1 will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during theweek(s) of 1IIIR../<<1'. From th~ date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC, JOB TITLE / RESPONSIBILITY PRINTED NAME SIGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE
- 1. M\\<..I-IAll...
St.1jVL:i\\-lbl,.
\\('<~i'l'I.N~
~.
jl!IOO/os"
- f/~r
,,/.,f"J.-
~: it~ j~It~1yj \\:.r
~
J~$1 6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
NOTES:
_.~.".' --
ES-201, Page 27 of 28
ES-301 Administrative Topics Outline Form ES-301-1 Facility:
Brunswick Date of Examination:
Nov 2008 Examination Level:
RO Administrative Topic (see Note)
SRO D Type Code*
Operating Test Number:
Describe activity to be performed Final Conduct of Operations Conduct of Operations Equipment Control Radiation Control P
Determine SRM/IRM Overlap per GP 2 R
2.1.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation N
Evaluate Reactor Water Level Instruments using Caution 1 R
2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc D
Drywell Average Temperature Calculation R
2.2.12 Knowledge of Surveillance Procedures M
Determine Stay Time Limitations in High Rad Area 2.3.7 Ability to comply with radiation work permit requirements during normal and abnormal conditions Emergency Procedures/Plan N/A N/A NOTE:
All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S 3 for ROs; s 4 for SROs & RO retakes)
(N)ew or (M)odified from bank (~ 1)
(P)revious 2 exams (S 1; randomly selected)
ES-301 Administrative Topics Outline Form ES-301-1 Date of Examination:
Nov 2008 Facility:
Brunswick Examination Level:
RO D SRO Operating Test Number:
Final D
Evaluate Core Spray Surveillance and determine Tech Specs Administrative Topic (see Note)
Conduct of Operations Type Code*
R Describe activity to be performed 2.1.32 Ability to explain and apply system limits and precautions Conduct of Operations N
Evaluate Reactor Water Level Instruments using Caution 1 R
2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc P
Evaluate Clearance - CRD Pump 2A Equipment Control R
2.2.13 Knowledge of tagging and clearance procedures Radiation Control M
Determine Stay Time Limitations in High Rad Area 2.3.7 Ability to comply with radiation work permit requirements during normal and abnormal conditions D
Classify Emergency Conditions (EALs)
Emergency Procedures/Plan R
2.4.41 Knowledge of the emergency action level thresholds and classifications NOTE:
All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes &Criteria:
(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (S 3 for ROs; S 4 for SROs & RO retakes)
(N)ew or (M)odified from bank (~ 1)
(P)revious 2 exams (S 1; randomly selected)
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility:
Brunswick Exam Level: RO I SRO-I SRO-U Date of Examination:
Nov 2008 Operating Test No.: __F_in_a_I__
Control Room Systems@ (8 for RO); (7 for SRO-I); (2 or 3 for SRO-U, including 1 ESF)
System I JPM Title Type Code*
Safety Function a.
Emergency Equalize MSIV's (239001 A4.01)
DIS 4
b.
Vent the DW w/Stack Rad Monitor Increase (261000 A4.04)
D/EN/AIS 9
c.
Recirc Runback Reset (295014 A1.02)
M/AIS 1
d.
HPCI in Pressure Control I Exhaust Diaphragm failure MIA/LIS 3
(295025 EA1.04) e.
RCIC with flow controller failure (295031 EA1.05)
D/A/L/S 2
f.
Diesel Generator to Normal Feeder (264000 A4.05)
DIS 6
g.
Reset Nitrogen Backup System after Isolation N/S 5
(232002 A4.03) h.
(RO only) Bypass control rod from RWM (201006 A2.05)
DILlS 7
In-Plant Systems@ (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U) i.
SLC with Demin Water (295031 EA1.08)
D/E/R 2
j.
Stop and Prepare DG4 for start per OASSD-02 (295003 M/AIE 6
AA1.02) k.
RHR SW per AOP-32 (295026 EA1.01)
P/E/R 5
All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
- Type Codes (A)lternate path (C)ontrol room (D)irect from bank (E)mergency or abnormal in-plant (EN)gineered safety feature (L)ow-Power / Shutdown (N)ew or (M)odified from bank including 1(A)
(P)revious 2 exams (R)CA (S)imulator Criteria for RO / SRO-I / SRO-U 4-6 / 4-6 / 2-3 S9/S8/S4
~1/~1/~1
- / -
/
~1 (control room system)
~1/~1/~1
~2/~2/~1 s 3 / s 3 / S 2 (randomly selected)
~1/~1/~1
Simulator JPM's a.
Emergency Equalize MSIV's using hard card (LOT-SIM-JP-025-A01)
KIA reference and importance rating:
239001 A4.01 Ability to manually operate and or monitor in the Control Room: MSIVs 4.2/4.0 Task 239 201 84 01 Equalize Around And Open Main Steam Isolation Valves Per Hot Startup OP-25.
Summary The unit has scrammed and a GRP I Isolation occurred. The main condenser is available and the MSIV's are to be re-opened to anticipate emergency depressurization.
b.
Vent the DW w/Stack Rad Monitor Increase (LOT-SIM-JP-010-A02)
KIA reference and importance rating:
261000 A4.04 Ability to manually operate and monitor Primary Containment Pressure 3.3/3.4 Task 261 008 81 01 Perform Normal Primary Containment Venting.
Summary Drywell pressure is high. The student will vent the drywell using S8GT (engineered safety feature). When aligned the rad monitor will increase (alternate path taken) and the student must isolate the venting.
c.
Recirc Scoop Tube Reset (LOT-SIM-JP-002-009)
KIA reference and importance rating:
295014 A1.02 Ability to manually operate and/or monitor in the control room: Recirc Pump Flow control as it applies to inadvertent reactivity addition.
3.6/3.8 Task 2022038401 Respond to a Recirc Pump flow control failure rising Per AOP-03.
Summary This is a modified alternate path JPM. A runback signal is being reset and after the second pump is reset the scoop tube runs away. This is modified in that previously the run away scoop tube would occur on the first pump selected.
d.
HPCI in Pressure Control/Exhaust Diaphragm failure (LOT-SIM-JP-019-14)
KIA reference and importance rating:
295025 EA1.04 Ability to operate and/or monitor the following as they apply to High Reactor Pressure: HPCI (plant specific) 3.8/3.9 Task 2062008401 Place HPCI in Reactor Pressure control from the standby lineup per OP-19.
Summary This is a modified alternate path JPM. The modification was to make this an alternate path JPM.
The unit has scrammed and the MSIV's are closed. The student is to place HPCI in reactor pressure control mode. After placed in service the exhaust diaphragm breaks and HPCI must be shutdown.
e.
RCIC with flow controller failure (LOT-S/M-JP-016-A02)
KIA reference and importance rating:
295031 EA1.05 Ability to operate and/or monitor the following as they apply to Reactor Low Water Level:
Reactor Core Isolation System (plant specific) 4.3/4.3 Task 2170038101 Manually Startup The RCIC System Per OP-16.
Summary This is a banked JPM. Unit has scrammed due to a loss of feedwater; level is below LL2 with HPCI under clearance. RCIC has failed to start.
f.
Diesel Generator to Normal Feeder (LOT-S/M-JP-050-A02)
KIA reference and importance rating:
264000 A4.05 Ability to manually operate and/or monitor in the control room: Transfer of emergency generator (with load) to grid 3.6/3.7 Task 2620178101 Complete A Control Room Manual Transfer Of Emergency Bus Supply From Diesel Generator To Normal Feeder Per OP-50.1.
Summary This is a banked JPM. DG3 is loaded and supplying power to E3. The student must unload the DG to place E3 back onto its normal power supply of D bus.
g.
Reset Nitrogen Backup System after Isolation (LOT-S/M-JP-046-001)
KIA reference and importance rating:
232002 A4.03 Ability to manually operate and/or monitor in the control room: Reset system isolations 3.6/3.5 Task 2782038101 Restore the Backup Nitrogen System following an Auto Initiation Per OP-46.
Summary This is a new JPM. An inadvertent initiation of Core Spray has occurred. The student must reset the CS logic and then restore the nitrogen backup system (Group 10 Isolation) to normal.
h.
Bypass control rod from RWM (LOT-S/M-JP-007-AO1)
KIA reference and importance rating:
201006 A2.05 Ability to use procedures to correct or control out of sequence rod movement 3.1/3.5 Task 2142018401 Bypass/unbypass a control rod from the Rod Worth Minimizer Computer Display.
Summary This is a banked JPM. A control rod has been inserted to suppress a fuel leak. The student is to bypass the control rod in the RWM sequence.
IN-PLANT JPMs i.
Alternate Coolant Injection - EOP-LEP Coolant Injection with SLC Pumps Aligned To Demineralized Water (AOT-OJT-JP-300-J10)
KIA reference and importance rating:
295031 EA1.08 Ability to operate and/or monitor the following as they apply to Reactor Low Water Level:
Alternate Injection Systems 3.8/3.9 Task 200 071 85 04 Perform Alternate Coolant Injection With SLC Pumps Per EOP-LEP-01.
Summary This is a banked JPM that is performed in the RCA. The control room has directed alternate coolant injection with demin water using the SLC pumps per EOP-01-LEP-01.
j.
Stop and Prepare DG4 for start per OASSD-02 (A0 T-OJT-JP-304-24 / AOT-OJT-JP-304-25)
KIA reference and importance rating:
295003 AA1.02 Ability to operate and/or monitor the following as they apply to Partial or Complete Loss of AC Power: Emergency Generators 4.2/4.3 Task 2006118504 Perform actions associated with Alternate Safe Shutdown as the Unit 1(2) DG Operator per OASSD-02.
Summary This is a modified banked alternate path JPM. This is a time criti.cal JPM also. The modification was to add the actions for stopping the DG and the alternate path to the JPM. The student is stopping and then preparing D4 for start per ASSD-02. Alternate path is to manually close a breaker.
k.
Control Room Evacuation lAW AOP-32, Placing the RHR Service Water System in Operation (LOT-OJT-JP-302-E07)
KIA reference and importance rating:
295026 EA1.01 Ability to operate and/or monitor the following as they apply to Suppression Pool High Water Temperature: Suppression Pool Cooling 4.1/4.1 Task 2006048504 Perform MCC Operator Actions For Placing Suppression Pool Cooling In Service Per ASSD-02 or AOP-32.
Summary This is a banked JPM. This JPM was randomly selected from an NRC exam previously given (2007). The control room has been abandoned and the student is directed to place the '8' Loop RHRSW System in operation per OAOP-32.
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
Brunswick Date of Examination:
11/3-7/08 Operating Test Number: 1 Initials
- 1. General Criteria a
b*
c#
a.
The operating test conforms with the previously approved outline; changes are consistent with IJ; vh
.~
sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b.
There is no day-to-day repetition between this and other operating tests to be administered IJ;
~. N during this examination.
c.
The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.)
Ib t{tt;~ ~
d.
Overlap with the written examination and between different parts of the operating test is within IJJ
~ ~
acceptable limits.
e.
It appears that the operating test will differentiate between competent and less-than-competent I!J
~'~
applicants at the designated license level.
- 2. Walk-Through Criteria a.
Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures Jq reasonable and validated time limits (average time allowed for completion) and specific
(@
~~
designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements"describing important observations to be made by the applicant criteria for successful com pletion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable b.
Ensure that any changes from the previously approved systems and administrative walk-through p ~~
outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with fJ;
~
Form ES-301-4 and a copy is attached.
Printed Name / Signature Date a.
Author Robert Bolin
~
/()b)~i b.
Facility Reviewer(*)
Leonard R. Bellerrl/;!Yl0tA£ ~ ~
I~L?£/~~
~
c.
NRC Chief Examiner (#) Ronald F. Aiello
~/)
//2-9;-. A
-/~&i)~
d.
NRC Supervisor Malcolm T. Widmann iN/fA-cll ~~
"fo!ZA(I!<t
~ VVY~'7
\\..
NOTE:
The facility signature is not applicable for NRC-developed tests.
Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 ilVrCl<-i~ / f)fl4 ~ e fiNIrL Facilty:
~t~~~~ "k.,
Date of Exam: 3/~enario Numbers: / / ~ /~
Operating Test No.: OA.lrPf QUALITATIVE ATTRIBUTES Initials a
b*
c#
f\\
1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out Ih
~
.~
of service, but it does not cue the operators into expected events.
2.
The scenarios consist mostly of related events.
Ih J/p,
-~
3.
Each event description consists of the point in the scenario when it is to be initiated
~
~
the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew
~
the expected operator actions (by shift position) the event termination point (if applicable) 1\\
4.
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario IJ; J,c
-~
without a credible preceding incident such as a seismic event.
5.
The events are valid with regard to physics and thermodynamics.
PJ
~~ ~
6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain I/J
~
~
complete evaluation results commensurate with the scenario objectives.
7.
If time compression techniques are used, the scenario summary clearly so indicates.
p
~~ ~
Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given.
~
8.
The simulator modeling is not altered.
Ih U~
~
9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator p ~
~
performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
10.
Every operator will be evaluated using at least one new or significantly modified scenario.
/}J I~
,h All other scenarios have been altered in accordance with Section 0.5 of ES-301.
11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6
/)
~ ~
(submit the form along with the simulator scenarios).
12.
Each applicant will be significantly involved in the minimum number of transients and events p
~~ "\\\\
specified on Form ES-301-5 (submit the form with the simulator scenarios).
13.
The level of difficulty is appropriate to support licensing decisions for each crew position.
Ih W~,~
Target Quantitative Attributes {Per Scenario; See Section D.5.d}
Actual Attributes 1.
Total malfunctions (5-8)
'I / 8 / b JIb
~ ~
2.
Malfunctions after EOP entry (1-2) 3 /3 / Z-
~~
}ffJ
~
3.
Abnormal events (2-4) 2.-/1/3
~~ JU "
4.
Major transients (1-2) l./z.,/z..
~A~
!tfI, '\\
5.
EOPs entered/requiring substantive actions (1-2) 2.. / J /z-A~
t{A "
6.
EOP contingencies requiring substantive actions (0-2) 3 / I
/.3
~~
~~ ~~
7.
Critical tasks (2-3)
""3 / 3 /
'Z..
~~
U~ \\,
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam: Nov 2008 Operating Test No.: Final T
M 0
I T
N A
I M
L U
M(*)
R I
U 2
2 11 4
4 2
2 11 4
4 B
o P
A T
C S
R o
B o
P A
T C
Scenarios 2
3 S
R o
CREW POSITION CREW POSITION 3
2 1
1 2,4,5,6,8, 3,4,5,6, 10 8
7,9 7,9 2,5 3,4 3
2 1
1 2,4,5,6,8, 3,4,5,6, 10 8
7,9 7,9 2,5 3,4 B
o P
A T
C 1
S R
o CREW POSITION T
Y P
E E
V E
N T
A P
P L
I C
A N
T MAJ TS SRO-U RX I----t-------+--t-----i-------t----t----+-----t-----t----+-
!Jj J--N_O_R-+-------f-----f------t-------f------t----+----+---f----t---
I/C SRO-U RX II----f---------t---f------it------t---+---+-----+---+------t---
!Jj n_N_O_R--+------+---I------+-----I------+---+----+------+----f---
I/C
- 2 MAJ TS
- 1 Instructions:
1.
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the "at-the-controls (ATe)"
and "balance-of-plant (BOP)" positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.
3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam:Nov 2008 Operating Test No.: Final A
E Scenarios P
V 1
2 3
T M
P E
0 I
L N
CREW POSITION CREW POSITION CREW POSITION T
N I
T S
A B
S A
B S
A B
A I
C R
T 0
R T
0 R
T 0
M L
U A
T 0
C p
0 C
p 0
C P
M(*)
N y
R I
U T
P E
RO RX 2
1 1
[Il~
NOR 1
1 1
~~~((%{§:{;~::J IIC 4,5,10 3,5 5
4
- 1 MAJ 7,9 7,9 4
2 TS 0
0 RO RX 3
1 1
[!]
NOR 1
1 1
IIC 2,6,8 4,6,8 6
4
- 2 MAJ 7,9 7,9 4
2 TS 0
0 RO RX 2
1 1
Ill~
NOR 1
1 1
':;I{@;(((({J IIC 4,5,10 3,5 5
4
- 3 MAJ 7,9 7,9 4
2 TS 0
0 RO RX 3
1 1
[Il~
NOR 1
1 1
- ~:::*:::::::::;.:::::::~1 IIC 2,6,8 4,6,8 6
4
- 4 MAJ 7,9 7,9 4
2 TS 0
0
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam:Nov 2008 Operating Test No.: Final A
E Scenarios P
V 1
2 3
T M
P E
0 I
L N
CREW POSITION CREW POSITION CREW T
N I
T POSITION A
I C
M S
A B
S A
B S
A B
L U
A T
R T
0 R
T 0
R T
0 M(*)
N Y
0 C
p 0
C p
0 C
p T
P R
I U
E SRO-I RX 1
2 2
lIJ NOR 2
1 2
I/C 3,4,5,6,8, 4,5,10 3,5 13
- 1 9,10,11 MAJ 7
7,9 7,9 5
TS 3,9 2
SRO-I RX 3
2 liT
........."J NOR 1
2 I/C 4,8,9, 2,4,5,6, 4,6, 13
- 2 10 8,10 8
MAJ 7
7,9 7,9 5
TS 2,5 2
SRO-I RX 3
2 2
NOR 2
1 2
I/C 5,6,8, 2,6,8 3,4,5, 12
- 3 11 6,8 MAJ 7
7,9 7,9 5
TS 3,4 2
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam:Nov 2008 Operating Test No.: Final Scenarios CREW POSITION 4 Back up T
M 0
I T
N A
I M
B L
U 0
M(*)
P R
I U
1 1
5 2
2 1
1 3
2 0
0 0
3 2
0 A
T C
CREW POSITION S
R o
B o
p A
T C
S Ro CREW POSITION B
o p
5,6,7 8,9 A
T C
2,3,4 8,9 S
R o
3,6 2,3,4, 5,6 8,9 A
E P
V P
E L
N I
T C
A T
N Y
T P
E SRO-I RX (I]
NOR I/C
- 1 MAJ TS SRO-I RX
[1]1 NOR
- ~:::::::::::::~::::~
IIC
- 2 MAJ TS SRO-I RX NOR I/C
- 3 MAJ TS
ES*301 Facility: Brunswick Competencies Checklist Date of Examination: Nov. 2008 Form ES-301-6 Operating Test No.: Final APPLICANTS RO
- RO D
RO D
SRO-I D
SRO-I D
SRO-I
- Back up Scenario SRO-U D SRO-U
- SRO-U D Competencies SCENARIO SCENARIO SCENARIO 1
2 3
4 1
2 3
4 1
2 3
4 SROI
<\\i
/
Interpret/Diagnose 2,3, 3,4, 1\\/
i\\
1<
2,3, 3,4, I
< 3,4, 2,3, 3,4, 2,3,4,7 4,5, 6
1<
4,5, 6
Ii 5,6 4,5, 6
i Events and Conditions
\\
I<Yi 6
6 6
/>
- Yi
/
Comply With and
\\\\< \\/
1,2, 1,2, 1,2, 1,2, 1,2, 1,2, 1,2, 1,2,5,6 ii 3
3,5 1/
3 3,5 4,5 3
3,5<\\
Use Procedures (1) i<
1<
/
/\\
i Operate Control
- 1,3, 1,2, I
/ 1,2, 1,3, 1,2,
/>
1,2,3,4,5,
- ..*.** 4,5, 3,4, i
1<
/
4,5, 4,5, 3,4, Boards (2) 6-5,6-
- 1
<>\\
7 6-5,6-6 1\\</
>\\ I>i><
10 10
/
10 10
\\\\<
1>/><> I>
i Communicate All All 1><
1<
All All All All All
/
All
/i/<
\\
\\
and Interact
\\
/ili/
/
- i.***.*...
/
1\\*********
Demonstrate
\\<
3,6, 2,3,
/
4, 3,6, 2,3, 3,4,7-9
<1<
Supervisory Ability (3)
- Y I
7-4,7-7-
7-4,7-
./
il/
/<
\\
10 10
/..*.** >
11 10 10
/
Comply With and
/
/
2,5 3,4 3,9 2,5 3,4 I
\\
\\
<Ii 3,4
><1.**.*.*
1/
Use Tech. Specs. (3)
/
I>
\\
I.i
/<
... /
Notes:
(1 )
(2)
(3)
Includes Technical Specification compliance for an RO.
Optional for an SRO-U.
Only applicable to SROs.
Instructions:
Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
Brunswick Date of Exam:
11/10/2008 Exam Level: RO X SRO X Initial 1.
Questions and answers are technicall accurate and applicable to the facility.
4.
The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensin exams, consult the NRR OL pro ram office).
Item Description NRC K/As are referenced for all questions.
Facilit learnin ob'ectives are referenced as available.
a.
b.
3.
SRO 2.
5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
- 1..-. the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6.
Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only uestion distribution s at ri ht.
Bank 25/4 Modified New 50/21 Question ps chome'tric qualit and format meet the uidelines in ES Appendix B.
The exam contains the required number of one-point, multiple choice items; the total is correct and a rees with the value on the cover sheet.
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are *ustified.
",,/
CIA 41/17 34/8 Memory Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter the actual RO / SRO question distribution s at ri ht.
References/handouts provided do not give away answers or aid in the elimination of distractors.
7.
9.
11.
10.
8.
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor Robert Bolin Leonard Beller Ronald Aiello Malcolm Widmann ::~i~~~~7~*~~uZ4~~C===
r~
Date "ljlftl'
/!/t!.q Note:
- The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-401 Written Examination Review Worksheet Form ES-401-9 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only Gen
- /units: If an annunciator is referred to in the question, use the exact name as the window engraving and put panel # and window #.
For consistency, use all capital letters, for example:
PUMP B SEAL STAGING FLOW HI/LO (A-7, 5-5)
Gen SRO-Only: Each SRO question should include a brief statement identifying which item in 10CFR55.43 the question targets.
Recommend using the SRO-Only Guidance provided by Region 2.
Gen If a fill-in-the-blank statement is used in the stem, ensure that the preceding stem question states WOOTF choices identifies....
Gen If a reference is being provided for a question, indicate in the analysis field! explanation field the exact intended page(s) that will be distributed (versus the name of the procedure only).
Gen Ensure that all the choices for any question only contain two items within the choice. If the choice has three items, then the applicant could potentially recognize only one of the three items without having to process through the other two items.
Gen NRC Review of the Initial Exam Submittal included Q#'s 1-37 and 76-100. Exam returned to licensee for re-work due to high number of unsat questions. See Question Summary chart for breakdown on which questions were unsat, including the reasons.
BRUNSWICK 2008-301 WRITTEN EXAM REVIEW "j:. n \\+;~ ~~b~" 11-~ eM. '1/22/ D8 Sample: 37 RO Questions + 25 SRO Questions = 62 items NUMBER OF QUESTIONS Unsatisfactory KIA not met Not SRO Implausible Distractors Other (Partially correct LOD=1, no correct Enhancement Satisfactory
References:
NUREG-1021: ES-401, E.2.d; Form ES-401-9; Appendix B 1:47:49 PM 11/19/2008
Instructions
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOO) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (Le., the question has a valid KIA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and licens.e level mismatches are unacceptable).
6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section O.2.f.
7.
Based on the reviewer's judgment, is the'question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8.
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanatio~
Focus Dist.
Link units ward KIA Only 1
H 2
x x
x x
N
201 003A1.02 S
1.
Job-link: 10P-7, Section 8.1 doesn't allow using the CRD flow controller to increase drive water dP (i.e., only allows double clutching, raising drive water dP using F003). Potential fix is item
- 4 below.
2.
Cues: Stem teaches by stating that OP allows raising dp to 300 psid. This information isn't necessary to answer the question 3.
- /units: Use the same terminology and label names as on the control board, i.e., "C11/C12-FC-R600 placed in AUTO and the thumbwheel setpoint raised"...versus throttle closed C11-F002.
4.
Stem Focus: Re-word stem question as follows: WOOTF component manipulations will raise the drive water header differential pressure indication at Panel P603?
5.
Licensee pointed out that OP-7 states to raise drive water dP, but does not provide guidance how to raise drive water dP. This addresses comment #1 above.
6.
Still need to resolve comment #2 and #4.
7.
Comments incorporated.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LaD (F/H)
(1-5)
Stem Cues T/F
({red.
Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 2
H 2
x x
x x
N Y
202001 A1.09 e
1.
Cred Distractors: "A" and "B" are not plausible because 1st stage S
seal pressure at 0 psig at the same time 2 nd stage seal pressure is at 500 psig can never occur, no viable scenario exists [See SD-02, Figure 02-18]
2.
Backward Logic: Usually, you provide the applicant with control board indications and ask him/her to diagnose the failure. This asks applicant to determine the indications for a given failure.
Discuss wI licensee to ensure acceptable.
3.
Stem Focus: Specify the initial % power to eliminate rx pressure at 0 psig possibility.
4.
- /units/Cred Distractors: For annunciators, use the exact name as the windown engraving. Also, put panel # and window # in parenthesis behind name of alarm:
PUMP B SEAL STAGING FLOW HI/La (A-7, 5-5), all caps...instead of "Seal Staging Flow Hi annunciator. The alarm (as listed in "B" and "0") exists ONLY on Unit 1. This question is for Unit 2. Applicant may discern that these choices are not plausible.
5.
Licensee re-worked question to address comments. However, each item contains 3 elements. The first element in each choice
(#1 seal pressure - 1000 psig) should be deleted since it is included in all four choices anyway.
6.
Include the word "Cavity", Le., #2 Seal Cavity Pressure" because this is the way the PI is labeled on the control panel.
7.
Comments incorporated.
- ! IBack-I Q= ISRO I B/M/N IU/E/S unIts ward KIA Only Stem ICuesIT/F Icred*1 PartialIJob-I Minutia Focus Oist.
Link Q#
3 1.
LOK (F/H)
H 2.
LOO (1-5) 2 x
- 3. Psychometric Flaws x
- 4. Job Content Flaws
- 5. Other x
6.
N 7.
y
S 8.
Explanation 203000K5.02 1.
Cred Oistractors: "c" and "0" are not plausible because of the words "significant fuel damage/hydrogen generation" are synonymous, i.e., you can't have one without the other. Suggest using similar wording as in "A" and "B" with "Clad temperatures are expected to exceed 1800 deg F."
2.
Stem Focus: Add "in accordance with 01-37(?).." to the stem question.
3.
Licensee eliminated "c" and "0" issues; however, "A" is not plausible because why would clad temperatures be expected to exceed 1500 deg if adequate core cooling is met?
4.
Q=KlA: Does question target the KIA for RHRlLPCI? Suggest adding second knowledge that evaluates applicant's knowledge of 1) whether or not adequate core cooling exists and 2) the required RHR flow value directed by procedure.
5.
Licensee argued that KIA is met because vessel injection flow values would be different for Core Spray system. Also changed "A" to state temps expected to remain between 1500 and 1800.
~~_~m'~~::!:!J~!:!~iill'::!:'!~t~:~!:t~~
4 F
2 x
N
1205000K2.01 S
1.
Stem Focus: The first sentence in the stem is not necessary to answer the question. Suggest deleting. Re-word stem question as follows: 'WOOTF pumps is powered from 4KV E-bus E2?"
2.
I Back-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem Icuesl T/F I cred'l Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 5
H 2
x N
E I 206000G2.4.18 S
11.
Cues: The first sentence in the stem is teaching/cues. Suggest deleting this and re-wording the stem question as follows:
'WOOTF actions is required when suppression pool level cannot be maintained above -6.5 tt, including the basis for the action, in accordance with PCCP and 01-37.8?" Pull the words "Secure HPCI" out of the stem into each choice.
2.
Stack each choice with required action on top and basis on the bottom for better readability.
3.
Re-word each choice to eliminate the words "to prevent" and "due to", i.e., for "A"> "primary containment over pressurization";
for "B"> "HPCI turbine protection."
4.
Licensee re-worded stem to eliminate the teaching statement; however, the new stem still teaches, Le., 'WOOTF identifies when HPCI must be secured when pool level cannot be maintained above - 6.5 tt?" See comment #1 above and include another plausible action that is taken with respect to torus level, i.e., emergency depressurize or ensure CAC-4409, 4410 sample point changed to drywell, etc.
5.
If Item #4 not used, then re-work the stem because it asks for "when" HPCI must be secured whereas each choice provides a condition. Suggest adding the following lead-in words:
a.
Immediately and b.
Immediately and c.
ONLY if not...
d.
ONLY if not...
6.
Question re-worked to ask for whether to leave HPCI on irrespecti~~~f~~'~~r~~in~~i8~.~flif.neededfor cc'g and the reason.
1~r:.;iml¥.l~::J.~.::~~llif::;::~:;~;9:~:;~a
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanation Focus Dist.
Link units ward KIA Only 6
H 3
x x
B
209001 K3.02 S
1.
Cues: the words "ADS automatically initiates" in the first sentence are not necessary to answer the question. This is redundant to the fourth bullet.
2.
Stem Focus: Add the words "Unit 2" to the second sentence in the stem, Le., Unit 2 plant conditions are as follows..
3.
Stem Focus: Re-word the stem question as follows: 'WOOTF predicts how the ADS valves will respond during the loss of offsite power and subsequent re-energization of power to the E-busses?"
4.
Is "c" better worded as" close then re-open immediately when low pressure ECCS pumps sequence on."
5.
Correct sentence fragm ent (first sentence) 6.
Make each choice into two parts a.
Remain open when the LOOP initially occurs; Remain open after the E-busses are re-energized b.
Close when the LOOP initially occurs; Remain closed after the E-busses are re-energized c.
Close when the LOOP initially occurs; Re-open 83 seconds after the low pressure ECCS pumps start d.
Close when the LOOP initially occurs; Re-open immediately after the low pressure ECCS pumps start Comments incorporated.
7.
- 1. I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
I 8.
Q# I LOK LOO (F/H)
(1-5)
Explanation 7 I H I 2 I I
I I
I I
I I
I I
I N
209001 G2.2.37 S
Ask licensee to provide the rules of usage for the NPSH limit curves, which procedure describes how to use the torus pressure curves?
Need to read whether or not interpolation was intent of curve?
1.
Re-word "A" to read "2A and 28 Core Spray Pumps and 2A and 28 RHR Pumps" 2.
Re-word stem question: WOOTF identifies the ECCS pump(s) that is/are operating within their associated NPSH limit(s)?
3.
This question may overlap SRO Question #77 (203000 A2.01) 4.
Question #77 doesn't overlap because this question requires RO applicant to use graph to determine NPSH limit, whereas SRO
- 77 provides applicant that pump alreCidy at NPSH limit and asks for consequence and procedure.
8 I F I 2 I I x I I
x I x I I
I I
I I
I N I y
211000K5.06 B
1.
Partial: Does loss of instrument air imply loss of service air also?
S If so, then "A" could also be argued as correct. Suggestion: re-word the stem such that it is understood that ONLY instrument air supply is being referred to. (See comment #3 suggestion below) 2.
Stem Focus: The first sentence in the stem is not necessary to answer the question.
3.
Cred Dist: "0" is not plausible because none of the plant pneumatic systems supply the SLC pump accumulators.
Suggestion: re-word "0" as follows. Also..."A" could be re-worded as follows to eliminate item #1 above:
A. SLC storage tank boron concentration will not be within limits.
O. SLC storage tank B-1 0 enrichment (atom percent) will not be within Tech Spec Limits."
- 4. Licensee incorporated items #1 and #2; however, "0" is not plausible as described in item #3 above.
- 5. Since Q#59 didn't hit the KIA and was a direct hit for this KIA, licensee deleted this 9~e;ti9n~~~~~8~!it~t~d9#?9. Licensee will develop ne~ Q#59.
l~i~~:I.~~*J,i::::~~iliU*:i~:!~9~!m~~
Stem Icuesl T/F I cred*1 Partial I JOb-I Minutia I
- 1 I Back-I Q= I SRO I B/M/N IU/EIS Focus Dist.
Link units ward KIA Only Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 9
H x
x x
N
~
1212000A4.02 S
1.
LOD=1. As presented, this question will not provide any discriminatory value. Suggest asking for which RPS channel that N002D feeds and the expected alarm that will occur if it were to fail upscale, as follows:
A.
B1 channel; REACTOR MANUAL SCRAM SYS B (A-5, 2-8)
B.
B2 channel; REACTOR MANUAL SCRAM SYS B (A-5, 2-8)
C.
B2 channel; REACTOR AUTO SCRAM SYS B (A-5, 1-7)
D.
B1 channel; REACTOR AUTO SCRAM SYS B (A-5, 1-7) 2.
Stem Focus: Anytime an annunciator is referred to in the question, use the exact name as the window engraving with all Caps. Also, put panel # and window # in parenthesis 3.
Q=KlA: Licensee addressed comment #1 by asking how RPS Channel B2 was affected (energize or de-energize) and the expected alarm (Auto or Man scram) if N002D failed upscale.
(not the same as item #1 above)
Discuss wi licensee: This may not meet the KIA because the knowledge associated with depressing one scram pushbutton and whether RPS energizes or de-energizes is not a tight link with the KIA (performing system functional tests). However, the knowledge associated with the N002D channel assignment is directly tied to performing system functional tests.
4.
Licensee argued that alarm indications and RPS channel status was directly linked to KIA.
~~.~~m!'I~::..!,~i:!iij;lh!::*!i!~.!~r~:~irr~~
- ! IBack-I Q= ISRO IB/M/N IU/E/S units ward KIA Only Stem ICuesIT/F ICred. IPartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 10 F
2 x
x x
N m 1212000K1.12
.~.
1.
Partial: Since main condenser vacuum results in RETS pressure trip, then "A" can be argued as correct. The words "direct input" in the stem may not preclude this in appeal space. Suggest reworking the question to ask for the switches that provide trip signals to contacts in the RPS "A" and "B" auto scram log'ic...potential solution needs investigation:
A. Pressure switches located on the ETS header B. Pressure switches located on the pressure averaging manifold C. Pressure switches located on each of the stop valve actuators D. Pressure switches located on each of the control valve actuators 2.
Cred Dist: "B" is not credible because this does not pertain to the reactor/turbine pressure control system as KIA requires.
3.
Partial: Licensee re-worked question but "B" and "c" can still be potentially argued as correct since EHC-PS-1 01 A-C and EHC-PS-100A/B will actuate a turbine trip which causes a reactor scram.
Use of the word "direct input" and "would be" are vague.
4.
Stem Focus: If parenthesis are used for "c" and "0" items, then use parenthesis for "A" and "B" acronym EHC.
5.
Revised choices to ensure no possible correct answers.
Licensee proved that PS-1g1A:9C?r."l1¥9?~~~.I~"Ypr~~~~re standby pump auto start.
~J.JJ,i.~I0I:III:J,~m:~~Iili.G:~i~t~~:r~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 11 H
2 x
x x
N E
215001 G2.1.31 S
1.
Partial: If the TIP drawer mode switch position were in the OFF position (not specified in the stem), then "C" could be argued as correct.
2.
Cues: Instead of having each choice present the word "open" or "closed", present the applicant with the lite/label terminology that would be available, i.e., red, green, white light, etc.
3.
Licensee addressed comments #1 and #2 by specifying the TIP mode switch position and providing light indication, respectively.
4.
- /units: Need to include the back panel number (P607 vs only stating "back panel") since some of the choices pose options that the light is ONLY at the back panel.
5.
Comments incorporated.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanation Focus Dist.
Link units ward KIA Only 12 H
2 x
N y
215003A4.07 E
1.
Cred Dist: "c" is not plausible because it is saying that nothing S
will happen. "A" is not plausible because if there is a Rod Out Block then there has to be an accompanying IRM downscale light. Suggestion:
A.
White light iliuminated ONLY ROD OUT BLOCK (A-5, 2-2) will alarm B.
White light illuminated BOTH REACTOR AUTO SCRAM SYS B (a-5, ) AND ROD OUT BLOCK ( ) will alarm C.
White light extinguished ONLY ROD OUT BLOCK (A-5, 2-2) will alarm D.
White light extinguished BOTH REACTOR AUTO SCRAM SYS B (a-5, ) AND ROD OUT BLOCK ( ) will alarm 2.
Cue: the word "inadvertently" in the second sentence is not required to answer the question. Simply state that the operator takes the switch from Range 1 to Range 3.
3.
Typo in the stem question, the word "system."
4.
Licensee incorporated all comments. Need to clarify the stem by adding the words "white light" after IRM downscale, including the Panel P601 number to ensure applicant knows exactly which downscale indicator the question is referring to.
5.
Comment incorporated.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOO (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Oist.
Link units ward KIA Only 13 H
3 x
x x
B U
215004K4.01
1.
Cred Oist: "c" and "0" are not plausible because they contain 3 S
elements each. For example, if an applicant knows that the SRMs can never cause a scram ~ignal, then he/she has no reason to consider the first two items in these choices. The choices should only contain 2 elements. Suggest re-working the question to include ROD OUT BLOCK (A-5, 2-2) and NEUTRON MONITORING SYSTEM TRIP (A-5, 4-7) alarms as potential options (instead of Y2 scram or full scram) 2.
Stem Focus: Is the second sentence necessary? Ask licensee if they ever pull shorting links.
3.
Stem Focus: Change the words "design features" in the stem question to "actuations" and change "should" to "wilL" 4.
Suggest having IRMs on Range 7 to add credibility.
5.
Licensee incorporated comment #1 and #3.
6.
Stem Focus: Re-word stem question: Given these plant conditions, WOOTF identifies the annunciator(s) that will be in the alarmed condition?
7.
Partial: Verify wi licensee that "0" is incorrect? Will SRM Upscale cause the Neutron Mon Sys Trip alarm even though no scram occurs?
8.
Licensee verified.
- 1 IBack-I Q= ISRO I B/M/N IU/E/S units ward KIA Only x
Stem ICuesITIF Icred'l PartialIJob-I Minutia Focus Dist.
Link 1.
2.
Q# I LOK LOD (F/H)
(1-5) 1417G 2
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
N 7.
y
S 8.
Explanation 215005A3.03 1.
Cred Dist: "A" and "B" are not plausible because they do not affect the power-to-flow map; therefore, have no way to affect the APRM ODA display.
2.
LaO = 1;As presented, this question will not discrillJinate.
3.
Suggest presenting applicants with a small portion of the stability screen (following onset of power oscillations) and ask them to determine why or why not a reactor trip occurred. Based only on whether the thresholds were exceeded on the ODA display.
4.
Cred Dist: Licensee addressed comment #1 by changing "A" to FW-V120 fails open and "B" to control rod drifting into the core.
Is FW-V120 a motor-operated valve?
I~ so, then "A" is not plausible.
Suggest providing the applicants with a point on the power-to-flow map and asking them to predict the corresponding ODA display that the APRM will have.
5.
Changed "A" to state that FW-V120 is inadvertently opened.
~Yi~ilJl~~ii.J:~:;i~il0~::i~;mt~~:it~§
- 1. I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LaD (F/H)
(1-5) 15 I F I 2 I x I I
I x I x I I
I I
x I I
8.
Explanation 217000K1.01 1.
Cred Dist: "C" and "0" are not plausible because the fill-in-the-blank" wording is not grammatically correct. Also, the wording in these two choices appears to be backward logic and difficult to understand because the first phrase is not in context with the scenario presented in the stem.
2.
Partial: "A" can be argued as correct because it is a subset of "B", i.e., F010 will indeed auto close when both torus valves aren't full closed. Re-word each choice to include words such as "immediately" auto opens; "begins to close when" to eliminate potential for arguing "A" as correct.
3.
Stem Focus: Anytime an annunciator is referred to in the question, use the exact name as the windown engraving with all Caps. Also, put panel # and window #
4.
Comment #1 and #2 not yet addressed. In other words, for choice "A", what does "when both torus suction valves are NOT full closed" mean? Not sure what this distractor is saying.
Q.~:*:.;:.:.;..:*.ticensee stated that this type of statement is exactly how the
...... ******Iimit switch terminology is discussed, which adds plausibility.
~i9~?f~~p~~ti1-~~~~RI~9~~!~n of what "A" was stating.
IJg;j§~IiliJ~~;::li:::~im:i::~:;~:~;~m~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanation Focus Dist.
Link units ward KIA Only 16 H
3 x
x N
e 218000A2.01 S
1.
Q=KIA: The second half of the question does not hit the KIA; consequently question is disjointed. Suggest revising the second part of the question to ask applicant procedural allowance or requirement in order to defeat ADS using keylock switches or pushbuttons.
2.
Stem Focus: Reword the stem question as follows: 'WOOTF identifies the current status of the ADS Timer and what operator action. is..."
3.
What is RPV level trend?
4.
Licensee incorporated comment#2. Comment#1 is not critical to the question.
5.
Stem Focus: replace in accordance with "EOPs" to "PCCP" 6.
Comment incorporated.
17 H
2 x
x N
.y 219000K1.09 S
1.
Cred Dist: "A" is not plausible because it is the only choice that says nothing will happen. (With F048B listed in 3 distractors, why would you choose "A?") With a LOCA signal, this is not plausible. "0" is not plausible because 10 minutes is not a time associated with any RHR valve. Suggestion:
A.
Both Pumps remain runhing E11-F048B will auto-open B.
Both pumps remain running E11-F048B will remain closed C.
ONLY the RHR SW Pump will trip E11-F048B will auto-open D.
ONLY the RHR SW Pump will trip E11-F048B will remain closed 2.
Stem Focus: What is the status of F048B in the stem?
3.
Comments incorporated:
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanation Focus Dist.
Link units ward KIA Only 18 F
2 x
x N
223002K4.08 S
1.
Q=KlA: KIA is looking for how you manually bypass using a procedure, switch, etc. Question is written to test knowledge of which signal is bypassed. Kind of tough KlA...but do we ever use the low condenser vacuum bypass switches in EOPs?
2.
Cue: The first few words of the stem can lead an applicant to the correct answer, Le., the words RC/L (level); Level/Power (level).
Suggest rewording to say "During an ATWS.."
3.
Cue: In "C", change the location of the word "low" to the beginning to match "D." Also, eliminate the descriptor "Level 3" because it is not necessary to elicit the correct response.
4.
Does the section of SEP-1 0 that jumpers MSL drain valve only eliminate the level input? If not, then make sure question is worded to preclude this item from making another choice correct.
5.
Licensee incorporated comments.
19 H
2 x
x N
tJ 223002K6.08
1.
Cred Dist & KIA: "A" and "B" do not include any impact on PCIS; S
therefore these are not credible. Additionally, "A" and "B" are not hitting the KIA of knowledge of how RPS affects PCIS. The correct choice "c" does not include any actuations Le., no MSIV movement; therefore impact on PCIS is negligible.
Instead, re-work the question to test knowledge of how PCIS is affected by the MG set trip or RPS bus transfer, Le., items listed in SD-03, Section 4.1.4 Suggestion: test which Group 1 lights will extinguish or which alarms will come in.
2.
Mis-spelled word "outboard" in each choice. QUESTION IS SAT OTHERWISE.
~* ::...im*...:iComments incorporated.
- 1 IBack-I Q= ISRO I BIMIN IU/E/S units ward KIA Only Stem ICuesITIF Icred'l PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 20 H
2 x
x N
E tJ S
226001 A2.03 1.
Q=KIA: Discuss with licensee: If neither valve (V111 or V117) can be opened, is operator still required to place DW sprays in service irrespective of vital header availability? If so, then there may be no correct answer.
2.
Stem Focus: Need to reword the stem question to include lAW SEP-02: 'WOOTF describes the impact this failure will have on the Drywell Spray Mode of operation and also identifies the required operator actions in accordance with SEP-02?"
Possible alternative is to use a question where the drywell pressure goes below the auto-closure of the drywell spray valves (sprays stop or not) and then whether or not the operator is required to re-assess the DWSIL curve the 2 nd time sprays are initiated.
3.
Licensee incorporated comment #2. Still concerned whether KIA for Drywell Spray is being met with predicting the impact on the RHR pumps when the V111 fails to open. Discuss wI licensee and chief examiner.
fti !:..::i:.i.i:.:!*.Licensee argued that at Brunswick the RHR pump serves a dual role, Le., both decay heat removal and containment spray.
Additionally, the spray procedure (SEP-02) specifica-.lltpr9yi(j~~
~gi~~g~~i~~~;~~Pi~,~ital header valve fails to open. ~4!'"tt~1
~lm::~~lh*:::.:*:~:*~r~*"J~~
- 1 IBack-I Q= ISRO I B/M/N IU/EIS units ward KIA Only Stem Icuesl T/F Icred*lpartiall Job-I Minutia Focus Dist.
Link y.
1233000 S
1.
Partial: OAOP-38.0, Step 3.2.10 does not identify "preferred" makeup sources in any specific order or hierarchy. This could make other choices potentially argued as correct 2.
LOO=1: Because "0" is the normal method of filling the fuel pool this question will not discriminate.
3.
Q=K/A: May need to pick another Generic item (with Chief Examiner concurrence). Question is testing knowledge of off-normal procedure versus emergency operating procedures. But this is a tough KIA to hit. Discuss wi licensee.
4.
Comments not addressed because only the SO specifies the preferred order whereas AOP-38 does not identify preferred order. Other choices could potentially be argued as correct.
5.
Questio~.r~:Y\\'~r~~9<.~9~~.~~~.i~~.~x.~!~m can be used following a LOOP.
i~i~ml~m:I~':~ai~::~:~t~~:rrQ~
1.
2.
Q# I LOK LOD (F/H)
(1-5) 211~+
2
- 3. Psychometric Flaws x
- 4. Job Content Flaws
- 5. Other x
6.
N 7.
8.
Explanation
- ! IBack-I Q= ISRO I B/M/N IU/EiS Units ward KIA Only Stem,cues, T/F, cred., PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 22 I H I + I x I I
I x I x I I
I I
I x
I I
N I
E 239001 K3.09 2
tJ 1.
Partial: The condenser vacuum value provided in the stem does S
not include the recorder/meter number or whether it's absolute or gauge reading. The set point for low vacuum Gp 1 isolation is 19.92 " Hg (per SD-25, Table 25-5; assuming gauge pressure).
This corresponds to 10 "Hg absolute. If the applicant argues that the value provided in the stem was 8 " Hg absolute, then the MSIVs would still be open at that point and "B", and "0" could be argued as correct.
2.
Stem Focus: 'WOOTF systems is available and allowed for use in accordance with the Level Power Control Procedure to stabilize pressure below 1050 psig?
3.
Partial: Discuss w/ licensee - Does HPCI hard card pressure control guidance include options for defeating LL2 interlocks to allow HPCI to be placed in pressure control? If so, then there are two correct answers.
4.
LOD=1 marked on the original comments provided to licensee because SRVs (choice "B") is always a correct choice. Also, w/
low condenser vacuum, SJAEs and MTBVs are not plausible.
5.
Q=KIA: KIA requires knowledge of capacity (vs availability).
~8::':*. ::6i::Changed question to eliminate SRVs becau~~th~Y.§l.r~~I.~CiY~
correct. Licensee argued that KIA was hit.
I.!¥§~llill~:*:jfi::~~w;~
I:~tr~:~llmm.~
23 I F I 2 I I
I I
I I
I I
I I
I I
B I S I239002K6.03 1.
Identify acronym (SRV) in the stem of the question
- 1 I Back-I Q= I SRO I B/M/N IU/EIS units ward KIA Only Stem ICuesIT/F Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 24 H
2 x
x x
N E
1241000K5.05 S
1.
Cues: The word "inadvertently" is not necessary to answer the question and implies that either "A" or "c" is correct. Suggest rewording as "If the RO sets the Turbine Load Set to 90%
and the Load Limit at 110%, then WOOTF...."
2.
Stem Focus: Define what the phrase "All other turbine controls are normal" means; i.e., The Load Limit Potentiometer is at 110%. This will help with "B" and "0" credibility. Re-word the stem question as follows:
WOOTF predicts how the plant will respond as reactor power is raised?
3.
Does "following a refueling outage" imply meaning that could affect turbine settings? Discuss with licensee 4.
Licensee incorporated comments. Question is similar to RO Question #51(295025) 5.
Q=KlA: Ask licensee to explain how this question meets the KIA.
What is normal 1st stage pressure at 100% turbine load?
6.
Licensee re-worked Question#51 to eliminate similarity.
Licensee stated that turbine inlet pressure is equal to PAM pressure and that PAM pressure is the controlling parameter;
!n~rS~~~~9G~~~.i0~iij.ig~~~~.r~latedto turbine inlet pressure.
l:m:;~Illi"~t~t:::~i::::~~~~*:*:*;~:J~;~:~;~~
- /1 Back-I Q= ISRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F 1 cred'l Partial I Job-I Minutia Focus Oist.
Link Q#
1.
LOK (F/H) 2.
LOO (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 25 H
2 x
x x
N tJ 1256000A3.08 S
1.
Cred Oist: "c" and "0" are not credible because 2A FWH is a low pressure heater.
The HOD is a high pressure tank.
2.
Stem Focus: Change stem question to read: WOOFT choices completes the statement below."
3.
Stem Focus: Modify the fill-in-the-blank statement to identify that FINAL feedwater temperature to the reactor will...
4.
Stem Focus: Include an initial power because this could later be argued as no correct answer.
5.
Job-Link: Verify FW temperature response on the simulator.
6.
Licensee incorporated comments except for #1. Ask licensee to explain the plausibility of "c" and "0" given that the heater is inside the condenser.
7.
Licensee stated that #3 FWH is a low pressure heater that drain~
!C?~~~.9~§l.~r§l!~f.;therefore "c" and "0" are plausible.
~li~iliItJ~~
1:~.:::~~ii*:..!.~9;:7m~
- 1 I 8ack-1 Q= I SRO I 8/M/N IU/EIS units ward KIA Only Stem Icuesl T/F I cred'lpartiall Job-I Minutia Focus Oist.
Link Q#
1.
LOK (F/H) 2.
LOO (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 26
'H 2
x x
8 y.
e S
259002A1.05 1.
Cred Oist: "A" and "8" are not plausible because voiding cannot occur upstream of the SULCV.
2.
Stem Focus: Spell out acronym "SULCV" and include the controller label 10, i.e., SULCV FW-LIC-3269 3.
Stem Focus: Reposition the letter "A" after RFP in the first bullet to signify that the alpha pump is in service 4.
- /units: Include the %
open for both FW-3269 and FW-V177 in the stem initial conditions. Also include reactor pressure. Use final values in the fill-in-the-blank statement to aid applicants in knowing "how far" the item is moved.
5.
Stem Focus: Change the stem question to read: 'WOOTF choices predicts the automatic response of the FW-LIC-3269 and also completes the caution statement in accordance with OGP-02, Approach to Criticality and Pressurization of the Reactor?"
This will help define by what is mean by "downstream."
6.
Stem Focus: Add the word "automatically" to the fill-in-the-blank statement.
7.
Licensee addressed comment #1, #3, and #5.
8.
Stem Focus: Add valve numbers to 4A and 48 inlet isolation valve bullet 9.
Mis-spelled word "automaitic" in stem question.
1O.
Stem Focus: Provide initial % open for FW-V177 in the last bullet.
11.
Job-Link: Will RFP min flow valve be open at 400 psig wi FWV177 throttled open?
12.
Licensee stated that recent mod ensures RFP min flow remains open. Comments incorporated.
~~:I§~~J;~~i:il~:~lIi1J.i~~t~~r~~
- 1 I Back-I Q= I SRO I B/M/N IU/E/S units ward KIA Only Stem Icuesl T/F I cred*1 Partial I Job-I Minutia Focus Dist.
Link Q#
27 1.
LOK (F/H)
H 2.
LOD (1-5) 2 x
- 3. Psychometric Flaws x
x
- 4. Job Content Flaws
- 5. Other 6.
N 7.
y.
S 8.
Explanation 261 OOOA1.02 1.
Cred Dist: "B" is not plausible because drywell pressure will not ever rise as SBGT venting is occurring. "0" is not plausible because if the torus is being vented how could drywell pressure ever lower at a faster rate than torus pressure? Suggest the following:
WOOTF predicts the flow indication on the SBGT "A" and "B" Train Flow Indicators at Panel XU-51 and also identifies how containment pressure will respond?
A.
BOTH Flow Indicators will briefly rise and then lower; Drywell Pressure will lower at the same rate as torus pressure B.
BOTH Flow Indicators will briefly rise and then lower; Drywell Pressure will remain steady C.
ONLY ONE Flow Indicator will briefly rise and then lower; Drywell Pressure will lower at the same rate as torus pressure D.
ONLY ONE Flow Indicator will briefly rise and then lower; Drywell Pressure will remain steady 2.
Job-Link: Discuss the initial conditions [OW press @ 0.8 psig and Torus press @ 1.2 psig] wI the licensee since not sure if this happens during normal plant operation. Does drywell pressure normally creep up before torus pressure? The statement in the stem 3.
Redundant statement in the stem: "Torus venting in service to lower torus pressure." Suggest stating that only the torus is aligned to be vented lAW OP-1 O.
4.
Licensee incorporated comment #1 and #3.
5.
Stem Focus: Discuss adding the word "initially" to the stem question before the last word.
6.
Stem Focus: Add the flow indicator num.bers to the stem (VA-FI-3150-1 and -3151-1).
7.
Mis-spelled word "wil" in "A" and "c" choices.
8.
Subsequent joint review indicated that flow indicators may not rise; question re-worked to ask whether one (or two) trains were aligned to Y~r:'t§lf1d~s>YV~\\.'Yprf3~~~r~ ~ill respond wI torus pressure.
1*~Ii~!E:llfI'~(:~t-\\m!:~;~B~~:;f4§
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOO (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Oist.
Link units ward KIA Only 28 H
3 x
x B
262001 K3.04 S
1.
Cues: The stem defines the meaning of the term "station blackout", i.e., the stem includes statement that LOOP wi loss of OG3 and OG4 and also states that this is station blackout. This could potentially cue a different question in the exam.
2.
Stem Focus: Missing the WOOTF statement preceding the fill-in-the-blank statement.
3.
Capitalize the words Primary Inverter in the fill-in-the-blank statement (both places).
4.
Verify wi licensee the switch alignment on SO-52, Figure 52-7 that will preclude the Standby Inverter from picking up load.
5.
Licensee incorporated comments.
Stem ICuesITIF Ic~ed'l PartialIJ?b-I Minutia I
- ( IBack-I Q= I SRO I B/M/N IU/EIS Focus OIS1.
Link Units ward KIA Only Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 29 H
4 x
x x
N y
1262001A2.03 S
1.
Partial: "B" could also be argued as correct (in appeal space) because the 1B SW Pump will initially trip (Le., RHRSW will temporarily "lose" its suction source if initially operating on the Nuclear Header) and AOP 36.1, Section 3.2.11, Step 2 states "if 4KV busses are not cross-tied and it is desirable to cross tie 480V busses, then obtain permission from SCO and cross-tie E5 and E6."
2.
The first part of each choice is unnecessary because the applicant only has to know the second part to obtain correct answer.
3.
Stem Focus: Use of the term "maximized cooling" may not be specific enough. Are 2 RHR + 2 RHRSW pumps running? If so, then list running pumps.
4.
Stem Focus: Is RHRSW in service from Nuclear Header, I.e., is SW-V102 closed?
5.
Job-Link: With OG2 underclearance, is it operationally valid for HPCI surveillance? Suggest stating that OG2 failed to start following LOOP.
6.
This question may overlap Q#33 (264000K5.06) 7.
~1~~~~~~*****~gg.rl~~~i.g~m.m~g~1j.~i.i~ *****~:~*****~~~:.~fl ***IM***
8~
Partial: "0" can be argued as correct if AOP 36.1 allows cross-tying E5 to E6; Le., the stem doesn't speCifically state that cross tie capability exists at the 4KV level. Oiscuss wi licensee.
9.
Licensee identified typo in "c" and "0" per 10-22-08 telecom; both pumps should be "10" (vs "1 B")
1O.
F028 changed to F024.
Thi~~li~i~~t~9!n~R~8~1~Jl1.<yvith"0" being argued as correct.
~~fi~7J8I~mliil~~::.:::.~..~s~.j:m~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Dist.
Link units ward KIA Only 30 F
2 x
x N
262002K1.02 S
1.
Q=KlA: Sample Plan shows K1.16 whereas this question is K1.02. Were KIA changes approved by Chief Examiner?
2.
Minutia: Discuss "complete loss" with licensee. It appears (SD-32.3, Section 4.3) that these pumps have backup panels available. The question may be targeted to the Vital UPS only (vs the RFP speed control panels). Need to be specific in the stem with respect to alarms received and panels lost.
3.
This question may overlap Q#31 (262002K3.01) 4.
Question mark at the end of the first sentence (statement) is typo.
5.
Licensee incorporated comment #2. Still need to address comment #4.
6.
Comments incorporated.
31 F
2 x
x N
262002K3.01 S
1.
Q=KlA: Sample Plan shows K3.02 whereas this question is K3.01. Were KIA changes approved by Chief Examiner?
2.
Stem Focus: Reword stem statement preceding the fill-in-the-blank statement as follows:
'WOOTF choices completes the following statement regarding how a complete loss of UPS will affect the Digital Feedwater Level Control System Controllers?"
3.
Discuss wi licensee: Does this question overlap Q#30 (262000K1.02) 4.
Question does not overlap with #30.
~~it~~
32 F
2 B
S 263000K2.01
- ! IBack-I Q= ISRO I B/M/N 1U/EIS units ward KIA Only Stem Icuesl T/F I cred'lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 33 -I H
2 x
N E
1264000K5.06 S
1.
Stem Focus: The phrase "as DG3 output breaker closes" may cause confusion to the applicants. Re-word the stem question as follows:
"WOOTF predicts the NSW and CSW pump response when the DG3 output breaker closes to bus E3?"
- 2. Comments incorporated by licensee.
~~I:i~~iill~~!)i~g\\i;~t~ill..:~~m 34 35 36 H
F F
2 2
2 x
x x
N B
N E
1271000K3.01 S
1.
Partial: "c" could also be argued correct because as downstream [H2] rises, AOG System Trip will result when 2%
[H2]; therefore, condenser vacuum would be degraded at that point.
2.
If SJE-V15 is closed, wouldn't there also be other alarms, i.e.,
PREHEATER STEAM SUPPLY VALVE CLOSED,? If there are any additional alarms that come in when valve is manually closed, then include them in the stem.
3.
- 1 units: Include annunciator panel and windo.w #s in parenthesis with alarm title (all caps) 4.
Discuss comment #1 wi licensee to ensure "c" is incorrect.
5.
Licensee clarified that AOG ~YRC:l??Y§lIY~()~~~?8~~il~g];
therefore, "c" was incorrect.
1~:~~~~~fM.:!~::.~lIm.:*:~:~]~~r~~
S 1286000K2.02 E
1290002K6.06 S
1.
Stem Focus: Ensure that the stem question elicits each of the choices, Le., WOOTF describes the reactor vessel design pressure and also identifies whether the Reactor Coolant System (RCS)
Pressure Tech Spec Safety Limit 2.1.2 was exceeded?
A.
Reactor Vessel Design Pressure was NOT exceeded TS 2.1.2 RCS Pressure Safety Limit was exceeded B.
...and so on.
- 2. Comments incorporated.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/EiS Explanation Focus Dist.
Link units ward KIA Only 37 H
2 x
x x
N y
295002AK1.04
1.
Cues: Choices "A" and "B" provide cues to the applicant that S
condenser vacuum is affected by the rising offgas flow presented to the stem.
This is the point of the KIA, Le., to verify applicant's knowledge of the operational. implication of rising offgas flow.
Need to delete the reasons from each of the choices; each choice should only provide an action for the applicant.
2.
Partial: AOP-37.0, Step 3.2.10 and 3.2.11 provide guidance to place one SJAE in full load if a malfunction is suspected. This guidance makes "C" potentially correct; could be argued that way. Suggest adding third bullet to stem with Steam Seal Header Pressure at 3 psig and changing "C" to Throttle open Steam Seal Byp Vlv, MVD-S2 (incorrect) 3.
Stem Focus: Ensure that the stem question asks 'WOOTF is an operational implication of these conditions, including the required operator action?
A.
Turbine Trip and Reactor Scram; reduce power B.
Augmented Offgas (AOG) System Automatic Bypass; start a mechanical vacuum pump C.
Turbine Trip and Reactor Scram: Throttle open Steam Seal Byp Vlv, MVD-S2 D.
AOG System Automatic Bypass; throttle open the SJAE Recirculation Valve, CO-FV-49.
4.
5.
Stem Focus: The question is asking the applicant to predict a potential plant response and the associated operator action which will preclude the plant response from occurring. Consider re-phrasing the stem question. Also add "in accordance with AOP-37' to the stem question.
6.
Add the valve number to choice "C" (MVD-S2); ensure the noun name is as labeled on the control board.
7.
Delete the reactor scram from choices "A" and "C." Applicant should know that will occur as a consequence of a 100 power turbine trip.
8.
Comments incorporated.
- ( IBack-I Q= I SRO I B/M/N IU/EIS units ward KIA Only Stem Icuesl T/F Icred*1 Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5) 3.* Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 38 39 H
F 3
2 x
x x
B N
1295003AK1.03 S
1.
Cue: The correct choice "A" is the only choice that has the word "injecting" in the RHR portion of the statements.
2.
Re-word and stack the choices to be more precise, Le.,
Only one loop of Core Spray is injecting.
Only one loop of RHR is injecting with both pumps in that loop running
- 3. Comments incorporated.
y 1295004 AK1.02 S
1.
Q=KlA:* The operational implication of a redundant DC power
~upply following a partial or complete loss of DC is that 1) either the load never loses power or 2) the operator can manually swap the power supply. Since Distribution Panel 12A has no redundancy capability, the question isn't hitting the KIA.
Suggest writing a 2-part question for one of the panels in AOP-39 wrt to how a loss of a DC panel affects control room indications and also which panel is the backup power supply. (Ensure. no overlap wi previous questions related to HPCI/RCIC DC logic.)
2.
The two sentences in the stem are somewhat redundant. Does it matter that Unit 2 is at rated power?
3.
Question changed to ask about loss of 24VDC power supply in RPS cab A1. Applicant needs to know difference between energize.t~>~?tY~~~.*.~~~8~)~rE~g~~~-energize to actuate (RPS).
l~i~mll~;::I:~::i~!!:.::<:~:~r~~m~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOO (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 40 F
2 x
N E
295005 AK3.07 S
1.
SO-26, Page 30 of 126 only states "There are certain times during the operation of the turbine (e.g., unit startup or turbine trip) when it is necessary to pass steam directly from the reactor to the condenser without going through the t.urbine." <- - This is the only "reason" that I could find in the SO. Provide reference that states reason for bypass valve operation following a turbine trip.
2.
Change the word "state" to "identifies" in the stem.
3.
Is the reason different for Unit 1 versus Unit 2?
4.
Comments incorporated.
41 F
2 x
N E
295006 G2.2.3 S
1.
Suggest rewording the stem question as follows:
'WOOTF immediate operator actions has a different setpoint for unit 1 and unit 2 in accordance with the Reactor Scram Procedure "hard card?"
- 2. Comment not necessary. Raised concern during final review that "A" did not have a "setpoint" associated with it. (tripping the main turbine). Licensee stated that associated wI tripping the turbine was MW(e) 42 H
2 x
x N
E 295008 AK2.03 S
1.
- /units:.Use illuminated and extinguished versus "out" and "lit".
Also use the exact label name for these lights on the control board 2.
Stem Focus: Consider using fill-in-the-blank versus statement.
3.
Comment#1 incorporated.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 43 H
2 x
x x
B Y
295009 AK2.01 S
1.
Cred Dist: "0" is not credible because it does not provide an answer with an RTGB level instrument that is available (like the other choices and like the stem asks for)*
2.
Stem Focus: Suggest re-wording stem to ask more specifically, WOOTF level indicators would show RPV level at the point where RWCU isolates on low level?
3.
- /units: Use level indicator numbers along with the noun names.
Fuel Zone is B21-LI-R61 0; Wide Range is B21-LI-R604A/B 4.
Comments incorporated.
44 F
2 x
x B
tJ.
295010 AK1.03 S
1.
Cred Dist: Choices "c" and "0" each have 3 items; therefore the applicant only needs to know one of them to pick or eliminate the choice. Remove the thermal time constant piece in these choices.
2.
Stem Focus: Re-word the question as follows:
Unit Two was operating at 100
% power when a steam line break inside containment occurred causing drywell pressure to rise.
WOOTF identifies the difference between the normal temperature of compensated and uncompensated level instrument legs and alsp identifies the level instruments that will first be affected as drywell temperature rises due to the steam leak?
A.
Compensated legs are normally at a higher temperature than uncompensated legs; Compensated legs will boil first B.
Uncompensated legs are normally at a higher temperature than uncompensated legs; Uncompensated legs will boil first C.
Compensated and uncompensated instrument,legs are normally at the same temperature; Compensated legs will boil first D.
Compensated and uncompensated instrument legs are normally at the same temperature; Uncompensated legs will boil first 3.
Comments incorporated.
- (
I Back-I Q= I SRO I B/M/N IU/E/S Units ward KIA Only Stem Icuesl T/F I cred*lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 2.
3.
45 46 F
H 2
x x
x B
B y
1295015 AA2.02 S
1.
Job Link: Discussed wI licensee via telecom on 10-22-08:
Licensee stated that the RWM Shutdown Confirmation is no longer available; therefore question had to be re-worked.
Licensee also suggested revised question where the applicant would have to choose one condition that represented a reactor shutdown under all conditions without boron. Explained that Q=K/A was to interpret control rod position (first) 2.
Question reworked to ask how the RWM screen will display following a turbine trip and scram when 1 rod remains withdrawn
..9-fJ<:t.. ClI.~9.'.tVh.~!.her the reactor will remain shutdown.
~,l4Ji~m::J~rM li.::..i~I:.i*j:.~g!~l:~~
1295016 AA1.08 S
1.
Stem Focus: Re word the stem as follows:
While reducing reactor pressure at the RSDP to place shutdown cooling in service in accordance with AOP-32 (title), the following pressure readings were....
Based on the information provided, WOOTF choices completes the following statement?
The cooldown rate specified in AOP-32....
LOD=1 if AOP 32 is provided as a reference to the applicants.
Discuss wI licensee to ensure that only steam tables provided (versus AOP 32)
Licensee agrees that OnIY~~f~~j ~~~I~;~.liJI~~!trs~i~f~*
Comments incorporated.
~;~i~iHU§~~1~}~i0Jj::~;~:g5t;~~
- / IBack-I Q= I SRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F Icred'l Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 47 48 F
F 2
+
2 x
x x
B N
E 1295018 AK1.01 S
1.
Stem Focus: Questions asks how a loss of cooling affects MG sets. Does MG Set Oil'Cooler 2A Outlet Valve (TCC-V122) fail closed? If so, state in the stem.
2.
Stem Focus: Is the first sentence necessary? Second sentence says all that is needed?
3.
Add"...in the fluid drive" to the last statement in the stem.
4.
For "A" and "c" also state: The drive motor breaker will remain closed at this temperature.
5.
TCC-V122 was a manual valve. Changed valve number fr~~y~g?t8IY-~OZ~~r.irlJJon-site operating test week.
1~;i~WjI.~rN.:;I~*:.~~iJ0:,,~;~:rrOOR~~
y 1295019AK3.01 S
1.
LOD= 1 and/or Q=KIA: Test item asks for loads on Backup N2 system versus asking for knowledge of the reason for having a N2 backup. Suggest the following:
WOOTF identifies the signals that will initiate the Backup N2 system, including the reason for the backup nitrogen system?
a.
Low Reactor Bldg Instrument Air Header Pressure OR Core Spray LOCA signal; Ensures operability of ADS valves and Inboard MSIVs b.
ONLY Core Spray LOCA signal; Ensures operability of ADS valves and Inboard MSIVs c.
Low Reactor Bldg Instrument Air Header Pressure OR Core Spray LOCA signal; Ensures operability of ADS valves and hardened wet well vent valves d.
ONLY Core Spray LOCA signal; ensures operability of ADS valves and hardened wet well vent valves 2.
Cred Dist: With 3 items in each choice, the applicant only needs to know one of them to pick or eliminate the choice.
3.
Comments incorporated.
i~~.~~~1JI2!~~~I,~~-ji~~~aJ*****~i~r'~li'rr~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 49 H
4 x
x N
tJ 295021 AA2.05 S
1.
Partial and/or No Correct Answer: AOP-15 directs the operator to monitor reactor COOLANT temp lAW PT-1.7. AOP-15 does not require the operator to monitor vessel METAL temp.
Furthermore, AOP-15 caution states that if coolant temp was initially < 212 deg, then PRESSURE must be monitored because loop suction temps and bottom head temps can NOT be used for coolant temp monitoring. Since the stem specifies that COOLANT temp is 190 deg wi natural circulation in progress, then this AOP-15 caution applies, Le. reactor pressure is the correct way to monitor coolant temp. (choice not listed) 2.
Stem Focus: What was the peak temp when SDC'g was lost?
Applicant m.ay argue several choices if he/she contends that a heatup was initially in progress when shutdown cooling was lost, Le., vessel metal temp monitoring allowances depend on whether a heatup or cooldown is in progress. (See PT-1.7, P&L 3.4) Re-word stem question to eliminate this potential:
Given this cooldown in progress, WOOTF identifies the PREFERRED indication to use for vessel bottom head temp in accordance with PT 1.7, including the reason?
A.
Bottom Head Metal Temp; metal temp response leads the coolant temp response during a cooldown B.
Bottom Head Metal Temp; coolant temp response leads metal temp response during a cooldown C.
Bottom Drain Coolant Temp; coolant temp response leads metal temp response during a cooldown D.
Bottom Drain Coolant Temp; metal temp response leads the coolant temp response during a cooldown 3.
Stem focus: Add (Tsat) after 190 degrees in the last bullet to ensure that applicant does not confuse metal temp with coolant temp 4.
Stem focus: Stem states that "feed and'bleed" has been established. AOP-15 provides a list of four "feed" systems and two "bleed systems." Need to clarify stem bullet that feed and bleed was established lAW AOP-15.
5.
Licensee re-worked question to ask for method to determine vessel metal temp following a loss of SDC'g, includi.~.£.Jthe ba.sis for using the method. All comments incorporated.
i.~I~1'JJI,~~
'.~.,:,~Il*****~.~g;~~~~
- ( IBack-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem Icuesl T/F Icred*lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 50 51 F
H 2
2 x
x x
x N
N lj 1295024 EK1.01 S
1.Cred Dist: "A" and "B" are not credible because the values are too low. Suggest using values in "c" and "0" and iterating with an additional knowledge related to what procedure(s) are used to vent, etc.
- 2. Licensee eliminated "A" and "B" choices and iterated using 62 psig and 70 with how PCCP allowed venting to proceed.~~ji~~J,~~
1295025 EK2.08 S
1.
Job-Link: Normally Max Combined Flow and Load Limit are set at 110%
- Is the premise of the question that these two are initially set incorrectly with the plant at 100 power? Why would an operator be adjusting the MCFL at 100 power? Is there procedural guidance for this activity?
2.
Stem Focus: Where is Load Set currently set at?
3.
Cue: Is it necessary to state that Pressure Regulator "B" is in "standby (3 pisg bias)?"
4.
Q=KlA: Relationship between A-5, 3-5 High Reactor Pressure alarm (comes in at 1050 psig) and EHC Pressure set is (usually at 928 psig) is that as power ascension is in progress, alarm will come in if pressure set is mis-adjusted during the startup?
5.
Question is similar to RO Question #24 (241000K5.05) 6.
Licensee re-worked question to avoid an operator incorrectly adjusting MCFL. Question now asks how press responds when one regulator is oos and the other fails and also asks how the bypass valves can be used (via the jack). Licensee argued to provide EHC l()gic9i<:lQre~<:l~(lr~!~E~n9~\\'II1 Chief Examiner concurrence.
~!4Ji~lliYJ.~~I~;~~m*;~:~t@~:tt~~
- ! IBack-I Q= I SRO I B/M/N IU/EiS Units ward KIA Only Stem Icuesl T/F Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 52 53 H
F 2
x x
x x
x B
N E
1295026 EA1.01 S
1.
Partial/Stem Focus: Because of the stem question wording, an applicant could potentially argue that "c" is also correct because stem question does not illicit a required "sequence."
2.
Job-Link: The switch names must be as labeled on the actual control board to eliminate confusion and potential multiple correct answers, Le.,
Containment Spray Valve Control "Think" Switch (S17) 2/3 Core Height LPCllnitiation Override Keylock Switch (S18)
RHRSW Booster Pump LOCA Override Switch (S19) 3.
Each choice has RHRSW Booster Pump LOCA Override Switch.
The sequence is not critical for this switch and because it is included in all four choices, it is possibly irrelevant.
4.
.~i9~r1~e~ E~:~9rkE39.9~~~t.i()r1to incorporate all comments.
~~iiilill.Sl:~*.*l.i~.:i.~ill,*.~...m:z~~J%~~
y.
1295027 EK2.04 S
1.
LOD=1 and/or Cred Dist: "B", "C", and "D" are not plausible because the color "RED" is always used to indicate a higher severity; therefore if Yellow was potentially correct, then applicant would choose Red because there can be only one correct answer in a multiple choice question format.
2.
Partial: The stem question asks for a color which indicates that PCCP "would need to be entered." The applicant could argue that "c" is also correct. Use word "required to be entered."
3.
Job-Link: What is the exact name of the SPDS display for Suppression Pool Temperature? Are there several screens that could potentially fit this description? Provide exact name of screen in the question.
4.
Licensee eliminated non-plausible distractors and re-worked question to ask for the temp when ERFIS first turns RED and
~1~g!~~PE~~~dure that's required to be entered.
~~~.~~~IJ!'~~!:i.l~
~~rn;:lrmr~~:,~§
- ( IBack-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem Icuesl T/F I cred'l Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 54 55 F
F 2
2 x
x x
N N
lj 1295028 EK1.02 S
1.
Cred Dist: "A", "C", and "0" are not plausible because the second half of "B" (EQ qualification) is "all-encompassing", i.e.,
can never be wrong. Additionally, "A" is not plausible because the MSIV springs are never affected by drywell temperature. "0" isn't plausible because the H202 analyzers are located outside the drywell and isolate on a group isolation signal, i.e., require specific overrides to place in service following a LOCA.
Ask the applicant whether 340 deg affects drywell structure or SRV solenoids. Suggest re-working question to ask for basis of PCCP DWfT Step 19 (Can drywell average air temp be restored and maintained below 300 deg?) Iterate on basis is that once you go above you don't have to ED.
2.
Stem Focus: Re-word stem to include "in accordance with 001-37.8, Primary Containment Control Procedure Basis Document."
3.
Licensee re-worked question tOf?lirlli~§lt~)b~ ?~(?<:>~~.p'~~<?f~ach choice (i.e., the "reason" part).
~~I~ml:~~:~~:.i§~w;::;:~*j~Jg1~:%~fi lj 1295030 G2.1.7 S
1.
Q=KlA: Question requires applicant to know the PCCP procedure requirement for inserting a manual scram. This does not require applicant to perform an instrument interpretation or evaluation based on the behavior of the reactor or other operating characteristic.
Suggest asking applicant to evaluate NPSH, HCTL, or Vortex limit/graph and then make a call whether or not to ED, anticipate ED, or stop pump, etc.
2.
Licensee re-worked question to include an evaluation of whether to anti~ipat~~~~~~~in(~0rj<~~ti<:>nwith knowledge of low torus level.
ISI~~mMl:~~::::I:~;:;i~j::;:~:::~:[~~:7:~fl
I Back-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem Icuesl T/F Icred'lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 56 F
2 x
Last NRC 2008 exam B
1295031 EK3.04 S
1.
Stem Focus: The stem question asks for the reason that the Steam Cooling Procedure is performed. Based on on 001-37.7, the reason for steam cooling is to delay ED because a blowdown would deplete the remaining inventory of water in the reactor when no injection source is available.
Suggest asking for 1) reason for steam cooling and 2) how long should remain in steam cooling as follows:
a.
Delay ED when no injection source is available because a blowdown would deplete the remaining inventory of water in the reactor; ED is delayed until peak clad temperatures could potentially exceed 1500 deg b.
Delay ED when no injection source is available because a blowdown would deplete the remaining inventory of water in the reactor; ED is delayed until peak clad ternperatures could potentially exceed 1800 deg c.
Delay ED when level indication is not available because a blowdown would deplete any remaining inventory of water in the reactor; ED is delayed until peak clad temperatures could potentially exceed 1500 psig d.
Delay ED when level indication is not available because a blowdown would deplete any remaining inventory of water in the reactor; ED is delayed until peak clad ternperatures could potentially exceed 1800 psig 2.
This will ensure that exact repeat of 2008 NRC exam item does not occur, i.e., will be modified.
3.
Add, "in accordance with 001-37.6" to stem question.
4.
Licensee argued that this question was SAT for the previous exam; therefore it should be SAT this time also. Chief Examiner concurred and formatted the question as a fill-in-the-blank.
~1f:§~[J,~r-I;;I\\~':~~m\\\\;~\\~t~~t~~
I Back-I Q= I SRO I B/M/N IU/EiS Units ward KIA Only Stem Icuesl T/F I cred*lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 57 58 F
H 2
2 x
x x
x x
B N
y 1295032 EK3.01 S
1.
Partial/Stem Focus: Why is "0" incorrect? Is the question asking for how ED mitigates high temperature in the Rx Bldg? Is the question asking for why high ternperature in the Rx Bldg is problem? (two different answers) 2.
Cred Dist "B" is not plausible because the second part is not specific enough, Le., "may" cause fuel failure" is not credible.
3.
Suggest writing question where temperatures and rad levels are provided in the stem and applicant is provided with Table references and has to determine the reason why ED is required.
Alternative is to ask applicant when anticipation of ED is required as opposed to ED following 2 areas above max safe or approaching max safe.
4.
Include "in accordance with 001-37.9" in the stem question.
5.
Licensee changed "0" and "B" and boiled down all choices to the exact "reason"!<?r.~9.i~~92()nt~~~. ~lIgomments incorporated.
~~I~.jf.)I:~m.t'~u~~GI0*:~..~~i~j*mQ~
1295034 EA1.03 S
1.
Stem Focus: Re-word the stem question as follows: 'WOOTF subsequent conditions would cause the Reactor Building Supply and Exhaust Isolation Dampers to re-close?
2.
Use all caps for alarm windows.
3.
NOTE: This question is a replacement from the initial submittal.
NRC didn't comment on the initial submittal item; however, this item replaced..why?
4.
Licensee explained that question was changed out to avoid gyerl~p~i!~?~g!~~~.~~~!.i~~:[ll. All comments incorporated.
1~~~illIfJ~:~:*':~.:*~~":R*~:.~%~*~t~~
8.
Explanation 295037 EA2.03 1.
Q=KlA: Question is asking how SLC tank level can be determined following a loss of pneumatic pressure. (these type KlAs are included in-System 211000 SLC) The required KIA is asking for the applicant to determine or interpret tank level as it applies to power being above 5%
ATWS, i.e., hot shutdown vs cold shutdown boron weight as SLC tank level applies. None of the information in the stem related to an ATWS or both SLC pumps started is needed to answer the question.
2.
This question was used to replac~Q~~:kig~Q;~~{g~~~I<?p~9?l n~yyguestion to target this KIA.
~~~~~!I~mlJ~~J~:~
~**~**~.(J)~
1.
I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LaD Stem Cues T/F I cred., Partial I JOb-I Minutia I
- 1 IBaCk-I Q= ISRO I B/M/N IU/E/S (F/H)
(1-5)
Focus Dist.
Link units ward KIA Only,
59 I
~ I 2
I I
I I
I I
I I
I I
x I ~
H N
S 60 H
2 x
B y.
1295038 EK3.02 S
1.
Cred Dist: "B" is not credible because the fifth item in the stem states that all temperatures are less than 140 degrees, Le. this condition also includes the time when temperatures are all normal, e.g., 85 degrees; therefore, HPCI would not be isolated.
on high area temp. "C" is not credible because leaving HPCI running is not an effective method to reduce the amount of steam blowing into the reactor building, Le., may actually be worse depending on where the steam leak is.
2.
Suggest asking question related to why RRCP Steps RR-16 and RR-18 are performed in accordance with 001-37.10.
(Unmonitored ground release or release via TB HVAC if operating in once thru mode and RW HVAC discharges through the main stack past rad monitor). The systems isolations portion of the KIA statement could be met by these actions effectively isolating a potential ground level release path.
3.
Licensee room tem ps were 140 degrees.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
SRO 8/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 61 H
2 x
x 8
.y 300000 G2.1.20 S
1.
Partial: Applicant could potentially argue anyone of the answers as correct since the location whether the 100 psig condition exists isn't defined, i.e., if the Instrument Air Header pressure in the turbine building is indicating 100 psig, the applicant could reasonably argue that the pressure "as sensed" in the reactor building may perhaps be lower.
2.
Q=KlA: Question is asking for automatic actions that occur at 100 psig as opposed to asking the applicant for required procedure steps that the operator is required to perform.
3.
Licensee re-worked question to ask for a required operator (verifiable) action lAW AOP-20. Also, licensee added two new annunciators to the stem and stated these weren't in the alarm to avoid on partially correct answer.
62 F
2 x
x x
N
400000 K1.03 S
1.
- /units: Include the rad monitor numerical designator in the stem. (D12-RM-K606) 2.
Stem Focus: Recommend using the words "WOOTF identifies the exact location in the system where the..." to avoid confusion between the sample sink vs sample tap in the piping.
3.
Stem Focus: Is the alarm a "protective function?" If not, then re-word the stem to ask for the automatic actions that occur when the rad monitor exceeds its setpoint.
4.
Partial: SD-21 (page 6 of 42) states that this process rad monitor is located on the pump suction header. 8e more precise in "A".
and "8" by either matching the SO description and/or including the elevation. The "return header" can be virtually anywhere.
5.
Licensee changed R8CCW head tank to upstream of OW Clg.
Hdr Isol Vlv. Also incorporated all other comments.
6.
During operating exam week, licensee Ig C
request) the word "monitor" to "detector."
~~t'hli()81
- /
I Back-I Q= ISRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F I cred*lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 63 F
2 x
x N
y 1600000 AA1.01 S
1.
Ask licensee to document the reference material section of the question, (left blank).
2.
Partial and/or Cred Dist: "B" is not credible because the other three distractors are *all features of the SCBA (Le., bypass valve, alarm, etc.) whereas this choice (leakage past the face seals) is a symptom. "B" can potentially be argued as correct since if the bottle was low on air and the user continued to breathe, air leakage past the seals would occur. The word "out" is ambiguous, i.e., "out past the seals."
3.
If unable to write a discriminating question for this KIA, Chief Examiner can select alternate Ability statement.
4.
Licensee wanted to keep KIA and changed 'B" to air regulator bypass valve fails closed. Licensee provided ref~~~D.9E?rl'l§lt~Ei§l1
!Qr th.~~§g~~ via the manufacturer's web page.
~~:§I1KI.~~*..11
~Im:**:~j:.:~if%b~
- ( IBack-I Q= I SRO I B/M/N IU/EiS Units ward KIA Only Stem ICuesIT/F Icred'l PartialIJob-I Minutia Focus Dist.
Link tJ 1700000 AK1.03 S
1.
Job-Link: The annunciator listed in the stem triggers a main generator primary lockout. [See UA-13, 3-1, and 1-1] The premise of the question (Le., operating the generator without a field) can never occur given this primary generator lockout feature and the question could be potentially argued as not operationally valid, Le., would require deletion from the exam. If the premise of the question is to test the purpose of the generator primary lockout following a loss of excitation, Le., to prevent excessive heating of the rotor, then the Q does not equal KIA 2.
Q=KlA: The question asks for the operational implication of operating a generator without a field. The KIA requires asking the operational implication(s) of operating the generator in an under-excited condition. Suggest a replacement question that requires knowledge of the mitigation strategies/limitations imposed by AOP-22 and/or 001-1.08 during a grid instability condition that necessitates operating the generator in an under-frequency condition.
3.
LOD=1: This question targets a generic fundamentals knowledge item vs a plant specific knowledge item.
4.
Stem Focus: : Why is the first sentence (including the alarm) necessary to answer this question?
5.
Licensee re-worked question to ask what procedural action was required to cope with 0 MVAR condition lAW OP-27;Le., raise
~~~~ygl.t~fJ~r~r~lr~?r~r~~~ove a capacitor bank from service.
Imfiiwl~~;J~:::~~mL~::£l-t~";t~a
- 1. I 2.
Q#I LOK LOD (F/H)
(1-5) 64 1
F H
- 3. Psychometric Flaws x
- 4. Job Content Flaws
- 5. Other
'x 6.
N 7.
8.
Explanation 65 H
2 x
N
1700000 AA2.04 S
1.
Cred Dist: How is "A" ever plausible?
2.
Verify w/ licensee that only Unit 2 OP Figure 1 (only) will be provided to applicants versus Unit 1 OP 3.
Provide directions for how to read the spider graph in the reference section of the test item sheet.
4.
Licensee re-worked "A" to be plausible by changing to "raise gas pressure or lower MWe.".2nl¥spi~~~~r~p~p~fJ;<~il! be provided to applicants.
Fl.S!g~mf.I~::!:~~~im::~*.~jg~.::,~~
8.
Explanation G2.1.1 1.
Stem Focus: NUREG 1021, Appendix B, Section C.2.e recommends avoiding the use of "not" questions unless it is unavoidable. For this KIA, a suitable question can be developed by the region if the licensee requests.
2.
Stem Focus: cite the specific procedure, i.e., in accordance with 001-1.02, title. [Vs "in accordance with the conduct of operations manual.]
3.
Partial/No Correct Answer: "C" could fall into the sub-category of "A", i.e., steps in the AOP could be performed using two hands if the Unit SCO directs. In this case, there is potentially no correct answer.
4.
Licensee re-worked question using Chief Examiner suggestion to include two activities in each choice for when two-handed ops were allowed. Changed the w~E9:"~prr~~~~"~()"~!18~~g".during on-site operating exam week.
1~.I~mI8lr:N:::i~~.::.i~fI]ii:i:~.::j~:tW4~~
- 1. I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LOD (F/H)
(1-5) 66 I F I 2 I x I I
I I
x I I
I I
I I
67 F
2 x
N tJ IG2.1.17 S
1.
Partial: "A" can be argued as porrect because OAP-50 does not specifically prohibit the sender from identifying him/herself during face-to-face communications. [AP-050 requires that the receiver be identified by the sender, which "A" accomplishes this.] "0" can be argued as correct because OAP-50 only provides examples and does not specifically require "first-name-first" but only requires that the receiver be identified.
Suggest replacing with an AP-50 topic such as where radio and/or cell phone use is or is not allowed. (or similar) 2.
Licensee developed new test question using Chief Examiner suggestion to include two activities in each choice for when a PA ii.~i~ement was required lAW OAP-50. ~_tllltI1111
- 1. I 2. I
- 3. Psychometric Flaws I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LOD (F/H)
(1-5) IStem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO IB/M/N IU/E/S Focus Dist.
Link units ward KIA Only 68 I F I 2 I x
x x
I B I
S 8.
Explanation G2.1.19 1.
Partial: "B" can be argued as correct because 001-72,, Monitor Display Colors, states that cyan represents a static color for general usage on specific plant displays 2.
Stem Focus: include "in accordance with (title)" in the stem question.
3.
- /units: Use the actual screen name/number as depicted on the process computer, Le., "Display 820 Powerplex Heat Balance/Core Monitor Results" 4.
Replace the word "Safe" in "B" with "good" 5.
Licensee explained that 001-72, Att 5 was a monitor use color.
Licensee explained that question was asking for a value color.
Change~.'.'~"}?,,,~~eir~~"~~ff/~~g~?~e this was mentioned in 001-72.
~~:i~ilr4.lm:::.:II:::;~I$::~:~;~j:.;¥.l§
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Dist.
Link*
units ward KIA Only 69 H
3 x
x x
N tJ G2.4.9 S
1.
Partial:."A" can be argued as correct if applicant thinks that the reactor can't be shutdown before torus temperature reaches 110 degrees.
Stem indicates torus temperature is rising. The words "very slow rise" may not be sufficient to preclude "A" from being correct.
2.
Q=KIA: placing mode switch to SID, initiating ARI, and LEP-02 are the same actions for both high and low power mitigation strategies. [KIA requires knowledge of how a low power or shutdown scenario would affect an EOP/AOP mitigation strategy.]
Suggest that question be re-worked to ask applicant whether recirc pumps are required to be tripped (or not required to be tripped) and what level band is allowed when APRM downscales are illuminated.
[As an alternative for the second part, could ask the basis for leaving the Recirc pumps running during low power ATWS in accordance with Ol-??]
3.
Stem Focus: Instead of saying APRM downscales, say "APRM downscale lights are illuminated."
4.
Stem Focus: Why is the LOCA necessary in the stem? Discuss wi the licensee.
5.
Stem Focus: Stem question includes the word "should." Use the word "required."
6.
All comments incorporated.
- ( IBack-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem ICuesITIF Icred'l PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 70 71 F
F
.:1-2 x
x x
x 8
N N
y IG2.4.45 S
1.
LOD=1: Without having any plant knowledge, one can eliminate conductivity because rad always takes priority, thus the question provides no real discriminatory value.
2.
Cred Dist: "B" is not plausible because conductivity is never a sole indicator that there is fuel failure.
3.
Partial: "c" can potentially be argued as correct because high conductivity water is a priority because it could lead to significant fuel failure. The magnitude of the rad monitor reading is not specified in the question.
4.
Stem Focus: Which procedure states that Service Water Effluent Rad High is a higher priority than RHR Hx Outlet Conductivity?
Add procedure to stem question..."in accordance with..."
5.~.i~~~~~i~d.~~~lg~~~Cln~~:uestion to target KIA.
~~§I8JiIS;U't:J:I:.:i~*:.<:~:~rg:~::;~~
y IG2.2.4 S
1.
Cred Dist: "c" and "0" are not plausible because the number "seven" is not the number of bypass valves on either unit; Le., the number of SRVs and ADS valves is not a plausible distractor.
2.
LOD=1: This question does not provide discriminatory value.
Discuss wi licensee.
3.
- ~i~~~~ee developed new question.
ft.I§?:!ff:i:~~~.i~?;!mi~~.::J.~I.~~~ill*****~*.~~m g.~.r~~
- 1 IBack-I Q= ISRO I B/M/N IU/EIS units ward KIA Only Stem ICuesITIF Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 72 73 F
F H
a 3
x x
x x
x N
N B
lj IG2.2.12 S
1.
Cred Dist: "A" is not plausible because it is the same value as the surveillance frequency provided in the stem. "B" and "0" are not plausible because there is no basis for using 100/0 and 50%,
respectively.
2.
LOD = 5: Discuss wi licensee. Are ROs expected to know the TS motherhood statements?
3.
Add "in accordance with SR 3.0.2" to the stem fill-in-the-blank statement.
4.
Partial: The applicant could potentially argue that there is no correct answer because the word "monthly" is not defined in TS Section 1.0 (Definitions). The term "monthly" is defined in the In-Service Testing Program TS Section 5.5.6; however, not all tech spec components fall within the scope of the 1ST Program.
Suggest providing the surveillance frequency in the stem, Le., 31 day surveillance frequency 5.
Licensee changed the word "monthly" to specifically "31 days."
Licensee Operations Management approved this question as RO knowledge. Changed distractors to be more plausible.
1~Ii~ml~~~.:I~i;:iliii.~:imr~~:it~~
lj IG2.2.18 S
1.
Q=KlA: The question targets 001-01.02, Section 5.16, Operations Control of Maintenance, and is applicable for all modes of plant operation. The KIA requires knowledge of managing.maintenance activities during shutdown operations.
2.
Stem Focus: NUREG 1021, Appendix B, Section C.2.e recommends avoiding the use of "not" questions unless it is unavoidable. For this KIA, a suitable question can be developed by the region if the licensee requests.
3.
LOD=1: This question will not provide any discriminatory value.
4.
Licensee could not write a discriminating question for this KIA.
Chief Examiner randomly selected G2.2.42. Licensee developed new question (which would require distributing a reference to applicants) arl9.~~er.ni~~E~~~yi~~~99~rin~8~:site operating exam week.
f:}l.*:~:~i~m;I.~rI:.Ji:i"m:i~":~il~~~
- (
I Back-I Q= I SRO I B/M/N IU/E/S units ward KIA Only Stem ICuesITIF Icred'l PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 74 H
2 x
B y IG2.3.12 S
1.
Q=KIA: The question targets OPS-NGGC-1303, Section 9.5, Exceptions to Independent Verification, in a locked high rad area.
The KIA requires applicant knowledge related to radiological safety principles for either a locked high rad area, containment entry, fuel handling, aligning filters, etc. The waiver for dose during IV activities is not limited to locked high rad areas; therefore, this question does not appropriately test the applicants knowledge related to a locked high rad area. Discuss wI licensee.
2.
Licensee argued that question does hit KIA and examiners agreed based on the "etc." in the KIA statement. Licensee re-
~8~~~9.!b.~.~i.~tr§lctors to make all more plausible.
I~;liim~~~
- 1~
- ::;:~II:;::I:~Q.~;::i~~
75 F
x B
y S
1.
Similar to RO Question #57 (295032 EK3.01); but this question deals with rad (versus temperature).
2.
Q=KlA: Question (as written) targets the basis for the term "maximum safe radiation levels" as used in the SCCP. The KIA requires applicant's knowledge of specific radiation or contamination hazards that may arise during plant operation (normal, abnormal, or emergency conditions), e.g., transferring the BWRT contents causes the rad levels to rise on the 50' elevation; AOP-5 information, etc.
3.
Licensee developed a new question to target this KIA which required applicants to know radiation<?()J1~it~<:>D~",,~i<?h.V'J2~1~
~~9~iE~~P notification lAW OP-14.
~.iW..:;~g.i~II.lfM:.::;I~:..::~t=1*
- j*~rg*~..r~~
- /
I Back-I Q= I SRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F I cred*lpartiall Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 76 77 F
H 2
2 x
x N
N y
1201002A2.02 S
1.
SRO-only: No selection of procedures involved. RO knowledge of immediate manual scram requirements (Choices "A" and "C")
and overall mitigative strategy for multiple rods drifting in; knowledge not unique to the SRO position. Suggest making question involve TS 3.1.3 bases knowledge for operable/inoperable control rods to make question SRO only.
2.
Question revised to eliminate RO knowledge associated with multiple rods drifting in by only having one rod drift in and asking how this affected the RMCS. SRO knowledge incorporated for procedure selection by asking which procedure contained specific guidance for lowering core flow.
3.
y 1203000A2.01 S
1.
SRO-only: No selection of procedures involved. RO knowledge of inadequate NPSH and annunciator procedure guidance for whether pump should continue to be operated for adequate core cooling. Suggestion is to present the SRO with choices of EOP contingencies, SEPs, and/or LEPs that either 1) mitigate the clogging symptoms or 2) further ensure adequate core cooling.
2.
Include alarm panel and window in parenthesis for RHR PUMP 2A OVERLOAD (A-1, 4-8) in the stem of question.
3.
Stem question should be re-worded to ask "which one of the following is a possible cause for these RHR pump indications and the required action in accordance with the annunciator procedure A-1, 4-8.
4.
Licensee provided question rework that asked for consequence of operating outside NPSH limit and whether or not demin water injection could be used to augment vessel level (not available due to LOOP). This is still RO.knowledge 10-20-08 5.
This question may overlap RO Question #7 (209001 G2.2.37) 6.
Licensee re-worked the question to ask for consequence of operating at the NPSH limit and also which procedure was requir~gtg~~!P!eip"~cj~~~~~~ggrecooling" as defined in 01-37.4.
~!HI~lllt:Y;I~*~:~I:::~.~i"~~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 78 H
2 x
x B
y 209001 G2.2.22 S
1.
Partial: "B" can be argued as correct because it would never be wrong to contact engineering to evaluate.
2.
Cred Dist "0" is not plausible because the "B" room cooler is in an entirely different room than the "A" loop being tested.
3.
Suggest modifying question such that Unit 2 is in either Mode 1,2,3 or in Mode 4:
'WOOTF identifies whether the breaker should be reset and the affect of the room cooler on Core Spray operability in accordance with 0-01-08, Control of Equipment and Equipment Status?"
A. The breaker is allowed to be reset once; The room cooler is NOT required for Core Spray operability B. The breaker is allowed to be reset once; The room cooler IS required for Core Spray operability; C. The breaker is NOT allowed to be reset; The room cooler is NOT required for Core Spray operability D. The breaker is NOT allowed to be reset; The room cooler IS required for Core Spray operability;
- 4. Licensee incorporated comments. Since the details of whether the room cooler is (or is not in Mode 4,5) required for operability in Mode 1 is found in the BASES, this meets the SRO level.
5.
Stem Icuesl T/F I cred'l PartialIJOb-I Minutia I #/
I Back-I Q= ISRO I B/M/N IU/EiS Focus Dist.. Link units ward KIA Only Q#
1.
LOK (F/H)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 79 H
3 x
x N
y.
1212000A2.15 S
1.
Discuss with licensee. No correct answer possible because at 23%
power the control valve RPS trip signal (as well as the Stop Valve trip signal) is bypassed. [See SO-03, Section 3.1.3, pg 22]
2.
SRO-Only/Cues: Stem states "grid stabilities" therefore, the SRO applicant is not required to diagnose or prescribe procedures. Placing Auto Recloser to OFF position can be deduced using RO knowledge since only one incoming line is left from grid instability. Suggest providing control room indications (Le., alarms) and have SRO choose between two competing AOPs such as AOP 36.1, AOP 36.2, and/or AOP 22.
3.
Typo in "c" and "0" with PCB's (apostrophe "s")
4.
Licensee re-worked question to ask for the initiating device that causes an RPS trip following a load reject signal and also the procedure that directs tripping the last remaining offsite power feeder source.
5.
Need to verify that stem is clear that the Whitevilfe line is not still providing power to the plant. Applicant may think that 230KV Bus alarms mean that power is simply degraded (vs LOOP) and AOP 36.1 entry would not be appropriate in this case.
6.
Licensee added statem~Q~t.<:>t~~~!.~rT1.r~.g~~9in~hin~31 white VOLT lights are not lit.lm~~i"r¥~::;li;i~lm*~*~89~;:;t~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 80 H
2 x
x x
N tJ 216000A2.07 e
1.
SRO-only/Cues: The stem tells the applicant which procedure to S
enter. RO knowledge pertaining to overall mitigative strategy associated with Reactor Flooding Contingency. To make SRO-only question, suggest presenting the SRO applicant with a choice of two different EOP contingency procedures and have him/her choose the required contingency. For example, Reactor Flooding and stay in Level Power versus only be in Reactor Flooding.
2.
Cred Dist: "A" and "B" are not plausible because the word "flashing" is synonymous with "erratic" and easily eliminates these choices. Suggest making the applicant discern whether flashing is or is not occurring based on additional given conditions in the stem.
3.
Licensee re-worked question to ask how level indicators will eventually fail (either upscale or downscale) following a LOCA in containment with 12 rods stuck at position 02. SRO portion of question deals with whether to completely exit LPC flowchart when entering Rx FP flowchart (or remain in the "Q" leg of LPC when entering Rx FP flowchart.
4.
Stem should be focused to ensure that applicant knows that LOCA is a steam space break and actual vessel level is not challenged. Stem should be focused to ask for the response of "indicated level" versus response of "level instrumentation".
5.
Ask licensee for SD-1.2 sentence that says level indication will definitely fail upscale. Need to ensure stem conditions exactly match SO scenario for extreme combinations of pressure drywell ternperature.
6.
Licensee stated that simulator model predicts eventually upscale failure. Additionally, licensee stated that GFES knowledge of reference leg boiling proves this failure.
7.
During on-site operating exam week, examiner requested the word 'small" to be deleted from the stem regarding size of steam leak to correlate with stem statement "as the reactor depressurizes."
11f~11t~~~::IJ,~I.~I1_:1~1~~l'tr~~
- / IBack-I Q= I SRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F Icred'l Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 81 H
2 x
x N
y.
S 217000A2.05 1.
SRO-Only: Using RO knowledge (power supplies), the applicant can deduce whether or not the transition to another system for pressure control (from HPCI) or level control (from RCIC) is required. Additionally, using RO knowledge of Group I isolation impact on the feedpumps, the applicant can deduce that CRD is the only system available for injection at 900 psig. To make SRO-only, present the applicant with a choice of LEP and/or SEP. Another possibility is to exit EOP realm and ask for impact of tripped breaker on RCIC operability, including the required action lAW Tech Specs (or bases).
2.
Licensee re-worked question to ask for loss of panel 4B impact on RCIC and also to interpret the action statement associated with verifying HPCI operability by "administrative" means. Since this information is located in tech spec bases, this is SRO-only knowledge.
3.
Delete the portion of each selection associated with "for maintenance or other reasons" as this may cause one or more choices to be argued as correct. For "A" and "C", include statement "HPCI Operability PT is not required to be performed."
4.
Add the phrase "in accordance with Tech Spec 3.5.3, RCIC System" to the stem question.
5.
Annunciators are not necessary. Also, may not be the only ones associated with loss of panel4B. Suggest eliminating annunciators from stem and simply ask how RCIC is affected following a loss of distribution panel 4B.
6.
All com.T?p~~in~2rr()[~t~~'9gE3~ti~n re-formatted to fill-in-the-blank.
.limJ~ttI..;;:f:i.:*ilm)~:~Ri~:i~
- /
I Back-I Q= I SRO I B/M/N IU/EiS units ward KIA Only 8.
Explanation 7.
6.
- 5. Other
- 4. Job Content Flaws
- 3. Psychometric Flaws Stem Icuesl T/F I cred*1 Partial I Job-I Minutia Focus Dist.
Link 2.
LOD I,
" I,
I I
(1-5) 1.
LOK (F/H)
Q#
82 F
x x
x N
y IG2.4.41 S
1.
LOD=1/Cues: If a reference is being provided (OPEP-02.1,, Page 11 of 22) then this is a direct lookup and the stem provides a cue by stating a troubleshooting time. If no reference is provided then LaD will be acceptable for this specific test item.
2.
Cues/Partial: Applicant can potentially argue UE or Alert since the stem doesn't specify the highest EAL classification in accordance with OPEP-02.1. The stem uses the word "appropriate EAL to declare."
3.
Licensee re-worked question to incorporate a timeline of events which included a cross-tie from E1 to E3. Does DG1 and DG2 running make "A" the correct answer?
4.
Discuss providing only Attachment 1 of PEP-02.1 to applicants; will it provide answers to any other test items?
5.
Licensee verified with E-plan personnel that "A" was incorrect because the EAL declarations are for each unit separately.
ONLY attachment 1 of PEP-02.1 will be provided to the applicants.
1I{.J:I~ml~~:::.'ii~~ii:~**&l:~~:~:i:t=~~
- (
I Back-I Q= I SRO I B/M/N IU/EIS Units ward KIA Only Stem ICuesITIF Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7..
8.
Explanation 83 H
3 x
x N
y 1272000G2.2.14 S
1.
Partial: "A" can also be argued as correct because 001-01.08, Section 5.2.5 (Disabled Annunciators), paragraph h states that the intent of the allowance (for not completing Attachment 10) is to be used to address "nuisance" alarms which only exist for a short duration due to changing plant conditions. This question does not involve a "nuisance alarm due to changing plant conditions"; therefore, an applicant may also be correct for determining that Attachment 10 is required.
2.
Include the alarm (in caps) window designation (UA-48, 5-2) 3.
Re-word the stem question as follows: 'WOOTF identifies whether ODCM Radioactive Gaseous Effluent Monitoring Instrumentation 7.3.2 is required to be entered and also identifies whether 01-01.08, Attachment 10 is required to be completed for this activity?"
4.
Licensee re-worked question to incorporate comments 1 -3.
5.
The second sentence in the stem identifies that this alarm is an ODCM annunciator and provides a cue which makes "c" and "0" not plausible.
6.
Ensure that question is worded (stem and choices) to ask whether or not LCO 7.3.2 action statement entry is required or not required. Currently, the question is ambiguous with respect to what specification "must be entered" means.
7.
Licensee argued that it was unreasonable to require operators to know every annunciator listed in 001-01.08 Attach 11 from memory. Examiners agreed that second sentence in stem may be necessary.
8.
Licensee re-worked all choices to require applicant to know whether an ODCM action statement was required and whether Attach 10 was required.
~Y!~~iJl"':~~:i:::li~!*iii;.i~fi~~!j~~
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Dist.
Link units ward KIA Only 84 H
2 x
N Y.
295001 AA2.03 S
1.
SRO-Only: AOP-4.0 Caution is also a P&L [1 OP-02, P&L 3.4.2]
pertaining to limiting power to 50% when in 1-loop and is a required RO knowledge, i.e., not unique to the SRO position because it is an operating procedure precaution and limitation.
To make SRO-only, suggest including Tech Spec 3.4 on Recirc.
Discuss wi licensee that SRO-only Guidance Document excerpt should also be linked to an item in 10CFR55.43, Le., procedure selection and/or tech spec call.
2.
Typos: period after second bullet in stem; period before question mark in stem 3.
Licensee re-worked question to ask for the most accurate indication of total core flow and also to ask for TS 3.4.1 action statement time requirement for applying single loop trip setpoints (no reference provided).
4.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- /
Back-Q=
SRO B/M/N U/E/S Explanation Focus Dist.
Link units ward KIA Only 85 H
2 x
x x
N tJ 295004AA2.01 S
1.
SRO-Only: An applicant can answer the question solely using systems knowledge [i.e, that the annunciators reflect a loss of the ESS Logic Cabinet for DG-4 (no auto-transfer exists for the diesel logic - - manual only.) and the ESS logic cabinet H61 has auto-transfer capability and will auto-transfer to Panel 3B.]
Suggest incorporating a procedure selection or tech spec and/or bases determination to make SRO-only. Discuss with licensee:
use of the word "should be directed" leaves room for subjectivity and does not imply SRO-only knowledge.
2.
The stem statement leads the applicant to a loss of a 125VDC panel (versus a 250VDC panel or board loss) 3.
Include alarm panel and window designation for each alarm in the stem.
4.
Licensee re-worked question to ask for which panel had been lost and also whether the DG was operable given that its DC logic was on alternate power supply.
5.
"A" and "B" are not credible because a significant larger number of alarms would be received for a loss of the entire 250VDC Switchboard. Suggest adding another 125 VDC distribution panel for "A" and "B" to make more plausible.
6.
Also Add LCO 3.8.1 to stem statement, Le., "in accordance with LCO 3.8.1, AC Sources Operating, and LCO 3.8.7, Distribution Systems Operating?"
7.
Licensee changed "A" and "B" to 125VDC lnel 1B to make more All comments II
- 1. I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LOD (F/H)
(1-5) 86 I F I 2 I x I I
I I
x I I
I x I I x I 8.
Explanation 295006G2.2.37 1.
Verify that no reference intended to be provided to applicants for this question.
2.
Stem Focus: There is a potential for arguing that there is no correct answer provided that the accumulator is re-charged before 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> has elapsed, i.e., no need to declare the rod slor OR inoperable. Suggest the following wording:
Unit One is operating at 100 power with the following conditions:
All control rods and control rod scram accumulators operable All control rod scram times within Tech Spec Limits Subsequently, one control rod scram accumulator becomes inoperable and cannot be repaired for 2 days.
WOOTF identifies the required actions in accordance with Tech Spec (TS) 3.1.5, Control Rod Scram Accumulators?
A.
The ROD must be declared inoperable per TS 3.1.3,, and the rod's SCRAM TIME must also be declared inoperable per TS 3.1.4 B.
ONLY the ROD is allowed to be declared inoperable per TS 3.1.3, The rod's SCRAM TIME is not allowed to be declared inoperable per TS 3.1.4, C.
EITHER declare the ROD inoperable per TS 3.1.3, OR declare the rod's SCRAM TIME inoperable per TS 3.1.4, D.
ONLY the SCRAM TIME is allowed to be declared inoperable per TS 3.1.4, The ROD is not allowed to be declared inoperable per TS 3.1.3 3.
Licensee re-worked question as suggested. TS LCO numbers weren't listed in each choice (this is okay).
4.
Partial: Either re-word the stem question or add statement to each choice stating that the other choices are not allowed to clarify the word "only." In other words, there are several options that are allowed in this scenario. Ensure the incorrect choices are incorrect.
5.
Q=KlA: Do we need to tell the applicant that the accumulator "becomes inoperable" or can we provide indications and let the applicant determine operability? As written, the question doesn't hit the KIA because the KIA requires the applicant to determine operability.
l!igJi~§.~~.i:i~Jtllgg~gj~.**.*~~.I~tt='I:~~iii.I~ ** i~~~ ***i~.*~j~!J*;t~~
- ( IBack-I Q= ISRO I B/M/N IU/EiS units ward KIA Only Stem Icuesl T/F I cred'l Partial I Job-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 87 H
3 x
x N
y I295007G2.1.7 S
1.
SRO-only: The # of SRVs that will open (based on peak pressure of 1145 psig) and the failure of Recirc Pumps to trip (based on ARI initiation at> 1137.8 psig) is RO systems knowledge. Suggest incorporating a choice of either EOP contingency procedures (e.g., LEP, SEP, etc.) OR E-Plan call to make this question at the SRO level.
2.
Stem Focus: Avoid using words "would be considered" and "should" because these are subjective. Use WOOTF "identifies" the number of SRVs that opened and "required actions in accordance with..."
3.
Discuss with licensee: why are the scoop tubes locked?
4.
Licensee re-worked question to ask how many SRV memory lites were iliuminated and also which EP classification (highest) existed. Need to qiscuss the basis for the E-plan Section 5 statement "as indicated on Panel A-5." Is there a basis document that defines this question?
5.
Rework the lead in phrase to be grammatically correct.
6.
Change "based on the above observations" to Given these plant conditions" 7.
Focus the stem question to illicit the REQUIRED E-plan declaration to ensure SM/SED judgement higher classification is incorrect.
8.
Licensee ensured only UE was req~ir~cjcj~8IClr~!~~n.~i~~~-pICln personnel on security agreement.
~~~~mJ.irN.:J~.:i~~(lj;:::~:~.t=At~~
- / IBack-I Q= I SRO I B/M/N IU/E/S units ward KIA Only Stem Icuesl T/F Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 88 H
2 x
x x
N y
1295018AA2.03 S
1.
SRO-only: AOP entry conditions and off-normal plant conditions requiring a manual scram are RO knowledge items, i.e.,
knowledge is not unique to the SRO position.
2.
Partial/ Stem Focus: If the alarms listed in the stem are the ONLY ones in the alarm condition, then there is no correct answer. (Other alarms such as TBCCW Low Pressure would also be in an alarm condition if a complete loss of TBCCW had occurred.) If the alarms listed in the stem are not meant to be all inclusive, then the applicant may argue that "A" is correct because it identifies a partial loss of TBCCW; Even though there are no alarms which would indicate entering AOP-19 (Loss of CSW-second part of "A"). it can. be argued that entering the AOP-19 is a conservative action.
3.
For annunciators, include the panel and window number in parenthesis.
4.
Licensee developed new question. Q=KlA: Does stem need to state that SW-V1 06 is shut? KIA requires applicant to determine cause of partial or complete loss of RBCCW.
5.
The applicant does not need to know the first part of each choice because the second part of each choice is different, i.e., four different procedures.
6.
May want to consider an actual LOCA signal occurs on Unit 2 and how the operator regains RBCCW cooling during accident scenario (procedure selection) instead of an "inadvertent" initiation of CS because this may raise questions as to the current status of the unit wrt reactor scram, etc.
7.
Licensee re-worked this new question (see item #4 above) to ask applicant to predict status of SW-V106 and RBCCW pumps in conjunction with procedure selection that included guidance for restoring RBCCW cooling.
~~~~]I~~Ji1.i~~mi~i~H~~it~~
- /
I Back-I Q= I SRO I B/M/N IU/E/S units ward KIA Only Stem ICuesIT/F Icred'l PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 89 H
2 x
x N
y 1295022AA2.02 S
1.
SRO-Only: The second part of each choice can be deduced using RO knowledge of component power supplies. Choice "0" includes an SRO knowledge element pertaining to E5-E6 crosstie not allowed unless an "emergency" condition exists; however, the second part of this choice can be determined to be incorrect because shifting 1AB to alternate isn't required when E5 is crosstied to E6.
To make this question SRO-only, delete the portion of the first sentence in the stem ("with the B CRD pump operating'? and ask the following question:
"WOOTF identifies the required action to re-establish the CRO system and also identifies the procedure that contains the guidance for accomplishing this required action for this event?"
A. The 1A CRO Pump must be started; 10P-08, Control Rod Hydraulic System Operating Procedure B. The 1A CRD Pump must be started; AOP-2.0, Control Rod MalfunctionlMisposition C. The 1B CRD Pump must be started; 10P-08, Control Rod Hydraulic System Operating Procedure D. The 1B CRD Pump must be started; AOP-2.0, Control Rod MalfunctionlMisposition
.. 2. Licensee incorporated changes. During secondary review, I discovered that "B" and "0" could potentially be argued as correct since AOP-2.0 sends you to 10P-08; therefore AOP-2.0 indirectly provides the "procedural guidance" to re-establish the CRD system. Suggest re-wording the stem as follows:
"WOOTF identifies the required action to re-establish.....and also identifies the procedure that contains the step for initially placing the CRD Flow Control, C11-FC-R600, in MANUAL before attempting to start a pump?
- 3. Licensee i~~.~rpg~~!;~9:~~~Q~}~~p~tJre"B" and "0" were incorrect.l~fiil'~rtY~;;::"~~::llm:i;~::~:&l=l'~~
- 1 IBack-I Q= ISRO I B/M/N IU/EIS units ward KIA Only Stem ICuesITIF Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 90 H
2 x
x N
E 1295023G2.4.S S
1.
Cue: Delete the sentence that states AOP-5 has been entered and re-word the stem question as follows:
WOOTF predicts the plant response and also identifies the required procedure implemention?
A.
Secondary Containment has automatically isolated; OAOP-5.0 (title) and EOP RRCP are required to be implemented concurrently B.
Secondary Containment has automatically isolated; OAOP-5.0 (title) must be exited and ONLY EOP RRCP is required to be implemented C.
Secondary Containment has NOT automatically isolated; OAOP-5.0 (title) and EOP RRCP are required to be implemented concurrently D.
Secondary Containment has NOT automatically isolated; ;
OAOP-5.0 (title) must be exited and ONLY EOP RRCP is required to be implemented 2.
- /units: It's important to include the exact name of alarm window (in caps) and the annunciator panel and window number (in parenthesis) because only the Hi-Hi alarm causes the Secondary Containment isolation to occur in this case.
3.
Licensee incorporated comment #1 but did not incorporate window number for alarm window. In this question it is important for the applicant to understand that ONLY the Hi alarm (UA-03, 4-5) is illuminated and not the Hi Hi alarm (UA-03, 3-5).
Anticipate applicants asking proctor during exam administration.
Therefore, need to add window numbers for all three alarms in this question.
4.
Discuss wi licensee: Where is the administrative guidance that requires concurrent implementation? (Le., unlike AOP-14, AOP exit is incorrect) 5.
Licensee stated that the EOP User's Guide provided specific guidance to use AOP and EOP concurrently. Licensee verified that exact annunciator engraving was provided in the stem.
1~~~llil~rI*:*!I!i::!~m!:I:!~::~~~l~
Stem Icuesl T/F I c~ed*1 Partial I J?b-I MinutiaI #(
I Back-I Q= I SRO I B/M/N IU/EIS Focus Dls1.
link units ward KIA Only Q#
1.
lOK (F/H) 2.
lOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 91 H
2 x
x N
E 1295026EA2.03 S
1.
SRO-only: Include procedure selection as an element of the question as follows by adding bullet to the stem stating that rods are not fUlly inserted to or beyond position 02 and then ask the following question:
WOOTF identifies the status of the Heat Capacity Temperature Limit (HCTl) and also identifies the required procedure for reactor pressure control?
A. HCTl has been exceeded; EOP-01-level Power Control RC/P leg B. HCTl has been exceeded; EOP-01-Reactor Vessel Control RC/P leg C. HeTl has NOT been exceeded; EOP-01-level Power Control RC/P leg D. HCTl has NOT been exceeded; EOP-01-Reactor Vessel Control RC/P leg 2.
Licensee incorporated suggested changes.
3.
Cue: Why does stem state that control rod positions are unknown? Does a loss of UPS (spell exact portion of system that was lost) provide information that control rod positions are unknown?
4.
Need to verify on HCTl graph.
5.
Licensee deleted redundant statement that UPS was de-energized because st~~~lr~~9X~eig !~~t9~n~~81.~od positions were all unknown.
~l?-mg[~~m.:i::I~:;:~llSi.:~i{fl]~~::]~~
- 1 I Back-I Q= I SRO I B/M/N IU/EIS units ward KIA Only Stem Icuesl T/F I cred*1 Partial I Job-I Minutia Focus Dist.
Link e
1295031 G2.2.39 S
1.
Discuss wi licensee the proposed reference material to be distributed to applicants. May need to distribute the entire PCIS instrumentation section to avoid a direct lookup with only distributing one page.
2.
Cred Dist: Each choice must have only two parts. Suggest the following:
A. LL2 channel is inoperable; Place in tripped condition within 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> B. LL2 function is inoperable: Place in tripped condition within one hour C. LL3 channel is inoperable; Place in tripped condition within 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> D. LL3 function is inoperable; Place in tripped condition within one hour 3.
Licensee incorporated suggested item #2.
4.
Discuss providing TS 3.3.6.1 to make choices "A" and "C" plausible.
5.
Licensee agreed to provide TS 3.3.6.1 and also suggested to "white out" the allowable values column for the instrumentation table to avoid providing setpoint information that could jeopardize other questions on the test.
6.
During the on-site operating exam administration week, examiner asked licensee to add the words "as left trip setpoint data" to the stem (ins!~e98f"§l~I~ftqC:l!§l'2!8~~~ure that question operational validity.
l1~i~1J~~:I~::it-1~::~.:jk~!I:~~
1.
2.
Q# I LOK LaD (F/H)
(1-5) 921~
F
- 3. Psychometric Flaws x
- 4. Job Content Flaws
- 5. Other 6.
N 7.
8.
Explanation
- /
I Back-I Q= I SRO I B/M/N IU/E/S units ward KIA Only Stem Icuesl T/F I cred'l Partial I Job-I Minutia Focus Oist.
Link Q#
1.
LOK (F/H) 2.
LOO (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 93 H
2 x
x N
y.
S 295036A2.03 1.
SRO-Only: Knowledge that 2 areas> max safe requires ED is RO knowledge. No procedure selection is involved for SRO level knowledge. Suggest the following:
Given the current plant conditions, WOOTF identifies the leak location and also identifies whether or not the Tech Spec cooldown rate is required to be maintained?
A. HPCI Room; TS cool down rate is required B. HPCI Room; TS cool down rate is NOT required C. RWCU Triangle Penetration Room; TS cool down rate is required O. RWCU Triangle Penetration Room; TS cool down rate is NOT required 2.
Stem Focus: Avoid the use of the words "probable" and "should";
instead, use "required" 3.
Licensee incorporated suggested changes. During secondary review, I discovered that TS cooldown rate not required is virtually the same thing as saying ED. Suggest the following changes:
- remove the words "unisolable primary system" from the first sentence
- make "A" and "B" into HPCI turbine steam supply line in the steam tunnel.
- make ""c" and "0" into RHRSW line above the remote shutdown panel.
- make correct answer "C", i.e., tech spec cooldown rate is required to be maintained. (because not a primary system discharging) 4.
Licensee re-worked question to make an unisolable secondary system discharging (instead of a r.Eirn~ry?Y~!~~l~9~~g~ir~
adherence to TS cooldown rate.
~.~i~ll~m:::I:i:;il]*:~.*~r~~.:t~§
- ! IBack-I Q= I SRO I B/M/N IU/EiS Units ward KIA Only Stem ICuesIT/F Icred*1 PartialIJob-I Minutia Focus Dist.
Link Q#
1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Explanation 94 95 F
H 2
2 x
x x
x x
B B
E IG2.1.4 S
1.
Stem Focus: Suggest eliminate unnecessary wording with the following:
'WOOTF identifies the earliest point in a reactor startup that the requirement for two Control Operators in the affected unit's Main Control Room can be relaxed in accordance with 001-01.02, Shift Routines and Operating Practices?
Change each choice to "as soon as the..."
2.
"A" is not plausible because the startup is over. Change to "as soon as the point of adding heat is reached."
3.
Licensee incorporated suggested changes.
tJ IG2.1.7 S
1.
SRO-Only: RO knowledge of overall mitigative strategy (See NUREG 1123, Generic KIA 2.4.6 with RO IR of 3.7). Question doesn't involve assessment of plant conditions and selection of mitigating procedures per 10CFR55.43 (b) (5). Suggest using an E-plan classification based on core conditions/activity.
2.
Licensee substituted another bank question.
3.
Q=KIA: Substitution question states that RPV water level has dropped below LL4. KIA requires an operational judgement call based on instrument interpretation. Suggest providing level indications and make applicant determine that level is below LL4.
4.
Stem Focus: State that the reactor is shutdown to narrow the EOP network to level and pressure concern only.
5.
Licensee re-worked question to incorporate comment #3 above.
Licensee provided applicant with graph to ascertain LL4/LL5.
~IT<:><~~9~iE~i:P,rg9~~yr,~~~I~ctionfor steam cooling and/or ED.
~~:E~~I:~~:~:~:::~~i::::~::~r~.~n¥l~
- (
I Back-I Q= ISRO I B/M/N IU/EIS Units ward KIA Only Stem Icuesl T/F I cred*lpartiall Job-I Minutia Focus Dist.
Link Q#
96 1.
LOK (F/H)
H 2.
LOD (1-5) 2
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other x
6.
N 7.
tJ
S 8.
Explanation G2.4.27 1.
SRO-only: Question doesn't involve assessment of plant conditions and selection of mitigating procedures. Question asks for procedure actions; instead, suggest asking applicant to choose which ASSD procedure is applicable and then identify action from that procedure.
2.
Licensee re-worked question to incorporate suggestions.
3.
Cue: First sentence in the stem states that a control building fire occurs.."which requires entry to PFP-13 and ASSD-01". This is teaching in the stem.
4.
Q=KlA: The second sentence in the stem states that the SCO has determined that ASSD actions are required. Suggest providing a statement that control board wiring indications are affected, etc. (See note on page 7 of 144 in ASSD-01, before Step 3.5) Require the applicant to deduce that entry to ASSD-01 is required.
5.
Verify wi licensee that it's never ever possible to be in AOP-32 concurrently with OASSD-01. (to ensure incorrect) Is it conceivable that AOP-32 6.
Licensee argued that question is hitting the<JSI~?!§l!~~~~t(l~
written. Licensee verified item #5 above.
~&U;;~il:lrN:;:li:::~~J.ili
- ~i!~ti~i:jtB
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
8.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Credo Partial Job-Minutia
- 1 Back-Q=
SRO B/M/N U/EIS Explanation Focus Dist.
Link units ward KIA Only 97 F
2 x
N
G2.2.20 S
1.
Partial: Ensure that each choice includes a statement of what does NOT require PGM approval to avoid the use of the word "ONLY."
A. ALL high risk activities. Medium risk activities do not require PGM approval.
B. ONLY those high risk activities performed during maxlsafe/gen periods of operation. Other high and medium risk activities do not require PGM approval.
C. ALL medium and high risk activities performed during maxlsafe/gen periods of operation. Other medium and high risk activities do not require PGM approval.
D. ONLY medium risk activities performed during maxlsafe/gen periods of operation. ALL high risk activities require PGM approval.
2.
Licensee incorporated suggested changes.
4.
While on-site during administration of the operating exam, licensee validation activities indicated that "0" was essentially the same answer as "C". Therefore, examiner asked licensee to add the word "(anytime)" to "0" just after high risk activities to clarify intent.
98 F
2 x
N
G2.2.6 S
1.
For enhancement to distractor plausibility, re-word stem:
During the performance of 10P-30,..., an error is identified in the procedure and a temporary change to the procedure is being performed. WOOTF identifies how this type of temporary change is required to be categorized and the duration allowed in accordance with PRO NGGC-0204, Procedure Review and Approval?
2.
Licensee incorporated suggested changes.
Stem Icuesl T/F I c~ed*1 Partial I J?b-I Minutia I
- (
I Back-I Q= I SRO I B/M/N IU/E/S Focus Dls1.
Link Units ward KIA Only 8.
Explanation 7.
6.
- 5. Other
- 4. Job Content Flaws
- 3. Psychometric Flaws 2.
LOD I I
I I
(1-5) 1.
LOK (F/H)
Q#
99 H
2 x
x N
e y
S G2.3.15 (similar to SRO question # 18 (93) - 295036A2.03) 1.
SRO-Only: Knowledge of SCCP bases that allows "resetting" of parameter it it goes back below the MaxSafe value is required to answer this question. Discuss wI licensee whether ROs are required to know this information also.
2.
Cues: Ask licensee if providing SCCP chart will compromise SRO question #18 (93) - 295036A2.02) Instead, only provide rad levels table portion of the chart. Suggest using a question on radiation monitor tech spec.
3.
Licensee replaced question with another new question.
4.
CREV system flowpath and purpose is RO knowledge. This information is included in Tech Spec bases; however, this is systems knowledge. Suggest going back to previous item or incorporating a tech spec call that requires SRO level knowledge of bases for CREV tech specs.
5.
Licensee replaced the CREV question with YET ANOTHER question. The new question asked appli~~p~~~r~p~r~~i~~~~~'t for TB HVAC and E-plan classification.
1~:fii~ml:I~;:I~:;:::~B'M;:j;~J
- 1. I 2.
I
- 4. Job Content Flaws I
- 5. Other I
6.
I 7.
Q# I LOK LOD (F/H)
(1-5) 100 I F I 2 I x I I
I x I I
I I
I I
I 8.
Explanation G2.3.6 1.
Cred Dist: "A" and "B" are not plausible because "One" is the minimum possible time that a tank can be recirculated; otherwise there is no requirement to recirculation. Suggest changing 1 to 3.
2.
Ensure the phrase"...in accordance with OOP-06.4, title" is incorporated in stem question.
3.
WOOTF choices will complete the following statement in accordance with.....
4.
Licensee re-worked question and suggested that OOP-6.4 Section 5.7 should be provided to applicants to determine whether 1) recirc time requirement had been met and 2) sample valve open time requirement had been met.
5.
By providing the procedure, this appears to be direct lookup.
Discuss wi the licensee. The needed information is provided in the proposed reference to applicants.
6.
Note: The licensee's AUDIT EXAM included a test item which asked the applicant what is required for the same release when Liquid Release Rad Monitor D12-RM-K604 is inoperable. i.e., at least two independent samples are analyzed and at least two qualified members of the technical staff independently verify the release rate calcs and discharge valve alignments (OP-6.4 P&L 3.8).
7.
Licensee argued that question was not a direct lookup because this was the actual task that an SRO was responsible for at their plant. Chief Examiner re-worded the choices to ensure that the
~eRlig~n~>~~~r~~~ir~gt~~7~lIyze the procedure and data.
¥~¥Ui~ml~r:M::li:;ili:*::~:J~;~>~.£m~
ES-403 Written Examination Grading Quality Checklist Form ES-403-1 Facility: ~tuv\\~w, c-Date of Exam: \\\\
Co &,_0'"
Exam Level: RO t:8J.
SRO~
Initials Item Description 1.
Clean answer sheets copied before 2.
Answer key changes and question deletions justified and documented 3.
Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations) 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-onl ) reviewed in detail 5.
All other failing examinations checked to ensure that grades are 'ustified 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature Date
- a. Grader
.~ ~1)',-"
Itit/bs.
- b. Facility Reviewer(*)
- Y/MCI(~ A*~Jf)/) J
~~~
- c. NRC Chief Examiner (*)
~m¢c/~
/;/i~.ep
/
7
- d. NRC Supervisor (*)
lUUJJ~-r:
lJ.!ZV109
(*)
The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-501 Post-Examination Check Sheet Form ES-501-1 Post-Examination Check Sheet Facility: Brunswick Date of Examination:
Nov 3-7,2008 Task Description Date Complete 11/1 U/2UU~
1.
Facility written exam comments or graded exams received and verified complete 11/13/2UU~
2.
Facility written exam comments reviewed and incorporated and NRC grading completed, if necessary 11/1712UU~
3.
Operating tests graded by NRC examiners 11/1 Y/ZOOg 4.
NRC chief examiner review of operating test and written exam grading completed 11'24/2UU~
5.
Responsible supervisor review completed 11/24/2UUg 6.
Management (licensing official) review completed 12/U1/2UU~
7.
License and denial letters mailed 12/U1/200g 8.
Facility notified of results ur11U312UU~
9.
Examination report issued (refer to NRC MC 0612)
Reference material returned after final resolution of any "appeals N/A 10.
Pr gress Energ SEP 18 2008 SERIAL: BSEP 08-0122
- u. S. Nuclear Regulatory Commission, Region II ATTN: Mr. Luis A. Reyes, Regional Administrator Sam NunnAtlanta Federal Center 61 Forsyth Street, SW, Suite 23T85 Atlanta, GA 30303-8931
Subject:
Reference:
Brunswick Steam Electric Plant, Unit Nos. 1 and 2 Docket Nos. 50-325 and 50-324/License Nos. DPR-71 and DPR-62 Reactor and Senior Reactor Operator Initial Examination Reference Materials Letter from Malcolm T. Widmann (NRC) to Benjamin C. Waldrep (CP&L),
"Brunswick Steam Electric Plant - Reactor and Senior.- Reactor Operator Initial Examinations 05000325/2008302 and 05000324/2008302," dated August 5, 2008
Dear Mr. Reyes:
In accordance with the guidelines in Revision 9, Supplement 1, ofNUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Carolina Power & Light Company (CP&L), now doing business as Progress Energy Carolinas, Inc., is providing examination reference materials supporting operating and written examinations scheduled for the weeks ofNovember 3, 2008, and November 10, 2008, respectively.
A list of the examination materials and reference materials is provided in Enclosure 1.
Copies of Examiner Standard Fonns and Checklists from ES-201 and ES-401 are provided in Enclosure 2. A copy of the written examination is provided in Enclosure 3. Copies of the simulator dynamic scenarios and Job Performance Measures (JPMs) are provided in. Copies of the reference materials are provided in Enclosure 5 (i.e., on a CD-ROM). Enclosures 2,3, 4, and 5 are being provided only to Mr. Ronald F. Aiello, the assigned NRC lead examiner, with his copy of this letter.
Progress Energy Carolinas, Inc.
Brunswick Nuclear Plant PO Box 10429 Southport, NC 28461
Mr. Luis A. Reyes, Regional Administrator BSEP 08-0122/ Page 2 No regulatory commitments are contained in this letter. Please refer any questions regarding this submittal to Mr. Bob Bolin, Senior Nuclear Operations Training Instructor, at (910) 457-3078.
Sincerely, Philip A. Leich Manager - Support Services Brunswick Steam Electric Plant WRM/wrm
Enclosures:
1.
List ofExamination Materials and Reference Materials 2.
Examiner Standard Forms and Associated Checklists 3.
Written Examination 4.
Simulator Scenarios and Job Performance Measures (JPMs) 5.
Reference Materials (CD-ROM)
Mr. Luis A. Reyes, Regional Administrator BSEP 08-0122 / Page 3 cc (with Enclosures 1, 2, 3,4, and 5):
- u. S. Nuclear Regulatory Commission, Region II ATTN: Mr. Ronald F. Aiello Senior Operations Engineer Sam NunnAtlanta Federal Center 61 Forsyth Street, SW, Suite 23T85 Atlanta, GA 30303-8931 cc (with Enclosure 1 only):
U. S. Nuclear Regulatory Commission ATTN: Document Control Desk Washingto!1, DC 20555-0001 U. S. Nuclear Regulatory Commission, Region II ATTN: Mr. Malcolm T. Widmann Chief, Operations Branch Sam Nunn Atlanta Federal Center 61 Forsyth Street, SW, Suite 23T85 Atlanta, GA 30303-8931
- u. S. Nuclear Regulatory Commission ATTN: Mr. Joseph D. Austin, NRC Senior Resident Inspector 8470 River Road SOllthport, NC 28461-8869 U. S. Nuclear Regulatory Commission (Electronic Copy Only)
ATTN: Mrs. Farideh E. Saba (Mail Stop OWFN 8G9A) 11555 Rockville Pike Rockville, MD 20852-2738 Chair - North Carolina Utilities Commission P.O. Box 29510 Raleigh, NC 27626-0510
BSEP 08-0122 Enclosure.1 Page 1 of 1 List ofExaminations Materials and Reference Materials The following documents, developed in accordance with NUREG-1021, Revision 9, Supplement 1, "Operator Licensing Examination Standards for Power Reactors," are provided in Enclosure 2:
Form ES-301-1 Form ES-301-2 Form ES-301-3 Form ES-301-4 Form ES-301-5 Form ES-301-6 Form ES-401-6 Administrative Topics Outline Control Room/In-Plant Systems Outline Operating Test Quality Checklist Simulator Scenario Quality Checklist Transient and Event Checklist Competencies Checklist Written Examination Quality Checklist provides the proposed written examination (i.e., 75 "common" questions, 25 senior reactor operator (SRO) questions). provides the Simulator Dynamic Scenarios (3) and Job Performance Measures (i.e., Administrative, In-plant, and Simulator). provides the following reference materials on CD-ROM:
Index to Procedures Abnormal Operating Procedures (AOP)
Administrative Instructions (AI)
Administrative Procedures (AP)
Alternate Safe Shutdown (ASSD)
Annunciator Procedures (APP)
Brunswick Big Notes Emergency Operating Procedures (EOP)
Engineering Procedures (ENP-24)
Fuel Handling Procedures (FH)
Nuclear Generation Group Procedures (NGGC)
Operating Procedures (OP)
Operating Instructions (01)
Operating Work Packages (OWP)
Periodic Tests (PT)
Plant Emergency Procedures (PEP)
Pre-Fire Plans (PFP)
System Descriptions (SD)
Technical Specifications including Bases and Offsite Dose Calculation Manual (ODeM)
(
ES*401 Record of Rejected KIAs Form ES*401*4
(
(
Tier /
Randomly Reason for Rejection Group Selected KIA TlIG2 295011 K1.01 Brunswick does not have a Mark III containment. Randomly selected 295002 K1.04 T2IG1 207000 K2.02 Brunswick does not have an emergency isolation condenser.
Randomly selected 212000 A4.02 T2IG1 2070002.2.37 Brunswick does not have an emergency isolation condenser.
Randomly selected 212000 K1.12 T2IG1 209002 K1.12 Brunswick does not have a High Pressure Core Spray System.
Randomly selected 209001 K3.02 T2IG1 211000 K5.02 Brunswick has Super Boron which does not have a concern with chugging, No heat trace is required. Randomly selected K5.06 T2IG2 239003 Brunswick does not have a MSIV Leakage Control System.
Randomly selected 241000 K5.05 T2IG2 215001 2.1.45 Generic KIA does not meet guidance of Note 7. Refer to Section D of ES-401 for list of applicable KJAs that can be used. Randomly selected G2.1.31 T2/G1 262002 K1.16 UPS does not provide power to the MSIVs. Randoinly selected K1.02 instead.
T2IG1 262002 K3.02 UPS does not provide power to the Recirc Speed Control.
Randomly selected K3.01 instead T2IG2 272000 2.2.12 Generic KIA does not meet guidance of Note 7. Refer to Section D of ES-401 for list of applicable KJAs that can be used. Randomly selected 288000 K2.02 T3 G2.2.18 Licensee could not write a discriminating question at the RO level.
Chief Examiner randomly selected G2.2.42.
SROExam T2IG1 207000 2.2.17 Brunswick does not have this system. Randomly selected 209001 G2.2.22 T2IG1 2060002.4.14 Generic KIA does not meet guidance of Note 7. Refer to Section D of ES-401 for list of applicable KJAs that can be used. Randomly selected G2.4.18 T2IG2 2720002.3.12 Generic KIA does not meet guidance of Note 7. Refer to Section D of ES-401 for list of applicable KJAs that can be used. Randomly selected G2.2.14
ES-401 BWR Examination Outline FINAL Form ES-401-1
(
(
II
. k Date of Exam: Oct 27,2008 RO KIA Category Points SRO-Only Points Tier Group K
K K
K K
K A
A A
A G
A2 G*
Total 1
2 3
4 5
6 1
2 3
4 Total 1.
1 6
2 4
3 3
2 20 4
3 7
Emergency &
2 Abnormal Plant 2
2 1
N/A 1
1 N/A 0
7 2
1 3
Evolutions Tier Totals 8
4 5
4 4
2 27 6
4 10 1
4 2
3 2
3 2
2 2
1 2
3 26 3
2 5
2.
Plant 2
1 1
2 0
1 1
2 1
1 0
2 12 2
1 3
Systems Tier Totals 5
3 5
2 4
3 4
3 2
2 5
38 5
3 8
- 3. Generic Knowledge and Abilities 1
2 3
4 10 EEEE 7
I Categories 3
3 2
2 2
2 2
1 Note:
1.
Ensure that at least two topics from every applicable KIA category are sampled within each tier of the RO and SRO-only outlines (Le., except for one category in Tier 3 of the SRO-only outline, the "Tier Totals" in each KIA category shall not be less than two).
2.
The point total for each group and tier in the proposed outline must match that specified in the table.
The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.
The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3.
Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1.b of ES-401 for guidance regarding the elimination of inappropriate KIA statements.
4.
Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5.
Absent a plant-specific priority, only those KlAs having an importance rating (IR) of 2.5 or higher shall be selected.
Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6.
Select SRO topics for Tiers 1 and 2 from the shaded systems and KIA categories.
7.*
The generic (G) '(JAs in Tiers 1 and 2 shall be selected from Section 2 of the KIA Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable KlAs.
8.
On the following pages, enter the KIA numbers, a brief description of each topic, the topics' importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply).
Use duplicate pages for RO and SRO-only exams.
9.
For Tier 3, select topics from Section 2 of the KIA catalog, and enter the KIA numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to KlAs that are linked to 10 CFR 55.43.
10.
- Indicates Changes from the First Submittal
ES-401 2
Form ES-401-1
(
(
ES-401 BWR Examination Outline Form ES-401-1 Emeraency and Abnormal Plant Evolutions - Tier 1/Group 1 (RO / SRO)
E/APE # / Name / Safety Function K
K K
A A
G KIA Topic(s)
IR 1
2 3
1 2
295001 Partial or Complete Loss of Forced X
AA2.03: Ability to determine and/or interpret the 3.3/3.3 Core Flow Circulation / 1 &4 following as they apply to PARTIAL OR COMPLETE LOSS OF FORCED CORE FLOW CIRCULATION: Actual core flow 295003 Partial or Complete Loss of AC / 6 X
AKl.03: Knowledge of the operational implications of 2.9/3.2 the following concepts as they apply to PARTIAL OR COMPLETE LOSS OF A.C.
POWER - Under voltage/degraded voltage effects on electrical loads 295004 Partial or Total Loss of DC Pwr / 6 X
X AK1.02: Knowledge of the operational implications 3.2/3.4 of the following concepts as they apply to 3.2/3.6 PARTIAL OR COMPLETE LOSS OF D.C.
POWER: Redundant D.C. power supplies AA2.01 Ability to determine and/or interpret the following as they apply to PARTIAL OR i IC,OMPLETE LOSS OF D.C. POWER:
. Cause of partial or complete loss of D.C. power 295005 Main Turbine Generator Trip / 3 X
AK3.07: Knowledge of the reasons for the following 3.8/3.8 responses as they apply to MAIN TURBINE GENERATOR TRIP - Bypass valve operation 295006 SCRAM / 1 SCRAM X
G2.2.3 (multi-unit license) Knowledge of the design, 3.8/3.9 procedural, and operational differences between units.
X G2.2.37: Ability to determine operability and/or 3.6/4.6 availability of safety related eauipment.
295016 Control Room Abandonment/7 X
AA1.08: Ability to operate and/or monitor the 4.0/4.0 following as they apply to CONTROL ROOM ABANDONMENT: Reactor pressure 295018 Partial or Total Loss of CCW / 8 X
X AK1.01: Knowledge of the operational implications 3.5/3.6 of the following concepts as they apply to 3.2/3.5 PARTIAL OR COMPLETE LOSS OF COMPONENT COOLING WATER :Effects on component/system operations AA2.03: Ability to determine and/or interpret the following as they apply to PARTIAL OR COMPLETE LOSS OF COMPONENT COOLING WATER: Cause for partial or complete loss 295019 Partial or Total Loss of Inst. Air /8 X
AK3.01: 'Knowledge of the reasons for the following 3.3/3.4 responses as they apply to PARTIAL OR COMPLETE LOSS OF INSTRUMENT AIR: Backup air system supply:
295021 Loss of Shutdown Cooling / 4 X
AA2.05: Ability to determine and/or interpret the 3.4/3.5 following as they apply to LOSS OF SHUTDOWN COOLING: Reactor vessel metal temperature 295023 Refueling Acc / 8 X
G2.4.8: Knowledge of how abnormal operating 3.8/4.5 procedures are used in Iconjunction with EOPs.
- 295024 High Drywell Pressure / 5 X
EK1.01: Knowledge of the operational implications 4.1/4.2 of the following concepts as they apply to HIGH DRYWELL PRESSURE: Drywell integrity:
(
295025 High Reactor Pressure / 3 X
EK2.08: Knowledge of the interrelations between 3.7/3.7 HIGH REACTOR PRESSURE and the following - Reactor/turbine pressure regulating system
- 295026 Suppression Pool High Water X
X EA1.01:
Ability to operate and/or monitor the 4.1/4.1 following as they apply to SUPPRESSION Temp./5 POOL HIGH WATER TEMPERATURE:
Suppression pool cooling EA2.03 Ability to determine and/or interpret the 3.9/4.0 following as they apply to SUPPRESSION POOL HIGH WATER TEMPERATURE: Reactor pressure 295027 High Containment Temperature / 5 X
EK2.04 Knowledge of the interrelations between 2.6/3.2 HIGH CONTAINMENT TEMPERATURE (MARK III CONTAINMENT ONLY) and the foliowing:SPDS/ERIS/CRIDS/GDS: Mark-III 295028 High Drywell Temperature /5 X
EK1.02: Knowledge of the operational implications 2.9/3.1 of the following concepts as they apply to HIGH DRYWELL TEMPERATURE
- EQuipment environmental Qualification 295030 Low Suppression Pool Wtr Lvl/5 X
Low Suppression Pool Wtr Lvi 4.4/4.7 G2.1.7: ARility to evaluate plant performance and make operational judgments Ibased on operating characteristics, reactor behavior, and instrument interpretation.
295031 Reactor Low Water Level/2 X
X EK3.04 Knowledge of the reasons for the following 4.0/4.3 responses as they apply to REACTOR 3.9/4.5 LOW WATER LEVEL: Steam cooling G2.2.39: Knowledge of less than or equal to one hour Technical Specification action statements for systems.
295037 SCRAM Condition Present X
EA2.03: Ability to determine and/or interpret the 4.3/4.4 and Reactor Power Above APRM following as they apply to SCRAM Downscale or Unknown /1 CONDITION PRESENT AND REACTOR POWER ABOVE APRM DOWNSCALE OR UNKNOWN: SBLC tank level 295038 High Off-site Release Rate / 9 X
EK3.02: Knowledge of the reasons for the following 3.9/4.2 responses as they apply to HIGH OFF-SITE RELEASE RATE: System isolations
- 600000 Plant Fire On Site /8 X
AA1.01: Ability to operate and / or monitor the 3.0/2.9 following as they apply to PLANT FIRE ON SITE: Respirator air pack 700000 Generator Voltage and Electric Grid X
X AK1.03: Knowledge of the operational implications 3.3/3.4 Disturbances / 6 of the following concepts as they apply to GENERATOR VOLTAGE AND ELECTRIC 3.6/3.6 GRID DISTURBANCES: Under-excitation AA2.04: VARs outside capability curve KIA Category Totals:
6 2
4 3
3 2
Group Point Total:
2
/
/
h.
0 4
3
/
7
Form ES-401 1 3
ES-401 I ES-401 BWR Examination Outline Form ES-401-1
~,
2 (RO/ SRO)
E/APE # / Name / Safety Function K
K K
A A
G KIA Topic(s)
IR 1
2 3
1 2
- 295002 Loss of Main Condenser Vac / 3 X
AKl.04 Knowledge ofthe operational implications ofthe 3.0/3.3 following concepts as they apply to LOSS OF MAIN CONDENSER VACUUM: Ingreased offgas flow 295007 High Reactor Pressure / 3 X
G2.1.7: Ability to evaluate plant performance and make operational judgments based on 4.4/4.7 operating characteristics, reactor behavior, and instrument interpretation.
295008 High Reactor Water Level / 2 X
AK2.03: Knowledge of the interrelations between 3.6/3.7 HIGH REACTOR WATER LEVEL and the following - Reactor water level control 295009 Low Reactor Water Level / 2 X
AK2.01: Knowledge of the interrelations between 3.9/4.0 LOW REACTOR WATER LEVEL and the following - Reactor water level indication 295010 High Drywell Pressure / 5 X
AK1.03: Knowledge of the operational implications of 3.2/3.4 th~ following concepts as they apply to HtGH DRYWELL PRESSURE -
~
Temperature increases
- 295011 High Containment Temp / 5 295015 Incomplete SCRAM / 1 X
AA2.02: Ability to determine and/or interpret the 4.1/4.2 following as they apply to INCOMPLETE SCRAM: Control rod position 295022 Loss of CRD Pumps / 1 X
AA2.02 Ability to determine and/or interpret the 3.3/3.4 following as they apply to LOSS OF CRD PUMPS* CRD system status 295032 High Secondary Containment X
EK3.01: Knowledge of the reasons for the following 3.5/3.8 Area Temperature / 5 responses as they apply to HIGH SECONDARY CONTAINMENT AREA TEMPERATURE - Emergency/normal depressurization 295034 Secondary Containment X
EA1.03: Ability to operate and/or monitor the 4.0/3.9 Ventilation High Radiation / 9 folloWing as they apply to SECONDARY CONTAINMENT VENTILATION HIGH RADIATION - Secondary containment ventilation
- 295036 Secondary Containment High X
EA2.03: Ability to determine and/or interpret the 3.4/3.8 folloWing as they apply to SECONDARY Sump/Area Water Level / 5 CONTAINMENT HIGH SUMP/AREA WATER LEVEL - Cause of the high water level KIA Category Point Totals:
2 2
I I
I 1
Group Point Total:
7
/
/
2 3
\\
\\
\\
(
ES-401 4
Form ES-401*1
(
(
J ES-401 BWR Examination Outline Form ES-401-1 Plant Svstems - Tier 21Group 1 (RO / SRO)
System #1 Name K
K K
K K
K A
A A
A G
KIA Topic(s)
IR 1
2 3
4 5
6 1
2 3
4 203000 RHRlLPCI: Injection X
X K5.02: Knowledge of the operational 3.3/3.7 Mode implications of the following concepts as they apply to RHRlLPCI: INJECTION MODE (PLANT SPECIFIC) - Core cooling methods 3.213.4 A2.01: Ability to (a) predict the impacts of the following on the RHRlLPCI: INJECTION MODE (PLANT SPECIFIC) ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations* Inadequate net positive suction head 205000 Shutdown Cooling X
K2.01: Knowledge of electrical power 3.1/3.1 supplies to the following - Pump motors
- 206000 HPCI X
2.4.18: Knowledge of the specific bases for 3.3/4.0
~
- 209001 LPCS X
X K3.02: Knowledge of the effect that a loss 3.8/3.9
~r malfunction of the LOW RO and SRO Change PRESSURE CORE SPRAY SYSTEM will have on following:
X ADS logic 4.0/4.7 2.2.22 Knowledge of limiting conditions V for operations and safety limits.. v 2.2.37 Ability to determine operability and/or availability of safety related equipment.
3.6/4.6
- 212000 RPS X
A4.02: Ability to manually operate and/or 3.6/3.7 monitor in the control room:
Perform svstem functional testes)
- 212000 RPS X
K1.12: Knowledge of the physical 3.4/3.6 connections and/or causeeffect relationships between REACTOR PROTECTION SYSTEM and the following: Reactor/turbine pressure control system
- 211000 SLC X
K5.06: Knowledge of the operational 3.0/3.2 implications of the following concepts as they apply to STANDBY LIQUID CONTROL SYSTEM - Tank level measurement 212000 RPS X
A2.15: Ability to (a) predict the impacts 3.7/3.8 of the following on the REACTOR PROTECTION SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations - Load rejection
(
2150031RM X
A4.07: Ability to manually operate and/or 3.6/3.6 monitor in the control room -
Verification of proper functioning/
operability 215004 Source Range Monitor X
K4.01: Knowledge of SOURCE RANGE 3.7/3.7 MONITOR (SRM) SYSTEM design feature(s) and/or interlocks which provide for the following - Rod withdrawal blocks 215005 APRM / LPRM X
A3.03: Ability to monitor automatic 3.3/3.3 operations of the AVERAGE POWER RANGE MONITOR/LOCAL POWER RANGE MONITOR SYSTEM including - Meters and recorders 217000 RCIC X
X K1.01: Knowledge of the physical 3.5/3.5 connections and/or causeeffect relationships between REACTOR CORE ISOLATION COOLING SYSTEM (RCIC) and the following
- Condensate storage and transfer system A2.05: Ability to (a) predict the impacts 3.3/3.3 of the following on the REACTOR CORE ISOLATION COOLING SYSTEM (RCIC) ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations - D.C. power loss 218000 ADS X
A2.01: Ability to (a) predict the impacts of 4.1/4.3 the following on the AUTOMATIC DEPRESSURIZATION SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations - Small steam line break LOCA 223002 PCIS/Nuclear Steam X
X K4.08: Knowledge of PRIMARY 3.3/3.7 Supply Shutoff CONTAINMENT ISOLATION SYSTEM/NUCLEAR STEAM SUPPLY SHUT-OFF design feature(s) and/or interlocks which provide for the following - tManual defeating of selected isolations during specified emergency conditions K6.08: Knowledge of the effect that a loss or malfunction of the following will 3.5/3.7 have on the PRIMARY CONTAINMENT ISOLATION SYSTEM/NUCLEAR STEAM SUPPLY SHUT-OFF - Reactor protection system 239002 SRVs X
K6.03: Knowledge ofthe effect that a loss or 2.7/2.9 malfunction ofthe following will have on the RELIEF/SAFETY VALVES -
A.C. power: Plant-Specific 259002 Reactor Water Level X
A1.05: Ability to predict and/or monitor 2.9/2.9 Control changes in parameters associated with operating the REACTOR WATER LEVEL CONTROL SYSTEM controls including -
FWRV/startup level control position
(
261000 SGTS X
A1.02: Ability to predict and/or monitor 3.1/3.2 changes in parameters associated with operating the STANDBY GAS TREATMENT SYSTEM controls including - Primary containment pressure 262001 AC Electrical X
X K3.04: Knowledge of the effect that a loss 3,1/3.3 Distribution or malfunction of the AC.
ELECTRICAL DISTRIBUTION will have on following - Uninterruptible power supply A2.03: Ability to (a) predict the impacts of 3.9/4.3 the following on the AC.
ELECTRICAL DISTRIBUTION; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations - Loss of off-site power 262002 UPS (AC/DC)
X X
K1.16: Knowledge of the physical 3.1/3.2 connections and/or causeeffect relationships between NINTERRUPTABLE POWER SUPPLY (AC.lD.C.) and the following ~ MSIVs K3.02: Knowledge of the effect that a loss 2.9/2.0 or malfunction of the UNINTERRUPTABLE POWER SUPPLY (AC.lD.C.) will have on following - Recirculation pump speed 263000 DC Electrical X
K2.01: Knowledge of electrical power 3.1/3.4 Distribution supplies to the following - Major D.C. loads 264000 EDGs X
X K5.06: Knowledge of the operational 3.4/3.5 implications of the following concepts as they apply to EMERGENCY GENERATORS (DIESEUJET) - Load sequencing 2.4.41: Knowledge of the emergency 2.914.6 action level thresholds and classifications 300000 Instrument Air X
2.1.20: Ability to interpret and execute 4.614.6 procedure steps 400000 Component Cooling X
K1.03: Knowledge of the physical 2.7/3.0 Water connections and / or cause-effect relationships between CCWS and the following - Radiation monitoring systems KIA Category Point Totals:
4 2
3 2
3 2
2 2
1 2
3 Group Point Total:
26/
/
/
5 3
2
ES-401 5
Form ES-401*1
(
ES-401 BWR Examination Outline Form ES-401-1 Plant Systems - Tier 2/Group 2 (RO / SRO)
System # / Name K
K K
K K
K A
A A
A G
KIA Topic(s)
IR 1
2 3
4 5
6 1
2 3
4 201001 CRD Hydraulic 201002 RMCS X
A2.02: Ability to (a) predict the 3.2/3.3 impacts of the following on the REACTOR MANUAL CONTROL SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Rod drift alarm 201003 Control Rod and Drive X
AI.02: Ability to predict and/or monitor 2.8/2.8 Mechanism changes in parameters associated with operating the CONTROL ROD AND DRIVE MECHANISM controls including: CRD drive pressure 201004 RSCS 201005 RCIS 201006 RWM 202001 Recirculation X
AI.09: Ability to predict and/or monitor 3.3/3.3 changes in parameters associated with operating the RECIRCULATION SYSTEM controls including: Recirculation pump seal pressures 202002 Recirculation Flow Control 204000 RWCU 214000 RPIS
- 2150.01 Traversing In-core Probe X
Traversing In-Core Probe 4.6/4.3 G2.1.31: Ability to locate control room switches, controls, and indications, and to determine that they correctly reflect the desired plant lineup..
215002 RBM 216000 Nuclear Boiler Inst.
X A2.07: Ability to (a) predict the 3.4/3.5 impacts of the following on the NUCLEAR BOILER INSTRUMENTATION; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences ofthose abnormal conditions or operations: Reference leg flashing 219000 RHRlLPCI: Torus/Pool X
KI.09: Knowledge ofthe physical 3..3/3.4 Cooling Mode connections and/or causeeffect relationships between RHRILPCI:
TORUS/SUPPRESSION POOL COOLING MODE and the following: Nuclear boiler instrumentation 223001 Primary CTMT and Aux.
(
226001 RHRlLPCI: CTMT Spray X
A2.03: Ability to (a) predict the impacts 3.1/3.1 Mode ofthe following on the RHR/LPCI: CONTAINMENT SPRAY SYSTEM MODE; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Valve closures 230000 RHRlLPCI: Torus/Pool Spray Mode 233000 Fuel Pool Cooling/Cleanup X
Fuel Pool Cooling and Clean-up 3.7/4.7 G2.4.6: Knowledge ofEOP mitigation strategies 234000 Fuel Handling Equipment 239001 Main and Reheat Steam X
K3.09: Knowledge ofthe effect that a 3.6/3.7 loss or malfunction ofthe MAIN AND REHEAT STEAM SYSTEM will have on following:
Steam bypass capability
- 239003 MSIV Leakage Control
- 241000 ReactorlTurbine Pressure X
K5.05 Knowledge ofthe operational 2.8/2.9 Implications ofthe following Regulator concepts as they apply to REACTORfI1JRBINE
.r..
PRESSURE REGULATING SYSTEM: Turbine inlet pressure vs. turbine load 245000 Main Turbine Gen. / Aux.
256000 Reactor Condensate X
AJ.08: Ability to monitor automatic 3.1/3.1 operations ofthe REACTOR CONDENSATE SYSTEM including: Feedwater temperature 259001 Reactor Feedwater 268000 Radwaste 2710000ffgas X
K3.01: Knowledge ofthe effect that a 3.5/3.5 loss or malfunction ofthe OFFGAS SYSTEM will have on following: Condenser vacuum
- 272000 Radiation Monitoring X
Radiation Monitoring System 3.9/4.3 G2.2.14: Knowledge of the process for controlling equipment confijluration or status.
- 286000 Fire Protection X
K2.02: Knowledge of electrical power 2.9/3.1 supplies to the following:
Pumps:
288000 Plant Ventilation 290001 Secondary CTMT 290003 Control Room HVAC 290002 Reactor Vessel Internals X
K6.06: Knowledge ofthe effect that a 3.0/3.2 loss or malfunction ofthe following will have on the REACTOR VESSEL INTERNALS: Relief/safety valves KIA Category Point Totals:
1 1
2 0
1 1
2 1
1 0
2 Group Point Total:
12
/3
/
/
2 1
(
ES-401 Generic Knowledge and Abilities Outline (Tier 3)
Form ES-401-3 Facilitv:
Date of Exam:
Category KIA #
Topic RO SRO-Only IR IR 2.1.1
- Knowledge ofconduct of operations requirements 3.8 X
1.
2.1.4
- Knowledge of individual licensed operator responsibilities 3.8 X
Conduct of Operations related to shift staffing, such as medical requirements, "no-solo" operation, maintenance lof active license status, 10CFR55, etc 2.1.7
- Ability to evaluate plant performance and make operational 4.7 X
judgments based on operating characteristics, reactor behavior. and instrument interoretation 2.1.17
- Ability to make accurate, clear, and concise verbal reports 3.9 X
2.1.19 Ability to use plant computers to evaluate system or component 3.9 X
status Subtotal 3
2 2.2.4 (multi-unit license) Ability to explain the variations in control 3.6 X
board/control room layouts, systems, instrumentation, and procedural actions between units at a facility 2.
2.2.6 3.6 X
Equipment
- Knowledge of the process for making changes to procedures Control 2.2.12
- Knowledge ofsurveillance procedures 3.7 X
2.2.18 Knowledge ofthe process for managing maintenance activities 2.6 X
during shutdown operations, such as risk assessments, work prioritization, etc 2.220 Knowledge of the process for managing troubleshooting 3.8 X
activities Subtotal 3
2 2.3.6 Ability to approve release permits 3.8 X
2.3.12 Knowledge of radiological safety principles pertaining to licensed 3.2 X
3.
operator duties, such as containment entry requirements, fuel Radiation handling responsibilities, access to locked high-radiation areas, Control aligning filters, etc.
2.3.14 Knowledge of radiation or contamination hazards that may arise 3.4 X
during nonnal, abnormal, or emergency conditions or activities 2.3.15 Knowledge of radiation monitoring systems, such as fixed 3.1 X
radiation monitors and alarms, portable survey instruments, oersonnel monitorine:1 eQuioment etc Subtotal 2
2 2.4.9 Knowledge oflow power/shutdown implications in accident (e.g.,
3.8 X
loss ofcoolant accident or loss ofresidual heat removal) 4.
mitigation strategies Emergency 2.4.27 Knowled2e of "fire in the plant" procedures 3.9 X
Procedures /
Plan 2.4.45 Ability to prioritize and interpret the significance of each 4.1 X
annunciator or alarm Subtotal 2
1 Tier 3 Point Total 10 7