ML18032A266: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
(One intermediate revision by the same user not shown)
Line 15: Line 15:


=Text=
=Text=
{{#Wiki_filter:ES-401N Written Examination Review Worksheet Form ES-401N-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
{{#Wiki_filter:ES-301                                  Administrative Topics Outline                          Form ES-301-1 Facility: Vogtle Units 3&4                                            Date of Examination: 07/2016 Examination Level:      RO                                          Operating Test Number:
: 4. Job Content Flaws
Administrative Topic (see Note)
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred.Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnlyGen                1. Received first 25 questions from the licensee on 6-10-15. Provided feedback to licensee on 6-22-15. Gen                2. We need electronic copies of the reference material listed in ES-201. The web-link you provided doesn't include all the items listed in ES-201. Gen                3. For modified bank questions, please provide copy of the original (unmodified) bank question with the supporting information. Gen                4. Provide the administrative procedure that describes the expectations/requirements for entering AOPs; AOPs list symptoms/entry conditions.                  5. Received 2 nd batch of questions (Q#26 - 75) from the licensee on 9-2-15. Provided feedback on Q#s 26-42 to licensee on 9-18-15.                                  6. Provided feedback on Q#s 1-75 to licensee on 10-23-15. Items in yellow are either 1) previously approved test items were additional flaws were identified during the review of subsequent test items or 2) previously unresolved items.                 
[ Type Cod&
Describe activity to be performed Detetmine    if you  can replace a  watch stander due to illness using NMP-AD-0 16 Conduct of Operations M, R    and NMP-AD-01 6-003.
G2.1.5           2.9 Review heatup data that was logged using 3-RCS-OTS-005, to identify any errors and Conduct of Operations N, R    determine  if plant heatup rates have been violated.
G2.1.17          3.9 Perform  SR 3.1.6.2 and 3.1.6.3 in N, R    accordance with    3-GEN-OTS-17-002.
Equipment Control G2.2.$            3.7 Determine total projected dose and determine  if a CVS A    makeup pump oil Radiation Control M, R    addition can be performed without exceeding any radiological limits.
G2.3.4            3.5 NOTE:    All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).
* Type Codes    & Criteria:          (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs:    4 for SROs  & RO retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1; randomly selected)


Instructions [Refer to Section D of ES-401N and Appendix B for additional information regarding each of the following concepts.]
ES-301                              Administrative Topics Outline                          Form ES-301-1 Facility: Voqtle Units 3&4                                        Date of Examination: 07/2016 Examination Level:      SRO                                        Operating Test Number:
: 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1(easy)  - 5 (difficult); (questions with a difficulty of 2 - 4 are acceptable). 3. Check the appropriate box if a psychometric flaw is identified: * "Stem Focus": The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information) * "Cues": The stems or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.). * "T/F": The answer choices are a collection of unrelated true/false statements. * "Cred. Dist": The distractors are not credible; single implausible distractors should be repaired, more than one is unaccepta ble. * "Partial": One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified: * "Job Link": The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).   * "Minutia": The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). * "# / Units": The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). * "Backward": The question requires reverse logic or application compared to the job requirements.
Administrative Topic (see Note)           Type            Describe activity to be performed Code*
: 5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable) 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401N Section D.2.f. 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
Determine if you can replace a watch stander dcte to illness using NMP-AD-O1 6 Conduct of Operations M, R    and NMP-AD-016-003. (Same as RO)
G2.1.5           3.9 Determine if current conditions allow Mode 4 entry based on a review of IDS battery Conduct of Operations N, R    surveillances.
G2.1.21        4.4 Perform SR 3.1.6.2 and 3.1.6.3 in accordance with 3-GEN-OTS-17-002 Equipment Control N, R    (Same as RO) and then evaluate Technical Specification requirements, as necessary.
G2.2.2$        4.6 Determine total projected dose and determine if a CVS A makeup pump oil Radiation Control addition can be performed without M, R    exceeding any radiological limits.
(Same as RO)
G2.3.4          3.6 Classify an emergency event and complete N, R    the SNC Emergency Notification Form.
Emergency Plan G2.4.32          4.6 NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).
Type Codes & Criteria:           (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RD retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1; randomly selected)


ES-401N 2 Form ES-401N-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
ES-301                            Control Roomlln-Plant Systems Outline                    Form ES-301-2 Facility: Vogtle Units 3&4                                         Date of Examination: 07/2016 Exam Level: RD                SRO-l          SRO-U                Operating Test No.:
: 4. Job Content Flaws
Control Room Systems:* 8 for RO; 7 for SRO-l; 2 or 3 for SRO-U System / JPM Title                              Type Code*        Safety Function
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly1 F 2 x  x        N U S T1G1:  ES-0.1, EA2.01 1. Q=K/A:  This K/A may not be applicable to Vogtle 3 & 4 because the evaluation of neutron flux following a reactor trip is performed in E-0, Step 2.b, not in ES-0.1 Step 29. ES-0.1 doesn't include any evaluation of neutron flux. As currently presented, the 2 nd part of the question doesn't test beyond Tier 2 knowledge of when SR detectors auto-energize. incorporated 2. Stem Focus: The 1 st fill-in-the-blank statement uses the word "considered", which is not well defined. deleted 3. Stem Focus: The first bullet says the reactor was manually tripped spuriously?  This isn't operationally valid. Accepted as-is after discussion. 4. Cred Dist: The only justification for the 1 st part of Choices C/D (lowering at (-) 1/3 dpm) was that this was a "commercially accepted method" for verifying the reactor was not critical. Is there a Vogtle 3 & 4 procedure that uses this criterion?  FR-S.1 uses rod bottom lights; perhaps this is a better distracter. incorporated 5. 9-18-15:  Resolved all comments; Put power above P-6, but less than P-10, and asked if ES-0.1 requires energizing. SAT Question is sat as of 9/18/2015.
: a. Recover a dropped control rod.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly2 H 2 x x  x        M E/U S T1G1: A-313, G2.4.4 1. Please provide governing procedure that describes the philosophy of "when" an AOP is required to be entered; AOP entry seems subjective. For example, "Hotwell Level Lowering" is also listed as a symptom/entry condition in the AOP; however, the crew wouldn't necessarily always be required to enter the AOP for this condition. Revised to test entry conditions. 2. Cue/ Cred Dist:  The phrase "unexpectedly rises" in the 4 th bullet is a cue that AOP entry is required; anytime something "unexpected" occurs, AOP entry is normally justified. Consequently, the 1 st part of Choices B/D (AOP entry isn't required) is not plausible. The stem needs to provide information for the applicants' to identify (e.g, steam dump valve position, etc.) that the cool down was unexpected. Verbiage


deleted. Removing the words "unexpectedly rises" makes Choice D a correct answer; therefore, the question is somewhat subjective. Q modified to ensure only one answer. 3. Operational Validity:  Cool down rates are always evaluated in any ONE HOUR; rates provided in the stem are instantaneous only. The distracter analysis for GOP limits doesn't match the GOP; GOP limits are 50
== Description:==
ûF in any 60 minute period (not 50
The unit is at 70% power and rod H14 has fully dropped into the core. The candidate is directed to re-align rod H10 to its bank at 184 steps in accordance with 3-AOP-104 (Rod Control System Malfunction) Attachment 2 (Move Individual Rod N S or Group to Realign Rods).
ûF/hr). Incorporated. 4. Stem Focus: The stem needs to place the event into more context, for example, 1 st bullet says that GOP-205 is in progress; 3-MSS-SOP-001, Attachment 5, Section 4.3, Establish Plant Cool down in Steam Pressure Mode, is also in progress, and may add plausibility to NOT entering the AOP. Also, 3-RCS-OTS-XX-005, RCS Heat up and Cool down Surveillance Testing, is in progress, and may add plausibility to NOT entering the AOP. Stem conditions modified. 5. Provide copy of Modified Bank Question. Not yet provided, but Q modified during review process. 6. 9-18-15: Fixed question to show an erroneous steam dump valve position. All comments resolved. SAT Question is sat as of 9/18/2015.
Pre-JPM brief required.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
SF1 DRCSA4.09          RO/SRO4.0
: 4. Job Content Flaws
: b. Perform ES-O.1 (Reactor Trip Response)
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly3 F 2    x      x  N E/U S T1G1:  A-336 AK1.07 1. Q=K/A:  The test item's link between Main and Startup FW and AOP-402 is weak since PMS Malfunction mitigative strategy applies to ALL PMS malfunctions; the K/A requires testing the applicants' knowledge of how a PM S malfunction is identified for Main & Startup FW, including how to remedy. The proposed test item is missing the malfunction identification piece as it relates to Main & Startup FW. Suggest writing a question that includes a screen shot of the PMS screen, so that the applicant has to identify that  Startup FW isolation did/did not occur to better hit the K/A. Revised Q.
 
KA is met. 2. Cred Dist: The plausibility of Choice B (locally positioning SGS-V067A is the first option) is questionable because the fill-in-the-blank statement says "will first be closed"; local manipulation is never the first option. Q revised. 3. This question may overlap the same knowledge as Q#10. Question is sat as of 10/28/2015. 4 H 2    x        N E/U S T1G1:  E-1 EA1.05 1. Cred Dist:  To make the 1 st part of Choices A/B (1 st stage valve positions are correct at 1001) plausible, re-work the fill-in-the blank statements and stem question as follows: WOOTF completes both statements? At 1001, both ADS First Stage valve positions _______ as expected. With the above conditions, enabling the DAS Control Panel and manually actuating ADS Stage 1 from DAS _________ send an open signal to RCS-V001B Incorporated. 2. Please provide DAS logic that supports second half of question.
== Description:==
Done. 3. 9-18-15:  Comments incorporated; SAT Question is sat as of 9/18/2015.
The unit has been manually tripped due to a failed open CMT outlet valve. The crew has performed E-0 and transitioned to ES-0.1. The candidate is directed to perform ES-0.1. When Step 6 is entered, the B spray valve fails partially        A, L, N, S          2 open and the flowpath cannot be isolated requiring RCPs to be secured.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
SF2 RCS A1.01 RO/SRO 4.1        SF2
: 4. Job Content Flaws
: c. In accordance with AOP-103 reduce RCS pressure
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly5 H 2    x    x    N U S T1G1:  A-342 AK2.02 1. Cred Dist:  Choice A (raise 1C and 1D speed to 88%) is not plausible because raising speed is never required in Mode 3. OK based on GOP-303. 2. Cred Dist: Choice B (immediately restart tripped pumps) is not plausible because the reason for the spurious trip is unknown; conservative decision making eliminates this Choice. Additionally, the status of the following parameters are not provided in the stem to make Choice B plausible:  CCS availability, Surge Tank level  Bearing temps  Stator temps  Vibrations prior to trip Incorporated. 3. #/units:  The UNID and label names of the safety related breakers and non-safety related breakers is missing from Choices C/D. For example, the non-safety related breakers are the VFD Switchgear Breakers.
 
Q revised. 4. 9-18-15:  Kept safety/non-safety, but eliminated redundant information. SAT Question is sat as of 9/18/2015.
== Description:==
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
The unit has been shutdown due to a steam generator tube leak. The candidate is directed to lower RCS pressure in accordance with 3-AOP-1 03 (Steam Generator Tube A EN L M Leak) to less than 1 920 psig. RCPs are secured so Auxiliary          ,      ,  ,        3 spray must be used. Auxiliary spray alignment fails, therefore ADS Stage 1, Division A must be used to lower pressure.
: 4. Job Content Flaws
SF3 ADS A4.04 RO/SRO 4.1
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly6 H 3 x  x        B E/U S T1G1: A-337 AK3.01 Note to NRC Reviewers:  The "reason" for determining CMT valves' status is that CVS makeup flow cannot be reduced if CMT valves are open; thus the K/A portion related to the "reason" is indirectly being met. 1. Cred Dist: The 1 st part of Choices A/B (return makeup to normal) is not plausible because Pzr Level is too low. Suggest modifying Pzr level value in the stem to remedy. Q revised. 2. Stem Focus:  The stem is missing power level and/or unit status. Power added. 3. Stem Focus:  Suggest swapping the order of the fill-in-the-blank statements so that the first fill-in-the-blank statement is related to Identified vs Pressure Boundary Leakage. Incorporated. 4. Need to verify that AOP-109 preceding steps have CVS makeup flow already aligned to max rate; otherwise re-word the 1 st fill-in-the-blank statement as CVS makeup flow _________ (is / is NOT) required to be returned to normal. Reviewed - OK. 5. 9-18-15:  Comments incorporated; SAT Question is sat as of 9/18/2015.
 
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
U. Respond to Condensate System Malfunctions in accordance with AOP-202
: 4. Job Content Flaws
 
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly7 H 1 x  x        N U S T1G1:  A-343 AA2.03 1. Job-Link:  The procedure for Mode 5 isn't AOP-115; it's 3-EOP-SDP-2, Response to Loss of RNS During Shutdown. Is the crew allowed to be in AOP-115 in Mode 5? 2. Cue and/or LOD=1:  The test item does not test the applicants' ability to evaluate CCS flow. Instead, the stem tells the applicant that RNS Hx A Flow (CCS-FT-301) is zero, which cues the applicant to CCS-V301A is required to be opened. As written, this is LOD=1 because a pump tripped, and, in order to re-establish cooling, another pump should be started and cooling water aligned to the heat exchanger. 3. Cred Dist:  The 1 st part of Choices C/D (crew NOT required to start RNS Pump A) is not plausible because there is no auto-start feature on decay heat removal, since this adds positive reactivity. 4. Cred Dist:  Choice C is not plausible because of the interplay between the 1 st and 2 nd parts of this choice. IF the plausibility of the 1 st part is that the pump auto-started, THEN V301A would either auto-align or already be aligned open. 5. Partial:  The stem does not include the status of the cavity; flooded cavity does not have any requirements for re-establishing cooling. Suggest incorporating the following element to hit the K/A: In accordance with Step 13 (Align CCS for RNS Cooling), the operator is required to Check RNS HX CCS Flow (CCS-FT-301/302) greater than _______. (2800 gpm)
== Description:==
: 6. 9-18-15:  Re-wrote question; SAT Question is sat as of 9/18/2015.
The Unit is at 59% reactor power with CDS Pump A degraded. The candidate is directed to perform 3-AOP-202 (Condensate System Malfunctions) due to the reduced discharge pressure on CDS Pump A. During performance, CDS Pump A            A, N, S   4S will trip and CDS Pump C will have a sheared shaft, requiring the candidate to manually run back the unit. Once the run back is complete, CDS Pump B will trip, requiring a manual Reactor Trip.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
SF4S CDS A4.04 RO/SRO 2.8
: 4. Job Content Flaws
: e. Respond to lowering CCS surge tank level in accordance with AOP-702
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly8 F 2 x x  x x      N E S T1G1: ES-0.2 EK3.18 1. Partial:  Because RCS Void Growth is a concern in ES-0.2, re-word the 1 st fill-in-the-blank statement to ensure Choice C is incorrect: In accordance with3-EOP-ES-0.2-B, Background Information for 3-EOP-ES-0.2, the reason RCS pressure is required to be maintained at its present value at Step 44 is to ______.
 
Q modified. 2. Stem Focus:  the last portions of each Choice are not necessary. For example:  A. allow placing RNS in service for shutdown cooling B. prevent RCS void formation and subsequent CMT injection Q modified. 3. Stem Focus:  The 2 nd bullet is confusing and not an operationally valid way of presenting the information; suggest providing hottest un-isolated CMT temperature.
== Description:==
Q modified.
The Unit is at 80% reactor power with CCS surge tank level is lowering. The candidate is directed to perform 3-AOP-702 (Loss of Component Cooling Water) to address the lowering surge tank level. Manual surge tank makeup is             A, N, S    8 unsuccessful therefore requiring the candidate to manually trip the reactor, manually secure CCS pump A, and manually secure RCPs.
: 4. 9-18-15:  Re-wrote question; SAT Question is sat as of 9/18/2015.
SF8A317 AA1.01        RO/5R03.4 Respond to a loss of power in accordance with AOP-302
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
 
: 4. Job Content Flaws
== Description:==
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly9 H 2    x        N E S T1G1:  FR-S.1 EK1.05 1. Cred Dist:  Choice D (RCPs not running; V108A closed) is not plausible because IF RCPs are off (due to CMT actuation), THEN the PRHR Hx is always open. Q revised. 2. Stem Focus: Add "Reactor Power is 100%" to the stem initial conditions. Incorporated. Alternate Suggestion (just one option): One of the relationships between FR-S.1 and the Safeguards System is this:  At Step 8 of FR-S.1, IF Safeguards has actuated, the crew is required to EXIT FR-S.1 because all of the necessary boration (CMT) and auto-isolations (FW, Dilution Paths,Cnmt Air Filtration) are already sufficient to mitigate the ATWS; no other FR-S.1 actions are necessary. Therefore, if Lo Tcold (Safeguards Actuation) value was provided in the stem, then the applicant could decide whether to continue in FR-S.1 or to exit FR-S.1. 3. 9-18-15:  Replaced 2 nd fill-in-the-blank statement. Reworked to ensure not SRO-only. SAT Question is sat as of 9/18/2015. 10 H 3           N ?
The Unit is shutdown with a plant cooldown in progress when a loss of plant power occurs. The candidate is directed to respond to the loss of power using 3-AOP-302 (Loss of AC Power). Standby Diesel B fails to start. SWS and CCS N S       6 loads fail to start on Standby Diesel A and must be manually started using Attachments in AOP-302. Additionally, IDS 24 hr battery chargers must be manually loaded.
S T1G1:  E-3 EK2.05 1. Why does the 2 nd fill-in-the-blank statement list time at 10:25?
SF6 ZOS A2.18 RO 3.0 SRO 3.4
What's the significance of five minutes after the Safeguards Signal?  Ensures out of gray area for valve stroking. 2. It is operationally valid that RCS pressure rises to 1982 psig during max cooldown evolution IF small tube leak with auxiliary spray failure. Yes. 3. 9-18-15:  This question may overlap with RO Q#3. Overlap evaluated as OK. Question is sat as of 11/05/2015.
: g. Verify Containment Isolation in accordance with FR-Z.3
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
 
: 4. Job Content Flaws
== Description:==
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly11 H 2 x  x x       N E S T1G1:  E-2 G2.2.30 1. Partial and/or Cred Dist: The stem doesn't specify the size of the steam leak (steam flow values, etc.); does "swell" occur when a large MSL break occurs?  If so, then Choice C is also correct. Not at 1001:00 - OK. 2. Partial:  Choice B is also correct because the wording of E-2, Step 7 is "trending to 58.5%...go to E-1."  Review this procedure step basis again. (Procedure may need revision to use the word "controlled.")  Q modified. 3. Partial: The time 10:01 is not the same as "initially."  The times provided to the applicants in the stem need to also include the seconds values to ensure no one interprets this question to mean one second later. By providing the seconds values, we ensure that the applicants understand sixty seconds has elapsed. The word "initially" should be eliminated. Seconds added. 4. Stem Focus:  Provide normal secondary radiation values in the stem. Q modified. 5. 9-18-15:  Reworded to test how MSIV Bypass failure affected subsequent plant operations; SAT Question is sat as of 9/18/2015. 12 H 2         x  B U S T1G1:  A-301 AK3.04 1. Q=K/A:  The 2 nd part of the question is the part that targets the K/A; however, because of the 2 nd fill-in-the-blank wording, the only thing being tested is that Xenon is building in, which requires positive reactivity insertio
The unit was tripped due to a small RCS leak.
: n. This is the plant specific portion of the written exam; therefore, some plant specific information to hit the K/A must be tested.
Entry into 3-FR-Z.3 (Response to High Containment Radiation) is required. The candidate is directed to perform 3-FR-Z.3.
Suggest changing the 2 nd fill-in-the-blank statement to test the reason for why Rod Control is placed in the Low Power Mode, for example: The reason why rods are placed in the Low Power Control Mode is / is NOT  to maintain power constant. Second half replaced.
During performance, VFS valve failures require the candidate to  EN, L, D, S 9 restore a ventilation tlowpath for VAS by securing VFS-MA-O1A, closing the failed valves, and starting VFS-MA-02B.
: 2. 9-18-15:  Comments incorporated; SAT Question is sat as of 9/18/2015.
FR-Z.3 EA1.03 RO/SRO 3.1
: h. Establish Shutdown cooling with RNS Train A
 
== Description:==
Plant conditions have been established to align RNS Train A for shutdown cooling. The candidate is directed to establish shutdown cooling using RNS Train A in accordance with 3-RNS-SOP-O01.
L,D,S                4P Pre-JPM brief required.
(RO ONLY)
SF4P RNS A4.01 RO 3.6 In-Plant System& (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)
Perform PCS-SOP-OO1, Attachment 7 (Filling PCCWST from FPS)
 
== Description:==
Locally aligns the FPS to the PCCWST. Manually starts the MDFP from the Main Fire Protection Panel. Secures                N                   5 filling the PCCWST (at the discretion of the examiner).
PCS A2.07 RO/SRO 2.8
: j. Perform A0P402 (Malfunction of PMS)
 
== Description:==
The unit tripped from 100% due to a RCP heat exchanger leak to CCS. CCS Isolation failed from the MCR and AOP-402 has been performed up to local operator actions to                 E, N                7 operate 3 CCS containment isolation valves from the CIMs.
A-336 AA1 .03 ROISRO 2.7
: k. Perform local valve operations to support cooling the IRWST with RNS
 
== Description:==
Locally manipulate necessary valves to align RNS                                4P N R for IRWST cooling.
RNS G2.1.27 RO/SRO 4.4 All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
Type Codes                              Criteria for RO / SRO-l / SRO-U
 
(A)lternate path                              4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank                            9/814 (E)mergency or abnormal in-plant                1 I 1 / 1 (EN)gineered safety feature                  1 I 1 / 1 (control room system)
(L)ow-Power I Shutdown                          1 /1 I 1 (N)ew or (M)odified from bank including 1 (A)              1 (P)revious 2 exams                              3 I 3 I 2 (randomly selected) fR)CA                                          1 / 1 I 1 (S) im u lator
 
ES4OIN                                        AP-1000 Examination Outline                            Form ES4OIN-2 Facility:     Vcc le.. LLj 3              4/v.       UbM&Ct3 Date of Exam:          ewJer 20LS RO K/A Category Points                                  SRO-Only_Points Tier            Group        KKKKKKAAAA C*                A2          G      Total 1   2 3 4 5 6 1                2 3 4                Total 1                  1                                                                18                      3        6 Emergency &
2                                                                                                4 Abnormal                                        N/A                   NIA Evokitions        Tier Totals    4- 5 5                    5  4-                      27                              10 1         ZZ213333                                                28        3            2-       5 Plant 2          Il)jljl                                        0      10,øI2                          3 Systems Tier Totals    3 3 4            3 3 4 4 4 4 3                        38        S          3        8
: 3. Generic Knowledge and Abilities              1        2         3                          1      2    3    4 10 Categories                                                                                    j 3                  3                        -
Note:      1. Ensure that at least two topics from every applicable K]A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each KIA category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category)
: 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final 7t        point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.
The final RO exam must total 75 points and the SRO-only exam must total 25 points.
: 3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do fl. not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not induded on the outline should be added. Refer to Section D.1.b of ES-401N for guidance regarding the elimination of inappropriate K/A statements.
: 4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group 1iL        before selecting a second topic for any system or evolution.
: 5. Absent a plant-specific priority, only those K/As having an importance rating (lR) of 2.5 or higher shall be IZ        selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
: 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
: 7. The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must
      $tft... be relevant to the applicable evolution or system. Refer to Section 0.1 .b of ES4OI N for the applicable K/As.
: 8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings 4zA_      (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Ue duplicate pages for RO and ORO-enly eisms-                  - - e/a
: 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and 1S71-    point totals (#) on Form ES4OI N-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
G* Generic K/As ES4O1 N, Page 38 of 51
 
ES4OIN                                                        2                                    Form ES4OIN-2 ES-4QlN.2 Emergency and Abnormal Plant Evolutions Tier 1/Group I E/APE#/Name/Safeyjj0                            Krr<    A A [        K/A Topic(s)                              IR  #
E-0, Reactor Trip or Safeguards fi            1 21 Actuatjon/ 1,2,3,4 ES-0.1, Readormp Response / 1, 2, 3,                                () A2.0 I 4
ES-I .3, ADS Stage 1 3 Actuation Response 13
  / ES-1.4, ADS Stage 4 Actuation V  Response /3 A-313, Uncontrolled Cooldown /4                                1U Z5Ac 2.4.4 A-336, Malfunction of Protection and                               A 141.o7 Safety Monitoring System /7                                      5) AG Z.i I?
El,LossofCoolantAccjd ent,23                      A        (R) EAI.GS              fs) EZ.%.t7
    #342, Reactor Coolant Pump Malfunction/1, 2, 34                      I              __L I A-337, Passive RHR Heat Exchanger        ]                I I(P.)AK3        .0!
Leak/4                                      I                    I A-343, Loss of Normal Residual Heat        F                      R)    AA2.o3 Removal/4                                  I A-317, Loss of Component Cooling Water    I
    /8 ES-02, Natural Circulation Cooldown / 4                            CR)    K. lJ FR-S.1, Responseto Nudearpower           fP                          R Eif.0 Generation / 1                              I E-3, Steam Generator Tube Rupture /3 1                        CR) EK 2.05 E-2, Faulted Steam Generator Isolation /4 if                        SP  E L Z. Z. 30 A-301, Rapid PowerReduchonhi if                        ) 41(3.04.
A-307, DAS Operations at Local Cabinets                              f?,)ftft4. Dl V
rII P.            I
    /7 FR-C.i, Response to Inadequate Core                      9 I        .5Eicz.g          CS) EA2. 04.
Cooling /4 A-323, Loss of6.9 kV, 4160 V, or480 V                    R I        P.) AA .04 Bus Power/6                                  j            &#xa3; I      (5)AA2.03 ES-li, PassiveSafety5jj                                      j P. CP)Ez.4.3y Termination /3                              I A-345, Loss of Nuclear Service Water /4 A-329, Loss of (nstwmenfur/8 I [
S        (S)AAZp4.
ECA-I.I, Loss of Coolant Accident Outside Containment /3 s Ls) &#xa3;cz.4.24 SDPl,ResponsetoLoSsofR CS        jI                        JEKl.a2.
Inventory During Shutdown /2                 I       I SDP-2 Response to LOSS of RNS During      J          Jj Shutdown / 4                                          I K/A Category Totals:
13 I 11        Group Point Total:                            18/6 51W                    33 ES-401 N, Page 39 of 51
 
ES-401, REV 9                                          TIGI PWR EXAMINATION OUTLINE                                                  FORM ES-407-2 KA            NAME I SAFETY FUNCTION                IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO A-301AK3.04    Rapid Power Reduction              3                        E D            Placing Digital Rod Control System in Low Power Mode A-307AA1.Ol    DAS Operation At Local Cabinets    3.40                                      Passive Core Cooling System A-31 3AG2.4.4f Uncontrolled Cooldown              4.54.7                                   Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.
A-323AA2.04    Loss of 6.9KV, 4160 Volt, or 480                                            Battery, battery charger, and battery bus status and/or Volt Bus Power                                                              voltage A-336AK1 .07  Malfunction of Protection and      2.7                                      Main and Startup Feedwater System Safety Monitoring System A-337AK3.0l    Passive Residual Heat Removal      3.3                                      Determining whether core makeup tank discharge Heat Exchanger Leak                                                          isolation valves are open A-342AK2.02    Reactor Coolant Pump Malfunctions 3.1                                      Reactor coolant pump trip in mode 3, 4, or 5 A-343AA2.03    Loss of Normal Residual Heat                                                Component Cooling Water System to Normal Residual Removal                                                                      Heat Removal System heat exchanger flow E-l EA1 .05    Loss of Reactor or Secondary      3.8                                      Diverse Actuation System Coolant E-2EG2.2.30J  Faulted Steam Generator Isolation 4.2   4.4                                Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.
E-3EK2.05      Steam Generator Tube Rupture      3.5                                      Allowing Reactor Coolant System pressure to rise above 1970 psig after safeguards are blocked below P-ll, Pressurizer Pressure Below 1970 psig Page 1 of 2                                              02/04/2015 2:23PM
 
ES-401, REV 9 TIGI PWR EXAMINATION OUTLINE                                                FORM ES-401-2 KA                NAME I SAFETY FUNCTION                IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO ES-0.1EA2.0l      Reactor Trip Response              3.4  3.7                                Neutron flux ES-0.2EK3. 18     Natural Circulation Cooldown      3.1        DEI                            Terminating the Reactor Coolant System depressurization to minimum allowable ES-i .1 EG2.4.39tPassive Safety System Termination 4.24      DDE DEEDED Ei                  Ability to verify system alarm setpoints and operate controls identified in the Alarm Response Procedure.
FRC.1EK2.i1      RespoJo1oadequate-Cere          3.3 eDoffng
  -z.oI                                                                                        IZNc                      e FR-S.1 EK1 .05    Response to Nuclear Power        3.9          D D D D D D D D E D          Engineered Safeguards Actuation System Generation ATWS SDP-l EK1 .02    Response to Loss of RCS          3.4        DDDDDDDDDD                      Containment System Inventory During Shutdown SDP-2EA1 .03      Response to Loss of Normal        3.1      DDDDDDEDD                        Chemical and Volume Control System tOE related)
Residual Heat Removal System During Shutdown Page 2 of 2                                              02/04/2015 2:23 PM
 
ES-401, REV 9                                          SRO TIGI PWR EXAMINATION OUTLINE                                                FORM ES-401-2 KA            NAME I SAFETY FUNCTION                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO A-323AA2.03    Lossof6.9KV,4l6OVolt,or480          2.4  3.4                                  Standby diesel generator load Volt Bus Power A329AA2.O4    Loss of Instrument Air                3.23.2                                    Reactor Coolant System temperature, steam generator level, and/or steam generator pressure (OE related)
A-336AG2.2.191 Malfunction of Protection and Safety 0    4.2                                Knowledge of the bases in Technical Specifications for Monitoring System ED D D limiting conditions for operations and safety limits.
E-l EG2.l .7  Loss of Reactor or Seconda          4.4  4.7 EDDDDDDDDD                      Ability to evaluate plant performance and make Coolant                                                                        operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.
FR-C.l EA2.04  Response to Inadequate Core          3.7  3.5 EDDDDDDLDD                      Pressurizer level and/or Reactor Coolant System hot leg Cooling                                                                        level FR-H.lEG2.4.,  ResponsetoLossofHeatSink            4.2  4.1    D D D D D D D DD            Knowledge of annunciator alarms, indications, or response procedures.
Page 1 of 1                                              02/04/2015 2:23 PM
 
ES4OIN                                                      3                            Form ES-401N-2 ES4OIN                                        AP-l000 Examination Outline                      Form ES4O1N-2 Emergency and Abnormal Plant Evolutions Tier IlGroup 2 E!APE #1 Name! Safety Function                                      G      K/A Topic(s)              lR  #
A-31 1, Rod Control System Malfunction / 1 A-308, Loss of Control Room AC! B A-320, Loss of Circulating Water/8                      P              (P%)AK.3&#xe7; A-302, Emergency Boration / I A-327, Startup Feedwater System Malfunction /4 A-328, Malfunction of Feedwater Heaters and Extraction Steam / 4 FR-LI Response to High Pressurizer Level /2 A-314, Fuel Handling lnUdent! 6                                          ) AK3. 02.
A-304, Steam GeneratorTube Leak!3                                    S    (5) 2.. l.J!7 A-333, Main Turbine Malfunction / 4 FR-Z.I Response to High Containment Pressure /
5 SDP4, Response to Rising Nudear Flux During CR) E.A2. .P4 Shutdown/I                                                  S      (5) AZ. DI SDP-5, Response to RCS Cold Overpressure During Shutdown / 3 SDP-6 Response to Unexpected RCS                                          C P.) E KZ.04 Temperature Changes During Shutdown /4 A-306, Evacuation of Control Room! 8                                P. (R) Ac2.4.4 A-318, Condensate System Malfunctions! 4                    P.          CR) AAt. 09 FR-C-2, Response to Degraded Core Cooling /4 FR-C.3, Response to Saturated Core Cooling /4      1k                    (1k)  1< I .o FR-H.2, Response to Steam Generator Overpressure /4 FR-Z.2, Response to Containment Flooding! 5 FR-Z.3, Response to High Containment Radiation /
9
/  FR-Z.4, Response to Low Containment Pressure!                              CR) E I2 .01 5
A-332,TurbineTnpwithoutReactorTnp/4                                ?      (5)AZ.q ES-i .2, Post LOCA Cooldown and Depressurization /4 A-321, Loss of Data Display and Processing System / 7 FR-P.l Response to Imminent Pressurized Thermal Shock Condition /3 A-340, Reactor Coolant Leak / 2 U  FR-1.2, Response to Low Pressurized Level /2 U  FR-I .3, Response to Voids in Reactor Vessel /2    =                    L 5) EAZ. 02.
ES401 N, Page 40 of 51
 
ES4OIN                                                    4                                      Form ES4OIN-2 ES4OIN                                      AP-l000 Examination Outline                              Form ES4O1N-2 Emergency and Abnormal Plant Evolutions Tier llGroup 2 (RO I SRO)
/
EIAPE#/Name/SafetyFunction A-326, Eeedwater System Malfunctions / 4 KI A        G*
[  KIATopic(s)                      IR  #
V  A-331 Loss of plant DC Power or Batteries /6              R              CR) AA I. O.
/  A-348, Degraded Grid /6 Group Point Total:                    9/4 KIA Category Totals:
2.
22.
ES4O1N, Page 41 of 51
 
ES-401, REV 9                                      TIG2 PWR EXAMINATION OUTLINE                                                FORM ES-401-2 KA            NAME / SAFETY FUNCTION              IR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO A-306AG2.4.4J Evacuation of Control Room      4.5  4.7                                Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.
A-314AK3.02  Fuel Handling Incidents                                                  Maintaining pressurizer/reactor cavity level and/or spent fuel pool level A-31 8AA1 .09 Condensate System Malfunctions  2.5                                      Steam Generator Blowdown System controls A-320AK3.07  Loss of Circulating Water      3.3                                      Reducing turbine load A-331AA1.02  Loss of DC Power or AC          2.90                                      12OVAC Distribution Panels 1E Instrument Power FR-C.3EK1 .08 Response to Saturated Core      3.1                                      Reactor Coolant System Cooling FR-Z.4EK2.01  Low Containment Pressure        3.1  0                                    Containment integrity
[] fl SDP-4EA2.04  Response to Rising Nuclear Flux 3.6  3.7                                  Reactor Coolant System boration flow During Shutdown SDP-6EK2.04  Response to Unexpected RCS      3.3                                      Component Cooling System failure Temperature Changes During Shutdown Page 1 of 1                                            02/04/2015 2:23 PM
 
ES-401, REV 9                                        SRO TIG2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA            NAME I SAFETY FUNCTION                IR      Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO A-304AG2. 1.17 Steam Generator Tube Leak          3.9  3.8                                  Ability to use available indications to evaluate system or component status.
A-332AG2.l .7  Turbine Trip Without Reactor Trip 4.4    4.7                                  Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.
FR-l.3EA2.02  Response to Voids in Reactor      2.9    3.3                                  Reactor Coolant System temperature and pressure Vessel SDP-4EA2.Ol    Response to Rising Nuclear Flux  3.6    3.9                                  Reactor Coolant System boron and/or shutdown margin During Shutdown                                                                (OE related)
Page 1 of 1                                              02/06/2015 8:10AM
 
ES4OIN                                                    5                                    Form ES4OIN-2 ES4OI N                                        AP-1 aDO Examination Ou e                            Form ES-401 N-2 Plant Systems Tier 2/Group 1 0 SRO KKKKKKAAAA                        G*
System Name / Safety Function                                              K/A Topic(s)                      lR    #
1 2 3    4  5  6  1  2 3  4 (p.) AZ .3)
Reactor Coolant/2, 4 Steam Genet0tI4                  -
CR)    1(3.01.
Normal Residual Heat RemovaV4 Passive Residual Heat Removall4 PassiveCoreCooling/2 W                              fs)Az.I(.
Component Cooling Water! 8 Pressurizer Pressure Control / 3 R)A3 .0, Automatic Depressunzation / 3 W tR) G. 2. I. 2 I Reactor Trip System /7 R)
Engineered Safeguards Actuation                                  tPJ A3.13                             
/2 R)AZ.02.
DiverseActua&#xfc;on/7 Passive Containment Coong / 5 CR) P4.o I MainSteam/4 CRH4I.04 Main and Startup Feedwater/4 ACElecthcalDistribution/6       
                                                          $ R            (R A3.03 1.5) A2.OZ ClasslEandNoniEDCand                                                  (R)gL,.02 UPS/6 Onsite Standby Power System /6  g, (P.) .i .02. Cs) kZ .
Service Water/4                                      -  - -      i    P.) 1(4.0(0    Csy 2.4.q.
Compressed Air/B F) )<4.O Containment System /
Reactor Coolant Pump/4 CII.)  1(5.02 Chemical and Volume Control/i,    F..                                  (R) K2 .04 2
K/A Category Point Totals:            3  .      7_ 3 3            3      Group Point Total:                      28/5 SRO                                      2.
ES401 N, Page 42        of  51
 
ES-401, REV 9                                          T2GI PWR EXAMINATION OUTLINE                                                FORM ES-401-2 KA          NAME / SAFETY FUNCTION:                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO ADSG2.1.2l/  Automatic Depressurization          4.3  4.4 EEEEDEEEEE                      Ability to perform general and/or normal operating System                                                                        procedures during any plant condition.
CASA1 .03      Compressed Air System              2.9                                        Instrument air supply pressure CASK3.17      Compressed Air System              3.1                                        Passive Core Cooling System (OE-related)
CCSG2.4.4  I  Component Cooling Water System    4.5    4.7 DEED                EEE        Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.
CNSK4.07      Containment System                3.3                                        Containment evacuation CVSK2.04      Chemical and Volume Control        3.7        EEEEtEEEE                      Containment isolation valves System DASA2.02      Diverse Actuation System          3.33.5    EEEEEJJEEE                      Reactor and turbine trip ECSAT          AC Electrical Distribution Systems 3.6        EEEiiEEEEE 17I -o$IOl oC      Tit(    A 34A4 03 ESASA3. 13    Engineered Safeguards Actuation    4.3        EEEEEEEEE                      Passive Residual Heat Removal Heat Exchanger System                                                                        Actuation ESASK6. 13    Engineered Safeguards Actuation    4.1                                        Passive Containment Cooling System Actuation System FWSA2.33      Main and Startup Feedwater        2.6  3.1  EEEEEEEEE                      Startup feedwater pump low and high flow System Page 1 of 3                                              02/04/2015 2:23 PM
 
ES-401, REV 9                                      T2GJ PWR EXAMINATION OUTLINE                                                FORM ES-401-2 KA          NAME / SAFETY FUNCTION:              IR    Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RD    SRO FWSA4.06      Main and Startup Feedwater                                    D E        Startup feedwater control valve System IDSK6.02      Class JE and Non 1E DC and                                              Class 1 E battery charger failure UPS Systems MSSK1 .04    Main Steam System              3.2                                      Engineered Safeguards Actuation System PCSA4.01      Passive Containment Cooling  4.3                                        Passive Containment Cooling System Actuation System PPCSA3.01    Pressurizer Pressure Control  3.6                                        Pressurizer normal spray valve operation System PRHRA1 .01    Passive Residual Heat Removal 3.2        EIDEEJE              E E        Passive Residual Heat Removal System heat exchanger System                                                                  pressure PXSA4.16      Passive Core Cooling System  4.4                                        Reactor Trip Actuation PXSG2.4.271  Passive Core Cooling System  3.84                                      Knowledge of Non-Licensed operator tasks during an  -
EDEDEEJE                        emergency and the resultant operational effects.
RCPK5.02      Reactor Coolant Pump System  2.7                      DEEDED          Changing reactor coolant pump speed on pressurizer normal spray flow RCSA2.31      Reactor Coolant System        3.6    3.7 EDDIE                          Reactor vessel flange leakage RNSK3.01      Normal Resklual Heat Removal  2.8        EEEE DEEDED                    Chemical and Volume Control System System Page 2 of 3                                              02/04/2015 2:23PM
 
r ES-401, REV 9                                      T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION:              IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G  TOPIC:
RO    SRO RTSK3.06      Reactor Trip System            3.5                            E          Passive Core Cooling System RTSK5.03      Reactor Trip System            4.3                                        Anticipated transient without scram coincident with turbine trip failure SGSA1 .05    Steam Generator System        3.4                                        Reactor Coolant System temperature SGSK2.04      Steam Generator System        2.8                                        MSIV hydraulic pump SWSK4.06      Service Water System          2.7                  fl                    Service Water System tower makeup ZOSK1.02      Onsite Standby Power System    3.1                                        Main AC Power System Page 3 of 3                                              02/04/2015 2:23 PM
 
ES-401, REV 9                                      SRO T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION                  IR    Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO      SRO ECSA2.02    AC Electrical Distribution Systems  3.7    4.1                                Loss of offsite power PXSA2.16    Passive Core Cooling System        3.8    4.3 DDE DEED                        Core makeup tank discharge isolation valve SGSG2.4.39  Steam Generator System            4.24        DEE EIDDD                      Ability to verify system alarm setpoints and operate controls identified in the Alarm Response Procedure.
SWSG2.4.14j  Service Water System              3.4    4.1 DEIE EDEID                      Knowledge of Emergency/Abnormal Operating Procedures layout, symbols, and icons.
ZOSA2.Ol    Onsite Standby Power System      2.8  - 2.9                                Standby Diesel and Auxiliary Boiler Fuel Oil System E D D DEED Page 1 of 1                                              02/04/2015 2:23 PM
 
ES4OIN                                                          6                                Form ES4OIN-2 AP-l000 Examination Ou    e                            Form ES401 N-2 ES-401 N Iant Systems -Tier2lGroup2 RO SRO                                  =
                              .      KKKKKKAAAAG*
K/A  Topic(s)                            IR  #
System Name / Safety Function                          1  2    3  4 2  3  4  5  6 CR) AZ .l        () 2.4-. 3 Digital Rod Control/I Pressurizer Level Control / 2
() AZ .
Rod  Position Indication/I            P.                              LR)  142.03 Incore Instrument System  17 Containment Air Filtration /8 Containment Hydrogen Control    I 5
CR) K3 .01 Main Control Room HVAC /8 Spent Fuel Pool Cooling  /8 Condensate  /4 P.      ( i) A3 .0 I                               
                                                                                .G,.og CondenserAirRemoval/4 Main Turbine and Main Turbine      g                                  CR) 14 I. Og Control/4 Fuel Handling /8 (P.) Al . 02.
Gaseous Radwaste    /9 Radiation Monitoring /7 Circulating Water/8                                                    ) 144.0I                              -
Fire Protection /8 (P.) IC.o3 Steam Dump Control System/4 Nudear Instrumentation System    /                                    C          . oz      C ) AZ. 09 Liquid Radwaste System    I9 K/A Category Point Totals:
IL!I                I      Group Point Total:
[
SRt                        :2.
ES-401 N, Page 43 of 51
 
ES-401, REV 9                                        T2G2PWR EXAMINATION OUTLINE                                                    FORM ES-401-2 KA          NAME I SAFETY FUNCTION                IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO      SRO CDSA3.Ol    Condensate System                2.7        DEDDDDEEDD                      Condensate pump start CMSK6.08    Condenser Air Removal System      2.6                                        Condenser vacuum breakers CWSK4.01    Circulating Water System          3.1        DDE DDD DEED                    C-9, Condenser Available DRCSA2.19    Digital Rod Control System      3      3.8 EDDDDDDDDD                      Group demand position indication failure MTSK1.08    Main Turbine and Main Turbine    2.6          ED DEEDED ED                Main Steam System Control Systems NISA4.02    Nuclear Instrumentation System    3.7        DDDDDDDDDD                      Block Intermediate Range Neutron Flux High Reactor Trip RPISK2.03    Rod Position Indication System  2.8      ---j DEEDED DDE                  Digital rod position indication coils SDCSK5.03    Steam Dump Control System        3.5            D D E        D    D D D D    Changing steam flow effect on reactor power VESK3.Ol    Main Control Room HVAC          3.6        DDDDDDDDDD                      Control room habitability WGSA1 .02    Gaseous Radwaste System          2.5        DDDDDDDEDD                      Carbon bed and/or vault temperatures Page 1 of 1                                                02/04/2015 2:23 PM
 
ES-401, REV 9                                    SRO T2G2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 NAME I SAFETY FUNCTION              tR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO DRCSG2.4.36  Digital Rod Control System      4.1  43                                  Ability to prioritize and interpret the significance of each annunciator or alarm.
NISA2.09    Nuclear Instrumentation System  3.5  3.6                                Power Range nuclear Instrumentation detector failure (OE-related)
PLCSA2.08    Pressurizer Level Control System 3.8                                      Loss of coolant accident Page 1 of 1                                                02/06/2015 8:10AM
 
ES4OIN                          Generic Knowledge and Abilities Outline (Tier 3)        Form ES4OIN-3 Facility: Vogte- Aiwf          3s4  /Vc- 5e44e1          jc3        Date of Exam: Nov. .ZOLS
                                                        .                                RO_____    SRO-Only Category          KIA#                          Topic IR      #    IR      #
2.1.      LOC4Ah-CIe..)    ..
* d    csbie- tofre&+ tinecp 44 2.1.      Vrt,2.                    R&4&#xe7;                    37 Condu of            2.1. 2. .turtk 1k M4k,                qLLTf...                              4.2.
Operations Lvcak enik-                      .Q crtv%                            4.D Subtotal                                                                        2-.
2.2. 5    Tc        kou1i di\)Me 2.2. 3    (61viS 2.2.30    i1Crp                            Cta-                4.2.
2.
Equipment          2.2.
Control 2.2. 2.. peL c.odwfs        t.U. SD t Pwr                                4.
2.2.%                              > Ikr T&      .e4I:6vls                    4*&#xe7; Subtotal                                                        3 2.3.      &vik t4 1e44..                                      3.g 2.3.      (nd3, F4LL I              A, t_IJ1    fr-.        3.2 Radiation Control 2.3.      Q.ft,. M Ut                                                        3. 1 Subtotal                                                                          I 2.4.      it9vtj/M?vWM          iitnc,      Mbvt1    noes    .g 2.4.                  pri-)iw /kA              (mtvtc 4
Emergency 2.4. 3$
2.4.
                                      /I2e.ji utw                      reS ri4L      .2 Procedures I Plan 2.4.5    i4arwi,    Akiwrwi4 jgrj VnCc        fr1.wtwW.
2.4.            iAD    L4M3J4 D?5 Subtotal                                                        3              2-Tier 3 Point Total                                                                          10      7 ES-401N, Page44 of 51
 
C ES-401, REV 9                                  13 PWR EXAMINATION OUTLINE                                                    FORM ES-401-2 KA          NAME I SAFETY FUNCTION        IR      Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO G2.l.18    Conductofoperations        4.6  4.3  D D D D D D E E D D              Ability to locate control room switches, controls, and indications, and to determine that they correctly reflect the desired plant lineup.
G2.l .33    Conduct of operations      3.73.8    DDDDDDEDDE                      Knowledge of the stations requirements for verbal communications when implementing procedures.
G2.2.15    Equipment Control          2.6  3.8                                  Knowledge of the process for managing troubleshooting activities.
G2.2.23    Equipment Control          3.6  4.5                                  Knowledge of conditions and limitations in the facility license.
G2.2.30    Equipment Control          4.2    4.4                                  Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.
G2.3.5      Radiation Control          3.8    4.3                                  Ability to control radiation releases.
G2.3.6      Radiation Control          3.2  3.7                                  Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, or aligning filters.
G2.4.15    Emergency Procedures/Plans  3.8  4.3                                  Knowledge of the operational implications of Emergency/Abnormal Operating Procedures warnings, cautions, and notes.
G2.4.l 7    Emergency Procedures/Plans 3.6    4.4                  DDE ED          Knowledge of the bases for prioritizing safety functions during abnormal/emergency operations.
G2.4.38    Emergency Procedures/Plans 4.2    4.2  DEEDED DDDD                      Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material Page 1 of 1                                                02/04/2015 2:23 PM


Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
ES-401, REV 9                                SRO T3 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION          IR   Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
: 4. Job Content Flaws
RO    SRO G.2.3.9      Radiation Control          2.9   3.1 DDEDDDDEEE                      Knowledge of radiation monitoring systems, such as fixed radiation monitors and alarms, or personnel monitoring equipment.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly13 H 2    x x      N U S T1G1: A-307 AA1.01 1. Partial:  IF the CETs are lowering, THEN there may be no correct answer. CETs lowering means that some form of cooling is established. Why would you continue to blow squib valves if CETs are lowering?  Why go to the RNO? Another way to think about this is IF the local DAS switch attempt was NOT successful (and CETs were still lowering) wouldn't the operator STILL be required to use the blasting device cables/crank handle method of actuating IRWST since the normal method of firing the squib valves failed?  It looks like the intent of RNO Step 9.f is to use an alternate method to blow the squib valves. The previous method of using the local DAS switches means that the squib valves must be blown. IF you get to RNO Step 9.f, aren't the squib valves still required to be blown when the CETs are lowering? Second half replaced. 2. Cred Dist:  The 1 st part of Choices B/D (IRWST actuation NOT required) is not plausible because the wording of AOP-602, Step 9 is provided in the stem. Q modified. 3. 9-18-15:  Changed question to test whether IRWST/Stage 4 actuations is/is not required; SAT Question is sat as of 9/18/2015.
G2.1 .22      Conduct of operations      3.9   4.2                                Ability to interpret reference materials, such as graphs, curves, tables.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
G2.1 .27      Conduct of operations                                                Ability to locate and operate components, including local controls.
: 4. Job Content Flaws
G2.2.2       Equipment Control          4.6  4.1                                 Ability to manipulate the console controls as required to operate the facility between shutdown and designated power levels.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly14 F 2   x  x    x  N U S  T1G1:  FR-C.1 EK2.11 1. Job-Link and/or Q=K/A:  There may be an issue with the K/A Catalog for this K/A because the implementing procedure for aligning RNS to the CLP is 3-EOP-ES-1.4, Stage 4 Actuation Response, Step 20. Instead, the K/A catalog links FR-C.1 to aligning RNS to the CLP. Nevertheless, the K/A requires testing the operational implication or cause effect relationship of reaching the CLP low level.
G2.2.26      Equipment Control                4.7                                Ability to determine and/or interpret Technical Specifications with action statements of greater than one hour.
Is the K/A Catalog implying that the PACE of getting thru C.1, and then transitioning to ES-1.4, is important to conserve IRWST inventory?  We need to discuss whether there are any other points in the EOPs (other than ES-1.4) that direct RNS alignment to the CLP. The only place that has the CLP low level (15%) termination criteria appears to be ES-1.4. KA met. 2. Cred Dist:  The 1 st part of Choices A/B (CVS can inject from the Cask Loading Pit) is not plausible because these pumps don't have a suction from the Cask Loading Pit. Q modified. 3. Cred Dist:  The 2 nd part of Choices B/D (trying to conserve accumulator inventory after ADS Stages 1-3 have actuated and a DVI line break) is not plausible because the RCS is already depressurizing and accumulators will have already released their contents when RCS pressure lowered; therefore, there is no reason to conserve accumulator inventory. Q modified. 4. 9-18-15:  Future Memo to APOG that K/A Catalog needs revising, changed K/A number and kept topic; got rid of accumulator and changed to SFP cooling pump; SAT Question is sat as of 9/18/2015. 15              N S T1G1: A-323 AA2.04
G2.4.5        Emergency Procedures/Plans 3.7    4.3 DDE        DDDEEE              Knowledge of the organization of the operating procedures network for normal, abnormal, and emergency evolutions.
G2.4.7        Emergency Procedures/Plans 8      4.5 DEDDE                          Knowledge of how Abnormal Operating Procedures are used in conjunction with Emergency Operating Procedures.
Page 1 of 1                                                02/04/2015 2:23PM


Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
ES-401N                          Record of Rejected K/As                          Form ES-401N-4 Tier/Group Randomly Selected KA                          Reason for Rejection Overlaps with ZOS KI.02 and A323 AA2.03. Randomly selected T / GI    ECS A3 03 ECSA3.0l.4/6/2015 Changed K/A, to correctly match the original intent of FR-C. I TI / GI    fR-C.l EK2.I I          EK2.l I, due to procedural changes and subsequent K/A catalog additions. Selected ES-I.4 EK2.0I. 9/18/2015
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly16 H 3    x      x  N E/U S T1G1:  ES-1.1 G2.4.39 1. Q=K/A:  IF the annunciator was associated with an actual CVS isolation signal, THEN the K/A match would be unquestionable. However, in the proposed test item, the Letdown Hx Outlet Temp Hi annunciator isn't applicab le to evaluating ES-1.1, Step 3.d (RNO) because high temp doesn't ever auto-isolate letdown. Please provide justification as to how this annunciator being in alarm aids the operator when performing ES-1.1, Step 3.d. We may need to replace the generic portion of this K/A because the link between annunciator response procedures and ES-1.1 is may not be possible. Q modified. 2. Cred Dist:  The 1 st part of the proposed test is not plausible because Letdown Hx Outlet Temp Hi never causes an automatic letdown isolation. Suggest changing the annunciator to an annunciator that is associated with a CVS isolation. Q modified. 9-18-15:  Moved in accordance with ES-1.1 to only the 2 nd fill-in-the-blank; SAT Question is sat as of 9/18/2015. 17 H 3 x          N E S T1G1:  SDP-1 EK1.02 1. Stem Focus:  Revise the 7 th bullet to delete the words "has been"; change to "is." Incorporated. 2. Stem Focus:  Add the word "slowly" at the end. Incorporated.
: 3. Stem Focus:  The term "MODE 6" can be deleted since the 2 nd bullet already says the vessel head is NOT on the flange. Deleted flange piece instead. 4. Stem Focus:  Swap the order of the 5 th and 6 th bullets to chronologically flow better. Incorporated. 5. 9-18-15:  Comments incorporated; SAT Question is sat as of 9/18/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly18 H 2 x  x        N U S T1G1:  SDP-2 EA1.03 1. Cred Dist:  The 1 st part of Choices C/D (CVS won't be used) is not plausible because of the wording of the 1 st fill-in-the-blank statement. In other words, the stem tells the applicant (at 1030) that Step 36 (Refill RCS Using CVS Makeup) is required. Therefore, the correct choice can only be that CVS will be used, even if only one pump is available. Suggest using the word "sufficient" in the 1 st fill-in-the-blank statement to remedy. Changed Step. 2. Stem Focus:  Add a reason to the 1 st bullet (why are we draining the RCS? Is there fuel in the vessel?) in the stem to add context to the question. Added. 3. LOK:  It seems that this may be more than Fundamental (as marked on the distracter analysis
; consider changing to Higher Level. OK 4. 9-18-15:  Comments incorporated; higher cog question; SAT Question is sat as of 9/18/2015. 19 F 1    x x      N U S T1G2:  A-320 AK3.07 1. Cred Dist and/or LOD=1:  Based on the information in the stem, none of the distracters are plausible, that is, since TCS/GCS/turbine temperatures/vibrations, etc., are not provided in the stem, Choices A, B, and D are not plausible. Q replaced. 2. Partial:  To ensure Choice C is absolutely correct, include the title of the basis document in the stem question instead of only including AOP-203. Q replaced. Suggest testing the REASON fo r reducing turbine load in accordance with Step RNO 3.b, which is to maintain vacuum less than 7 " hg (vs 9" hg). Be careful to script the question such that it asks for the way the procedure is worded, to avoid a subset issue. Q replaced. Alternatively, there may be no way to write a discriminating question at the RO level and the K/A may need to be replaced. 3. 9-18-15:  Kept K/A but wrote question to test whether reducing load/turbine trip was was not required; the "reason" is thereby being indirectly tested; SAT Question is sat as of 9/18/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly20 H 2            N U S T1G2:  A-314 AK3.02 1. Cred Dist:  The 2 nd part of Choices A/C (SFS pumps is reason to check PZR level > 19.5%) is not plausible because the Step asked for PZR level (not SFP level). OK Do SFS pumps lose suction for a given PZR level? Or is PZR level off-scale low when SFS pumps lose suction? 2. 9-18-15:  Licensee explained how reason was to ensure level above flange; SAT Question is sat as of 9/18/2015. 21 H 1            N U S T1G2:  SDP-4 EA2.03 1. Cred Dist and/or LOD=1:  The stem needs to include PZR Level below the auto-makeup set point to add plausibility to  the 1 st part of Choices A/B (No Makeup Flow at 1000). As written, this is not plausible (LOD=1) because the stem says Borating the RCS wasn't started until 1005. Added. 2. Cred Dist and/or LOD=1:  The stem needs to include some item that can be misconstrued as why the CVS Manual Makeup Isol and Boron Dilution Block signals are unable to be reset to add plausibility to the 2 nd part of Choices B/D (No Makeup Flow at 1005). As written, this is not plausible (LOD=1) because the stem says Borating the RCS began at 1005; therefore, there has to be makeup flow. Q modified. 3. #/units:  The 1 st bullet should be replaced with the actual name of the annunciator. Incorporated. 4. 9-18-15:  One of the licensee's boration methods (CMT) does not indicate makeup flow; Comments incorporated; SAT Question is sat as of 9/18/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly22 F 2 x  x x      N U S T1G2:  SDP-6 EK2.04 1. Cred Dist:  Choices C/D are not plausible because they're too large; the values in these choices represents a HUGE heat up. Incorporated. 2. Partial:  To avoid partially correct answers, provide times down to the second values (put zero seconds on all times) to ensure "RCS temperature remained within +/- 5
&#xfb;F band in the last 10 minutes.." can't be used to make an post exam appeal. Incorporated. 3. Stem Focus:  Need to add the initial RCS temperature to the Given Conditions bullet. Incorporated. 4. 9-18-15:  Licensee changed temperatures; comments incorporated; SAT Question is sat as of 9/18/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly23 F 3 x  x x  x    N U S T1G2:  A-306 G2.4.4 1. Q=K/A:  This question does not test the applicants' ability to recognize abnormal SYSTEM operating parameters that require entry to AOP-601, or any other AOP. One opportunity to test this K/A, for example, is the radiation limit/value that requires entry to AOP-601 from AOP-905. If site-specific rad value is not available at this time, are there ways to test the Alert light, Hi alarm light, etc. without testing the site specific rad-value. We need to explore ways to hit this K/A, because we may not be able to repl ace the K/A if the reason is solely due to plant reference materials not being ready. Q


replaced. 2. Cred Dist: The 1 st part of Choices A/B (crew will stay in the main control room and continue with ES-0.1) is not plausible because the stem says the control room must be evacuated. Q
ES-401N                                              Written Examination Quality Checklist                                Form ES-4O1N6 Facitty,  \J        j_                          Date of Exam                            Exam LeveL          HO              SRO InitiSt tern  Description a
1          Questions and answers are technically accurate and applicable to the facility 2           a      NRC (lAs are referenced for all questions b    Facitity earning oectives are retereirced as availabte 3          SRO questions are appropriate in accordance mth Section 02 cI of ES-401 4          Tire sampllng process was random and systematic (If more than tour HO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRRINRO OL program office) 5          Question duplication from the licensee screeninglsudit exam was controlled as indicated hetow Icheck the item that applies) and appears appropriate The audit exam vms systematically and randomty developed, or the audit exam vms completed before the license exam was started, or the examinations were developed independently: or the licensee certifies that there is no ctuplir;etion, or 1.)        if other (explainl 6          Bank use meets limits (no more than 75 percent trom the bank, at least 10 percent new, and the rest newer Bank    I Modified    New      ,J Ii IPt N1 IA
                                                                                                                                      /tt    /
modified), enter tfie actual HO I SRO-only question distribution(s) at right                                            ,3/
j 13 / 3 57/ q              p 7          Between 50 and 60 percent of the questions on the HO exarrr are written at the comprehension) analysis level, the Memory          CIA P
                                                                                                                        /
                                                                                                                          /      ,,j
                                                                                                                                      /      ,i/
SRO exam may exceed 60 percent if the randomly selected K/As support tIre higher cognitive levels; enter
                                                                                                  &#xe7;7 3      / O    43 / 15              Z the actual RO I SRO question distribution(s) at right.                                                                pt
: 8.        References/handouts provided do not give away answers or aid in ttre elimination of distractors
: 9.        Question content conforms to specific KA statements in the previously approved examination                -
outline and is appropriate for the tier to which they are assigned, deviations are justified
: 10.        Question psychometric quality and format meet the guidelines in ES Appendix B.                                        j 11        The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet Printed Name / Signatur
                                                                                                                    /            flute
: a. Author                                                                                      .
: 5. Facility Reeiewer C)                11}WC.1         IJMZ                                                      I Note              The facility reviewers initials or signature are not applicable for NRC-developed examinations
          #      Independent NRC reviewer initials items in Initial column c, chief exaniirier concurrence required.
ES-401N, Page 47 of 51


replaced. 3. Minutia:  The 2 nd part of the question may be minutia because knowing the number of switches is not operationally valid.
ES-401N                                              Written Examination Review Worksheet                                                  Form ES-401N-9
Please provide reason why knowing the number of switches is operationally valid. One option is to test the applicants' knowledge of whether OCS-JW-001 (MCR/RSW Xfer Switch Panel) has to be placed in the Di sable position. Another option is to test the location of JW-001. Q replaced. 4. Partial and/or Stem Focus:  To ensure everyone is clear that the 2 nd fill-in-the-blank statement is NOT referring to Main Control Room switches, re-word the 2 nd fill-in-the-blank statement as: Step 3, "Evacuate to RSR" requires a minimum of ______ transfer switches to be manipulated in Room 12S05 before plant control can be established from the Remote Workstation.
: 1. 2.       3. Psychometric Flaws           4. Job Content Flaws   5. Other 6. 7.                                   8.
Q replaced. 5. 9-18-15: Re-worked to test AOP-601, Step 7, which has transition to E-0 for loss of MFPs; SAT Question is sat as of 9/18/2015.
Q# LOK   LOD (F/H) (1-5) Stem Cues     T/F   Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                             Explanation Focus               Dist.         Link         units ward K/A Only Gen                                                                                            1. Received first 25 questions from the licensee on 6-10-15.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Provided feedback to licensee on 6-22-15.
: 4. Job Content Flaws
Gen                                                                                            2. We need electronic copies of the reference material listed in ES-201. The web-link you provided doesnt include all the items listed in ES-201.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly24 H 3 x  x x      N E/U S T1G2:  A-318 AA1.09 1. Cred Dist:  The plausibility of the 1 st part of Choices A/B (9.3 gpm) is borderline because the stem doesn't include anything that could be misconstrued as a high rad condition such as the 10 o'clock BDS-RE011 (EDI Reject Rad) or BDS-RE010 (EDI Product Rad) normal values. Incorporated. 2. Partial:  The 1 st fill-in-the-blank statement does not match 3-BDS-SOP-001, Attachment 10, Step 13; the fill-in-the-blank statement isn't specific that 140 gpm is the max flow per heat exchanger. Suggest matching the words to the procedure to avoid partially/no correct answers. Incorporated. 3. Stem Focus:  The 2 nd bullet does not provide the procedure being implemented, which is 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS. Incorporated. 4. Stem Focus:  The order of the 3 rd and 4 th bullets should be swapped to chronologically flow. Incorporated. Suggest the following: Given: At time 1000  100 % power  3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS, is in progress  BDS-RE011 (EDI Reject Rad) is xxxx  BDS-RE010 (EDI Product Rad) is xxx At time 1020  SG BD HX A Outlet Temp (CDS-TE040A) is alarming at 420&deg;F  AOP-202 (Condensate System Malfunctions) is entered WOOTF completes both statements? At 1000, the maximum allowable BDS flow rate through each heat exchanger is limited to _______ gpm. At 1021, in accordance with AOP-202, blowdown from BOTH Steam Generators ________ required to be isolated.
Gen                                                                                            3. For modified bank questions, please provide copy of the original (unmodified) bank question with the supporting information.
Incorporated. 9-18-15:  Comments incorporated; SAT Question is sat as of 9/18/2015.
Gen                                                                                            4. Provide the administrative procedure that describes the expectations/requirements for entering AOPs; AOPs list symptoms/entry conditions.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 5. Received 2nd batch of questions (Q#26 - 75) from the licensee on 9-2-15. Provided feedback on Q#s 26-42 to licensee on 9-18-15.
: 4. Job Content Flaws
: 6. Provided feedback on Q#s 1-75 to licensee on 10-23-15. Items in yellow are either 1) previously approved test items were additional flaws were identified during the review of subsequent test items or 2) previously unresolved items.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly25 H 2   x      x  N U S T1G2:  FR-C.3 EK1.08 1. Q=K/A:  The question does not test the applicants' knowledge of the relationship between the FR-C.3 procedure and the RCS; the 1 st part of the question only requires GFES knowledge of the steam tables and the 2 nd part of the question does not require any knowledge of FR-C.3. Suggest testing the applicants' knowledge of the F-0 CET temperature threshold value that requires entry to FR-C.3, or some other RCS aspect of FR-C.3. Q replaced. 2. Cred Dist:  The 2 nd part of Choices B/D (CMT temperature already stable two minutes after PXS-V014A/B & PXS-V015A/B are opened) is not plausible because only two minutes has elapsed. How long do CMTs inject cold water? Q replaced. 3. 9-18-15:  Licensee presented new question; SAT Question is sat as of 9/18/2015. 26 H 2          x  N U S T1G2:  FR-Z.4 EK2.01 1. Q=K/A:  The question does not test the applicants' knowledge of the relationship between containment integrity and the Z.4 procedure; the proposed question only tests the Tier 2 aspect of how the vacuum relief auto-actuates and the LCO requirement.
Suggest making the 2 nd fill-in-the-blank statement the first, and then test the applicants' knowledge of WHEN Z.4 requires the operators to reset containment vacuum relief and close VFS-V800A/B (that is, when containment pressure is less negative than -0.2 psig).
Q acceptable. 2. Stem Focus:  Space needed between 0.4 and psig in the last bullet. 3. Move "At 1005:00 to the stem question since it's in both fill-in-the-blank statements. 4. Note:  Because of the limited content in Z.4, this question is being accepted to meet Tier 1. Question is sat as of 10/28/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 27 H 2 x x      x  x  N E S T1G2:  A331 AA1.02 1. Cue:  The 2 nd bullet tells the applicants that the static transfer switch auto-aligned to its backup AC power source; this description of the auto-alignment is not necessary to elicit the correct response because it is a direct result of the fault/alarm on IDSA-DS-1. 2. #/units and/or Cue:  The name of t he alarm is missing in the first bullet; if the alarm provides an auto-swap signal to the static transfer switch, then the phrase "..due to a fault on IDSA-DS-1" is not necessary to elicit the correct response. 3. Stem Focus:  The 4 th bullet (AOP-303 is entered) is not necessary. 4. Q=K/A:  The modified test item does not meet the Tier 1 aspect.Comments incorporated and 2 nd part of question re-written to test panels; Question is SAT. 28 H 2    x x      M E S T2G1:  RCS A2.31 1. Partial:  Choice C may also be correct because there is no other reason why containment sump level is rising other than a stuck open RCDT relief valve. Why is containment sump level rising?
Q modified. 2. Cred Dist:  The distracter analysis said that 2 nd part of Choices B/D (AOP-112 doesn't provide guidance on isolating..) was plausible because the AOP only pr ovides guidance for isolating the INNER seal. Therefore, the 2 nd fill-in-the-blank statement should include the word "INNER" between the words "vessel" and "flange."  Q modified. 3. Cred Dist:  The fact that RCDT pressure is rising means there is no way the relief valve can be lifted. Suggest deleting the phrase "and rising." Question is sat as of 10/28/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 29 H 1    x      x N U S T2G1:  SGS A1.05 1. Cred Dist and/or LOD=1:  The 1 st part of Choices A/B (Tavg goes up when SG PORV opens) is not plausible because this cools the primary. Q modified. 2. Cred Dist and/or LOD=1:  The 2 nd part of Choices B/D (Power goes down when SG PORV opens) is not plausible because this cools the primary. Q modified. 3. Q=K/A:  The proposed test item tests GFES knowledge only; this is the site specific portion of the written exam. Q modified. Instead of testing what Tavg does, suggest testing something that happens as a result of Tavg changing. Q modified. Question is sat as of 9/18/2015. 30 F 2 x x          N E S T2G1:  SGS K2.04 1. Cue:  The 1 st fill-in-the-blank statement contains two 1's; the correct answer contains a "1."  Suggest changing the 1 st part of Choices C/D to another bus that has a "1" in it. Discussed - OK.2. Stem Focus:  Reword the 2 nd fill-in-the-blank statement to be more precise as: IF power is lost to BOTH MSIV A hydraulic pumps, THEN SGS-V040A ___(2)___ immediately close. Incorporated.
: 3. Cred Dist:  The 2 nd part of Choices A/C (closes immediately) is not plausible because of the word "immediately."  Modified Q. 4. Distracter Analysis wasn't updated after changing Choices C/D to 1DSA-EA-1. Noted. Question is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly31 H 2    x x      N E/U S T2G1:  RNS K3.01 1. Partial:  When the HX BYPASS valve fails open, what will the HX INLET temperature do at RNS-TE-013A location?  IF the temperature at this point rises, then RNS-V006A will open up more, which will make another choice correct. Q asked at a point in time. 2. Cred Dist:  The 2 nd part of Choices A/C (Disch to CVS valve stays open even if letdown temperature rises to 141
&#xfb;F) is not plausible because resin must always be protected from temperatures near 140
&#xfb;F. Temp lowered. 3. Suggest revising the question such that the 3 rd bullet doesn't TELL the applicants which way the valve failed; instead, say that the air supply to the valve has failed. This increases discriminatory value. Incorporated. Question is sat as of 10/28/2015 32 H 2    x        N E/U S  T2G1:  PRHR A1.01 1. Cred Dist:  The 1 st part of Choices C/D (PRHR Hx Press remains the same) is not plausible because the HX conditions have changed; therefore, the pressure has to change, even if minutely. Distracter Analysis points: The possibility of PZR Pressure Control keeping the pressure constant, and the possibility of the applicants' misconception of inlet valve position keeping the pressure constant are eclipsed by the fact that the PRHR Hx conditions will change, even if minutely. 2. Cred Dist:  The inter-play between the two parts of Choice C make it not plausible. If a Safeguards Actuation has occurred, then PRHR Hx pressure hasn't remained the same. 3. Cred Dist:  The interplay between the 1 st and 2 nd parts of Choice C don't make sense; IF PRHR Hx pressure is going UP, then NOT having a safeguards signal (Tcold) is not plausible. Revised question to ask about PXS-V101 and pressure change with isolating a leaking PRHR Hx; Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly33 H 2 x  x        N U S T2G1:  PXS A4.16 1. Cred Dist:  The 1 st part of Choices C/D (trip bkrs remain closed) is not plausible because a CMT actuation is a direct reactor trip. Timing adds to plausibility. 2. Cred Dist:  The 2 nd part of Choices A/C (steam injection) is not plausible because the stem does not include anything that could be misconstrued as a LOCA. Q modified. 3. Stem Focus:  The 2 nd bullet is a sentence fragment. Corrected. 4. Cred Dist:  The 1 st part of Choices C/D is not plausible because a CMT actuation always eventually causes a reactor trip (ATL discussion was that DAS CMT won't cause direct reactor trip). The CMT actuation will cause RCPs to trip (for example), which will cause a reactor trip. Timing adds to plausibility. 5. Cred Dist:  The 2 nd part of Choices A/C (CMT level lowering) is not plausible because there is not anything in the stem that could be misconstrued as a LOCA (ATL discussion was that WR level "fluctuated" anytime CMT actuated). Credibility based on PRHR actuation and RCS shrink. Question is sat as of 11/05/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 34 H 2 x        x  N E/U S T2G1:  PXS G2.4.27 1. Q=K/A:  The proposed test item tests the applicants' knowledge of AOP-109 and the status of PXS-V101 breaker; the test item is not testing the applicants' knowledge of an NLO task. Let's discuss whether changing the K/A is necessary. 2. The second fill-in-the-blank statement seems unrelated to the PRHR Hx tube leak event; why is pressurizer level rising?  The second part of the question should be related to the topic. 3. Stem Focus:  The 2 nd fill-in-the-blank statement is missing the word "auto", that is, -"received an auto-open signal." 4. Stem Focus:  The 1 st fill-in-the-blank statement should be worded as "At 1000:00, an operator _____(1)___ required to be locally dispatched to assist the MCR with isolating the PRHR Hx." 5. Cred Dist:  The 1 st part of Choices C/D (breaker is OPENED) is not plausible because at 1000:00 no isolation has occurred.
Suggest changing the 1 st fill-in-the-blank to  "at 1020:00 the PRHR Hx Inlet MOV breaker is ____ ."  This tests the local operator aspect of the K/A. 6. Stem Focus:  Need to include "in accordance with procedure XYZ" in the stem question. Re-wrote question to test location of breaker for PXS-V027A;  comments incorporated. Question is SAT. 35 H 2  x  x        N U S T2G1:  CCS G2.4.4 1. Cred Dist:  The 2 nd part of Choices A/C (rising tank level auto-trips CCS pumps) is not plausible because a high tank level means more NPSH, which never auto-trips pumps. Q modified.2. Cue:  Instead of telling the applicants that a high-2 bearing temperature occurred, provide them with the bearing water temperatures and test their knowledge of whether the RCPs tripped. Incorporated. Question is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly36 F 1  x  x        N U S T2G1:  PPCS A3.01 1. Cred Dist and/or LOD=1:  The 1 st part of Choices C/D (spray valve s not open as pressure is rising) is not plausible because the 2 nd bullet says that pressure is rising slowly; therefore, the only possible mitigating response is spray valves open. Q modified. 2. Cue:  The 2 nd fill-in-the-blank statement cues the applicant that the spray valves should be open for the answer to the 1 st fill-in-the-blank statement; the 2 nd fill-in-the-blank statement contains the phrase "..as RCS pressure lowers..", which is an expected mitigation to the rising RCS pressure. Q modified. Question is sat as of 11/05/2015 37 F 2 x  x      x  N E/U S T2G1:  ADS G2.1.21 1. Q=K/A:  The proposed test item tests the applicants' knowledge of how ADS MOV RCS-V001A is operated, whereas the K/A requires testing the applicants' knowledge of the normal operating procedure for the ADS system. The information in the stem is what should be tested to fulfill the K/A. For example, suggest re-working the question to ask the applicant which procedure involves opening and closing the ADS valves. (Answer is RCS Fill, RCS-SOP-001, Attachment 1). Alternatively, re-work the question to test the applicants' knowledge of which ADS Train Valves are used in the RCS Fill procedure. 2. Cred Dist:  Choice C (DAS) is not plausible because the DAS system is only used when normal methods are broken; there is nothing in the stem that could be misconstrued as something is broken. 3. Stem Focus:  (typo) The 2 nd bullet is not the same as the procedure Step 4.6.e. The procedure step should be worded as "Close Train B Stage 1, 2, and 3, ADS Valves by performing the following" Modified question to require knowledge of RCS-SOP-001; Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 4. Job Content Flaws
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly38 H 3    x        N U S T2G1:  RTS K3.06 1. Cred Dist:  Choices A/B are not plausible because at these times the reactor is still not tripped; operational validity of trying to block Safeguards during an ATWS makes these choices not plausible (even though intent of the question was to purely test the logic from a Tier 2 perspective). Q modified to address trip status. Q is sat as of 10/28/2015. 39 5 2    x x    x  M E/U S T2G1:  RTS K5.03 1. Job-Link:  The 2 nd part of the question tests information located in the background document for FR-S.1. Generally, overall mitigative strategy is RO knowledge; however, in this question, the knowledge being tested is beyond mitigative strategy. The knowledge being tested is t he limiting design basis ATWS event. Q modified. 2. Cred Dist:  Given the picture in the stem, the 1 st part Choices A/B (turbine is tripped) is not plausible because the alpha steam line is blue for stop/control valves. Q modified. 3. Partial:  Choice C is also correct because the 2 nd fill-in-the-blank statement is too generic. A turbine trip is required during an ATWS with a steam leak also.  (feedwater leak will make steam as it leaks). Suggest changing the 2 nd part of A/C to main steam line leak. Q modified. Q is sat as of 11/05/2015 40 F 2            B S T2G1:  ESAS A3.13 41 H 2            N S T2G1:  ESAS K6.13


Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Instructions
: 4. Job Content Flaws
[Refer to Section D of ES-401N and Appendix B for additional information regarding each of the following concepts.]
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly42 H 2 x x  x      M E S T2G1: DAS A2.02 1. Stem Focus:  The last portion of the 2 nd bullet ("-due to low SG Water Level") is not necessary. Incorporated. 2. Cue: The first portion of the 3 rd bullet is not necessary; reword 3 rd bullet as "The reactor trip breakers are not open." Incorporated. 3. Stem Focus: Add "at 1000:00" in the 1 st fill-in-the-blank. Incorporated. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
: 4. Job Content Flaws
: 2. Enter the level of difficulty (LOD) of each question using a 1(easy) - 5 (difficult); (questions with a difficulty of 2 - 4 are acceptable).
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly43 F 2        x    N E S T2G1: PCS A4.01 1. Ensure manual actuation of PCCS is not required in any scenarios to preclude written/operating exam overlap. Noted. 2. For the 1 st part of the question, what procedure directs the operator to operate both switches?  (I could not find anything in NMP-OS-007-01.)  Why does the Conduct of Ops procedure require the operator to turn both switches even though the first switch actuates the PCCS?
: 3. Check the appropriate box if a psychometric flaw is identified:
Revise the first fill-in-the-blank statement to:  
* Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information)
"In order to manually actuate PCS at the PDSP, the minimum required operator action to satisfy the logic is to turn _____ .
* Cues: The stems or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).
(will there be two correct answers?) Q modified to test circuit logic specifically. 3. Stem focus:  Re-word the 2 nd fill-in-the-blank statement to: In order to generate a DAS PCS Actuation signal, the operator is required to turn ______ handswitch(es) at the DAS Control Panel. [ONLY one]  Q modified to test circuit logic specifically. 4. #/units: The actual switch names/numbers should be included. Switches are inherent with PCS Actuation. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
* T/F: The answer choices are a collection of unrelated true/false statements.
: 4. Job Content Flaws
* Cred. Dist: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly44 H 2 x x  x        B U S T2G1: MSS K1.04 1. Cred Dist: The 1 st part of Choices A/B (MSS-V020 remains open) is not plausible because the stem says that SG pressure is lowering rapidly. One isolation signal is 560 psig. If the SG pressure is currently 602 psig, and lowering RAPIDLY, then it's not plausible that MSS-V020 remains open at 1002:00. Q modified. 2. Cue: The phrase "lowering rapidly" is too strong of a cue. Q modified. 3. Why is the Stage 2 steam dump valve used in the 2 nd fill-in-the-blank statement instead of the Stage 1 steam dump valve (MSS-V005)? It is a cooldown valve. 4. Stem Focus:  What procedure is being used to block MSL/FW Isol & Safeguards, and enable Stage 1 & 2 steam dumps?  Put name/number of the governing procedure in the stem. GOP-
* Partial: One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
: 4. Check the appropriate box if a job content error is identified:
* Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
* Minutia: The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  *          # / Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
* Backward: The question requires reverse logic or application compared to the job requirements.
: 5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable)
: 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401N Section D.2.f.
: 7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).


205. Q is sat as of 10/28/2015 45 H 2 x  x    x  N U S T2G1: FWS  A2.33 1. Backwards:  In the context of the question, the 2 nd fill-in-the-blank is not operationally valid because there IS actually a feed pump running. The phrase "If no feed water pumps are running.." will cause confusion with the applicants because it's not true. 2. Partial: Choice B is also correct because the alarm may not be clear if the alarm doesn't automatically clear (without operator action). 3. Cred Dist:  The 2 nd part of Choices A/C (actuate PRHR) is not plausible because you always try to start a feedwater pump FIRST. 4. Stem Focus:  The last word in the 1 st fill-in-the-blank statement is a preposition; suggest re-wording as: At 1006:00, SFW Pump A Disch Flow (FWS-FT-015A) Low Flow ______ alarming. Revised question; Question is SAT.
ES-401N                                                                      2                                                                 Form ES-401N-9
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                     8.
: 4. Job Content Flaws
Q#  LOK LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 1  F    2    x                  x                                              N    U  T1G1: ES-0.1, EA2.01
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly46 H 2 x    x      N E S T2G1:  FWS A4.06 1. This question overlaps the same exact knowledge as RO Q#3; SGS-V255A auto-closes on Tcold = 505
: 1. Q=K/A: This K/A may not be applicable to Vogtle 3 & 4 because the evaluation of neutron flux following a reactor trip is performed S
&#xfb;F. O/L evaluated as OK. 2. Stem Focus:  It may not be operationally valid to assume the drop in temperature is linear; better to add another point in time to the stem with a temperature at that time. Timeline added. 3. Partial:  Is there any mathematical way that Choice B is also correct?  At 1027:00, Tavg is 523 F, what's Tcold. Q modified. 4. Partial:  Insert the word "automatically" before the word closed in the fill-in-the-blank statement. Incorporated. 5. Partial:  Re-word the fill-in-the-blank statement as:  "Of the following times listed below, the earliest time-." Incorporated. 6. Suggest replacing question due to conflict with Q#3. O/L evaluated as OK. Q is sat as of 10/28/2015 47 H 2  x  x        N U S  T2G1: ECS A3.01 1. Cred Dist:  The 1 st part of Choices C/D (ES-1 powered from RAT) is not plausible because the picture in the stem says the automatic bus transfer control is disabled. 2. Cred Dist: The 2 nd part of Choices A/C (ES-2 powered from diesels) is not plausible because the picture in the stem says that the automatic bus transfer control is enabled. 3. Cue:  The 2 nd bullet is not necessary to elicit the correct response. Removed picture and replaced 2 nd part of question; Question is SAT.
in E-0, Step 2.b, not in ES-0.1 Step 29. ES-0.1 doesnt include any evaluation of neutron flux. As currently presented, the 2nd part of the question doesnt test beyond Tier 2 knowledge of when SR detectors auto-energize. incorporated
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 2. Stem Focus: The 1st fill-in-the-blank statement uses the word considered, which is not well defined. deleted
: 4. Job Content Flaws
: 3. Stem Focus: The first bullet says the reactor was manually tripped spuriously? This isnt operationally valid. Accepted as-is after discussion.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 48 F 2 x  x    x    N U S T2G1:  IDS K6.02 Note: LCO 3.8.1 states The Division A, B, C, and D Class 1E DC power subsystems shall be OPERABLE in Modes 1, 2, 3, & 4. 1. Cred Dist:  The 1 st part of Choices A/B (LCO is met with Battery Charger broke) is not plausible because the stem says the battery charger has failed and at time 1000:00 no replacement charger has been connected. 2. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice B make it not plausible. 3. Stem Focus: The Plant status is missing from the stem. 4. #/units:  The name of 1DSB-DC-1 is missing from the stem (24 Hour Battery Charger).
: 4. Cred Dist: The only justification for the 1st part of Choices C/D (lowering at (-) 1/3 dpm) was that this was a commercially accepted method for verifying the reactor was not critical. Is there a Vogtle 3 & 4 procedure that uses this criterion? FR-S.1 uses rod bottom lights; perhaps this is a better distracter.
Revised 1 st part of question; comments incorporated. Question is SAT. 49 H    x        N U S T2G1: ZOS  K1.02 1. Cred Dist: The 1 st part of Choices A/B is not plausible because offsite is still available. Q modified to low power. 2. Cred Dist:  The 2 nd part of Choices B/D (Diesel still not powering bus) is not plausible because the stem says that a LOOP occurred at 10:30 and there is nothing in the stem that could be misconstrued as a "new" fault on ECS-ES-2 that occurred after 10:00. Q modified. 3. LOK: The distracter analysis indicated that this test item was a fundamental (lower) cog item; however, it appears it may be a higher cog question. Let's discuss. Q modified. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
incorporated
: 4. Job Content Flaws
: 5. 9-18-15: Resolved all comments; Put power above P-6, but less than P-10, and asked if ES-0.1 requires energizing. SAT Question is sat as of 9/18/2015.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly50 F 2    x        M S T2G1: SWS K4.06 1. Cred Dist: The 1 st part of Choices A/B (Fire water is the normal supply to towers) is not plausible because fire protection water is never the normal supply to anything except fire protection.
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                     8.
Suggest revising the question to test the applicants' knowledge of the alternate source of cooling tower makeup. Alternatively, change the 1 st part of the question to test cooling tower makeup is / is not normally provided from RWS. Incorporated. 2. Cred Dist: The 2 nd part of Choices A/C (normal control method is manual) is not plausible because normally all control methods are AUTOMATIC, which is the correct answer. Q modified. 3. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice B make it not plausible; unless a fire pump is ALWAYS running (unlikely), then automatic level control doesn't make sense. Q modified. Q is sat as of 10/28/2015. 51 F 2  x  x  x    N E/U S T2G1: CAS  A1.03 1. Cue: The 2 nd bullet is not necessary to elicit the correct response. The applicants should know that at 100% power, one instrument air package is always selected as the Lead compressor. Incorporated. 2. Minutia: The 2 nd portion of the question is testing trivial information because the choices are too close together. Q modified. 3. Cred Dist: The plausibility justification of the 2 nd part of Choices A/C is suspect. Q modified. 4. Cue: The 1 st part of the Choices in this question cues the answer to the 1 st part of RO Q#52. Q 52 modified. Q is sat as of 10/28/2015.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.         Link          units ward K/A Only 2  H    2    x      x          x                                              M  E/U  T1G1: A-313, G2.4.4
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. Please provide governing procedure that describes the philosophy of when an AOP is required to be entered; AOP S
: 4. Job Content Flaws
entry seems subjective. For example, Hotwell Level Lowering is also listed as a symptom/entry condition in the AOP; however, the crew wouldnt necessarily always be required to enter the AOP for this condition. Revised to test entry conditions.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly52 H 2    x x       M U S T2G1: CAS  K3.17 1. Partial:  There is no absolutely correct answer to the 1 st fill-in-the-blank statement because the SSD never said that PXS air operated valves WILL begin to reposition; the SSD basically says that the air operated valves are reliable down to a pressure of 50 psig. Q modified. 2. Cred Dist: The 2 nd part of Choices A/C (reactor still critical) is not plausible because a manual scram would already be performed since safety related valves (PXS) are repositioning everywhere. Q modified. 3. Cred Dist: Normal air pressure is 115 psig; the plausibility of the 1 st part of Choices C/D (100 psig) is borderline because 100 psig is the alarm set point and air operated components shouldn't be designed to begin reposit ioning at this high of air pressure. Q modified. IA P of 80 psig means that it could be as low as 50 psig at the components considering line losses. 4. What is the significance of the phrase "10 seconds after ALL PXS valves reposition" in the 2 nd fill-in-the-blank statement? Q modified. Q sat as of 10/28/2015.
: 2. Cue/ Cred Dist: The phrase unexpectedly rises in the 4th bullet is a cue that AOP entry is required; anytime something unexpected occurs, AOP entry is normally justified.
53 F 2 x   x       N U S T2G1: CNS K4.07 1. Cred Dist: The 2 nd part of Choices A/C (electrical interlock on containment doors) is not plausible because this type of interlock does not exist. 2. Cred Dist: The 2 nd part of Choices A/B (something was already overridden) is not plausible bec ause the stem does not contain any information that can be misconstrued to imply anything was previously overridden. 3. Stem Focus: The phrase "..without entering an additional Tech Spec CONDITION.." is cryptic and vague. The initial conditions should include the required Tech Spec 3.6 Condition for the broken outer door (as 4 th bullet). 4. Stem Focus: The 3 rd bullet is not necessary? Revised question to test whether 1 hour action is/is NOT required and knowledge of mechanical interlock design.
Consequently, the 1st part of Choices B/D (AOP entry isnt required) is not plausible. The stem needs to provide information for the applicants to identify (e.g, steam dump valve position, etc.) that the cool down was unexpected. Verbiage deleted.
Removing the words unexpectedly rises makes Choice D a correct answer; therefore, the question is somewhat subjective.
Q modified to ensure only one answer.
: 3. Operational Validity: Cool down rates are always evaluated in any ONE HOUR; rates provided in the stem are instantaneous only. The distracter analysis for GOP limits doesnt match the GOP; GOP limits are 50F in any 60 minute period (not 50F/hr).
Incorporated.
: 4. Stem Focus: The stem needs to place the event into more context, for example, 1st bullet says that GOP-205 is in progress; 3-MSS-SOP-001, Attachment 5, Section 4.3, Establish Plant Cool down in Steam Pressure Mode, is also in progress, and may add plausibility to NOT entering the AOP.
Also, 3-RCS-OTS-XX-005, RCS Heat up and Cool down Surveillance Testing, is in progress, and may add plausibility to NOT entering the AOP. Stem conditions modified.
: 5. Provide copy of Modified Bank Question. Not yet provided, but Q modified during review process.
: 6. 9-18-15: Fixed question to show an erroneous steam dump valve position. All comments resolved. SAT Question is sat as of 9/18/2015.
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.         Link          units ward K/A Only 3  F    2                       x                                    x        N  E/U  T1G1: A-336 AK1.07
: 1. Q=K/A: The test items link between Main and Startup FW and AOP-402 is weak since PMS Malfunction mitigative strategy S
applies to ALL PMS malfunctions; the K/A requires testing the applicants knowledge of how a PMS malfunction is identified for Main & Startup FW, including how to remedy. The proposed test item is missing the malfunction identification piece as it relates to Main & Startup FW.
Suggest writing a question that includes a screen shot of the PMS screen, so that the applicant has to identify that Startup FW isolation did/did not occur to better hit the K/A. Revised Q.
KA is met.
: 2. Cred Dist: The plausibility of Choice B (locally positioning SGS-V067A is the first option) is questionable because the fill-in-the-blank statement says will first be closed; local manipulation is never the first option. Q revised.
: 3. This question may overlap the same knowledge as Q#10.
Question is sat as of 10/28/2015.
4  H    2                        x                                              N  E/U  T1G1: E-1 EA1.05
: 1. Cred Dist: To make the 1st part of Choices A/B (1st stage valve S      positions are correct at 1001) plausible, re-work the fill-in-the blank statements and stem question as follows:
WOOTF completes both statements?
At 1001, both ADS First Stage valve positions _______ as expected.
With the above conditions, enabling the DAS Control Panel and manually actuating ADS Stage 1 from DAS _________ send an open signal to RCS-V001B Incorporated.
: 2. Please provide DAS logic that supports second half of question.
Done.
: 3. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 5  H    2                       x                          x                  N   U  T1G1: A-342 AK2.02 S  1. Cred Dist: Choice A (raise 1C and 1D speed to 88%) is not plausible because raising speed is never required in Mode 3.
OK based on GOP-303.
: 2. Cred Dist: Choice B (immediately restart tripped pumps) is not plausible because the reason for the spurious trip is unknown; conservative decision making eliminates this Choice.
Additionally, the status of the following parameters are not provided in the stem to make Choice B plausible:
CCS availability, Surge Tank level Bearing temps Stator temps Vibrations prior to trip Incorporated.
: 3. #/units: The UNID and label names of the safety related breakers and non-safety related breakers is missing from Choices C/D. For example, the non-safety related breakers are the VFD Switchgear Breakers.
Q revised.
: 4. 9-18-15: Kept safety/non-safety, but eliminated redundant information. SAT Question is sat as of 9/18/2015.
: 1. 2.       3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                               Explanation Focus              Dist.        Link          units ward K/A Only 6  H    3    x                  x                                              B  E/U  T1G1: A-337 AK3.01 Note to NRC Reviewers: The reason for determining CMT valves status is that CVS makeup flow cannot be reduced if CMT valves are S
open; thus the K/A portion related to the reason is indirectly being met.
: 1. Cred Dist: The 1st part of Choices A/B (return makeup to normal) is not plausible because Pzr Level is too low. Suggest modifying Pzr level value in the stem to remedy. Q revised.
: 2. Stem Focus: The stem is missing power level and/or unit status. Power added.
: 3. Stem Focus: Suggest swapping the order of the fill-in-the-blank statements so that the first fill-in-the-blank statement is related to Identified vs Pressure Boundary Leakage. Incorporated.
: 4. Need to verify that AOP-109 preceding steps have CVS makeup flow already aligned to max rate; otherwise re-word the 1st fill-in-the-blank statement as CVS makeup flow _________ (is / is NOT) required to be returned to normal. Reviewed - OK.
: 5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 7  H     1            x           x                                             N    U   T1G1: A-343 AA2.03
: 1. Job-Link: The procedure for Mode 5 isnt AOP-115; its 3-EOP-SDP-2, Response to Loss of RNS During Shutdown. Is the S
crew allowed to be in AOP-115 in Mode 5?
: 2. Cue and/or LOD=1: The test item does not test the applicants ability to evaluate CCS flow. Instead, the stem tells the applicant that RNS Hx A Flow (CCS-FT-301) is zero, which cues the applicant to CCS-V301A is required to be opened. As written, this is LOD=1 because a pump tripped, and, in order to re-establish cooling, another pump should be started and cooling water aligned to the heat exchanger.
: 3. Cred Dist: The 1st part of Choices C/D (crew NOT required to start RNS Pump A) is not plausible because there is no auto-start feature on decay heat removal, since this adds positive reactivity.
: 4. Cred Dist: Choice C is not plausible because of the interplay between the 1st and 2nd parts of this choice. IF the plausibility of the 1st part is that the pump auto-started, THEN V301A would either auto-align or already be aligned open.
: 5. Partial: The stem does not include the status of the cavity; flooded cavity does not have any requirements for re-establishing cooling.
Suggest incorporating the following element to hit the K/A:
In accordance with Step 13 (Align CCS for RNS Cooling), the operator is required to Check RNS HX CCS Flow (CCS-FT-301/302) greater than _______. (2800 gpm)
: 6. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 8  F    2    x      x          x    x                                        N    E  T1G1: ES-0.2 EK3.18 S  1. Partial: Because RCS Void Growth is a concern in ES-0.2, re-word the 1st fill-in-the-blank statement to ensure Choice C is incorrect:
In accordance with3-EOP-ES-0.2-B, Background Information for 3-EOP-ES-0.2, the reason RCS pressure is required to be maintained at its present value at Step 44 is to ______.
Q modified.
: 2. Stem Focus: the last portions of each Choice are not necessary. For example:
A. allow placing RNS in service for shutdown cooling B. prevent RCS void formation and subsequent CMT injection Q modified.
: 3. Stem Focus: The 2nd bullet is confusing and not an operationally valid way of presenting the information; suggest providing hottest un-isolated CMT temperature.
Q modified.
: 4. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 9  H    2                        x                                              N    E  T1G1: FR-S.1 EK1.05 S  1. Cred Dist: Choice D (RCPs not running; V108A closed) is not plausible because IF RCPs are off (due to CMT actuation),
THEN the PRHR Hx is always open. Q revised.
: 2. Stem Focus: Add Reactor Power is 100% to the stem initial conditions. Incorporated.
Alternate Suggestion (just one option): One of the relationships between FR-S.1 and the Safeguards System is this: At Step 8 of FR-S.1, IF Safeguards has actuated, the crew is required to EXIT FR-S.1 because all of the necessary boration (CMT) and auto-isolations (FW, Dilution Paths,Cnmt Air Filtration) are already sufficient to mitigate the ATWS; no other FR-S.1 actions are necessary. Therefore, if Lo Tcold (Safeguards Actuation) value was provided in the stem, then the applicant could decide whether to continue in FR-S.1 or to exit FR-S.1.
: 3. 9-18-15: Replaced 2nd fill-in-the-blank statement. Reworked to ensure not SRO-only. SAT Question is sat as of 9/18/2015.
10  H    3                                                                      N    ?  T1G1: E-3 EK2.05 S  1. Why does the 2nd fill-in-the-blank statement list time at 10:25?
Whats the significance of five minutes after the Safeguards Signal? Ensures out of gray area for valve stroking.
: 2. It is operationally valid that RCS pressure rises to 1982 psig during max cooldown evolution IF small tube leak with auxiliary spray failure. Yes.
: 3. 9-18-15: This question may overlap with RO Q#3.
Overlap evaluated as OK.
Question is sat as of 11/05/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 11  H    2    x                  x    x                                        N    E  T1G1: E-2 G2.2.30
: 1. Partial and/or Cred Dist: The stem doesnt specify the size of the steam leak (steam flow values, etc.); does swell occur S
when a large MSL break occurs? If so, then Choice C is also correct. Not at 1001:00 - OK.
: 2. Partial: Choice B is also correct because the wording of E-2, Step 7 is trending to 58.5%...go to E-1. Review this procedure step basis again. (Procedure may need revision to use the word controlled.) Q modified.
: 3. Partial: The time 10:01 is not the same as initially. The times provided to the applicants in the stem need to also include the seconds values to ensure no one interprets this question to mean one second later. By providing the seconds values, we ensure that the applicants understand sixty seconds has elapsed. The word initially should be eliminated. Seconds added.
: 4. Stem Focus: Provide normal secondary radiation values in the stem. Q modified.
: 5. 9-18-15: Reworded to test how MSIV Bypass failure affected subsequent plant operations; SAT Question is sat as of 9/18/2015.
12  H    2                                                              x        B    U  T1G1: A-301 AK3.04 S  1. Q=K/A: The 2nd part of the question is the part that targets the K/A; however, because of the 2nd fill-in-the-blank wording, the only thing being tested is that Xenon is building in, which requires positive reactivity insertion. This is the plant specific portion of the written exam; therefore, some plant specific information to hit the K/A must be tested.
Suggest changing the 2nd fill-in-the-blank statement to test the reason for why Rod Control is placed in the Low Power Mode, for example:
The reason why rods are placed in the Low Power Control Mode is / is NOT to maintain power constant. Second half replaced.
: 2. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 13  H    2                        x    x                                        N    U  T1G1: A-307 AA1.01 S  1. Partial: IF the CETs are lowering, THEN there may be no correct answer. CETs lowering means that some form of cooling is established. Why would you continue to blow squib valves if CETs are lowering? Why go to the RNO?
Another way to think about this is IF the local DAS switch attempt was NOT successful (and CETs were still lowering) wouldnt the operator STILL be required to use the blasting device cables/crank handle method of actuating IRWST since the normal method of firing the squib valves failed?
It looks like the intent of RNO Step 9.f is to use an alternate method to blow the squib valves. The previous method of using the local DAS switches means that the squib valves must be blown. IF you get to RNO Step 9.f, arent the squib valves still required to be blown when the CETs are lowering?
Second half replaced.
: 2. Cred Dist: The 1st part of Choices B/D (IRWST actuation NOT required) is not plausible because the wording of AOP-602, Step 9 is provided in the stem. Q modified.
: 3. 9-18-15: Changed question to test whether IRWST/Stage 4 actuations is/is not required; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 14  F    2                        x            x                        x        N    U  T1G1: FR-C.1 EK2.11 S  1. Job-Link and/or Q=K/A: There may be an issue with the K/A Catalog for this K/A because the implementing procedure for aligning RNS to the CLP is 3-EOP-ES-1.4, Stage 4 Actuation Response, Step 20. Instead, the K/A catalog links FR-C.1 to aligning RNS to the CLP. Nevertheless, the K/A requires testing the operational implication or cause effect relationship of reaching the CLP low level. Is the K/A Catalog implying that the PACE of getting thru C.1, and then transitioning to ES-1.4, is important to conserve IRWST inventory? We need to discuss whether there are any other points in the EOPs (other than ES-1.4) that direct RNS alignment to the CLP. The only place that has the CLP low level (15%) termination criteria appears to be ES-1.4. KA met.
: 2. Cred Dist: The 1st part of Choices A/B (CVS can inject from the Cask Loading Pit) is not plausible because these pumps dont have a suction from the Cask Loading Pit. Q modified.
: 3. Cred Dist: The 2nd part of Choices B/D (trying to conserve accumulator inventory after ADS Stages 1-3 have actuated and a DVI line break) is not plausible because the RCS is already depressurizing and accumulators will have already released their contents when RCS pressure lowered; therefore, there is no reason to conserve accumulator inventory. Q modified.
: 4. 9-18-15: Future Memo to APOG that K/A Catalog needs revising, changed K/A number and kept topic; got rid of accumulator and changed to SFP cooling pump; SAT Question is sat as of 9/18/2015.
15                                                                                  N    S  T1G1: A-323 AA2.04
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 16  H    3                        x                                    x        N  E/U  T1G1: ES-1.1 G2.4.39
: 1. Q=K/A: IF the annunciator was associated with an actual CVS isolation signal, THEN the K/A match would be unquestionable.
S However, in the proposed test item, the Letdown Hx Outlet Temp Hi annunciator isnt applicable to evaluating ES-1.1, Step 3.d (RNO) because high temp doesnt ever auto-isolate letdown.
Please provide justification as to how this annunciator being in alarm aids the operator when performing ES-1.1, Step 3.d.
We may need to replace the generic portion of this K/A because the link between annunciator response procedures and ES-1.1 is may not be possible. Q modified.
: 2. Cred Dist: The 1st part of the proposed test is not plausible because Letdown Hx Outlet Temp Hi never causes an automatic letdown isolation.
Suggest changing the annunciator to an annunciator that is associated with a CVS isolation. Q modified.
9-18-15: Moved in accordance with ES-1.1 to only the 2nd fill-in-the-blank; SAT Question is sat as of 9/18/2015.
17  H    3    x                                                                N    E  T1G1: SDP-1 EK1.02 S  1. Stem Focus: Revise the 7th bullet to delete the words has been; change to is. Incorporated.
: 2. Stem Focus: Add the word slowly at the end. Incorporated.
: 3. Stem Focus: The term MODE 6 can be deleted since the 2nd bullet already says the vessel head is NOT on the flange.
Deleted flange piece instead.
: 4. Stem Focus: Swap the order of the 5th and 6th bullets to chronologically flow better. Incorporated.
: 5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                        8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                  Explanation Focus              Dist.        Link          units ward K/A Only 18  H    2    x                  x                                              N    U  T1G1: SDP-2 EA1.03 S  1. Cred Dist: The 1st part of Choices C/D (CVS wont be used) is not plausible because of the wording of the 1st fill-in-the-blank statement. In other words, the stem tells the applicant (at 1030) that Step 36 (Refill RCS Using CVS Makeup) is required.
Therefore, the correct choice can only be that CVS will be used, even if only one pump is available. Suggest using the word sufficient in the 1st fill-in-the-blank statement to remedy.
Changed Step.
: 2. Stem Focus: Add a reason to the 1st bullet (why are we draining the RCS? Is there fuel in the vessel?) in the stem to add context to the question. Added.
: 3. LOK: It seems that this may be more than Fundamental (as marked on the distracter analysis; consider changing to Higher Level. OK
: 4. 9-18-15: Comments incorporated; higher cog question; SAT Question is sat as of 9/18/2015.
19  F    1                        x    x                                        N    U  T1G2: A-320 AK3.07 S  1. Cred Dist and/or LOD=1: Based on the information in the stem, none of the distracters are plausible, that is, since TCS/GCS/turbine temperatures/vibrations, etc., are not provided in the stem, Choices A, B, and D are not plausible. Q replaced.
: 2. Partial: To ensure Choice C is absolutely correct, include the title of the basis document in the stem question instead of only including AOP-203. Q replaced.
Suggest testing the REASON for reducing turbine load in accordance with Step RNO 3.b, which is to maintain vacuum less than 7  hg (vs 9 hg). Be careful to script the question such that it asks for the way the procedure is worded, to avoid a subset issue. Q replaced.
Alternatively, there may be no way to write a discriminating question at the RO level and the K/A may need to be replaced.
: 3. 9-18-15: Kept K/A but wrote question to test whether reducing load/turbine trip was was not required; the reason is thereby being indirectly tested; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 20  H    2                                                                      N    U  T1G2: A-314 AK3.02 S  1. Cred Dist: The 2nd part of Choices A/C (SFS pumps is reason to check PZR level > 19.5%) is not plausible because the Step asked for PZR level (not SFP level). OK Do SFS pumps lose suction for a given PZR level? Or is PZR level off-scale low when SFS pumps lose suction?
: 2. 9-18-15: Licensee explained how reason was to ensure level above flange; SAT Question is sat as of 9/18/2015.
21  H    1                                                                      N    U  T1G2: SDP-4 EA2.03 S  1. Cred Dist and/or LOD=1: The stem needs to include PZR Level below the auto-makeup set point to add plausibility to the 1st part of Choices A/B (No Makeup Flow at 1000). As written, this is not plausible (LOD=1) because the stem says Borating the RCS wasnt started until 1005. Added.
: 2. Cred Dist and/or LOD=1: The stem needs to include some item that can be misconstrued as why the CVS Manual Makeup Isol and Boron Dilution Block signals are unable to be reset to add plausibility to the 2nd part of Choices B/D (No Makeup Flow at 1005). As written, this is not plausible (LOD=1) because the stem says Borating the RCS began at 1005; therefore, there has to be makeup flow. Q modified.
: 3.  #/units: The 1st bullet should be replaced with the actual name of the annunciator. Incorporated.
: 4. 9-18-15: One of the licensees boration methods (CMT) does not indicate makeup flow; Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 22  F    2    x                  x    x                                        N    U  T1G2: SDP-6 EK2.04 S  1. Cred Dist: Choices C/D are not plausible because theyre too large; the values in these choices represents a HUGE heat up.
Incorporated.
: 2. Partial: To avoid partially correct answers, provide times down to the second values (put zero seconds on all times) to ensure RCS temperature remained within +/- 5F band in the last 10 minutes.. cant be used to make an post exam appeal.
Incorporated.
: 3. Stem Focus: Need to add the initial RCS temperature to the Given Conditions bullet. Incorporated.
: 4. 9-18-15: Licensee changed temperatures; comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 23  F    3    x                  x    x              x                        N    U  T1G2: A-306 G2.4.4 S  1. Q=K/A: This question does not test the applicants ability to recognize abnormal SYSTEM operating parameters that require entry to AOP-601, or any other AOP.
One opportunity to test this K/A, for example, is the radiation limit/value that requires entry to AOP-601 from AOP-905. If site-specific rad value is not available at this time, are there ways to test the Alert light, Hi alarm light, etc. without testing the site specific rad-value. We need to explore ways to hit this K/A, because we may not be able to replace the K/A if the reason is solely due to plant reference materials not being ready. Q replaced.
: 2. Cred Dist: The 1st part of Choices A/B (crew will stay in the main control room and continue with ES-0.1) is not plausible because the stem says the control room must be evacuated. Q replaced.
: 3. Minutia: The 2nd part of the question may be minutia because knowing the number of switches is not operationally valid.
Please provide reason why knowing the number of switches is operationally valid. One option is to test the applicants knowledge of whether OCS-JW-001 (MCR/RSW Xfer Switch Panel) has to be placed in the Disable position. Another option is to test the location of JW-001. Q replaced.
: 4. Partial and/or Stem Focus: To ensure everyone is clear that the 2nd fill-in-the-blank statement is NOT referring to Main Control Room switches, re-word the 2nd fill-in-the-blank statement as:
Step 3, Evacuate to RSR requires a minimum of ______
transfer switches to be manipulated in Room 12S05 before plant control can be established from the Remote Workstation. Q replaced.
: 5. 9-18-15: Re-worked to test AOP-601, Step 7, which has transition to E-0 for loss of MFPs; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 24  H    3    x                  x    x                                        N  E/U  T1G2: A-318 AA1.09 S  1. Cred Dist: The plausibility of the 1st part of Choices A/B (9.3 gpm) is borderline because the stem doesnt include anything that could be misconstrued as a high rad condition such as the 10 oclock BDS-RE011 (EDI Reject Rad) or BDS-RE010 (EDI Product Rad) normal values. Incorporated.
: 2. Partial: The 1st fill-in-the-blank statement does not match 3-BDS-SOP-001, Attachment 10, Step 13; the fill-in-the-blank statement isnt specific that 140 gpm is the max flow per heat exchanger. Suggest matching the words to the procedure to avoid partially/no correct answers. Incorporated.
: 3. Stem Focus: The 2nd bullet does not provide the procedure being implemented, which is 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS.
Incorporated.
: 4. Stem Focus: The order of the 3rd and 4th bullets should be swapped to chronologically flow. Incorporated.
Suggest the following:
Given:
At time 1000 100 % power 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS, is in progress BDS-RE011 (EDI Reject Rad) is xxxx BDS-RE010 (EDI Product Rad) is xxx At time 1020 SG BD HX A Outlet Temp (CDS-TE040A) is alarming at 420&deg;F AOP-202 (Condensate System Malfunctions) is entered WOOTF completes both statements?
At 1000, the maximum allowable BDS flow rate through each heat exchanger is limited to _______ gpm.
At 1021, in accordance with AOP-202, blowdown from BOTH Steam Generators ________ required to be isolated.
Incorporated.
9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 25  H    2                        x                                    x        N    U  T1G2: FR-C.3 EK1.08 S  1. Q=K/A: The question does not test the applicants knowledge of the relationship between the FR-C.3 procedure and the RCS; the 1st part of the question only requires GFES knowledge of the steam tables and the 2nd part of the question does not require any knowledge of FR-C.3. Suggest testing the applicants knowledge of the F-0 CET temperature threshold value that requires entry to FR-C.3, or some other RCS aspect of FR-C.3.
Q replaced.
: 2. Cred Dist: The 2nd part of Choices B/D (CMT temperature already stable two minutes after PXS-V014A/B & PXS-V015A/B are opened) is not plausible because only two minutes has elapsed. How long do CMTs inject cold water? Q replaced.
: 3. 9-18-15: Licensee presented new question; SAT Question is sat as of 9/18/2015.
26  H    2                                                              x        N    U  T1G2: FR-Z.4 EK2.01 S  1. Q=K/A: The question does not test the applicants knowledge of the relationship between containment integrity and the Z.4 procedure; the proposed question only tests the Tier 2 aspect of how the vacuum relief auto-actuates and the LCO requirement.
Suggest making the 2nd fill-in-the-blank statement the first, and then test the applicants knowledge of WHEN Z.4 requires the operators to reset containment vacuum relief and close VFS-V800A/B (that is, when containment pressure is less negative than -0.2 psig).
Q acceptable.
: 2. Stem Focus: Space needed between 0.4 and psig in the last bullet.
: 3. Move At 1005:00 to the stem question since its in both fill-in-the-blank statements.
: 4. Note: Because of the limited content in Z.4, this question is being accepted to meet Tier 1.
Question is sat as of 10/28/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 27  H    2    x      x                                      x        x        N    E  T1G2: A331 AA1.02 S  1. Cue: The 2nd bullet tells the applicants that the static transfer switch auto-aligned to its backup AC power source; this description of the auto-alignment is not necessary to elicit the correct response because it is a direct result of the fault/alarm on IDSA-DS-1.
: 2.  #/units and/or Cue: The name of the alarm is missing in the first bullet; if the alarm provides an auto-swap signal to the static transfer switch, then the phrase ..due to a fault on IDSA-DS-1 is not necessary to elicit the correct response.
: 3. Stem Focus: The 4th bullet (AOP-303 is entered) is not necessary.
: 4. Q=K/A: The modified test item does not meet the Tier 1 aspect.
Comments incorporated and 2nd part of question re-written to test panels; Question is SAT.
28  H    2                        x    x                                        M    E  T2G1: RCS A2.31 S  1. Partial: Choice C may also be correct because there is no other reason why containment sump level is rising other than a stuck open RCDT relief valve. Why is containment sump level rising?
Q modified.
: 2. Cred Dist: The distracter analysis said that 2nd part of Choices B/D (AOP-112 doesnt provide guidance on isolating..) was plausible because the AOP only provides guidance for isolating the INNER seal. Therefore, the 2nd fill-in-the-blank statement should include the word INNER between the words vessel and flange. Q modified.
: 3. Cred Dist: The fact that RCDT pressure is rising means there is no way the relief valve can be lifted. Suggest deleting the phrase and rising.
Question is sat as of 10/28/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 29  H    1                        x                                          x  N    U  T2G1: SGS A1.05 S  1. Cred Dist and/or LOD=1: The 1st part of Choices A/B (Tavg goes up when SG PORV opens) is not plausible because this cools the primary. Q modified.
: 2. Cred Dist and/or LOD=1: The 2nd part of Choices B/D (Power goes down when SG PORV opens) is not plausible because this cools the primary. Q modified.
: 3. Q=K/A: The proposed test item tests GFES knowledge only; this is the site specific portion of the written exam. Q modified.
Instead of testing what Tavg does, suggest testing something that happens as a result of Tavg changing. Q modified.
Question is sat as of 9/18/2015.
30  F    2    x      x                                                          N    E  T2G1: SGS K2.04 S  1. Cue: The 1st fill-in-the-blank statement contains two 1s; the correct answer contains a 1. Suggest changing the 1st part of Choices C/D to another bus that has a 1 in it. Discussed - OK.
: 2. Stem Focus: Reword the 2nd fill-in-the-blank statement to be more precise as:
IF power is lost to BOTH MSIV A hydraulic pumps, THEN SGS-V040A ___(2)___ immediately close. Incorporated.
: 3. Cred Dist: The 2nd part of Choices A/C (closes immediately) is not plausible because of the word immediately. Modified Q.
: 4. Distracter Analysis wasnt updated after changing Choices C/D to 1DSA-EA-1. Noted.
Question is sat as of 10/28/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 31  H    2                        x    x                                        N  E/U  T2G1: RNS K3.01
: 1. Partial: When the HX BYPASS valve fails open, what will the HX INLET temperature do at RNS-TE-013A location? IF the S
temperature at this point rises, then RNS-V006A will open up more, which will make another choice correct. Q asked at a point in time.
: 2. Cred Dist: The 2nd part of Choices A/C (Disch to CVS valve stays open even if letdown temperature rises to 141F) is not plausible because resin must always be protected from temperatures near 140F. Temp lowered.
: 3. Suggest revising the question such that the 3rd bullet doesnt TELL the applicants which way the valve failed; instead, say that the air supply to the valve has failed. This increases discriminatory value. Incorporated.
Question is sat as of 10/28/2015 32  H    2                        x                                              N  E/U  T2G1: PRHR A1.01 S  1. Cred Dist: The 1st part of Choices C/D (PRHR Hx Press remains the same) is not plausible because the HX conditions have changed; therefore, the pressure has to change, even if minutely.
Distracter Analysis points: The possibility of PZR Pressure Control keeping the pressure constant, and the possibility of the applicants misconception of inlet valve position keeping the pressure constant are eclipsed by the fact that the PRHR Hx conditions will change, even if minutely.
: 2. Cred Dist: The inter-play between the two parts of Choice C make it not plausible. If a Safeguards Actuation has occurred, then PRHR Hx pressure hasnt remained the same.
: 3. Cred Dist: The interplay between the 1st and 2nd parts of Choice C dont make sense; IF PRHR Hx pressure is going UP, then NOT having a safeguards signal (Tcold) is not plausible.
Revised question to ask about PXS-V101 and pressure change with isolating a leaking PRHR Hx; Question is SAT.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 33  H    2    x                  x                                              N    U  T2G1: PXS A4.16 S  1. Cred Dist: The 1st part of Choices C/D (trip bkrs remain closed) is not plausible because a CMT actuation is a direct reactor trip.
Timing adds to plausibility.
: 2. Cred Dist: The 2nd part of Choices A/C (steam injection) is not plausible because the stem does not include anything that could be misconstrued as a LOCA. Q modified.
: 3. Stem Focus: The 2nd bullet is a sentence fragment. Corrected.
: 4. Cred Dist: The 1st part of Choices C/D is not plausible because a CMT actuation always eventually causes a reactor trip (ATL discussion was that DAS CMT wont cause direct reactor trip).
The CMT actuation will cause RCPs to trip (for example), which will cause a reactor trip. Timing adds to plausibility.
: 5. Cred Dist: The 2nd part of Choices A/C (CMT level lowering) is not plausible because there is not anything in the stem that could be misconstrued as a LOCA (ATL discussion was that WR level fluctuated anytime CMT actuated). Credibility based on PRHR actuation and RCS shrink.
Question is sat as of 11/05/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 34  H    2    x                                                        x        N  E/U  T2G1: PXS G2.4.27 S  1. Q=K/A: The proposed test item tests the applicants knowledge of AOP-109 and the status of PXS-V101 breaker; the test item is not testing the applicants knowledge of an NLO task. Lets discuss whether changing the K/A is necessary.
: 2. The second fill-in-the-blank statement seems unrelated to the PRHR Hx tube leak event; why is pressurizer level rising? The second part of the question should be related to the topic.
: 3. Stem Focus: The 2nd fill-in-the-blank statement is missing the word auto, that is, received an auto-open signal.
: 4. Stem Focus: The 1st fill-in-the-blank statement should be worded as At 1000:00, an operator _____(1)___ required to be locally dispatched to assist the MCR with isolating the PRHR Hx.
: 5. Cred Dist: The 1st part of Choices C/D (breaker is OPENED) is not plausible because at 1000:00 no isolation has occurred.
Suggest changing the 1st fill-in-the-blank to at 1020:00 the PRHR Hx Inlet MOV breaker is ____ . This tests the local operator aspect of the K/A.
: 6. Stem Focus: Need to include in accordance with procedure XYZ in the stem question.
Re-wrote question to test location of breaker for PXS-V027A; comments incorporated. Question is SAT.
35  H    2            x          x                                              N    U  T2G1: CCS G2.4.4 S  1. Cred Dist: The 2nd part of Choices A/C (rising tank level auto-trips CCS pumps) is not plausible because a high tank level means more NPSH, which never auto-trips pumps. Q modified.
: 2. Cue: Instead of telling the applicants that a high-2 bearing temperature occurred, provide them with the bearing water temperatures and test their knowledge of whether the RCPs tripped. Incorporated.
Question is sat as of 10/28/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 36  F    1            x          x                                              N    U  T2G1: PPCS A3.01 S  1. Cred Dist and/or LOD=1: The 1st part of Choices C/D (spray valve s not open as pressure is rising) is not plausible because the 2nd bullet says that pressure is rising slowly; therefore, the only possible mitigating response is spray valves open. Q modified.
: 2. Cue: The 2nd fill-in-the-blank statement cues the applicant that the spray valves should be open for the answer to the 1st fill-in-the-blank statement; the 2nd fill-in-the-blank statement contains the phrase ..as RCS pressure lowers.., which is an expected mitigation to the rising RCS pressure. Q modified.
Question is sat as of 11/05/2015 37  F    2    x                  x                                    x        N  E/U  T2G1: ADS G2.1.21 S  1. Q=K/A: The proposed test item tests the applicants knowledge of how ADS MOV RCS-V001A is operated, whereas the K/A requires testing the applicants knowledge of the normal operating procedure for the ADS system. The information in the stem is what should be tested to fulfill the K/A. For example, suggest re-working the question to ask the applicant which procedure involves opening and closing the ADS valves.
(Answer is RCS Fill, RCS-SOP-001, Attachment 1).
Alternatively, re-work the question to test the applicants knowledge of which ADS Train Valves are used in the RCS Fill procedure.
: 2. Cred Dist: Choice C (DAS) is not plausible because the DAS system is only used when normal methods are broken; there is nothing in the stem that could be misconstrued as something is broken.
: 3. Stem Focus: (typo) The 2nd bullet is not the same as the procedure Step 4.6.e. The procedure step should be worded as Close Train B Stage 1, 2, and 3, ADS Valves by performing the following Modified question to require knowledge of RCS-SOP-001; Question is SAT.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 38  H    3                        x                                              N    U  T2G1: RTS K3.06 S  1. Cred Dist: Choices A/B are not plausible because at these times the reactor is still not tripped; operational validity of trying to block Safeguards during an ATWS makes these choices not plausible (even though intent of the question was to purely test the logic from a Tier 2 perspective). Q modified to address trip status.
Q is sat as of 10/28/2015.
39  5    2                              x      x                        x        M  E/U  T2G1: RTS K5.03 S  1. Job-Link: The 2nd part of the question tests information located in the background document for FR-S.1. Generally, overall mitigative strategy is RO knowledge; however, in this question, the knowledge being tested is beyond mitigative strategy. The knowledge being tested is the limiting design basis ATWS event. Q modified.
: 2. Cred Dist: Given the picture in the stem, the 1st part Choices A/B (turbine is tripped) is not plausible because the alpha steam line is blue for stop/control valves. Q modified.
: 3. Partial: Choice C is also correct because the 2nd fill-in-the-blank statement is too generic. A turbine trip is required during an ATWS with a steam leak also. (feedwater leak will make steam as it leaks). Suggest changing the 2nd part of A/C to main steam line leak. Q modified.
Q is sat as of 11/05/2015 40  F    2                                                                        B    S  T2G1: ESAS A3.13 41  H    2                                                                        N    S  T2G1: ESAS K6.13
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 42  H    2    x      x                x                                        M    E  T2G1: DAS A2.02 S  1. Stem Focus: The last portion of the 2nd bullet (due to low SG Water Level) is not necessary. Incorporated.
: 2. Cue: The first portion of the 3rd bullet is not necessary; reword 3rd bullet as The reactor trip breakers are not open.
Incorporated.
: 3. Stem Focus: Add at 1000:00 in the 1st fill-in-the-blank.
Incorporated.
Q is sat as of 10/28/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 43  F    2                                                    x                  N    E  T2G1: PCS A4.01 S  1. Ensure manual actuation of PCCS is not required in any scenarios to preclude written/operating exam overlap. Noted.
: 2. For the 1st part of the question, what procedure directs the operator to operate both switches? (I could not find anything in NMP-OS-007-01.) Why does the Conduct of Ops procedure require the operator to turn both switches even though the first switch actuates the PCCS?
Revise the first fill-in-the-blank statement to:
In order to manually actuate PCS at the PDSP, the minimum required operator action to satisfy the logic is to turn _____ .
(will there be two correct answers?) Q modified to test circuit logic specifically.
: 3. Stem focus: Re-word the 2nd fill-in-the-blank statement to:
In order to generate a DAS PCS Actuation signal, the operator is required to turn ______ handswitch(es) at the DAS Control Panel. [ONLY one] Q modified to test circuit logic specifically.
: 4.  #/units: The actual switch names/numbers should be included.
Switches are inherent with PCS Actuation.
Q is sat as of 10/28/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 44  H    2    x      x          x                                              B    U  T2G1: MSS K1.04 S  1. Cred Dist: The 1st part of Choices A/B (MSS-V020 remains open) is not plausible because the stem says that SG pressure is lowering rapidly. One isolation signal is 560 psig. If the SG pressure is currently 602 psig, and lowering RAPIDLY, then its not plausible that MSS-V020 remains open at 1002:00. Q modified.
: 2. Cue: The phrase lowering rapidly is too strong of a cue. Q modified.
: 3. Why is the Stage 2 steam dump valve used in the 2nd fill-in-the-blank statement instead of the Stage 1 steam dump valve (MSS-V005)? It is a cooldown valve.
: 4. Stem Focus: What procedure is being used to block MSL/FW Isol & Safeguards, and enable Stage 1 & 2 steam dumps? Put name/number of the governing procedure in the stem. GOP-205.
Q is sat as of 10/28/2015 45  H    2    x                  x                                  x          N    U  T2G1: FWS A2.33 S  1. Backwards: In the context of the question, the 2nd fill-in-the-blank is not operationally valid because there IS actually a feed pump running. The phrase If no feed water pumps are running.. will cause confusion with the applicants because its not true.
: 2. Partial: Choice B is also correct because the alarm may not be clear if the alarm doesnt automatically clear (without operator action).
: 3. Cred Dist: The 2nd part of Choices A/C (actuate PRHR) is not plausible because you always try to start a feedwater pump FIRST.
: 4. Stem Focus: The last word in the 1st fill-in-the-blank statement is a preposition; suggest re-wording as:
At 1006:00, SFW Pump A Disch Flow (FWS-FT-015A) Low Flow
______ alarming.
Revised question; Question is SAT.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 46  H    2    x                        x                                        N    E  T2G1: FWS A4.06 S  1. This question overlaps the same exact knowledge as RO Q#3; SGS-V255A auto-closes on Tcold = 505F. O/L evaluated as OK.
: 2. Stem Focus: It may not be operationally valid to assume the drop in temperature is linear; better to add another point in time to the stem with a temperature at that time. Timeline added.
: 3. Partial: Is there any mathematical way that Choice B is also correct? At 1027:00, Tavg is 523 F, whats Tcold. Q modified.
: 4. Partial: Insert the word automatically before the word closed in the fill-in-the-blank statement. Incorporated.
: 5. Partial: Re-word the fill-in-the-blank statement as: Of the following times listed below, the earliest time. Incorporated.
: 6. Suggest replacing question due to conflict with Q#3. O/L evaluated as OK.
Q is sat as of 10/28/2015 47  H    2            x          x                                              N    U    T2G1: ECS A3.01 S  1. Cred Dist: The 1st part of Choices C/D (ES-1 powered from RAT) is not plausible because the picture in the stem says the automatic bus transfer control is disabled.
: 2. Cred Dist: The 2nd part of Choices A/C (ES-2 powered from diesels) is not plausible because the picture in the stem says that the automatic bus transfer control is enabled.
: 3. Cue: The 2nd bullet is not necessary to elicit the correct response.
Removed picture and replaced 2nd part of question; Question is SAT.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                                  Explanation Focus              Dist.        Link          units ward K/A Only 48  F    2    x                  x                          x                  N    U  T2G1: IDS K6.02 S  Note: LCO 3.8.1 states The Division A, B, C, and D Class 1E DC power subsystems shall be OPERABLE in Modes 1, 2, 3, & 4.
: 1. Cred Dist: The 1st part of Choices A/B (LCO is met with Battery Charger broke) is not plausible because the stem says the battery charger has failed and at time 1000:00 no replacement charger has been connected.
: 2. Cred Dist: The interplay between the 1st and 2nd parts of Choice B make it not plausible.
: 3. Stem Focus: The Plant status is missing from the stem.
: 4.  #/units: The name of 1DSB-DC-1 is missing from the stem (24 Hour Battery Charger).
Revised 1st part of question; comments incorporated. Question is SAT.
49  H                              x                                              N    U  T2G1: ZOS K1.02 S  1. Cred Dist: The 1st part of Choices A/B is not plausible because offsite is still available. Q modified to low power.
: 2. Cred Dist: The 2nd part of Choices B/D (Diesel still not powering bus) is not plausible because the stem says that a LOOP occurred at 10:30 and there is nothing in the stem that could be misconstrued as a new fault on ECS-ES-2 that occurred after 10:00. Q modified.
: 3. LOK: The distracter analysis indicated that this test item was a fundamental (lower) cog item; however, it appears it may be a higher cog question. Lets discuss. Q modified.
Q is sat as of 10/28/2015
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 50  F    2                        x                                              M        T2G1: SWS K4.06 S  1. Cred Dist: The 1st part of Choices A/B (Fire water is the normal supply to towers) is not plausible because fire protection water is never the normal supply to anything except fire protection.
Suggest revising the question to test the applicants knowledge of the alternate source of cooling tower makeup. Alternatively, change the 1st part of the question to test cooling tower makeup is / is not normally provided from RWS. Incorporated.
: 2. Cred Dist: The 2nd part of Choices A/C (normal control method is manual) is not plausible because normally all control methods are AUTOMATIC, which is the correct answer. Q modified.
: 3. Cred Dist: The interplay between the 1st and 2nd parts of Choice B make it not plausible; unless a fire pump is ALWAYS running (unlikely), then automatic level control doesnt make sense. Q modified.
Q is sat as of 10/28/2015.
51  F    2            x          x                    x                        N  E/U  T2G1: CAS A1.03 S  1. Cue: The 2nd bullet is not necessary to elicit the correct response. The applicants should know that at 100% power, one instrument air package is always selected as the Lead compressor. Incorporated.
: 2. Minutia: The 2nd portion of the question is testing trivial information because the choices are too close together. Q modified.
: 3. Cred Dist: The plausibility justification of the 2nd part of Choices A/C is suspect. Q modified.
: 4. Cue: The 1st part of the Choices in this question cues the answer to the 1st part of RO Q#52. Q 52 modified.
Q is sat as of 10/28/2015.
: 1. 2.      3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F      Cred. Partial Job- Minutia #/ Back-    Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 52  H    2                        x    x                                        M    U  T2G1: CAS K3.17 S  1. Partial: There is no absolutely correct answer to the 1st fill-in-the-blank statement because the SSD never said that PXS air operated valves WILL begin to reposition; the SSD basically says that the air operated valves are reliable down to a pressure of 50 psig. Q modified.
: 2. Cred Dist: The 2nd part of Choices A/C (reactor still critical) is not plausible because a manual scram would already be performed since safety related valves (PXS) are repositioning everywhere. Q modified.
: 3. Cred Dist: Normal air pressure is 115 psig; the plausibility of the 1st part of Choices C/D (100 psig) is borderline because 100 psig is the alarm set point and air operated components shouldnt be designed to begin repositioning at this high of air pressure. Q modified. IA P of 80 psig means that it could be as low as 50 psig at the components considering line losses.
: 4. What is the significance of the phrase 10 seconds after ALL PXS valves reposition in the 2nd fill-in-the-blank statement? Q modified.
Q sat as of 10/28/2015.
53   F     2     x                 x                                             N   U   T2G1: CNS K4.07 S  1. Cred Dist: The 2nd part of Choices A/C (electrical interlock on containment doors) is not plausible because this type of interlock does not exist.
: 2. Cred Dist: The 2nd part of Choices A/B (something was already overridden) is not plausible because the stem does not contain any information that can be misconstrued to imply anything was previously overridden.
: 3. Stem Focus: The phrase ..without entering an additional Tech Spec CONDITION.. is cryptic and vague. The initial conditions should include the required Tech Spec 3.6 Condition for the broken outer door (as 4th bullet).
: 4. Stem Focus: The 3rd bullet is not necessary?
Revised question to test whether 1 hour action is/is NOT required and knowledge of mechanical interlock design.
Question is SAT.
Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                   8.
: 4. Job Content Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 54  F     2     x                 x                                             N   E/U T2G1: RCP K5.02 S  1. Cred Dist: Change RCP 1A speed to 88% to make Choices A/B plausible. 88% is the max allowed speed when < 520 F.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly54 F 2 x   x       N E/U S T2G1: RCP K5.02 1. Cred Dist: Change RCP 1A speed to 88% to make Choices A/B plausible. 88% is the max allowed speed when < 520  
Incorporated.
&#xfb;F. Incorporated. The distracter analysis may be a cut-and-paste error; it refers to Loop 2 and PRHR Hx even though these items don't apply.
The distracter analysis may be a cut-and-paste error; it refers to Loop 2 and PRHR Hx even though these items dont apply.
Let's discuss. OK Q sat as of 10/28/2015. 55 F 2           B S T2G1: CVS K2.04 56 H 2 x           M E/U S T2G2: DRCS A2.19 1. Bank demand position failing to 0 steps may not be operationally valid because lesson plan AP-LT-I-PP-DRCS, Slide 39 says the step counter data is retained even if a total loss of power occurs in the logic cabinet. Is it an operationally valid event? 2. Cred Dist: The plausibility of the 1 st part of Choices A/B (trip reactor) is borderline because the stem of the question never says there is an actual deviation between actual vs demanded rod position. 3. Stem Focus: Re-word the 2 nd fill-in-the-blank statement as: "The LCO for Tech Spec 3.1.7 (Rod Position Indication) ___(2)___ met." 4. LOK: It appears that the proposed test item is a higher cog question. Let's discuss. Bank position can be "reset" to zero for each group demanded position without a loss of power; comments incorporated.
Lets discuss. OK Q sat as of 10/28/2015.
55   F     2                                                                       B   S   T2G1: CVS K2.04 56   H     2     x                                                                 M   E/U T2G2: DRCS A2.19 S  1. Bank demand position failing to 0 steps may not be operationally valid because lesson plan AP-LT-I-PP-DRCS, Slide 39 says the step counter data is retained even if a total loss of power occurs in the logic cabinet. Is it an operationally valid event?
: 2. Cred Dist: The plausibility of the 1st part of Choices A/B (trip reactor) is borderline because the stem of the question never says there is an actual deviation between actual vs demanded rod position.
: 3. Stem Focus: Re-word the 2nd fill-in-the-blank statement as:
The LCO for Tech Spec 3.1.7 (Rod Position Indication)
___(2)___ met.
: 4. LOK: It appears that the proposed test item is a higher cog question. Lets discuss.
Bank position can be reset to zero for each group demanded position without a loss of power; comments incorporated.
Question is SAT.
Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
: 4. Job Content Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 57  H     2     x                 x                                             M   U   T2G2: RPIS K2.03 S  1. Cred Dist: The 1st part of Choices C/D (rod position is unknown during a LOOP) is not plausible because control rod positions are always powered from a vital/inverter power supply; control rods perform a safety function. Based solely on conservative design principles, the applicants can answer both parts of this question as yes/yes and be correct, thus bypassing the K/A.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly57 H 2 x   x       M U S T2G2: RPIS K2.03 1. Cred Dist: The 1 st part of Choices C/D (rod position is unknown during a LOOP) is not plausible because control rod positions are always powered from a vital/inverter power supply; control rods perform a safety function. Based solely on conservative design principles, the applicants can answer both parts of this question as "yes"/"yes" and be correct, thus bypassing the K/A. Suggest writing a question that tests the applicants' knowledge of the power supply to the digital rod position indicating coils. Incorporated. 2. Cred Dist: The 2 nd part of Choices B/D (rod position unknown 6 hrs later) is not plausible because the stem does not include anything that could be misconstrued that the SDGs are not available. The timing of Q enhanced plausibility. 3. Stem Focus: The 2 nd bullet is vague; the LOOP needs to be better defined. Added words. Q sat as of 10/28/2015 58 H 2 x   x x       M E S T2G2: VES K3.02 1. Partial: There may be no correct answer to the 2 nd part of the question because the concrete heat sink design doesn't work; that is, the CR gets too hot when VES is isolated. For example, AOP-903, Toxic Gas, Attachment 1, MCR Heat Load Reduction, is required to ensure the max temperature does not exceed 90&#xfb;F. 2. Cred Dist: The basis for the 5
Suggest writing a question that tests the applicants knowledge of the power supply to the digital rod position indicating coils.
&#xfb;F temperature rise (2 nd part of Choices B/D) is missing. If ther e is no basis, then this portion of these choices is not plausible. Suggest replacing with 100 deg. 3. Stem Focus: The phrase "..following a loss of VBS operation" should be added to the 2 nd fill-in-the-blank statement. Changed to say "with operator action"; comments incorporated.
Incorporated.
: 2. Cred Dist: The 2nd part of Choices B/D (rod position unknown 6 hrs later) is not plausible because the stem does not include anything that could be misconstrued that the SDGs are not available. The timing of Q enhanced plausibility.
: 3. Stem Focus: The 2nd bullet is vague; the LOOP needs to be better defined. Added words.
Q sat as of 10/28/2015 58   H     2     x                 x     x                                       M   E   T2G2: VES K3.02 S  1. Partial: There may be no correct answer to the 2nd part of the question because the concrete heat sink design doesnt work; that is, the CR gets too hot when VES is isolated. For example, AOP-903, Toxic Gas, Attachment 1, MCR Heat Load Reduction, is required to ensure the max temperature does not exceed 90F.
: 2. Cred Dist: The basis for the 5F temperature rise (2nd part of Choices B/D) is missing. If there is no basis, then this portion of these choices is not plausible. Suggest replacing with 100 deg.
: 3. Stem Focus: The phrase ..following a loss of VBS operation should be added to the 2nd fill-in-the-blank statement.
Changed to say with operator action; comments incorporated.
Question is SAT.
Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
: 4. Job Content Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 59  H     2                                                                       N   E   T2G2: CDS A3.01 S  1. Stem Focus: To ensure no confusion with what the fill-in-the-blank statement is asking, re-word as:
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly59 H 2           N E S T2G2: CDS A3.01 1. Stem Focus: To ensure no confusion with what the fill-in-the-blank statement is asking, re-word as: The minimum CDS flow required for the number of CDS pumps operating at 1005:00 is _____ gpm. Incorporated.
The minimum CDS flow required for the number of CDS pumps operating at 1005:00 is _____ gpm. Incorporated.
Q sat as of 10/28/2015. 60 H 2 x   x       N E S T2G2: CMS K6.08 1. Cred Dist: The 1 st part of Choice C (Compressor D hasn't auto-started yet) is not plausible because at 1005:00 condenser vacuum has decayed to 7.6 "HgA. Additionally, the interplay between the first and second portions of Choice C don't make sense (turbine tripped and compressor hasn't auto-started). Q modified to change initial equipment lineup which enhanced plausibility. 2. Stem Focus: It is not operationally valid to linearly extrapolate the vacuum decay since the delta P is not linear with respect to time. Suggest providing another point in time with the vacuum value. Extrapolation no longer needed to ensure correct answer because with the new alignment, the answer is "has not." Q sat as of 11/05/2015. 61 H 2 x x       B U S T2G1: MTS K1.08 1. Cred Dist: The stem picture shows V017A CLOSED and its smaller bypass (V016A) is OPEN. Since the line is smaller, then the answer can't be the larger power choices. Valve sizes are comparable. 2. Cue: The largest range is also the correct answer; suggest changing to: WOOTF identifies a turbine power that is equivalent to these valve positions? A. A% B. B% C. C%
Q sat as of 10/28/2015.
D. D% Q modified. Q sat as of 11/05/2015.
60   H     2     x                 x                                             N   E   T2G2: CMS K6.08 S  1. Cred Dist: The 1st part of Choice C (Compressor D hasnt auto-started yet) is not plausible because at 1005:00 condenser vacuum has decayed to 7.6 HgA. Additionally, the interplay between the first and second portions of Choice C dont make sense (turbine tripped and compressor hasnt auto-started). Q modified to change initial equipment lineup which enhanced plausibility.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 2. Stem Focus: It is not operationally valid to linearly extrapolate the vacuum decay since the delta P is not linear with respect to time. Suggest providing another point in time with the vacuum value. Extrapolation no longer needed to ensure correct answer because with the new alignment, the answer is has not.
: 4. Job Content Flaws
Q sat as of 11/05/2015.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly62              N U S T2G2: WGS A1.02 1. Cred Dist: The 1 st part of Choices C/D (TCS cools WGS) is not plausible because the stem says letdown is being cooled, which is located in the reactor auxiliary (potentially contaminated) building. Does TCS cool any contaminated system? Q modified. 2. Stem Focus: The 1 st fill-in-the-blank statement should be softened to "..could be due to a loss of.."  Q modified. 3. The 2 nd fill-in-the-blank statement should include the phrase.."in accordance with". Incorporated. 4. Stem Focus: The way the 2 nd fill-in-the-blank statement is worded implies that there IS a delay bed fire. Suggest rewording as: IAW..at 1030:00, nitrogen injection _____ required. Incorporated.
61   H     2           x           x                                             B   U   T2G1: MTS K1.08 S  1. Cred Dist: The stem picture shows V017A CLOSED and its smaller bypass (V016A) is OPEN. Since the line is smaller, then the answer cant be the larger power choices. Valve sizes are comparable.
: 2. Cue: The largest range is also the correct answer; suggest changing to:
WOOTF identifies a turbine power that is equivalent to these valve positions?
A. A%
B. B%
C. C%
D. D%
Q modified.
Q sat as of 11/05/2015.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 62                                                                                N   U   T2G2: WGS A1.02 S  1. Cred Dist: The 1st part of Choices C/D (TCS cools WGS) is not plausible because the stem says letdown is being cooled, which is located in the reactor auxiliary (potentially contaminated) building. Does TCS cool any contaminated system? Q modified.
: 2. Stem Focus: The 1st fill-in-the-blank statement should be softened to ..could be due to a loss of.. Q modified.
: 3. The 2nd fill-in-the-blank statement should include the phrase..in accordance with. Incorporated.
: 4. Stem Focus: The way the 2nd fill-in-the-blank statement is worded implies that there IS a delay bed fire. Suggest rewording as:
IAW..at 1030:00, nitrogen injection _____ required.
Incorporated.
Q is sat as of 10/28/2015.
Q is sat as of 10/28/2015.
63             N E S T2G2: CWS K4.01 1. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice C makes this choice not plausible. Answer changes when < 10% power; Question is SAT. 64 H 1   x       N U S T2G2: SDCS K5.03 1. Cred Dist: The 1 st part of Choices C/D (reactor power won't rise) is not plausible because a steam leak is occurring. Q modified to test valve capacity. 2. Cred Dist: The 2 nd part of Choices B/D (rods won't move) is not plausible because there is nothing in the steam that can be misconstrued that the rods aren't in AUTO. Q modified. 3. LOD=1: This question will not provide any discriminatory value on the exam. Q modified. Q sat as of 11/05/2015.
63                                                                                 N   E   T2G2: CWS K4.01 S  1. Cred Dist: The interplay between the 1st and 2nd parts of Choice C makes this choice not plausible.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Answer changes when < 10% power; Question is SAT.
: 4. Job Content Flaws
64   H     1                       x                                             N   U   T2G2: SDCS K5.03 S  1. Cred Dist: The 1st part of Choices C/D (reactor power wont rise) is not plausible because a steam leak is occurring. Q modified to test valve capacity.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly65 F 2 x           N E S T2G2: NIS A4.02 1. Stem Focus: At 1000:00, break the ONLY bullet into two bullets: A/B/C Blocked and D NOT Blocked. Incorporated. Q sat as of 11/05/2015. 66 F 2           N S T3: G2.1.18 67 F 1   x       M U S T3: G2.1.33 1. Cred Dist: The 1 st part of Choices A/B (announcing transient alarms is required) is not plausible because the purpose of transient alarm protocol is emergency operating procedures' events. 2. Cred Dist: The 2 nd part of Choices B/D (no update to return to normal) is not plausible because no one would ever know when normal annunciator protocols went back into effect without some sort of update. 3. LOD=1: This question will provide no discriminatory value on the exam. Re-wrote question to test AOP/EOP communication protocols; Question is SAT.
: 2. Cred Dist: The 2nd part of Choices B/D (rods wont move) is not plausible because there is nothing in the steam that can be misconstrued that the rods arent in AUTO. Q modified.
68 F 2           N U S T3: G2.2.15 1. Cred Dist: The 2 nd part of Choices A/C (only one procedure involved for configuration mgmt.)
: 3. LOD=1: This question will not provide any discriminatory value on the exam. Q modified.
is not plausible because the word ONLY is too exclusive. There are multiple procedures in effect for configuration management. 2. Stem Focus: The title of NMP-AD-002 is missing from the 2 nd fill-in-the-blank statement. Rewrote question to test resetting tripped breaker; Question is SAT.
Q sat as of 11/05/2015.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                   8.
: 4. Job Content Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 65  F    2     x                                                                 N   E   T2G2: NIS A4.02 S  1. Stem Focus: At 1000:00, break the ONLY bullet into two bullets: A/B/C Blocked and D NOT Blocked. Incorporated.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly69 F 2 x   x       N U S T3: G2.2.23 1. Cred Dist: The 2 nd part of Choices A/C (excore detectors only thing that matters) is not plausible because of the phrase "core thermal power."  Thermal power is always more conservative to drive by. Q modified. 2. Stem Focus: Include the phrase "-in accordance with procedure XYZ" in the 1 st fill-in-the-blank statement. Procedure tie now exists. Q sat as of 11/05/2015. 70 F 2   x       N U S T3: G2.2.30 1. Cred Dist: The 2 nd part of Choices A/C (only operated at RO workstation) is not plausible because the word ONLY is too exclusive; there are many ways to operate components at the CIM, for example. Q modified. Q sat as of 11/05/2015.
Q sat as of 11/05/2015.
71 H 2   x     x N U S T3: G2.3.5 1. Cred Dist: The 1 st part of Choices A/B is not plausible because the oxygen feature never causes an auto-isolation for a radioactive release. 2. Cred Dist: The 2 nd part of Choices B/D is not plausible because nitrogen would only be automatically introduced for a fire or oxygen issue - not for high rad at 1003:00. 3. Q=K/A: This is an extension of a Tier 2 (Systems) topic; the proposed question does not test a generic plant wide radiation release concept. For example, the administrative aspects of releases or the emergency operating procedures allowances for releases - - more than just how the system works. Significantly modified the question; Question is SAT.
66   F     2                                                                       N   S   T3: G2.1.18 67   F     1                       x                                             M   U   T3: G2.1.33 S  1. Cred Dist: The 1st part of Choices A/B (announcing transient alarms is required) is not plausible because the purpose of transient alarm protocol is emergency operating procedures events.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 2. Cred Dist: The 2nd part of Choices B/D (no update to return to normal) is not plausible because no one would ever know when normal annunciator protocols went back into effect without some sort of update.
: 4. Job Content Flaws
: 3. LOD=1: This question will provide no discriminatory value on the exam.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly72 F 1   x       M U S T3: G2.3.6 1. Cred Dist: The 1 st part of Choices C/D (must frisk coming out of high rad area) is not plausible because contamination is the concern; radiation fields are around us all the time and we never frisk. This is GET knowledge. Q modified. 2. Cred Dist: The 2 nd part of Choices A/C is not plausible because the control room would be overwhelmed when any person caused a gamma portal alarm. Q modified. 3. LOD=1: This test item will provide no discriminatory value. Q sat as of 11/05/2015. 73 H 2 x   x       B E S T3: G2.4.15 1. Cue: The phrase "in a 15 minute period" is not necessary to elicit the correct response. Time bounding is needed. 2. Partial: There may be no correct answer; the 2 nd part of Choice B may not be always totally correct when plant conditions require shutting the MOV. Just because the caution exists doesn't mean there may be times when the MOV should be closed anyway. Q asked iaw procedure. 3. Ensure this question does not overlap with RO Q#37. Overlap evaluated sat. Q sat as of 11/05/2015. 74 L 3           M S T3: G2.4.17 75 H 2         x N U S T3: G2.4.38 1. Q=K/A: The ability to diagnose and recognize trends is not being met because the graph is merely a point in time value. Q modified and graph now supports KA match. Q sat as of 11/05/2015. 76 H 3           N S T1G1 A-336 (AOP-402, Malf of Prot & Safety Mon'g) G2.2.19 Q is sat.
Re-wrote question to test AOP/EOP communication protocols; Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
68   F     2                                                                       N   U   T3: G2.2.15 S  1. Cred Dist: The 2nd part of Choices A/C (only one procedure involved for configuration mgmt.) is not plausible because the word ONLY is too exclusive. There are multiple procedures in effect for configuration management.
: 4. Job Content Flaws
: 2. Stem Focus: The title of NMP-AD-002 is missing from the 2nd fill-in-the-blank statement.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly77 H 2 x x x       N E S T1G1 E-1 G2.1.7 Note to NRC reviewers: In the Westinghouse operating fleet EOPs, if you're in E-3 and subsequently get a LOCA, you stay in E-3 because it is designed to handle SGTR + LOCA. In AP-1000 this is not the case - - you leave E-3 and enter E-1. 1. Cue: The phrase "to mitigate the above conditions" in the 1 st fill-in-the-blank statement is not necessary to elicit the correct response. 2. Cred Dist: To enhance the plausibility of the 1 st part of A/B (will transition to E-3), and better raise the question of the SGTL, revise the 4 th bullet in the stem to say: The crew is performing the following step in E-1:   3. Stem Focus: It seems more appropriate to re-order the 1000:00 bullets so that the 1 st bullet becomes the last bullet. 4. Stem Focus: The 2 nd bullet needs to add the phrase "IAW AOP-103, SGTL.
Rewrote question to test resetting tripped breaker; Question is SAT.
" 5. Stem Focus: The phrase "direct a" in the 1 st fill-in-the-blank statement is not necessary. Comments incorporated; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 69  F     2     x                 x                                             N   U   T3: G2.2.23 S  1. Cred Dist: The 2nd part of Choices A/C (excore detectors only thing that matters) is not plausible because of the phrase core thermal power. Thermal power is always more conservative to drive by. Q modified.
: 4. Job Content Flaws
: 2. Stem Focus: Include the phrase in accordance with procedure XYZ in the 1st fill-in-the-blank statement. Procedure tie now exists.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly78 H 2 x x         N E S T1G1 FR-C.1 EA2.04 1. Cue: Because the 2 nd fill-in-the-blank statement is asking about RNS alignment, and RNS alignment is directed AFTER Step 32 in FR-C.1, the applicant is cued that the correct answer to the 1 stfill-in-the-blank statement must be to stay in the procedure (which is the correct answer). 2. Stem Focus: Re-write the 2 nd fill-in-the-blank statement to eliminate the word "strategy", whic h hints that this alignment is only a severe accident strategy, as follows:
Q sat as of 11/05/2015.
70   F     2                       x                                             N   U   T3: G2.2.30 S  1. Cred Dist: The 2nd part of Choices A/C (only operated at RO workstation) is not plausible because the word ONLY is too exclusive; there are many ways to operate components at the CIM, for example. Q modified.
Q sat as of 11/05/2015.
71   H     2                       x                                     x       N   U   T3: G2.3.5 S  1. Cred Dist: The 1st part of Choices A/B is not plausible because the oxygen feature never causes an auto-isolation for a radioactive release.
: 2. Cred Dist: The 2nd part of Choices B/D is not plausible because nitrogen would only be automatically introduced for a fire or oxygen issue - not for high rad at 1003:00.
: 3. Q=K/A: This is an extension of a Tier 2 (Systems) topic; the proposed question does not test a generic plant wide radiation release concept. For example, the administrative aspects of releases or the emergency operating procedures allowances for releases - - more than just how the system works.
Significantly modified the question; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 72  F     1                       x                                             M   U   T3: G2.3.6 S  1. Cred Dist: The 1st part of Choices C/D (must frisk coming out of high rad area) is not plausible because contamination is the concern; radiation fields are around us all the time and we never frisk. This is GET knowledge. Q modified.
: 2. Cred Dist: The 2nd part of Choices A/C is not plausible because the control room would be overwhelmed when any person caused a gamma portal alarm. Q modified.
: 3. LOD=1: This test item will provide no discriminatory value.
Q sat as of 11/05/2015.
73   H     2           x                 x                                       B   E   T3: G2.4.15 S  1. Cue: The phrase in a 15 minute period is not necessary to elicit the correct response. Time bounding is needed.
: 2. Partial: There may be no correct answer; the 2nd part of Choice B may not be always totally correct when plant conditions require shutting the MOV. Just because the caution exists doesnt mean there may be times when the MOV should be closed anyway. Q asked iaw procedure.
: 3. Ensure this question does not overlap with RO Q#37. Overlap evaluated sat.
Q sat as of 11/05/2015.
74   L     3                                                                       M   S   T3: G2.4.17 75   H     2                                                             x       N   U   T3: G2.4.38 S  1. Q=K/A: The ability to diagnose and recognize trends is not being met because the graph is merely a point in time value. Q modified and graph now supports KA match.
Q sat as of 11/05/2015.
76   H     3                                                                       N   S   T1G1 A-336 (AOP-402, Malf of Prot & Safety Mong) G2.2.19 Q is sat.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                         8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                  Explanation Focus              Dist.        Link          units ward K/A Only 77  H     2     x     x           x                                             N   E   T1G1 E-1 G2.1.7 S  Note to NRC reviewers: In the Westinghouse operating fleet EOPs, if youre in E-3 and subsequently get a LOCA, you stay in E-3 because it is designed to handle SGTR + LOCA. In AP-1000 this is not the case - - you leave E-3 and enter E-1.
: 1. Cue: The phrase to mitigate the above conditions in the 1st fill-in-the-blank statement is not necessary to elicit the correct response.
: 2. Cred Dist: To enhance the plausibility of the 1st part of A/B (will transition to E-3), and better raise the question of the SGTL, revise the 4th bullet in the stem to say:
The crew is performing the following step in E-1:
: 3. Stem Focus: It seems more appropriate to re-order the 1000:00 bullets so that the 1st bullet becomes the last bullet.
: 4. Stem Focus: The 2nd bullet needs to add the phrase IAW AOP-103, SGTL.
: 5. Stem Focus: The phrase direct a in the 1st fill-in-the-blank statement is not necessary.
Comments incorporated; Question is SAT.
: 1. 2.      3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 78  H     2     x     x                                                         N   E   T1G1 FR-C.1 EA2.04 S  1. Cue: Because the 2nd fill-in-the-blank statement is asking about RNS alignment, and RNS alignment is directed AFTER Step 32 in FR-C.1, the applicant is cued that the correct answer to the 1st fill-in-the-blank statement must be to stay in the procedure (which is the correct answer).
: 2. Stem Focus: Re-write the 2nd fill-in-the-blank statement to eliminate the word strategy, which hints that this alignment is only a severe accident strategy, as follows:
In accordance with Error! Reference source not found.
In accordance with Error! Reference source not found.
(Error! Reference source not found.) aligning RNS for RWST is __________ (credited for preventing core damage within the EOPs for an accident at power vs. a post-core damage severe accident management strategy
(Error! Reference source not found.) aligning RNS for RWST is __________
) Improper transition at Step 32 leads to SACRG; Comment #2 incorporated. Question is SAT. 79 H 2         x N U S T1G1 A-323 (Loss 6.9/4kv, or 480v) AA2.03 1. Q=K/A: The 2 nd part of the question is the SRO-only part; however, the 2 nd part of the question does not pertain to the standby diesel generator load topic. The 4 hour NRC notification pertains to the reactor trip. Suggest re-working the question to test whether Attachment 1, Load Management (or alternatively Attachment 3, Prolonged Loss of AC Power) is/ is NOT required, given that the stem includes more info that makes the "not" version plausible. Suggestion incorporated; Question is SAT.
(credited for preventing core damage within the EOPs for an accident at power vs. a post-core damage severe accident management strategy)
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Improper transition at Step 32 leads to SACRG; Comment #2 incorporated. Question is SAT.
: 4. Job Content Flaws
79   H     2                                                             x       N   U   T1G1 A-323 (Loss 6.9/4kv, or 480v) AA2.03 S  1. Q=K/A: The 2nd part of the question is the SRO-only part; however, the 2nd part of the question does not pertain to the standby diesel generator load topic. The 4 hour NRC notification pertains to the reactor trip.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly80 H 2 x         B U S T1G1 A-329 (AOP-703, LOIA) AA2.04 1. Cred Dist: The 1 st part of Choices C/D (mini-flow valve normally open at 100% power-RCS temp lowers when valve closes) is not plausible because the feed water pumps are pumping "all forward" at 100% power. 2. Cue: The 2 nd fill-in-the-blank statement tells the applicant that a feed water transient will occur; therefore, this cues the applicant that the mini-flow valves must fail to a position that's different to their normal position. (For exam ple, if the mini-flow valve is normally closed, and it fails closed on a lOIA, then there would be no transient.) 3. Cred Dist: The 2 nd part of Choices A/C (Uncontrolled cooldown) is not plausible because RCS temperature will rise due to the failed positions of the MFRVs and feed pump mini-flow valves. Suggest testing the applicants' knowledge of where E-0 Step 32 RNO sends you (Check Instrument Air > 105 psig RNO is to go to E-1, Step 6). This, in a sense, does evaluate the ability of the applicant to evaluate RCS temp, SG level, and/or SG pressure because E-1, Step 6 sends you to AOP-703. Rewrote question; Question is SAT. 81 H 3           N E S T1G1 FR-H.1 G2.4.24 (EMERGENCY CLASSIFICATION) 1. The VEGP EALS-ICS Threshold Values & Basis (B-GEN-PLMP-020-GL01) was not available in the references; I used NMP-EP-110-GL03, VEGPEALs-ICs, Threshold Values & Basis to research this question. 2. LOD: No E-plan reference is being provided to the applicants; ensure that Operations management has a learning objective or some basis for why the E-plan procedure fission product barrier thresholds must be known from memory. 3. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.
Suggest re-working the question to test whether Attachment 1, Load Management (or alternatively Attachment 3, Prolonged Loss of AC Power) is/ is NOT required, given that the stem includes more info that makes the not version plausible.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Suggestion incorporated; Question is SAT.
: 4. Job Content Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly82 H 2   x       x N E/U S T1G2 A304 (SGTL, AOP-103) G2.1.17 (EMERGENCY CLASSIFICATION) 1. Cred Dist: The 1 st part of Choices C/D (GOP-101, Power Operation Above 25% Power) is not plausible because the title of GOP-101 conflicts with the 1 st fill-in-the-blank statement.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 80  H     2           x                                                         B   U   T1G1 A-329 (AOP-703, LOIA) AA2.04 S  1. Cred Dist: The 1st part of Choices C/D (mini-flow valve normally open at 100% power-RCS temp lowers when valve closes) is not plausible because the feed water pumps are pumping all forward at 100% power.
That is, the 1 st fill-in-the-blank statement says "initiate a shutdown", whereas GOP-10 can be correctly eliminated,solely based on its title. The distracter analysis says that, if the rad monitor were available, then GOP-101 "could " be right. Let's discuss the basis for this analysis 2. SRO-only: The 2 nd part of the question can be answered solely based on information "above-the-line" in Tech Spec 3.4.7. That is, the E-plan excerpt provided in the stem deals with unidentified leakage, pressure boundary leakage, and identified leakage. The applicant only has to know that another category exists in Tech Spec 3.4.7, which is 'PRIMARY TO SECONDARY LEAKAGE." Suggest modifying the 1 st fill-in-the-blank statement to test the applicants' knowledge of whether or not AOP-101 is / Is NOT required. 3. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? Second part of question re-written; B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam. Question is SAT.
: 2. Cue: The 2nd fill-in-the-blank statement tells the applicant that a feed water transient will occur; therefore, this cues the applicant that the mini-flow valves must fail to a position thats different to their normal position. (For example, if the mini-flow valve is normally closed, and it fails closed on a lOIA, then there would be no transient.)
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 3. Cred Dist: The 2nd part of Choices A/C (Uncontrolled cooldown) is not plausible because RCS temperature will rise due to the failed positions of the MFRVs and feed pump mini-flow valves.
: 4. Job Content Flaws
Suggest testing the applicants knowledge of where E-0 Step 32 RNO sends you (Check Instrument Air > 105 psig RNO is to go to E-1, Step 6). This, in a sense, does evaluate the ability of the applicant to evaluate RCS temp, SG level, and/or SG pressure because E-1, Step 6 sends you to AOP-703.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly83 H 2 x         x N U S T1G2 SDP-4, EA2.01 1. SRO-only: Neither part of the question is SRO-only, for the following reasons:
Rewrote question; Question is SAT.
1 st fill-in the-blank statement: The applicants only have to know the information "above-the-line" in Tech Spec 3.9.1 (Refueling
81   H     3                                                                       N   E   T1G1 FR-H.1 G2.4.24 (EMERGENCY CLASSIFICATION)
S  1. The VEGP EALS-ICS Threshold Values & Basis (B-GEN-PLMP-020-GL01) was not available in the references; I used NMP-EP-110-GL03, VEGPEALs-ICs, Threshold Values & Basis to research this question.
: 2. LOD: No E-plan reference is being provided to the applicants; ensure that Operations management has a learning objective or some basis for why the E-plan procedure fission product barrier thresholds must be known from memory.
: 3. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?
B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                       8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 82  H     2                       x                                           x N   E/U T1G2 A304 (SGTL, AOP-103) G2.1.17 S  (EMERGENCY CLASSIFICATION)
: 1. Cred Dist: The 1st part of Choices C/D (GOP-101, Power Operation Above 25% Power) is not plausible because the title of GOP-101 conflicts with the 1st fill-in-the-blank statement.
That is, the 1st fill-in-the-blank statement says initiate a shutdown, whereas GOP-10 can be correctly eliminated,solely based on its title. The distracter analysis says that, if the rad monitor were available, then GOP-101 could be right. Lets discuss the basis for this analysis
: 2. SRO-only: The 2nd part of the question can be answered solely based on information above-the-line in Tech Spec 3.4.7. That is, the E-plan excerpt provided in the stem deals with unidentified leakage, pressure boundary leakage, and identified leakage. The applicant only has to know that another category exists in Tech Spec 3.4.7, which is PRIMARY TO SECONDARY LEAKAGE.
Suggest modifying the 1st fill-in-the-blank statement to test the applicants knowledge of whether or not AOP-101 is / Is NOT required.
: 3. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?
Second part of question re-written; B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam. Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 83  H     2     x                                                             x N   U   T1G2 SDP-4, EA2.01 S  1. SRO-only: Neither part of the question is SRO-only, for the following reasons:
1st fill-in the-blank statement: The applicants only have to know the information above-the-line in Tech Spec 3.9.1 (Refueling
[B], (1662 ppm). Since 1600 ppm < 1662, then the only option is to borate the RCS.
[B], (1662 ppm). Since 1600 ppm < 1662, then the only option is to borate the RCS.
2 nd fill-in-the-blank statement: The most conservative basis for the 1662 ppm Tech Spec limit is core reactivity at the BEGINNING of a cycle, since this is when the core contains the most fissionable material. 2. Stem Focus: The stem says (4 th bullet) that SR neutron flux is stable; this does not align with the 2 nd bullet that says SDP-4 was entered due to rising nuclear flux. Replaced question; new question is SAT.
2nd fill-in-the-blank statement: The most conservative basis for the 1662 ppm Tech Spec limit is core reactivity at the BEGINNING of a cycle, since this is when the core contains the most fissionable material.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 2. Stem Focus: The stem says (4th bullet) that SR neutron flux is stable; this does not align with the 2nd bullet that says SDP-4 was entered due to rising nuclear flux.
: 4. Job Content Flaws
Replaced question; new question is SAT.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly84 F 2 x          x N U S T1G2 A-332 (AOP-207) G2.1.7 1. SRO-only: The distracter analysis indicated that this question was tied to SRO topic 55.43(b)(2) (Tech Specs); however, the proposed test item does not test bases knowledge nor does it involve the application of Tech Specs. Instead, the 1 st fill-in-the-blank statement can be answered solely based on the RCS activity surveillance requirement when power has changed more than 15% in a 1 hour period. (typically RO knowledge) The second part of the question does not involve procedure selection, Tech Specs, or any of the other five 55.43(b) topics. 2. Stem Focus: The SUR is not necessary. A better way to hit the K/A would be to test the applicants' ability select a procedure at the Step 19.e point in AOP-207.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                   8.
Replaced 2 nd half of question; Question is SAT.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                             Explanation Focus              Dist.        Link          units ward K/A Only 84  F    2    x                                                              x N    U  T1G2 A-332 (AOP-207) G2.1.7 S  1. SRO-only: The distracter analysis indicated that this question was tied to SRO topic 55.43(b)(2) (Tech Specs); however, the proposed test item does not test bases knowledge nor does it involve the application of Tech Specs. Instead, the 1st fill-in-the-blank statement can be answered solely based on the RCS activity surveillance requirement when power has changed more than 15% in a 1 hour period. (typically RO knowledge)
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
The second part of the question does not involve procedure selection, Tech Specs, or any of the other five 55.43(b) topics.
: 4. Job Content Flaws
: 2. Stem Focus: The SUR is not necessary.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly85 F 2 x   x       N U S T1G2 FR-I.3 EA2.02 1. Cred Dist: The 1 st part of Choices A/B (raise RCS pressure to satisfy sub cooling req'ts) is not plausible because the stem implies that the EOPs were entered, a Safeguards was blocked, and that the plant is headed to cold shut down; raising pressure not usually the preferred option in this scenario. 2. Stem Focus: The 1 st bullet does not provide information related to what procedure, or past situation, required blocking  
A better way to hit the K/A would be to test the applicants ability select a procedure at the Step 19.e point in AOP-207.
 
Replaced 2nd half of question; Question is SAT.
safeguards, etc. Suggest reworking the proposed test item to test the applicants' knowledge of another item such as, 1) when, while implementing FR-I.3, transition to FR-I.2 would be actually be required, or 2) possibly test when vessel venting is required to be terminated.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Raising pressure would be the answer if not already at 1920 psig; Question is SAT. 86 F 2 x       x x N U S T2G1 SGS G2.4.39 1. Q=K/A: The K/A is not being met because the proposed test item stem does not require any alarm response procedure ability; the 3 rd bullet says the alarm response procedure ability has already been taken. The proposed test item only requires the applicant to know which instruments are dedicated to DAS (vs PMS), and the DAS function. 2. SRO-only: The applicant can answer the question solely by knowing which instruments are dedicated to DAS, and the associated DAS function.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 85  F     2     x                 x                                             N   U   T1G2 FR-I.3 EA2.02 S  1. Cred Dist: The 1st part of Choices A/B (raise RCS pressure to satisfy sub cooling reqts) is not plausible because the stem implies that the EOPs were entered, a Safeguards was blocked, and that the plant is headed to cold shut down; raising pressure not usually the preferred option in this scenario.
Suggest taking the 3 rd item listed in the stem and test the applicants' ability to implement Tech Spec actions in accordance with the alarm response procedure. 3. Cue: The 2 nd bullet should include the information that the applicant would see in the control room instead of telling the applicant that SGS-LT018 failed downscale with bad quality. Re-wrote question; Question is SAT.
: 2. Stem Focus: The 1st bullet does not provide information related to what procedure, or past situation, required blocking safeguards, etc.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Suggest reworking the proposed test item to test the applicants knowledge of another item such as, 1) when, while implementing FR-I.3, transition to FR-I.2 would be actually be required, or 2) possibly test when vessel venting is required to be terminated.
: 4. Job Content Flaws
Raising pressure would be the answer if not already at 1920 psig; Question is SAT.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly87 F 2   x     x N U S T2G1 PXS A2.16 1. Cred Dist: The 1 st part of Choices C/D (manual DAS not required) is not plausible because conservative decision making would always seem to require follow up with a manual DAS to attempt to make the PDSP actuation occur. 2. Cred Dist: The 2 nd part of Choices B/D (the limiting DBA doesn't require at least one of the CMTs. 3. Q=K/A: The proposed test item doesn't test the applicants' ability to predict HOW the CMT discharge isolation valve failure affects the plant, including the required subsequent procedures.4. Stem Focus: The Tech Spec number is missing from the 2 nd fill-in-the-blank statement. Question replaced; Question is SAT. 88 H 2   x       N E T2G1 ECS K2.02 (EMERGENCY CLASSIFICATION) 1. Cred Dist: Choice D is not plausible because the note is included in the stem. 2. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? Note removed and B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT. 89 F 2   x       x N U S T2G1 DOS A2.01 1. SRO-only: The 2 nd part of the question is the part that hits the K/A; however, the 2 nd part of the question is not SRO-only knowledge because the RO has to know the required tank level.  
86   F     2           x                                                 x     x N   U   T2G1 SGS G2.4.39 S  1. Q=K/A: The K/A is not being met because the proposed test item stem does not require any alarm response procedure ability; the 3rd bullet says the alarm response procedure ability has already been taken. The proposed test item only requires the applicant to know which instruments are dedicated to DAS (vs PMS), and the DAS function.
 
: 2. SRO-only: The applicant can answer the question solely by knowing which instruments are dedicated to DAS, and the associated DAS function.
The 1 st part of the question is TRM; however, the required knowledge is "above-the-line." 2. Cred Dist: The 2 nd part of Choices A/B (fuel level is SAT) is not plausible because the fuel oil transfer pump won't have a suction (as indicated in the stem). Suggest writing a question that tests the applicants' ability to determine the course of action when a common cause failure of the DG fuel oil transfer system renders it non-functional for both diesels, with the plant operating at 100% power.
Suggest taking the 3rd item listed in the stem and test the applicants ability to implement Tech Spec actions in accordance with the alarm response procedure.
2 nd part of question modified; Question is SAT.  
: 3. Cue: The 2nd bullet should include the information that the applicant would see in the control room instead of telling the applicant that SGS-LT018 failed downscale with bad quality.
 
Re-wrote question; Question is SAT.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
: 4. Job Content Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 87  F     2                       x                                     x       N   U   T2G1 PXS A2.16 S  1. Cred Dist: The 1st part of Choices C/D (manual DAS not required) is not plausible because conservative decision making would always seem to require follow up with a manual DAS to attempt to make the PDSP actuation occur.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly90 F 2    x        N U S T2G1  SWS G2.4.14 1. Cred Dist: The 1 st part of Choices A/C (can be performed in any order) is not plausible because the steps are alpha-numerically identified, which implies "a" before "b."  The 1 st part of the proposed test item will not provide any discriminatory value. First part of question re-wrote; Question is SAT. 91 F 2 x   x       N E S T2G2 DRCS G2.4.36 1. Partial: There may be no correct answer to the 2 nd fill-in-the-blank statement based on the following PLS-SOP-001 guidance.
: 2. Cred Dist: The 2nd part of Choices B/D (the limiting DBA doesnt require at least one of the CMTs.
The stem conditions don't exactly match the context of the guidance.
: 3. Q=K/A: The proposed test item doesnt test the applicants ability to predict HOW the CMT discharge isolation valve failure affects the plant, including the required subsequent procedures.
The 2 nd fill-in-the-blank statement does not involve a power reduction in progress. 2. Stem Focus: The stem does not provide the initial reactor power level. 3. Stem Focus: The stem should indicate which section of PLS-SOP-001 is being implemented (Attachment 4, Grey Control Rod Exchange?). Comments incorporated; Question is SAT. 92 H 2   x       x N U S T2G2 PLCS A2.08 1. SRO-only: The 2 nd part of the proposed test item is not linked to any of the 10CFR55.43(b) topics - the 2 nd part of the question does not involve procedure selection. 2. Cred Dist: The 2 nd part of Choices B/D (turn off makeup pumps to perform leak calc) is not pl ausible because pressurizer level is lowering. It is not plausible to turn off the makeup source when performing the leak calcul ation because this could cause pressurizer level to lower more rapidly. Question re-written; Question is SAT.
: 4. Stem Focus: The Tech Spec number is missing from the 2nd fill-in-the-blank statement.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Question replaced; Question is SAT.
: 4. Job Content Flaws
88   H     2                       x                                             N   E   T2G1 ECS K2.02 (EMERGENCY CLASSIFICATION)
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly93 H 5 3 x   x       N E/U S T2G2 NIS A2.09 1. There appears to be no approved procedure for NIS. Please provide procedure for bypassi ng and placing PR channels in tripped condition. The stem contains phrase such as the 1030 bullet (functions associated with NE004A placed in bypass) and 2 nd fill-in-the-blank statement (NE004B is required to be placed in trip). Need to see how each of these actions is described in the procedure. 2. Cred Dist: The plausibility of the 2 nd part of Choices B/D (NE004B NOT required to be placed in tripped) is questionable because there is no procedure for NIS. IF there is only allowance to place ONE NI channel in bypass, THEN, the 2 nd part of Choices B/D is not plausible. 3. LOD=5: Generally speaking, we always provide Tech Specs for  
: 1. Cred Dist: Choice D is not plausible because the note is included in the stem.
> 1 hour action statement applications. This is done to ensure no post-exam appeals. This question has the potential to be argued as LOD=5 w/o a reference. 4. Stem Focus: The 2 nd fill-in-the-blank statement is missing the Tech Spec #/title. 5. Stem Focus: There are font size issues in the 2 nd and 3 rd bullets in the stem. 6. Stem Focus: Why can't the 2 nd fill-in-the-blank statement be worded as "At 1645:00, in accordance with Tech Spec 3.3.1, Reactor Trip Instrumentation, RXS-NE004B _____- required to be placed in the TRIPPED condition."  Is there something associated with using the phrase "the functions associated with.." in the statement? Procedure exists; second part of question re-written to test knowledge of Tech Spec bases. Question is SAT.
: 2. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Note removed and B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.
: 4. Job Content Flaws
89   F     2                       x                                           x N   U   T2G1 DOS A2.01 S  1. SRO-only: The 2nd part of the question is the part that hits the K/A; however, the 2nd part of the question is not SRO-only knowledge because the RO has to know the required tank level.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly94 H 2 x   x       N E S T3 G2.1.22 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (use of steam tables to correlate the secondary-to-primary temperature relationship), using a contextual example (EOPs). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: Choice C (go to yellow path procedure) is not plausible because yellow path procedures are always optional and typically written for situations where a safeguards has occurred. If a safeguards were presumed to have occurred, then Choice B (go to E-0) is always the winner vs choosing to implement a yellow path. 2. Stem Focus: In order to protect the credibility of Choice B (safeguards has occurred while the crew was performing Step 35 of ES-0.1), re-order the stem as: The crew is performing ES-0.1, Step 35: (picture of step and RNO) While the crew was performing Step 35, the following conditions were noted: (the 5 bullets)
The 1st part of the question is TRM; however, the required knowledge is above-the-line.
: 3. Suggest re-working the choices (to ensure procedure selection for SRO and to avoid using the word ONLY) as: A. Remain in ES-0.1, do not perform SOP-ECS-001, Attachment 21 B. Exit ES-0.1 and transition to E-0 C. (Need something else plausible here) D. Remain in ES-0.1, perform SOP-ECS-001, Attachment 21 Question replaced; Question is SAT.
: 2. Cred Dist: The 2nd part of Choices A/B (fuel level is SAT) is not plausible because the fuel oil transfer pump wont have a suction (as indicated in the stem).
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Suggest writing a question that tests the applicants ability to determine the course of action when a common cause failure of the DG fuel oil transfer system renders it non-functional for both diesels, with the plant operating at 100% power.
: 4. Job Content Flaws
2nd part of question modified; Question is SAT.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly95 F 2 x   x       M U S T3 G2.1.27 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (PCIV Tech Spec allowance for using an in-line valve to comply), using a contextual example (VFS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: The 2 nd part of Choices B/D (V009 breaker can remain ON) is not plausible because leaving the breaker ON can still allow someone or some malfunction to change the valve position. Suggest re-working the question to test the same scenario, except in a situation where reli ance on a check valve is / is NOT allowed to comply with TS 3.6.3. 2. Stem Focus: To ensure operational validity and compliance with policy statement regarding tracking Tech Specs during EOP implementation (ML#042960453), re-write stem such that crew originally found V010 failure while implementing the EOPs, but subsequently exited the EOPs and entered the GOI procedure, and is now in Mode 3 determining required Tech Spec actions. 3. Provide original question with the modified question. Question replaced; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                               Explanation Focus              Dist.        Link          units ward K/A Only 90  F    2                        x                                              N    U  T2G1 SWS G2.4.14 S  1. Cred Dist: The 1st part of Choices A/C (can be performed in any order) is not plausible because the steps are alpha-numerically identified, which implies a before b. The 1st part of the proposed test item will not provide any discriminatory value.
: 4. Job Content Flaws
First part of question re-wrote; Question is SAT.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly96 F 5       x   x M U S T3 G2.2.2 1. Q=K/A: The proposed test item solely tests a Tier 2 (Plant Systems) knowledge related to the Main Steam Line Flow Path Isolation Valves (TS 3.7.2). There is no plant-wide generic concept being tested. ES-401N, Section D.2.a (page 6 of 51) says that Tier 3 should not become an extension of Tier 2.
91   F     2     x                       x                                       N   E   T2G2 DRCS G2.4.36 S  1. Partial: There may be no correct answer to the 2nd fill-in-the-blank statement based on the following PLS-SOP-001 guidance.
Suggest testing some aspect of V34 Specific Management MCR Policies, NMP-OS-007-001, Conduct of Ops, NMP-OS-001, Reactivity Mgmt Program, etc. , including required approvals for deviating from these type of admin requirements, related to operating the controls, etc, during various points in time such as startup, shutdowns, normal ops, etc. 2. Minutia: The 2 nd part of the question can be argued as minutia without a reference being provided. 3. Provide original question with the modified question. Question replaced; Question is SAT. 97 H 3 x   x       M E S T3 G2.2.26 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (any missed TRM surveillance requirement allowances for delaying entry to TR 3.0.3), using a contextual example (EDS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: Choice D is not plausible because, unlike the other choices, the stem does not include the original due date of the  
The stem conditions dont exactly match the context of the guidance.
 
The 2nd fill-in-the-blank statement does not involve a power reduction in progress.
surveillance. 2. Stem Focus: Modify the choices to be clear, for example: A. 14 days after 4/30/2021 B. 15 days after 4/30/2021 C. 106 days after 4/30/2021 D. 106 days after ????
: 2. Stem Focus: The stem does not provide the initial reactor power level.
: 3. Stem Focus: The word "applicable" in the 2 nd bullet should be "allowable." 4. Include original question that this question was modified from. Comments incorporated; Question is SAT.
: 3. Stem Focus: The stem should indicate which section of PLS-SOP-001 is being implemented (Attachment 4, Grey Control Rod Exchange?).
Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws
Comments incorporated; Question is SAT.
: 4. Job Content Flaws
92   H     2                       x                                           x N   U   T2G2 PLCS A2.08 S  1. SRO-only: The 2nd part of the proposed test item is not linked to any of the 10CFR55.43(b) topics - the 2nd part of the question does not involve procedure selection.
: 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly98 F 2           N S T3 G2.3.9 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (SR 3.0.2), using a contextual example (Leakage Detection Rad Monitor). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 99 H 1 2            M E/U S T3 G2.4.5 1. B-GEN-PLMP-038, Emergency Notifications, was not provided in the reference material. 2. LOD=1: The 1 st part of Choices A/B will not provide any discriminatory value because the title of the procedure refers to the licensee emergency organization. 3. Include original question that this question was modified from.
: 2. Cred Dist: The 2nd part of Choices B/D (turn off makeup pumps to perform leak calc) is not plausible because pressurizer level is lowering. It is not plausible to turn off the makeup source when performing the leak calculation because this could cause pressurizer level to lower more rapidly.
Question revised to include a fuel handling accident to enhance discriminatory value. Question is SAT. 100 H 2 x x   x       M E S T3 G2.4.7 1. Cue: The EAL designators listed in the 2 nd part of each choice are not needed to elicit the correct response. 2. Stem Focus: The 1 st part of each choice (can be used vs can NOT be used) may be better as is allowed vs is NOT allowed. 3. Partial: The 2 nd fill-in-the-blank statement should be worded as "the highest required emergency classification is ____ . 4. Include original question that this question was modified from. Comments incorporated; Question is SAT.}}
Question re-written; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 93  H     5     x                 x                                             N   E/U T2G2 NIS A2.09 3                                                                            S  1. There appears to be no approved procedure for NIS. Please provide procedure for bypassing and placing PR channels in tripped condition. The stem contains phrase such as the 1030 bullet (functions associated with NE004A placed in bypass) and 2nd fill-in-the-blank statement (NE004B is required to be placed in trip). Need to see how each of these actions is described in the procedure.
: 2. Cred Dist: The plausibility of the 2nd part of Choices B/D (NE004B NOT required to be placed in tripped) is questionable because there is no procedure for NIS. IF there is only allowance to place ONE NI channel in bypass, THEN, the 2nd part of Choices B/D is not plausible.
: 3. LOD=5: Generally speaking, we always provide Tech Specs for
                                                                                                > 1 hour action statement applications. This is done to ensure no post-exam appeals. This question has the potential to be argued as LOD=5 w/o a reference.
: 4. Stem Focus: The 2nd fill-in-the-blank statement is missing the Tech Spec #/title.
: 5. Stem Focus: There are font size issues in the 2nd and 3rd bullets in the stem.
: 6. Stem Focus: Why cant the 2nd fill-in-the-blank statement be worded as At 1645:00, in accordance with Tech Spec 3.3.1, Reactor Trip Instrumentation, RXS-NE004B _____- required to be placed in the TRIPPED condition. Is there something associated with using the phrase the functions associated with.. in the statement?
Procedure exists; second part of question re-written to test knowledge of Tech Spec bases. Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                       8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 94  H     2     x                 x                                             N   E   T3 G2.1.22 S  NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (use of steam tables to correlate the secondary-to-primary temperature relationship), using a contextual example (EOPs). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.
: 1. Cred Dist: Choice C (go to yellow path procedure) is not plausible because yellow path procedures are always optional and typically written for situations where a safeguards has occurred. If a safeguards were presumed to have occurred, then Choice B (go to E-0) is always the winner vs choosing to implement a yellow path.
: 2. Stem Focus: In order to protect the credibility of Choice B (safeguards has occurred while the crew was performing Step 35 of ES-0.1), re-order the stem as:
The crew is performing ES-0.1, Step 35: (picture of step and RNO)
While the crew was performing Step 35, the following conditions were noted: (the 5 bullets)
: 3. Suggest re-working the choices (to ensure procedure selection for SRO and to avoid using the word ONLY) as:
A. Remain in ES-0.1, do not perform SOP-ECS-001, Attachment 21 B. Exit ES-0.1 and transition to E-0 C.   (Need something else plausible here)
D. Remain in ES-0.1, perform SOP-ECS-001, Attachment 21 Question replaced; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 95  F     2     x                 x                                             M   U   T3 G2.1.27 S  NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (PCIV Tech Spec allowance for using an in-line valve to comply), using a contextual example (VFS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.
: 1. Cred Dist: The 2nd part of Choices B/D (V009 breaker can remain ON) is not plausible because leaving the breaker ON can still allow someone or some malfunction to change the valve position.
Suggest re-working the question to test the same scenario, except in a situation where reliance on a check valve is / is NOT allowed to comply with TS 3.6.3.
: 2. Stem Focus: To ensure operational validity and compliance with policy statement regarding tracking Tech Specs during EOP implementation (ML#042960453), re-write stem such that crew originally found V010 failure while implementing the EOPs, but subsequently exited the EOPs and entered the GOI procedure, and is now in Mode 3 determining required Tech Spec actions.
: 3. Provide original question with the modified question.
Question replaced; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                     8.
Q# LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                              Explanation Focus              Dist.        Link          units ward K/A Only 96  F     5                                             x               x       M   U   T3 G2.2.2 S  1. Q=K/A: The proposed test item solely tests a Tier 2 (Plant Systems) knowledge related to the Main Steam Line Flow Path Isolation Valves (TS 3.7.2). There is no plant-wide generic concept being tested. ES-401N, Section D.2.a (page 6 of 51) says that Tier 3 should not become an extension of Tier 2.
Suggest testing some aspect of V34 Specific Management MCR Policies, NMP-OS-007-001, Conduct of Ops, NMP-OS-001, Reactivity Mgmt Program, etc. , including required approvals for deviating from these type of admin requirements, related to operating the controls, etc, during various points in time such as startup, shutdowns, normal ops, etc.
: 2. Minutia: The 2nd part of the question can be argued as minutia without a reference being provided.
: 3. Provide original question with the modified question.
Question replaced; Question is SAT.
97   H     3     x                 x                                             M   E   T3 G2.2.26 S  NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (any missed TRM surveillance requirement allowances for delaying entry to TR 3.0.3), using a contextual example (EDS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.
: 1. Cred Dist: Choice D is not plausible because, unlike the other choices, the stem does not include the original due date of the surveillance.
: 2. Stem Focus: Modify the choices to be clear, for example:
A. 14 days after 4/30/2021 B. 15 days after 4/30/2021 C. 106 days after 4/30/2021 D. 106 days after ????
: 3. Stem Focus: The word applicable in the 2nd bullet should be allowable.
: 4. Include original question that this question was modified from.
Comments incorporated; Question is SAT.
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other 6. 7.                                       8.
Q#  LOK  LOD (F/H) (1-5) Stem Cues T/F     Cred. Partial Job- Minutia #/ Back-   Q= SRO B/M/N U/E/S                                Explanation Focus              Dist.        Link          units ward K/A Only 98    F     2                                                                       N   S   T3 G2.3.9 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (SR 3.0.2),
using a contextual example (Leakage Detection Rad Monitor). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.
99   H     1                                                                       M   E/U T3 G2.4.5 2                                                                            S  1. B-GEN-PLMP-038, Emergency Notifications, was not provided in the reference material.
: 2. LOD=1: The 1st part of Choices A/B will not provide any discriminatory value because the title of the procedure refers to the licensee emergency organization.
: 3. Include original question that this question was modified from.
Question revised to include a fuel handling accident to enhance discriminatory value. Question is SAT.
100   H     2     x     x                 x                                       M   E   T3 G2.4.7 S  1. Cue: The EAL designators listed in the 2nd part of each choice are not needed to elicit the correct response.
: 2. Stem Focus: The 1st part of each choice (can be used vs can NOT be used) may be better as is allowed vs is NOT allowed.
: 3. Partial: The 2nd fill-in-the-blank statement should be worded as the highest required emergency classification is ____ .
: 4. Include original question that this question was modified from.
Comments incorporated; Question is SAT.}}

Latest revision as of 16:01, 3 February 2020

05200025/2016301 Initial NRC Exam - ADAMS 2C - Public Exam Administrative Items - Delay Release 2 Yrs
ML18032A266
Person / Time
Site: Vogtle  Southern Nuclear icon.png
Issue date: 02/01/2018
From:
NRC/RGN-II/DRS/OLB
To:
Southern Nuclear Operating Co
References
Download: ML18032A266 (83)
v • d • e


Text

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Vogtle Units 3&4 Date of Examination: 07/2016 Examination Level: RO Operating Test Number:

Administrative Topic (see Note)

[ Type Cod&

Describe activity to be performed Detetmine if you can replace a watch stander due to illness using NMP-AD-0 16 Conduct of Operations M, R and NMP-AD-01 6-003.

G2.1.5 2.9 Review heatup data that was logged using 3-RCS-OTS-005, to identify any errors and Conduct of Operations N, R determine if plant heatup rates have been violated.

G2.1.17 3.9 Perform SR 3.1.6.2 and 3.1.6.3 in N, R accordance with 3-GEN-OTS-17-002.

Equipment Control G2.2.$ 3.7 Determine total projected dose and determine if a CVS A makeup pump oil Radiation Control M, R addition can be performed without exceeding any radiological limits.

G2.3.4 3.5 NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs: 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Voqtle Units 3&4 Date of Examination: 07/2016 Examination Level: SRO Operating Test Number:

Administrative Topic (see Note) Type Describe activity to be performed Code*

Determine if you can replace a watch stander dcte to illness using NMP-AD-O1 6 Conduct of Operations M, R and NMP-AD-016-003. (Same as RO)

G2.1.5 3.9 Determine if current conditions allow Mode 4 entry based on a review of IDS battery Conduct of Operations N, R surveillances.

G2.1.21 4.4 Perform SR 3.1.6.2 and 3.1.6.3 in accordance with 3-GEN-OTS-17-002 Equipment Control N, R (Same as RO) and then evaluate Technical Specification requirements, as necessary.

G2.2.2$ 4.6 Determine total projected dose and determine if a CVS A makeup pump oil Radiation Control addition can be performed without M, R exceeding any radiological limits.

(Same as RO)

G2.3.4 3.6 Classify an emergency event and complete N, R the SNC Emergency Notification Form.

Emergency Plan G2.4.32 4.6 NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RD retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Vogtle Units 3&4 Date of Examination: 07/2016 Exam Level: RD SRO-l SRO-U Operating Test No.:

Control Room Systems:* 8 for RO; 7 for SRO-l; 2 or 3 for SRO-U System / JPM Title Type Code* Safety Function

a. Recover a dropped control rod.

Description:

The unit is at 70% power and rod H14 has fully dropped into the core. The candidate is directed to re-align rod H10 to its bank at 184 steps in accordance with 3-AOP-104 (Rod Control System Malfunction) Attachment 2 (Move Individual Rod N S or Group to Realign Rods).

Pre-JPM brief required.

SF1 DRCSA4.09 RO/SRO4.0

b. Perform ES-O.1 (Reactor Trip Response)

Description:

The unit has been manually tripped due to a failed open CMT outlet valve. The crew has performed E-0 and transitioned to ES-0.1. The candidate is directed to perform ES-0.1. When Step 6 is entered, the B spray valve fails partially A, L, N, S 2 open and the flowpath cannot be isolated requiring RCPs to be secured.

SF2 RCS A1.01 RO/SRO 4.1 SF2

c. In accordance with AOP-103 reduce RCS pressure

Description:

The unit has been shutdown due to a steam generator tube leak. The candidate is directed to lower RCS pressure in accordance with 3-AOP-1 03 (Steam Generator Tube A EN L M Leak) to less than 1 920 psig. RCPs are secured so Auxiliary , , , 3 spray must be used. Auxiliary spray alignment fails, therefore ADS Stage 1, Division A must be used to lower pressure.

SF3 ADS A4.04 RO/SRO 4.1

U. Respond to Condensate System Malfunctions in accordance with AOP-202

Description:

The Unit is at 59% reactor power with CDS Pump A degraded. The candidate is directed to perform 3-AOP-202 (Condensate System Malfunctions) due to the reduced discharge pressure on CDS Pump A. During performance, CDS Pump A A, N, S 4S will trip and CDS Pump C will have a sheared shaft, requiring the candidate to manually run back the unit. Once the run back is complete, CDS Pump B will trip, requiring a manual Reactor Trip.

SF4S CDS A4.04 RO/SRO 2.8

e. Respond to lowering CCS surge tank level in accordance with AOP-702

Description:

The Unit is at 80% reactor power with CCS surge tank level is lowering. The candidate is directed to perform 3-AOP-702 (Loss of Component Cooling Water) to address the lowering surge tank level. Manual surge tank makeup is A, N, S 8 unsuccessful therefore requiring the candidate to manually trip the reactor, manually secure CCS pump A, and manually secure RCPs.

SF8A317 AA1.01 RO/5R03.4 Respond to a loss of power in accordance with AOP-302

Description:

The Unit is shutdown with a plant cooldown in progress when a loss of plant power occurs. The candidate is directed to respond to the loss of power using 3-AOP-302 (Loss of AC Power). Standby Diesel B fails to start. SWS and CCS N S 6 loads fail to start on Standby Diesel A and must be manually started using Attachments in AOP-302. Additionally, IDS 24 hr battery chargers must be manually loaded.

SF6 ZOS A2.18 RO 3.0 SRO 3.4

g. Verify Containment Isolation in accordance with FR-Z.3

Description:

The unit was tripped due to a small RCS leak.

Entry into 3-FR-Z.3 (Response to High Containment Radiation) is required. The candidate is directed to perform 3-FR-Z.3.

During performance, VFS valve failures require the candidate to EN, L, D, S 9 restore a ventilation tlowpath for VAS by securing VFS-MA-O1A, closing the failed valves, and starting VFS-MA-02B.

FR-Z.3 EA1.03 RO/SRO 3.1

h. Establish Shutdown cooling with RNS Train A

Description:

Plant conditions have been established to align RNS Train A for shutdown cooling. The candidate is directed to establish shutdown cooling using RNS Train A in accordance with 3-RNS-SOP-O01.

L,D,S 4P Pre-JPM brief required.

(RO ONLY)

SF4P RNS A4.01 RO 3.6 In-Plant System& (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

Perform PCS-SOP-OO1, Attachment 7 (Filling PCCWST from FPS)

Description:

Locally aligns the FPS to the PCCWST. Manually starts the MDFP from the Main Fire Protection Panel. Secures N 5 filling the PCCWST (at the discretion of the examiner).

PCS A2.07 RO/SRO 2.8

j. Perform A0P402 (Malfunction of PMS)

Description:

The unit tripped from 100% due to a RCP heat exchanger leak to CCS. CCS Isolation failed from the MCR and AOP-402 has been performed up to local operator actions to E, N 7 operate 3 CCS containment isolation valves from the CIMs.

A-336 AA1 .03 ROISRO 2.7

k. Perform local valve operations to support cooling the IRWST with RNS

Description:

Locally manipulate necessary valves to align RNS 4P N R for IRWST cooling.

RNS G2.1.27 RO/SRO 4.4 All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO-l / SRO-U

(A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank 9/814 (E)mergency or abnormal in-plant 1 I 1 / 1 (EN)gineered safety feature 1 I 1 / 1 (control room system)

(L)ow-Power I Shutdown 1 /1 I 1 (N)ew or (M)odified from bank including 1 (A) 1 (P)revious 2 exams 3 I 3 I 2 (randomly selected) fR)CA 1 / 1 I 1 (S) im u lator

ES4OIN AP-1000 Examination Outline Form ES4OIN-2 Facility: Vcc le.. LLj 3 4/v. UbM&Ct3 Date of Exam: ewJer 20LS RO K/A Category Points SRO-Only_Points Tier Group KKKKKKAAAA C* A2 G Total 1 2 3 4 5 6 1 2 3 4 Total 1 1 18 3 6 Emergency &

2 4 Abnormal N/A NIA Evokitions Tier Totals 4- 5 5 5 4- 27 10 1 ZZ213333 28 3 2- 5 Plant 2 Il)jljl 0 10,øI2 3 Systems Tier Totals 3 3 4 3 3 4 4 4 4 3 38 S 3 8

3. Generic Knowledge and Abilities 1 2 3 1 2 3 4 10 Categories j 3 3 -

Note: 1. Ensure that at least two topics from every applicable K]A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each KIA category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category)

2. The point total for each group and tier in the proposed outline must match that specified in the table. The final 7t point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.

The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do fl. not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not induded on the outline should be added. Refer to Section D.1.b of ES-401N for guidance regarding the elimination of inappropriate K/A statements.
4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group 1iL before selecting a second topic for any system or evolution.
5. Absent a plant-specific priority, only those K/As having an importance rating (lR) of 2.5 or higher shall be IZ selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
7. The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must

$tft... be relevant to the applicable evolution or system. Refer to Section 0.1 .b of ES4OI N for the applicable K/As.

8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings 4zA_ (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Ue duplicate pages for RO and ORO-enly eisms- - - e/a
9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and 1S71- point totals (#) on Form ES4OI N-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.

G* Generic K/As ES4O1 N, Page 38 of 51

ES4OIN 2 Form ES4OIN-2 ES-4QlN.2 Emergency and Abnormal Plant Evolutions Tier 1/Group I E/APE#/Name/Safeyjj0 Krr< A A [ K/A Topic(s) IR #

E-0, Reactor Trip or Safeguards fi 1 21 Actuatjon/ 1,2,3,4 ES-0.1, Readormp Response / 1, 2, 3, () A2.0 I 4

ES-I .3, ADS Stage 1 3 Actuation Response 13

/ ES-1.4, ADS Stage 4 Actuation V Response /3 A-313, Uncontrolled Cooldown /4 1U Z5Ac 2.4.4 A-336, Malfunction of Protection and A 141.o7 Safety Monitoring System /7 5) AG Z.i I?

El,LossofCoolantAccjd ent,23 A (R) EAI.GS fs) EZ.%.t7

  1. 342, Reactor Coolant Pump Malfunction/1, 2, 34 I __L I A-337, Passive RHR Heat Exchanger ] I I(P.)AK3 .0!

Leak/4 I I A-343, Loss of Normal Residual Heat F R) AA2.o3 Removal/4 I A-317, Loss of Component Cooling Water I

/8 ES-02, Natural Circulation Cooldown / 4 CR) K. lJ FR-S.1, Responseto Nudearpower fP R Eif.0 Generation / 1 I E-3, Steam Generator Tube Rupture /3 1 CR) EK 2.05 E-2, Faulted Steam Generator Isolation /4 if SP E L Z. Z. 30 A-301, Rapid PowerReduchonhi if ) 41(3.04.

A-307, DAS Operations at Local Cabinets f?,)ftft4. Dl V

rII P. I

/7 FR-C.i, Response to Inadequate Core 9 I .5Eicz.g CS) EA2. 04.

Cooling /4 A-323, Loss of6.9 kV, 4160 V, or480 V R I P.) AA .04 Bus Power/6 j £ I (5)AA2.03 ES-li, PassiveSafety5jj j P. CP)Ez.4.3y Termination /3 I A-345, Loss of Nuclear Service Water /4 A-329, Loss of (nstwmenfur/8 I [

S (S)AAZp4.

ECA-I.I, Loss of Coolant Accident Outside Containment /3 s Ls) £cz.4.24 SDPl,ResponsetoLoSsofR CS jI JEKl.a2.

Inventory During Shutdown /2 I I SDP-2 Response to LOSS of RNS During J Jj Shutdown / 4 I K/A Category Totals:

13 I 11 Group Point Total: 18/6 51W 33 ES-401 N, Page 39 of 51

ES-401, REV 9 TIGI PWR EXAMINATION OUTLINE FORM ES-407-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO A-301AK3.04 Rapid Power Reduction 3 E D Placing Digital Rod Control System in Low Power Mode A-307AA1.Ol DAS Operation At Local Cabinets 3.40 Passive Core Cooling System A-31 3AG2.4.4f Uncontrolled Cooldown 4.54.7 Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.

A-323AA2.04 Loss of 6.9KV, 4160 Volt, or 480 Battery, battery charger, and battery bus status and/or Volt Bus Power voltage A-336AK1 .07 Malfunction of Protection and 2.7 Main and Startup Feedwater System Safety Monitoring System A-337AK3.0l Passive Residual Heat Removal 3.3 Determining whether core makeup tank discharge Heat Exchanger Leak isolation valves are open A-342AK2.02 Reactor Coolant Pump Malfunctions 3.1 Reactor coolant pump trip in mode 3, 4, or 5 A-343AA2.03 Loss of Normal Residual Heat Component Cooling Water System to Normal Residual Removal Heat Removal System heat exchanger flow E-l EA1 .05 Loss of Reactor or Secondary 3.8 Diverse Actuation System Coolant E-2EG2.2.30J Faulted Steam Generator Isolation 4.2 4.4 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.

E-3EK2.05 Steam Generator Tube Rupture 3.5 Allowing Reactor Coolant System pressure to rise above 1970 psig after safeguards are blocked below P-ll, Pressurizer Pressure Below 1970 psig Page 1 of 2 02/04/2015 2:23PM

ES-401, REV 9 TIGI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO ES-0.1EA2.0l Reactor Trip Response 3.4 3.7 Neutron flux ES-0.2EK3. 18 Natural Circulation Cooldown 3.1 DEI Terminating the Reactor Coolant System depressurization to minimum allowable ES-i .1 EG2.4.39tPassive Safety System Termination 4.24 DDE DEEDED Ei Ability to verify system alarm setpoints and operate controls identified in the Alarm Response Procedure.

FRC.1EK2.i1 RespoJo1oadequate-Cere 3.3 eDoffng

-z.oI IZNc e FR-S.1 EK1 .05 Response to Nuclear Power 3.9 D D D D D D D D E D Engineered Safeguards Actuation System Generation ATWS SDP-l EK1 .02 Response to Loss of RCS 3.4 DDDDDDDDDD Containment System Inventory During Shutdown SDP-2EA1 .03 Response to Loss of Normal 3.1 DDDDDDEDD Chemical and Volume Control System tOE related)

Residual Heat Removal System During Shutdown Page 2 of 2 02/04/2015 2:23 PM

ES-401, REV 9 SRO TIGI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO A-323AA2.03 Lossof6.9KV,4l6OVolt,or480 2.4 3.4 Standby diesel generator load Volt Bus Power A329AA2.O4 Loss of Instrument Air 3.23.2 Reactor Coolant System temperature, steam generator level, and/or steam generator pressure (OE related)

A-336AG2.2.191 Malfunction of Protection and Safety 0 4.2 Knowledge of the bases in Technical Specifications for Monitoring System ED D D limiting conditions for operations and safety limits.

E-l EG2.l .7 Loss of Reactor or Seconda 4.4 4.7 EDDDDDDDDD Ability to evaluate plant performance and make Coolant operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.

FR-C.l EA2.04 Response to Inadequate Core 3.7 3.5 EDDDDDDLDD Pressurizer level and/or Reactor Coolant System hot leg Cooling level FR-H.lEG2.4., ResponsetoLossofHeatSink 4.2 4.1 D D D D D D D DD Knowledge of annunciator alarms, indications, or response procedures.

Page 1 of 1 02/04/2015 2:23 PM

ES4OIN 3 Form ES-401N-2 ES4OIN AP-l000 Examination Outline Form ES4O1N-2 Emergency and Abnormal Plant Evolutions Tier IlGroup 2 E!APE #1 Name! Safety Function G K/A Topic(s) lR #

A-31 1, Rod Control System Malfunction / 1 A-308, Loss of Control Room AC! B A-320, Loss of Circulating Water/8 P (P%)AK.3ç A-302, Emergency Boration / I A-327, Startup Feedwater System Malfunction /4 A-328, Malfunction of Feedwater Heaters and Extraction Steam / 4 FR-LI Response to High Pressurizer Level /2 A-314, Fuel Handling lnUdent! 6 ) AK3. 02.

A-304, Steam GeneratorTube Leak!3 S (5) 2.. l.J!7 A-333, Main Turbine Malfunction / 4 FR-Z.I Response to High Containment Pressure /

5 SDP4, Response to Rising Nudear Flux During CR) E.A2. .P4 Shutdown/I S (5) AZ. DI SDP-5, Response to RCS Cold Overpressure During Shutdown / 3 SDP-6 Response to Unexpected RCS C P.) E KZ.04 Temperature Changes During Shutdown /4 A-306, Evacuation of Control Room! 8 P. (R) Ac2.4.4 A-318, Condensate System Malfunctions! 4 P. CR) AAt. 09 FR-C-2, Response to Degraded Core Cooling /4 FR-C.3, Response to Saturated Core Cooling /4 1k (1k) 1< I .o FR-H.2, Response to Steam Generator Overpressure /4 FR-Z.2, Response to Containment Flooding! 5 FR-Z.3, Response to High Containment Radiation /

9

/ FR-Z.4, Response to Low Containment Pressure! CR) E I2 .01 5

A-332,TurbineTnpwithoutReactorTnp/4  ? (5)AZ.q ES-i .2, Post LOCA Cooldown and Depressurization /4 A-321, Loss of Data Display and Processing System / 7 FR-P.l Response to Imminent Pressurized Thermal Shock Condition /3 A-340, Reactor Coolant Leak / 2 U FR-1.2, Response to Low Pressurized Level /2 U FR-I .3, Response to Voids in Reactor Vessel /2 = L 5) EAZ. 02.

ES401 N, Page 40 of 51

ES4OIN 4 Form ES4OIN-2 ES4OIN AP-l000 Examination Outline Form ES4O1N-2 Emergency and Abnormal Plant Evolutions Tier llGroup 2 (RO I SRO)

/

EIAPE#/Name/SafetyFunction A-326, Eeedwater System Malfunctions / 4 KI A G*

[ KIATopic(s) IR #

V A-331 Loss of plant DC Power or Batteries /6 R CR) AA I. O.

/ A-348, Degraded Grid /6 Group Point Total: 9/4 KIA Category Totals:

2.

22.

ES4O1N, Page 41 of 51

ES-401, REV 9 TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO A-306AG2.4.4J Evacuation of Control Room 4.5 4.7 Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.

A-314AK3.02 Fuel Handling Incidents Maintaining pressurizer/reactor cavity level and/or spent fuel pool level A-31 8AA1 .09 Condensate System Malfunctions 2.5 Steam Generator Blowdown System controls A-320AK3.07 Loss of Circulating Water 3.3 Reducing turbine load A-331AA1.02 Loss of DC Power or AC 2.90 12OVAC Distribution Panels 1E Instrument Power FR-C.3EK1 .08 Response to Saturated Core 3.1 Reactor Coolant System Cooling FR-Z.4EK2.01 Low Containment Pressure 3.1 0 Containment integrity

[] fl SDP-4EA2.04 Response to Rising Nuclear Flux 3.6 3.7 Reactor Coolant System boration flow During Shutdown SDP-6EK2.04 Response to Unexpected RCS 3.3 Component Cooling System failure Temperature Changes During Shutdown Page 1 of 1 02/04/2015 2:23 PM

ES-401, REV 9 SRO TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO A-304AG2. 1.17 Steam Generator Tube Leak 3.9 3.8 Ability to use available indications to evaluate system or component status.

A-332AG2.l .7 Turbine Trip Without Reactor Trip 4.4 4.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.

FR-l.3EA2.02 Response to Voids in Reactor 2.9 3.3 Reactor Coolant System temperature and pressure Vessel SDP-4EA2.Ol Response to Rising Nuclear Flux 3.6 3.9 Reactor Coolant System boron and/or shutdown margin During Shutdown (OE related)

Page 1 of 1 02/06/2015 8:10AM

ES4OIN 5 Form ES4OIN-2 ES4OI N AP-1 aDO Examination Ou e Form ES-401 N-2 Plant Systems Tier 2/Group 1 0 SRO KKKKKKAAAA G*

System Name / Safety Function K/A Topic(s) lR #

1 2 3 4 5 6 1 2 3 4 (p.) AZ .3)

Reactor Coolant/2, 4 Steam Genet0tI4 -

CR) 1(3.01.

Normal Residual Heat RemovaV4 Passive Residual Heat Removall4 PassiveCoreCooling/2 W fs)Az.I(.

Component Cooling Water! 8 Pressurizer Pressure Control / 3 R)A3 .0, Automatic Depressunzation / 3 W tR) G. 2. I. 2 I Reactor Trip System /7 R)

Engineered Safeguards Actuation tPJ A3.13

/2 R)AZ.02.

DiverseActuaüon/7 Passive Containment Coong / 5 CR) P4.o I MainSteam/4 CRH4I.04 Main and Startup Feedwater/4 ACElecthcalDistribution/6

$ R (R A3.03 1.5) A2.OZ ClasslEandNoniEDCand (R)gL,.02 UPS/6 Onsite Standby Power System /6 g, (P.) .i .02. Cs) kZ .

Service Water/4 - - - i P.) 1(4.0(0 Csy 2.4.q.

Compressed Air/B F) )<4.O Containment System /

Reactor Coolant Pump/4 CII.) 1(5.02 Chemical and Volume Control/i, F.. (R) K2 .04 2

K/A Category Point Totals: 3 . 7_ 3 3 3 Group Point Total: 28/5 SRO 2.

ES401 N, Page 42 of 51

ES-401, REV 9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO ADSG2.1.2l/ Automatic Depressurization 4.3 4.4 EEEEDEEEEE Ability to perform general and/or normal operating System procedures during any plant condition.

CASA1 .03 Compressed Air System 2.9 Instrument air supply pressure CASK3.17 Compressed Air System 3.1 Passive Core Cooling System (OE-related)

CCSG2.4.4 I Component Cooling Water System 4.5 4.7 DEED EEE Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for Emergency/Abnormal Operating Procedures.

CNSK4.07 Containment System 3.3 Containment evacuation CVSK2.04 Chemical and Volume Control 3.7 EEEEtEEEE Containment isolation valves System DASA2.02 Diverse Actuation System 3.33.5 EEEEEJJEEE Reactor and turbine trip ECSAT AC Electrical Distribution Systems 3.6 EEEiiEEEEE 17I -o$IOl oC Tit( A 34A4 03 ESASA3. 13 Engineered Safeguards Actuation 4.3 EEEEEEEEE Passive Residual Heat Removal Heat Exchanger System Actuation ESASK6. 13 Engineered Safeguards Actuation 4.1 Passive Containment Cooling System Actuation System FWSA2.33 Main and Startup Feedwater 2.6 3.1 EEEEEEEEE Startup feedwater pump low and high flow System Page 1 of 3 02/04/2015 2:23 PM

ES-401, REV 9 T2GJ PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RD SRO FWSA4.06 Main and Startup Feedwater D E Startup feedwater control valve System IDSK6.02 Class JE and Non 1E DC and Class 1 E battery charger failure UPS Systems MSSK1 .04 Main Steam System 3.2 Engineered Safeguards Actuation System PCSA4.01 Passive Containment Cooling 4.3 Passive Containment Cooling System Actuation System PPCSA3.01 Pressurizer Pressure Control 3.6 Pressurizer normal spray valve operation System PRHRA1 .01 Passive Residual Heat Removal 3.2 EIDEEJE E E Passive Residual Heat Removal System heat exchanger System pressure PXSA4.16 Passive Core Cooling System 4.4 Reactor Trip Actuation PXSG2.4.271 Passive Core Cooling System 3.84 Knowledge of Non-Licensed operator tasks during an -

EDEDEEJE emergency and the resultant operational effects.

RCPK5.02 Reactor Coolant Pump System 2.7 DEEDED Changing reactor coolant pump speed on pressurizer normal spray flow RCSA2.31 Reactor Coolant System 3.6 3.7 EDDIE Reactor vessel flange leakage RNSK3.01 Normal Resklual Heat Removal 2.8 EEEE DEEDED Chemical and Volume Control System System Page 2 of 3 02/04/2015 2:23PM

r ES-401, REV 9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO RTSK3.06 Reactor Trip System 3.5 E Passive Core Cooling System RTSK5.03 Reactor Trip System 4.3 Anticipated transient without scram coincident with turbine trip failure SGSA1 .05 Steam Generator System 3.4 Reactor Coolant System temperature SGSK2.04 Steam Generator System 2.8 MSIV hydraulic pump SWSK4.06 Service Water System 2.7 fl Service Water System tower makeup ZOSK1.02 Onsite Standby Power System 3.1 Main AC Power System Page 3 of 3 02/04/2015 2:23 PM

ES-401, REV 9 SRO T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO ECSA2.02 AC Electrical Distribution Systems 3.7 4.1 Loss of offsite power PXSA2.16 Passive Core Cooling System 3.8 4.3 DDE DEED Core makeup tank discharge isolation valve SGSG2.4.39 Steam Generator System 4.24 DEE EIDDD Ability to verify system alarm setpoints and operate controls identified in the Alarm Response Procedure.

SWSG2.4.14j Service Water System 3.4 4.1 DEIE EDEID Knowledge of Emergency/Abnormal Operating Procedures layout, symbols, and icons.

ZOSA2.Ol Onsite Standby Power System 2.8 - 2.9 Standby Diesel and Auxiliary Boiler Fuel Oil System E D D DEED Page 1 of 1 02/04/2015 2:23 PM

ES4OIN 6 Form ES4OIN-2 AP-l000 Examination Ou e Form ES401 N-2 ES-401 N Iant Systems -Tier2lGroup2 RO SRO =

. KKKKKKAAAAG*

K/A Topic(s) IR #

System Name / Safety Function 1 2 3 4 2 3 4 5 6 CR) AZ .l () 2.4-. 3 Digital Rod Control/I Pressurizer Level Control / 2

() AZ .

Rod Position Indication/I P. LR) 142.03 Incore Instrument System 17 Containment Air Filtration /8 Containment Hydrogen Control I 5

CR) K3 .01 Main Control Room HVAC /8 Spent Fuel Pool Cooling /8 Condensate /4 P. ( i) A3 .0 I

.G,.og CondenserAirRemoval/4 Main Turbine and Main Turbine g CR) 14 I. Og Control/4 Fuel Handling /8 (P.) Al . 02.

Gaseous Radwaste /9 Radiation Monitoring /7 Circulating Water/8 ) 144.0I -

Fire Protection /8 (P.) IC.o3 Steam Dump Control System/4 Nudear Instrumentation System / C . oz C ) AZ. 09 Liquid Radwaste System I9 K/A Category Point Totals:

IL!I I Group Point Total:

[

SRt :2.

ES-401 N, Page 43 of 51

ES-401, REV 9 T2G2PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO CDSA3.Ol Condensate System 2.7 DEDDDDEEDD Condensate pump start CMSK6.08 Condenser Air Removal System 2.6 Condenser vacuum breakers CWSK4.01 Circulating Water System 3.1 DDE DDD DEED C-9, Condenser Available DRCSA2.19 Digital Rod Control System 3 3.8 EDDDDDDDDD Group demand position indication failure MTSK1.08 Main Turbine and Main Turbine 2.6 ED DEEDED ED Main Steam System Control Systems NISA4.02 Nuclear Instrumentation System 3.7 DDDDDDDDDD Block Intermediate Range Neutron Flux High Reactor Trip RPISK2.03 Rod Position Indication System 2.8 ---j DEEDED DDE Digital rod position indication coils SDCSK5.03 Steam Dump Control System 3.5 D D E D D D D D Changing steam flow effect on reactor power VESK3.Ol Main Control Room HVAC 3.6 DDDDDDDDDD Control room habitability WGSA1 .02 Gaseous Radwaste System 2.5 DDDDDDDEDD Carbon bed and/or vault temperatures Page 1 of 1 02/04/2015 2:23 PM

ES-401, REV 9 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 NAME I SAFETY FUNCTION tR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO DRCSG2.4.36 Digital Rod Control System 4.1 43 Ability to prioritize and interpret the significance of each annunciator or alarm.

NISA2.09 Nuclear Instrumentation System 3.5 3.6 Power Range nuclear Instrumentation detector failure (OE-related)

PLCSA2.08 Pressurizer Level Control System 3.8 Loss of coolant accident Page 1 of 1 02/06/2015 8:10AM

ES4OIN Generic Knowledge and Abilities Outline (Tier 3) Form ES4OIN-3 Facility: Vogte- Aiwf 3s4 /Vc- 5e44e1 jc3 Date of Exam: Nov. .ZOLS

. RO_____ SRO-Only Category KIA# Topic IR # IR #

2.1. LOC4Ah-CIe..) ..

  • d csbie- tofre&+ tinecp 44 2.1. Vrt,2. R&4ç 37 Condu of 2.1. 2. .turtk 1k M4k, qLLTf... 4.2.

Operations Lvcak enik- .Q crtv% 4.D Subtotal 2-.

2.2. 5 Tc kou1i di\)Me 2.2. 3 (61viS 2.2.30 i1Crp Cta- 4.2.

2.

Equipment 2.2.

Control 2.2. 2.. peL c.odwfs t.U. SD t Pwr 4.

2.2.% > Ikr T& .e4I:6vls 4*ç Subtotal 3 2.3. &vik t4 1e44.. 3.g 2.3. (nd3, F4LL I A, t_IJ1 fr-. 3.2 Radiation Control 2.3. Q.ft,. M Ut 3. 1 Subtotal I 2.4. it9vtj/M?vWM iitnc, Mbvt1 noes .g 2.4. pri-)iw /kA (mtvtc 4

Emergency 2.4. 3$

2.4.

/I2e.ji utw reS ri4L .2 Procedures I Plan 2.4.5 i4arwi, Akiwrwi4 jgrj VnCc fr1.wtwW.

2.4. iAD L4M3J4 D?5 Subtotal 3 2-Tier 3 Point Total 10 7 ES-401N, Page44 of 51

C ES-401, REV 9 13 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO G2.l.18 Conductofoperations 4.6 4.3 D D D D D D E E D D Ability to locate control room switches, controls, and indications, and to determine that they correctly reflect the desired plant lineup.

G2.l .33 Conduct of operations 3.73.8 DDDDDDEDDE Knowledge of the stations requirements for verbal communications when implementing procedures.

G2.2.15 Equipment Control 2.6 3.8 Knowledge of the process for managing troubleshooting activities.

G2.2.23 Equipment Control 3.6 4.5 Knowledge of conditions and limitations in the facility license.

G2.2.30 Equipment Control 4.2 4.4 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.

G2.3.5 Radiation Control 3.8 4.3 Ability to control radiation releases.

G2.3.6 Radiation Control 3.2 3.7 Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, or aligning filters.

G2.4.15 Emergency Procedures/Plans 3.8 4.3 Knowledge of the operational implications of Emergency/Abnormal Operating Procedures warnings, cautions, and notes.

G2.4.l 7 Emergency Procedures/Plans 3.6 4.4 DDE ED Knowledge of the bases for prioritizing safety functions during abnormal/emergency operations.

G2.4.38 Emergency Procedures/Plans 4.2 4.2 DEEDED DDDD Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material Page 1 of 1 02/04/2015 2:23 PM

ES-401, REV 9 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO G.2.3.9 Radiation Control 2.9 3.1 DDEDDDDEEE Knowledge of radiation monitoring systems, such as fixed radiation monitors and alarms, or personnel monitoring equipment.

G2.1 .22 Conduct of operations 3.9 4.2 Ability to interpret reference materials, such as graphs, curves, tables.

G2.1 .27 Conduct of operations Ability to locate and operate components, including local controls.

G2.2.2 Equipment Control 4.6 4.1 Ability to manipulate the console controls as required to operate the facility between shutdown and designated power levels.

G2.2.26 Equipment Control 4.7 Ability to determine and/or interpret Technical Specifications with action statements of greater than one hour.

G2.4.5 Emergency Procedures/Plans 3.7 4.3 DDE DDDEEE Knowledge of the organization of the operating procedures network for normal, abnormal, and emergency evolutions.

G2.4.7 Emergency Procedures/Plans 8 4.5 DEDDE Knowledge of how Abnormal Operating Procedures are used in conjunction with Emergency Operating Procedures.

Page 1 of 1 02/04/2015 2:23PM

ES-401N Record of Rejected K/As Form ES-401N-4 Tier/Group Randomly Selected KA Reason for Rejection Overlaps with ZOS KI.02 and A323 AA2.03. Randomly selected T / GI ECS A3 03 ECSA3.0l.4/6/2015 Changed K/A, to correctly match the original intent of FR-C. I TI / GI fR-C.l EK2.I I EK2.l I, due to procedural changes and subsequent K/A catalog additions. Selected ES-I.4 EK2.0I. 9/18/2015

ES-401N Written Examination Quality Checklist Form ES-4O1N6 Facitty, \J j_ Date of Exam Exam LeveL HO SRO InitiSt tern Description a

1 Questions and answers are technically accurate and applicable to the facility 2 a NRC (lAs are referenced for all questions b Facitity earning oectives are retereirced as availabte 3 SRO questions are appropriate in accordance mth Section 02 cI of ES-401 4 Tire sampllng process was random and systematic (If more than tour HO or two SRO questions were repeated from the last two NRC licensing exams, consult the NRRINRO OL program office) 5 Question duplication from the licensee screeninglsudit exam was controlled as indicated hetow Icheck the item that applies) and appears appropriate The audit exam vms systematically and randomty developed, or the audit exam vms completed before the license exam was started, or the examinations were developed independently: or the licensee certifies that there is no ctuplir;etion, or 1.) if other (explainl 6 Bank use meets limits (no more than 75 percent trom the bank, at least 10 percent new, and the rest newer Bank I Modified New ,J Ii IPt N1 IA

/tt /

modified), enter tfie actual HO I SRO-only question distribution(s) at right ,3/

j 13 / 3 57/ q p 7 Between 50 and 60 percent of the questions on the HO exarrr are written at the comprehension) analysis level, the Memory CIA P

/

/ ,,j

/ ,i/

SRO exam may exceed 60 percent if the randomly selected K/As support tIre higher cognitive levels; enter

ç7 3 / O 43 / 15 Z the actual RO I SRO question distribution(s) at right. pt

8. References/handouts provided do not give away answers or aid in ttre elimination of distractors
9. Question content conforms to specific KA statements in the previously approved examination -

outline and is appropriate for the tier to which they are assigned, deviations are justified

10. Question psychometric quality and format meet the guidelines in ES Appendix B. j 11 The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet Printed Name / Signatur

/ flute

a. Author .
5. Facility Reeiewer C) 11}WC.1 IJMZ I Note The facility reviewers initials or signature are not applicable for NRC-developed examinations
  1. Independent NRC reviewer initials items in Initial column c, chief exaniirier concurrence required.

ES-401N, Page 47 of 51

ES-401N Written Examination Review Worksheet Form ES-401N-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Gen 1. Received first 25 questions from the licensee on 6-10-15.

Provided feedback to licensee on 6-22-15.

Gen 2. We need electronic copies of the reference material listed in ES-201. The web-link you provided doesnt include all the items listed in ES-201.

Gen 3. For modified bank questions, please provide copy of the original (unmodified) bank question with the supporting information.

Gen 4. Provide the administrative procedure that describes the expectations/requirements for entering AOPs; AOPs list symptoms/entry conditions.

5. Received 2nd batch of questions (Q#26 - 75) from the licensee on 9-2-15. Provided feedback on Q#s 26-42 to licensee on 9-18-15.
6. Provided feedback on Q#s 1-75 to licensee on 10-23-15. Items in yellow are either 1) previously approved test items were additional flaws were identified during the review of subsequent test items or 2) previously unresolved items.

Instructions

[Refer to Section D of ES-401N and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1(easy) - 5 (difficult); (questions with a difficulty of 2 - 4 are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information)
  • Cues: The stems or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).
  • T/F: The answer choices are a collection of unrelated true/false statements.
  • Cred. Dist: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • Partial: One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • Minutia: The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • # / Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • Backward: The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable)
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401N Section D.2.f.
7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401N 2 Form ES-401N-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F 2 x x N U T1G1: ES-0.1, EA2.01

1. Q=K/A: This K/A may not be applicable to Vogtle 3 & 4 because the evaluation of neutron flux following a reactor trip is performed S

in E-0, Step 2.b, not in ES-0.1 Step 29. ES-0.1 doesnt include any evaluation of neutron flux. As currently presented, the 2nd part of the question doesnt test beyond Tier 2 knowledge of when SR detectors auto-energize. incorporated

2. Stem Focus: The 1st fill-in-the-blank statement uses the word considered, which is not well defined. deleted
3. Stem Focus: The first bullet says the reactor was manually tripped spuriously? This isnt operationally valid. Accepted as-is after discussion.
4. Cred Dist: The only justification for the 1st part of Choices C/D (lowering at (-) 1/3 dpm) was that this was a commercially accepted method for verifying the reactor was not critical. Is there a Vogtle 3 & 4 procedure that uses this criterion? FR-S.1 uses rod bottom lights; perhaps this is a better distracter.

incorporated

5. 9-18-15: Resolved all comments; Put power above P-6, but less than P-10, and asked if ES-0.1 requires energizing. SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 2 x x x M E/U T1G1: A-313, G2.4.4

1. Please provide governing procedure that describes the philosophy of when an AOP is required to be entered; AOP S

entry seems subjective. For example, Hotwell Level Lowering is also listed as a symptom/entry condition in the AOP; however, the crew wouldnt necessarily always be required to enter the AOP for this condition. Revised to test entry conditions.

2. Cue/ Cred Dist: The phrase unexpectedly rises in the 4th bullet is a cue that AOP entry is required; anytime something unexpected occurs, AOP entry is normally justified.

Consequently, the 1st part of Choices B/D (AOP entry isnt required) is not plausible. The stem needs to provide information for the applicants to identify (e.g, steam dump valve position, etc.) that the cool down was unexpected. Verbiage deleted.

Removing the words unexpectedly rises makes Choice D a correct answer; therefore, the question is somewhat subjective.

Q modified to ensure only one answer.

3. Operational Validity: Cool down rates are always evaluated in any ONE HOUR; rates provided in the stem are instantaneous only. The distracter analysis for GOP limits doesnt match the GOP; GOP limits are 50F in any 60 minute period (not 50F/hr).

Incorporated.

4. Stem Focus: The stem needs to place the event into more context, for example, 1st bullet says that GOP-205 is in progress; 3-MSS-SOP-001, Attachment 5, Section 4.3, Establish Plant Cool down in Steam Pressure Mode, is also in progress, and may add plausibility to NOT entering the AOP.

Also, 3-RCS-OTS-XX-005, RCS Heat up and Cool down Surveillance Testing, is in progress, and may add plausibility to NOT entering the AOP. Stem conditions modified.

5. Provide copy of Modified Bank Question. Not yet provided, but Q modified during review process.
6. 9-18-15: Fixed question to show an erroneous steam dump valve position. All comments resolved. SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 3 F 2 x x N E/U T1G1: A-336 AK1.07

1. Q=K/A: The test items link between Main and Startup FW and AOP-402 is weak since PMS Malfunction mitigative strategy S

applies to ALL PMS malfunctions; the K/A requires testing the applicants knowledge of how a PMS malfunction is identified for Main & Startup FW, including how to remedy. The proposed test item is missing the malfunction identification piece as it relates to Main & Startup FW.

Suggest writing a question that includes a screen shot of the PMS screen, so that the applicant has to identify that Startup FW isolation did/did not occur to better hit the K/A. Revised Q.

KA is met.

2. Cred Dist: The plausibility of Choice B (locally positioning SGS-V067A is the first option) is questionable because the fill-in-the-blank statement says will first be closed; local manipulation is never the first option. Q revised.
3. This question may overlap the same knowledge as Q#10.

Question is sat as of 10/28/2015.

4 H 2 x N E/U T1G1: E-1 EA1.05

1. Cred Dist: To make the 1st part of Choices A/B (1st stage valve S positions are correct at 1001) plausible, re-work the fill-in-the blank statements and stem question as follows:

WOOTF completes both statements?

At 1001, both ADS First Stage valve positions _______ as expected.

With the above conditions, enabling the DAS Control Panel and manually actuating ADS Stage 1 from DAS _________ send an open signal to RCS-V001B Incorporated.

2. Please provide DAS logic that supports second half of question.

Done.

3. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 5 H 2 x x N U T1G1: A-342 AK2.02 S 1. Cred Dist: Choice A (raise 1C and 1D speed to 88%) is not plausible because raising speed is never required in Mode 3.

OK based on GOP-303.

2. Cred Dist: Choice B (immediately restart tripped pumps) is not plausible because the reason for the spurious trip is unknown; conservative decision making eliminates this Choice.

Additionally, the status of the following parameters are not provided in the stem to make Choice B plausible:

CCS availability, Surge Tank level Bearing temps Stator temps Vibrations prior to trip Incorporated.

3. #/units: The UNID and label names of the safety related breakers and non-safety related breakers is missing from Choices C/D. For example, the non-safety related breakers are the VFD Switchgear Breakers.

Q revised.

4. 9-18-15: Kept safety/non-safety, but eliminated redundant information. SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 6 H 3 x x B E/U T1G1: A-337 AK3.01 Note to NRC Reviewers: The reason for determining CMT valves status is that CVS makeup flow cannot be reduced if CMT valves are S

open; thus the K/A portion related to the reason is indirectly being met.

1. Cred Dist: The 1st part of Choices A/B (return makeup to normal) is not plausible because Pzr Level is too low. Suggest modifying Pzr level value in the stem to remedy. Q revised.
2. Stem Focus: The stem is missing power level and/or unit status. Power added.
3. Stem Focus: Suggest swapping the order of the fill-in-the-blank statements so that the first fill-in-the-blank statement is related to Identified vs Pressure Boundary Leakage. Incorporated.
4. Need to verify that AOP-109 preceding steps have CVS makeup flow already aligned to max rate; otherwise re-word the 1st fill-in-the-blank statement as CVS makeup flow _________ (is / is NOT) required to be returned to normal. Reviewed - OK.
5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 7 H 1 x x N U T1G1: A-343 AA2.03

1. Job-Link: The procedure for Mode 5 isnt AOP-115; its 3-EOP-SDP-2, Response to Loss of RNS During Shutdown. Is the S

crew allowed to be in AOP-115 in Mode 5?

2. Cue and/or LOD=1: The test item does not test the applicants ability to evaluate CCS flow. Instead, the stem tells the applicant that RNS Hx A Flow (CCS-FT-301) is zero, which cues the applicant to CCS-V301A is required to be opened. As written, this is LOD=1 because a pump tripped, and, in order to re-establish cooling, another pump should be started and cooling water aligned to the heat exchanger.
3. Cred Dist: The 1st part of Choices C/D (crew NOT required to start RNS Pump A) is not plausible because there is no auto-start feature on decay heat removal, since this adds positive reactivity.
4. Cred Dist: Choice C is not plausible because of the interplay between the 1st and 2nd parts of this choice. IF the plausibility of the 1st part is that the pump auto-started, THEN V301A would either auto-align or already be aligned open.
5. Partial: The stem does not include the status of the cavity; flooded cavity does not have any requirements for re-establishing cooling.

Suggest incorporating the following element to hit the K/A:

In accordance with Step 13 (Align CCS for RNS Cooling), the operator is required to Check RNS HX CCS Flow (CCS-FT-301/302) greater than _______. (2800 gpm)

6. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 8 F 2 x x x x N E T1G1: ES-0.2 EK3.18 S 1. Partial: Because RCS Void Growth is a concern in ES-0.2, re-word the 1st fill-in-the-blank statement to ensure Choice C is incorrect:

In accordance with3-EOP-ES-0.2-B, Background Information for 3-EOP-ES-0.2, the reason RCS pressure is required to be maintained at its present value at Step 44 is to ______.

Q modified.

2. Stem Focus: the last portions of each Choice are not necessary. For example:

A. allow placing RNS in service for shutdown cooling B. prevent RCS void formation and subsequent CMT injection Q modified.

3. Stem Focus: The 2nd bullet is confusing and not an operationally valid way of presenting the information; suggest providing hottest un-isolated CMT temperature.

Q modified.

4. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 2 x N E T1G1: FR-S.1 EK1.05 S 1. Cred Dist: Choice D (RCPs not running; V108A closed) is not plausible because IF RCPs are off (due to CMT actuation),

THEN the PRHR Hx is always open. Q revised.

2. Stem Focus: Add Reactor Power is 100% to the stem initial conditions. Incorporated.

Alternate Suggestion (just one option): One of the relationships between FR-S.1 and the Safeguards System is this: At Step 8 of FR-S.1, IF Safeguards has actuated, the crew is required to EXIT FR-S.1 because all of the necessary boration (CMT) and auto-isolations (FW, Dilution Paths,Cnmt Air Filtration) are already sufficient to mitigate the ATWS; no other FR-S.1 actions are necessary. Therefore, if Lo Tcold (Safeguards Actuation) value was provided in the stem, then the applicant could decide whether to continue in FR-S.1 or to exit FR-S.1.

3. 9-18-15: Replaced 2nd fill-in-the-blank statement. Reworked to ensure not SRO-only. SAT Question is sat as of 9/18/2015.

10 H 3 N  ? T1G1: E-3 EK2.05 S 1. Why does the 2nd fill-in-the-blank statement list time at 10:25?

Whats the significance of five minutes after the Safeguards Signal? Ensures out of gray area for valve stroking.

2. It is operationally valid that RCS pressure rises to 1982 psig during max cooldown evolution IF small tube leak with auxiliary spray failure. Yes.
3. 9-18-15: This question may overlap with RO Q#3.

Overlap evaluated as OK.

Question is sat as of 11/05/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 11 H 2 x x x N E T1G1: E-2 G2.2.30

1. Partial and/or Cred Dist: The stem doesnt specify the size of the steam leak (steam flow values, etc.); does swell occur S

when a large MSL break occurs? If so, then Choice C is also correct. Not at 1001:00 - OK.

2. Partial: Choice B is also correct because the wording of E-2, Step 7 is trending to 58.5%...go to E-1. Review this procedure step basis again. (Procedure may need revision to use the word controlled.) Q modified.
3. Partial: The time 10:01 is not the same as initially. The times provided to the applicants in the stem need to also include the seconds values to ensure no one interprets this question to mean one second later. By providing the seconds values, we ensure that the applicants understand sixty seconds has elapsed. The word initially should be eliminated. Seconds added.
4. Stem Focus: Provide normal secondary radiation values in the stem. Q modified.
5. 9-18-15: Reworded to test how MSIV Bypass failure affected subsequent plant operations; SAT Question is sat as of 9/18/2015.

12 H 2 x B U T1G1: A-301 AK3.04 S 1. Q=K/A: The 2nd part of the question is the part that targets the K/A; however, because of the 2nd fill-in-the-blank wording, the only thing being tested is that Xenon is building in, which requires positive reactivity insertion. This is the plant specific portion of the written exam; therefore, some plant specific information to hit the K/A must be tested.

Suggest changing the 2nd fill-in-the-blank statement to test the reason for why Rod Control is placed in the Low Power Mode, for example:

The reason why rods are placed in the Low Power Control Mode is / is NOT to maintain power constant. Second half replaced.

2. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 13 H 2 x x N U T1G1: A-307 AA1.01 S 1. Partial: IF the CETs are lowering, THEN there may be no correct answer. CETs lowering means that some form of cooling is established. Why would you continue to blow squib valves if CETs are lowering? Why go to the RNO?

Another way to think about this is IF the local DAS switch attempt was NOT successful (and CETs were still lowering) wouldnt the operator STILL be required to use the blasting device cables/crank handle method of actuating IRWST since the normal method of firing the squib valves failed?

It looks like the intent of RNO Step 9.f is to use an alternate method to blow the squib valves. The previous method of using the local DAS switches means that the squib valves must be blown. IF you get to RNO Step 9.f, arent the squib valves still required to be blown when the CETs are lowering?

Second half replaced.

2. Cred Dist: The 1st part of Choices B/D (IRWST actuation NOT required) is not plausible because the wording of AOP-602, Step 9 is provided in the stem. Q modified.
3. 9-18-15: Changed question to test whether IRWST/Stage 4 actuations is/is not required; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 14 F 2 x x x N U T1G1: FR-C.1 EK2.11 S 1. Job-Link and/or Q=K/A: There may be an issue with the K/A Catalog for this K/A because the implementing procedure for aligning RNS to the CLP is 3-EOP-ES-1.4, Stage 4 Actuation Response, Step 20. Instead, the K/A catalog links FR-C.1 to aligning RNS to the CLP. Nevertheless, the K/A requires testing the operational implication or cause effect relationship of reaching the CLP low level. Is the K/A Catalog implying that the PACE of getting thru C.1, and then transitioning to ES-1.4, is important to conserve IRWST inventory? We need to discuss whether there are any other points in the EOPs (other than ES-1.4) that direct RNS alignment to the CLP. The only place that has the CLP low level (15%) termination criteria appears to be ES-1.4. KA met.

2. Cred Dist: The 1st part of Choices A/B (CVS can inject from the Cask Loading Pit) is not plausible because these pumps dont have a suction from the Cask Loading Pit. Q modified.
3. Cred Dist: The 2nd part of Choices B/D (trying to conserve accumulator inventory after ADS Stages 1-3 have actuated and a DVI line break) is not plausible because the RCS is already depressurizing and accumulators will have already released their contents when RCS pressure lowered; therefore, there is no reason to conserve accumulator inventory. Q modified.
4. 9-18-15: Future Memo to APOG that K/A Catalog needs revising, changed K/A number and kept topic; got rid of accumulator and changed to SFP cooling pump; SAT Question is sat as of 9/18/2015.

15 N S T1G1: A-323 AA2.04

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 16 H 3 x x N E/U T1G1: ES-1.1 G2.4.39

1. Q=K/A: IF the annunciator was associated with an actual CVS isolation signal, THEN the K/A match would be unquestionable.

S However, in the proposed test item, the Letdown Hx Outlet Temp Hi annunciator isnt applicable to evaluating ES-1.1, Step 3.d (RNO) because high temp doesnt ever auto-isolate letdown.

Please provide justification as to how this annunciator being in alarm aids the operator when performing ES-1.1, Step 3.d.

We may need to replace the generic portion of this K/A because the link between annunciator response procedures and ES-1.1 is may not be possible. Q modified.

2. Cred Dist: The 1st part of the proposed test is not plausible because Letdown Hx Outlet Temp Hi never causes an automatic letdown isolation.

Suggest changing the annunciator to an annunciator that is associated with a CVS isolation. Q modified.

9-18-15: Moved in accordance with ES-1.1 to only the 2nd fill-in-the-blank; SAT Question is sat as of 9/18/2015.

17 H 3 x N E T1G1: SDP-1 EK1.02 S 1. Stem Focus: Revise the 7th bullet to delete the words has been; change to is. Incorporated.

2. Stem Focus: Add the word slowly at the end. Incorporated.
3. Stem Focus: The term MODE 6 can be deleted since the 2nd bullet already says the vessel head is NOT on the flange.

Deleted flange piece instead.

4. Stem Focus: Swap the order of the 5th and 6th bullets to chronologically flow better. Incorporated.
5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 H 2 x x N U T1G1: SDP-2 EA1.03 S 1. Cred Dist: The 1st part of Choices C/D (CVS wont be used) is not plausible because of the wording of the 1st fill-in-the-blank statement. In other words, the stem tells the applicant (at 1030) that Step 36 (Refill RCS Using CVS Makeup) is required.

Therefore, the correct choice can only be that CVS will be used, even if only one pump is available. Suggest using the word sufficient in the 1st fill-in-the-blank statement to remedy.

Changed Step.

2. Stem Focus: Add a reason to the 1st bullet (why are we draining the RCS? Is there fuel in the vessel?) in the stem to add context to the question. Added.
3. LOK: It seems that this may be more than Fundamental (as marked on the distracter analysis; consider changing to Higher Level. OK
4. 9-18-15: Comments incorporated; higher cog question; SAT Question is sat as of 9/18/2015.

19 F 1 x x N U T1G2: A-320 AK3.07 S 1. Cred Dist and/or LOD=1: Based on the information in the stem, none of the distracters are plausible, that is, since TCS/GCS/turbine temperatures/vibrations, etc., are not provided in the stem, Choices A, B, and D are not plausible. Q replaced.

2. Partial: To ensure Choice C is absolutely correct, include the title of the basis document in the stem question instead of only including AOP-203. Q replaced.

Suggest testing the REASON for reducing turbine load in accordance with Step RNO 3.b, which is to maintain vacuum less than 7 hg (vs 9 hg). Be careful to script the question such that it asks for the way the procedure is worded, to avoid a subset issue. Q replaced.

Alternatively, there may be no way to write a discriminating question at the RO level and the K/A may need to be replaced.

3. 9-18-15: Kept K/A but wrote question to test whether reducing load/turbine trip was was not required; the reason is thereby being indirectly tested; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 20 H 2 N U T1G2: A-314 AK3.02 S 1. Cred Dist: The 2nd part of Choices A/C (SFS pumps is reason to check PZR level > 19.5%) is not plausible because the Step asked for PZR level (not SFP level). OK Do SFS pumps lose suction for a given PZR level? Or is PZR level off-scale low when SFS pumps lose suction?

2. 9-18-15: Licensee explained how reason was to ensure level above flange; SAT Question is sat as of 9/18/2015.

21 H 1 N U T1G2: SDP-4 EA2.03 S 1. Cred Dist and/or LOD=1: The stem needs to include PZR Level below the auto-makeup set point to add plausibility to the 1st part of Choices A/B (No Makeup Flow at 1000). As written, this is not plausible (LOD=1) because the stem says Borating the RCS wasnt started until 1005. Added.

2. Cred Dist and/or LOD=1: The stem needs to include some item that can be misconstrued as why the CVS Manual Makeup Isol and Boron Dilution Block signals are unable to be reset to add plausibility to the 2nd part of Choices B/D (No Makeup Flow at 1005). As written, this is not plausible (LOD=1) because the stem says Borating the RCS began at 1005; therefore, there has to be makeup flow. Q modified.
3. #/units: The 1st bullet should be replaced with the actual name of the annunciator. Incorporated.
4. 9-18-15: One of the licensees boration methods (CMT) does not indicate makeup flow; Comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 22 F 2 x x x N U T1G2: SDP-6 EK2.04 S 1. Cred Dist: Choices C/D are not plausible because theyre too large; the values in these choices represents a HUGE heat up.

Incorporated.

2. Partial: To avoid partially correct answers, provide times down to the second values (put zero seconds on all times) to ensure RCS temperature remained within +/- 5F band in the last 10 minutes.. cant be used to make an post exam appeal.

Incorporated.

3. Stem Focus: Need to add the initial RCS temperature to the Given Conditions bullet. Incorporated.
4. 9-18-15: Licensee changed temperatures; comments incorporated; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 23 F 3 x x x x N U T1G2: A-306 G2.4.4 S 1. Q=K/A: This question does not test the applicants ability to recognize abnormal SYSTEM operating parameters that require entry to AOP-601, or any other AOP.

One opportunity to test this K/A, for example, is the radiation limit/value that requires entry to AOP-601 from AOP-905. If site-specific rad value is not available at this time, are there ways to test the Alert light, Hi alarm light, etc. without testing the site specific rad-value. We need to explore ways to hit this K/A, because we may not be able to replace the K/A if the reason is solely due to plant reference materials not being ready. Q replaced.

2. Cred Dist: The 1st part of Choices A/B (crew will stay in the main control room and continue with ES-0.1) is not plausible because the stem says the control room must be evacuated. Q replaced.
3. Minutia: The 2nd part of the question may be minutia because knowing the number of switches is not operationally valid.

Please provide reason why knowing the number of switches is operationally valid. One option is to test the applicants knowledge of whether OCS-JW-001 (MCR/RSW Xfer Switch Panel) has to be placed in the Disable position. Another option is to test the location of JW-001. Q replaced.

4. Partial and/or Stem Focus: To ensure everyone is clear that the 2nd fill-in-the-blank statement is NOT referring to Main Control Room switches, re-word the 2nd fill-in-the-blank statement as:

Step 3, Evacuate to RSR requires a minimum of ______

transfer switches to be manipulated in Room 12S05 before plant control can be established from the Remote Workstation. Q replaced.

5. 9-18-15: Re-worked to test AOP-601, Step 7, which has transition to E-0 for loss of MFPs; SAT Question is sat as of 9/18/2015.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 24 H 3 x x x N E/U T1G2: A-318 AA1.09 S 1. Cred Dist: The plausibility of the 1st part of Choices A/B (9.3 gpm) is borderline because the stem doesnt include anything that could be misconstrued as a high rad condition such as the 10 oclock BDS-RE011 (EDI Reject Rad) or BDS-RE010 (EDI Product Rad) normal values. Incorporated.

2. Partial: The 1st fill-in-the-blank statement does not match 3-BDS-SOP-001, Attachment 10, Step 13; the fill-in-the-blank statement isnt specific that 140 gpm is the max flow per heat exchanger. Suggest matching the words to the procedure to avoid partially/no correct answers. Incorporated.
3. Stem Focus: The 2nd bullet does not provide the procedure being implemented, which is 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS.

Incorporated.

4. Stem Focus: The order of the 3rd and 4th bullets should be swapped to chronologically flow. Incorporated.

Suggest the following:

Given:

At time 1000 100 % power 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS, is in progress BDS-RE011 (EDI Reject Rad) is xxxx BDS-RE010 (EDI Product Rad) is xxx At time 1020 SG BD HX A Outlet Temp (CDS-TE040A) is alarming at 420°F AOP-202 (Condensate System Malfunctions) is entered WOOTF completes both statements?

At 1000, the maximum allowable BDS flow rate through each heat exchanger is limited to _______ gpm.

At 1021, in accordance with AOP-202, blowdown from BOTH Steam Generators ________ required to be isolated.

Incorporated.

9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 25 H 2 x x N U T1G2: FR-C.3 EK1.08 S 1. Q=K/A: The question does not test the applicants knowledge of the relationship between the FR-C.3 procedure and the RCS; the 1st part of the question only requires GFES knowledge of the steam tables and the 2nd part of the question does not require any knowledge of FR-C.3. Suggest testing the applicants knowledge of the F-0 CET temperature threshold value that requires entry to FR-C.3, or some other RCS aspect of FR-C.3.

Q replaced.

2. Cred Dist: The 2nd part of Choices B/D (CMT temperature already stable two minutes after PXS-V014A/B & PXS-V015A/B are opened) is not plausible because only two minutes has elapsed. How long do CMTs inject cold water? Q replaced.
3. 9-18-15: Licensee presented new question; SAT Question is sat as of 9/18/2015.

26 H 2 x N U T1G2: FR-Z.4 EK2.01 S 1. Q=K/A: The question does not test the applicants knowledge of the relationship between containment integrity and the Z.4 procedure; the proposed question only tests the Tier 2 aspect of how the vacuum relief auto-actuates and the LCO requirement.

Suggest making the 2nd fill-in-the-blank statement the first, and then test the applicants knowledge of WHEN Z.4 requires the operators to reset containment vacuum relief and close VFS-V800A/B (that is, when containment pressure is less negative than -0.2 psig).

Q acceptable.

2. Stem Focus: Space needed between 0.4 and psig in the last bullet.
3. Move At 1005:00 to the stem question since its in both fill-in-the-blank statements.
4. Note: Because of the limited content in Z.4, this question is being accepted to meet Tier 1.

Question is sat as of 10/28/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 27 H 2 x x x x N E T1G2: A331 AA1.02 S 1. Cue: The 2nd bullet tells the applicants that the static transfer switch auto-aligned to its backup AC power source; this description of the auto-alignment is not necessary to elicit the correct response because it is a direct result of the fault/alarm on IDSA-DS-1.

2. #/units and/or Cue: The name of the alarm is missing in the first bullet; if the alarm provides an auto-swap signal to the static transfer switch, then the phrase ..due to a fault on IDSA-DS-1 is not necessary to elicit the correct response.
3. Stem Focus: The 4th bullet (AOP-303 is entered) is not necessary.
4. Q=K/A: The modified test item does not meet the Tier 1 aspect.

Comments incorporated and 2nd part of question re-written to test panels; Question is SAT.

28 H 2 x x M E T2G1: RCS A2.31 S 1. Partial: Choice C may also be correct because there is no other reason why containment sump level is rising other than a stuck open RCDT relief valve. Why is containment sump level rising?

Q modified.

2. Cred Dist: The distracter analysis said that 2nd part of Choices B/D (AOP-112 doesnt provide guidance on isolating..) was plausible because the AOP only provides guidance for isolating the INNER seal. Therefore, the 2nd fill-in-the-blank statement should include the word INNER between the words vessel and flange. Q modified.
3. Cred Dist: The fact that RCDT pressure is rising means there is no way the relief valve can be lifted. Suggest deleting the phrase and rising.

Question is sat as of 10/28/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 29 H 1 x x N U T2G1: SGS A1.05 S 1. Cred Dist and/or LOD=1: The 1st part of Choices A/B (Tavg goes up when SG PORV opens) is not plausible because this cools the primary. Q modified.

2. Cred Dist and/or LOD=1: The 2nd part of Choices B/D (Power goes down when SG PORV opens) is not plausible because this cools the primary. Q modified.
3. Q=K/A: The proposed test item tests GFES knowledge only; this is the site specific portion of the written exam. Q modified.

Instead of testing what Tavg does, suggest testing something that happens as a result of Tavg changing. Q modified.

Question is sat as of 9/18/2015.

30 F 2 x x N E T2G1: SGS K2.04 S 1. Cue: The 1st fill-in-the-blank statement contains two 1s; the correct answer contains a 1. Suggest changing the 1st part of Choices C/D to another bus that has a 1 in it. Discussed - OK.

2. Stem Focus: Reword the 2nd fill-in-the-blank statement to be more precise as:

IF power is lost to BOTH MSIV A hydraulic pumps, THEN SGS-V040A ___(2)___ immediately close. Incorporated.

3. Cred Dist: The 2nd part of Choices A/C (closes immediately) is not plausible because of the word immediately. Modified Q.
4. Distracter Analysis wasnt updated after changing Choices C/D to 1DSA-EA-1. Noted.

Question is sat as of 10/28/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 31 H 2 x x N E/U T2G1: RNS K3.01

1. Partial: When the HX BYPASS valve fails open, what will the HX INLET temperature do at RNS-TE-013A location? IF the S

temperature at this point rises, then RNS-V006A will open up more, which will make another choice correct. Q asked at a point in time.

2. Cred Dist: The 2nd part of Choices A/C (Disch to CVS valve stays open even if letdown temperature rises to 141F) is not plausible because resin must always be protected from temperatures near 140F. Temp lowered.
3. Suggest revising the question such that the 3rd bullet doesnt TELL the applicants which way the valve failed; instead, say that the air supply to the valve has failed. This increases discriminatory value. Incorporated.

Question is sat as of 10/28/2015 32 H 2 x N E/U T2G1: PRHR A1.01 S 1. Cred Dist: The 1st part of Choices C/D (PRHR Hx Press remains the same) is not plausible because the HX conditions have changed; therefore, the pressure has to change, even if minutely.

Distracter Analysis points: The possibility of PZR Pressure Control keeping the pressure constant, and the possibility of the applicants misconception of inlet valve position keeping the pressure constant are eclipsed by the fact that the PRHR Hx conditions will change, even if minutely.

2. Cred Dist: The inter-play between the two parts of Choice C make it not plausible. If a Safeguards Actuation has occurred, then PRHR Hx pressure hasnt remained the same.
3. Cred Dist: The interplay between the 1st and 2nd parts of Choice C dont make sense; IF PRHR Hx pressure is going UP, then NOT having a safeguards signal (Tcold) is not plausible.

Revised question to ask about PXS-V101 and pressure change with isolating a leaking PRHR Hx; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 33 H 2 x x N U T2G1: PXS A4.16 S 1. Cred Dist: The 1st part of Choices C/D (trip bkrs remain closed) is not plausible because a CMT actuation is a direct reactor trip.

Timing adds to plausibility.

2. Cred Dist: The 2nd part of Choices A/C (steam injection) is not plausible because the stem does not include anything that could be misconstrued as a LOCA. Q modified.
3. Stem Focus: The 2nd bullet is a sentence fragment. Corrected.
4. Cred Dist: The 1st part of Choices C/D is not plausible because a CMT actuation always eventually causes a reactor trip (ATL discussion was that DAS CMT wont cause direct reactor trip).

The CMT actuation will cause RCPs to trip (for example), which will cause a reactor trip. Timing adds to plausibility.

5. Cred Dist: The 2nd part of Choices A/C (CMT level lowering) is not plausible because there is not anything in the stem that could be misconstrued as a LOCA (ATL discussion was that WR level fluctuated anytime CMT actuated). Credibility based on PRHR actuation and RCS shrink.

Question is sat as of 11/05/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 34 H 2 x x N E/U T2G1: PXS G2.4.27 S 1. Q=K/A: The proposed test item tests the applicants knowledge of AOP-109 and the status of PXS-V101 breaker; the test item is not testing the applicants knowledge of an NLO task. Lets discuss whether changing the K/A is necessary.

2. The second fill-in-the-blank statement seems unrelated to the PRHR Hx tube leak event; why is pressurizer level rising? The second part of the question should be related to the topic.
3. Stem Focus: The 2nd fill-in-the-blank statement is missing the word auto, that is, received an auto-open signal.
4. Stem Focus: The 1st fill-in-the-blank statement should be worded as At 1000:00, an operator _____(1)___ required to be locally dispatched to assist the MCR with isolating the PRHR Hx.
5. Cred Dist: The 1st part of Choices C/D (breaker is OPENED) is not plausible because at 1000:00 no isolation has occurred.

Suggest changing the 1st fill-in-the-blank to at 1020:00 the PRHR Hx Inlet MOV breaker is ____ . This tests the local operator aspect of the K/A.

6. Stem Focus: Need to include in accordance with procedure XYZ in the stem question.

Re-wrote question to test location of breaker for PXS-V027A; comments incorporated. Question is SAT.

35 H 2 x x N U T2G1: CCS G2.4.4 S 1. Cred Dist: The 2nd part of Choices A/C (rising tank level auto-trips CCS pumps) is not plausible because a high tank level means more NPSH, which never auto-trips pumps. Q modified.

2. Cue: Instead of telling the applicants that a high-2 bearing temperature occurred, provide them with the bearing water temperatures and test their knowledge of whether the RCPs tripped. Incorporated.

Question is sat as of 10/28/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 36 F 1 x x N U T2G1: PPCS A3.01 S 1. Cred Dist and/or LOD=1: The 1st part of Choices C/D (spray valve s not open as pressure is rising) is not plausible because the 2nd bullet says that pressure is rising slowly; therefore, the only possible mitigating response is spray valves open. Q modified.

2. Cue: The 2nd fill-in-the-blank statement cues the applicant that the spray valves should be open for the answer to the 1st fill-in-the-blank statement; the 2nd fill-in-the-blank statement contains the phrase ..as RCS pressure lowers.., which is an expected mitigation to the rising RCS pressure. Q modified.

Question is sat as of 11/05/2015 37 F 2 x x x N E/U T2G1: ADS G2.1.21 S 1. Q=K/A: The proposed test item tests the applicants knowledge of how ADS MOV RCS-V001A is operated, whereas the K/A requires testing the applicants knowledge of the normal operating procedure for the ADS system. The information in the stem is what should be tested to fulfill the K/A. For example, suggest re-working the question to ask the applicant which procedure involves opening and closing the ADS valves.

(Answer is RCS Fill, RCS-SOP-001, Attachment 1).

Alternatively, re-work the question to test the applicants knowledge of which ADS Train Valves are used in the RCS Fill procedure.

2. Cred Dist: Choice C (DAS) is not plausible because the DAS system is only used when normal methods are broken; there is nothing in the stem that could be misconstrued as something is broken.
3. Stem Focus: (typo) The 2nd bullet is not the same as the procedure Step 4.6.e. The procedure step should be worded as Close Train B Stage 1, 2, and 3, ADS Valves by performing the following Modified question to require knowledge of RCS-SOP-001; Question is SAT.
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 38 H 3 x N U T2G1: RTS K3.06 S 1. Cred Dist: Choices A/B are not plausible because at these times the reactor is still not tripped; operational validity of trying to block Safeguards during an ATWS makes these choices not plausible (even though intent of the question was to purely test the logic from a Tier 2 perspective). Q modified to address trip status.

Q is sat as of 10/28/2015.

39 5 2 x x x M E/U T2G1: RTS K5.03 S 1. Job-Link: The 2nd part of the question tests information located in the background document for FR-S.1. Generally, overall mitigative strategy is RO knowledge; however, in this question, the knowledge being tested is beyond mitigative strategy. The knowledge being tested is the limiting design basis ATWS event. Q modified.

2. Cred Dist: Given the picture in the stem, the 1st part Choices A/B (turbine is tripped) is not plausible because the alpha steam line is blue for stop/control valves. Q modified.
3. Partial: Choice C is also correct because the 2nd fill-in-the-blank statement is too generic. A turbine trip is required during an ATWS with a steam leak also. (feedwater leak will make steam as it leaks). Suggest changing the 2nd part of A/C to main steam line leak. Q modified.

Q is sat as of 11/05/2015 40 F 2 B S T2G1: ESAS A3.13 41 H 2 N S T2G1: ESAS K6.13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 42 H 2 x x x M E T2G1: DAS A2.02 S 1. Stem Focus: The last portion of the 2nd bullet (due to low SG Water Level) is not necessary. Incorporated.

2. Cue: The first portion of the 3rd bullet is not necessary; reword 3rd bullet as The reactor trip breakers are not open.

Incorporated.

3. Stem Focus: Add at 1000:00 in the 1st fill-in-the-blank.

Incorporated.

Q is sat as of 10/28/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 43 F 2 x N E T2G1: PCS A4.01 S 1. Ensure manual actuation of PCCS is not required in any scenarios to preclude written/operating exam overlap. Noted.

2. For the 1st part of the question, what procedure directs the operator to operate both switches? (I could not find anything in NMP-OS-007-01.) Why does the Conduct of Ops procedure require the operator to turn both switches even though the first switch actuates the PCCS?

Revise the first fill-in-the-blank statement to:

In order to manually actuate PCS at the PDSP, the minimum required operator action to satisfy the logic is to turn _____ .

(will there be two correct answers?) Q modified to test circuit logic specifically.

3. Stem focus: Re-word the 2nd fill-in-the-blank statement to:

In order to generate a DAS PCS Actuation signal, the operator is required to turn ______ handswitch(es) at the DAS Control Panel. [ONLY one] Q modified to test circuit logic specifically.

4. #/units: The actual switch names/numbers should be included.

Switches are inherent with PCS Actuation.

Q is sat as of 10/28/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 44 H 2 x x x B U T2G1: MSS K1.04 S 1. Cred Dist: The 1st part of Choices A/B (MSS-V020 remains open) is not plausible because the stem says that SG pressure is lowering rapidly. One isolation signal is 560 psig. If the SG pressure is currently 602 psig, and lowering RAPIDLY, then its not plausible that MSS-V020 remains open at 1002:00. Q modified.

2. Cue: The phrase lowering rapidly is too strong of a cue. Q modified.
3. Why is the Stage 2 steam dump valve used in the 2nd fill-in-the-blank statement instead of the Stage 1 steam dump valve (MSS-V005)? It is a cooldown valve.
4. Stem Focus: What procedure is being used to block MSL/FW Isol & Safeguards, and enable Stage 1 & 2 steam dumps? Put name/number of the governing procedure in the stem. GOP-205.

Q is sat as of 10/28/2015 45 H 2 x x x N U T2G1: FWS A2.33 S 1. Backwards: In the context of the question, the 2nd fill-in-the-blank is not operationally valid because there IS actually a feed pump running. The phrase If no feed water pumps are running.. will cause confusion with the applicants because its not true.

2. Partial: Choice B is also correct because the alarm may not be clear if the alarm doesnt automatically clear (without operator action).
3. Cred Dist: The 2nd part of Choices A/C (actuate PRHR) is not plausible because you always try to start a feedwater pump FIRST.
4. Stem Focus: The last word in the 1st fill-in-the-blank statement is a preposition; suggest re-wording as:

At 1006:00, SFW Pump A Disch Flow (FWS-FT-015A) Low Flow

______ alarming.

Revised question; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 H 2 x x N E T2G1: FWS A4.06 S 1. This question overlaps the same exact knowledge as RO Q#3; SGS-V255A auto-closes on Tcold = 505F. O/L evaluated as OK.

2. Stem Focus: It may not be operationally valid to assume the drop in temperature is linear; better to add another point in time to the stem with a temperature at that time. Timeline added.
3. Partial: Is there any mathematical way that Choice B is also correct? At 1027:00, Tavg is 523 F, whats Tcold. Q modified.
4. Partial: Insert the word automatically before the word closed in the fill-in-the-blank statement. Incorporated.
5. Partial: Re-word the fill-in-the-blank statement as: Of the following times listed below, the earliest time. Incorporated.
6. Suggest replacing question due to conflict with Q#3. O/L evaluated as OK.

Q is sat as of 10/28/2015 47 H 2 x x N U T2G1: ECS A3.01 S 1. Cred Dist: The 1st part of Choices C/D (ES-1 powered from RAT) is not plausible because the picture in the stem says the automatic bus transfer control is disabled.

2. Cred Dist: The 2nd part of Choices A/C (ES-2 powered from diesels) is not plausible because the picture in the stem says that the automatic bus transfer control is enabled.
3. Cue: The 2nd bullet is not necessary to elicit the correct response.

Removed picture and replaced 2nd part of question; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 F 2 x x x N U T2G1: IDS K6.02 S Note: LCO 3.8.1 states The Division A, B, C, and D Class 1E DC power subsystems shall be OPERABLE in Modes 1, 2, 3, & 4.

1. Cred Dist: The 1st part of Choices A/B (LCO is met with Battery Charger broke) is not plausible because the stem says the battery charger has failed and at time 1000:00 no replacement charger has been connected.
2. Cred Dist: The interplay between the 1st and 2nd parts of Choice B make it not plausible.
3. Stem Focus: The Plant status is missing from the stem.
4. #/units: The name of 1DSB-DC-1 is missing from the stem (24 Hour Battery Charger).

Revised 1st part of question; comments incorporated. Question is SAT.

49 H x N U T2G1: ZOS K1.02 S 1. Cred Dist: The 1st part of Choices A/B is not plausible because offsite is still available. Q modified to low power.

2. Cred Dist: The 2nd part of Choices B/D (Diesel still not powering bus) is not plausible because the stem says that a LOOP occurred at 10:30 and there is nothing in the stem that could be misconstrued as a new fault on ECS-ES-2 that occurred after 10:00. Q modified.
3. LOK: The distracter analysis indicated that this test item was a fundamental (lower) cog item; however, it appears it may be a higher cog question. Lets discuss. Q modified.

Q is sat as of 10/28/2015

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 50 F 2 x M T2G1: SWS K4.06 S 1. Cred Dist: The 1st part of Choices A/B (Fire water is the normal supply to towers) is not plausible because fire protection water is never the normal supply to anything except fire protection.

Suggest revising the question to test the applicants knowledge of the alternate source of cooling tower makeup. Alternatively, change the 1st part of the question to test cooling tower makeup is / is not normally provided from RWS. Incorporated.

2. Cred Dist: The 2nd part of Choices A/C (normal control method is manual) is not plausible because normally all control methods are AUTOMATIC, which is the correct answer. Q modified.
3. Cred Dist: The interplay between the 1st and 2nd parts of Choice B make it not plausible; unless a fire pump is ALWAYS running (unlikely), then automatic level control doesnt make sense. Q modified.

Q is sat as of 10/28/2015.

51 F 2 x x x N E/U T2G1: CAS A1.03 S 1. Cue: The 2nd bullet is not necessary to elicit the correct response. The applicants should know that at 100% power, one instrument air package is always selected as the Lead compressor. Incorporated.

2. Minutia: The 2nd portion of the question is testing trivial information because the choices are too close together. Q modified.
3. Cred Dist: The plausibility justification of the 2nd part of Choices A/C is suspect. Q modified.
4. Cue: The 1st part of the Choices in this question cues the answer to the 1st part of RO Q#52. Q 52 modified.

Q is sat as of 10/28/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 52 H 2 x x M U T2G1: CAS K3.17 S 1. Partial: There is no absolutely correct answer to the 1st fill-in-the-blank statement because the SSD never said that PXS air operated valves WILL begin to reposition; the SSD basically says that the air operated valves are reliable down to a pressure of 50 psig. Q modified.

2. Cred Dist: The 2nd part of Choices A/C (reactor still critical) is not plausible because a manual scram would already be performed since safety related valves (PXS) are repositioning everywhere. Q modified.
3. Cred Dist: Normal air pressure is 115 psig; the plausibility of the 1st part of Choices C/D (100 psig) is borderline because 100 psig is the alarm set point and air operated components shouldnt be designed to begin repositioning at this high of air pressure. Q modified. IA P of 80 psig means that it could be as low as 50 psig at the components considering line losses.
4. What is the significance of the phrase 10 seconds after ALL PXS valves reposition in the 2nd fill-in-the-blank statement? Q modified.

Q sat as of 10/28/2015.

53 F 2 x x N U T2G1: CNS K4.07 S 1. Cred Dist: The 2nd part of Choices A/C (electrical interlock on containment doors) is not plausible because this type of interlock does not exist.

2. Cred Dist: The 2nd part of Choices A/B (something was already overridden) is not plausible because the stem does not contain any information that can be misconstrued to imply anything was previously overridden.
3. Stem Focus: The phrase ..without entering an additional Tech Spec CONDITION.. is cryptic and vague. The initial conditions should include the required Tech Spec 3.6 Condition for the broken outer door (as 4th bullet).
4. Stem Focus: The 3rd bullet is not necessary?

Revised question to test whether 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action is/is NOT required and knowledge of mechanical interlock design.

Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 54 F 2 x x N E/U T2G1: RCP K5.02 S 1. Cred Dist: Change RCP 1A speed to 88% to make Choices A/B plausible. 88% is the max allowed speed when < 520 F.

Incorporated.

The distracter analysis may be a cut-and-paste error; it refers to Loop 2 and PRHR Hx even though these items dont apply.

Lets discuss. OK Q sat as of 10/28/2015.

55 F 2 B S T2G1: CVS K2.04 56 H 2 x M E/U T2G2: DRCS A2.19 S 1. Bank demand position failing to 0 steps may not be operationally valid because lesson plan AP-LT-I-PP-DRCS, Slide 39 says the step counter data is retained even if a total loss of power occurs in the logic cabinet. Is it an operationally valid event?

2. Cred Dist: The plausibility of the 1st part of Choices A/B (trip reactor) is borderline because the stem of the question never says there is an actual deviation between actual vs demanded rod position.
3. Stem Focus: Re-word the 2nd fill-in-the-blank statement as:

The LCO for Tech Spec 3.1.7 (Rod Position Indication)

___(2)___ met.

4. LOK: It appears that the proposed test item is a higher cog question. Lets discuss.

Bank position can be reset to zero for each group demanded position without a loss of power; comments incorporated.

Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 57 H 2 x x M U T2G2: RPIS K2.03 S 1. Cred Dist: The 1st part of Choices C/D (rod position is unknown during a LOOP) is not plausible because control rod positions are always powered from a vital/inverter power supply; control rods perform a safety function. Based solely on conservative design principles, the applicants can answer both parts of this question as yes/yes and be correct, thus bypassing the K/A.

Suggest writing a question that tests the applicants knowledge of the power supply to the digital rod position indicating coils.

Incorporated.

2. Cred Dist: The 2nd part of Choices B/D (rod position unknown 6 hrs later) is not plausible because the stem does not include anything that could be misconstrued that the SDGs are not available. The timing of Q enhanced plausibility.
3. Stem Focus: The 2nd bullet is vague; the LOOP needs to be better defined. Added words.

Q sat as of 10/28/2015 58 H 2 x x x M E T2G2: VES K3.02 S 1. Partial: There may be no correct answer to the 2nd part of the question because the concrete heat sink design doesnt work; that is, the CR gets too hot when VES is isolated. For example, AOP-903, Toxic Gas, Attachment 1, MCR Heat Load Reduction, is required to ensure the max temperature does not exceed 90F.

2. Cred Dist: The basis for the 5F temperature rise (2nd part of Choices B/D) is missing. If there is no basis, then this portion of these choices is not plausible. Suggest replacing with 100 deg.
3. Stem Focus: The phrase ..following a loss of VBS operation should be added to the 2nd fill-in-the-blank statement.

Changed to say with operator action; comments incorporated.

Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 H 2 N E T2G2: CDS A3.01 S 1. Stem Focus: To ensure no confusion with what the fill-in-the-blank statement is asking, re-word as:

The minimum CDS flow required for the number of CDS pumps operating at 1005:00 is _____ gpm. Incorporated.

Q sat as of 10/28/2015.

60 H 2 x x N E T2G2: CMS K6.08 S 1. Cred Dist: The 1st part of Choice C (Compressor D hasnt auto-started yet) is not plausible because at 1005:00 condenser vacuum has decayed to 7.6 HgA. Additionally, the interplay between the first and second portions of Choice C dont make sense (turbine tripped and compressor hasnt auto-started). Q modified to change initial equipment lineup which enhanced plausibility.

2. Stem Focus: It is not operationally valid to linearly extrapolate the vacuum decay since the delta P is not linear with respect to time. Suggest providing another point in time with the vacuum value. Extrapolation no longer needed to ensure correct answer because with the new alignment, the answer is has not.

Q sat as of 11/05/2015.

61 H 2 x x B U T2G1: MTS K1.08 S 1. Cred Dist: The stem picture shows V017A CLOSED and its smaller bypass (V016A) is OPEN. Since the line is smaller, then the answer cant be the larger power choices. Valve sizes are comparable.

2. Cue: The largest range is also the correct answer; suggest changing to:

WOOTF identifies a turbine power that is equivalent to these valve positions?

A. A%

B. B%

C. C%

D. D%

Q modified.

Q sat as of 11/05/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 62 N U T2G2: WGS A1.02 S 1. Cred Dist: The 1st part of Choices C/D (TCS cools WGS) is not plausible because the stem says letdown is being cooled, which is located in the reactor auxiliary (potentially contaminated) building. Does TCS cool any contaminated system? Q modified.

2. Stem Focus: The 1st fill-in-the-blank statement should be softened to ..could be due to a loss of.. Q modified.
3. The 2nd fill-in-the-blank statement should include the phrase..in accordance with. Incorporated.
4. Stem Focus: The way the 2nd fill-in-the-blank statement is worded implies that there IS a delay bed fire. Suggest rewording as:

IAW..at 1030:00, nitrogen injection _____ required.

Incorporated.

Q is sat as of 10/28/2015.

63 N E T2G2: CWS K4.01 S 1. Cred Dist: The interplay between the 1st and 2nd parts of Choice C makes this choice not plausible.

Answer changes when < 10% power; Question is SAT.

64 H 1 x N U T2G2: SDCS K5.03 S 1. Cred Dist: The 1st part of Choices C/D (reactor power wont rise) is not plausible because a steam leak is occurring. Q modified to test valve capacity.

2. Cred Dist: The 2nd part of Choices B/D (rods wont move) is not plausible because there is nothing in the steam that can be misconstrued that the rods arent in AUTO. Q modified.
3. LOD=1: This question will not provide any discriminatory value on the exam. Q modified.

Q sat as of 11/05/2015.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 65 F 2 x N E T2G2: NIS A4.02 S 1. Stem Focus: At 1000:00, break the ONLY bullet into two bullets: A/B/C Blocked and D NOT Blocked. Incorporated.

Q sat as of 11/05/2015.

66 F 2 N S T3: G2.1.18 67 F 1 x M U T3: G2.1.33 S 1. Cred Dist: The 1st part of Choices A/B (announcing transient alarms is required) is not plausible because the purpose of transient alarm protocol is emergency operating procedures events.

2. Cred Dist: The 2nd part of Choices B/D (no update to return to normal) is not plausible because no one would ever know when normal annunciator protocols went back into effect without some sort of update.
3. LOD=1: This question will provide no discriminatory value on the exam.

Re-wrote question to test AOP/EOP communication protocols; Question is SAT.

68 F 2 N U T3: G2.2.15 S 1. Cred Dist: The 2nd part of Choices A/C (only one procedure involved for configuration mgmt.) is not plausible because the word ONLY is too exclusive. There are multiple procedures in effect for configuration management.

2. Stem Focus: The title of NMP-AD-002 is missing from the 2nd fill-in-the-blank statement.

Rewrote question to test resetting tripped breaker; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 69 F 2 x x N U T3: G2.2.23 S 1. Cred Dist: The 2nd part of Choices A/C (excore detectors only thing that matters) is not plausible because of the phrase core thermal power. Thermal power is always more conservative to drive by. Q modified.

2. Stem Focus: Include the phrase in accordance with procedure XYZ in the 1st fill-in-the-blank statement. Procedure tie now exists.

Q sat as of 11/05/2015.

70 F 2 x N U T3: G2.2.30 S 1. Cred Dist: The 2nd part of Choices A/C (only operated at RO workstation) is not plausible because the word ONLY is too exclusive; there are many ways to operate components at the CIM, for example. Q modified.

Q sat as of 11/05/2015.

71 H 2 x x N U T3: G2.3.5 S 1. Cred Dist: The 1st part of Choices A/B is not plausible because the oxygen feature never causes an auto-isolation for a radioactive release.

2. Cred Dist: The 2nd part of Choices B/D is not plausible because nitrogen would only be automatically introduced for a fire or oxygen issue - not for high rad at 1003:00.
3. Q=K/A: This is an extension of a Tier 2 (Systems) topic; the proposed question does not test a generic plant wide radiation release concept. For example, the administrative aspects of releases or the emergency operating procedures allowances for releases - - more than just how the system works.

Significantly modified the question; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 72 F 1 x M U T3: G2.3.6 S 1. Cred Dist: The 1st part of Choices C/D (must frisk coming out of high rad area) is not plausible because contamination is the concern; radiation fields are around us all the time and we never frisk. This is GET knowledge. Q modified.

2. Cred Dist: The 2nd part of Choices A/C is not plausible because the control room would be overwhelmed when any person caused a gamma portal alarm. Q modified.
3. LOD=1: This test item will provide no discriminatory value.

Q sat as of 11/05/2015.

73 H 2 x x B E T3: G2.4.15 S 1. Cue: The phrase in a 15 minute period is not necessary to elicit the correct response. Time bounding is needed.

2. Partial: There may be no correct answer; the 2nd part of Choice B may not be always totally correct when plant conditions require shutting the MOV. Just because the caution exists doesnt mean there may be times when the MOV should be closed anyway. Q asked iaw procedure.
3. Ensure this question does not overlap with RO Q#37. Overlap evaluated sat.

Q sat as of 11/05/2015.

74 L 3 M S T3: G2.4.17 75 H 2 x N U T3: G2.4.38 S 1. Q=K/A: The ability to diagnose and recognize trends is not being met because the graph is merely a point in time value. Q modified and graph now supports KA match.

Q sat as of 11/05/2015.

76 H 3 N S T1G1 A-336 (AOP-402, Malf of Prot & Safety Mong) G2.2.19 Q is sat.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 H 2 x x x N E T1G1 E-1 G2.1.7 S Note to NRC reviewers: In the Westinghouse operating fleet EOPs, if youre in E-3 and subsequently get a LOCA, you stay in E-3 because it is designed to handle SGTR + LOCA. In AP-1000 this is not the case - - you leave E-3 and enter E-1.

1. Cue: The phrase to mitigate the above conditions in the 1st fill-in-the-blank statement is not necessary to elicit the correct response.
2. Cred Dist: To enhance the plausibility of the 1st part of A/B (will transition to E-3), and better raise the question of the SGTL, revise the 4th bullet in the stem to say:

The crew is performing the following step in E-1:

3. Stem Focus: It seems more appropriate to re-order the 1000:00 bullets so that the 1st bullet becomes the last bullet.
4. Stem Focus: The 2nd bullet needs to add the phrase IAW AOP-103, SGTL.
5. Stem Focus: The phrase direct a in the 1st fill-in-the-blank statement is not necessary.

Comments incorporated; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 78 H 2 x x N E T1G1 FR-C.1 EA2.04 S 1. Cue: Because the 2nd fill-in-the-blank statement is asking about RNS alignment, and RNS alignment is directed AFTER Step 32 in FR-C.1, the applicant is cued that the correct answer to the 1st fill-in-the-blank statement must be to stay in the procedure (which is the correct answer).

2. Stem Focus: Re-write the 2nd fill-in-the-blank statement to eliminate the word strategy, which hints that this alignment is only a severe accident strategy, as follows:

In accordance with Error! Reference source not found.

(Error! Reference source not found.) aligning RNS for RWST is __________

(credited for preventing core damage within the EOPs for an accident at power vs. a post-core damage severe accident management strategy)

Improper transition at Step 32 leads to SACRG; Comment #2 incorporated. Question is SAT.

79 H 2 x N U T1G1 A-323 (Loss 6.9/4kv, or 480v) AA2.03 S 1. Q=K/A: The 2nd part of the question is the SRO-only part; however, the 2nd part of the question does not pertain to the standby diesel generator load topic. The 4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> NRC notification pertains to the reactor trip.

Suggest re-working the question to test whether Attachment 1, Load Management (or alternatively Attachment 3, Prolonged Loss of AC Power) is/ is NOT required, given that the stem includes more info that makes the not version plausible.

Suggestion incorporated; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 80 H 2 x B U T1G1 A-329 (AOP-703, LOIA) AA2.04 S 1. Cred Dist: The 1st part of Choices C/D (mini-flow valve normally open at 100% power-RCS temp lowers when valve closes) is not plausible because the feed water pumps are pumping all forward at 100% power.

2. Cue: The 2nd fill-in-the-blank statement tells the applicant that a feed water transient will occur; therefore, this cues the applicant that the mini-flow valves must fail to a position thats different to their normal position. (For example, if the mini-flow valve is normally closed, and it fails closed on a lOIA, then there would be no transient.)
3. Cred Dist: The 2nd part of Choices A/C (Uncontrolled cooldown) is not plausible because RCS temperature will rise due to the failed positions of the MFRVs and feed pump mini-flow valves.

Suggest testing the applicants knowledge of where E-0 Step 32 RNO sends you (Check Instrument Air > 105 psig RNO is to go to E-1, Step 6). This, in a sense, does evaluate the ability of the applicant to evaluate RCS temp, SG level, and/or SG pressure because E-1, Step 6 sends you to AOP-703.

Rewrote question; Question is SAT.

81 H 3 N E T1G1 FR-H.1 G2.4.24 (EMERGENCY CLASSIFICATION)

S 1. The VEGP EALS-ICS Threshold Values & Basis (B-GEN-PLMP-020-GL01) was not available in the references; I used NMP-EP-110-GL03, VEGPEALs-ICs, Threshold Values & Basis to research this question.

2. LOD: No E-plan reference is being provided to the applicants; ensure that Operations management has a learning objective or some basis for why the E-plan procedure fission product barrier thresholds must be known from memory.
3. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?

B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 82 H 2 x x N E/U T1G2 A304 (SGTL, AOP-103) G2.1.17 S (EMERGENCY CLASSIFICATION)

1. Cred Dist: The 1st part of Choices C/D (GOP-101, Power Operation Above 25% Power) is not plausible because the title of GOP-101 conflicts with the 1st fill-in-the-blank statement.

That is, the 1st fill-in-the-blank statement says initiate a shutdown, whereas GOP-10 can be correctly eliminated,solely based on its title. The distracter analysis says that, if the rad monitor were available, then GOP-101 could be right. Lets discuss the basis for this analysis

2. SRO-only: The 2nd part of the question can be answered solely based on information above-the-line in Tech Spec 3.4.7. That is, the E-plan excerpt provided in the stem deals with unidentified leakage, pressure boundary leakage, and identified leakage. The applicant only has to know that another category exists in Tech Spec 3.4.7, which is PRIMARY TO SECONDARY LEAKAGE.

Suggest modifying the 1st fill-in-the-blank statement to test the applicants knowledge of whether or not AOP-101 is / Is NOT required.

3. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?

Second part of question re-written; B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 83 H 2 x x N U T1G2 SDP-4, EA2.01 S 1. SRO-only: Neither part of the question is SRO-only, for the following reasons:

1st fill-in the-blank statement: The applicants only have to know the information above-the-line in Tech Spec 3.9.1 (Refueling

[B], (1662 ppm). Since 1600 ppm < 1662, then the only option is to borate the RCS.

2nd fill-in-the-blank statement: The most conservative basis for the 1662 ppm Tech Spec limit is core reactivity at the BEGINNING of a cycle, since this is when the core contains the most fissionable material.

2. Stem Focus: The stem says (4th bullet) that SR neutron flux is stable; this does not align with the 2nd bullet that says SDP-4 was entered due to rising nuclear flux.

Replaced question; new question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 84 F 2 x x N U T1G2 A-332 (AOP-207) G2.1.7 S 1. SRO-only: The distracter analysis indicated that this question was tied to SRO topic 55.43(b)(2) (Tech Specs); however, the proposed test item does not test bases knowledge nor does it involve the application of Tech Specs. Instead, the 1st fill-in-the-blank statement can be answered solely based on the RCS activity surveillance requirement when power has changed more than 15% in a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period. (typically RO knowledge)

The second part of the question does not involve procedure selection, Tech Specs, or any of the other five 55.43(b) topics.

2. Stem Focus: The SUR is not necessary.

A better way to hit the K/A would be to test the applicants ability select a procedure at the Step 19.e point in AOP-207.

Replaced 2nd half of question; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 85 F 2 x x N U T1G2 FR-I.3 EA2.02 S 1. Cred Dist: The 1st part of Choices A/B (raise RCS pressure to satisfy sub cooling reqts) is not plausible because the stem implies that the EOPs were entered, a Safeguards was blocked, and that the plant is headed to cold shut down; raising pressure not usually the preferred option in this scenario.

2. Stem Focus: The 1st bullet does not provide information related to what procedure, or past situation, required blocking safeguards, etc.

Suggest reworking the proposed test item to test the applicants knowledge of another item such as, 1) when, while implementing FR-I.3, transition to FR-I.2 would be actually be required, or 2) possibly test when vessel venting is required to be terminated.

Raising pressure would be the answer if not already at 1920 psig; Question is SAT.

86 F 2 x x x N U T2G1 SGS G2.4.39 S 1. Q=K/A: The K/A is not being met because the proposed test item stem does not require any alarm response procedure ability; the 3rd bullet says the alarm response procedure ability has already been taken. The proposed test item only requires the applicant to know which instruments are dedicated to DAS (vs PMS), and the DAS function.

2. SRO-only: The applicant can answer the question solely by knowing which instruments are dedicated to DAS, and the associated DAS function.

Suggest taking the 3rd item listed in the stem and test the applicants ability to implement Tech Spec actions in accordance with the alarm response procedure.

3. Cue: The 2nd bullet should include the information that the applicant would see in the control room instead of telling the applicant that SGS-LT018 failed downscale with bad quality.

Re-wrote question; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 87 F 2 x x N U T2G1 PXS A2.16 S 1. Cred Dist: The 1st part of Choices C/D (manual DAS not required) is not plausible because conservative decision making would always seem to require follow up with a manual DAS to attempt to make the PDSP actuation occur.

2. Cred Dist: The 2nd part of Choices B/D (the limiting DBA doesnt require at least one of the CMTs.
3. Q=K/A: The proposed test item doesnt test the applicants ability to predict HOW the CMT discharge isolation valve failure affects the plant, including the required subsequent procedures.
4. Stem Focus: The Tech Spec number is missing from the 2nd fill-in-the-blank statement.

Question replaced; Question is SAT.

88 H 2 x N E T2G1 ECS K2.02 (EMERGENCY CLASSIFICATION)

1. Cred Dist: Choice D is not plausible because the note is included in the stem.
2. Why isnt the entire E-plan classification procedure being provided to the applicants as a reference?

Note removed and B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.

89 F 2 x x N U T2G1 DOS A2.01 S 1. SRO-only: The 2nd part of the question is the part that hits the K/A; however, the 2nd part of the question is not SRO-only knowledge because the RO has to know the required tank level.

The 1st part of the question is TRM; however, the required knowledge is above-the-line.

2. Cred Dist: The 2nd part of Choices A/B (fuel level is SAT) is not plausible because the fuel oil transfer pump wont have a suction (as indicated in the stem).

Suggest writing a question that tests the applicants ability to determine the course of action when a common cause failure of the DG fuel oil transfer system renders it non-functional for both diesels, with the plant operating at 100% power.

2nd part of question modified; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 F 2 x N U T2G1 SWS G2.4.14 S 1. Cred Dist: The 1st part of Choices A/C (can be performed in any order) is not plausible because the steps are alpha-numerically identified, which implies a before b. The 1st part of the proposed test item will not provide any discriminatory value.

First part of question re-wrote; Question is SAT.

91 F 2 x x N E T2G2 DRCS G2.4.36 S 1. Partial: There may be no correct answer to the 2nd fill-in-the-blank statement based on the following PLS-SOP-001 guidance.

The stem conditions dont exactly match the context of the guidance.

The 2nd fill-in-the-blank statement does not involve a power reduction in progress.

2. Stem Focus: The stem does not provide the initial reactor power level.
3. Stem Focus: The stem should indicate which section of PLS-SOP-001 is being implemented (Attachment 4, Grey Control Rod Exchange?).

Comments incorporated; Question is SAT.

92 H 2 x x N U T2G2 PLCS A2.08 S 1. SRO-only: The 2nd part of the proposed test item is not linked to any of the 10CFR55.43(b) topics - the 2nd part of the question does not involve procedure selection.

2. Cred Dist: The 2nd part of Choices B/D (turn off makeup pumps to perform leak calc) is not plausible because pressurizer level is lowering. It is not plausible to turn off the makeup source when performing the leak calculation because this could cause pressurizer level to lower more rapidly.

Question re-written; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 H 5 x x N E/U T2G2 NIS A2.09 3 S 1. There appears to be no approved procedure for NIS. Please provide procedure for bypassing and placing PR channels in tripped condition. The stem contains phrase such as the 1030 bullet (functions associated with NE004A placed in bypass) and 2nd fill-in-the-blank statement (NE004B is required to be placed in trip). Need to see how each of these actions is described in the procedure.

2. Cred Dist: The plausibility of the 2nd part of Choices B/D (NE004B NOT required to be placed in tripped) is questionable because there is no procedure for NIS. IF there is only allowance to place ONE NI channel in bypass, THEN, the 2nd part of Choices B/D is not plausible.
3. LOD=5: Generally speaking, we always provide Tech Specs for

> 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statement applications. This is done to ensure no post-exam appeals. This question has the potential to be argued as LOD=5 w/o a reference.

4. Stem Focus: The 2nd fill-in-the-blank statement is missing the Tech Spec #/title.
5. Stem Focus: There are font size issues in the 2nd and 3rd bullets in the stem.
6. Stem Focus: Why cant the 2nd fill-in-the-blank statement be worded as At 1645:00, in accordance with Tech Spec 3.3.1, Reactor Trip Instrumentation, RXS-NE004B _____- required to be placed in the TRIPPED condition. Is there something associated with using the phrase the functions associated with.. in the statement?

Procedure exists; second part of question re-written to test knowledge of Tech Spec bases. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 94 H 2 x x N E T3 G2.1.22 S NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (use of steam tables to correlate the secondary-to-primary temperature relationship), using a contextual example (EOPs). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.

1. Cred Dist: Choice C (go to yellow path procedure) is not plausible because yellow path procedures are always optional and typically written for situations where a safeguards has occurred. If a safeguards were presumed to have occurred, then Choice B (go to E-0) is always the winner vs choosing to implement a yellow path.
2. Stem Focus: In order to protect the credibility of Choice B (safeguards has occurred while the crew was performing Step 35 of ES-0.1), re-order the stem as:

The crew is performing ES-0.1, Step 35: (picture of step and RNO)

While the crew was performing Step 35, the following conditions were noted: (the 5 bullets)

3. Suggest re-working the choices (to ensure procedure selection for SRO and to avoid using the word ONLY) as:

A. Remain in ES-0.1, do not perform SOP-ECS-001, Attachment 21 B. Exit ES-0.1 and transition to E-0 C. (Need something else plausible here)

D. Remain in ES-0.1, perform SOP-ECS-001, Attachment 21 Question replaced; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 F 2 x x M U T3 G2.1.27 S NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (PCIV Tech Spec allowance for using an in-line valve to comply), using a contextual example (VFS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.

1. Cred Dist: The 2nd part of Choices B/D (V009 breaker can remain ON) is not plausible because leaving the breaker ON can still allow someone or some malfunction to change the valve position.

Suggest re-working the question to test the same scenario, except in a situation where reliance on a check valve is / is NOT allowed to comply with TS 3.6.3.

2. Stem Focus: To ensure operational validity and compliance with policy statement regarding tracking Tech Specs during EOP implementation (ML#042960453), re-write stem such that crew originally found V010 failure while implementing the EOPs, but subsequently exited the EOPs and entered the GOI procedure, and is now in Mode 3 determining required Tech Spec actions.
3. Provide original question with the modified question.

Question replaced; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 96 F 5 x x M U T3 G2.2.2 S 1. Q=K/A: The proposed test item solely tests a Tier 2 (Plant Systems) knowledge related to the Main Steam Line Flow Path Isolation Valves (TS 3.7.2). There is no plant-wide generic concept being tested. ES-401N, Section D.2.a (page 6 of 51) says that Tier 3 should not become an extension of Tier 2.

Suggest testing some aspect of V34 Specific Management MCR Policies, NMP-OS-007-001, Conduct of Ops, NMP-OS-001, Reactivity Mgmt Program, etc. , including required approvals for deviating from these type of admin requirements, related to operating the controls, etc, during various points in time such as startup, shutdowns, normal ops, etc.

2. Minutia: The 2nd part of the question can be argued as minutia without a reference being provided.
3. Provide original question with the modified question.

Question replaced; Question is SAT.

97 H 3 x x M E T3 G2.2.26 S NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (any missed TRM surveillance requirement allowances for delaying entry to TR 3.0.3), using a contextual example (EDS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.

1. Cred Dist: Choice D is not plausible because, unlike the other choices, the stem does not include the original due date of the surveillance.
2. Stem Focus: Modify the choices to be clear, for example:

A. 14 days after 4/30/2021 B. 15 days after 4/30/2021 C. 106 days after 4/30/2021 D. 106 days after ????

3. Stem Focus: The word applicable in the 2nd bullet should be allowable.
4. Include original question that this question was modified from.

Comments incorporated; Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 98 F 2 N S T3 G2.3.9 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (SR 3.0.2),

using a contextual example (Leakage Detection Rad Monitor). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures.

99 H 1 M E/U T3 G2.4.5 2 S 1. B-GEN-PLMP-038, Emergency Notifications, was not provided in the reference material.

2. LOD=1: The 1st part of Choices A/B will not provide any discriminatory value because the title of the procedure refers to the licensee emergency organization.
3. Include original question that this question was modified from.

Question revised to include a fuel handling accident to enhance discriminatory value. Question is SAT.

100 H 2 x x x M E T3 G2.4.7 S 1. Cue: The EAL designators listed in the 2nd part of each choice are not needed to elicit the correct response.

2. Stem Focus: The 1st part of each choice (can be used vs can NOT be used) may be better as is allowed vs is NOT allowed.
3. Partial: The 2nd fill-in-the-blank statement should be worded as the highest required emergency classification is ____ .
4. Include original question that this question was modified from.

Comments incorporated; Question is SAT.

Retrieved from "https://kanterella.com/w/index.php?title=ML18032A266&oldid=2418438"