ML18032A266

05200025/2016301 Initial NRC Exam - ADAMS 2C - Public Exam Administrative Items - Delay Release 2 Yrs

ML18032A266
Person / Time
Site:	Vogtle
Issue date:	02/01/2018
From:	NRC/RGN-II/DRS/OLB
To:	Southern Nuclear Operating Co
References
Download: ML18032A266 (83)

Text

ES-401N Written Examination Review Worksheet Form ES-401N-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred.Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnlyGen 1. Received first 25 questions from the licensee on 6-10-15. Provided feedback to licensee on 6-22-15. Gen 2. We need electronic copies of the reference material listed in ES-201. The web-link you provided doesn't include all the items listed in ES-201. Gen 3. For modified bank questions, please provide copy of the original (unmodified) bank question with the supporting information. Gen 4. Provide the administrative procedure that describes the expectations/requirements for entering AOPs; AOPs list symptoms/entry conditions. 5. Received 2 nd batch of questions (Q#26 - 75) from the licensee on 9-2-15. Provided feedback on Q#s 26-42 to licensee on 9-18-15. 6. Provided feedback on Q#s 1-75 to licensee on 10-23-15. Items in yellow are either 1) previously approved test items were additional flaws were identified during the review of subsequent test items or 2) previously unresolved items.

Instructions [Refer to Section D of ES-401N and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1(easy) - 5 (difficult); (questions with a difficulty of 2 - 4 are acceptable). 3. Check the appropriate box if a psychometric flaw is identified: * "Stem Focus": The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information) * "Cues": The stems or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.). * "T/F": The answer choices are a collection of unrelated true/false statements. * "Cred. Dist": The distractors are not credible; single implausible distractors should be repaired, more than one is unaccepta ble. * "Partial": One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified: * "Job Link": The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). * "Minutia": The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). * "# / Units": The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). * "Backward": The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable) 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401N Section D.2.f. 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401N 2 Form ES-401N-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly1 F 2 x x N U S T1G1: ES-0.1, EA2.01 1. Q=K/A: This K/A may not be applicable to Vogtle 3 & 4 because the evaluation of neutron flux following a reactor trip is performed in E-0, Step 2.b, not in ES-0.1 Step 29. ES-0.1 doesn't include any evaluation of neutron flux. As currently presented, the 2 nd part of the question doesn't test beyond Tier 2 knowledge of when SR detectors auto-energize. incorporated 2. Stem Focus: The 1 st fill-in-the-blank statement uses the word "considered", which is not well defined. deleted 3. Stem Focus: The first bullet says the reactor was manually tripped spuriously? This isn't operationally valid. Accepted as-is after discussion. 4. Cred Dist: The only justification for the 1 st part of Choices C/D (lowering at (-) 1/3 dpm) was that this was a "commercially accepted method" for verifying the reactor was not critical. Is there a Vogtle 3 & 4 procedure that uses this criterion? FR-S.1 uses rod bottom lights; perhaps this is a better distracter. incorporated 5. 9-18-15: Resolved all comments; Put power above P-6, but less than P-10, and asked if ES-0.1 requires energizing. SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly2 H 2 x x x M E/U S T1G1: A-313, G2.4.4 1. Please provide governing procedure that describes the philosophy of "when" an AOP is required to be entered; AOP entry seems subjective. For example, "Hotwell Level Lowering" is also listed as a symptom/entry condition in the AOP; however, the crew wouldn't necessarily always be required to enter the AOP for this condition. Revised to test entry conditions. 2. Cue/ Cred Dist: The phrase "unexpectedly rises" in the 4 th bullet is a cue that AOP entry is required; anytime something "unexpected" occurs, AOP entry is normally justified. Consequently, the 1 st part of Choices B/D (AOP entry isn't required) is not plausible. The stem needs to provide information for the applicants' to identify (e.g, steam dump valve position, etc.) that the cool down was unexpected. Verbiage

deleted. Removing the words "unexpectedly rises" makes Choice D a correct answer; therefore, the question is somewhat subjective. Q modified to ensure only one answer. 3. Operational Validity: Cool down rates are always evaluated in any ONE HOUR; rates provided in the stem are instantaneous only. The distracter analysis for GOP limits doesn't match the GOP; GOP limits are 50

ûF in any 60 minute period (not 50

ûF/hr). Incorporated. 4. Stem Focus: The stem needs to place the event into more context, for example, 1 st bullet says that GOP-205 is in progress; 3-MSS-SOP-001, Attachment 5, Section 4.3, Establish Plant Cool down in Steam Pressure Mode, is also in progress, and may add plausibility to NOT entering the AOP. Also, 3-RCS-OTS-XX-005, RCS Heat up and Cool down Surveillance Testing, is in progress, and may add plausibility to NOT entering the AOP. Stem conditions modified. 5. Provide copy of Modified Bank Question. Not yet provided, but Q modified during review process. 6. 9-18-15: Fixed question to show an erroneous steam dump valve position. All comments resolved. SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly3 F 2 x x N E/U S T1G1: A-336 AK1.07 1. Q=K/A: The test item's link between Main and Startup FW and AOP-402 is weak since PMS Malfunction mitigative strategy applies to ALL PMS malfunctions; the K/A requires testing the applicants' knowledge of how a PM S malfunction is identified for Main & Startup FW, including how to remedy. The proposed test item is missing the malfunction identification piece as it relates to Main & Startup FW. Suggest writing a question that includes a screen shot of the PMS screen, so that the applicant has to identify that Startup FW isolation did/did not occur to better hit the K/A. Revised Q.

KA is met. 2. Cred Dist: The plausibility of Choice B (locally positioning SGS-V067A is the first option) is questionable because the fill-in-the-blank statement says "will first be closed"; local manipulation is never the first option. Q revised. 3. This question may overlap the same knowledge as Q#10. Question is sat as of 10/28/2015. 4 H 2 x N E/U S T1G1: E-1 EA1.05 1. Cred Dist: To make the 1 st part of Choices A/B (1 st stage valve positions are correct at 1001) plausible, re-work the fill-in-the blank statements and stem question as follows: WOOTF completes both statements? At 1001, both ADS First Stage valve positions _______ as expected. With the above conditions, enabling the DAS Control Panel and manually actuating ADS Stage 1 from DAS _________ send an open signal to RCS-V001B Incorporated. 2. Please provide DAS logic that supports second half of question.

Done. 3. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly5 H 2 x x N U S T1G1: A-342 AK2.02 1. Cred Dist: Choice A (raise 1C and 1D speed to 88%) is not plausible because raising speed is never required in Mode 3. OK based on GOP-303. 2. Cred Dist: Choice B (immediately restart tripped pumps) is not plausible because the reason for the spurious trip is unknown; conservative decision making eliminates this Choice. Additionally, the status of the following parameters are not provided in the stem to make Choice B plausible: CCS availability, Surge Tank level Bearing temps Stator temps Vibrations prior to trip Incorporated. 3. #/units: The UNID and label names of the safety related breakers and non-safety related breakers is missing from Choices C/D. For example, the non-safety related breakers are the VFD Switchgear Breakers.

Q revised. 4. 9-18-15: Kept safety/non-safety, but eliminated redundant information. SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly6 H 3 x x B E/U S T1G1: A-337 AK3.01 Note to NRC Reviewers: The "reason" for determining CMT valves' status is that CVS makeup flow cannot be reduced if CMT valves are open; thus the K/A portion related to the "reason" is indirectly being met. 1. Cred Dist: The 1 st part of Choices A/B (return makeup to normal) is not plausible because Pzr Level is too low. Suggest modifying Pzr level value in the stem to remedy. Q revised. 2. Stem Focus: The stem is missing power level and/or unit status. Power added. 3. Stem Focus: Suggest swapping the order of the fill-in-the-blank statements so that the first fill-in-the-blank statement is related to Identified vs Pressure Boundary Leakage. Incorporated. 4. Need to verify that AOP-109 preceding steps have CVS makeup flow already aligned to max rate; otherwise re-word the 1 st fill-in-the-blank statement as CVS makeup flow _________ (is / is NOT) required to be returned to normal. Reviewed - OK. 5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly7 H 1 x x N U S T1G1: A-343 AA2.03 1. Job-Link: The procedure for Mode 5 isn't AOP-115; it's 3-EOP-SDP-2, Response to Loss of RNS During Shutdown. Is the crew allowed to be in AOP-115 in Mode 5? 2. Cue and/or LOD=1: The test item does not test the applicants' ability to evaluate CCS flow. Instead, the stem tells the applicant that RNS Hx A Flow (CCS-FT-301) is zero, which cues the applicant to CCS-V301A is required to be opened. As written, this is LOD=1 because a pump tripped, and, in order to re-establish cooling, another pump should be started and cooling water aligned to the heat exchanger. 3. Cred Dist: The 1 st part of Choices C/D (crew NOT required to start RNS Pump A) is not plausible because there is no auto-start feature on decay heat removal, since this adds positive reactivity. 4. Cred Dist: Choice C is not plausible because of the interplay between the 1 st and 2 nd parts of this choice. IF the plausibility of the 1 st part is that the pump auto-started, THEN V301A would either auto-align or already be aligned open. 5. Partial: The stem does not include the status of the cavity; flooded cavity does not have any requirements for re-establishing cooling. Suggest incorporating the following element to hit the K/A: In accordance with Step 13 (Align CCS for RNS Cooling), the operator is required to Check RNS HX CCS Flow (CCS-FT-301/302) greater than _______. (2800 gpm)

6. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly8 F 2 x x x x N E S T1G1: ES-0.2 EK3.18 1. Partial: Because RCS Void Growth is a concern in ES-0.2, re-word the 1 st fill-in-the-blank statement to ensure Choice C is incorrect: In accordance with3-EOP-ES-0.2-B, Background Information for 3-EOP-ES-0.2, the reason RCS pressure is required to be maintained at its present value at Step 44 is to ______.

Q modified. 2. Stem Focus: the last portions of each Choice are not necessary. For example: A. allow placing RNS in service for shutdown cooling B. prevent RCS void formation and subsequent CMT injection Q modified. 3. Stem Focus: The 2 nd bullet is confusing and not an operationally valid way of presenting the information; suggest providing hottest un-isolated CMT temperature.

Q modified.

4. 9-18-15: Re-wrote question; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly9 H 2 x N E S T1G1: FR-S.1 EK1.05 1. Cred Dist: Choice D (RCPs not running; V108A closed) is not plausible because IF RCPs are off (due to CMT actuation), THEN the PRHR Hx is always open. Q revised. 2. Stem Focus: Add "Reactor Power is 100%" to the stem initial conditions. Incorporated. Alternate Suggestion (just one option): One of the relationships between FR-S.1 and the Safeguards System is this: At Step 8 of FR-S.1, IF Safeguards has actuated, the crew is required to EXIT FR-S.1 because all of the necessary boration (CMT) and auto-isolations (FW, Dilution Paths,Cnmt Air Filtration) are already sufficient to mitigate the ATWS; no other FR-S.1 actions are necessary. Therefore, if Lo Tcold (Safeguards Actuation) value was provided in the stem, then the applicant could decide whether to continue in FR-S.1 or to exit FR-S.1. 3. 9-18-15: Replaced 2 nd fill-in-the-blank statement. Reworked to ensure not SRO-only. SAT Question is sat as of 9/18/2015. 10 H 3 N ?

S T1G1: E-3 EK2.05 1. Why does the 2 nd fill-in-the-blank statement list time at 10:25?

What's the significance of five minutes after the Safeguards Signal? Ensures out of gray area for valve stroking. 2. It is operationally valid that RCS pressure rises to 1982 psig during max cooldown evolution IF small tube leak with auxiliary spray failure. Yes. 3. 9-18-15: This question may overlap with RO Q#3. Overlap evaluated as OK. Question is sat as of 11/05/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly11 H 2 x x x N E S T1G1: E-2 G2.2.30 1. Partial and/or Cred Dist: The stem doesn't specify the size of the steam leak (steam flow values, etc.); does "swell" occur when a large MSL break occurs? If so, then Choice C is also correct. Not at 1001:00 - OK. 2. Partial: Choice B is also correct because the wording of E-2, Step 7 is "trending to 58.5%...go to E-1." Review this procedure step basis again. (Procedure may need revision to use the word "controlled.") Q modified. 3. Partial: The time 10:01 is not the same as "initially." The times provided to the applicants in the stem need to also include the seconds values to ensure no one interprets this question to mean one second later. By providing the seconds values, we ensure that the applicants understand sixty seconds has elapsed. The word "initially" should be eliminated. Seconds added. 4. Stem Focus: Provide normal secondary radiation values in the stem. Q modified. 5. 9-18-15: Reworded to test how MSIV Bypass failure affected subsequent plant operations; SAT Question is sat as of 9/18/2015. 12 H 2 x B U S T1G1: A-301 AK3.04 1. Q=K/A: The 2 nd part of the question is the part that targets the K/A; however, because of the 2 nd fill-in-the-blank wording, the only thing being tested is that Xenon is building in, which requires positive reactivity insertio

n. This is the plant specific portion of the written exam; therefore, some plant specific information to hit the K/A must be tested.

Suggest changing the 2 nd fill-in-the-blank statement to test the reason for why Rod Control is placed in the Low Power Mode, for example: The reason why rods are placed in the Low Power Control Mode is / is NOT to maintain power constant. Second half replaced.

2. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly13 H 2 x x N U S T1G1: A-307 AA1.01 1. Partial: IF the CETs are lowering, THEN there may be no correct answer. CETs lowering means that some form of cooling is established. Why would you continue to blow squib valves if CETs are lowering? Why go to the RNO? Another way to think about this is IF the local DAS switch attempt was NOT successful (and CETs were still lowering) wouldn't the operator STILL be required to use the blasting device cables/crank handle method of actuating IRWST since the normal method of firing the squib valves failed? It looks like the intent of RNO Step 9.f is to use an alternate method to blow the squib valves. The previous method of using the local DAS switches means that the squib valves must be blown. IF you get to RNO Step 9.f, aren't the squib valves still required to be blown when the CETs are lowering? Second half replaced. 2. Cred Dist: The 1 st part of Choices B/D (IRWST actuation NOT required) is not plausible because the wording of AOP-602, Step 9 is provided in the stem. Q modified. 3. 9-18-15: Changed question to test whether IRWST/Stage 4 actuations is/is not required; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly14 F 2 x x x N U S T1G1: FR-C.1 EK2.11 1. Job-Link and/or Q=K/A: There may be an issue with the K/A Catalog for this K/A because the implementing procedure for aligning RNS to the CLP is 3-EOP-ES-1.4, Stage 4 Actuation Response, Step 20. Instead, the K/A catalog links FR-C.1 to aligning RNS to the CLP. Nevertheless, the K/A requires testing the operational implication or cause effect relationship of reaching the CLP low level.

Is the K/A Catalog implying that the PACE of getting thru C.1, and then transitioning to ES-1.4, is important to conserve IRWST inventory? We need to discuss whether there are any other points in the EOPs (other than ES-1.4) that direct RNS alignment to the CLP. The only place that has the CLP low level (15%) termination criteria appears to be ES-1.4. KA met. 2. Cred Dist: The 1 st part of Choices A/B (CVS can inject from the Cask Loading Pit) is not plausible because these pumps don't have a suction from the Cask Loading Pit. Q modified. 3. Cred Dist: The 2 nd part of Choices B/D (trying to conserve accumulator inventory after ADS Stages 1-3 have actuated and a DVI line break) is not plausible because the RCS is already depressurizing and accumulators will have already released their contents when RCS pressure lowered; therefore, there is no reason to conserve accumulator inventory. Q modified. 4. 9-18-15: Future Memo to APOG that K/A Catalog needs revising, changed K/A number and kept topic; got rid of accumulator and changed to SFP cooling pump; SAT Question is sat as of 9/18/2015. 15 N S T1G1: A-323 AA2.04

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly16 H 3 x x N E/U S T1G1: ES-1.1 G2.4.39 1. Q=K/A: IF the annunciator was associated with an actual CVS isolation signal, THEN the K/A match would be unquestionable. However, in the proposed test item, the Letdown Hx Outlet Temp Hi annunciator isn't applicab le to evaluating ES-1.1, Step 3.d (RNO) because high temp doesn't ever auto-isolate letdown. Please provide justification as to how this annunciator being in alarm aids the operator when performing ES-1.1, Step 3.d. We may need to replace the generic portion of this K/A because the link between annunciator response procedures and ES-1.1 is may not be possible. Q modified. 2. Cred Dist: The 1 st part of the proposed test is not plausible because Letdown Hx Outlet Temp Hi never causes an automatic letdown isolation. Suggest changing the annunciator to an annunciator that is associated with a CVS isolation. Q modified. 9-18-15: Moved in accordance with ES-1.1 to only the 2 nd fill-in-the-blank; SAT Question is sat as of 9/18/2015. 17 H 3 x N E S T1G1: SDP-1 EK1.02 1. Stem Focus: Revise the 7 th bullet to delete the words "has been"; change to "is." Incorporated. 2. Stem Focus: Add the word "slowly" at the end. Incorporated.

3. Stem Focus: The term "MODE 6" can be deleted since the 2 nd bullet already says the vessel head is NOT on the flange. Deleted flange piece instead. 4. Stem Focus: Swap the order of the 5 th and 6 th bullets to chronologically flow better. Incorporated. 5. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly18 H 2 x x N U S T1G1: SDP-2 EA1.03 1. Cred Dist: The 1 st part of Choices C/D (CVS won't be used) is not plausible because of the wording of the 1 st fill-in-the-blank statement. In other words, the stem tells the applicant (at 1030) that Step 36 (Refill RCS Using CVS Makeup) is required. Therefore, the correct choice can only be that CVS will be used, even if only one pump is available. Suggest using the word "sufficient" in the 1 st fill-in-the-blank statement to remedy. Changed Step. 2. Stem Focus: Add a reason to the 1 st bullet (why are we draining the RCS? Is there fuel in the vessel?) in the stem to add context to the question. Added. 3. LOK: It seems that this may be more than Fundamental (as marked on the distracter analysis

consider changing to Higher Level. OK 4. 9-18-15

Comments incorporated; higher cog question; SAT Question is sat as of 9/18/2015. 19 F 1 x x N U S T1G2: A-320 AK3.07 1. Cred Dist and/or LOD=1: Based on the information in the stem, none of the distracters are plausible, that is, since TCS/GCS/turbine temperatures/vibrations, etc., are not provided in the stem, Choices A, B, and D are not plausible. Q replaced. 2. Partial: To ensure Choice C is absolutely correct, include the title of the basis document in the stem question instead of only including AOP-203. Q replaced. Suggest testing the REASON fo r reducing turbine load in accordance with Step RNO 3.b, which is to maintain vacuum less than 7 " hg (vs 9" hg). Be careful to script the question such that it asks for the way the procedure is worded, to avoid a subset issue. Q replaced. Alternatively, there may be no way to write a discriminating question at the RO level and the K/A may need to be replaced. 3. 9-18-15: Kept K/A but wrote question to test whether reducing load/turbine trip was was not required; the "reason" is thereby being indirectly tested; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly20 H 2 N U S T1G2: A-314 AK3.02 1. Cred Dist: The 2 nd part of Choices A/C (SFS pumps is reason to check PZR level > 19.5%) is not plausible because the Step asked for PZR level (not SFP level). OK Do SFS pumps lose suction for a given PZR level? Or is PZR level off-scale low when SFS pumps lose suction? 2. 9-18-15: Licensee explained how reason was to ensure level above flange; SAT Question is sat as of 9/18/2015. 21 H 1 N U S T1G2: SDP-4 EA2.03 1. Cred Dist and/or LOD=1: The stem needs to include PZR Level below the auto-makeup set point to add plausibility to the 1 st part of Choices A/B (No Makeup Flow at 1000). As written, this is not plausible (LOD=1) because the stem says Borating the RCS wasn't started until 1005. Added. 2. Cred Dist and/or LOD=1: The stem needs to include some item that can be misconstrued as why the CVS Manual Makeup Isol and Boron Dilution Block signals are unable to be reset to add plausibility to the 2 nd part of Choices B/D (No Makeup Flow at 1005). As written, this is not plausible (LOD=1) because the stem says Borating the RCS began at 1005; therefore, there has to be makeup flow. Q modified. 3. #/units: The 1 st bullet should be replaced with the actual name of the annunciator. Incorporated. 4. 9-18-15: One of the licensee's boration methods (CMT) does not indicate makeup flow; Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly22 F 2 x x x N U S T1G2: SDP-6 EK2.04 1. Cred Dist: Choices C/D are not plausible because they're too large; the values in these choices represents a HUGE heat up. Incorporated. 2. Partial: To avoid partially correct answers, provide times down to the second values (put zero seconds on all times) to ensure "RCS temperature remained within +/- 5

ûF band in the last 10 minutes.." can't be used to make an post exam appeal. Incorporated. 3. Stem Focus: Need to add the initial RCS temperature to the Given Conditions bullet. Incorporated. 4. 9-18-15: Licensee changed temperatures; comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly23 F 3 x x x x N U S T1G2: A-306 G2.4.4 1. Q=K/A: This question does not test the applicants' ability to recognize abnormal SYSTEM operating parameters that require entry to AOP-601, or any other AOP. One opportunity to test this K/A, for example, is the radiation limit/value that requires entry to AOP-601 from AOP-905. If site-specific rad value is not available at this time, are there ways to test the Alert light, Hi alarm light, etc. without testing the site specific rad-value. We need to explore ways to hit this K/A, because we may not be able to repl ace the K/A if the reason is solely due to plant reference materials not being ready. Q

replaced. 2. Cred Dist: The 1 st part of Choices A/B (crew will stay in the main control room and continue with ES-0.1) is not plausible because the stem says the control room must be evacuated. Q

replaced. 3. Minutia: The 2 nd part of the question may be minutia because knowing the number of switches is not operationally valid.

Please provide reason why knowing the number of switches is operationally valid. One option is to test the applicants' knowledge of whether OCS-JW-001 (MCR/RSW Xfer Switch Panel) has to be placed in the Di sable position. Another option is to test the location of JW-001. Q replaced. 4. Partial and/or Stem Focus: To ensure everyone is clear that the 2 nd fill-in-the-blank statement is NOT referring to Main Control Room switches, re-word the 2 nd fill-in-the-blank statement as: Step 3, "Evacuate to RSR" requires a minimum of ______ transfer switches to be manipulated in Room 12S05 before plant control can be established from the Remote Workstation.

Q replaced. 5. 9-18-15: Re-worked to test AOP-601, Step 7, which has transition to E-0 for loss of MFPs; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly24 H 3 x x x N E/U S T1G2: A-318 AA1.09 1. Cred Dist: The plausibility of the 1 st part of Choices A/B (9.3 gpm) is borderline because the stem doesn't include anything that could be misconstrued as a high rad condition such as the 10 o'clock BDS-RE011 (EDI Reject Rad) or BDS-RE010 (EDI Product Rad) normal values. Incorporated. 2. Partial: The 1 st fill-in-the-blank statement does not match 3-BDS-SOP-001, Attachment 10, Step 13; the fill-in-the-blank statement isn't specific that 140 gpm is the max flow per heat exchanger. Suggest matching the words to the procedure to avoid partially/no correct answers. Incorporated. 3. Stem Focus: The 2 nd bullet does not provide the procedure being implemented, which is 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS. Incorporated. 4. Stem Focus: The order of the 3 rd and 4 th bullets should be swapped to chronologically flow. Incorporated. Suggest the following: Given: At time 1000 100 % power 3-BDS-SOP-001, SGBD System, Attachment 10, Upset Chemistry Recovery Mode Using BDS, is in progress BDS-RE011 (EDI Reject Rad) is xxxx BDS-RE010 (EDI Product Rad) is xxx At time 1020 SG BD HX A Outlet Temp (CDS-TE040A) is alarming at 420°F AOP-202 (Condensate System Malfunctions) is entered WOOTF completes both statements? At 1000, the maximum allowable BDS flow rate through each heat exchanger is limited to _______ gpm. At 1021, in accordance with AOP-202, blowdown from BOTH Steam Generators ________ required to be isolated.

Incorporated. 9-18-15: Comments incorporated; SAT Question is sat as of 9/18/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly25 H 2 x x N U S T1G2: FR-C.3 EK1.08 1. Q=K/A: The question does not test the applicants' knowledge of the relationship between the FR-C.3 procedure and the RCS; the 1 st part of the question only requires GFES knowledge of the steam tables and the 2 nd part of the question does not require any knowledge of FR-C.3. Suggest testing the applicants' knowledge of the F-0 CET temperature threshold value that requires entry to FR-C.3, or some other RCS aspect of FR-C.3. Q replaced. 2. Cred Dist: The 2 nd part of Choices B/D (CMT temperature already stable two minutes after PXS-V014A/B & PXS-V015A/B are opened) is not plausible because only two minutes has elapsed. How long do CMTs inject cold water? Q replaced. 3. 9-18-15: Licensee presented new question; SAT Question is sat as of 9/18/2015. 26 H 2 x N U S T1G2: FR-Z.4 EK2.01 1. Q=K/A: The question does not test the applicants' knowledge of the relationship between containment integrity and the Z.4 procedure; the proposed question only tests the Tier 2 aspect of how the vacuum relief auto-actuates and the LCO requirement.

Suggest making the 2 nd fill-in-the-blank statement the first, and then test the applicants' knowledge of WHEN Z.4 requires the operators to reset containment vacuum relief and close VFS-V800A/B (that is, when containment pressure is less negative than -0.2 psig).

Q acceptable. 2. Stem Focus: Space needed between 0.4 and psig in the last bullet. 3. Move "At 1005:00 to the stem question since it's in both fill-in-the-blank statements. 4. Note: Because of the limited content in Z.4, this question is being accepted to meet Tier 1. Question is sat as of 10/28/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 27 H 2 x x x x N E S T1G2: A331 AA1.02 1. Cue: The 2 nd bullet tells the applicants that the static transfer switch auto-aligned to its backup AC power source; this description of the auto-alignment is not necessary to elicit the correct response because it is a direct result of the fault/alarm on IDSA-DS-1. 2. #/units and/or Cue: The name of t he alarm is missing in the first bullet; if the alarm provides an auto-swap signal to the static transfer switch, then the phrase "..due to a fault on IDSA-DS-1" is not necessary to elicit the correct response. 3. Stem Focus: The 4 th bullet (AOP-303 is entered) is not necessary. 4. Q=K/A: The modified test item does not meet the Tier 1 aspect.Comments incorporated and 2 nd part of question re-written to test panels; Question is SAT. 28 H 2 x x M E S T2G1: RCS A2.31 1. Partial: Choice C may also be correct because there is no other reason why containment sump level is rising other than a stuck open RCDT relief valve. Why is containment sump level rising?

Q modified. 2. Cred Dist: The distracter analysis said that 2 nd part of Choices B/D (AOP-112 doesn't provide guidance on isolating..) was plausible because the AOP only pr ovides guidance for isolating the INNER seal. Therefore, the 2 nd fill-in-the-blank statement should include the word "INNER" between the words "vessel" and "flange." Q modified. 3. Cred Dist: The fact that RCDT pressure is rising means there is no way the relief valve can be lifted. Suggest deleting the phrase "and rising." Question is sat as of 10/28/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 29 H 1 x x N U S T2G1: SGS A1.05 1. Cred Dist and/or LOD=1: The 1 st part of Choices A/B (Tavg goes up when SG PORV opens) is not plausible because this cools the primary. Q modified. 2. Cred Dist and/or LOD=1: The 2 nd part of Choices B/D (Power goes down when SG PORV opens) is not plausible because this cools the primary. Q modified. 3. Q=K/A: The proposed test item tests GFES knowledge only; this is the site specific portion of the written exam. Q modified. Instead of testing what Tavg does, suggest testing something that happens as a result of Tavg changing. Q modified. Question is sat as of 9/18/2015. 30 F 2 x x N E S T2G1: SGS K2.04 1. Cue: The 1 st fill-in-the-blank statement contains two 1's; the correct answer contains a "1." Suggest changing the 1 st part of Choices C/D to another bus that has a "1" in it. Discussed - OK.2. Stem Focus: Reword the 2 nd fill-in-the-blank statement to be more precise as: IF power is lost to BOTH MSIV A hydraulic pumps, THEN SGS-V040A ___(2)___ immediately close. Incorporated.

3. Cred Dist: The 2 nd part of Choices A/C (closes immediately) is not plausible because of the word "immediately." Modified Q. 4. Distracter Analysis wasn't updated after changing Choices C/D to 1DSA-EA-1. Noted. Question is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly31 H 2 x x N E/U S T2G1: RNS K3.01 1. Partial: When the HX BYPASS valve fails open, what will the HX INLET temperature do at RNS-TE-013A location? IF the temperature at this point rises, then RNS-V006A will open up more, which will make another choice correct. Q asked at a point in time. 2. Cred Dist: The 2 nd part of Choices A/C (Disch to CVS valve stays open even if letdown temperature rises to 141

ûF) is not plausible because resin must always be protected from temperatures near 140

ûF. Temp lowered. 3. Suggest revising the question such that the 3 rd bullet doesn't TELL the applicants which way the valve failed; instead, say that the air supply to the valve has failed. This increases discriminatory value. Incorporated. Question is sat as of 10/28/2015 32 H 2 x N E/U S T2G1: PRHR A1.01 1. Cred Dist: The 1 st part of Choices C/D (PRHR Hx Press remains the same) is not plausible because the HX conditions have changed; therefore, the pressure has to change, even if minutely. Distracter Analysis points: The possibility of PZR Pressure Control keeping the pressure constant, and the possibility of the applicants' misconception of inlet valve position keeping the pressure constant are eclipsed by the fact that the PRHR Hx conditions will change, even if minutely. 2. Cred Dist: The inter-play between the two parts of Choice C make it not plausible. If a Safeguards Actuation has occurred, then PRHR Hx pressure hasn't remained the same. 3. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice C don't make sense; IF PRHR Hx pressure is going UP, then NOT having a safeguards signal (Tcold) is not plausible. Revised question to ask about PXS-V101 and pressure change with isolating a leaking PRHR Hx; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly33 H 2 x x N U S T2G1: PXS A4.16 1. Cred Dist: The 1 st part of Choices C/D (trip bkrs remain closed) is not plausible because a CMT actuation is a direct reactor trip. Timing adds to plausibility. 2. Cred Dist: The 2 nd part of Choices A/C (steam injection) is not plausible because the stem does not include anything that could be misconstrued as a LOCA. Q modified. 3. Stem Focus: The 2 nd bullet is a sentence fragment. Corrected. 4. Cred Dist: The 1 st part of Choices C/D is not plausible because a CMT actuation always eventually causes a reactor trip (ATL discussion was that DAS CMT won't cause direct reactor trip). The CMT actuation will cause RCPs to trip (for example), which will cause a reactor trip. Timing adds to plausibility. 5. Cred Dist: The 2 nd part of Choices A/C (CMT level lowering) is not plausible because there is not anything in the stem that could be misconstrued as a LOCA (ATL discussion was that WR level "fluctuated" anytime CMT actuated). Credibility based on PRHR actuation and RCS shrink. Question is sat as of 11/05/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 34 H 2 x x N E/U S T2G1: PXS G2.4.27 1. Q=K/A: The proposed test item tests the applicants' knowledge of AOP-109 and the status of PXS-V101 breaker; the test item is not testing the applicants' knowledge of an NLO task. Let's discuss whether changing the K/A is necessary. 2. The second fill-in-the-blank statement seems unrelated to the PRHR Hx tube leak event; why is pressurizer level rising? The second part of the question should be related to the topic. 3. Stem Focus: The 2 nd fill-in-the-blank statement is missing the word "auto", that is, -"received an auto-open signal." 4. Stem Focus: The 1 st fill-in-the-blank statement should be worded as "At 1000:00, an operator _____(1)___ required to be locally dispatched to assist the MCR with isolating the PRHR Hx." 5. Cred Dist: The 1 st part of Choices C/D (breaker is OPENED) is not plausible because at 1000:00 no isolation has occurred.

Suggest changing the 1 st fill-in-the-blank to "at 1020:00 the PRHR Hx Inlet MOV breaker is ____ ." This tests the local operator aspect of the K/A. 6. Stem Focus: Need to include "in accordance with procedure XYZ" in the stem question. Re-wrote question to test location of breaker for PXS-V027A; comments incorporated. Question is SAT. 35 H 2 x x N U S T2G1: CCS G2.4.4 1. Cred Dist: The 2 nd part of Choices A/C (rising tank level auto-trips CCS pumps) is not plausible because a high tank level means more NPSH, which never auto-trips pumps. Q modified.2. Cue: Instead of telling the applicants that a high-2 bearing temperature occurred, provide them with the bearing water temperatures and test their knowledge of whether the RCPs tripped. Incorporated. Question is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly36 F 1 x x N U S T2G1: PPCS A3.01 1. Cred Dist and/or LOD=1: The 1 st part of Choices C/D (spray valve s not open as pressure is rising) is not plausible because the 2 nd bullet says that pressure is rising slowly; therefore, the only possible mitigating response is spray valves open. Q modified. 2. Cue: The 2 nd fill-in-the-blank statement cues the applicant that the spray valves should be open for the answer to the 1 st fill-in-the-blank statement; the 2 nd fill-in-the-blank statement contains the phrase "..as RCS pressure lowers..", which is an expected mitigation to the rising RCS pressure. Q modified. Question is sat as of 11/05/2015 37 F 2 x x x N E/U S T2G1: ADS G2.1.21 1. Q=K/A: The proposed test item tests the applicants' knowledge of how ADS MOV RCS-V001A is operated, whereas the K/A requires testing the applicants' knowledge of the normal operating procedure for the ADS system. The information in the stem is what should be tested to fulfill the K/A. For example, suggest re-working the question to ask the applicant which procedure involves opening and closing the ADS valves. (Answer is RCS Fill, RCS-SOP-001, Attachment 1). Alternatively, re-work the question to test the applicants' knowledge of which ADS Train Valves are used in the RCS Fill procedure. 2. Cred Dist: Choice C (DAS) is not plausible because the DAS system is only used when normal methods are broken; there is nothing in the stem that could be misconstrued as something is broken. 3. Stem Focus: (typo) The 2 nd bullet is not the same as the procedure Step 4.6.e. The procedure step should be worded as "Close Train B Stage 1, 2, and 3, ADS Valves by performing the following" Modified question to require knowledge of RCS-SOP-001; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly38 H 3 x N U S T2G1: RTS K3.06 1. Cred Dist: Choices A/B are not plausible because at these times the reactor is still not tripped; operational validity of trying to block Safeguards during an ATWS makes these choices not plausible (even though intent of the question was to purely test the logic from a Tier 2 perspective). Q modified to address trip status. Q is sat as of 10/28/2015. 39 5 2 x x x M E/U S T2G1: RTS K5.03 1. Job-Link: The 2 nd part of the question tests information located in the background document for FR-S.1. Generally, overall mitigative strategy is RO knowledge; however, in this question, the knowledge being tested is beyond mitigative strategy. The knowledge being tested is t he limiting design basis ATWS event. Q modified. 2. Cred Dist: Given the picture in the stem, the 1 st part Choices A/B (turbine is tripped) is not plausible because the alpha steam line is blue for stop/control valves. Q modified. 3. Partial: Choice C is also correct because the 2 nd fill-in-the-blank statement is too generic. A turbine trip is required during an ATWS with a steam leak also. (feedwater leak will make steam as it leaks). Suggest changing the 2 nd part of A/C to main steam line leak. Q modified. Q is sat as of 11/05/2015 40 F 2 B S T2G1: ESAS A3.13 41 H 2 N S T2G1: ESAS K6.13

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly42 H 2 x x x M E S T2G1: DAS A2.02 1. Stem Focus: The last portion of the 2 nd bullet ("-due to low SG Water Level") is not necessary. Incorporated. 2. Cue: The first portion of the 3 rd bullet is not necessary; reword 3 rd bullet as "The reactor trip breakers are not open." Incorporated. 3. Stem Focus: Add "at 1000:00" in the 1 st fill-in-the-blank. Incorporated. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly43 F 2 x N E S T2G1: PCS A4.01 1. Ensure manual actuation of PCCS is not required in any scenarios to preclude written/operating exam overlap. Noted. 2. For the 1 st part of the question, what procedure directs the operator to operate both switches? (I could not find anything in NMP-OS-007-01.) Why does the Conduct of Ops procedure require the operator to turn both switches even though the first switch actuates the PCCS?

Revise the first fill-in-the-blank statement to:

"In order to manually actuate PCS at the PDSP, the minimum required operator action to satisfy the logic is to turn _____ .

(will there be two correct answers?) Q modified to test circuit logic specifically. 3. Stem focus: Re-word the 2 nd fill-in-the-blank statement to: In order to generate a DAS PCS Actuation signal, the operator is required to turn ______ handswitch(es) at the DAS Control Panel. [ONLY one] Q modified to test circuit logic specifically. 4. #/units: The actual switch names/numbers should be included. Switches are inherent with PCS Actuation. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly44 H 2 x x x B U S T2G1: MSS K1.04 1. Cred Dist: The 1 st part of Choices A/B (MSS-V020 remains open) is not plausible because the stem says that SG pressure is lowering rapidly. One isolation signal is 560 psig. If the SG pressure is currently 602 psig, and lowering RAPIDLY, then it's not plausible that MSS-V020 remains open at 1002:00. Q modified. 2. Cue: The phrase "lowering rapidly" is too strong of a cue. Q modified. 3. Why is the Stage 2 steam dump valve used in the 2 nd fill-in-the-blank statement instead of the Stage 1 steam dump valve (MSS-V005)? It is a cooldown valve. 4. Stem Focus: What procedure is being used to block MSL/FW Isol & Safeguards, and enable Stage 1 & 2 steam dumps? Put name/number of the governing procedure in the stem. GOP-

205. Q is sat as of 10/28/2015 45 H 2 x x x N U S T2G1: FWS A2.33 1. Backwards: In the context of the question, the 2 nd fill-in-the-blank is not operationally valid because there IS actually a feed pump running. The phrase "If no feed water pumps are running.." will cause confusion with the applicants because it's not true. 2. Partial: Choice B is also correct because the alarm may not be clear if the alarm doesn't automatically clear (without operator action). 3. Cred Dist: The 2 nd part of Choices A/C (actuate PRHR) is not plausible because you always try to start a feedwater pump FIRST. 4. Stem Focus: The last word in the 1 st fill-in-the-blank statement is a preposition; suggest re-wording as: At 1006:00, SFW Pump A Disch Flow (FWS-FT-015A) Low Flow ______ alarming. Revised question; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly46 H 2 x x N E S T2G1: FWS A4.06 1. This question overlaps the same exact knowledge as RO Q#3; SGS-V255A auto-closes on Tcold = 505

ûF. O/L evaluated as OK. 2. Stem Focus: It may not be operationally valid to assume the drop in temperature is linear; better to add another point in time to the stem with a temperature at that time. Timeline added. 3. Partial: Is there any mathematical way that Choice B is also correct? At 1027:00, Tavg is 523 F, what's Tcold. Q modified. 4. Partial: Insert the word "automatically" before the word closed in the fill-in-the-blank statement. Incorporated. 5. Partial: Re-word the fill-in-the-blank statement as: "Of the following times listed below, the earliest time-." Incorporated. 6. Suggest replacing question due to conflict with Q#3. O/L evaluated as OK. Q is sat as of 10/28/2015 47 H 2 x x N U S T2G1: ECS A3.01 1. Cred Dist: The 1 st part of Choices C/D (ES-1 powered from RAT) is not plausible because the picture in the stem says the automatic bus transfer control is disabled. 2. Cred Dist: The 2 nd part of Choices A/C (ES-2 powered from diesels) is not plausible because the picture in the stem says that the automatic bus transfer control is enabled. 3. Cue: The 2 nd bullet is not necessary to elicit the correct response. Removed picture and replaced 2 nd part of question; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly 48 F 2 x x x N U S T2G1: IDS K6.02 Note: LCO 3.8.1 states The Division A, B, C, and D Class 1E DC power subsystems shall be OPERABLE in Modes 1, 2, 3, & 4. 1. Cred Dist: The 1 st part of Choices A/B (LCO is met with Battery Charger broke) is not plausible because the stem says the battery charger has failed and at time 1000:00 no replacement charger has been connected. 2. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice B make it not plausible. 3. Stem Focus: The Plant status is missing from the stem. 4. #/units: The name of 1DSB-DC-1 is missing from the stem (24 Hour Battery Charger).

Revised 1 st part of question; comments incorporated. Question is SAT. 49 H x N U S T2G1: ZOS K1.02 1. Cred Dist: The 1 st part of Choices A/B is not plausible because offsite is still available. Q modified to low power. 2. Cred Dist: The 2 nd part of Choices B/D (Diesel still not powering bus) is not plausible because the stem says that a LOOP occurred at 10:30 and there is nothing in the stem that could be misconstrued as a "new" fault on ECS-ES-2 that occurred after 10:00. Q modified. 3. LOK: The distracter analysis indicated that this test item was a fundamental (lower) cog item; however, it appears it may be a higher cog question. Let's discuss. Q modified. Q is sat as of 10/28/2015 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly50 F 2 x M S T2G1: SWS K4.06 1. Cred Dist: The 1 st part of Choices A/B (Fire water is the normal supply to towers) is not plausible because fire protection water is never the normal supply to anything except fire protection.

Suggest revising the question to test the applicants' knowledge of the alternate source of cooling tower makeup. Alternatively, change the 1 st part of the question to test cooling tower makeup is / is not normally provided from RWS. Incorporated. 2. Cred Dist: The 2 nd part of Choices A/C (normal control method is manual) is not plausible because normally all control methods are AUTOMATIC, which is the correct answer. Q modified. 3. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice B make it not plausible; unless a fire pump is ALWAYS running (unlikely), then automatic level control doesn't make sense. Q modified. Q is sat as of 10/28/2015. 51 F 2 x x x N E/U S T2G1: CAS A1.03 1. Cue: The 2 nd bullet is not necessary to elicit the correct response. The applicants should know that at 100% power, one instrument air package is always selected as the Lead compressor. Incorporated. 2. Minutia: The 2 nd portion of the question is testing trivial information because the choices are too close together. Q modified. 3. Cred Dist: The plausibility justification of the 2 nd part of Choices A/C is suspect. Q modified. 4. Cue: The 1 st part of the Choices in this question cues the answer to the 1 st part of RO Q#52. Q 52 modified. Q is sat as of 10/28/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly52 H 2 x x M U S T2G1: CAS K3.17 1. Partial: There is no absolutely correct answer to the 1 st fill-in-the-blank statement because the SSD never said that PXS air operated valves WILL begin to reposition; the SSD basically says that the air operated valves are reliable down to a pressure of 50 psig. Q modified. 2. Cred Dist: The 2 nd part of Choices A/C (reactor still critical) is not plausible because a manual scram would already be performed since safety related valves (PXS) are repositioning everywhere. Q modified. 3. Cred Dist: Normal air pressure is 115 psig; the plausibility of the 1 st part of Choices C/D (100 psig) is borderline because 100 psig is the alarm set point and air operated components shouldn't be designed to begin reposit ioning at this high of air pressure. Q modified. IA P of 80 psig means that it could be as low as 50 psig at the components considering line losses. 4. What is the significance of the phrase "10 seconds after ALL PXS valves reposition" in the 2 nd fill-in-the-blank statement? Q modified. Q sat as of 10/28/2015.

53 F 2 x x N U S T2G1: CNS K4.07 1. Cred Dist: The 2 nd part of Choices A/C (electrical interlock on containment doors) is not plausible because this type of interlock does not exist. 2. Cred Dist: The 2 nd part of Choices A/B (something was already overridden) is not plausible bec ause the stem does not contain any information that can be misconstrued to imply anything was previously overridden. 3. Stem Focus: The phrase "..without entering an additional Tech Spec CONDITION.." is cryptic and vague. The initial conditions should include the required Tech Spec 3.6 Condition for the broken outer door (as 4 th bullet). 4. Stem Focus: The 3 rd bullet is not necessary? Revised question to test whether 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action is/is NOT required and knowledge of mechanical interlock design.

Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly54 F 2 x x N E/U S T2G1: RCP K5.02 1. Cred Dist: Change RCP 1A speed to 88% to make Choices A/B plausible. 88% is the max allowed speed when < 520

ûF. Incorporated. The distracter analysis may be a cut-and-paste error; it refers to Loop 2 and PRHR Hx even though these items don't apply.

Let's discuss. OK Q sat as of 10/28/2015. 55 F 2 B S T2G1: CVS K2.04 56 H 2 x M E/U S T2G2: DRCS A2.19 1. Bank demand position failing to 0 steps may not be operationally valid because lesson plan AP-LT-I-PP-DRCS, Slide 39 says the step counter data is retained even if a total loss of power occurs in the logic cabinet. Is it an operationally valid event? 2. Cred Dist: The plausibility of the 1 st part of Choices A/B (trip reactor) is borderline because the stem of the question never says there is an actual deviation between actual vs demanded rod position. 3. Stem Focus: Re-word the 2 nd fill-in-the-blank statement as: "The LCO for Tech Spec 3.1.7 (Rod Position Indication) ___(2)___ met." 4. LOK: It appears that the proposed test item is a higher cog question. Let's discuss. Bank position can be "reset" to zero for each group demanded position without a loss of power; comments incorporated.

Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly57 H 2 x x M U S T2G2: RPIS K2.03 1. Cred Dist: The 1 st part of Choices C/D (rod position is unknown during a LOOP) is not plausible because control rod positions are always powered from a vital/inverter power supply; control rods perform a safety function. Based solely on conservative design principles, the applicants can answer both parts of this question as "yes"/"yes" and be correct, thus bypassing the K/A. Suggest writing a question that tests the applicants' knowledge of the power supply to the digital rod position indicating coils. Incorporated. 2. Cred Dist: The 2 nd part of Choices B/D (rod position unknown 6 hrs later) is not plausible because the stem does not include anything that could be misconstrued that the SDGs are not available. The timing of Q enhanced plausibility. 3. Stem Focus: The 2 nd bullet is vague; the LOOP needs to be better defined. Added words. Q sat as of 10/28/2015 58 H 2 x x x M E S T2G2: VES K3.02 1. Partial: There may be no correct answer to the 2 nd part of the question because the concrete heat sink design doesn't work; that is, the CR gets too hot when VES is isolated. For example, AOP-903, Toxic Gas, Attachment 1, MCR Heat Load Reduction, is required to ensure the max temperature does not exceed 90ûF. 2. Cred Dist: The basis for the 5

ûF temperature rise (2 nd part of Choices B/D) is missing. If ther e is no basis, then this portion of these choices is not plausible. Suggest replacing with 100 deg. 3. Stem Focus: The phrase "..following a loss of VBS operation" should be added to the 2 nd fill-in-the-blank statement. Changed to say "with operator action"; comments incorporated.

Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly59 H 2 N E S T2G2: CDS A3.01 1. Stem Focus: To ensure no confusion with what the fill-in-the-blank statement is asking, re-word as: The minimum CDS flow required for the number of CDS pumps operating at 1005:00 is _____ gpm. Incorporated.

Q sat as of 10/28/2015. 60 H 2 x x N E S T2G2: CMS K6.08 1. Cred Dist: The 1 st part of Choice C (Compressor D hasn't auto-started yet) is not plausible because at 1005:00 condenser vacuum has decayed to 7.6 "HgA. Additionally, the interplay between the first and second portions of Choice C don't make sense (turbine tripped and compressor hasn't auto-started). Q modified to change initial equipment lineup which enhanced plausibility. 2. Stem Focus: It is not operationally valid to linearly extrapolate the vacuum decay since the delta P is not linear with respect to time. Suggest providing another point in time with the vacuum value. Extrapolation no longer needed to ensure correct answer because with the new alignment, the answer is "has not." Q sat as of 11/05/2015. 61 H 2 x x B U S T2G1: MTS K1.08 1. Cred Dist: The stem picture shows V017A CLOSED and its smaller bypass (V016A) is OPEN. Since the line is smaller, then the answer can't be the larger power choices. Valve sizes are comparable. 2. Cue: The largest range is also the correct answer; suggest changing to: WOOTF identifies a turbine power that is equivalent to these valve positions? A. A% B. B% C. C%

D. D% Q modified. Q sat as of 11/05/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly62 N U S T2G2: WGS A1.02 1. Cred Dist: The 1 st part of Choices C/D (TCS cools WGS) is not plausible because the stem says letdown is being cooled, which is located in the reactor auxiliary (potentially contaminated) building. Does TCS cool any contaminated system? Q modified. 2. Stem Focus: The 1 st fill-in-the-blank statement should be softened to "..could be due to a loss of.." Q modified. 3. The 2 nd fill-in-the-blank statement should include the phrase.."in accordance with". Incorporated. 4. Stem Focus: The way the 2 nd fill-in-the-blank statement is worded implies that there IS a delay bed fire. Suggest rewording as: IAW..at 1030:00, nitrogen injection _____ required. Incorporated.

Q is sat as of 10/28/2015.

63 N E S T2G2: CWS K4.01 1. Cred Dist: The interplay between the 1 st and 2 nd parts of Choice C makes this choice not plausible. Answer changes when < 10% power; Question is SAT. 64 H 1 x N U S T2G2: SDCS K5.03 1. Cred Dist: The 1 st part of Choices C/D (reactor power won't rise) is not plausible because a steam leak is occurring. Q modified to test valve capacity. 2. Cred Dist: The 2 nd part of Choices B/D (rods won't move) is not plausible because there is nothing in the steam that can be misconstrued that the rods aren't in AUTO. Q modified. 3. LOD=1: This question will not provide any discriminatory value on the exam. Q modified. Q sat as of 11/05/2015.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly65 F 2 x N E S T2G2: NIS A4.02 1. Stem Focus: At 1000:00, break the ONLY bullet into two bullets: A/B/C Blocked and D NOT Blocked. Incorporated. Q sat as of 11/05/2015. 66 F 2 N S T3: G2.1.18 67 F 1 x M U S T3: G2.1.33 1. Cred Dist: The 1 st part of Choices A/B (announcing transient alarms is required) is not plausible because the purpose of transient alarm protocol is emergency operating procedures' events. 2. Cred Dist: The 2 nd part of Choices B/D (no update to return to normal) is not plausible because no one would ever know when normal annunciator protocols went back into effect without some sort of update. 3. LOD=1: This question will provide no discriminatory value on the exam. Re-wrote question to test AOP/EOP communication protocols; Question is SAT.

68 F 2 N U S T3: G2.2.15 1. Cred Dist: The 2 nd part of Choices A/C (only one procedure involved for configuration mgmt.)

is not plausible because the word ONLY is too exclusive. There are multiple procedures in effect for configuration management. 2. Stem Focus: The title of NMP-AD-002 is missing from the 2 nd fill-in-the-blank statement. Rewrote question to test resetting tripped breaker; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly69 F 2 x x N U S T3: G2.2.23 1. Cred Dist: The 2 nd part of Choices A/C (excore detectors only thing that matters) is not plausible because of the phrase "core thermal power." Thermal power is always more conservative to drive by. Q modified. 2. Stem Focus: Include the phrase "-in accordance with procedure XYZ" in the 1 st fill-in-the-blank statement. Procedure tie now exists. Q sat as of 11/05/2015. 70 F 2 x N U S T3: G2.2.30 1. Cred Dist: The 2 nd part of Choices A/C (only operated at RO workstation) is not plausible because the word ONLY is too exclusive; there are many ways to operate components at the CIM, for example. Q modified. Q sat as of 11/05/2015.

71 H 2 x x N U S T3: G2.3.5 1. Cred Dist: The 1 st part of Choices A/B is not plausible because the oxygen feature never causes an auto-isolation for a radioactive release. 2. Cred Dist: The 2 nd part of Choices B/D is not plausible because nitrogen would only be automatically introduced for a fire or oxygen issue - not for high rad at 1003:00. 3. Q=K/A: This is an extension of a Tier 2 (Systems) topic; the proposed question does not test a generic plant wide radiation release concept. For example, the administrative aspects of releases or the emergency operating procedures allowances for releases - - more than just how the system works. Significantly modified the question; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly72 F 1 x M U S T3: G2.3.6 1. Cred Dist: The 1 st part of Choices C/D (must frisk coming out of high rad area) is not plausible because contamination is the concern; radiation fields are around us all the time and we never frisk. This is GET knowledge. Q modified. 2. Cred Dist: The 2 nd part of Choices A/C is not plausible because the control room would be overwhelmed when any person caused a gamma portal alarm. Q modified. 3. LOD=1: This test item will provide no discriminatory value. Q sat as of 11/05/2015. 73 H 2 x x B E S T3: G2.4.15 1. Cue: The phrase "in a 15 minute period" is not necessary to elicit the correct response. Time bounding is needed. 2. Partial: There may be no correct answer; the 2 nd part of Choice B may not be always totally correct when plant conditions require shutting the MOV. Just because the caution exists doesn't mean there may be times when the MOV should be closed anyway. Q asked iaw procedure. 3. Ensure this question does not overlap with RO Q#37. Overlap evaluated sat. Q sat as of 11/05/2015. 74 L 3 M S T3: G2.4.17 75 H 2 x N U S T3: G2.4.38 1. Q=K/A: The ability to diagnose and recognize trends is not being met because the graph is merely a point in time value. Q modified and graph now supports KA match. Q sat as of 11/05/2015. 76 H 3 N S T1G1 A-336 (AOP-402, Malf of Prot & Safety Mon'g) G2.2.19 Q is sat.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly77 H 2 x x x N E S T1G1 E-1 G2.1.7 Note to NRC reviewers: In the Westinghouse operating fleet EOPs, if you're in E-3 and subsequently get a LOCA, you stay in E-3 because it is designed to handle SGTR + LOCA. In AP-1000 this is not the case - - you leave E-3 and enter E-1. 1. Cue: The phrase "to mitigate the above conditions" in the 1 st fill-in-the-blank statement is not necessary to elicit the correct response. 2. Cred Dist: To enhance the plausibility of the 1 st part of A/B (will transition to E-3), and better raise the question of the SGTL, revise the 4 th bullet in the stem to say: The crew is performing the following step in E-1: 3. Stem Focus: It seems more appropriate to re-order the 1000:00 bullets so that the 1 st bullet becomes the last bullet. 4. Stem Focus: The 2 nd bullet needs to add the phrase "IAW AOP-103, SGTL.

" 5. Stem Focus: The phrase "direct a" in the 1 st fill-in-the-blank statement is not necessary. Comments incorporated; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly78 H 2 x x N E S T1G1 FR-C.1 EA2.04 1. Cue: Because the 2 nd fill-in-the-blank statement is asking about RNS alignment, and RNS alignment is directed AFTER Step 32 in FR-C.1, the applicant is cued that the correct answer to the 1 stfill-in-the-blank statement must be to stay in the procedure (which is the correct answer). 2. Stem Focus: Re-write the 2 nd fill-in-the-blank statement to eliminate the word "strategy", whic h hints that this alignment is only a severe accident strategy, as follows:

In accordance with Error! Reference source not found.

(Error! Reference source not found.) aligning RNS for RWST is __________ (credited for preventing core damage within the EOPs for an accident at power vs. a post-core damage severe accident management strategy

) Improper transition at Step 32 leads to SACRG; Comment #2 incorporated. Question is SAT. 79 H 2 x N U S T1G1 A-323 (Loss 6.9/4kv, or 480v) AA2.03 1. Q=K/A: The 2 nd part of the question is the SRO-only part; however, the 2 nd part of the question does not pertain to the standby diesel generator load topic. The 4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> NRC notification pertains to the reactor trip. Suggest re-working the question to test whether Attachment 1, Load Management (or alternatively Attachment 3, Prolonged Loss of AC Power) is/ is NOT required, given that the stem includes more info that makes the "not" version plausible. Suggestion incorporated; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly80 H 2 x B U S T1G1 A-329 (AOP-703, LOIA) AA2.04 1. Cred Dist: The 1 st part of Choices C/D (mini-flow valve normally open at 100% power-RCS temp lowers when valve closes) is not plausible because the feed water pumps are pumping "all forward" at 100% power. 2. Cue: The 2 nd fill-in-the-blank statement tells the applicant that a feed water transient will occur; therefore, this cues the applicant that the mini-flow valves must fail to a position that's different to their normal position. (For exam ple, if the mini-flow valve is normally closed, and it fails closed on a lOIA, then there would be no transient.) 3. Cred Dist: The 2 nd part of Choices A/C (Uncontrolled cooldown) is not plausible because RCS temperature will rise due to the failed positions of the MFRVs and feed pump mini-flow valves. Suggest testing the applicants' knowledge of where E-0 Step 32 RNO sends you (Check Instrument Air > 105 psig RNO is to go to E-1, Step 6). This, in a sense, does evaluate the ability of the applicant to evaluate RCS temp, SG level, and/or SG pressure because E-1, Step 6 sends you to AOP-703. Rewrote question; Question is SAT. 81 H 3 N E S T1G1 FR-H.1 G2.4.24 (EMERGENCY CLASSIFICATION) 1. The VEGP EALS-ICS Threshold Values & Basis (B-GEN-PLMP-020-GL01) was not available in the references; I used NMP-EP-110-GL03, VEGPEALs-ICs, Threshold Values & Basis to research this question. 2. LOD: No E-plan reference is being provided to the applicants; ensure that Operations management has a learning objective or some basis for why the E-plan procedure fission product barrier thresholds must be known from memory. 3. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly82 H 2 x x N E/U S T1G2 A304 (SGTL, AOP-103) G2.1.17 (EMERGENCY CLASSIFICATION) 1. Cred Dist: The 1 st part of Choices C/D (GOP-101, Power Operation Above 25% Power) is not plausible because the title of GOP-101 conflicts with the 1 st fill-in-the-blank statement.

That is, the 1 st fill-in-the-blank statement says "initiate a shutdown", whereas GOP-10 can be correctly eliminated,solely based on its title. The distracter analysis says that, if the rad monitor were available, then GOP-101 "could " be right. Let's discuss the basis for this analysis 2. SRO-only: The 2 nd part of the question can be answered solely based on information "above-the-line" in Tech Spec 3.4.7. That is, the E-plan excerpt provided in the stem deals with unidentified leakage, pressure boundary leakage, and identified leakage. The applicant only has to know that another category exists in Tech Spec 3.4.7, which is 'PRIMARY TO SECONDARY LEAKAGE." Suggest modifying the 1 st fill-in-the-blank statement to test the applicants' knowledge of whether or not AOP-101 is / Is NOT required. 3. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? Second part of question re-written; B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam. Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly83 H 2 x x N U S T1G2 SDP-4, EA2.01 1. SRO-only: Neither part of the question is SRO-only, for the following reasons:

1 st fill-in the-blank statement: The applicants only have to know the information "above-the-line" in Tech Spec 3.9.1 (Refueling

[B], (1662 ppm). Since 1600 ppm < 1662, then the only option is to borate the RCS.

2 nd fill-in-the-blank statement: The most conservative basis for the 1662 ppm Tech Spec limit is core reactivity at the BEGINNING of a cycle, since this is when the core contains the most fissionable material. 2. Stem Focus: The stem says (4 th bullet) that SR neutron flux is stable; this does not align with the 2 nd bullet that says SDP-4 was entered due to rising nuclear flux. Replaced question; new question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly84 F 2 x x N U S T1G2 A-332 (AOP-207) G2.1.7 1. SRO-only: The distracter analysis indicated that this question was tied to SRO topic 55.43(b)(2) (Tech Specs); however, the proposed test item does not test bases knowledge nor does it involve the application of Tech Specs. Instead, the 1 st fill-in-the-blank statement can be answered solely based on the RCS activity surveillance requirement when power has changed more than 15% in a 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period. (typically RO knowledge) The second part of the question does not involve procedure selection, Tech Specs, or any of the other five 55.43(b) topics. 2. Stem Focus: The SUR is not necessary. A better way to hit the K/A would be to test the applicants' ability select a procedure at the Step 19.e point in AOP-207.

Replaced 2 nd half of question; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly85 F 2 x x N U S T1G2 FR-I.3 EA2.02 1. Cred Dist: The 1 st part of Choices A/B (raise RCS pressure to satisfy sub cooling req'ts) is not plausible because the stem implies that the EOPs were entered, a Safeguards was blocked, and that the plant is headed to cold shut down; raising pressure not usually the preferred option in this scenario. 2. Stem Focus: The 1 st bullet does not provide information related to what procedure, or past situation, required blocking

safeguards, etc. Suggest reworking the proposed test item to test the applicants' knowledge of another item such as, 1) when, while implementing FR-I.3, transition to FR-I.2 would be actually be required, or 2) possibly test when vessel venting is required to be terminated.

Raising pressure would be the answer if not already at 1920 psig; Question is SAT. 86 F 2 x x x N U S T2G1 SGS G2.4.39 1. Q=K/A: The K/A is not being met because the proposed test item stem does not require any alarm response procedure ability; the 3 rd bullet says the alarm response procedure ability has already been taken. The proposed test item only requires the applicant to know which instruments are dedicated to DAS (vs PMS), and the DAS function. 2. SRO-only: The applicant can answer the question solely by knowing which instruments are dedicated to DAS, and the associated DAS function.

Suggest taking the 3 rd item listed in the stem and test the applicants' ability to implement Tech Spec actions in accordance with the alarm response procedure. 3. Cue: The 2 nd bullet should include the information that the applicant would see in the control room instead of telling the applicant that SGS-LT018 failed downscale with bad quality. Re-wrote question; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly87 F 2 x x N U S T2G1 PXS A2.16 1. Cred Dist: The 1 st part of Choices C/D (manual DAS not required) is not plausible because conservative decision making would always seem to require follow up with a manual DAS to attempt to make the PDSP actuation occur. 2. Cred Dist: The 2 nd part of Choices B/D (the limiting DBA doesn't require at least one of the CMTs. 3. Q=K/A: The proposed test item doesn't test the applicants' ability to predict HOW the CMT discharge isolation valve failure affects the plant, including the required subsequent procedures.4. Stem Focus: The Tech Spec number is missing from the 2 nd fill-in-the-blank statement. Question replaced; Question is SAT. 88 H 2 x N E T2G1 ECS K2.02 (EMERGENCY CLASSIFICATION) 1. Cred Dist: Choice D is not plausible because the note is included in the stem. 2. Why isn't the entire E-plan classification procedure being provided to the applicants as a reference? Note removed and B-GEN-PLMP-020-GL01 provided as reference to applicants on the exam; Question is SAT. 89 F 2 x x N U S T2G1 DOS A2.01 1. SRO-only: The 2 nd part of the question is the part that hits the K/A; however, the 2 nd part of the question is not SRO-only knowledge because the RO has to know the required tank level.

The 1 st part of the question is TRM; however, the required knowledge is "above-the-line." 2. Cred Dist: The 2 nd part of Choices A/B (fuel level is SAT) is not plausible because the fuel oil transfer pump won't have a suction (as indicated in the stem). Suggest writing a question that tests the applicants' ability to determine the course of action when a common cause failure of the DG fuel oil transfer system renders it non-functional for both diesels, with the plant operating at 100% power.

2 nd part of question modified; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly90 F 2 x N U S T2G1 SWS G2.4.14 1. Cred Dist: The 1 st part of Choices A/C (can be performed in any order) is not plausible because the steps are alpha-numerically identified, which implies "a" before "b." The 1 st part of the proposed test item will not provide any discriminatory value. First part of question re-wrote; Question is SAT. 91 F 2 x x N E S T2G2 DRCS G2.4.36 1. Partial: There may be no correct answer to the 2 nd fill-in-the-blank statement based on the following PLS-SOP-001 guidance.

The stem conditions don't exactly match the context of the guidance.

The 2 nd fill-in-the-blank statement does not involve a power reduction in progress. 2. Stem Focus: The stem does not provide the initial reactor power level. 3. Stem Focus: The stem should indicate which section of PLS-SOP-001 is being implemented (Attachment 4, Grey Control Rod Exchange?). Comments incorporated; Question is SAT. 92 H 2 x x N U S T2G2 PLCS A2.08 1. SRO-only: The 2 nd part of the proposed test item is not linked to any of the 10CFR55.43(b) topics - the 2 nd part of the question does not involve procedure selection. 2. Cred Dist: The 2 nd part of Choices B/D (turn off makeup pumps to perform leak calc) is not pl ausible because pressurizer level is lowering. It is not plausible to turn off the makeup source when performing the leak calcul ation because this could cause pressurizer level to lower more rapidly. Question re-written; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly93 H 5 3 x x N E/U S T2G2 NIS A2.09 1. There appears to be no approved procedure for NIS. Please provide procedure for bypassi ng and placing PR channels in tripped condition. The stem contains phrase such as the 1030 bullet (functions associated with NE004A placed in bypass) and 2 nd fill-in-the-blank statement (NE004B is required to be placed in trip). Need to see how each of these actions is described in the procedure. 2. Cred Dist: The plausibility of the 2 nd part of Choices B/D (NE004B NOT required to be placed in tripped) is questionable because there is no procedure for NIS. IF there is only allowance to place ONE NI channel in bypass, THEN, the 2 nd part of Choices B/D is not plausible. 3. LOD=5: Generally speaking, we always provide Tech Specs for

> 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statement applications. This is done to ensure no post-exam appeals. This question has the potential to be argued as LOD=5 w/o a reference. 4. Stem Focus: The 2 nd fill-in-the-blank statement is missing the Tech Spec #/title. 5. Stem Focus: There are font size issues in the 2 nd and 3 rd bullets in the stem. 6. Stem Focus: Why can't the 2 nd fill-in-the-blank statement be worded as "At 1645:00, in accordance with Tech Spec 3.3.1, Reactor Trip Instrumentation, RXS-NE004B _____- required to be placed in the TRIPPED condition." Is there something associated with using the phrase "the functions associated with.." in the statement? Procedure exists; second part of question re-written to test knowledge of Tech Spec bases. Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly94 H 2 x x N E S T3 G2.1.22 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (use of steam tables to correlate the secondary-to-primary temperature relationship), using a contextual example (EOPs). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: Choice C (go to yellow path procedure) is not plausible because yellow path procedures are always optional and typically written for situations where a safeguards has occurred. If a safeguards were presumed to have occurred, then Choice B (go to E-0) is always the winner vs choosing to implement a yellow path. 2. Stem Focus: In order to protect the credibility of Choice B (safeguards has occurred while the crew was performing Step 35 of ES-0.1), re-order the stem as: The crew is performing ES-0.1, Step 35: (picture of step and RNO) While the crew was performing Step 35, the following conditions were noted: (the 5 bullets)

3. Suggest re-working the choices (to ensure procedure selection for SRO and to avoid using the word ONLY) as: A. Remain in ES-0.1, do not perform SOP-ECS-001, Attachment 21 B. Exit ES-0.1 and transition to E-0 C. (Need something else plausible here) D. Remain in ES-0.1, perform SOP-ECS-001, Attachment 21 Question replaced; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly95 F 2 x x M U S T3 G2.1.27 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (PCIV Tech Spec allowance for using an in-line valve to comply), using a contextual example (VFS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: The 2 nd part of Choices B/D (V009 breaker can remain ON) is not plausible because leaving the breaker ON can still allow someone or some malfunction to change the valve position. Suggest re-working the question to test the same scenario, except in a situation where reli ance on a check valve is / is NOT allowed to comply with TS 3.6.3. 2. Stem Focus: To ensure operational validity and compliance with policy statement regarding tracking Tech Specs during EOP implementation (ML#042960453), re-write stem such that crew originally found V010 failure while implementing the EOPs, but subsequently exited the EOPs and entered the GOI procedure, and is now in Mode 3 determining required Tech Spec actions. 3. Provide original question with the modified question. Question replaced; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly96 F 5 x x M U S T3 G2.2.2 1. Q=K/A: The proposed test item solely tests a Tier 2 (Plant Systems) knowledge related to the Main Steam Line Flow Path Isolation Valves (TS 3.7.2). There is no plant-wide generic concept being tested. ES-401N, Section D.2.a (page 6 of 51) says that Tier 3 should not become an extension of Tier 2.

Suggest testing some aspect of V34 Specific Management MCR Policies, NMP-OS-007-001, Conduct of Ops, NMP-OS-001, Reactivity Mgmt Program, etc. , including required approvals for deviating from these type of admin requirements, related to operating the controls, etc, during various points in time such as startup, shutdowns, normal ops, etc. 2. Minutia: The 2 nd part of the question can be argued as minutia without a reference being provided. 3. Provide original question with the modified question. Question replaced; Question is SAT. 97 H 3 x x M E S T3 G2.2.26 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (any missed TRM surveillance requirement allowances for delaying entry to TR 3.0.3), using a contextual example (EDS). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 1. Cred Dist: Choice D is not plausible because, unlike the other choices, the stem does not include the original due date of the

surveillance. 2. Stem Focus: Modify the choices to be clear, for example: A. 14 days after 4/30/2021 B. 15 days after 4/30/2021 C. 106 days after 4/30/2021 D. 106 days after ????

3. Stem Focus: The word "applicable" in the 2 nd bullet should be "allowable." 4. Include original question that this question was modified from. Comments incorporated; Question is SAT.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia#/ units Back-ward Q= K/A SROOnly98 F 2 N S T3 G2.3.9 NOTE: This is a Tier 3 (plant-wide generic) K/A. It appears that the proposed test item is testing a plant-wide generic concept (SR 3.0.2), using a contextual example (Leakage Detection Rad Monitor). This K/A match is acceptable provided other Tier 3 K/As also test administrative procedures. 99 H 1 2 M E/U S T3 G2.4.5 1. B-GEN-PLMP-038, Emergency Notifications, was not provided in the reference material. 2. LOD=1: The 1 st part of Choices A/B will not provide any discriminatory value because the title of the procedure refers to the licensee emergency organization. 3. Include original question that this question was modified from.

Question revised to include a fuel handling accident to enhance discriminatory value. Question is SAT. 100 H 2 x x x M E S T3 G2.4.7 1. Cue: The EAL designators listed in the 2 nd part of each choice are not needed to elicit the correct response. 2. Stem Focus: The 1 st part of each choice (can be used vs can NOT be used) may be better as is allowed vs is NOT allowed. 3. Partial: The 2 nd fill-in-the-blank statement should be worded as "the highest required emergency classification is ____ . 4. Include original question that this question was modified from. Comments incorporated; Question is SAT.