ML20267A208

08 Draft Written Exam Comments ES-401-9

ML20267A208
Person / Time
Site:	Waterford
Issue date:	08/26/2020
From:	Greg Werner Operations Branch IV
To:	Entergy Operations
References
W3-2020-08
Download: ML20267A208 (41)

Text

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 to 5 (easy to difficult) rating scale (questions in the 2 to 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

a. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

b. The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

c. The answer choices are a collection of unrelated true/false statements.

d. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

e. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

a. The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

b. The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

c. The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

d. The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

Place the answer letter here Place the 55.41 or 55.43 item here

8. At a minimum, explain any Unsat ratings (e.g., how the Appendix B psychometric attributes are not being met).

1. Ans

2. LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6 7 CFR 8 LOK Letter stem cred job #/ back- SRO- A/B/C/ 55.41x55 Q# (F/H) (1-5) cueing T/F partial minutia K/A B/M/N U/E/S Explanation focus dist link units ward only D .43y Need LOD and 10 CFR info (all) a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 K/A mismatch. K/A discusses reactor trip recovery (not criteria to initiate a reactor trip).

Distractor D "observe proper response of nuclear instrumentation" would always be correct (delete). D also only distractor to add positive reactivity, so doesn't appear credible. The K/A discusses procedures "associated with" reactor trip recovery. OP-901-103 1 H 3 X X N U B 41.6/10 is one of the two offnormals mentioned in 902-001 and OP-010-003 indirectly puts the crew into OP-902-001. Distractor D would be the correct answer if the applicant determines that CEA positions are within the ECC and the TIL. The statement "observe proper response of nuclear instrumentation" is not correct in this situation because it is combined with pulling CEAs another 25 inches. This exactly what the procedure step says to do and makes distractor D more plausible. Would like to leave this question as is. Negative, picked a new K/A. Question accepted.

2 H 3 N S A 41.7 Question accepted.

FIRST TEN. Change "will" to 3 F 2 X N E B "should" in stem. Question revised, Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. Could it be argued on an appeal that answer choice A accomplishes the intent of the procedural step? Changed the root to ask "what does Appendix 4 F 2 X N E B 41.7 15 "state" instead of what does Appendix 15 "direct". Appendix 15 states what is in answer B and not what is in answer A. The revised question could not be argued on appeal. Question accepted.

ON 2012 NRC EXAM. Don't see how anyone would believe decreasing amps on a locked motor rotor. Also, second half one need only know that RCS flow will decrease on an RCP failure.

Don't see any disciminating value 5 H 1 X B U D 41.3 here. There is knowledge to be demonstrated on the effect that a sheared shaft or locked rotor would have on motor amperage.

DNBR trip is plausbile because the RCP speed sensors are an input to the DNBR trip. In the case of a sheared shaft, the RCP speed sensors are not affected.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 K/A mismatch - the question reads like a "knowledge of procedures" question vice a "knowledge of radiological priincipals" question. The problem is that the generic K/A is tied to the loss of charging offnormal procedure. There is no other way to tie this generic K/A to the loss 6 H 3 X N U A 41.10/12 of charging event without referencing the offnormal procedures. Would have to change the K/A. There is knowledge of radiological principles in this question because the crew is aligning the ventilation trains that contain the charcoal absorbers to reduce iodine levels. Question accepted.

Trim unnecessary information from stem (LOCA appears irrelevant here). LOCA is required because the SIAS has caused the 7 H 3 X X N U C 41.7/10 EDGs to start and are running unloaded. Capitalize LATEST in stem. Capitalized LATEST in the stem. Change A and B to 0825 to make more discriminating.

Changed distractor A and B to 0825. Question accepted.

ON 2011 NRC EXAM. Question 8 F 2 B S D 41.7 accepted a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Not plausible that Thot RTD's would be located in the incore instrumenstation tubes, while it's quite obvious that core exit thermocouples are located there (cueing in stem - ICI) (B and D not plausible). Agree. Removed 9 H 4 X X N U A 41.10 "located in the incore instrument tubes" from the stem. Added "may read less for the given conditions" to the stem to eliminate the possibility of two correct answers. Question accepted.

10 H 3 N S C 41.7 FIRST TEN. Question accepted.

Change "will" to "should" in stem.

11 F 2 X N S A 41.5 Changed "will" to "should" in the stem. Question accepted.

ON 2014 NRC EXAM. Extra 12 H 3 X B E D 41.10 space needed in distractor B.

Added an extra space to distractor B. Question accepted.

FIRST TEN. Change "will's" to should's" in stem. Procedure OP-901-310 does not appear to prohibit local manual operation of CC-620. This would make both A 13 H 3 X X N U B 41.7/10 and B correct. Resolutions:

Changed "will" to "should".

Changed part 2 to test the knowledge of what interlocks would isolate CCW flow to the Spent Fuel Pool (CC-620).

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 For A and C to be plausible, the applicant would have to believe that steam generators would automatically depressurize uncontrollably on a loss of vital AC. The depressurization is not uncontrollable. The second part of the question is asking the method the operator will use to manually operate the valve. There are malfunctions that fail the ADV open (setpoint failing low, output failing high). These malfunctions 14 F 2 X N U D 41.7 are run on the applicants in the simulator. Modify part 1. Open is not plausible. Changed the question, requires review. Add to the explanations for A and B the plausibility that handwheel only is plausible. Added to the explanations for A and B why the handwheel only distractors are credible. Question accepted.

Fix the indent issue. Fixed the 15 H 3 N S A 41.10 indent issure. Question accepted.

There's a big difference between 7 days and 30 days. Is there another TS action that is closer to 16 F 2 X N E D 41.4/10 30 days? 14 days? There are actions in W3 Tech Specs that are 14 days. Changed to 14 days and updated the explanations.

Question accepted.

17 H 3 N S C 41.7/10 Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. Change "will" to "should" in stem. Discuss changing MVAR values to be 18 H 3 X N E A 41.5 closer to their respective limits.

Revised question as suggested.

Question Accepted.

ON 2018 NRC EXAM. Need to have discussion to understand why anyone would think distractors A, C, or D would lower power 11% more in one quadrant? Lowering power 11%

19 H 3 X B X B 41.1 in one quadarant is the only thing that makes A,C or D wrong. The K/A is directing me to ask about power indications on a dropped rod. Question accepted.

What happened to the A BAM pump? Are both the A and B BAM pumps on train A? (discuss) Spell out RAB. Make correct answer D? Both the BAM Pump A and B are de-energized in this question.

Both are powered from the A train. Would rather not spell out 20 H 3 X N E B 41.10 RAB. This person is always referred to as the RAB watch.

Both gravity feed valves are powered from the B train of electrical power. The answer is B.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. Enusre RO level of knowledge. Resolution: The guidance is a note in OP-901-113, VCT Level Control Malfunction. The objective is and 21 H 3 N S A 41.7/10 RO objective for this offnormal Apply procedural steps, cautions, and notes applicable to the diagnosed event EO3 Question accepted.

Spell out PIG. Spelled out PIG.

Wouldn't the Normal Supply and Exhaust Fan already be running -

plausible distractor? The FHB Normal Supply and Exhaust Fan 22 F 2 X N E D 41.11/13 would not be running. They both secure on a Fuel Handling Accident Signal. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Delete "release" at end of stem.

Deleted the word "release".

"Distractor D not possible - if you open both ADV's then haven't you automatically failed at preventing opening the ADV on the affected steam generator? Added "after isolation" to distractors B and D to match what is written in the Tech Guide. Also since RCP curves must always be met, then is there two correct answers?

This question might be better as a 23 F 2 X X N E B 41.5 1x1. Changed question from "commence a normal plant cooldown" to "perform an initial plant cooldown". The initial cooldown to 520F is performed to prevent opening of the ADV or MSSV on the affected SG not to maintain RCP operating curves.

Question accepted.

Ensure RO level of knowledge.

WLP-OPS-EP02 obj. 22 (Given plant and environmental data, 24 F 2 N S C 41.10 determine Protective action recommendations LO-22) is an RO objective. Changed the question and the K/A. Question accepted.

Add noun name to LCP-43.

25 F 2 N S D 41.7 Added the noun name to LCP-43.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Discuss plausibility of industrial wast sump and possible alternatives. The industrial waste sumps are plausible because most drains outside of the RCA and all of the (Turbine Generator Building) TGB drains are routed 26 H 3 X N E B 41.7 to this sump and the CCW surge tank is located at the top of the TGB on the +69 level. Added to the explanations for distractors C and D. Changed distractors.

Inserted "Dry Cooling Tower" instead of "Industrial Waste Sump" to be more plausible.

Question accepted.

Stem indicates first that the cooldown is excessive, then states that it's uncontrolled (choose one). Chose uncontrolled. Distractor C not plausible - not enough infromation in stem to definitively conclude that all CEA's are inserted. The applicant should conclude that all 27 H 3 X X N E B 41.10 CEAs are inserted unless told otherwise. Also, the distractor is stating that all CEAs are fully inserted. Change dropping to lowering in the stem. Changed dropping to lowering in the stem and in distractor D. Question accepted.

28 H 3 X B E B 41.3 2015 NRC exam. Question Accepted 29 F 2 N S D 41.7 Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Discuss/ensure RO level of knowledge (particularly the TS basis portion). WLP-OPS-SDC00 obj. 6 is an RO objective and it states "Given plant status, identify and evaluate the operability, actions and bases for the following Technical Specifications as they relate to the SDC system:

TS 3.9.8.1". Also looks like a KA 30 H 3 X X N U C 41.7 mismatch - the question reads like a shutdown cooling requirements KA vice a RHR malfunction has what effect on the RCS question. Altered the question such that the BOP has identified that SDC Train B flow has lowered. Question accepted.

In stem make abbreviations consistent (temperature control, shutdown cooling). Leave asi is because these are the noun names for the valves in the procedure. Discuss plausibility that the 415 valve will go closed and temperature will remain the same. Added to the explanation for distractors A and C, "Part 2 is 31 H 3 X N E D 41.7 plausible if the applicant does not understand the SDC HX flow path and determines that SDC flow increasing will cause more SDC flow through the HX when actually SI-129 bypasses the SDC HX." Question accepted.

32 F 2 N S D 41.7 Question accepted.

2018 NRC Exam. Question 33 H 3 B S C 41.5 accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Could it be argued that answer A could also be correct? Change A to "remains de-energized?" I dont think it can be argued because 34 F 2 N S C 41.7 the stem says "based on the level switch failure". Added to answer A "(Breaker Open)". Question accepted.

Not sure that "closed" is a credible distractor. As temperature increases and the coolant expands, would anyone believe that Close is correct?

Distractor seems credible, one would have to know how the 35 H 3 N S C 41.5 system works to answer the first part of the question. Replaced "open the valve" and "close the valve" with "raise controller output" and "lower controller output". Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Need to discuss why one would think bypassing two channels would be plausible (distractors B and C). The normal action on a failed bistable is to go to bypass.

The applicant would have to know that putting the second bistable in bypass will remove both bistables from bypass. If the bistable fails High, then is Low a credible distractor? Failing either way 36 H 3 X N E D 41.7 would affect the high pressure trip because the instrument would be broke and we would still go to bypass. That being said, there is no reason to put which way it failed. Removed "instrument failed high" and inserted "instrument failed." Question accepted.

ON 2010 NRC EXAM. K/A mismatch. K/A is asking for the basis for a reactor trip setpoint, not the setpoints value. The information that the manual RESET pushbutton will only lower the existing setpoint of a 37 H 3 X N U B 41.7 maximum of 400 PSIA below existing RCS pressure and that the setpoint has a ceiling of 1684 PSIA is only found in the basis for TS 2.2.1 concerning Pressurizer Pressure-Low Trip.

Question accepted.

Add comma after "Currently."

38 H 3 N S A 41.7 Added a comma after "currently".

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Delete "one" in stem. Deleted "one" in the stem. Distractors A and B indicate that there are flow "headers." Does this cue that flow to individual coolers is not plausible (distractors C and D)?

39 H 3 X X N E B 41.7 Distractors C and D are plausible as is. Added more verbiage to the explanations for distractors C and D to explain the plausibility.

Reworded the stem to ensure there is only one correct answer.

Discovered during validation.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 How is C plausible with CS 111A/117A NOT FULLY OPEN in alarm? One would have to know that these valves would make the CS train inoperable and the requirement is before reaching Mode 1. Added more to the explanation to distractor C.

Ensure RO level knowledge. WLP-OPS-CS00 obj 7 discusses TS actions and is an RO objective.

Objective 9 discusses procedure cautions and notes and is an RO objective. Added objective 9 to the list of objectives on the exam worksheet. In the stem, is it necessary to say, "pressurization 40 H 3 X N E D 41.10 is in progress?" No, I changed it to "a plant startup is in progress" Could it be argued that answer choice C is a subset of choice D?

Dont see how choice C could be a subset of choice D. Is answer B or C also correct? NO. The plant cannot be taken to mode 3 with the present conditions and the plant cannot be taken to greater than 400 psia at the present conditions. Answer D is the only correct answer.

Question Accepted a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 In stem, delete "ONE" and capitalize MINIMUM. Deleted "ONE" and capitalized MINIMUM.

Why is "without causing another overspeed" necessary information in the stem? Because technically the pump would restart if MS-41 H 3 X N E C 41.4 401A and MS-401B were not closed but it would just trip again on overspeed once the throttle valve (MS-416) is opened. If "without causing another overspeed" is not in the stem the other distractors become challengeable. Question accepted.

42 H 3 N S A 41.5 Question accepted.

ON 2015 NRC EXAM. How could both main feedwater pumps be operating if the high pressure governor valves are fully closed (distractors B and C)? Above 39% power, the steam supply is 43 H 3 X B E D 41.4 through the LP governor. Added "The Main Feed Pump HP governor valves are fully closed at 39% power and the Main Feed Pump steam supply is through the LP governor valve from 39%

to 100% power" to the explanation for both distractor B and C. Question accepted.

Why is it necessary to have a SG wide range level indicator fail high in the stem? Because the failed 44 F 2 X N E D 41.4 indicator makes one of the EFW FCVs inoperable. The rest of the question is based on this EFW FCV being inoperable and out of service. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 K/A mismatch. Applicant could select correct answer without knowing anything about the implications of voiding or water hammer. Question could probably be re-written to ask for why the limit is specified instead of just 45 F 2 X N U B 41.5 asking for the limit. Added "to prevent feed line voiding and water hammer in the event of an EFAS signal" to the stem. The question meets the K/A because the question is testing the operational implications for preventing water hammer in the EFW line. Question accepted.

Does this meet the K/A? Yes, I see that it meets all aspects of the K/A. In the stem, return after "condition." Hit return after "condition". LOD is low. Most 46 F 1 N E B 41.7 "Normally" operating devices have an automatic backup feature. I dont think the LOD is one. How the SUPS works is required to answer this question.

Question accepted.

2015 NRC exam. Is 30 minutes plausible? I'm not sure anyone would believe that licensee's have 30 minute batteries. 120 minutes is a better distractor. Capitalize Maximum in the stem. Changed the distractors part 1 to "120 47 F 2 B E D 41.7 minutes". Updated the explanation for distractor A and B for plausibility. Capitalized "Maximum" in the stem. Question accepted.

2011 NRC exam. Question 48 H 3 B S D 41.7 accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 2015 NRC exam. Add BD-303 to the question, change "can" to "will." Added the valve number 49 F 2 B S B 41.7 and noun name to the question.

Changed "can" to "will". Question accepted.

Distractors A and B do not appear plausible. Rad waste operations (WCT) from the main control room? W3 has Rad Waste controls in the control room.

50 F 2 N S D 41.12 Examples are LWM and BM discharge valves, HUT inlet valves, Oil Separator Sump outlet valves. Question accepted.

Distractor A does not appear to be physically possible. Add information to the stem that the cause is debris. Distractor A could be credible if one does not know heat exchanger theory.

Added "excessive debris" to the 51 H X N E C 41.4 stem. Again, Ensure that distractor A is a possible scenario. It is, added to distractor A explanation, The indications in this distractor would indicate that the TCW shell side requires venting as detailed in OP-901-512 section E3 first bullet. Question accepted.

The way the question is stuctured, it's pretty obvious the answer is B or C. Discuss making question more discriminatory by 52 F X N E B 41.7 making distractors A and D more consistent (i.e. is there a SWGR 212A or 22A that could be credible?) Changed distractor A to the 22A bus. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 53 F N S A 41.4 Question accepted.

Chang "will's" to "should's" in stem. Ensure RO level. Changed "wills" to "shoulds". Objective 16 of WLP-OPS-PPE02 states "Given plant and/or equipment conditions, evaluate Safety 54 H X N E C 41.7 Function Status and determine action to be taken if SFSC criteria are not being met as applicable to OP-902-002". This objective is both an RO and SRO objective.

Also, the ROs are responsible to continuously monitor safety functions in accordane with OI-038-000. Question accepted.

55 H N S B 41.8 Question accepted.

ON 2008 NRC EXAM. Delete "one" in stem. Distractor C - don't see how it is credible to believe that a high range containment radiation moitor would not be safety related and not be able to be used in a harsh environment 56 F X X B E D 41.7 (like high range containment radiation). Replace distractor C.

Distractor C has been changed with The low range detector has automatically shutdown at a preset radiation level and the high range detectors have been placed in service. Question accepted.

ON 2015 NRC EXAM. If possible, shorten the stem. Most of the 57 H B S D 41.7 information is required. Deleted the speed controller UNID. No need to have that in the question.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Distractor A - 213 appears out of place with 313, 314, and 315.

Discuss possibility of making distractors more consistent. The 213B bus is located in the same safety switchgear as the 313B bus and contains power supplies that are located in containment (refueling machine, upender, etc.)Added this to the explanation for distractor A. Look into changing the K/A. Could not 58 F X N E B 41.7 change the K/A because there were no other systems to choose from that had power supply K/As greater than 2.5. Removed the distractor that had the 213B bus and replaced it with the 317B bus.

Re-ordered the answers. The answer key must be changed.

Question requires review.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Are using TVs plausible/credible distractors? Let's discuss this one. Next to the GV lower pushbutton is the TV lower pushbutton. Using the throttle valves are plausible because throttle valves are used to bring turbine speed up to 1700 rpm during a startup, but are not used to adjust turbine load. However, the throttle valve lower pushbutton is active at power and 59 H X N U A 41.4 would reduce turbine load if the procedure would allow it. Added these words to the explanation.

Put a reference to the procedure in the stem to avoid any challenge. Added per OP-005-007, Main Turbine and Generator to the stem. Question accepted.

"Valve" should be "Valves" in second part of stem. At what diminished SBCV capability would the ADV's be required?

Changed "Valve" to "Valves". If two SBCVs were out of service, it would require the ADV to throttle 60 H X N E D 41.7 open. Part 2 was reworded as a result of feedback during validation. Although, the knowledge required to answer the question has not changed.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Change "will's" to "should's" in stem. Plausibilty of maintaing SG pressure at a safety setpoint seems a stretch (discuss).

Changed the "will's" to "shoulds".

The question is not asking the student if S/G pressure is going to be controlled at safety setpoint.

It is testing the knowledge of what one would expect SG pressure to be with no condenser available 61 H X X N E C 41.5 and operable ADVs. The student may determine that the ADV setpoint is 1070 psig. Change distractor A and D to 1038 psig which is -3% of lift pressure for the first MSSV to open. Changed distractor A and D to 1038 psig and updated the explanations.

Question accepted.

In stem, shouldn't "read" be "reading?' If possible, shorten the stem. Changed "read" to 62 F X N E C 41.7 "reading". Could not identify any way to shorten the stem.

Question accepted.

63 F N S C 41.4 Question accepted.

ON 2017 NRC EXAM. Need to better understand why anyone would think lowering SA-125 setpoint in response to lowering IA pressure would "force it open."

64 H X B E A 41.10 Did anyone miss this on the 2017 exam? Need to verify on the 2017 exam. This part of the question was missed by 1/2 ROs during validation. The first part of the question requires comprehensive thinking. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 ON 2010 NRC EXAM. If a task can be successfully accomplished in the CR, is it ever preferred to do it in the field? The reactor regulating cabinets are 65 H X B E D 41.7 located in the control room.

Added this information to the explanation for distractors A and C. Question accepted.

Distractor D essentially says "once the RCS has been filled and vented." Correct answer obvious (no discriminating value)The question is asking "what is the definition for "RCS loops filled" IAW OP-100-014. It could be before the vent sections are completed. Distractor A 66 F X N U D 41.10 occurs after answer "D". Answer B is the actual level of the hot leg being full. Knowing when "RCS loops filled" is important for some TS actions (TS 3.1.2.9). Change distractor D, it seems too obvious. Added a procedure reference to all distractors and changed distractor C to venting CEDM connections is complete.

Updated all explanations.

Question requires review.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Detensioning and removal of the reactor head is essentially all part of the one activity of removing the head and exposing the internals.

Fairly obvious that A and B aren't 67 F X N U C 41.3 the correct answer. Make A "detensioning and removal of the reactor vessel head" and come up with something credible for B.

Made all changes as suggested.

Inserted "Disconnecting a CET when < 18 ft. MSL" into distractor B and changed the explanation accordingly. Question accepted.

Capitalize MINIMUM. LOD is very low. Can either the question be revised or the distractors be revised? New Q? This Q has been observed numerous times in intoduction to NLO training. Don't see any discriminating value here. Capitalized MINIMUM.

Dont agree that the LOD is 1.

68 F X N U D 41.10 The RO assigns standby valve lineups and it is important that the RO has the knowledge of how to check an open valve in the "open" position if asked by an NAO. It is not uncommon at W3 that ROs will assist in performing valve lineups. How to check a throttle valve has been used before on a W3 RO NRC exam. Deleted the question, changed the K/A and wrote a new question. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Changed the K/A and the question because I could not 69 F N S D 41.10 write an RO question to the previous K/A.Question accepted.

LOD is low. Is there a way to enhance this question? This is the type of question used for this 70 F N S B 41.10 K/A in the past. The LOD is not very low for an RO exam.

Question accepted.

Discuss changing 750,000 in stem to 600,000 (make Q a little more discriminatory). The liquid release permits at W3 always has the minimum flow rate in increments of 250,000 gpm.

Changing it to 600,000 would be unrealistic. Delete and change 71 H X X N E C 41.4 the question. The question has been deleted and replaced with a different question for the same K/A. Question requires review.

Put at a minimum in the stem.

Question accepted.

Distractors A and B do not appear plausible. It's very unlikely an elevator would be constructed in an area forbidden to be entered.

Also, "elevation 11" seems very general compared to the specificity of C and D. Changed distractor A from RCB elevator to the RCP Sump. This area also 72 F X N U D 41.9 requires RP manager/designee permission to enter. RCB-11 is plausible because it is an area that we normally dont access and egress. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Change "will" to "should" in stem.

Changed "will" to "should" in the stem. Don't see how "verify turbine trip" would be thought of as a post trip action that does not need to be committed to memory (renders distractors C and D implausible). Typo on proposed answer (D). The immediate actions in OP-902-000 were changed in 2017 from having everything an immediate action to 73 F X X N U B 41.10 only two steps being an immediate action. Also, Turbine Trip was a part of the Maintenance of Vital Auxiliaries step and was removed be its own step. Part 2 of this question was also recently changed.

Previously, if no contingency actions were taken, the crew could go directly to OP-902-001.

Question accepted.

ON 2018 NRC EXAM. Change "less than 5" to "less than 10" in A and B to make more credible. OI-038-000 states that natural circ will take 5 to 15 minutes. The Tech Guide states longer than 15 minutes from low power. Would worry if this question is "challengeable" if changed to 10.

The first part of the question is 74 F X B E C 41.10 only testing if the applicant know that natural circulation takes longer to setup if securing RCPs from a low power. Change part 1 such that the student is asked which takes longer instead of giving time requirements.

Question accepted a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Add "the" to C(2) and D(2). Added 75 H X N E A 41.7 "the" to C(2) and D(2). Question accepted.

Change "will" to "should" in stem.

Changed "will" to "should" in the stem. Distractor C indicates that a suction source is verified prior to charging pump start. This appears to satisfy procedural caution and renders distrator C as a possble correct answer. Agree.

Changed distractor A and C by 76 H 3 X X N U D 43.5 deleting "verify a suction source" and inserting "verify adequate VCT level". Verifying VCT level alone does not satisfy the caution statement requiring the suction source to be recovered.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 ON 2015 NRC EXAM. Change "will" to "should" in stem.

Changed "will' to "should".

Distractors A & B : Why would anyone associate SI pumps starting as a SDC malfunction? In this case, SDC is in service and the Low Temperature Overpressure relief valves will be lifing discharging the RCS to the Containment Sump. The applicant could determine that OP-901-131 SDC Malfunction, section E1 77 H 3 X X B E D 43.2 System Leakage, could provide guidance for a loss of inventory occuring from the SDC piping (LTOP relief). Although OP-901-131 will not help because the guidance to secure HPSI pumps is located in OP-901-504. Added these words to the descriptions for explanations A and B.

Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. Change "will" to "should" in stem. B does not appear plausible. Why would one go to pressurizer pressure malfunction if the problem is only in the spray valve controller?

"Will" changed to "should." Let's discuss this one. Answer choice B still seems not plausible - if an applicant believes the problem is only with the spray valve, then would they really go to procedure 78 H 3 X X N E A 43.5 E2? We can discuss. Part 1 of the question is not asking where is the problem, it is asking what controller will be placed in manual. The applicant could determine that the controller is the problem but the spray valve needs to be opened so its controller must be placed in manual and opened thus alleviating the problem. The applicant must realize that the pressurizer pressure controller must also be place in manual because it is also the input to the proportional heaters. Question accepted.

Question can be answered with knowledge of what Rx trip breakers open on a loss of SUPS MB and that SUPS B1 can take the place of SUPS MB or MD.

79 H 3 X X N U B 43.5 Don't see SRO only here. Also, this looks like a K/A Mismatch.

The K/A and question has been changed. Requires review.Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Don't see how someone would choose instrument air malfunction procedure when no IA malfunction is descibed in stem (distractors A and B). Is it really SRO knowledge to understand 80 H 3 X X N U D 43.5 that normal pressurizer spray is unavailable with no RCPs?

Correct answer appeared obvious. The K/A and question has changed. Requires review.

Question Accepted ON 2018 NRC EXAM. Need original bank question to determine if appropriately modified. A and C do not appear plausible. Why would entry in "response to degraded grid" be plausible when the question stem states that the grid remains stable? To make "response to degraded grid" more plausible the initial MVAR OUT number was changed from 50 to 100 MVAR.

This real number now exceeds the MVAR IN limit of 75. If the applicant determines that the MVAR limit is being exceed then 81 H 3 X X M U B 43.5 the "response to degraded grid" section would be the appropriate section to enter. The MVAR limits are -75 to +400 MVAR.

Therefore, the initial MVAR reading (100) and the requested MVAR (350) readings are both within limits. Added these words into the explanations for the appropriate distractors. K/A has been changed and new question written. Requires review.

Question accepted.

82 F 2 N S C 43.2 SAT Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 ON 2018 NRC EXAM. Change "will" to "should" in stem.

83 H 2 X B E B 43.5 Changed "will" to "should" in the stem. Question accepted.

Initially SAT. Question was edited 84 F 2 N S A 43.2/4 after validation. Requires review.

Question accepted.

85 H 4 N S D 43.5 SAT. Question accepted.

Change "will" to "should" in stem.

Changed "will" to "should" in the stem. Is section E0 General just entry criteria - RO knowledge? E0 is not just entry criteria, this 86 H 3 X X N E C 43.5 section contains the steps to perform in the event of a failed VCT level transmitter. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Change "will" to "should" in stem.

Changed "will" to "should" in the stem. Add "ONLY" at the end of distractor C. Added "only" to the end of distractor C. Is "2 minutes" in the stem necessary or a valid way to distinguish the distractors from the answer? Yes, because there is presently no CCW flow to the RCPs. If it got to 3 minutes of no CCW flow to the RCPs, the crew would trip the reactor and secure RCPs. Distractor C 87 H 3 X X N E B 43.5 appears to be RO knowledge. It is a plausible distractor and is not the correct answer. The answer and the other distractors reference a subsection of the procedure. Would like to leave it as is. From 5/12/2020, Adjust the root such that it asking what does OP-901-510 say to do first.

Adjusted the stem to ask what does OP-901-510 say to do first.

Adjusted the stem to ask what does OP-901-510 say to do first.

Changed the stem from two minutes to one minute to ensure that there is time to override the isolations to the AB header. Question accepted.

FIRST TEN. Change "will" to "should" in stem. Add "the" before "required" in the third bullet. On the seventh bullet, are both temperature and pressure steady?In the last bullet add 88 H 3 X N E B "operator" after "BOP" or writeout balance of plant operator. In answer explanation B, edit "an RAS" to be "a RAS." Question revised, Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. Change "will's" to 89 F 2 X N E A "should's" in stem. Question revised, Question accepted.

Change "will" to "should" in stem.

Changed "will" to "should" in the stem. Proposed answer says C is the correcty answer and explanation says D is the correct answer.The answer is D and I have corrected the explanations.Question appears to be a generic EDG operabilty question. Don't see anything here regarding correct/control/mitigate water buildup in the EDG cylinders (K/A mismatch). Part 2 of the question is what we are using to meet the portion of the K/A for mitigating water buildup in 90 H 3 X X X N U D 43.5 the EDG cylinders. This is the only guidance we have for water buildup and will have to change the K/A if this is not good enough.

Part 2 is relevant for the SRO because it is operations that performs this sample and it must be coordinated with security and signed off in the surveillance. Add CR to references concerning water in the diesel feed tank.

Changed the K/A. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 FIRST TEN. C and D do not appear credible. Do not see how one might think letdown would go to "minimum flow" when there is zero charging pump flow. There is no explanation as to how this 91 H 3 X N U B could be plausible. Answer A is a subset of Answer B and partially correct. Answer choice explanations expanded, question accepted.

Change "will" to "should" in 92 F 2 X N E A 43.5 stem.Changed "will" to "should" in the stem. Question accepted.

Change "will" to "should" in stem.

Changed "will" to "should" in the stem. The (2) answers do not grammtically fit when inserted into the stem. Changed the root such that the answers fit grammatically

.Hard return after discharge.

93 F 2 X X N E D 43.2 Inserted a hard return after discharge. Please revise. Revised as requested and reworded to more closely match the works in the TRM. Question accepted.

FIRST TEN. Change "will" to 94 F 2 X N E B 43.7 "should" in stem. Question revised, Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Is it plausible that answer choices B and D would be in the Conduct of Operations procedure? Answer B is plausible because maintaining CEAs above the TILs is how we ensure SDM requirements are met at power.

Answer D is plausible because this guidance is provided in OP-010-005 but is not located in EN-OP-115. Both answer B and D are related to the "Conduct of an Operator" and would be correct things to do if an RPS set point was not exceeded. Added these words to the explanations for answers B, C and D as stated 95 H 2 X X N E A 43.5 above. Distractor C - when is informing the CRS ever a wrong thing to do? Removed distractor C and replaced with "Place CEDMCS control switch to OFF".

The explanation for distractor C was updated also. Distractor D is essentially "do nothing" beyond monitoring, which is what the ATC should continually be doing.

Gudiance exists in OP-010-005 for the RO to wait and monitor response. Again, this would be the correct thing to do if an RPS setpoint has not been exceeded.

RO level? This question is SRO knowledge because the trip setpoint for ASI is an aux trip that Question Accepted a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 If one rounds a time to the 1/100 second, isn't it automatically correctly rounded to the 1/10 second as well? Stem cues that some form of the word "actuate" is probable in (1) to match second part of statement. Changed part 2 of the root to "What does OP-903-094 state". OP-903-094 states to round to the 1/10th. Changed part 2 to add this procedure reference and started a new paragraph.

96 F 3 X X N U C 43.3 Added to the explanation for the correct answer "Part 2 is not a substep because the procedure is being quoted". Changed distractor C and D to "initiation of the test signal. Expanded correct answer justification to explain why this is a plantwide generic question. Question accepted.

SRO only knowledge? This question is SRO knowledge.

Reference Step 2 of section 4.0 in EP-OP-115-08 (CRS responsibilities). 1) The CRS approves all decisions made to 97 F 2 X N E C 43.3 disable an annunciator. 2) CRS is responsible for maintaining the Annunciator Out of Service Log in the Control Room. Added this explanation to the description for the correct answer. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 ON 2008 NRC EXAM. SRO only?

- seems like system knowledge. I was able to guess the right answer. Part 1 and Part 2 of the question can only be found in the TS basis for TS 3.7.6.1, which makes it SRO knowledge.

Indentified this in the explanation.

98 F 2 B S A 43.2 This question is generic because there are many events that could cause high radiation at the intake of the HVC filters. Both of these explanations are in the description for the correct answer. Question accepted.

99 F 2 N S A 43.5 Good. Question accepted. a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 Distractors B and C too similar.

Changed distractor B. Step 4 of EP-002-010 attachment 7.1 states that the emergency phone (extension 3500) is transferred to the TSC. Plausible because the communications that are normally performed by operations are the NMF and the emergency phone.

The NMF is transferred to the EOF. However, the emergency phone located at the RO desk is not, it is transferred to the TSC 100 F 2 X X N E D 43.3 Please replace either B or C.

Discuss plausibility of A. Added to the explanation for A. "This is plausible because the NRC is updated along with the operations hotline members by the EOF using the notification message form but continuous communications with the NRC is done in the TSC. See step 5.2.4 of EP-002-010". Added EP-002-010 to the references. K/A mismatch? Not a K/A mismatch.

The candidate requires knowledge of the communication responsibilities of the emergency response facilities. Question accepted.

Results Table RO LOK -H 42 Avg RO LOD 2.58 Flaws 10 CFR Distribution RO LOK-F 33 AVG SRO LOD 2.56 Stem focus 33 41.1 15 43.1 0 SRO LOK - H 14 Overall LOD 2.57 Cues 2 41.2 0 43.2 4 SRO LOK - F 11 T/F 0 41.3 3 43.3 3

%  % Cred Dist 40 41.4 8 43.4 0 RO Bank 15 20 SRO Bank 3 12 Partial 4 41.5 8 43.5 13 a Rev 2

ES-401 W3-2020-08 Written Examination Review Worksheet Form ES-401-9 RO Mod 0 0 SRO Mod 1 4 job link 0 41.6 0 43.6 0 RO New 60 80 SRO New 21 84 units 1 41.7 29 43.7 1

% minutia 0 41.8 1 Total Bank 18 18 backward 0 41.9 1 Total Mod 1 1 KA 8 41.10 15 Total New 81 81 SRO-only 7 41.11 0

%  % LOD = 1 2 41.12 1 RO Sat 25 33.33 SRO Sat 5 20 41.13 0 RO Unsat 16 21.33 SRO Unsat 7 28 Answer Dist ( in %) 41.14 0 RO Edit 33 44 SRO Edit 13 52 RO-A 13 SRO-A 7

%  % RO-B 20 SRO-B 7 Total Sat 30 30 Total Unsat 23 23 RO-C 17 SRO-C 4 Total Edit 46 46 RO-D 25 SRO-D 7 a Rev 2

Question Overlap with the Previous Two NRC Exams QA form ES-401-6 item 4 requires 4 or less questions on RO exam from previous two NRC exams, SRO portion two or less questions from previous two NRC exams*

• if this is exceeded, the region shall call NRR to explain why/reasons.

RO overlap from previous two NRC exams 4

SRO overlap from the previous two NRC exams 2

Questions Requiring References to Answer 6-10 questions rule of thumb on SRO portion of exam are allowed to be open reference, while the RO exam is generally none RO Questions that require hand-outs 0

SRO Questions that require hand-outs 1