ML20276A155

From kanterella
Jump to navigation Jump to search
4-CW-2020-08 Written Exam Comments Final 8-25-2020
ML20276A155
Person / Time
Site: Callaway Ameren icon.png
Issue date: 09/09/2020
From: Greg Werner
Operations Branch IV
To:
Ameren Missouri
References
Download: ML20276A155 (18)


Text

ES-401 CW-2020-08 Written Examination Review Worksheet Form ES-401-9

1. 2. 4. Job Content 6. 7. 8.
3. Psychometric Flaws 5. Other Q# LOK LOD Flaws (F/H) (1-5) B/M/ U/E/S Explanation N

Stem Focus Cred. Dist. Job-Link Backward SRO-Only Cues T/F Partial Minutia #/units Q=K/A K/A m/m - I interpret this K/A statement to be asking what proper actions are to be taken if some required automatic safety function has not taken place. BC comments -

agree with K/A mismatch. Also, dont like Answer C because dissimilar to Answers B recommend saying . . . transition to ES-0.1, Title,. . . vs transition to another EOP U procedure . . . Similar comment for Answer D, . . . transition to the proper OTG.

1 H 3 X N S Would add procedure number and name as in distractor explanation.

LS - Modified stem and answer to make KA match and also incorporated comments on distractors.

[NRC 8/14] - ok Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
3. Check the appropriate box if a psychometric flaw is identified:
  • Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • Cues: The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
  • T/F: The answer choices are a collection of unrelated true/false statements.
  • Cred. Dist.: The distractors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.
  • Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
4. Check the appropriate box if a job content error is identified:
  • Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
  • #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • Backward: The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only. (K/A and license-level mismatches are unacceptable.)
6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.
7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met). _Rev 3 Page 1 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 2 Form ES-401-9 Explanation states the distractor of not allowed due to subcooling is if the adverse containment minimum of 50F is used - this doesnt make sense, this is the correct answer regardless of adverse CTMT.

Edit - several of the explanations dont match the distractor / answer. Was this modified or 2 H 3 N S new?

[NRC 6/29 - Revised Question provided]

PBS - previously fixed on 6/16/2020 Add to explanation that 1 CCP running is plausible (but wrong) if applicant believes that the corresponding trains RHR pump is necessary for cold leg recirculation.

3 3 H 2

N S Change LOD = 2 PBS - updated explanation and changed LOD to 2 Clarify the explanation:

The Shaft vibration component has 2 actionable limits:

  • ALL RCPs vibration on the shaft -NOT LESS THAN 20 MILS (Step A1) 4 H 3 N S
  • ALL RCPs vibration on the shaft - NOT LESS THAN 15 MILS AND rises at a rate greater than 2 Mils/hr. (Step A2 and RNO)

PBS - updated explanation Where is the basis for this answer found? Correct answer B is a true statement, but distractor D is also a true statement, it seems. What is in writing? In general justifications such as while a positive side effect of maintaining CCW flow it is not the basis are high risk for appeal.

Distractor A - Clarify what the plausibility of this is, Im unclear on the intent of what is implied.

LS - Added bases from FSAR to explanation and removed positive side effect from E explanation 5 F 3 X X N S

NRC - I still dont like D. It is a true statement and the explanation supports that. It could be argued an implicit correct answer regardless if it is explicitly documented in the FSAR or not. Replace or revise distractor.

NRC - Dist D Replaced. OK.

What Is the purpose of including Excore Nis in distractor D? Is this a plausible indicator for a E

6 H 3 X N S

leak, vice just repeating Radiation Monitoring? BC comments - agree that Excore Nis is NOT a valid distractor. I agree with your comment about repeating radiation monitoring -> keep _Rev 3 Page 2 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 3 Form ES-401-9 answers similar A and B, then C and D. I would classify LOD as 2, since fairly simplistic in nature.

PBS - updated choice D to " Surge tank level AND Radiation Monitoring" and changed LOD to 2 and clarified explanation NRC OK.

2016 NRC #6 The part (2) choices are determined by knowing what the specific temperature limit for the bearings and stator windings are. It doesnt make sense to alternate 0903 and 0905 in part 2, unless there was some plausible reason that 193F (Motor bearing) and 317F (Stator Windings) would be choices the applicant might consider. It would be better to make A and D part (2) equal to 0908, and the applicant would have to consider if 10 minutes was allowed before E

7 H 3 X B S

tripping the RCP. OR, find some other plausible but wrong trip value for each component.

PBS - updated part 2 choices in part B and D (not A and D as indicated above) to 0908 in order to maintain the 2 x 2 presentation with the other choice as 0903. Time 0905 was completely removed from the question. Updated explanation.

NRC OK.

8 H 3 B S 9 F 3 N S REFERENCE 10 H 2 M S Pre-Review Very flawed question - replace.

Dist A: Why would a longer RCS cooldown time cause PTS? Not logical.

Dist B: Given no other conditions in the stem, why is B wrong? S/G pressure is to be assumed below RCS pressure.

Dist D: Overfilling a faulted dry S/G is about the least likely concern, unless its a result of rupturing it first. Not logical. BC comments - agree with Ans A and D not being valid for reasons given. Since you cant assume any plant conditions than other than the stem, you only U have a faulted NOT a ruptured S/G as well, so I believe Ans B is ok???

3 11 F X N E 2

S LS - Changed KA from 000040 AK1.07 to 000040 AK1.05 and replaced question NRC 8/17 - There are no justifications for why positive is a plausible answer choice for reactivity.

NRC 8/18 - OK, minimally acceptable, LOD = 2. _Rev 3 Page 3 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 4 Form ES-401-9 PBS - updated LOD to 2.

Distractor D: If the entry conditions for OTO-AE-00002 are satisfied (they are), what station policy directs that the crew MUST enter OTO-AE-00001 FIRST? This could be justified as an additional correct answer.

E 12 H 2 X N S

PBS - updated the stem and explanations.

NRC OK.

13 H 3 N S 14 H 3 B S NRC 2019 #13 Explanation states Both the PORVs and the Spray Valve can / will discharge into the PRT -

I dont understand how the PZR Spray Valve can/will discharge into the PRT. In that light, I dont see how Distractor C is plausible/logical.

E 15 F 3 X M s PBS - revised question and changed the part 2 distractor to "to prevent exceeding PZR temperature change limits" and revised explanation.

NRC OK.

NRC 2017 #3 Pre-Review Question does not meet criteria for Modified because no pertinent condition was M

16 F 3 B

S changed in the stem. Question counts towards limit on bank use from last 2 NRC exams.

PBS - question explanation updated to indicate bank question 17 F 4 B S 18 H 3 B S NRC 2005 19 H 2 N S 20 H 2 N S Pre-Review 21 H 2 N S 22 F 3 B S NRC 2005 23 F 3 B S NRC 2016 #22 24 H 3 B S 25 H 3 N S _Rev 3 Page 4 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 5 Form ES-401-9 NRC 2009 This question feels like cueing since the only alarm given in the stem is the correct answer.

Distractor B: What makes this option explicitly wrong?

Distractor D: What is a containment spray line rupture and wouldnt that just be the same effect E

26 H 3 X B S

flooding wise as containment spray actuation?

LS - Removed alarm from stem and changed distractor D and clarified distractor B explanation -

NRC OK.

Its not clear to me what is incorrect about Distractor C. It has all of the same elements as correct answer B except minimizes RCS heat input, and additionally has provides Boron mixing which could be argued true. The explanation isnt helping me and doesnt seem to be E addressing the distractor as written.

27 H 3 X B S

LS - Modified answer and distractor C for clarity -

NRC OK.

NRC 2009 28 H 2 M S REFERENCE 29 F 4 N S Delete Assuming NO ACTION by the operator from the stem, and add until operator action is taken to both A and B.

30 H 3 B S PBS - updated as directed Stem should read, in-vessel.

The discriminating factor for this question is effectively just whether the applicant recognizes that the plant is in Mode 6, which is told in the stem, and is implicit by the fact that in-vessel fuel movement is in progress. Answer can be divulged without knowledge of the K/A by recognizing the S/Gs arent the heat sink in Mode 6, which eliminates all 3 distractors. Non-discriminatory.

BC comments - Confirm this is required RO knowledge.

U LS - Changed KA from 005 K3.07 to 005 K3.01and replaced question 31 H 3 X N E S

NRC - Specify in answer B its RHR heat exchanger, like with C and D.

Answer B, C and D all cause RHR HX flow to increase. Do you have any objective data, either training material or systems data, to back up B as the single right answer for this question that causes cooldown rate to increase the fastest?

NRC 8-18: OK, but check the accuracy of this statement in explanation: This will slightly increase flow thru RHR heat exchanger but since EJ-HCV608 does not change _Rev 3 Page 5 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 6 Form ES-401-9 position, therefore total RHR flow (on EJ-FT618) will go down resulting in slightly higher cooldown rate.

PBS 8/18/2020 - revised explanation to better explain system operation and effects of failures on the RHR system NRC OK 32 H 2 B S A and B part 2, modify to At least ONE RTB open.

E 33 F 3 X N S

PBS - updated as directed NRC OK.

NRC 2005 This question was effectively the same on NRC 2011 exam, Q34.

Modify A and C part 2 to Vent the PRT to the Shutdown Gas Decay Tank Modify B and D part 2 to drain the PRT to the Reactor Coolant Drain Tank this is preferred over the Containment Sump, and more plausible, correct?

E 34 H 3 X B S

PBS - draining the PRT to the RCDT or the containment sumps are both options present in OTN-BB-00004, PRT. RDCT would be preferred for plant conditions in the stem therefore, both part 2 changes made as directed. Rearranged choices to make D the correct answer vice C as per general comment. Updated Last NRC Exam information to 2011.

NRC OK.

Recommend adding a trend for A CCW Surge Tanks Level in stem.

35 H 2 X B S PBS - added the trend steady for 'A' CCW Surge Tank level.

The stem construction doesnt flow with the fill-in-the-blank format it is using. Modify such as:

During a plant cooldown on RHR, CCW heat exchanger outlet temperature is allowed to reach

___(1)___, MAXIMUM, for up to the first ___(2)___ hours of cooldown.

E 36 F 3 X N PBS - updated the stem to state " During a plant cooldown on RHR, CCW heat S

exchanger outlet temperature is allowed to reach ___(1)____, MAXIMUM, for up to the first ___(2)___ hours of the cooldown."

NRC OK.

The formatting of your 2-part questions is not consistent across the exam. Some are 37 F 4 X N S numbered, some are not (like this one). _Rev 3 Page 6 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 7 Form ES-401-9 PBS - apologize. This was correct to the standard presentation The stem numbering should be at the beginning of the question or in the blank, not both. And the blank should either be a line, or dots, but not both. Part (1) should not have a question mark at the end of it. The meat of the question is fine but the stem needs cleaned up (generic 38 F 3 X N S comment).

PBS - updated as directed 39 H 4 N S 40 F 3 B S NRC 2016 Question does not meet criteria for Modified because no pertinent condition was changed in the stem. Slightly rephrasing the wording of the stem is not a pertinent M

41 F 4 X B

S modification. Otherwise satisfactory.

PBS - update information in stem to indicate bank Clarify in stem, If the Containment pressure trend continues linearly What is the basis for 75 seconds (Dist D)? I dont understand what CSAS actuation not added to CS pump start means.

E 42 H 3 X N S

PBS - stem updated as directed. Updated distractor explanation for 75 seconds (choice D)

NRC OK.

Clarify in stem, the MINIMUM achievable required combination The explanation for Dist C implies that this combination would be allowed -- This combination is not allowed for plant conditions.

E Is this question supposed to be Reference Provided? The original bank Q was.

43 H 3 X M S

PBS - no reference was to be provided. Updated stem as directed and updated explanations.

NRC OK.

44 H 3 N S Pre-Review 45 F 3 B S NRC 2019 #43 46 H 3 B S NRC 2016 NRC 2013 B E Distractors A/D: Distractor balance is not a justification for plausibility. Either provide a better 47 H 2 X M S justification for why A and D are plausible as written, or modify question stem or distractors. No SGs are being fed would be plausible if applicant thought A MDAFP lost power, for example, _Rev 3 Page 7 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 8 Form ES-401-9 and All S/Gs are being fed if applicant thought the cross-connect valves were already open (they shouldnt be).

PBS - Changed A and D choice as indicated above. updated stem which changed the correct answer to D from C. Marked as modified question instead of bank. Update explanations.

NRC - I dont like that we are telling the applicant the status of one AFP (A MDAFP) but not telling them the status of TDAFP, and expecting them to guess that TDAFP is fine and feeding all SGs.

Id like to restore the original stem, and Replace 2 implausible distractors with No / All SGs are being fed as discussed in original comment.

BC comments: recommend changing the stem to leave NB02 is locked out and adding All other plant equipment responded as designed. The candidates should know what equipment started and the capability of the equipment. Delete the info on A MDAFW pump.

NRC - Changes incorporated. OK.

48 H 2 B S NRC 2016 Make sure name plates are readable when printed, consider enlarging image if necessary.

49 H 3 M S PBS - Understood - FYI Validation feedback indicated they were able to read the name plates 50 H 3 B S NRC 2019 51 H 4 N S Add semi-colon between the two different parts of the answer, or otherwise make it a more clear separation.

Add to the beginning of A and B, Trip of a running Service Water Pump and Auto start if this is necessarily true of the given conditions.

Clarify in Dist C Trip of a running service water pump E

52 H 4 X B S

PBS - semi-colon added between parts of the answer. Added to the beginning of choices A and B, Trip of a running Service Water Pump and". Capitalized "Water" in choice D. Clarified Choice C as indicated.

NRC OK. _Rev 3 Page 8 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 9 Form ES-401-9 NRC 2016 #52 This K/A seems like it should be testing on emergency makeup sources or backup sources of Service Water. E due to being previously used for this K/A on an NRC exam.

PBS - Callaway's plant design is such that the emergency backup to the service water system is ESW, i.e. Essential Service Water system. This question does examine the E backup SW supply as ESW will get an autostart on the shutdown sequencer from the 53 H 3 X B S EDG starting due to the NB02 undervoltage. This question further examines the relationship between SW and ESW, as ESW discharge pressure is higher than SW and a check valve will seat separating SW loads and Essential Service Water loads aka turbine building loads or aux building loads. As ESW takes the Aux building loads, SW flowpaths will be restricted thereby raising system pressure requiring operator action which test the cause and effect aspect of the K/A. No change was made.

NRC OK.

54 H 3 B S 55 F 3 N S Pre-Review Id prefer for increased plausibility to modify A and C part 2) to The crew may attempt to reset the alarm once, before directing I&C troubleshooting actions IF this is explicitly wrong.

PBS - fixed spelling error in choice D "resetting". No change was made to part 2 of E choices A & C as the procedure does not include that action for this type of failure and 56 H 3 X N S my concern is that someone could argue that there is no correct answer if reworded.

NRC: Add to stem part 2, Per OTO-SF-00001, NRC OK 57 H 2 B S NRC 2004 58 F 2 N S Modify A and B part (1) to Minimal Change, since its possible there would be some change if highest indicating CET failed.

E 59 H 3 X B S PBS - Updated choice A and B as directed NRC OK.

60 F 3 B S NRC 2014 _Rev 3 Page 9 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 10 Form ES-401-9 Simplify stem to:

(1) On a reactor and turbine trip, a reactor at 40% power will experience [more/less] SG shrink than a reactor at 20% power (steady state)

(2) S/G level in a stabilized idle loop will be [higher/lower] than in the active loops immediately E following the reactor/turbine trip.

61 H 2 X N S

PBS - updated stem as indicated above but did not include the phrase "steady state".

Corrected the fill in the blank style opening as indicated earlier.

NRC OK.

62 H 3 M S 63 F 3 N S 64 F 3 N S How do you know the standby service water pump auto started leaving the same number of SW pumps as before the damage?

Distractor A, Trip Turbine and go to OTO-AC-00001 Turbine Trip Below P-9, is not plausible with Reactor power at 80%.

E 65 H 3 X N S LS - Auto start of standby SW pump is automatic action from Ann 12A Changed distractor A to Trip the reactor and main turbine and proceed to E-0, Reactor Trip or Safety Injection NRC OK.

66 F 4 N S 67 F 3 N S 68 F 3 N S Confirm that this knowledge of 50.59 requirements is RO knowledge.

Modify Stem Tags may permissibly be placed E

69 F 3 X M S

LS - Modified stem as requested and 50.59 requirements are RO knowledge NRC OK.

70 F 2 N S For part 2, modify to a __________ should be issued , since an RO would not be the one issuing the Night Order (but should still understand this requirement).

E 71 F 4 X B S PBS - updated stem as indicated. Changed the order of distractors and answer to address general comment of too many Correct Answers of C. Correct Answer is now A.

NRC OK.

72 F 2 N S _Rev 3 Page 10 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 11 Form ES-401-9 NRC 2009 LOD = 1, replace.

E due to previous use on an NRC exam.

H 2

B E LS - Replaced question 73 1 X F N S 2

NRC - the titles of the column dont match the answers. Stem needs cleaned up.

NRC - OK - Changed to memory/fundamental.

PBS 8/18/2020 - changed to lower order 74 F 3 N S Pre-Review Distractors B and C dont bear a relation to the plain language definition of the word TRY, and it is not plausible that an applicant would think either of these choices mean TRY, regardless of level of plant knowledge. BC comments - agree with comment about Ans B and C.

U 75 F 3 X N S LS - Modified question into 2 by 2 using answer and distractor D as suggested by TJ on 8/6/20.

NRC - OK.

Stem: the above event is required to be reported under 10 CFR 50.72 as I dont like Valid system actuation as a distractor, Id prefer to use the other one, Nuclear plant, including principal safety barriers, seriously degraded.

E 76 F 4 X N S PBS - updated the stem and distractors as indicated above. Rearranged choice of answers due to general comment of too many C's. Correct Answer now is A.

NRC OK.

77 F 3 B S NRC 2019 #79 Parts 1) and 2) should be swapped.

Clarify stem, what procedure should be implemented by the CRS to address the malfunction?

E 78 H 3 X M S

PBS - included both comments NRC OK.

NRC 2014 REFERENCE 79 H 2 B S BC comments - I couldnt find Procedure OSP-NE-0003 in the references. Is the SRO expected to know this value listed in Att 5 of the procedure? Seems way too deep. This is not even reference in the TS 3.8.1, which I thought it might be. _Rev 3 Page 11 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 12 Form ES-401-9 PBS - Category 8 alarms are trained and required knowledge for SROs has part of the operability of offsite sources and stressed as part of NERC/FERC requirements established from the northeast blackout response. Callaway's Facility Rep approved the question.

Changed punctuation from ? to a period.

NRC OK.

Pre-Review Stem, split the CRS should direct into a separate line.

Modify the second part of each answer to To ensure discharge pressure does not exceed a maximum of [2/24] hours at up to 85 psig.

PBS - reworded the stem to:"

(1) For the given plant conditions, what is the applicable system limitation?

E 80 F 2 X N S And (2) The CRS should direct which section of OTN EA-00001, Service Water System?"

Updated the second part of each answer as directed but removed the "To".

Updated 2x2 format to match other questions, change order of distractor and answer to address general comment of too many C correct answers. Correct Answer is now A.

NRC OK.

81 H 3 B S NRC 2017 #80 NRC 2013 REFERENCE Pre-Review If S/D Bank A Rods D2 and B12 failed to move, why are they at 228 steps when the rest of the E

82 H 3 X B S

bank rods are at 210?

Why do S/D Bank Step Counters A1 and A2 indicate different (212) rod position indication on SF-074 for the normally positioned rods?

LS - per discussion with TJ on 8/6/20, disregard his comments 83 F 3 B S 84 H 3 N S Pre-Review REFERENCE 85 H 3 M S Pre-Review 86 H 2 X X N E Stem AN ESFAS status .. _Rev 3 Page 12 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 13 Form ES-401-9 S Specify what component BG-LI-185 is.

Specify which SG NR level indication fails low on each SG.

Part 2), are the entry criteria for both of these procedures met? If so, then need to modify stem to clarify. What makes OTO-BG-00004 explicitly wrong?

LS - modified stem as requested NRC OK.

Modify part 2) to Every 10 to 20 minutes.

E 87 H 4 X N S PBS - updated part 2) as directed NRC OK.

NRC 2014 Part 2) appears to cue the answer to part 1), since all choices include entry into TS 3.8.7 Inverters, implying Inverter NN14 is INOP. Why would you enter 3.8.7 Inverter Tech Spec if the E inverter was Operable?

88 H 2 X B S E due to previous exam use.

LS - Modified stem and 2 distractors NRC OK.

NRC 2013 B AND D part 1), how is low lube oil temperature plausible/logical after a 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> run?

LS - Changed distractors B and D part 1 NRC - What makes Lube oil temperature will be > 165F incorrect for E

89 H 2 X B s given plant conditions? Might it be > 165F? Explanation just states what to do when LO > 165, not why it is explicitly wrong. If it might be >

165 (in addition to oil build up in exhaust), then D could technically also be correct.

NRC - Explanation clarified. Ok.

Explanation states All Choices were limited to CRVIS (ie no FBIS) to prevent non plausible distractors. Why no FBIS - does it actuate? Explain this further.

If FBIS actuates, clarify in stem, In addition to [FBIS response procedure], what procedure(s)

E should the CRS direct?

90 H 3 X N S

LS - Modified stem for CRVIS only NRC - OK _Rev 3 Page 13 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 14 Form ES-401-9 91 H 4 B S Dist A part 2), it is not logical that you cant continue fuel movement with 1 ARM INOP but you CAN continue fuel movement with 2 ARM INOP if you restore both ARMs in 30 days.

Dist B, better to modify to Restore ONE channel Dist C, same problem as Dist A described above.

Overall, part 2) is problematic in combination with part 1), due to logic issues. Going to need to find a way to modify the wording away from a clean alternating 2X2 format to make it work.

BC comments - agree LS - Modified question to 2 by 2 NRC 8/17 - the wording still isnt working with the part (2) distractor in relation to the stem. Modify stem to What is the minimum required action to allow continued new U fuel movement operation, per FSAR 16.3.3.7?

92 H 3 X N E New fuel movement may continue so long as ONE channel is restored to functional S status WITHIN 30 days. VS New fuel movement may continue when a portable continuous monitor with the same alarm setpoint is installed, for UP TO 30 days.

NRC 8-18: New question doesnt reflect the part (2) choices above. To prevent confusion, modify to new fuel movement may continue for UP TO 30 days, by which time ONE channel must be restored. Vs New fuel movement may continue when a portable continuous monitor with the same alarm setpoint is installed, for UP TO 30 days, by which time ONE channel must be restored. I do not want to test on restoring 1 channel vs 2.

PBS - 8/18/2020 updated as indicated above.

Nrc ok.

REFERENCE Ensure EAL wall chart being provided doesnt help answer Q91 or any other question with a nexus to EALs. Redact if necessary.

93 H 3 N S PBS - Reviewed SRO section and I believe that question #93's reference doesnt help answer any other question. If there is a specific concern with cueing Q#91, we could consider giving on the "hot mode" EALs as a reference in this question. Q#91 stem states that the plant is in Mode 6.

Nrc ok. _Rev 3 Page 14 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 15 Form ES-401-9 REFERENCE Put the chemistry results in a lined up table for easier reading in columns.

94 H 3 N S PBS - included table of chemistry results, minor reformat of stem to make it easier to read.

95 F 4 B S Take a harder look at this question. I want to make sure that the language of each answer choice is sufficiently differentiated and specific to be considered mutually exclusive, without overlap. Is 50.59 screening considered a wholly-separate process from 50.59 evaluation, or could it be considered a subset of a 50.59 evaluation? Please provide CA2511.

Distractor B, be more clear about what is meant by in compliance with Technical Specifications. Failure to satisfy an LCO but implementing the action statements would be in compliance. In compliance with Technical Specification LCO?

Distractor D, without performing a 10CFR50.59 evaluation - change to a 10CFR50.59 evaluation is not required.

E 96 H 3 X B S

BC comments - is there enough information to determine if it would or would not screen out?

Im not a 50.59 inspector, so have to look at the procedure or NEI guidance document. Need to include Design Change and Temporary Mod procedures in references.

LS - modified distractors as required and included CA2511 in folder NRC - I dont see an answer to the highlighted question above, and I dont have CA2511. If we talked about this onsite at validation I dont recall.

NRC - Explanation clarified. OK.

97 F 3 N S 98 F 4 N S Add, per EIP-ZZ-00230, Accountability to end of stem.

99 F 3 B S PBS - updated stem as directed Dist C is technically true. I dont like to use a distractor that is technically true.

Dist D is technically true.

BC comments - the explanation for the various answers are VERY DIFFICULT to follow. Almost uses a circular logic. I think Ans A is technically true as well. Almost trying to trick the U applicants with answers vs. providing easily understood answers.

100 F 2 X N E S

LS - maintained K/A and replaced question NRC - I am struggling with this replacement. Correct answer A can be overturned if an applicant can provide any additional basis for CSF hierarchy beyond prevent _Rev 3 Page 15 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 16 Form ES-401-9 radiation release, since the answer contains only, and is just a paraphrase. The three distractors are the 3 Fission Product barriers, not bases, and its not plausible to just pick one of the 3 at the SRO level. Finally, the questions is not actually testing on the hierarchy of CSFs, its testing on the 3 FP barriers and the overall goal of CSFs, paraphrased. Does the ERG provide a basis for why CSFSTs are addressed in the order they are? That would be the better question for this KA.

QUESTION REPLACED NRC 8/18 - Is the Field Supervisor explicitly the individual responsible for initiating the Fire Impairment Permit, or is he/she just one from among Control Room watch standers, Field Supervisor and Work Control Center Operating Supervisor who is authorized to submit it? Modify stem to Which of the following positions could be required to initiate the Fire Protection Impairment Permit, Per APA-ZZ-00701, section 4.3, Planning Unscheduled Impairment? I dont generally like to use could, but I want to avoid the argument that Field Supervisor is not the sole position with this responsibility.

PBS 8/18/2020 - updated stem by asking "which group" and changed potential answers to control room and work planning NRC OK. _Rev 3 Page 16 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 17 Form ES-401-9 GENERIC COMMENTS For handout sheets, label each separate handout with the question it is intended for. Ensure that ROs are not being given handouts for SRO exam.

Some answers changed from C to A or D for better answer balance.

If youre going to include an entire P&ID drawing as a reference, at least mark it up to identify where/what piece of information the reviewer is intended to be looking at, especially if youre not going to include excerpts in the question worksheet.

PBS Comments I revised the exam title on this document to CW-2020-8 from CW-2021-8.

My practice with handouts is to include them after the applicable Question. The applicants have seen this during their training and are use to this practice. I can add headers or text boxes but it will be unnecessary.

There are _2_ RO questions with handouts provided and __5___ SRO questions with handouts provided.

Bank Qs from last 2 NRC Exams (2019, 2017): RO - 4, SRO - 2 _Rev 3 Page 17 of 18 OBDI 202 - IOLE Process

ES-401 CW-2020-08 18 Form ES-401-9 Results Table RO LOK -H 45 0.6 Avg RO LOD 2.91 Flaws 10 CFR Distribution RO LOK-F 30 0.4 AVG SRO LOD 2.96 Stem focus 20 41.1 0 43.1 5 SRO LOK - H 16 0.64 Overall LOD 2.92 Cues 3 41.2 0 43.2 6 SRO LOK - F 9 0.36 T/F 0 41.3 4 43.3 1

%  % Cred Dist 12 41.4 4 43.4 1 RO Bank 28 37.3 SRO Bank 11 44 Partial 6 41.5 7 43.5 11 RO Mod 9 12 SRO Mod 2 8 job link 0 41.6 5 43.6 0 RO New 38 50.7 SRO New 12 48 units 1 41.7 23 43.7 1

% minutia 0 41.8 1 Total Bank 39 39 backward 0 41.9 1 Total Mod 11 11 KA 2 41.10 25 Total New 50 50 SRO-only 0 41.11 2

%  % LOD = 1 0 41.12 2 RO Sat 49 65.3 SRO Sat 13 52 41.13 0 RO Unsat 4 5.33 SRO Unsat 2 8 41.14 1 RO Edit 22 29.3 SRO Edit 10 40 Answer Dist (%)

%  % RO-A 15 SRO-A 4 Total Sat 62 62 Total Unsat 6 6 RO-B 20 SRO-B 5 Total Edit 32 32 RO-C 25 SRO-C 9 RO-D 15 SRO-D 7 Note: Sat/Unsat percentages reflect original draft submittal. All questions administered were Sat. _Rev 3 Page 18 of 18 OBDI 202 - IOLE Process