ML21356B727
| ML21356B727 | |
| Person / Time | |
|---|---|
| Site: | Byron  |
| Issue date: | 10/28/2021 |
| From: | Gregory Roach NRC/RGN-III/DRS/OLB |
| To: | |
| Roach G | |
| Shared Package | |
| ML21055A847 | List: |
| References | |
| Download: ML21356B727 (35) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021 B YR 2 1 Ans. 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (A-D) (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only
NRC The question is testing whether the applicant understands that the reactor tripped and that bypass breaker A is open, and therefore, per BEP-0, they must manually trip the reactor.
- 1. Are Bullets 4-7 supposed to be a subset under Bullet 3?
If so, they should be indented more than Bullet 3..
B-E 2. The diagram is a bit difficult to read (i.e., to see the letters 1 A H 2 X BWD S over the colors). Is there anything we can do to improve 2018 that?
- 3. For the part of the diagram showing bypass breaker A - if I am reading it correctly, it shows red lit for rx trip breaker A and B, too. Is that a problem? Also, for bypass breaker B, would green be lit?
- 4. The stem says, What is the NEXT procedurally required action? However, it does not say that the crew has entered any procedure. Should the stem say something
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 35 ES-401 2 Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
like, The crew just entered 1BEP-0 or something like that?
This question has a reference (diagram of rx trip and bypass breakers from 1PM01J) in the stem.
Response: No, bullets 4-7 are not a subset of bullet 3. Bullet 3 states the stem drawing is for the reactor trip breaker indications.
Bullets 4-7 are separate 1PM05J indications. Replaced drawing with a photo. No, that is correct configuration for the breakers. Red lit for RTA and RTB indicate they are both open. Red lit for BYA indicate racked in and closed. BYB is racked out, so no lights are lit. Providing the procedure entry in the stem would be cueing the correct answer.
NRC: Revised question is satisfactory.
NRC:
The KA is, Knowledge of the reasons for the following responses as they apply to the Pressurizer Vapor Space Accident: ECCS U termination or throttling criteria. I dont think the question meets 2 D H 2 X N S the KA since it is testing whether the applicant knows the differences in ECCS termination criteria for adverse containment conditions vs reasons for those criteria (U).
Response: Agree with comment. Revised question to meet K/A.
NRC: Revised question is satisfactory.
NRC :
- 1. Is the word IMMEDIATE in the step accurate and also needed? The OAS does not say it, and Im thinking it should not be uppercase, or even included at all.
- 2. I think you need to add a statement that the crew has entered 1BEP - 0.
- 3. T he stem says total SI pump discharge flow, but the procedure does not say total pump discharge flow. I recommend rephrasing the question like this: If RCS E pressure reaches ___1___ and SI pump discharge flow 3 D H 2 X N is ___2___, then the RCPs must be stopped IAW 1 BEP S 0.
- 4. Please explain why 150 gpm is plausible. If they confuse high head SI flow and SI pump flow criteria, would something less than 100 GPM would be more discriminating?
Response: Immediate is probably not necessary. Removed IMMEDIATE. Added statement that crew is in 1BEP-0. Revised stem questions as suggested in item 3. Did not change distractor.
If distractor was less than 100 gpm, then R CP trip would not be required even if they confuse high head SI flow and SI pump flow.
Page 2 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC: Revised question is satisfactory.
B-NRC 4 D H 3 BWD S Response: None 2020 NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the AOPs.
E With no indications of an alarming or rising 2PR09J in the stem it B-doesnt appear that 2BOA PRI-6, Attachment B, Step 6 would get 5 A H 3 X BWD you to assess isolating the 2A RH HX.
2009 FREE SAMPLE #1 S Braidwood 2009 NRC ILE (Q44)
Response: Added stem statement 0PR09J and 2PR09J Rad Monitors are at ALERT alarm and rising.
NRC: T his question is now SAT.
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only B-NRC:
6 C H 3 BWD S Response: None 2016 NRC:
- 1. The stem says, I f the EO performed the following actions in the listed order, by placing the associated control switch in PULL OUT, WHEN would the reactor trip?
however, placing the control switches in PULL OUT to shutdown both MG sets is Step 6.a.2, and opening both MG set generator side breakers is Step 6.a.3, so are the breakers really opened by placing the control switches in B - E PULL OUT?
7 B H 3 X BWD S 2. Given there are multiple ways the reactor has already 2011 failed to trip in this situation, I think it would be more appropriate to word the stem like this: The operator should expect the reactor to trip when the following actions(s) is/are complete: vs when would the reactor trip.
- 3. The procedure says to open both MG set generator breakers before opening any MG set motor side breakers. So its not ideal to have the stem say the operator is going to do the actions in the order listed, but in reality would not need to do actions 3 and 4 if the Rx is Page 3 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
going to trip after action 2 is done. I think we need to re-word the stem and perhaps answer options. (note - it looks like the bank question also provided the actions in an order that is not per the current version of the procedure, so lets not use the options as presented in the bank question.)
Response: Step 6.a.3 is an alternate way to trip the generator breakers IF the control switches in step 6.a.2 did not work. By changing the question to read expected makes the question subjective. Candidate should not assume that something does not work as intended unless told so in stem.
Disagree with comment item 3. The operator should complete the step 6.a.2 by procedure usage rules even though the reactor would trip midway through the step. The closed bullets in procedure step 6.a.2 dictate that the steps can be performed in ANY order. The operator would not need to perform step 6.a.3 because the reactor will be tripped after step 6.a.2.
NRC: Actions are all contained in 6.a.2; nothing is in 6.a.3.
Question is sat.
NRC:
- 1. Please capitalize first letters in first words of options A and C.
- 2. The stem starts out with, During a design basis SGTR event, but the reference cited for the correct answer is BD-EP-3, which provides the basis for steps in E-3. E-3 does not use a time limit as criteria for closure of the AFW valves; it uses SG NR level. So the question asks about a basis for an event described in the UFSAR, but the answer is from the basis document for an EOP B-procedure step - this may be misleading to some BWD E applicants and create confusion. To be more accurate 8 C F 2 X COPS and more clear, I recommend saying instead, What is exam S the reason for closing the AF isolation and throttle valves to a ruptured S/G IAW E-3? or something like. Also, operators operate by procedure, not the UFSAR, so this would be a more operationally valid way of phrasing the question.
- 3. The explanation for why Distractor A is plausible does not seem to be relevant since E-3 does not use a time limit (it uses NR SG level). How is it still plausible, or is there another distractor that would be better to use?
- 4. Distractor D - I think it would be better to say just, promote thermal stratification, since minimize SG cooling to promote thermal stratification does not seem to be plausible
Page 4 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: Agree with comment to capitalize first letters in first words of options A and C. Letters capitalized. Agree with comment on question wording. Made suggested change. Believe Distractor A is relevant. The SG level criteria in the procedure specifies a minimum level, while the question is asking about an action to prevent a maximum level. There is no specified time limit in 1BEP-3, however operator performance criteria in the simulator is based upon performing the procedurally required actions within the time limits specified in the UFSAR. Agree with comment on Distractor D. Made suggested change.
NRC: Add to distractor D that BD BEP 3 is the basis for promote thermal stratification to be plausible.
Byron: Added WOG BD from BEP 3 explanation for thermal stratification to the explanation of Distractor D.
NRC: Question is sat.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to emergency conditions for (RPS, ESFAS, FW) multiple systems.
- Stem: Instead of saying that there was a large steam line break, I would rather provide them the indications they would see, such as, Unit 1 was at 100% power when the crew observed all steam generator pressures and Tave lowering and reactor power rising. The following events occurred: This would be closer to what they E would see in the plant, on the job.
- Answer explanations, for Answer B: Should this say 9 B F 2 X N instead, Auto FWI signals are P-4 combined with either low Tave, SI, or P-14?
S FREE SAMPLE #2 Response: Made suggested change to question stem. Reformatted Answer B explanation for clarity as shown below.
B - Correct: Auto FWI signals are:
- P-4 combined with Low Tave
- P-14 The SI actuation would preempt the P-4/Low Tave signal and actuate FWI.
NRC: This question is now SAT.
10 D H 2 X X X N U NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3)
Page 5 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
progression of an event, OR 4) assessment of integrated plant response to emergency or abnormal situations crossing several S plant systems and/or safety functions.
The question is a KA mismatch in that it does not require the applicant to differentiate plant conditions under a loss of all FW pumps versus just a loss of 1 FW pump. The stem just gives a condition where a loss of 1 FW pump results in a loss of all running FW pumps.
Based on plant conditions in the stem why wouldnt operators just start Aux Feedwater per 1BOA SEC-1, Attachment D Step 2. S/G pressure should be greater than 650 psig. If that is not the case, it is not easily determined whether it would be based on the data provided in the stem.
Would applicants be expected to memorize steam table info? This seems like a reference which would be provided.
1BOA SEC-1 seems to be incorrectly named in the stem. It should be titled, Secondary Pump Trip.
FREE SAMPLE #3 Response: Replaced question with a new question.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the AOPs.
This question is now SAT.
NRC:
B-The stem says, per BOP MS-6, LOCAL MANUAL OPERATION 2019 E OF THE SG PORVs - this level of detail does not seem to be 11 A F 3 X BWD S necessary and can be deleted.
Exam Response: Agree with comment. Made suggested change.
NRC: Revised question is satisfactory.
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only Page 6 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC:
Given the stem tells the candidates that there are saturated conditions somewhere, why do you think anyone would choose options that would limit the cooldown rate (B2 and C2)?
Reference provided (steam tables)
Response: Original distractor was repressurize RCS to collapse the void. Changed because validators though it was too attractive.
B-Distractor is plausible because it is a strategy contained within the 2013 E procedure for a different set of circumstances.
12 A H 2 X BWD S Exam NRC: Add to the answer explanation that limiting cooldown for saturated conditions is a strategy in other procedures.
Byron: Added reference to steps in the same procedure for actions to reduce the cooldown in order to address loop stagnation to Distractor B explanation.
NRC: Question is sat.
NRC:
Answer choice D is an example of a specific determiner, since its the only one NOT like the others, and since this is the correct answer, it could be a cue. Is there a way to make this one more like the others, or one other look more like it (e.g., would NOT be started).
Response: R evised Distractor C to would NOT be started in 1BEP-0 because the instrument bus loss prevents a manual start.
NRC review of revised question:
(1) First sentence of answer explanation for A is the same as B
E (2) Answer explanations A and B are missing the name of 13 D F 2 X N S the attachment (is it B? C?)
(3) The stem says the operator is doing Step 10 of Att B in BEP-0. 10a says to see if containment pressure is greater than 20 psig (it is), and 10b says to see if Group 6 CS monitor lights - LIT. The RNO for 10b says to manually actuate CS and Phase B isolation, and if NO CS train is providing flow, then GO TO Att C. Since in this scenario the 1B CS pump is running, they dont need to go to Att C to start the 1A pump. So it is accurate to say that the 1A pump will NOT be started per BEP-0.
However, I need to understand what causes the Group 6 CS monitor lights to be lit.
- If they are expected to be lit in the conditions provided in the stem, then this step will be met, and the crew wont do anything more in BEP-0 for CS pumps.
Page 7 of 35 ES-401 8 Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
- If they are NOT expected to be lit in the conditions provided in the stem, then the crew would do the RNO action to manually actuate CS, and in that case, the 1A and 1B CS pumps should get start signals, and the 1A pump would NOT start in that case because of the loss of the instrument bus. So would this be partially correct or fully correct? (NO - we are OK - add this to the answer explanation)
NRC: Add to explanation for Distractor C that a manual CS actuation wont start the pump and they dont need to go to Att C, which is why Distractor C is incorrect.
Byron: Added to explanation steps of Attachment B that attempt to actuate CS / Phase B and why manual operation of the pump is not performed. Added explanation of why CS /
Phase B will actuate via the control switches.
NRC: Question is sat.
B-NRC: Meets Tier 1 requirements per FAQ 401.55 because the 2020 question addresses operator response to an abnormal plant 14 C F 2 BWD S condition per the AOPs.
Exam FREE SAMPLE #4 Braidwood 2020 NRC ILE (Q12)
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for (CV, IA, Annunciators) multiple systems.
- Please add an apostrophe in the stem to say, valves response E
- Answer Option C explanation: Stem says normal B-charging is aligned to 1B RC loop. Would 1CV8146 15 C H 3 X BWD already be fully open? If so, if it fails in the open position, 2019 why would there be lower flow resistance to charging? If S there is no change, then this sentence should be deleted.
- Answer Option D explanation says, 1CV8142 will fail closed and would not affect RCP seal injection during a loss of instrument air. Since it fails closed and is already closed there will be no effect on seal flows.
FREE SAMPLE #5 Braidwood 2019 NRC ILE (Q15)
Page 8 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: Made suggested changes to question stem and answer C & D explanations.
NRC: This question is now SAT.
NRC:
Distractors B and D use UAT watts. The question asks about calculating loading on the SAT s. I dont see how UAT watts is plausible, so two distractors are implausible, and will need to be changed.
Response: 0BOA ELEC -1 is a procedure that is commonly performed with errors. Checking Non-ESF bus loading specifies the use of UAT Winding indications. Determination of allowable B-loading. requires a calculation using indicated bus volts and amps.
16 A F 3 X 2009 S It is probable that 2 of busses will be carried by the UAT at the time BWD of the calculation and the data will be used to calculate the max loading allowed by the SAT in the vent of a loss of the UAT.
Without the procedure to reference, licensed operators, and candidates, have difficulty determining the proper required data. 3 validators chose distractor B, so believe the distractor is plausible
NRC: This question was initially counted as UNSAT due to two implausible distractors, but the information provided shows they are plausible, and so it is marked as SAT.
NRC:
- 1. The stem says, 1SI8811A and B, CNMT SUMP ISOL VLVs, are STUCK CLOSED. Is that information necessary? If not, please delete.
- 2. Distractor B in the bank question is RVLIS head region drops to 31%, so t he options were arranged as level, B-level, temp, temp. Distractor B in this question is a 17 D F 2 X BWD temperature option, so the options are now level, temp, 2020 S temp, temp. Why did you change distractor B?
Response: Stem Information about 1SI8811A and B provided in order to identify reason to enter 1BCA-1.1. Changed distractor due to feedback from validators that they thought it was too attractive a distractor.
NRC: question is sat.
NRC:
B-1. The first three bullets in the stem do not seem to me to 18 A F 3 X 2020 E be needed to answer the question. I recommend BWD S deleting or editing the stem so that the information is needed to answer the question.
- 2. The correct answer choice A is different than the bank question, and the way its worded here seems to reduce Page 9 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
the LOD significantly. Why was it changed? (Bank question answer says, ECCS flow at the PZR PORV setpoint is insufficient to ensure core cooling is maintained.)
Response: Information in stem to ensure the K/A match. Wording was revised per validator comments.
NRC: question is sat.
NRC:
- 1. The first sentence in the stem is, Unit 2 is at 80%
power. Is that needed for the question? Its also strange since it then says what happened at 1000 and 1200, so someone might be confused about whether it should say WAS or it is now, and is now 1200.
- 2. The stem says,..which ONE of the following describes the proper switch manipulations to recover Rod H-8?
So the stem is cueing that there is more than one manipulation. Distractor D is just one switch manipulation, so it could be ruled out just by that wording alone. The procedure also requires the crew to place computer points in test if H-8 is affected. Recommend rewording stem to say something like this: Per 2BOA ROD-3, which of the following is/are necessary to recover Rod H-8?The crew will place the Rod Bank Select Switch in and also D. CBD ONLY.
B-E 3. Distractors D explanation says, Plausible, because the 19 B H 3 X X 2019 S stuck rod is in CB/B Should that be CBD?
BWD 4. Distractor C explanation says, This configuration would realign the affected bank to the stuck rod Distractor C says to place the Rod Bank Select Switch in Manual (and also disconnect the Rod H-8 lift coil). What is the impact of placing that switch in Manual vs CBD on the operation of Control Bank B?
Response: Yes, unit status gives context for the relative positions of the control rods. The time delineations provide reference to proper recovery time window. Agreed and m ade suggested change per item 2. Made correction per item 3. When rods are placed into manual, no other banks should move unless the overlap limit was reached. However, this should not be the case at 80%
power.
Byron: Moved Unit 2 power status to after 1200 time stamp as discussed.
NRC: question is sat.
Page 10 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
B-NRC:
20 C H 4 2009 S Response: None BWD NRC:
- 1. Distractors C and D dont see m to be plausible. I have a hard time believing anyone would pick LCO 3.3.2, especially since SRNIs are not anywhere in it.
- 2. Use Neither vs None when there are only 2 options provided (use none when more than 2).
- 3. Distractor A explanation says, However, 500 CPS is approximately one decade below P-6. In the Horsenotes I have seen that P-6 is given in units of %.
Please confirm you expect them to know that 500 CPS is E below P-6.
21 B H 2 X X N S Response: TS 3.3.2 is plausible because source range NIs are interlocked with permissive P-6. Several other permissives interlocks (P-4, P-11, P-12) are applicable to TS 3.3.2. Additionally, TS 3.3.1 and 3.3.2 are commonly confused by novice applicants.
TS 3.3.1 and 3.3.2 both are instrumentation tech specs. The instrumentation signals are for both functions are similarly processed through SSPS input bays and logic cabinets. Made suggested change for item 2. Overlap of NI indications is expected knowledge.
NRC: question was initially marked a UNSAT, but agree distractors are plausible. Changed U to E. Now is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the progression of an abnormal event as operational conditions change.
- The correct answer is 18.4 GPM. As written, B is the correct answer, but if someone selects B, we wont necessarily know whether they actually understand how SG pressure changes at 0% load since 20 gpm is in E answer B and is also the initial leak rate, at 100%,
22 B H 3 X N power, given in the stem. Please change the answer options so that the right answer (approximately 18gpm) is a separate choice from the option that has the initial leak S rate. For example:
A. ~16 gpm B. ~18 gpm C. ~22 gpm D. ~24 gpm
FREE SAMPLE #6 Page 11 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: Made suggested changes to answer and distractors.
NRC: This question is now SAT.
NRC:
The bank question Distractor B is different and says, The Hi Level Spent Resin Storage Tank is being de-watered. Why was B changed in this question?
B-Reference provided in stem (RMS Grid 4 screen shot) 23 A H 3 2016 S Response: Distractor was altered during station validation process.
BWD Identified possible conditions in which the answer would not always be incorrect.
Byron: Embeded partial screen shot of RMs instead of the full screen. Allows for better readability of the relevant material.
NRC: Question is sat.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the EOPs.
Distractor B is not plausible as the need for containment isolation is not determined based on the potential contamination in a system.
Perhaps a better approach is to focus the distractor on the fact that a division 2 component WO56B oddly has a division 1 power supply from 131X2 and would be not able to be closed manually from the MCR due to the loss of power to Bus 141.
E FREE SAMPLE #7 Response: Believe distractor B to be plausible based upon the following:
24 A F 2 X N PWROG-14043-NP the PWR WOG Emergency Response Guideline Based Critical Tasks, lists CT-11, closing some containment isolation Phase A valves as a critical task. Two of the plant conditions referenced in the bases are:
S Fluid is flowing into the auxiliary building through at least one of the following pathways:
- At least one unisolated Phase A penetration that is in direct communication with the RCS.
- At least one unisolated Phase A penetration that is in direct communication with the containment atmosphere.
Therefore, while 1BEP-0 does not determine the need for containment isolation based upon the potential contamination in the system, the bases for considering the manual isolation of each system as a critical task does account for the potential of the system being contaminated.
Page 12 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Revised plausibility statement in distractor explanation to include the above information.
NRC: Based on the additional information provided, this question is now SAT.
NRC:
As worded, none of the info in the first three bullets is needed to answer the question, the link to the K/A is weak, and LOD is very low. It could be revised to be more operationally valid. For example: Unit 1 tripped from 100% power. The transient caused SG pressures to RISE. SG pressures are currently reading as follows: SG A x#, SG B y#, SG C z#, SG D 1257#. Based on these 25 D F 2 X N indications, the crew should __(1)__ based on __(2)__ (answer -
S the crew should enter H.2., SG D pressure) OR just delete the first four bullets.
Response: Revising the question as suggested would result in asking student to know a yellow path CFR entry from memory which is not required knowledge.
NRC: question is sat.
NRC:
- 1. I noticed this was an SRO question on the 2009 exam.
Please confirm it is appropriate for ROs.
- 2. The stem says, Because it contains the specific actions to mitigate these conditions, Is this necessary, or can it just say, which of the following is the appropriate B-procedure to address these conditions? or something 26 A H 3 X BWD like that?
2009 S Response: Knowing entry conditions for OA procedures and overall mitigation strategy is RO knowledge per ES-401N attachment 2. The wording in the stem is directed to identify the specific procedure to address the current conditions. If worded differently, an argument could be made that entering PRI-1 will lead to a transition to S/D-2 as thus still correct.
NRC: question is sat.
NRC:
B-1. Delete comma in between step and 16c in the stem Byron E (second to last sentence).
27 B H 3 X LOR 2. Please add a statement in the stem that a reference is Bank S provided.
Reference provided: 1BFR-P.1, Page 14 (step 16 c.)
FIGURE 1BFR P.1-5 FIGURE 1BFR P.1-6
Page 13 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: Comma deleted. Statement for reference added.
NRC: delete specific reference to be given and just have statement that a reference is provided.
Byron: Changed reference comment to [REFERENCE PROVIDED]
NRC: question is sat.
NRC:
Stem question and answer options are wordy - please reword stem like this: With NO operator action, an automatic reactor trip will B-E __(1)__ and delta T will __(2)__ and options as NOT occur / rise, 28 A H 2 X 2014 NOT occur / lower, occur / rise, occur / lower (i.e., like the 2014 BWD S BWD question from the bank).
Response: Made suggested changes.
NRC: Question is sat.
NRC:
- 1. The second bullet in the stem says, A plant transient has caused Unit 1 VCT level to rise to >95%. Is this needed given the information in the third bullet (or could we edit third bullet to say, A plant transient has occurred and 1CV112A ). This would raise LOD.
- 2. Since the question is asking for the highest level, would it E be more appropriate to say 94/72/54/36 instead of <95, 29 B F 2 X N <73, <55, <37?
S Response: Recommend we leave as is. Question intent would change if level was less than 95% due to reset of positon change of valve. Student would have this indication readily available on MCB and it adds plausibility to Distractor A. Made suggested change to provide answers and distractors as level indications and not ranges.
NRC: question is sat.
B-NRC:
30 C F 2 2020 S Response: None BWD B-NRC:
31 A H 2 Byron S LOR Response: None bank
Page 14 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only NRC:
- 1. Answer explanation C says, The VCT outlet valves are interlocked by independent trains such that 1CV112B closes when 1CV112D is full open and 1CV112C closes when 1CV112E closes. Should that say instead, 1CV112C closes when 1CV112E opens?
- 2. Please edit stem to say, What is the result of this failure to the high head ECCS suction source?
E Response: Correct component position to read opens. Agreed.
32 C H 2 X N Changed stem as recommended.
S NRC: question still needs to be edited to address previous NRC set of comments above.
Byron: Edited explanation to read as open and added the to the stem.
NRC: question is sat.
NRC: Answer explanation D says, D is correct, Per BOP RH-11, Isolating an RH suction from the RCS with RCS Hot Leg temperature > 200°F will render the associated RH Train inoperable for ECCS Cold Leg Injection until the RH Pump suction is < 200°F.
B-E The stem provides RCS cold leg temperature at 275F. In this 33 D H 3 X 2020 configuration described in the stem, RCS Tc = Th, and thats part of BWD S the question to know that to answer it, or does an edit need to be made?.
Response: Removed T-cold reference from stem. L eft as RCS temperature is 275°F NRC: Question is sat.
NRC:
Distractor D has the word initially in it, but that word did not B-appear in the question on the 2017 exam. Why does it need to be 34 C H 2 X 2017 E there?
Byron S Response: Added per validators comment. Because eventually (after PRT pressure is below 6 psig) vent and draining simultaneously is possible.
Page 15 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC: question is sat.
NRC:
- 1. The answer choices mention WM and PW. What are they, and what is the technical reference supporting the actions?
- 2. Are the actions needed, or could that part of the question be deleted?
35 B F 3 X N E 3. Please walk through how the valve fails based on the S reference provided.
Response: WM is Demin water. PW is Primary water. Valve failure positions are shown on Drwg M-66 sht 4A. Actions used to match part b) of K/A. F.C. (fail closed) or F.O. (fail open) designators are located adjacent to the valves on the P&ID.
NRC: question is sat.
NRC:
- 1. Backup appears twice in steam, but one instance is capitalized, and the other is not - please edit to be consistent.
B-2. How does the listed technical reference support the correct 2011 E answer? (I dont see it.) 3. Please confirm variable heater current is 36 A H 3 X BWD on 1PM05J? It is, but not important to stem. Can eliminate 1PM05J.
cert S Response: Made suggested change, neither are capitalized.
exam Variable heater current is present on 1PM05J. Reverse logic of component use from prereq C.3 Added Pressurizer LP as another reference.
NRC: question is sat.
NRC:
- 1. Answer is listed a B. However, explanations for B and D appear to be swapped.
- 2. Please explain how the listed technical reference supports the B-E correct answer (or add another reference 37 B H 3 X 2018 S Response: Corrected explanations to line up with the correct BWD answer and distractor. Per A.1, pressing the reset pushbutton will bring in the alarm. Reverse logic from C.1 indicates the SI actuated alarm will clear.
NRC: question is sat.
B-NRC: The valves listed in the distractors correspond to the valves 38 B H 3 2016 S listed next to the contacts in the schematic in the answer key, BWD correct?
Page 16 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: Yes.
B-NRC: Second bullet in stem - use uppercase for the word not 39 C H 3 X Byron E (i.e., NOT running).
LOR S Response: Made suggested change.
bank NRC: question is sat.
NRC: The stem says, Due to a containment cooling malfunction, containment pressure and temperature became more elevated than the designed plant response to the event. Is there a way B-to rephrase this so the stem provides more operationally valid 40 B H 3 X Byron E indications (e.g., CTMT pressure rose to 7 psig, CTMT temperature LOR S rose to X)?
bank Response: Changed statement to specify adverse condition.
Avoided actual values to prevent overlap with other portions of the exam.
NRC: question is sat.
B-NRC:
41 A H 3 2020 S BWD Response: None exam NRC:
- 1. The question asks what the effect will be on the 1B FW pump. Three of the options only address effect on the pump. Distractor A does that PLUS talks about an effect on a different pump. So, its giving more information than the question is asking. This could be a cue that the answer is not correct (its not) since it makes it different. I think this should be edited.
B-2. I will need you to talk me through the reference provided 42 D H 3 X Byron E to show the correct answer is correct.
2019-S LAST TWO NRC EXAMS 1 Response: C hanged to Will trip. Enhanced explanations with lesson plan material.
NRC: Add the word feedwater before flow in answers B, C, and D.
Byron: Added the word feedwater to B, C, and D
NRC:question is sat.
B-NRC:
43 C H 3 2020 S Response: None BWD
Page 17 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
44 C H 2 N S NRC:
Response: None NRC:
B-I didnt see this question on the 2020 BWD exam. Am I missing it, 45 D H 3 2011S or is it a different NRC exam?
BWD Response: Updated question pedigree information to 2011 BWD NRC Exam.
B-NRC:
46 C H 2 2013 S Response: None BWD
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only 47 B H 3 N S NRC:
Response: None B-NRC:
48 D F 3 2016 S Response: None BWD 49 C H 3 N S NRC:
Response: None NRC: I dont think I would count this as a modified question (two distractors were changed, but the change made to the stem does M B-E not seem to be a pertinent condition. Should be counted as a 50 A F 3 2019-bank question.
2 S LAST TWO NRC EXAMS Byron Response: Changed pedigree information to Bank question.
NRC: Question is sat.
NRC:
B-Bwd Answer choice D says, HALF INTENSITY CYAN (grey) - does COPS that really appear as grey vs blue-green? yes 51 B F 3 X exam S bank Response: Grey is the common term used. Half Intensity Cyan is referenced to original procedure and original CRT screen used.
NRC: Question is sat.
Page 18 of 35 ES-401 19 Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC: I need some help looking at the drawing provided to verify correct answer.
B-Response: Contact 14RX1 opens on DG RPM >280 causing 52 A F 3 2011 S 1SX169A/B to fail open because the air solenoid is ETC (energize BWD to close). We will assist reviewing any documents when validating onsite.
NRC:
E Part of the explanations for A and B look like they need to be 53 D F 3 X N S swapped.
Response: Agreed. Swapped plausibility explanations.
NRC: question is sat.
NRC: I need some help looking at the drawings provided to verify correct answer.
B-Response: K605 (phase A) relay must be reset to open 54 C H 3 2013 S 1WO006A/B valves.
BWD K610 (SI) relay must be reset to remove shunt trip signal from High Speed RCFC circuit. We will assist reviewing any documents when validating onsite.
NRC:
- 1. The question from the 2011 exam is worded a bit differently: An inadvertent Phase A Containment Isolation occurs due to a SINGLE ESF relay actuation on ONE train. Does that change the meaning of the question?
- 2. It would take them 10 minutes to figure out the train???
B-E 3. A and B explanations both say they are correct answers.
55 B F 4 X 2011 A should say incorrect.
BWD S 4. Why change two distractors from what was on the 2011 exam? Validators request.
Response: No, just clarified the wording per validators request.
Time not relevant. It is just an estimate of how long it would take the crew to mitigate the event and then start investigating the cause. Corrected A to say incorrect.
NRC: question is sat.
B-NRC:
56 D H 4 2011 S Response: None BWD
Page 19 of 35 ES-401 20 Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC:
- 1. Is the third bullet in the stem needed given the B-information in the second bullet?
57 A H 3 X 2011 E 2. Is there another technical reference that can be cited BWD S (perhaps lesson plan)?
Response: Agreed. Removed third bullet as the information was redundant. Added Pressurizer LP as another reference.
NRC: question is sat.
NRC:
Edit answer options and stem as follows: What effect, if any, will the N41 gain adjustment have on the QPTR calculation? N41 QPTR calculation will A LOWER, B. Remain the same, C. Rise and other channels will lower, D. Rise and other channels will remain the same.
E Response: Agreed. Made change as suggested.
58 B H 3 X N S NRC:
Delete will for C and D (redundant).
Last sentence should REMOVE N41 and replace with The for The QPTR calculation
Byron: removed will from distractors. Replaced N41 with the word The.
NRC: question is sat.
NRC:
- 1. This question does not meet criteria in NUREG-1021, ES-401, Page 9/52, to be counted as modified.
M B-E 2. For answer explanation for D, please cite that RWST is 59 D F 3 X 2016 S the normal makeup source per the referenced procedure BWD (not just that PW is used as a last resort).
Response: Changed pedigree information to bank question.
Added information to explanation.
NRC: question is sat.
NRC:
- 1. Are these words necessary in the stem: by preventing 60 C F 3 X N E upward motion?
S 2. Limitation 3.2.1 in the procedure says, The weight of a fuel assembly in the basket will inhibit upward movement. The key-locked bypass switch, located on the power center, permits over-riding this interlock to raise Page 20 of 35 ES-401 21 Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
new fuel if required. So, this interlock prevents lifting a new or spent fuel assembly. Recommend editing the stem to say instead, which of the following is designed to prevent inadvertent raising of a spent fuel assembly or something similar. Also, is it 750 lbs vs 1200?
Response: Removed from stem upward motion words from the stem. It is 1200#. 750# only actuates a warning light. Added Fuel Handling LP for further clarification.
NRC: Add inadvertent and also do not capitalize spent.
Byron: Added the word inadvertently and changed spent to lower case.
NRC: question is sat.
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only B-NRC:
61 A F 3 2011 S Response: None BWD NRC:
- 1. The stem asks, which side of the main condenser but the options are either lowest or highest indicated level.
The 2013 version of the question had answer options east or west ( sides), so the wording of the stem seems to me to make more sense when using those options unless lowest indicated level and highest indicated level are considered sides of the main condenser (although I B-dont think that is the case). I think it would be better to 62 B F 2 X 2013 E reword the stem to say something like this, Per 1BGP BWD S 100- 3, POWER ASCENSION, the main condenser hotwell level controllers need to be aligned to the __(1)__
indicated level as power is raised to __(2)___...
- 2. The answer explanation for B includes a lot of additional info that doesnt seem to be relevant to the way this question is worded (but does seem to be relevant to the 2013 version of the question). Everything after the first sentence in the answer explanation seems like it needs to be deleted.
- 3. I see in 1BGP 100- 3 where it says to use the lowest indicated level at 280MWE / Step 49, but not the basis for Page 21 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
the step. Am I missing it? If not, please add reference with the basis.
Response: Agreed. Made suggested change to stem. Made suggested change to answer explanation. Added Condensate/FW System LP NRC: question is sat.
NRC:
- 1. Could not verify correct answer - no reference in folder Q63. Also need to check title of BCP -400 is accurate (EWASTE or TWASTE?).
- 2. Answer A says, but flow from the 0B GDT can NOT be isolated. Should that specify that flow from the 0B GDT can NOT be isolated automatically? I assume there is SOME way to isolate it.
B-E 3. Edit stem as follows: Add, Flow from to the stem 63 A H 2 X 2013 S question, then delete that phrase from the answer Byron options.
- 4. Is the word effluents needed in D? Recommend deleting.
Response: Added BCP-400- EWASTE to references. NO, there is not an isolation for a relief valve, so automatically does not need to be added. Agreed, made suggested change to stem. Effluents was added due to validators comments, prefer to leave it the wording for D.
NRC: question is sat.
NRC:
- 1. The K/A is, Knowledge of the effect that a loss or malfunctions of the circulating water system will have on the following: ESFAS, but the question is asking about effect of loss of circ water on steam dumps - the KA B-E justification says ESFAS (C -9 interlock) - please confirm 64 B H 3 2020 S C-9 interlock is ESFAS.
BWD 2. Is there a more straightforward technical reference?
Response: C-9 is a control interlock processed from SSPS, therefore an ESFAS. Added CW pump control schematics to references.
NRC: question is sat.
NRC:
E 1. Standby is misspelled twice in B as Standby.
65 D F 3 X N S 2. Add comma in A between auto start and and
- 3. Why is STANDBY in all caps in the stem?
- 4. Explanation for B and C says, Plausible because the compressor configurations are programable by the Page 22 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
compressor controller. Does that mean its possible to program one or more SAC to have a manual start vs auto start?
Response: Agreed, made suggested changes to B. and A.
Standby is capitalized because that is how the procedure BOP SA-12 identifies the SACs. Changed to All CAPS. The SACs are programmable for what setpoint they will auto start. This can also be used to eliminate the auto start. Manually operation of the SACs is normal to swap Lead, Lag, and Standby SACs.
NRC: question is sat.
NRC:
- 1. Make the __(1)__ all on one line.
- 2. Title of procedures has WATCH-STANDING - please edit title in stem.
- 3. Why is PERFORM in all caps?
B-E 4. Section 4.4.1 of the procedure says Unit Reactor 66 A F 2 X 2020 Operator vs NSO - does that matter?
BWD S Response: Agreed. Made suggested changes to the stem. NO.
Unit Reactor Operator, NSO, and RO are synonymous at Byron.
NRC: Need to put __(1)___ all on one line.
Byron: changed formatting to allow underlined number to be on one line.
NRC:
- 1. Item 1 says, Immediately prior to withdrawing CONTROL banks, and appears to be characterized as comparable to a mode change in the answer explanation.
Are control banks ever moved without being part of a mode change? I f so, this item needs to be edited.
- 2. Please put procedure number/title all on one line.
- 3. The procedure says, Make public address announcements: prior to plant start -ups, mode E changes, criticality, etc. - I think it would be a better 67 B F 2 X N supported response to say prior to criticality instead of S when criticality has been observed?
Response: Changed Item 1 to Immediately prior to initial CONTROL bank withdrawal. Made suggested change to stem.
Byron waits until criticality observed before making the page announcement. Prior refers to plant start ups only.
NRC: Make explanation for D say incorrect. Also add to answer explanation that initial withdrawl of the control rods is considered the mode change from 3 to 2 for rx startup.
Page 23 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Byron: Changed the explanation for D to say incorrect. Added definition of mode change from 3 to 2 in BGP 100- 2A1 as being withdrawal of first Control bank to answer explanation.
NRC: question is sat.
NRC:
This would be a good Tier 1 question, but it is not a Tier 3 question because it is not focused on plantwide generic topics ; its focused on diagnosing an event. The K/A is, Ability to identify and interpret diverse indications to validate the response of another indication, B-and it might be tricky to write a generic question using this unless 68 B H 2 BWD U there is generic procedural guidance for use of diverse indications 2020 S in certain situations, or something like that.
Response: Original question K/A match is a broader interpretation of K/A than NRC. Reject K/A based upon unable to create a discriminating question. Submitting amended ES -401-4. Replace with K/A 2.1.7 and different bank question.
NRC: revised question is sat.
NRC:
69 A F 3 N S Response: None NRC:
- 1. This could be edited to be generically applicable, such as this: Per AD -AA-101, Processing of Procedures and T&RMs, a proposed procedure change that would result in a change to plant configuration __1__ contain a change of intent, and an __2__ procedure change should be initiated.
- 2. The procedure defines interim change and temporary procedure changes, but not editorial since it says, B-editorial changes do not constitute a change to the 70 A H 3 X 2014 E procedure. Explanations for C and D should be edited Byron S to clarify that vs saying editorial changes are a type of procedure change.
Response: Agreed. Made suggested changes.
NRC: Clean up the distractors/explanations to remove reference to filter.
Byron: Removed any reference to bypassing filter and replace with a plant configuration change.
Page 24 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC: question is sat.
NRC:
- 1. The stem says, the annunciator isolation switch will be tracked The procedures says, If the annunciator mode switch will be re-positioned or the alarm disabled for more than one shift, INITIATE an Equipment Status Tracking (EST) tag to TRACK the abnormal condition or annunciator mode switch position. Is it accurate to say the annunciators isolation switch will be tracked, or is it better to say something like, the condition of the alarm?
- 2. Since the stem does not specify which board has the nuisance alarm, would it be better to say appropriate turnovers vs Unit NSO turnover?
E 3. Is critical parameter list really plausible for alarms (are 71 C F 3 X X N there actually alarms ever on this list)?
S Response: No change. Per procedure, the EST Tag is tracking the switch position. Made suggested change about turnover. Yes, it is plausible because another action for di sabled alarms is to establish increased monitoring for the disabled function. This could be done with the critical parameter list.
NRC: Delete the in A2 and C 2 and ensure answer (1) on one line in question stem.
Byron: Removed the word the from A2 and C2. Changed formatting to allow underlined 1 to appear all on one line.
NRC: question is sat.
NRC:
- 1. Question-none of the non-safety related radiation monitors have an RM-23, correct (also, is the first sentence needed)?
- 2. The procedure says, SELECT the CHANNEL ITEMS or MONITOR ITEMS button for the item requiring change, 72 B F 2 X N but doesnt specify which to select - is there another S technical reference to show CHANNEL ITEMS is the correct answer?
Response: Correct, only safety related radiation monitors have an RM-23. The sentence sets the task up clearly for the second sentence. BCP 400- EWASTE specifies selection of Channel Items for changing setpoints in Step 5.1.2.6.
NRC: question is sat.
73 D F 2 N S NRC:
Page 25 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Response: None NRC:
Answer D is written as, 1AR20J, CONTAINMENT HI RNG, but the note in BEP 0 says, 1RT-AR020 Grid 4 4AS120 and 1RT -AR021 B-E Grid 4 4AS121 - should two options be provided in the answer and 74 D F 2 X 2016 distractors to be accurate, or the question be worded like this, BWD S W hich of the following will be monitored?
Response: Changed stem wording.
NRC: question is sat.
NRC:
The stem says, Which of the Emergency Procedures will BFRs NOT be implemented - it should be edited to say something like, B-BFRs must be implemented during the performance of the EOPs 75 B F 4 X 2020 E EXCEPT when __ and __ are entered ?
BWD S Response: The distractors contain sections where BFRs are also not implemented. Changing the stem wording would make all answers correct.
NRC: Revised stem. Question is sat.
- 1. 2. 6. 7. 8.
Q# LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) B/M/N U/E/S Explanation Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO Focus Dist. Link units ward K/A Only NRC: Meets Tier 1 requirements per FAQ 401.55 because the 76 B H 2 N S question addresses operator response to plant condition per the EOP/FRPs.
Response: None NRC: According to RCP-1 and BOP RC-1 a bearing temperature limit of 195F is in effect if Component Cooling Water is lost. In this question there is no mention of a loss of CC.
77 D H 3 X N E Please provide reference which specifically prevents Mode 1 S operation below P-8 with less than 4 RCPs running.
Response: Caution before step 30 of BOP RC-1 does not mention loss of CC. Added TS 3.4.4 to distractor explanation to identify that 3 loop operation is not allowed.
Page 26 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
NRC: Add why tripping RCP 1A is done after the Rx trip to explanation for C2.
Byron: Add information to answer and distractor A referencing BOA RNO Actions. Revised question to address rising temperature to lower bearing instead of motor bearing to avoid procedure conflicts on required actions. Revised answer and distractors to read as RNO step.
NRC: question is sat.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the 78 A H 2 N S question addresses operator response to an abnormal plant condition per the AOPs.
FREE SAMPLE #8 NRC:
- 1. Add the word and in the stem between Unit 1, and the crew
- 2. What are RCP support conditions? Conditions as described in 1BOA ESP-1 If they are met, does the crew have another decision to make about whether they will start an RCP, and if not, how are A and B plausible?
- 3. Answer C states, Start one RCP because localized boron dilution concerns will lower, but the answer explanation states, C-Correct: Start one RCP because pressurized thermal shock concerns will lower is correct.
Also, the background document cited, for Step 37, says, RCP operation is preferred during recovery from a steam generator tube rupture to provide normal B-E pressurizer spray and to ensure homogeneous fluid 79 C H 2 2019 temperatures and boron concentrations. In addition to BWD S minimizing pressurized thermal shock and boron dilution concerns, this also aids in cooling the ruptured steam generator. Saying concerns will lower is strange - I think this answer should be edited to say something like, Start one RCP, which will help ensure homogenous boron concentrations Response: Made suggested change to stem wording. Per caution before step 37, if RCP seal cooling had previously been lost the RCP should not be started prior to a status evaluation.
Revising the answer would make it a specific determiner. Currently the answer is worded similar to the distractors.
NRC:
For option B, reword to say NOT start an RCP to prevent pressurized thermal shock
Page 27 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
For option C, reword to say, Start one RCP to minimize localized boron dilution
Byron: Made recommended changes.
NRC: question is sat.
NRC:
- 1. Delete periods after A2 and C2 or use consistently for all options.
- 2. Part 2 of the question starts with, When the crew re-energizes Bus 143 They need to know that on loss of DC 113 and a rx trip that power is also lost to AC bus 143 to answer the first part, correct? If so, is it cuing to say, when the crew re-energizes Bus 143 ? Perhaps a potential edit is to say instead, In accordance with 1BOA ELEC-1, the SRO will direct use of ___ as part of re-energizing plant equipment
- 3. The stem does not indicate that the control room is inaccessible. So, the title alone of D2 and B2 will be able to be too easily eliminated. So, it would be preferable to use a different distractor that has a more plausible title E (regardless of whether it has 4kv operation procedures in 80 A H 3 X X X N it).
S Response: Made suggested change for periods. Intent was not to make student diagnose loss of bus 143, but rather how that affects the annunciator system. Many EOPs reference BOA PRI-5 as a procedure to use when control room functions are not working even though the control room is not evacuated. Example is 1BEP ES-1.1 for resetting ESF actuation signals. It allows for rapid execution of local actions. No change to distractors.
NRC: Initially was marked as unsat, but the distractors are plausible, so changed to E for initial review. Question is now sat with changes.
Byron: Added specific examples to distractor B to support plausibility of use of BOA PRI-5.
NRC: question is sat.
NRC:
E 1. Please delete back to in stem because it makes that 81 B H 3 X N S option stick out
- 2. Stem says Unit 2 has leak, but then also says the crew closed 2SI8809B, RH TO COLD LEGS 1B + 1C ISOL VLV, but it needs to say 2B and 2C.
Page 28 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
- 3. Please either delete periods in first three answer choices or use for all answer choices.
Response: Made suggested change to stem. Made unit designator corrections. Made suggested change for periods.
NRC: question is sat.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the AOPs.
- Stem says, 1BOA ROD -3, DROPPED OF MISALIGNED ROD, (not OR)
- As worded, the answer options are confusing because E the stem asks for the reactor power LIMIT, but then there 82 C F 4 X N are less than symbols, which suggest a range of acceptable power, not a limit. These symbols should be S deleted when asking for the limit.
FREE SAMPLE #9 Response: Corrected 1BOA ROD -3 procedure name in stem.
Changed wording of stem to not use limit and listed power levels in answer and distractors precisely as they are referenced in 1BOA ROD-3 and TS 3.1.4.
NRC: This question is now SAT.
NRC:
The stems says, 1CW001C, 1C PP DSCH VLV? Should CW be 83 A H 3 X N S added before PP?
Response: As written label is what is on MCB NRC: question is sat.
NRC:
- 1. Please add statement in stem that says a reference is provided.
- 2. This seems like too easy of a question since reference is provided and they read the lined-out items from the table (direct lookup) and dont have to assess operability.
B-U This question would be more challenging and match the 84 A H 1 BWD E K/A if it actually asked about what the TS implications 2 X X 2020 are.
S References provided: BOP FR-1T25 page 10 & 11. (step 17)
Response: Submitting new K/A in ES-401-4.
NRC review of revised question: (1) There is no actual question in the stem (e.g., What procedure will the SRO use next?). (2)
Answer explanation for C is same as D; please correct. (3)
Instead of Go directly to 1BEP-3 or 1BCA-3 series procedure, isnt Page 29 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
there enough info in the stem to say one or the other (e.g., 1BEP-3)? (4) Why is the question categorized as low cog? It seems to require evaluation of the information in the stem to determine the right answer.
NRC:
Answer explanation for C is same as D; please correct.
Question should be categorized as high cognitive level.
Byron: Changed cognitive level to HIGH. Provided answer explanation for distractor C. Added reference to the question for procedure usage.
NRC: question is sat.
NRC:
- 1. Please capitalize Chemistry in stem
- 2. Please say which event(s) vs what event(s)
- 3. BOA PRI-4 does not mention BOP CV-9. What B-E procedure says to use that procedure?
85 A F 3 X 2011 4. Should 2 say, Per the bases for the LCO 3.4.16, RCS BWD S Specific Activity, RCS specific activity limits ?
Response: Made suggested changes to stem. Deleted the referenced to BOP CV-9. made suggested change
NRC: question is sat.
NRC:
- 1. The stem asks what is the operability status of the 1B RH train, but the answer options include other information that isnt asked for in the stem. Please edit.
E 2. BOP RH-6 and TS 3.5.3 bases should be listed as 86 D H 3 X N technical references.
S Response: Agreed. Made suggested change to the stem. Added BOP RH-6 to references. Technical discussion of RH8716s not in TS3.5.3 bases.
NRC: question is sat.
NRC:
B-E 1. It says a reference is to be provided, but I think the 87 C H 2 BWD question is asking for recall of information that an SRO LOR S should know from memory. Please delete that a Bank reference is provided from the question information sheet.
Page 30 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
- 2. Technical reference should be listed as SAF 1.6 and/or 50.72(b)(2(iv )(B ) Reference provided in stem Response Information is not expected to know from memory.
changed to LS-AA-1110 which contains SAF 1.6.
Mid-West Reportability Manual provided in stem
NRC: Add note to provide refe rence (just that statement - delete the specific reference they will use)
Byron: Changed reference comment to [REFERENCE PROVIDED]
NRC: question is sat.
NRC:
- 1. Why is Steam capitalized in stem?
- 2. With reference, this seems to be a direct look up. Without B-the reference provided, it would be an acceptable LOD BWD U (U).
88 B H 13 X LOR S 1BEP-1 Step 7.b table provided in stem Bank Response: Steam changed to small letter in stem. Modified question to require CAS knowledge in addition to table reference.
NRC: question is sat.
NRC:
89 B H 3 N S Response: None NRC:
- 1. Why is cog level listed as high? It seems to require recall of facts only.
E 2. First sentence in stem does not seem to be necessary 90 D F 3 X N given the way the questions are worded.
S Response: Changed to low cog. Removed first sentence from stem.
NRC: question is sat.
NRC:
B-U This question does not meet the criteria for SRO only. It was also 91 D H 3 X 2009 S an RO question on the 2009 BWD exam. (U)
BWD Agree with comment. However, 2009 was before NUREG-1021 was revised with ES-401N Attachment 2 (Clarification guidance for
Page 31 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
SRO-ONLY questions). Because second part of answer is SRO only knowledge.
Response: Revised question answers to make 1 of 2 taken twice format requiring SRO only level knowledge to 2nd part of question.
NRC: Please explain how the second part is SRO knowledge -
looking at the flow chart (Fig 2-2 in ES-401, Att 2, Page 24/52), I dont see how second part fits into that. Recommend editing to require knowledge of transitions to sub-procedures or contingency, such as this (also add RVLIS is available in the stem if you go this route):
A. 1. Natural circulation has stopped. 2. R emain in 1BEP ES- 0.2 and raise the RCS cooldown rate.
B. 1. Natural circulation has stopped. 2. (add some distractor procedure here like, Go to xyz and raise the RCS cooldown rate).
C. 1. The reactor head is voiding. 2. Go to 1BEP ES-0.3, Natural Circulation Cooldown with Steam Void in Vessel (With RVLIS) and raise RCS pressure.
D. 1. The reactor head is voiding. 2. Remain in 1BEP ES-0.2 and raise RCS pressure.
NRC: Revised question is sat.
NRC:
- 1. Option A says, and performed the required actions should say and perform
- 2. B says, in accordance with Specification 5.6.7. The explanations for B and D say TS 5.6.7 - should this say Tech Spec 5.6.7?
- 3. Add statement Reference Provided to stem
- 4. I would add the word, indefinitely or some other time information about the SG WR level being inop to make it clear we are asking them what happens after the 7 days E pass. For example, recommend using dates/times for 92 C H 3 X N when each instrument was inop so they have to S determine the time each has been inoperable.
Reference provided: Tech Spec 3.3.3 Response: Made suggested change to stem. No, TS 3.3.3 says Specification 5.6.7. Made suggested change to note reference provided. Made suggested change and added time reference to stem question.
NRC:
Delete ed and just say perform for answer choice A.
Delete specific reference from statement that a reference is provided.
Page 32 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Byron: Changed reference comment to [REFERENCE PROVIDED]. Deleted the ed from performed.
NRC: question is sat.
NRC:
I see the justification for it being SRO only is that equipment status tracking is an SRO function, but the equipment status tag log is also the right answer for RO Q#71. Is there something else about tracking this valve that is more specific to the SRO level only?
B-Response: The EST log is specific to the SRO position. However, 93 C H 3 X 2016 S the use of the EST in question #71 involves equipment that is BWD operated by (and the card would be hung by) the RO. Whereas, in question #93 the equipment is a locally operated valve in the field.
The interface of operations with this evolution would be the SRO and field operator.
NRC: Ok-was marked as unsat on initial review, but response makes it sat.
NRC: Provide OU-AP-200. Will need to review procedure, to E confirm accuracy of the answer/distractors.
B-FREE SAMPLE #10 94 A F 2 2020 BWD Braidwood 2020 NRC ILE (Q95)
S Response: Exam author to provide procedure reference to NRC.
NRC: This question is now SAT.
NRC:
Note: OP-A-101-111, Revision 12, Page 4 of 11 - there are two of 95 C F 2 N S Step 4.2.6 (same number, different actions) in this procedure.
Response: Added to station exam tracker. Revise request will be processed in post exam CAP product.
B-NRC: I didnt see the right answer in the procedure referenced.
96 B F 3 ClintoS Response: The answer is located in WC -AA-101 Step 4.19 on n 12-1 page 12.
NRC:
B-E Step 3.7.1 says the US Authorizes field troubleshooting activities 97 C F 2 X 2017 S and ensures adequate bounds have been established to limit plant Byron impact and/or cause a change from previous risk assessment values by review and approval of each applicable Attachment 1, Troubleshooting Log. Does that mean the same thing as
Page 33 of 35
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
Review and approve the new troubleshooting activity? Or should C match the procedure more closely?
Response: The statement means the same thing. Adding more words to more closely match the procedure exactly would make it more a single discriminator.
NRC: question is sat.
NRC:
E C says, MUST have exhaust 1 fan and should say MUST 98 B F 2 X N S have 1 exhaust fan ?
Response: Agreed. Made suggested change.
NRC: question is sat.
99 D F 2 N S NRC:
Response: None NRC:
- 1. How will they know the PAR is being made from the control room?
- 2. Please add statement in stem that says a reference is provided.
Reference provided: EP-AA-111-F03, BYRON PAR FLOWCHART B-Response: Using the terms Shift Emergency Director and 100 C H 3 X 2014 E INITIAL means the action is being taken from the Main Control Byron S Room, as identified in the procedure. Added statement to indicate reference provided.
NRC: Delete name of reference to be provided and just have a statement that a reference is provided.
Byron: Changed reference comment to [REFERENCE PROVIDED]
NRC: question is sat.
Page 34 of 35 ES-401 Written Examination Review Worksheet Form ES-401-9
Facility: BYRON STATION Exam Date: SEP 27 - OCT 12, 2021
B= 51 F= 34 E= 44 RO TOTALS: M= 0 H= 41 (10 New) U= 3 Additional Notes: SATISFACTORY SUBMITTAL N= 24 B= 10 F= 9 E= 14 SRO TOTALS: M= 1 H= 16 (9 New) U= 3 Additional Notes: SATISFACTORY SUBMITTAL N= 14
GENERAL COMMENT
S:
- 1. Question numbers highlighted as FREE SAMPLE are sample test items the facility submitted for pre-review.
- 2. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 5. The answer distribution is: The distribution has changed due to replacement questions. Changed 4 questions ( 8, 15, 43, 44) from B to C for more even distribution.
RO / SRO A = 21 (28%) / 6 (24%) 21 (28%) / 6 (24%)
B = 25 (33%) / 6 (24%) 21 (28%) / 6 (24%)
C = 12 (16%) / 10 (40%) 16 (21%) / 7 (28%)
D = 17 (23%) / 3 (12%) 17 (23%) / 6 (24%)
Page 35 of 35