ML20007E846
| ML20007E846 | |
| Person / Time | |
|---|---|
| Site: | Wolf Creek  |
| Issue date: | 12/14/2019 |
| From: | Greg Werner Operations Branch IV |
| To: | Wolf Creek |
| References | |
| Download: ML20007E846 (23) | |
Text
ES-401 WC-2019-12 Written Examination Review Worksheet Form ES-401-9 Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
Cues: The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
T/F: The answer choices are a collection of unrelated true/false statements.
Cred. Dist.: The distractors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- 4. Check the appropriate box if a job content error is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only. (K/A and license-level mismatches are unacceptable.)
- 6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
_Rev 3 Page 1 of 23 OBDI 202 - IOLE Process
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/
N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred. Dist.
Partial Job-Link Minutia
- /units Backward Q=K/A SRO-Only 1
F 2
X B
E S
[NRC 9/25] Stem: Specify trip from 100% power.
Distractor C: Clarify RCS Cold Leg temperatures 529F and lowering to match procedure.
Revision History:
Specified Trip was from 100% power and added "Cold Leg" to Answer choice C. Swapped distractors C and D to maintain Short to Long format.
[NRC 10/29] OK. Also, going forward you do not need to swap answers around to maintain short to long format, that is not my expectation nor that of anyone still in R-IV operations.
ES-401 WC-2019-12 2
Form ES-401-9
_Rev 3 Page 2 of 23 OBDI 202 - IOLE Process 2
H 3
X X
N U
S Answer A states that variable heaters dont operate at full current until pressure lowers to 2200 psig but current pressure is above that at 2209 psig, so seems that they would not be at full current yet? No correct answer if thats the case.
This question is testing if 2209 psig is low pressure or high pressure for normal operations. Non-discriminatory, def not LOD=3. Recommend limiting scope of choices to: Variable heaters operating at FULL or LESS THAN FULL current, and Backup Heaters ENERGIZED or DE-ENERGIZED.
Revision History:
1 - Modified answer choices to make 2x2. Removed the distractors for automatic response to rising pressure.
[NRC 10/29] Again, the explanations state that Variable heaters operate at full current once pressure lowers to 2200 psig, and pressure per the stem has only lowered to 2209 psig if the explanation is correct then A is not the correct answer, because the heaters would be operating at less than full current the answer would be C.
Deconflict.
2 - Corrected pressure value listed in Answer Choice A Explanation (2220 psig)
[NRC 11/13] OK 3
H 3
X N
E S
Does pump breaker have both timed and instantaneous o/c trips? Prefer if either C or D was a trip on low voltage instead of two different kinds of overcurrent trips, simply because we dont give anything that would differentiate between timed vs instant o/c.
Revision History:
1 - Changed Distractor D from "instantaneous overcurrent" to "electrical fault."
Swapped order of distractors B, C, and D to maintain short to long format.
[NRC 10/29] OK 4
H 3
N S
ES-401 WC-2019-12 3
Form ES-401-9
_Rev 3 Page 3 of 23 OBDI 202 - IOLE Process 5
F 2
X X
B U
S NRC 2007 K/A mismatch no link to CVCS which is the selected system.
I get that this was an NRC exam question 12 years ago but there are a lot of inconsistencies with this question.
This is not operationally valid a plant simply isnt going to start up 6, 8, or 10 hours1.157407e-4 days <br />0.00278 hours <br />1.653439e-5 weeks <br />3.805e-6 months <br /> after a trip.
Stem says operating at 100% power but question tests on 80 or 90% power.
Stem says criticality scheduled to occur 8 hrs later (not realistic) but question tests on 6 or 10 hours1.157407e-4 days <br />0.00278 hours <br />1.653439e-5 weeks <br />3.805e-6 months <br />.
Question UNSAT because of the K/A mismatch.
Replaced with LO98958
[NRC 10/29] the second part, testing on whether a dilution causes a positive or negative reactivity transient, adds no discriminatory value and is LOD=0. I would accept something about how to procedurally respond.
Revision History:
1 - Added to exam as Replacement Question 2 - Revised to change second part of the question to improve discriminatory value.
[NRC 11/13] OK 6
H 3
B S
NRC 2013 Restructure stem for clarity:
BG TK-130 LTDN HX OUTLET TEMP Controller fails to 100%.
With no operator action, over the next 30 minutes:
VCT Temperature will _____
VCT Pressure will _____
Revision History:
1 - Revised question format. and updated applicable CFR to 41.13 (from 41.7 / 45.7).
[NRC 10/29] OK 7
H 3
N S
ES-401 WC-2019-12 4
Form ES-401-9
_Rev 3 Page 4 of 23 OBDI 202 - IOLE Process 8
H 3
X N
E S
The stem question reads 1) and 1) instead of 1) and 2). Include an objective plot of PRT Pressure and Level for this transient in explanation to confirm response.
Explanations need clarified: What is ALR 00-034E? Its not defined in explanation.
D - says PRT Pressure rises to >6% almost instantaneously is this supposed to by 6 psig?
Revision History:
1 - Updated question 1) and "2)", and improved answer explanation section by Including an objective plot of PRT Pressure and PRT Level for the transient, Clarified the noun name of ALR 00-034E, and updated answer explanation wording. (See plots below) 2 - Updated Answer explanation for Distractor D to state 6 psig instead of 6%.
[NRC 10/29] OK - D still says PRT Pressure rises to >6% instead of 6psig 9
H 3
B S
STP 2005
ES-401 WC-2019-12 5
Form ES-401-9
_Rev 3 Page 5 of 23 OBDI 202 - IOLE Process 10 H
3 X
N E
S Clarify 2nd stem bullet to: Loop 1 Hot Leg Channel BB PI-411C failed HI. All required actions performed per OFN SB-008, INSTRUMENT MALFUNCTIONS, including tripping the associated bistables.
Clarify stem relationship to K/A Statement: OFN SB-008 Attachment K CAUTIONS that which of the following reactor trips would be introduced by tripping the associated bistable for the failed Pressure instrument under these conditions?
Quote the caution statement verbatim in the explanation.
Revision History:
1 - Reworded the 2nd stem bullet. Updated the question to specify there is a CAUTION in OFN SB-008 that warns of the tested reason for the reactor trip. Added the verbatim OFN SB-008 CAUTION to the answer explanation and improved the wording in the answer explanations for answer choices B and C.
[NRC 10/29] - OK 11 F
2 N
S 12 H
2 X
N E
S Stem - specify what type of bus PA01 is.
A and B part 1): rephrase to Reactor will Trip automatically B and D part 2): rephrase to Trip the Reactor manually Revision History:
1 - specified 13.8KV Bus for PA01 in the stem. Rephrased answer choices to include Reactor trips are either automatically or manually initiated. Improved wording in answer explanations to match.
[NRC 10/29] - OK 13 F
2 B
S DCPP 2008 14 H
3 X
B E
S Distractor A is implausible that neither SIS nor MSLIS would occur for what is effectively a design basis ESD casualty. May be salvageable if you include a condition that some number of protective bistables are bypassed related to SG pressure, possibly the reason for the shutdown.
Revision History:
1 - Specified AB PI-524A for B S/G was failed in the stem to make distractor A plausible and updated answer explanations.
[NRC 10/29] - OK
ES-401 WC-2019-12 6
Form ES-401-9
_Rev 3 Page 6 of 23 OBDI 202 - IOLE Process 15 F
2 B
S NRC 2013 Simplify stem to: Containment Fan Coolers A and D are powered from which buses, respectively?
Revision History:
1 - Changed question wording to ask the question more directly.
[NRC 10/29] - OK 16 H F 3 2 N
S Change to LOW cognitive level and LOD = 2. Just memorizing setpoints, no comprehension necessary.
Revision History:
Changed cognitive level and LOD from High/3
[NRC 10/29] - OK 17 F
2 X
N E
S Station confirm that this is expected RO level knowledge per facilitys ILT program.
EOP design basis documents are typically SRO-only knowledge.
Station confirmed this question is expected RO knowledge
[NRC 10/29] - OK 18 H
3 N
S Is crew required to match indications to close signal on MSIVBPVs, i.e., required to match AB HIK-15 demand to 0, after MSLIS? If so, B could be argued partially correct.
Station has no such procedure direction nor expectation.
[NRC 10/29] - OK 19 F
2 N
S Pre-reviewed.
20 H
3 B
S NRC 2015 21 H
3 B
S CW 2009 22 F
2 X
N E
S Distractors B and C - is not a transformer overcurrent also a lockout? How are these two choices fundamentally different from each other?
The PB04/PB03 cross tie will automatically close unless one of the two busses is faulted. Agree overcurrent causes a transformer lockout, so changed the distractor to a different malfunction that also causes a transformer lockout.
Revision History:
1 - Updated Distractor B from Lockout to Differential and updated answer explanation.
[NRC 10/29] - OK 23 F
2 N
S Pre-review. Station confirmed this is RO knowledge.
24 H
3 N
S
ES-401 WC-2019-12 7
Form ES-401-9
_Rev 3 Page 7 of 23 OBDI 202 - IOLE Process 25 F
2 N
S Pre-review Revision History:
Updated applicable CFR to 41.13 (from 41.5 / 45.7).
[NRC 10/29] - OK 26 F
2 B
S Seabrook 2013, Specify what type of bus SL-31 is.
Revision History:
1 - Specified 13.8 KV BUS for SL-31.
2 - Corrected the bus voltage to 4.16KV Bus.
[NRC 10/29] - OK 27 H
3 N
S 28 F
2 B
S Pre-reviewed. Station confirmed this is RO knowledge.
CW 2007 Revision History:
Updated applicable CFR to 41.9 (from 41.7 / 45.6).
[NRC 10/29] - OK 29 F
2 N
S 30 H
3 X
B E
S Distractors A and D part 1) implausible that dilution is required to add positive reactivity following a transient where temp is likely already high and rods are at LOLO limit.
Revision History:
1-Swapped the order the questions were asked and changed distractors for two required actions. Swapped answer choices C and D to maintain short to long answer choice format. Also specified Per Technical Specifications as the basis for required actions and updated answer explanations.
[NRC 10/29] hr TS action statements are not required RO knowledge, only 1-hr or less action statements.
2-Changed the second part to what action would be accomplished WITHIN 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> to meet RO knowledge requirements. Also changed what had been the correct answer to a distractor since it was not an action required WITHIN 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.
[NRC 11/13] OK
ES-401 WC-2019-12 8
Form ES-401-9
_Rev 3 Page 8 of 23 OBDI 202 - IOLE Process 31 F H 2
X B
E S
Stem question asks about Malfunction THEN Permissive, answers are ordered Permissive THEN Malfunction. Put them in matching order.
Specify the names of P-6 and P-10 This is Comprehension level of knowledge.
Revision History:
1 - Changed each answer choice to a sentence to present material in right order, and specified the noun names for P6 and P10. Also changed the cognitive level designation from Low.
[NRC 10/29]- ok 32 H
3 X
B S?
S Get rid of bolding in stem and answers.
This is LOD = 4. Confirm this is required RO knowledge at WCNOC, as this clearly would qualify as SRO level of knowledge by NRC standards.
Replaced with LO153832 2013 Diablo Canyon
[NRC 10/29] - OK 33 F
2 B
S Revision History:
1-Updated applicable CFR to 41.13 (from 41.2 to 41.9, / 45.7 to 45.8).
34 H
3 N
S Pre-reviewed. Station confirmed this is RO knowledge.
35 H
3 X
X N
E S
Include a reference to procedure in the stem, i.e. what action now should be performed per procedure [x]? Strengthens the correctness of the answer.
Is Distractor D a subset of C, i.e., is maximizing TDAFW Pump operation a form of feed and steaming S/G?
Revision History:
1 - Changed given S/G NR Levels to a band that is >23.5% and changed the question to make it more Operationally valid per EMG ES-04, specifically to how the crew will perform the cooldown. Shuffled answer choices to maintain short to long format and improved the answer explanations to make it clear why operation of the TDAFW pump is NOT a subset second correct answer.
[NRC 10/29] - OK 36 F
2 X
M E
S Explanation states that both B and C are correct - fix.
Add the word approximately to the stem since its hard to tell exactly where the curve crosses 200 MVAR.
Make the correct answer 1140 MW since the curve crosses 200 MVAR slightly past the halfway point between 1125 and 1150.
Revision History:
ES-401 WC-2019-12 9
Form ES-401-9
_Rev 3 Page 9 of 23 OBDI 202 - IOLE Process 1 - Added approximately to the question and changed the correct answer to 1140 MW. Also updated answer explanations.
[NRC 10/29] - OK 37 H
3 X
N E?
S Distractor B explanation states that The volume of water being pumped by the two remaining [condensate] pumps rises, causing discharge pressure (MFP suction) to drop. Should this say Condensate pump suction pressure drops instead?
No, limit is based on maintaining NPSH for MFP (not condensate pumps)
How objective is this correct answer? Question asks how could this malfunction affect the Main Condensate System could is a very loose word, subject to being argued against. WILL the two running condensate pumps experience excessive running current > pump rating under the given plant conditions, objectively? Yes Revision History:
1 - Rephrased the question and answer choices to eliminate any subjectivity. Rated pump running current WILL be exceed without Operator action, which could result in Condensate Pump motor damage. Swapped answer choices to maintain short to long format and updated answer explanations.
[NRC 10/29] - OK 38 H
3 N
S 39 F
2 N
S 40 H
3 X
B E
S Last bullet in each answer is black vice blue.
Specify the name of BB LI-460 in the stem.
Pressurizer level lowering is not a plausible distractor given that the stem already states PZR level is 60% and rising. Eliminate this part of the answers and stick with the other two, RCS Pressure and ECCS flow.
Revision History:
1 -Specified the noun name for BB LI-460, removed expected change in PZR Level from the answer choices and modified the remaining choices to 2x2 format using only RCS pressure and ECCS flow. Swapped answer choices to maintain short to long format and updated answer explanations.
[NRC 10/29] - OK 41 F
2 N
E S
Couldnt A be argued as potentially correct esp. given colder safety injection coolant?
Does B have to say rapidly rising CTMT RAD levels? Would this be rapid for a SBLOCA?
The phrasing of this question is open to interpretation we need to make it more direct.
Revision History:
ES-401 WC-2019-12 10 Form ES-401-9
_Rev 3 Page 10 of 23 OBDI 202 - IOLE Process 1-Rephrased the question and all four answer choices to make more direct and remove ambiguity & possible 2nd correct answer challenges. Also updated answer explanations.
[NRC 10/29] - OK 42 H
3 N
S 43 H
3 N
S 44 H
3 N
S 45 H
3 B
S Why does first bullet say A unit is operating ?
Revision History:
1-Fixed Typo in stem
[NRC 10/29] - OK 46 H
3 B
S Seabrook 2013 47 F
2 B
S 48 F
2 B
S 49 H
3 X
N E
S C and D part 1), not very plausible to trip the MFP from ovation graphic; modify to : 1)
In response to high vibrations, MFP A will trip [ONLY manually if push buttons FC HS-018A or FC HS-018B are depressed] vs [EITHER automatically when high vibration trip setpoint is exceeded OR manually if push buttons FC HS-018A or FC HS-018B are depressed].
Revision History:
1-Deleted stem bullet for CRS directing manual trip of MFP. Changed the first part of the question to test if the MFP will automatically trip on high vibration or not. Updated answer explanations.
[NRC 10/29] - OK
ES-401 WC-2019-12 11 Form ES-401-9
_Rev 3 Page 11 of 23 OBDI 202 - IOLE Process 50 H
3 X
N E
S Use quotations instead of bolding in stem generic.
Would like to discuss leaving this as is. This is my standard formatting and the applicants are used to seeing Procedure Steps Bolded. Ive spent great effort updating all questions in Wolf Creek Bank to match this formatting standard.
Has NB01 actually been reenergized already from SBO DG, or are all preps simply made in anticipation of? Not clear from stem.
Dist A - what is Step 26?
Stem - clarify The crew has performed EMG C-0, LOSS OF ALL AC POWER, through Step 25, Check Is S/Gs are Not Faulted. This is to clarify that step 15 eqpt PTL has been completed, which is important to establishing correct answer.
Revision History:
1-Improved clarity in the stem my specifying power was restored to NB01 and that steps 1-25 were completed. Added noun name for Step 26 in the answer choice and shuffled A and B answer choices to maintain short to long format.
Updated answer explanations.
[NRC 10/29] - OK, if applicants are used to bolding, can leave as-is.
51 H
3 X
N E
S Answer A explanation says 1600 psig (1615 psig) should be (1615 psia)
Distractor C explanation says Aux spray could have been aligned per attachment c if Letdown was NOT in service. Should this say if Letdown WAS in service, since stem states Letdown is not in service? If so, can we simplify C.1) and D.1) to just Spray, if neither normal nor aux spray is available?
Revision History:
1-Clarified question wording and updated answer explanations.
[NRC 10/29] - OK 52 H
3 B
S Callaway 2013 Specify what type of bus LC NG01 is.
Put the 2nd part in the same order, i.e., 120 VAC Bus NN01 is supplied by Battery NK11.
Revision History:
1-Clarified in the stem that NG01 is a 480V VAC Bus and modified the order of two answer choices for consistency. Also updated answer explanations.
[NRC 10/29] - OK
ES-401 WC-2019-12 12 Form ES-401-9
_Rev 3 Page 12 of 23 OBDI 202 - IOLE Process 53 H
3 X
N E
B is not plausible that for a loss of NB01 red train only the opposite yellow train components actuated.
Revision History:
1-Modified distractor B to improve plausibility. Specified ONLY in the correct answer to avoid subset 2nd correct answer choice with the new distractor B. Updated answer explanations.
-For my own edification, which ESW suction and discharge isolation valves receive a close signal on a loss of NB01 only? EF HIS-23 and EF HIS-24
[NRC 10/29] - OK
ES-401 WC-2019-12 13 Form ES-401-9
_Rev 3 Page 13 of 23 OBDI 202 - IOLE Process 54 F H 2
N S
Clearly state in the stem that the crew is lowering power using OFN MA-038 rapid plant shutdown.
This is a higher cognitive level question because the applicant has to understand how operating in MW control mode while connected to an unstable grid will impact the primary.
Revision History:
1 - Specified in the stem the crew had lowered power using OFN MA-038 and changed the cognitive level to High.
55 F
2 X
B U
S A is not plausible with a SBLOCA in progress that has not been mitigated.
C is not plausible with a nearly full RWST. Would be plausible with a much lower RWST level closer to swap setpoint, if applicant still has to recognize that break flow is not going to sump.
Revision History:
1 - Changed the opening stem statement from SBLOCA to trip and SI, removed the RWST Level and added S/G pressures, also specified RCS Pressure at 1800 psig to make Distractor A plausible. Changed Distractor C from EMG ES-12, which isnt a likely transition from EMG E-0. Resorted answer choices to maintain short to long format and updated answer explanations.
[NRC 10/29] - OK 56 H
3 N
S Add per EMG ES-12 to end of stem.
Revision History:
1 - Added Per EMG ES-12 to end of question.
ES-401 WC-2019-12 14 Form ES-401-9
_Rev 3 Page 14 of 23 OBDI 202 - IOLE Process 57 H
3 X
N U
S D is illogical The first action the crew should take prior to or upon entering OFN BG-009 EMERGENCY BORATION [is to] determine adequate SDM does not exist, and then enter OFN BG-009 to prevent an unnecessary boron addition ?
Question is not testing on the reason, just the procedurally required method of borating. Stem already cues applicant that boration is required.
Modify this question to test on whether boration is required or not, and then the method to be used. For method, alternate between the correct answer C and distractor B, testing on knowledge of LTOP in Mode 4.
Revision History:
1 - Modified question to make 2x2 format by eliminating distractors A and D. Arranged the answer choices in short to long format and updated answer explanations.
[NRC 10/29] - So looking at this now it doesnt really work, we cant ask if emergency boration is required or not, and then say but if it WAS required what actions are performed? - its cueing. Lets focus on method of boration.
2 - Modified question and answer choices to focus on the method of boration.
[NRC 11/13] OK 58 F H 2
N S
Higher cog level - requires interpretation of plant indications to diagnose event.
Revision History:
1 - Changed the cognitive level designation.
[NRC 10/29] - OK 59 H
3 X
N E
S Make the stem more objective - state how far the bank was pulled.
Revision History:
1 - Specified Shutdown Bank A Rods were pulled 228 steps (fully withdrawn).
[NRC 10/29] - OK 60 F
2 B
S Dist A - by improved solubility do you mean the solubility of the analyzed isotopes?
If so then edit to improved solubility of analyzed isotopes.
Revision History:
1 - Edited Distractor A to clarify solubility of analyzed isotopes, swapped distractors A and B to maintain short to long format, and updated answer explanation. Also updated applicable CFR to 41.14 (From 41.8 / 41.10 / 45.3).
[NRC 10/29] - OK 61 H
3 N
S
ES-401 WC-2019-12 15 Form ES-401-9
_Rev 3 Page 15 of 23 OBDI 202 - IOLE Process 62 H
3 B
S Specify per EMG FR-C2 at end of stem.
Dist B - specify Manually open Revision History:
1 - Specified "Per EMG FR-C2" at end of question, added "Manually" to distractor B and answer explanation.
63 F
2 X
B E
S Dist A - what is the significance of reactuation 60 seconds later? If none, evaluate if more discriminatory to state SI Actuate light on SB069 would extinguish when pushbutton depressed, but reflash and auto actuation would immediately reoccur when pushbutton released. From LO1301200, RPS Lesson Plan Revision History:
1 - Improved answer explanation for distractor A to discuss significance of 60 seconds.
[NRC 10/29] - OK
ES-401 WC-2019-12 16 Form ES-401-9
_Rev 3 Page 16 of 23 OBDI 202 - IOLE Process 64 F
2 N
S Entry into Functional Recovery Procedures is typically SRO-only knowledge, confirm that this is required RO knowledge per WC ILT program.
Station confirmed this question is expected RO knowledge
[NRC 10/29] - OK 65 H
3 N
S Site Specific OE - ESW water hammer to Ctmt Air Coolers.
Confirm that this is required RO knowledge.
Station confirmed this question is expected RO knowledge Revision History:
1-Updated applicable CFR to 41.9 (from 41.7 / 45.6).
66 F
2 N
S 67 F
2 B
S Pre-Review 68 F
2 N
S 69 F
2 N
S 70 H
3 B
S Reference Provided as part of Question (Not in a handout).
71 F
2 X
N E
S Dist A should we consider specifying that the start time for Non-Functionality is some time within the last 14 days?
Confirm that this is required RO knowledge per WC ILT program. This level of knowledge of ODCM is typically SRO knowledge.
Revision History:
1 - Replaced with LO153833 (for better RO/SRO knowledge)
[NRC 10/29] - Not a generic question, it is a liquid radwaste systems question, evidenced by explanations that confirm systems knowledge required to answer.
2 - Replaced with LO153836 (for better generic knowledge.
[NRC 11/13] OK 72 F
2 B
S WC 2015 73 F
2 B
S WC 2001 74 F
2 B
S 75 F
2 N
S
ES-401 WC-2019-12 17 Form ES-401-9
_Rev 3 Page 17 of 23 OBDI 202 - IOLE Process 76 H
3 X
N U
S Not SRO-only - this is a basic RO question. Entry into Major EOPs (E-0, E-1, etc) is not usually considered SRO knowledge. NUREG 1021 ES 401 states, SRO-only knowledge should not be claimed for questions that can be answered solely using fundamental knowledge of the following:
- any abnormal operating procedure (AOP) entry condition
- plant parameters that require direct entry into major EOPs (e.g., major Westinghouse EOPs are E0, E1, E2, E3, ECA-0.0, and Red/Orange Functional Restoration Replaced with LO153834
[NRC 10/29] - OK 77 H
2 X
N E
S Why does Distractor A have a specific explanation of where the value is taken from, but the other choices dont?
Distractor D - At Maximum Rate, is not discriminatory, doesnt fit with the other choices that are value-derived, and could be logically true: The maximum allowed cool down rate is the maximum rate. Edit.
Revision History:
1-Eliminated the 53°F/hr cooldown limit clarifier from Distractor A, replaced Distractor D, shuffled answer choices to sort sequentially and updated answer explanations.
[NRC 10/29] - OK 78 H
3 N
S Pre-review.
79 H
3 X
N U
S RO knowledge. Part 1) is systems knowledge, and Part 2) is direct entry into an AOP/Off-Normal procedure. NUREG 1021 ES 401 states, SRO-only knowledge should not be claimed for questions that can be answered solely using fundamental knowledge of the following:
- any abnormal operating procedure (AOP) entry condition
- plant parameters that require direct entry into major EOPs (e.g., major Westinghouse EOPs are E0, E1, E2, E3, ECA-0.0, and Red/Orange Functional Restoration Replaced with LO153835
[NRC 10/29] - OK 80 H
3 N
S
ES-401 WC-2019-12 18 Form ES-401-9
_Rev 3 Page 18 of 23 OBDI 202 - IOLE Process 81 H
3 X
N E
S This is very close to RO knowledge as-written. Modify so that the BB LT-460 also fails off-scale LOW, such that B is now the correct answer. Since all 4 choices have a different part 1), part 2) procedure selection is not necessary to answer the question.
Modify so that part 1) is a DISCRIMINATORY 2x2, such that part 2) procedure selection is required to answer the question.
Revision History:
1 - Modified question so that BB LT-460 also failed low so that the distractor for LCO 3.0.3 became the correct answer. Modified answer choices to make 2x2 using technical specification LCO 3.0.3 vs. LCO 3.3.1, COND M and OFN MA-038 vs. EMG E-0. Resorted answer choices to maintain short to long format and updated answer explanations.
[NRC 10/29] - OK 82 F
2 N
S Pre-reviewed.
83 H
3 N
S 84 H
3 X
N E
S Make part 2) alternating between excess letdown and rapid plant shutdown.
Revision History:
1 - Changed part 2 of Distractors C and D to make 2x2 question, shuffled answer choices and updated answer explanation.
[NRC 10/29] - OK 85 H
3 N
S 86 H
2 N
S Pre-reviewed.
87 H
2 X
N U
S This is RO systems knowledge, knowing trip coincidence and power supplies to components. Knowing entry conditions for E-0 is also RO knowledge per NUREG 1021 - see excerpt in Q79 comments.
Replaced with LO153839
[NRC 10/29] - OK
ES-401 WC-2019-12 19 Form ES-401-9
_Rev 3 Page 19 of 23 OBDI 202 - IOLE Process 88 H
3 N
E S
Note: this is the second SRO question where the correct answer is trip the reactor and go to E0. Balance of coverage issues need more thorough testing of EOP structure.
Revision History:
1 - Replaced with LO15837
[NRC 10/29] - RO systems knowledge, knowing what depressurization sources are available with a loss of IA. Modify and make the question about which EMG to transition to, C-31, C-32, C-33, etc.
2 - Rewrote question to specify PORVs were unavailable to make one of the distractors the correct answer and changed the other three answer choices to possible procedure transitions.
[NRC 11/13] OK 89 H
3 N
S Pre-Reviewed.
90 F
2 X
N E
S Answer A isnt credible. As rods go out, temperature increasesIm not sure anyone is going think that as temperature increases, pressure will decrease (saturated system).
Revision History:
1 - Changed given PressurizeR Pressure Trip distractor to High and updated answer explanation.
[NRC 10/29] - OK but recommend adding, per Technical Specification Bases to the end of the stem.
2 - Added "Per Technical Specification Bases" to the end of the question.
[NRC 11/13] OK 91 F
2 X
N U
S RO knowledge. Another trip and enter E-0 question. Knowledge that an alarm response procedure directs tripping the RX with 2 rods on the bottom is not SRO knowledge. Recommend testing on design basis information regarding how dropped or misaligned rods affect assumptions regarding flux distribution, response, safety margin, etc.
Replaced with LO153838 based on general comments about lack of CSFST questions, would like to change the K/A for this question to 005 2.4.21 (Stuck Rod, Safety Function Monitoring) based on inability to write a question at the SRO level for Dropped rod and using AOPs in conjunction with EOPS. Question 30 already covers flux distribution concept (AFD vs. Radial flux)
[NRC 10/29] - OK approved, make sure to update ES-401-2/4 ES-401-2/4 updated [NRC 11/13] OK
ES-401 WC-2019-12 20 Form ES-401-9
_Rev 3 Page 20 of 23 OBDI 202 - IOLE Process 92 H
2 X
N E
S The stem should provide specific initial and final values for relevant parameters for better discriminatory value of distractors.
We would like to discuss leaving as-is. The SROs on exam security agreement do not know what a typical value would be for pre-transient conditions and a CS-137 value is not specified for entry into OFN BB-006. We do not think adding values would enhance Operational Validity and ultimately think adding values would confuse the students. The concept of what could cause the parameter change and what action the crew would take based on the OFN guidance should be sufficient from an Operational validity perspective?
[NRC 10/29] - OK 93 H
3 X
N E
S The second part of each answer is confusing. The first part of each answer answers the question, What is the required manner of operation of the RHR pumps under current conditions, but the second part of each answer doesnt seem to be consistently answering the same question.
Distractor A conflicts with itself. First part says Stop RHR pumps, second part says to throttle RHR HX flow.
Revision History:
1-Modified question to ask how the RHR pumps were to be operated and why.
Changed all four answer choices. Sorted the new answer choices in short to long format and updated answer explanations.
[NRC 10/29] - OK - requires EOP basis document knowledge.
94 F
2 X
N E
S Is the applicant supposed to assume that the CRS is STA-qualified?
Is Distractor A supposed to mean that no turnover is required, i.e. none of the above?
Stem lacks clarity as to what is being asked.
AP 21-001 6.6.5.1 states, In the event the individual standing the Work Controls SRO position is not Shift Technical Advisor (STA) qualified they will perform a turnover with the STA following the read through of the Immediate Actions. Why is question talking about WC SRO relieving the CRS?
Revision History:
1 - Specified in the stem that both the CRS and SM are STA qualified. Modified all four answer choices with consistent wording regarding at what point the CRS and Work Control SRO will turnover. Improved distractor A by specify the SM could fulfil the STA role since qualified to eliminate none of the above answer choice.
[NRC 10/29] - OK
ES-401 WC-2019-12 21 Form ES-401-9
_Rev 3 Page 21 of 23 OBDI 202 - IOLE Process
95 F
2 X
X N
U S
Basis for SRO-only is unsound. Just because the ODMI process contains actions that are SRO-only responsibilities, doesnt mean that the definition of an ODMI is SRO-only knowledge. ROs should know difference between a special order, standing order, and ODMI definitions. Detailed knowledge of the ODMI process itself would likely be SRO knowledge.
Since Night Orders are not used at Wolf Creek, answer choice C is not a credible distractor.
Replaced with LO153651, which is tied to underused CFR 43.3 K/A
[NRC 10/29] - OK 96 F
2 B
S Gauge is misspelled in last sentence of stem.
Revision History:
1 - Corrected mis-spelling in the stem
[NRC 10/29] - OK 97 F
2 N
S Pre-Reviewed.
98 F
2 N
S Pre-Reviewed.
99 F
2 N
S 100 H
2 X?
B E?
S REFERENCE PROVIDED How is applicant supposed to differentiate between C and D? Explanation for C talks about FG1.1 but theres nothing in stem about that.
This seems like direct lookup, just plugging stem information into flow chart with exception of C and D distinction which I've asked about above.
Revision History:
1-Modified stem information to present how the GE was declared, actual loss of 2 barriers and potential loss of 3rd barrier due to being in EMG FR-C1 for >15 minutes without clearing the CSFST RED path condition on Core Cooling. Changed status of containment barrier from intact to specify a pressure and trend so that the applicant has to determine the CTMT barrier is still intact and therefore the minimum PAR is 2-5 miles downwind.
[NRC 10/29] - OK
ES-401 WC-2019-12 22 Form ES-401-9
_Rev 3 Page 22 of 23 OBDI 202 - IOLE Process
GENERAL COMMENT
S
-Last 2 NRC Exams: 2017 (NRC-developed, Osterholtz), 2015 (Larson)
-Too many SRO questions are simply testing on knowing reactor trip and EOP E-0 entry criteria. SRO questions should test a deeper more complex understanding of the EOP structure and interrelations between.
NONE remain after proposed Rev 1 Changes. I had previously received counsel that there is no greater responsibility for an SRO to know when a Reactor Trip is required and to direct that action based on recent industry focus per IER 17-05, Line of Site to the Reactor Core. I see now that is more of an Operational focus vs. SRO knowledge on a written exam.
-SRO exam lacks balance of coverage. Almost no Tech Spec specific questions, almost no questions on EOP contingency or functional response procedures. Improved with proposed Rev 1 changes. I had previously considered it a K/A mismatch to ask a Tech Spec question where a Tech Spec K/A was NOT specified. Rev 1 replacement questions bolded [NRC 11/01, This is a good point to bring up for SRO questions, yes you have to meet the K/A, but in order to tie it to SRO functions you often have to incorporate knowledge and abilities that is SRO-specific even if not explicitly called out in the K/A, such as Tech Spec usage, reportability, basis or licensing information etc. It is one reason why you often see a lot of 2x2 style questions on the SRO portion]
4 - Tech Spec Questions - #81, #86, #87, #90 6 - AOP/EOP Structure - #77, #80, #82, #84, #88, #93 3 - EOP Contingency - #76, #78, #85 2 - Functional Response - #89, #91 10 - Other Generic SRO Only Concepts - #79, #82, #92, #94, #95,96-100
-Review if any of the questions as-written can take credit for some of the under-documented 1-CFR55.41/.43 sampling areas, e.g.
41.9 [Shielding, isolation and containment design features, including assess limitations] #28, #65 41.13 [Procedures and equipment available for handing and disposal of radioactive materials and effluents] #25, #33, #71 Replacement 41.14 [Principles of heat transfer thermodynamics and fluid mechanics] #6, #60 43.3 [Facility licensee procedures required to obtain authority for design and operating changes in the facility.] #95 Replacement There are __1__ RO questions with handouts provided and __1___ SRO questions with handouts provided.
ES-401 WC-2019-12 23 Form ES-401-9
_Rev 3 Page 23 of 23 OBDI 202 - IOLE Process Results Table RO LOK -
H 42 Avg RO LOD 2.52 Flaws 10 CFR Distribution RO LOK-F 33 AVG SRO LOD 2.44 Stem focus 14
41.1 1
43.1 2
SRO LOK - H 16 Overall LOD 2.5 Cues 0
41.2 2
43.2 1
SRO LOK - F 9
T/F 0
41.3 2
43.3 1
Cred Dist 16
41.4 1
43.4 3
8 Partial 3
41.5 16 43.5 17 RO Mod 1
1.333 SRO Mod 0
0 job link 0
41.6 1
43.6 0
RO New 44 58.67 SRO New 23 92 units 0
41.7 23 43.7 1
minutia 0
41.8 4
Total Bank 32 32 backward 0
41.9 3
Total Mod 1
1 KA 2
41.10 17 Total New 67 67 SRO-only 8
41.11 0
LOD = 1 0
41.12 1
41.13 3
RO Unsat 4
5.333 SRO Unsat 5
20
41.14 2
36 Answer Dist (%)
RO-A 17 SRO-A 6
Total Sat 59 59 Total Unsat 9
9 RO-B 21 SRO-B 5
Total Edit 32 32 RO-C 20 SRO-C 6
RO-D 17 SRO-D 8
Note: Sat/Unsat percentages reflect original draft submittal. All questions administered were Sat.