ML19247D691
| ML19247D691 | |
| Person / Time | |
|---|---|
| Site: | South Texas  |
| Issue date: | 07/29/2019 |
| From: | Greg Werner Operations Branch IV |
| To: | South Texas |
| References | |
| Download: ML19247D691 (22) | |
Text
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9
- 1. LOK 2. LOD 6
7 Ans Letter CFR 8
Q#
(F/H)
(1-5) stem focus cueing T/F cred dist partial job link minutia
- /
units back-ward K/A SRO-only B/M/N U/E/S A/B/C/
D 55.41x55
.43y Explanation 1
F 3
B S
B 41.10 2
F 2
N S
D 41.10 3
F 2
B S
D 41.7 ON 2015 NRC EXAM.
4 F
3 X
N E
A 41.7 Discuss similarity to Q21.
Questions having to do with CB locations of important switches are better served on the operating test. Don't see much discriminating value here.
Consider replacing K/A and/or question. Replaced with new Q. Q now SAT 5
F 2
N S
D 41.7 6
F 2
B S
C 41.10 ON 2015 NRC EXAM.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 to 5 (easy to difficult) rating scale (questions in the 2 to 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- a. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- b. The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- c. The answer choices are a collection of unrelated true/false statements.
- d. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- e. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- a. The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- b. The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- c. The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- d. The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
Place the answer letter here Place the 55.41 or 55.43 item here
- 8. At a minimum, explain any Unsat ratings (e.g., how the Appendix B psychometric attributes are not being met). a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 7
F 3
X N
E C
41.10 Change distractor B to "10-40 CPS," change C to "the audible count rate stops working in the control room but is still audible in the RCB," change D to "3055 ppm at 0200 and 3035 ppm at 1400."
Revised. Q now SAT 8
H 3
X X
N U
B 41.12 According to the reference, >25 REM exposure is only allowed for lifesaving activities (not equipment). Question does not appear to have a correct answer as written. In stem, change to "an actibity to protect large populations," keep area exosure rate at 66 REM/HR, change stay time to 22 minutes, and change correct answer to "B." Also revise explanations. Revised. Q now SAT 9
H 4
X N
E C
41.10 Change MODE 2 to MODE 5 in stem. Revised. Q now SAT 10 F
3 X
N E
B 41.10 Change "will" to "should" in stem.
Revised. Q now SAT 11 F
3 B
S B
41.10 ON 2015 NRC EXAM. Please amplify explanation for distractor A. Revised. Q now SAT 12 F
2 N
S D
41.1 13 F
3 X
N E
A 41.10 Modify stem to say "by procedure, the crew is required to have a MINIMUM of" Revised.
Q now SAT 14 H
3 X
B E
D 41.10 ON 2018 NRC EXAM.Change "will" to "did" in stem. Revised. Q now SAT 15 H
3 X
N E
C 41.7 This is "below the line" TS knowledge - how RO knowledge?
I don't see in provided reference where four channels of PZR level are required. Reference discussed; verified RO expected knowledge. a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 16 H
3 X
X N
U D
41.5 Don't understand how B and C are ever possible. When would one ever go to FRC.1 on an Orange or FRC.2 on a red? B and C appear to be implausible without reading the question. Also, is knowing orange paths from memory RO knowledge? Replaced with new Q.
Q now SAT 17 F
3 X
X N
U B
41.10 Queston stem lists only problem as loss of offsite power. What would this have to do with a SGTR vulnerability? Obvious that you have a problem with forced RCS circulation, which renders distractors A and C implausible.
Also, the correct SG levels "just happened" to be the choice that provides the most secondary inventory. Q discussed; changed correct answer to be a choice with the LESSER inventory. Q now SAT 18 H
3 N
S B
41.10 First ten. REFERENCE REQUIRED.
19 F
2 X
N U
A 41.10 Almost anything could impact critical systems and components necessary for accident response, making it the obvious (1) answer (makes distractors B and D implausible). Revised to put a(1) and c(1) in stem and ask what MINIMUM level this would occur at. Q now SAT 20 H
4 X
X N
E C
41.10 Change "will" to "should" in stem.
Capatalize AND in distractors C and D Revised. Q now SAT 21 F
3 N
S A
41.7 OK - but in the future please avoid asking CB locations of key switches as this is better served on the operatin test. Discuss similarity to Q4. Q 4 replaced. Q SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 22 H
3 X
N E
A 41.10 First ten. If modified, need to see original question. Was original question used on any previous NRC exam? In stem add "per procedure XXX," and change "will" to "should."AFTER FIRST REVISION: Q was replaced Q now SAT 23 H
3 X
N E
D 41.10 First ten. Add "per procedure XXX" in stem. Revised. Q now SAT 24 H
3 X
X N
E C
41.10 In stem, add "per procedure XXX, the crew should FIRST depressurize all intact SG to" Also, the ICC procedure actually says to depressurize to LESS THAN 305 psig. Need to modify C and D to specify "less than" 305 psig to be consistent with procedure. Revised. Q now SAT 25 F
3 X
N U
C 41.6 Applicant knowing where to find the reactor trip switches in the CR is LOD=1 knowledge, and is cetainly verified during the operating test (immediately eliminates A and B as plausible).
Either need to revise question or select new K/A / Replaced with Q that describes CT used in Event 4 of Scenario 3 of the operating test.
Need to Replace Q Replaced with new Q. Q now SAT 26 H
3 X
N E
B 41.10 As written, if D was the correct answer, than A would also be correct, eliminating D as a plausible distractor. Modify stem to say "verify level is less than a MINIMUM of" to eliminate problem. Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 27 H
3 X
B U
D 41.10 USED ON 2009 NRC EXAM.
Distractor A not plausible, as all other distractors have some procedural guidance associated with them except this one + where does 3000 gpm come from?
Distractor B not plausible - I have never seen "use skill of the craft" as a correct answer on any NRC exam. Distractor C not plausible as no information is given about the RCS in stem except a 5% PZR level with no trend. Zero indication a LOCA is happening. This leaves only the correct answer as plausible. Revised to add procedures, eliminate "skill of the craft," and to specify that PZR level is lowering. Q now SAT 28 H
3 X
B E
C 41.10 ON 2011 NRC EXAM. Change "will" to "should" in stem Revised.
Q now SAT 29 H
3 B
S B
41.10 ON 2014 NRC EXAM.
30 H
3 B
S B
41.7 ON 2017 NRC EXAM.
31 H
3 X
N E
D 41.7 If discussing "top priority" of operators, then there should be procedural direction to perform the associated tasks. Is there procedural direction (not in reference)? Stem revised to include procedure. Q now SAT 32 H
3 X
X N
E C
41.10 Stem says a 1E 125VDC bus is de-energized. Correct procedure is Loss of Class 1E 125VDC (answer is in question). Could we just say "a 100% ground has occurred on 125VDC Bus E1B11?" Also need reference that directs placing excess letdown in service. Revise stem to ask for "a procedural required action is to" Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 33 H
3 X
N E
C 41.10 Change "will" to "should" in stem.
Revised. Q now SAT 34 H
3 N
S D
41.5 35 H
3 X
X B
E D
41.7 Change "wills" to "shoulds" in stem. Discuss plausibility of distractor C. Discussed and revised. Q now SAT 36 F
3 X
X B
E B
41.7 ON 2013 NRC EXAM. Add "power" after 100% in stem. Need new D. Implausible to believe containment integrity would be compromised with isolation valve closed and de-energized.
Replaced D. Revised stem. Q now SAT 37 H
3 B
S B
41.8 ON 2014 NRC EXAM.
38 H
3 X
B E
C 41.7 ON 2016 NRC EXAM. Delete first sentence in stem, replace with "Unit 1 is at 50% power." Replace "became an issue" with "began oscillating." Revised. Q now SAT 39 H
3 X
N E
C 41.10 Why not just say "trip the reactor" in A and B? Doesn't a reactor trip "suspend the startup?" (didn't see anything about suspending the startup in the reference). DNB threat at 50 cps does not seem plausible - discuss other options for B and D (cold water accident protection?) Revise Q to change "suspend startup" to "maintain current power level." Change "DNB" to "excessive cooldown." Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 40 H
3 X
N U
B 41.11 Reference doesn't make sense as it talks about Unit vent stack monitors and not RCB atmospheric radiation (need new reference?). Don't see the plausibility of failed fuel in distractors C and D. Why would anyone think you would get atmospheric alarms in containment with failed fuel if there is no leakage? Q replaced with new Q; revised C and D to include "to detect RCS leakage during at-power operations." Q now SAT 41 H
3 X
N E
C 41.4 Change "will" to "should" in stem.
See Q43 comment regarding control boards. Where is the calculation info in the reference
(.775X1400)? Could we revise to make solely a calculation problem? Reference enhanced; Q revised to delete control board portion and to have only 4 numbers in distractors. Q now SAT 42 F
3 N
S D
41.4 43 F
3 X
X N
U C
41.3 Change "will" to "should" in stem.
Asking control board numbers for where indications are located is not very dicriminatory and better observed during scenarios and simulator JPMs. Stem cues RCS pressure is in the correct answer, rendering distractors A and B implausible Revised stem and eliminated control board numbers.
Q now SAT 44 F
3 X
N E
D 41.3 Implausible that a student would not know that there is a control board indication for PRT level.
Better to ask relief setpoint?
Revised to eliminate control board portion; relief setpoint clarified. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 45 H
3 N
S A
41.7 46 F
3 N
S A
41.7 47 F
3 N
S D
41.4 48 H
3 N
E A
41.7 Needs 10 CFR reference.
Revised. Q now SAT 49 H
3 X
X N
E A
41.4 Change "will" to "should in stem.
Very close to Q 65 (should probably replace one or the other).
This one better than 65. Need 10 CFR reference. Revised. Q now SAT 50 H
3 B
S A
41.7 Looks like the same thing as Scenario 2, event 3 (need to replace Q) Determined Q was SAT as written following scenario validation 51 F
3 X
X N
E B
41.5 Need to add "Per procedure xxx, the normal operating range" in stem (didn't see where normal operating range was discussed in references). Need to specify what temperature is high in (2). C and D temperatures seem a bit far fetched - might be better to ask for setpoint instead of range (discuss) Added procedure in stem and revised (2) temperature.
Q now SAT 52 F
3 X
N E
C 41.4 Change "wills" to "shoulds" in stem. Revised. Q now SAT 53 H
3 X
B E
A 41.7 ON 2017 NRC EXAM. Change "wills" to "shoulds" in distractors.
How could D be right without C being right (makes D implausible)? If the student realizes that pressure would either rise or lower, doesn't that make only A and B credible distractors?
Revised. Q now SAT 54 H
3 X
B E
B 41.5 Change "will" to "should" in stem.
Beaver Valley event. Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 55 F
3 X
X X
N U
A 41.2 If the core was partially uncovered, wouldn't the lower RVWL probe still be uncovered (making B also correct)? Also, if there were 8 probes there would be two correct answers as 6 is a subset of 8. This makes distractors C and D implausible. Q needs restructured to eliminate problems. Q restructured to eliminate problem. Q now SAT 56 H
3 X
B E
C 41.7 ON 2016 NRC EXAM. Changes "wills" to "shoulds" in stem and distractors. Revised. Q now SAT 57 H
3 X
B E
B 41.4 ON 2009 NRC EXAM. Voltage regulator is in stem and in distractors A and B. Need to better understand why anyone would even consider distractors C and D. Deleted voltage cue in stem. Q now SAT 58 H
3 X
X B
U A
41.7 Change "will" to "should" in stem and distractors. Delete "always" in A and B. Stem indicates "All systems function properly." If they did, one would not have invalid RAW water alarms coming in.
This makes distractors B and D implausible. Revised; deleted "all systems function properly" in stem. Q now SAT 59 H
3 X
B E
D 41.7 First ten. ON 2016 NRC EXAM.
Looks a lot like Event 4 in scenario 1. Change "will" to "should" in distractors and stem.
Revised; Q determined not to be in conflict with scenario during operating test validation. Q now SAT 60 H
3 X
B E
C 41.7 ON 2015 NRC EXAM. Change "wills" to "shoulds" in stem.
Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 61 H
3 X
X B
U A
41.7 ON 2016 NRC EXAM. Change "will" to "should" in stem and distractors. Unless the student believes that SG 1C would be unaffected, then either A or B has to be correct, immediately eliminating C and D as plausible distractors. Q restructured to eliminate problem. Q now SAT 62 H
3 X
X N
E D
41.7 Change "wills" to "shoulds" in stem. Don't see the value in recalling the number of the level transmitter - would rather see four different leak rates in the distractors (all in the same time frame, i.e. "per hour" or "per 12 hour1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> shift"). Also - need reference that shows VCT loss rate without makeup. Revised Q to have four different leak rates. Q now SAT 63 H
3 X
N U
C 41.4 ON 2014 NRC EXAM. Needs 10 CFR reference. Question does not appear to be dicriminating enough. One only needs the knowledge that a regular dosimeter will not alarm to eliminate 2/4 distractors.
Replaced with new Q. Q now SAT 64 H
3 N
S A
41.1 65 H
3 X
N E
D 41.5 Change "wills" to "shoulds" in stem. Simple fundamental question on temperature coefficient of reactivity; close to LOD=1. Also very close to Q 49 (should replace one or the other)
Replaced with new Q. Q now SAT 66 H
3 N
E C
41.6 Change "will" to "should" in stem.
Revised. Q now SAT 67 H
3 X
N E
A 41.2 Change "wills" to "shoulds" in stem. Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 68 H
3 X
N E
B 41.7 Distractor B implausible as it has a pump selected to "off" running.
Distractor D is essentially "none of the above" and should be avoided.
Discuss restructuring Q. Q restructured; enhanced explanation as to why a pump selected to "off" may auto start. Q now SAT 69 F
3 X
X X
N U
C 41.2 In stem, change "the reason is" to "the reason should be." Control bank D is mentioned three times in the distractors, while banks A, B, and C are mentioned once, cueing that the problem is in control bank D. Also, distractor D is the only distractor that has a rod position difference within the same bank, obviously cueing it as the correct answer. Replaced with new Q. Q now SAT 70 F
3 X
X N
E A
41.10 Change "will" to "should" in stem.
Would like fuller explanation as to why anyone would think a degass could be perfromed with no forced flow. Revised; change "no" to "at least two" in C and D. Q now SAT 71 F
3 X
X N
E D
41.7 Change "wills",to "shoulds" in stem. Question needs restructuring. As written can be answered with only partial knowledge. Maybe better if 2 by 2 with 2/8 and 8/2 in two distractors each with "open" in two distractors and "closed" in two distractors. Q restructured. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 72 F
2 X
B E
B 41.7 ON 2017 NRC EXAM. Discuss restructuring question. As written, A and B are in three distractors, while C is only in two. This implies A and B are the correct trains.
Also, distractor D is essentially saying "all of the above" which should be avoided. Q restructured; Q now SAT 73 F
3 B
S B
41.7 ON 2014 NRC EXAM.
74 F
2 B
S A
41.13 ON 2010 NRC EXAM.
75 F
2 X
N E
B 41.7 In stem, change "would" to "should" Revised. Q now SAT 76 F
3 X
X N
E A
43.2 "limits" in stem cues that (1) has more than one answer. Change to "a limit." Also in stem, change "at least" to "a MINIMUM of." In distractors, capitalize AND in A and B Revised. Q now SAT 77 H
3 X
X X
N E
B 43.5 In stem, change "will" to "should."
Distactor B stands out as the correct answer, as it is the only distractor to have the term "take required actions" in it. Per the reference, C could also be interpreted as a correct answer.
All but disctractor D have enter E-0 first, rendering distractor D implausible Revised: made D to look consistent with B and D. Q now SAT 78 H
3 X
X B
E D
43.5 ON 2018 NRC EXAM. Change "will" to "should" in stem. Change C to have the same feed pumps as D for consistency. Revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 79 H
3 X
X B
E A
43.2 Change "will" to "should" in stem.
As written, C is a subset of D. In C and D, change "up to" to "a MAXIMUM of." What is the definition of an "on shift crew member?" Discuss the possibility of making a modified bank by having the STA work six 12 hour1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> shifts (changes correct answer to A) Revised as described to make a modified bank Q. Q now SAT 80 F
3 X
X X
B E
C 43.1 First ten. MAB, TGB stand for?
Change "will" to "should" in stem.
As written, answer is in stem.
Remove cue that recirc limits haven't been met. Simply state that the tank was recirculated for 30 minutes. Will ODCM limts be exceeded or not? Anything MAY exceed limits. If necessary, place a source number in the stem.
Explain why TS limits not exceeded. Distractors better two by two for operators instead of listing chemistry technician twice.AFTER FIRST REVISION:
Q still needs to be revised to 2 by 2 instead of thee inadequates and one adequate. Delete the adequates/inadequates and just provide four options. Need new D -
as written is the same thing as "none of the above." Revised-added "in accordance with procedure XXX" in stem.
Restructured distractors to have four distinct choices. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 81 H
3 X
B E
D 43.2 ON 2018 NRC EXAM. Delete "will" in stem. P-6 is a permissive, not a power level, and is already armed based on info in the stem.
A and C are thus easily eliminated and are implausible distractors.
Revised A and C; Q now SAT 82 H
3 X
X X
N E
B 43.2 Change "will" to "should" in stem.
By having "restore (at least one)"
in stem, it cues that both offsite power sources would be affected.
Also "hours" in stem cues that the correct answer is greater than one. Also, there are two correct answers as written (A and B).
Need to revise second half of stem to read "Per TS, action must be taken within a MAXIMUM of
____hour(s)." Q revised and restructured. Q now SAT 83 H
3 N
S A
43.2 84 F
3 X
N E
B 43.4 Answer doesn't fit with Q (fuel movement?) Why would anyone associate Mode with gaseous release requirements (C and D)?
Q revised and restructured. Q now SAT 85 H
3 X
B E
C 43.2 ON 2015 NRC EXAM. Change "will" to "should" in stem. Change rad level to 2200. Revised. Q now SAT 86 H
3 X
N E
B 43.5 Change "wills" to "shoulds" in stem. Please explain how student concludes CET temp is less than 708 Discussed and revised. Q now SAT 87 H
4 X
X N
E C
43.5 How can an ATWS occur with no offsite power (i.e. is this a credible condition)? Change "wills" to "shoulds" in stem. Q replaced with new Q. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 88 H
3 X
X N
U D
43.5 Change "will" to "should" in stem.
Distrators A and C: how is it plausible to associate a leak in containment with a rising floor drain tank level? Doesn't appear plausible. Revised Q to eliminate drain tank levbel in distractors. Q now SAT 89 H
3 X
X N
E A
43.2 Change "will" to "should" in stem.If 10 hours1.157407e-4 days <br />0.00278 hours <br />1.653439e-5 weeks <br />3.805e-6 months <br /> was correct, then 6 would also be correct as written.
Eliminates C and D as plausible.
In stem, add "within a MAXIMUM of ___ hours." Revised. Q now SAT 90 H
3 X
X N
E D
43.5 Change "will" to "should" in stem.
Distractor B: Don't see how student could target the RCP number 2 seal given the limited info in stem. Distractor D: How could student associate the letdown pressure control valve with radioactive pipe penetration temperature? Q replaced with new Q. Q now SAT 91 H
3 X
X B
E A
43.5 In stem, should "occurred Core Reload" be "occurred during Core Reload?" Also in stem, change "will" to "should." How are B and D plausible - taking actions in the FHB instead of containment when stem specifically says RCB alarms? What does CRE stand for? Q restructured and revised. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 92 F
3 X
X N
E C
43.4 First ten. Don't see how chemistry manager plausible in A and B - when is a chemistry manager autorization ever required for licensed operators?
Please explain correct answer -
how can contaminated water accumulate if there is no flow (change to low flow)? AFTER FIRST REVISION - Q doesn't appear to be revised.Revised Q to put SM in stem and ask for the independent reviewer. Changed "low flow" to "no flow. Q now SAT 93 H
3 X
B E
D 43.5 First ten. In stem, change "will' to "should." What is GWPS and why is it plausible (rupture disk failure seems obvious)? AFTER FIRST REVISION - Isn't the proper response to close the associated block valve? Q restructured and revised. Q now SAT 94 F
3 X
X N
E D
43.6 First ten. Correct answer obvious.
Any supervisor associated with refueling should stop core alterations when required. Better to give the supervisor a set of circumstances in the stem that require an action OTHER than stopping core alterations. AFTER FIRST REVISION - correct answer in key needs to match up with correct answer in Q. Revised.
Q now SAT 95 F
3 X
N U
B 43.4 ON 2011 NRC EXAM. Shift Manager cued as correct answer in stem + common knowledge that emergency work would have priotity over emergent work makes correct answer obvious. Replaced with new Q. Q now SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 96 H
3 X
X N
E B
43.3 Change "will" to "should" in stem.
Operations Manager not a credible choice as shift SRO's have approval of shift activities.
Performing a general revsion to perform an alternate step seems far fetched as well. Only credible distractor is the correct answer.
Need 10CFR reference. Q restructured and revised. Q now SAT 97 F
3 X
N E
B 43.5 Change "wills" to "shoulds" in stem. Change "who is" to "should be" in stem. Revised. Q now SAT 98 H
3 X
X N
U A
43.4 First Ten. As written, doesn't meet K/A. Must tie situation to a some kind of emergency action level threshold or classification knowledge. Change "will" to "should" in stem. Add "per procedural requirements" in stem.
Add THE MOST SIGNIFICANT risk is... in stem.
/REPLACE?NEW Q; Change "wills" to "shoulds" in stem.
Distractors C and D can be eliminated without reading question. How could containment pressure lower on loss of containment cooling? Replaced with new Q. Q now SAT 99 H
3 X
X N
E D
43.5 Change "wills" to "shoulds" in stem. Placing the startup feed pump in service at 100% power doesn't appear plausible for a failed steam pressure channel (distractors A and C) Following discussion on capacity of startup feed pump, question was deemed SAT a Rev 2
ES-401 STP-2019-07 Written Examination Review Worksheet Form ES-401-9 100 H
3 X
X N
U C
43.5 First ten. REFERENCE REQUIRED. Where is the required reference? Change "will' to "should" in stem. Use Number instead of "#" for consistency.
Need 10 CFR reference. AFTER FIRST REVISION - LOD=1. All student has to do is subtract 5 from 415 to immediately see on the handout that seal leakoff is above the normal operating range.
Still needs 10CFR reference.
Replaced with new Q. Add
"...rises to a MINIMUM of..." in stem. Q now SAT Results Table RO LOK -H 44 Avg RO LOD 2.91 Flaws 10 CFR Distribution RO LOK-F 31 AVG SRO LOD 3.04 Stem focus 51 41.1 26 43.1 1 SRO LOK - H 18 Overall LOD 2.94 Cues 7
41.2 3
43.2 7 SRO LOK - F 7
T/F 0
41.3 2
43.3 1 Cred Dist 51 41.4 7
43.4 4 RO Bank 25 33.33 SRO Bank 7
28 Partial 4
41.5 5
43.5 11 RO Mod 0
0 SRO Mod 0
0 job link 0
41.6 2
43.6 1 RO New 50 66.67 SRO New 18 72 units 0
41.7 26 43.7 0 minutia 0
41.8 1
Total Bank 32 32 backward 0
41.9 0
Total Mod 0
0 KA 1
41.10 26 Total New 68 68 SRO-only 2
41.11 1
LOD = 1 0
41.12 1
4 41.13 1
16 Answer Dist ( in %)
41.14 0
RO Edit 41 54.67 SRO Edit 20 80 RO-A 18 SRO-A 6
RO-B 19 SRO-B 7
Total Sat 22 22 Total Unsat 17 17 RO-C 20 SRO-C 5
Total Edit 61 61 RO-D 18 SRO-D 7 a Rev 2
Question Overlap with the Previous Two NRC Exams QA form ES-401-6 item 4 requires 4 or less questions on RO exam from previous two NRC exams, SRO portion two or less questions from previous two NRC exams*
- if this is exceeded, the region shall call NRR to explain why/reasons.
RO overlap from previous two NRC exams 4
SRO overlap from the previous two NRC exams 2
Questions Requiring References to Answer 6-10 questions rule of thumb on SRO portion of exam are allowed to be open reference, while the RO exam is generally none RO Questions that require hand-outs 2
SRO Questions that require hand-outs 0