ML20315A451
| ML20315A451 | |
| Person / Time | |
|---|---|
| Site: | Dresden  |
| Issue date: | 07/13/2020 |
| From: | Chuck Zoia NRC/RGN-III |
| To: | Exelon Generation Co |
| Zoia C | |
| Shared Package | |
| ML19121A247 | List: |
| References | |
| Download: ML20315A451 (20) | |
Text
ES-401 Facility: Dresden/Year: 2020 Written Examination Review Worksheet Form ES-401-9 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
T/F: The answer choices are a collection of unrelated true/false statements.
Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
F 2
?
N E
2X2 NRC: State in the pedigree that this is information required to be known from memory and explain why.
Response
FWLC Lesson Plan, Objective 12, covers knowledge of the effect that a total loss or malfunction of various plant systems has on the plant. The pressure at which backup nitrogen will activate, and the length of time the backup nitrogen will function is covered under this objective, which is required to be known from memory. This knowledge is important since it gives the operators knowledge of how long the backup air would be expected to be available if a loss or reduction in normal air supply pressure occurs.
Added to pedigree.
NRC: Question is now SAT 2
F 3
?
B E 2013 Cert Exam NRC: State in the pedigree that this is information required to be known from memory
ES-401 Facility: Dresden
/Year: 2020 2
Form ES-401-9 Page 2 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only and explain why.
Response
Lesson Plan DRE223LN001, Objective 3, covers knowledge of the Drywell components under normal operating conditions. This knowledge, to be known from memory, includes knowledge of design limits for temperature and pressure. This is important information to an operator, since it provides the basis for knowledge of when component operating limits have been exceeded. Added to pedigree.
NRC: Question is now SAT 3
F 2
X B
E 2X2; 2011 Cert. Exam NRC: Part 1 of the question needs to apply to the K/A and to part 2.
Response: The location of the Boron injection point has a direct effect on boron distribution, and therefore power reduction in the DEOPs. Per EPG/SAG Appendix B, Rev 3, page B-14-45: When an amount of boron equivalent to the HSBW has been injected, RPV water level is restored to and maintained within the normal operating range. As RPV water level is increased, natural circulation flow increases and the boron which has accumulated in the lower plenum is quickly mixed and distributed throughout the core region. This phenomenon is known as boron remixing, thereby distinguishing it from mixing that may have occurred earlier in the transient, before RPV water level was lowered.
Additionally, location of boron injection applies to this K/A due to the possibility of RWCUs taking boron out of the core. From UFSAR 9.3.5.3 - In the event that the SBLC system interlock fails to isolate the reactor water cleanup system, the cleanup system would start to remove the boron from the core. This removal rate would be extremely small because of the flow path of the boron; the boron is inserted into the bottom of the vessel, moves up through the core, then to the outside of the core shroud.
The K/A Justification for Part 1 of the question was added to the pedigree of the question.
NRC: Question is now SAT 4
F 2
X N
U S
2X2 NRC: It is not plausible that with the entire area from the 2B IAC to the U2 EHC pumps engulfed in flames and the potential for a severe, Appendix R type fire to induce multiple shorts, that a CAUTION sign would be enough. Since this eliminates 2 distractors, this results in the question being UNSAT. and an easier question.
Response: Revised the question.
NRC: Question is now SAT 5
H 3
X B
E 2017 NRC Exam, 2019 Cert Exam NRC: Question does not match the K/A. The question asks for scram criteria based on
ES-401 Facility: Dresden
/Year: 2020 3
Form ES-401-9 Page 3 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only CRD position and not the interrelation between CRD pumps and accumulator pressures.
Response: Question does match the K/A due to DOA 0300-01 section D.4 stating: If CRD Charging Water Pressure can NOT be immediately restored to 940 psig, Reactor Steam Dome Pressure < 900 psig and any ACCUMULATOR TROUBLE light illuminates on the full core display for a control rod NOT at positions 00, THEN immediately scram the reactor AND enter DGP 02-03. The ACCUMULATOR TROUBLE light comes in at 1000 psig on the each individual CRD, therefore the student must know the accumulator alarm setpoint of 1000 psig is sufficient accumulator pressure to still be able to scram the reactor. Added to pedigree.
NRC: Question is now SAT 6
H 3
B S 2X2; 2013 Cert. Exam 7
H 3
B E
2007 NRC Exam NRC: Editorial::
a) Bullets vs. ? in stem, b) Remove the a in front of distractors A & B, and reword like distractor C, c) Reword stem where is timed opened to is timed open.
Response
- a.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
- b.
Removed a in front of answer and distractor 1 and reworded like distractor 2.
Also changed tipped in distractor 3 to trip to match grammar structure of the other answers.
- c.
Corrected as requested.
NRC: Question is now SAT 8
H 3
B E
NRC: The bolded ONE in the stem should be deleted - it adds no value and would minimize the amount of emphasized information in the stem.
Response
Correction made as requested NRC: Question is now SAT 9
F 1
3 X
?
M?
N E
2X2; Early Review Submittal NRC: The choices where both sets of IRMs are either energized or deenergized are not plausible, reducing the LOD by making the probability of guessing correctly 50%. In addition, supply the original question to show the question is significantly modified.
ES-401 Facility: Dresden
/Year: 2020 4
Form ES-401-9 Page 4 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Finally, state the learning objective and supply the lesson plan as a reference to support the requirement that this information needs to be known from memory.
Response: Wrote new question. For final submittal all procedures and lesson plans will be included on disk. Question is #9 on the exam.
NRC: (NEW) State in the pedigree that this is information required to be known from memory and explain why.
Response
Lesson Plan DRE263LN003, Objective 2, covers knowledge of the inter-relationships between the 24-48 VDC system and related systems, such as the loads fed from 24-48 VDC. This knowledge is required to be known from memory.
NRC: New question is now SAT 10 H
3 B
S 2009 NRC Exam 11 H
2 B
S 2010 NRC Exam 12 H
2 X
B E
2009 NRC Exam NRC: Distractor B is not plausible. Suggest using Positive 5 VOLTS.
Response
Correction made as requested. Revised order of distractors to meet psychometric requirements.
NRC: Question is now SAT 13 F
3 B
E 2012 NRC Exam, 2013 Cert Exam NRC: Explain why the phase angles would be matched as stated in the pedigree for distractor D.
Response
Although we do NOT parallel an EDG and the SBO due to concerns with circulating currents (as the note in the procedure states), if we did then the two diesel generators would be synchronized, and therefore the phase angles would be matched. Therefore, distractor D is not correct. This information was added to the pedigree for distractor D.
NRC: Question is now SAT 14 H
2 B
E NRC: Editorial: Revise the pedigrees Answer Explanation from therefor 25%of to therefore 25% of
Response
Correction made as requested. Swapped distractor A and B due to psychometrics.
Also, corrected typo in answer explanation, fixed therefore NRC: Question is now SAT
ES-401 Facility: Dresden
/Year: 2020 5
Form ES-401-9 Page 5 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 15 H
3 B
S 2010 NRC Exam 16 H
F 2
B E
NRC:
a) Arriving at the correct answer relies on recognizing that the 30 second time delay is met (thus F).
b) Where is the 30 second time delay explained? (what reference) c) Modify distractor C to avoid reminding applicants about the 30 second time delay.
Response
a)
Changed to Memory.
b)
DOP 1500-03, step G.1.b.9 has a note that addresses the 30 second time delay.
c)
Question was revised to change time to 40 seconds after LPCI initiation instead of 20 seconds after LPCI initiation. The answer and the distractor were changed to remove the 30 Second portion.
NRC: Question is now SAT 17 H
2 B
E NRC:
a) Editorial: Bullets vs. ? in stem b) Explain what all the different CST level low setpoints mean, and why 6 feet was given in the stem versus a different value.
Response
- a.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
- b.
HPCI takes suction from the CSTs, which are normally cross connected. If level in Tank 2/3A is less than 11.9 feet (+/- 2 inches); AND level in Tank 2/3B is less than 8.3 feet (+/- 2 inches), the HPCI suction valves will re-align to take suction from the Torus. Six feet was arbitrarily chosen because it was less than the nominal value of eight feet, which would have caused the HPCI suction transfer to occur. Added additional detail to the answer explanation.
NRC: Question is now SAT 18 H
F 2
B E
NRC:
a) Knowing that RMCS receives a rod out block due to an APRM having less than 50%
of assigned LPRMs in service is all thats required for the correct answer b) Correct typo in the Answer Explanation from that to than c) If one might incorrectly think a Rod Select Block may also be correct, explain how it is caused, and how it may be appropriate to believe it may be caused by.
ES-401 Facility: Dresden
/Year: 2020 6
Form ES-401-9 Page 6 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only
Response
- a.
Question has been changed to Memory level
- b.
Correction made. Also revised answer order to address psychometrics
- c.
Added information from Lesson plan to pedigree to explain what will generate a Rod Select Block.
NRC: Question is now SAT 19 H
3
?
B E
NRC: Explain how this question tests the K/As Analog trip system criterion in the pedigree.
Response
The equipment listed in the question are all powered by the Analog Trip System (ATS).
A knowledge of the power source, via ATS, to each item of equipment is required in order to answer the question. Updated the pedigree to state that the equipment listed in the answer and the distractors is all powered by ATS. Added this to the pedigree.
NRC: Question is now SAT 20 F
2 B
E 2012 NRC Exam NRC:
a) Spell out FR in distractors or just use the SA-AA-129 terminology b) Provide SA-AA-129 and SA-AA-116 in References.
Response
- a.
Revised answer explanation to include appropriate long sleeve outer garment (Flame Resistant clothing meets this criteria) versus long sleeve cotton shirt.
Spelled out Flame Resistant in the distractor and answer. Changed location of answer for psychometrics due to changes in length of answer and distractor.
- b.
A copy of SA-AA-129 and SA-AA-116 was provided.
NRC: Question is now SAT 21 F
2 B
S 2008 NRC Exam, 2017 NRC Exam 22 F
2 B
E 2008 NRC Exam, 2011 Cert Exam NRC: Provide a copy of procedure HR-AA-07-101 in References and explain all acronyms in the pedigree.
Response
A copy of HR-AA-07-101 was provided. Revised pedigree wording to include a definition of No Solo, and to define QNE.
NRC: Question is now SAT
ES-401 Facility: Dresden
/Year: 2020 7
Form ES-401-9 Page 7 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 23 F
2 N
S 2X2 24 F
2 N
E 2X2; Early Review Submittal NRC: State the learning objective in the pedigree and supply the lesson plan as a reference to support the requirement that TS Bases information needs to be known by ROs. Finally, in the pedigree, include support that this question, which was selected for Tier 3, maintains its focus on plantwide generic K/As and is not an extension of Tier 2 (Systems) - See ES-401, Page 7.
Response: ROs are required to know tech spec actions of less than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> from memory. The focus is on Reactor pressure and not on any specific systems and actions. Purely a design/ fundamental question. For final submittal all procedures and lesson plans will be included in submittal. In each lesson plan objective 7a clearly states a requirement to from memory, associated with any LCO with a duration of 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or less. Added this justification to pedigree. Question is #24 on the exam NRC: Question is now SAT 25 H
2 B
S 2014 NRC Exam 26 F
3
?
B E
2014 NRC Exam NRC:
a) Provide a copy of procedure NISP-RP-004 in References b) Editorial: Bullets vs. ? in stem c) State in the pedigree that the information is required to be known from memory and explain why.
Response
- a.
A copy of NISP-RP-004 was provided with the references.
- b.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
- c.
This is required operator knowledge, as part of NGET. Added to pedigree NRC: Question is now SAT 27 F
2 X
B E
2x2 NRC: Based on the severity of the accident described in the stem, NOUE is not plausible and it could also be argued that ALERT would also be implausible too. It would be more discriminating to limit responses to GE and SAE, coupled with another consideration aligned with the K/A (Thus, a 2X2 format).
Response: Changed question to a 2x2 format.
NRC: Question is now SAT
ES-401 Facility: Dresden
/Year: 2020 8
Form ES-401-9 Page 8 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 28 H
3 N
E NRC: Editorial: Bullets vs. ? in stem
Response
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: Question is now SAT 29 F
2 B
S 2007 NRC Exam; Reference Provided: HPCI flow controller image (embedded) 30 H
3
?
B E
2012 NRC Exam NRC: Explain how the K/A is met in the pedigree Response: Added justification to pedigree.
NRC: Question is now SAT 31 F
H 3
2 X
B E
2010 NRC Cert Exam; 2X2; Early Review Submittal NRC: State the learning objective and supply the lesson plan as a reference to support the requirement that this information needs to be known from memory. Also, is AEER a known/official acronym? If not, spell it out to avoid unnecessary questions.
Response: Replaced question. Question is #31 on the exam.
NRC: New question is SAT 32 H
3 B
S 2X2 33 H
3 B
S 2X2; 2012 NRC Exam 34 H
F 2
1 2
X N
E 2X2; Early Review Submittal NRC: The question does not meet the K/A (Specifically, including understanding of running and incoming voltages) but relies on remembering often-practiced procedure steps when closing the output breaker on the EDG. The underlying reasons given in the Answer Explanation of the pedigree need to be demonstrated, versus just recalling actions taken, as it happens, because of those reasons. Also, as written, the LOK = F.
Response: Revised question to meet K/A requirement for incoming and running voltages. Question is #34 on the exam.
NRC: The revised question better meets the K/A but is now an easy memory question focusing on recalling how procedure steps are performed versus showing an understanding of running and incoming voltages. Suggest refocusing the question to answer why as well as how.
Response: Incorporated the comments made by RIII to address the concerns above.
35 F
2 B
S 2010 NRC Exam
ES-401 Facility: Dresden
/Year: 2020 9
Form ES-401-9 Page 9 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 36 H
3 B
S 2X2; 2013 Cert Exam:
37 H
3 B
S 2017 NRC Exam 38 H
3 N
E 2X2; NRC: There is misalignment between the overall Answer Explanation and the pedigree explanation for distractors C & D - please clarify.
Response
Revised procedure number in overall Answer Explanation from DSSP 0010-10 (typo) to DSSP 0010-01, to match up with pedigree explanation for answers C & D.
NRC: The question is now SAT.
39 F
H 3
N E
NRC:
a) Stem column (DRYWELL TEMPERATURE) alignment needs to be adjusted, b) The question requires more than just recognition of EOP entry conditions and immediate action steps (LOK = H).
Response
- a.
The stem column is correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
- b.
Changed LOK to H.
NRC: The question is now SAT.
40 H
3 B
S 41 H
3 B
S 2015 Cert Exam 42 H
2 B
S 43 H
2 X
N E
NRC: This question is asked in a confusing way, so the answer, which is an elapsed time, is in-between the distractors provided. This question could be asked more directly with the answers in terms of pressure dropped versus time elapsed.
Response: Per FacRep this question is examining system response and trend analysis, no changes made except adding later to the answers to show that this is elapsed time (e.g. 5 minutes later).
NRC: The question is now SAT.
44 H
3 N
E 2X2 NRC: Cite the specific reference where the open pathway prohibition is explained in the questions pedigree.
ES-401 Facility: Dresden
/Year: 2020 10 Form ES-401-9 Page 10 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only
Response
Revised pedigree and references to say DOP 1200-03 versus DOP 1900-03. That is the correct reference for the open pathway prohibition.
NRC: The question is now SAT.
45 H
2 X
B U
S NRC:
a) The question asks for the effect on gland seal steam system, but all the distractors fail to properly answer the question. Instead, they offer only unnecessary corrective actions.
b) Distractor A has no effect (not affect), and at 100% power is already stated in the stem and does not need to be repeated.
Response
- a.
Revised question wording to address actions needed to maintain adequate gland seal system, instead of effect.
- b.
Removed affect, as part of change to question stem.
NRC: The question is now SAT.
46 H
3 B
S 2012 NRC Exam 47 F
2 N
S Early Review Submittal.
Question is #47 on the exam.
48 F?
H 3
B E
2016 CERT Exam NRC: LOK needs to be explained in the questions pedigree, since resultant rise in pressure will cause the Bypass Valves to open.
Response: This was changed to a LOK=H, since it is more than just a memory question. The student needs to recognize that the fast closure of the Control valves will occur, and that the load and closing errors will also cause a fast closure of the intercept valves. Additionally, when these close, the rising RPV pressure will cause the Bypass valves to open. This was added to the pedigree.
NRC: The question is now SAT.
49 H
3 N
E 2X2 NRC: In the stem, state, but is not indicating bad quality, to avoid questions during exam administration. A failing instrument could be considered as bad quality.
Response: The current stem states but is not bad quality. Capitalized and bolded NOT in the question stem to ensure students recognize that a bad quality condition does NOT exist.
NRC: The question is now SAT.
ES-401 Facility: Dresden
/Year: 2020 11 Form ES-401-9 Page 11 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 50 H
3 B
S 2X2; 2016 NRC Exam 51 H
3 B
S 2017 NRC Exam; REQUIRED
REFERENCE:
12E-6822 52 F
2 N
S 2X2 53 F
3
?
N E
2X2 NRC:
a) Both sources are technically preferred, Contaminated Condensate is the MOST preferred b) In the pedigree, explain why this distinction is required to be known from memory (cite the objective, etc.).
Response
- a.
Added Most Preferred instead of Preferred in stem.
- b.
Added DRELN001, Objective 3, to the Objective list. Justification for Memory level: DRE233LN001.03j - Discuss the operation of the following components under normal operating conditions including support required from other plant systems and local indications, operations or override capability: Skimmer Surge Tanks. Added this information to the pedigree.
NRC: The question is now SAT.
54 H
3 B
E NRC: Add and stabilizes to H2 flow makes a step change to 94 scfm. for clarity.
Response: Made the recommended change.
NRC: The question is now SAT.
55 F
3 N
E 2X2 NRC: The stem statement, and CANNOT be reversed is unnecessary.
Response
Made the recommended change and changed Aux Oil Pump normally start to Aux Oil Pump would normally start.
NRC: The question is now SAT.
56 H
F 2
N E
NRC: LOK = F because the question only requires recall that there are no high temperature trips on the LPCI pumps needed for injection.
Response
Changed the LOK to F. Also reviewed the exam to ensure that enough High-level questions are on the RO exam.
NRC: The question is now SAT.
ES-401 Facility: Dresden
/Year: 2020 12 Form ES-401-9 Page 12 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 57 F
3 B
S 2015 NRC Cert Exam; Early Review Submittal Question is #57 on the exam.
58 F
2 X
B E
2015 NRC Exam NRC: Distractor A, part 2, does not answer the question asked.
Response
Changed distractor A, part 2 from SRM response is normal for these conditions to No limitation on grapple operation. Revised plausibility for Distractor A.
NRC: The question is now SAT.
59 F
2 N
S 60 F
2 N
S 2X2 61 H
3 2
X N
E 2X2; Early Review Submittal; Embedded Reference NRC: Explain how the question meets the K/A, specifically, Ability to locate, when various indications are given in the distractors; i.e. answers what lights are lit? Also, is the reference given in the pedigree correct? DAN 903(2) vs. DAN 902(3)?
Response: Replaced question. Question is #61 on the exam NRC: New question is SAT 62 F
2 B
E 2X2 NRC: Distractor D spacing needs to be aligned with the other distractors.
Response
Distractor D spacing is correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner.
NRC: The question is now SAT.
63 F
2 N
S 2X2 64 F
2 N
S NRC: Distractor D would be more visually balanced as MCC 29-3. Would that be a plausible distractor compared to MCC 39-2?
Response
No change made. MCC 39-2 was chosen because it is plausible, since it is the backup supply to the 2/3 battery charger. At Dresden, most power supplies were selected based on cost of copper wiring (i.e. closest to load) versus human factoring.
NRC: The question is SAT.
65 H
3 B
E 2X2; 2007 NRC Exam
ES-401 Facility: Dresden
/Year: 2020 13 Form ES-401-9 Page 13 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only NRC: The timing of the cues provided in the stem should be clarified by referring to a clock time versus saying XX minutes later multiple times.
Response
Changed the stem of the question to include the times 0910, 0930 (i.e. 20 minutes later), and 0945 (i.e. 15 minutes later). Reworded stem to allow use of these times in a more succinct and grammatically correct fashion.
NRC: The question is now SAT.
66 F
2 B
S 2009 NRC Exam, 2015 Cert Exam 67 H
3 N
E 2X2 NRC: The stem statement, and can not be turned is unnecessary.
Response: Made the recommended change.
NRC: The question is now SAT.
68 F
2 X
N E
NRC:
a) Editorial: Bullets vs. ? in stem b) Distractor A says Range 5, but its pedigree says Range 7, which seems more plausible.
Response
- a.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
- b.
Range 5 is less than range 7, so the distractor is still valid. Additionally, depending on the initial power level, temperature, RPV level, etc. having IRMs fall below range 5 could occur. The key is that the fact that this does not guarantee that the reactor will remain shutdown under all conditions. No change made.
NRC: The question is now SAT.
69 H
3 B
E NRC 2012 Exam NRC: Distractors C and D should be reduced to simply state the overall reason to be like Distractors A and B. For example, Distractor C should say NOT be performed to avoid adding positive reactivity. Distractor D should say NOT be performed to avoid removal of boron.
Response
Made recommended change and moved answer from C to D for psychometric reasons.
NRC: The question is now SAT.
70 H
3 N
S 2X2
ES-401 Facility: Dresden
/Year: 2020 14 Form ES-401-9 Page 14 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 71 H
3 X
N U
S 2X2 NRC: Distractors A(2) and B(2) are not plausible, and their plausibility is also unsupported in the pedigree. With 2 implausible distractors, the question is UNSAT.
Response
Shortened and revised distractor A(2) an B(2) to say 95% of noncondensible gases have been transferred from the drywell to the torus. Also revised the stem to add If Torus Sprays are started and shortened the answer and distractor D to say steam is bypassing the torus suppression function and entering the torus air space directly.
NRC: The question is now SAT.
72 F
H 3
B E
2008 NRC Exam NRC: The questions stem misalignment (initially) made it too difficult to evaluate. The reformatted version was readable but required one to consider backfeed in addition to recognizing several preferred power supplies for specific conditions (LOK = H).
Response: Changed LOK to H.
NRC: The question is now SAT.
73 H
2 N
E 2X2 NRC:
a) Distractors A(1) and B(1) are unnecessarily lengthy - BELOW is sufficient b) Define ERV when it is first used (Similar to DHR).
Response
- a.
The question was left as worded, except that the word EQUAL was removed from the C and D distractors in order to shorten the overall answer. Per the FSAR, the power level will recover to near the original power level. Since this power is slightly below the original power level, it allows the potential for two correct answers if the word BELOW is used instead of the current wording.
- b.
Defined ERV as requested.
NRC: The question is now SAT.
74 F
2 B
S 2X2; 2009 Cert Exam 75 F
2 X
B E
NRC: a) Distractor A is implausible and its plausibility support in the pedigree is weak b)
Its also implausible that you would not always get Annunciator 902-5 D-3, so it should be included in all distractors and bought up into the stem.
Response
- a.
Changed plausibility statement
- b.
Made recommended change and re-ordered distractors A and B for
ES-401 Facility: Dresden
/Year: 2020 15 Form ES-401-9 Page 15 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only psychometrics.
NRC: The question is now SAT.
76 H
3 X
N U
S 2x2, References provided NRC:
a) The question can be answered with RO-level knowledge; by knowing heat removal capacity of the methods in choices A, B, & D (C is not possible due to the loss of power). It does not require applicant to know how to implement DEOP-100 alternate pressure control methodologies, because these choices are valid alternate pressure control methods.
b) Editorial: Bullets vs. ? in stem Response: Replaced question.
NRC: The replacement addressed the concerns above (SAT).
77 F
2 N
S 2x2 78 H
3 N
S 2x2, References provided NRC: Editorial: Bullets vs. ? in stem
Response
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: Question submittal was SAT 79 F
2 B
S 2010 NRC Exam 80 F
2 B
S 2011 Cert Exam 81 H
3 N
S U
2X2; Early Review Submittal NRC: Provide DOA 5750-01 as a reference file and provide more details in the pedigree to support the plausibility of those distractors where a transition to it is made.
Response: For final submittal all procedures and lesson plans will be included in submittal. Question is # 81 on the exam.
NRC: Question submittal was SAT, however, post-exam comments revealed that there were 2 correct answers, and the question was included in the count of unacceptable questions per ES-501.
82 H
3 N
E Reference provided NRC: DOP 0500-7 was not referenced in DAN 902(3)-5 A-6, or D-13 (not found at all in the references provided) as stated in the pedigree. C-12 does say to reset the half
ES-401 Facility: Dresden
/Year: 2020 16 Form ES-401-9 Page 16 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only scram, though no procedural details were provided. Where is the reference to DOP 0500-7 to reset the half-scram?
Response
There is no reference in the DANs to DOP 0500-07. Dresden management expectation is that all equipment operations that are performed in the control room are made IAW a procedure or an equipment status tag, except those manipulations specifically excluded (for example, under OP-DR-108-101-1003, OPERATIONS CRAFT CAPABILITY ACTIVITIES, Attachment A, Approved Operations Craft Capability Activities List; or OP-DR-103-102-1002, STRATEGIES FOR SUCCESSFUL TRANSIENT MITIGATION). Clarified correct answer as to what procedures are used to reset the 1/2 scram and the rod block. Additionally, made grammatical corrections to the answer and distractors.
NRC: The question is now SAT.
83 H
2 B
E NRC:
a) Consider removing the bolding and caps from which and action from the stem.
b) Editorial: Bullets vs. ? in stem
Response
- a.
Made the recommended change.
- b.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: The question is now SAT.
84 H
3 X
B E
2017 NRC Exam NRC: Question does not match the K/A - K/A is asking about criteria/conditions that require making plant-wide announcements; while the question does not ask the applicant anything about plant announcements (other than stating the explanation that a mode change requires a plant-wide announcement). The generic K/A intent is not met with this question.
Response: Replaced question NRC: New question is SAT 85 F
2 B
S 2012 NRC Exam 86 F
2 B
S 2012 NRC Exam 87 H
2 N
E 2X2; Early Review Submittal; Reference provided NRC: Provide DOA 500-01 as a reference file and provide more details in the pedigree to support the plausibility of those distractors where a transition to it is made. Also, the
ES-401 Facility: Dresden
/Year: 2020 17 Form ES-401-9 Page 17 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only pedigree contains several typos that need to be addressed.
Response: For final submittal all procedures and lesson plans were included in the submittal. One typo was found, please identify if there are others. Question is # 87 on the exam.
NRC: Question is now SAT 88 H
2 B
S 2x2, 2016 Cert Exam; Reference provided 89 F
3 B
E 2013 Cert Exam NRC: Answer explanation should include discussion of mild post-accident EQ areas (UFSAR 3.11.1.4.2) and how 10CFR50.49 does not apply to those areas.
Response: Added section 3.11.1.4.2 of the UFSAR to the answer explanation.
NRC: Question is now SAT 90 H
3 N
E Reference provided NRC: Editorial: Bullets vs. ? in stem Response: The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: Question is now SAT 91 H
3 N
E 2X2 NRC: Editorial: Bullets vs. ? in stem Response The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: Question is now SAT 92 F
2 N
S 2x2 93 H
3 N
S 2x2 94 H
3 B
E 2X2; 2016 NRC Exam NRC: Clarify wording in the stem - the latest time and action required to be directed is confusing (Possibly - when must the required action directed below be taken by).
Response
Revised stem of question, as recommended.
NRC: Question is now SAT 95 H
3 B
S 2019 NRC Exam; 2010 NRC Exam; Reference provided
ES-401 Facility: Dresden
/Year: 2020 18 Form ES-401-9 Page 18 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 96 H
3 X
N U
S 2x2, Reference provided NRC: No correct answer exists - Answer/distractor C and D are the same. Part 2 of answer C should be limit fission product barrier as in distractor A.
Response: Made the recommended changes. NOTE: The wrong version of the question was submitted. The correct version is now in the exam. This would normally be caught during the Corporate REE review of the submittal and the review did not happen due to COVID-19 concerns.
NRC: Question is now SAT 97 H
2 N
E 2X2; Early Review Submittal NRC:
- 1) Fix the ? bullets in the stem.
- 2) The 2nd part of distractors C and D are incomplete. What needs to be done after the interlocks clear, etc.?
- 3) The pedigrees readability needs to be improved.
Response
- 1) The bullets print normal from Vision, when the test is saved as a Word document some of the formatting is changed. It has been verified that the final version will print as desired.
- 2) The SDC interlocks self-clear when the conditions warrant.
- 3) Unsure what part of the pedigree readability needs to be improved.
NRC:
a) Explain distractor explanations once versus repeating information several times b) Explain that SDC interlocks self-clear in the pedigree when the applicable distractor applies.
c) ? versus bullets must be addressed in the submittal so the proposed exam in ADAMS is what the students would see (i.e. ready to be administered)
Response
- a.
Revised the distractor explanations to avoid repeating information and Bolded NOT in stem of question for readability.
- b.
Added that the SDC interlocks self-clear in the applicable distractors.
- c.
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner and will be corrected in the next exam submittal.
NRC: Question is now SAT 98 H
2 X
N U 2x2
ES-401 Facility: Dresden
/Year: 2020 19 Form ES-401-9 Page 19 of 20 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/
S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S
NRC: Question is not SRO-only. The question asks equipment location and system knowledge (i.e. the purpose of resetting the generator lockout relay).
Response: New question was written.
NRC: The replacement question is SAT.
99 H
3 N
E 2x2. Provided reference NRC:
a) Editorial: Bullets vs. ? in stem b) Correct spacing formatting in answer A.
Response
The bullets are correct in the master copy of the exam. The issue is due to translation problems that occur when processing the exam to send to the Chief Examiner. This will be corrected in the next exam submittal.
NRC: Question is now SAT 100 H
3 N
E 2x2 NRC: Stating that An NSO reported is unnecessary and should be deleted from the conditions in the stem.
Response: Made the recommended changes.
NRC: Question is now SAT
ES-401 Facility: Dresden
/Year: 2020 20 Form ES-401-9 Page 20 of 20 RO TOTALS:
B= 48 F= 34 E= 43 Additional Notes: 3/75 = 4% UNSAT M= 0 H= 41 U= 3 N= 27 SRO TOTALS:
B= 10 F= 7 E= 11 Additional Notes: 4/25 = 16% UNSAT M= 0 H= 18 U= 4 N= 15
GENERAL COMMENT
S:
- 1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N