ML20328A291
| ML20328A291 | |
| Person / Time | |
|---|---|
| Site: | Ginna  |
| Issue date: | 09/17/2020 |
| From: | Joseph Demarshall Operations Branch I |
| To: | Exelon Generation Co |
| Shared Package | |
| ML19309E375 | List: |
| References | |
| CAC 000500 | |
| Download: ML20328A291 (21) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 3 B S 2014 Braidwood NRC Exam 2016 Byron NRC Exam Reference provided: Steam Tables NRC:
- Explanations for Distractors A and B incorrectly state entropy of 1165.
Explanations should state enthalpy of 1165.
2 H 3 B S
- Add the Steam Tables to the Propose references to be provided to applicants field on the Form ES-401-5.
GINNA:
- Changed entropy to enthalpy in plausibility statements A and B
- Added Steam Tables to the Propose references to be provided to applicants field E Reference provided: Primary Plant Computer System (PPCS) Display Sheets 3 H 3 N S NRC:
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 21
ES-401 2 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Steam Generator A Pressure curve and associated triangle marker are difficult to read on the Four-Variable Trend due to the color assignment.
GINNA:
- Colors are assigned by the PPCS Computer and cannot be changed by the Operator. Printer adjustments will be made to enhance the vibrancy of the yellow graph for the students.
NRC:
- Question, as written, does not meet the intent of the K/A. K/A states Ability to operate and monitor the following as they apply to a Large Break LOCA:
Control of RCS pressure and temperature to avoid violating PTS limits.
U Question does not test the operate/control aspect of the K/A to preclude PTS 4 H 3 X N limit violation.
S GINNA:
- Changed second part of question to the US will FR-P.1.
- Changed second part of answer choices to either exit or continue in.
- Revised all plausibility and answer explanation statements.
5 H 3 N S 6 F 2 M S NRC:
- Explanations for Distractors C and D require enhancement to sufficiently address why it is plausible that RCS pressure will stabilize above or below SI Pump Shutoff head. Explanations to include where RCS pressure would be expected to stabilize and why, for failure of PC 431K that results in Pressurizer Spray Valves opening.
E 7 H 3 M
- Clarify use of the word initially in the stem as it applies to the response of S the Pressurizer Spray valves. Would the Spray Valves be expected to reposition, assuming no operator action, if the output of PC 431K failed low?
GINNA:
- Revised plausibility statements C and D to address why it is plausible that RCS pressure will stabilize above or below SI Pump Shutoff head.
- Changed initially to will in the overhead question statement.
NRC:
- Distractor D does not appear to be plausible. Why would preventing a E potential secondary steam line break from occurring be the basis for what is a 8 F 2 X N highly prioritized ATWS Immediate Action step and strategy?
S GINNA:
- Replaced Distractor D and revised plausibility statement D.
Page 2 of 21
ES-401 3 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC:
- Proposed reference is unnecessary. RO applicants should know, given the specific conditions provided in the stem and overall knowledge of E-3 mitigation strategies, that actions are required to stabilize the plant at equilibrium conditions. Accordingly, the applicants should know that primary pressure needs to be raised (i.e., Heaters energized) to equalize RCS pressure and ruptured SG pressure in order to minimize leakage into the RCS.
E 9 H 3 B Recommend eliminating the proposed reference and enhancing the stem by S adding another plant condition that states:
o Charging and Normal Letdown have been established.
GINNA:
- Added bullet Charging and Normal Letdown have been established to plant conditions
- Changed PRZR level to 40%
- Deleted reference provided to students 10 H 2 B S NRC:
- Editorial issue. Stem is awkwardly written. The words Given the following E are only applied to the list of Initial Plant Conditions. The list of Current Plant 11 H 3 X N Conditions is not preceded by a qualifier. Revise the stem accordingly.
S GINNA:
- Added Given the following prior to Current plant conditions.
2019 Wolf Creek NRC Exam NRC:
- The Question requires the applicant to assess plant conditions and to know the content of ECA-0.0, Loss of All AC Power, in order to select a required course of action. Appears that the question can be answered solely by knowing the overall sequence of events or the overall mitigative strategy of ECA-0.0. Is this S* considered RO knowledge at GInna? Question SAT (S*) contingent upon 12 H 3 B S Licensee confirmation of RO knowledge.
GINNA:
- Ginnas Facility Representative has determined that this is RO knowledge based on the answer testing a CAUTION in ECA-0.0, which is tied to a RO knowledge-based learning objective. ROs are required to know procedural NOTEs and CAUTIONs and the basis for them. Added justification statement for RO knowledge.
13 H 3 N S Page 3 of 21
ES-401 4 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC:
- Suggest enhancing Question Statement #1 by asking what the expected condition is for the Channel 2 (Red) Bistable Status Lights, upon Loss of the B Instrument Bus, given that the P-10 Technical Reference only discusses the condition of the Red Bistable Status Lights for Loss of the A Instrument Bus.
E 14 H 3 N GINNA:
S
- Instrument Bus B supplies AC power to the Bistable Status Lights for Protection Channels 1 (Red) and 2 (White). Loss of Instrument Bus B will result in ALL Protection Channel 1 and 2 Bistable Status Lights being extinguished due to loss of power. Changed OFF to Extinguished in first part of answer choices C and D.
15 H 3 N S NRC:
- Question appears to be written at the SRO License Level. Question requires knowledge of diagnostic steps and decision points in Emergency Contingency Procedure ECA-1.2, LOCA Outside Containment, that involve transition to Emergency Contingency Procedure ECA-1.1, Loss of Emergency Coolant E
16 H 3 X B Recirculation.
S GINNA:
- RO knowledge since the first part is testing the overall mitigative strategy (Major Action Categories) of ECA-1.2 and the second part is testing Entry Conditions for the applicable Emergency Procedures. Both of these are RO knowledge. Added RO Justification Statement.
17 H 3 B S 2011 Ginna NRC Retake Exam NRC:
- The question statement reads, IF the SI signal is not RESET it will cause
_____. The wording of this statement may inadvertently provide clues to the correct answer. For example, the intention is to convey that the SI signal is what caused Distractors B and D, and that these conditions will remain unless the SI signal is reset. Restated, it is NOT the failure to RESET the SI that will E cause the actions identified in Distractors B and D to occur (i.e., the failure to 18 F 3 B RESET will not cause the SAFW Pump Discharge Valve to CLOSE or the S
Service Water isolation which eliminates the suction source for the SAFW Pumps).
- In addition, the combination of the question statement and correct Answer A contain a double negative, which can lead to confusion.
- Reword the question statement and the answer choices to address the issues identified above. This is considered an enhancement only and does not change the intent or objective of the question.
Page 4 of 21
ES-401 5 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only GINNA:
- Revised the question statement, overhead statement, and Distractor C.
2005 Kewaunee NRC Exam NRC:
- Stem is confusing with respect to the first bullet under the Subsequently section, and how it relates to the Part 1 question statement. First bullet in the second half of the stem states The misaligned Control Rod is aligned with its E associated Rod Bank, implying that the rod has already been aligned. The 19 F 3 X M S Part 1 question statement reads The misaligned Control Rod will be inserted , implying that the rod is yet to be aligned. Is the Part 1 question statement intended to read The misaligned Control Rod was inserted Clarification required.
GINNA:
- Changed will be to was in 1st part of question.
2019 Ginna NRC Exam (LAST 2 NRC EXAMS)
NRC:
- Question, as written, does not meet the intent of the K/A. K/A states Knowledge of the reasons for the following responses as they apply to the Pressurizer Level Control Malfunctions: False indication of PZR level when PORV or spray valve is open and RCS saturated. Question does not test M U the Pressurizer Level Control Malfunction aspect of the K/A as it pertains to 20 H 3 X B S false indication of Pressurizer level under the stated conditions. Question instead asks whether rising Pressurizer level is an accurate indication of RCS inventory given conditions indicative of bubble formation in the Reactor Vessel Head.
GINNA:
- Rejected K/A and Chief Examiner randomly selected APE028 AK2.03.
- Replaced Question with Question from 2019 Ginna ILT NRC Exam.
21 F 3 B S 22 F 3 B S NRC:
- Use of the word local in the question statement AND in Part 2 of correct Answer D, can cue the applicant to the correct answer.
U 23 H 3 X X M
- AP-CR.1, Control Room Inaccessibility, Step 11 RNO, provides direction to S ONLY transfer the Backup Heaters to local control at the MDAFW Pump Area if PRZR Pressure is lowering. In addition, AP-CR.1 Background Document, states PRZR Pressure Controller, PC-431K, is expected to be controlling RCS pressure in automatic. Accordingly, Part 2 of Distractors A and C, i.e., PRZR Page 5 of 21
ES-401 6 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Heaters and Spray Valves in Auto, is not necessarily incorrect. Conversely, Part 2 of Distractor B and correct Answer D, i.e., local operation of PRZR Backup Heaters, is not entirely correct. Prior to transferring Backup Heaters to local control (following MCR evacuation), all PRZR Heaters (Proportional and Backup) and Spray Valves will be controlling pressure in AUTO. After local control of the PRZR Backup Heaters has been established, pressure will be controlled using a combination of (1) Proportional Heaters and Spray Valves in AUTO, and (2) local operation of the Backup Heaters.
GINNA:
- Revised overhead question statement.
- Changed 2nd part of answer choices to either PRZR Backup Heaters ONLY or PRZR Proportional and Backup Heaters.
- Changed correct answer to C to meet question psychometric requirements.
- Revised plausibility and answer explanation statements.
24 F 2 B S 2012 Ginna NRC Retake Exam 25 H 3 B S NRC:
- Question requires the applicant to assess plant conditions and to know the content of ES-0.2, Natural Circulation Cooldown, and ES-0.3, Natural Circulation Cooldown with Steam Void in Vessel, in order to select a required course of action. Appears that the question can be answered solely by knowing the overall mitigative strategy of these procedures. Is this considered S*
26 H 4 N RO knowledge at GInna? Question SAT (S*) contingent upon Licensee S confirmation of RO knowledge.
GINNA:
- Ginnas Facility Representative has determined that the question requires knowledge of the overall mitigative strategy (Major Action Categories) and Entry Conditions for Emergency procedure which is RO knowledge. Added RO knowledge justification statement.
27 H 3 M S 28 H 3 B S 2008 Harris NRC Exam NRC:
- Question, as written, does not meet the intent of the K/A. K/A states Ability to E manually operate and/or monitor in the control room: Letdown isolation and 29 H 2 X M S flow control valves. Question does not test the flow control valve aspect of the K/A.
GINNA:
Page 6 of 21
ES-401 7 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Question meets the K/A since Ginna does not have a specific Letdown flow control valve. Letdown flow is controlled by the differential pressure across the Letdown Orifice Valves which is controlled by PCV-135, Low Pressure Letdown Pressure Control Valve. The question requires the Applicant to monitor and determine that the demand on PCV-135 controller is not correct for the given plant conditions, which is an indication that a leak exists in the Letdown line.
Added K/A Justification statement.
30 F 4 N S NRC:
- Distractor A is not credible and can be easily eliminated. Question statement asks for a specific setpoint.
- Eliminate the phrase is less than from each of the answer choices in order E to accommodate the specific interlock setpoint wording in the question 31 F 2 B statement.
S GINNA:
- Revised specific interlock setpoint to permissive interlock value.
- Replaced Distractor A and plausibility statement A.
- Revised answer choices.
2013 VC Summer NRC Exam NRC:
- The Part 2 answer explanations for Distractors A are B are incorrect. For E Distractor A, Part 2 of the answer is correct (i.e., MOV-841), however, the 32 H 2 B associated explanation states that the second part is plausible and incorrect.
S For Distractor B, Part 2 of the answer is incorrect (i.e., MOV-865), however, the associated explanation states that the second part is correct.
GINNA:
- Swapped plausibility statements A and B.
33 F 2 N S 34 H 3 N S 2014 Ginna NRC Exam NRC:
- Question appears SAT, as written, based on answer explanations. Was S* unable to confirm the same using the references provided; i.e., (a) ER-ELEC.2, 35 F 2 B S Recovery from Loss of A or B DC Train, Attachment 1, Pages 16-18, and (b)
P-10, Instrument Failure Reference Manual, Page 73. Clarification required.
Question SAT (S*) contingent upon clarification from the Licensee.
GINNA:
Page 7 of 21
ES-401 8 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Revised answer explanation statement.
- Added control schematics to Technical References.
2015 South Texas Project NRC Exam NRC:
- Distractor B does not appear to be credible. Why would a failed high auctioneered T signal cause rods to drive in? Is auctioneered T an input to E the Rod Control System at Ginna?
36 H 3 X B S GINNA:
- Changed Distractor B from auctioneered T to a single Loop TAVG.
- Changed auctioneered to Average in Distractor A to conform with Operations terminology at Ginna.
- Revised plausibility statement B.
37 H 3 B S 2009 McGuire NRC Retake Exam NRC:
- Distractor B does not appear to be credible. A Containment Spray Actuation could not occur without a Safety Injection and Steam Line Isolation Actuation per ER-INST.1, Reactor Protection Bistable Defeat after Instrumentation Loop Failure, Attachments 19-23. Suggest the following revision:
E A. ONLY SI Actuation will occur 38 H 3 X B B. ONLY SLI Actuation will occur S
C. SI, SLI, and CS Actuations will ALL occur D. NO Engineered Safety Feature Actuation will occur GINNA:
- Changed Distractors as suggested.
- Revised plausibility statements B and C.
NRC:
- Question requires the applicant to know that a minimum of 2 CRFC units and one CS train are required to maintain containment peak pressure below the design limit (60 psig) during a DBA; i.e., information contained in Tech Spec LCO 3.6.4 Bases. Is this information considered RO knowledge at GInna?
S*
39 H 4 N Question SAT (S*) contingent upon Licensee confirmation of RO knowledge.
S GINNA:
- Ginnas Facility Representative has determined that this is RO knowledge since the question is testing systems knowledge of CNMT design features and UFSAR accident analysis worst-case failure scenario knowledge. Added a justification statement.
40 H 3 N S Page 8 of 21
ES-401 9 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 41 F 2 B S 2015 Vogtle NRC Exam 42 F 3 B S 2013 Catawba NRC Exam NRC:
- Question, as written, does not appear to meet the intent of the K/A. K/A states Ability to manually operate and monitor in the control room: Recovery from automatic feedwater isolation (Main Feedwater (MFW) System). Question does not test the manually operate and monitor Recovery aspect of the K/A.
GINNA:
- Added K/A Justification Statement: K/A is matched since at Ginna an automatic feedwater isolation occurs at 85% S/G water level. The associated E Main Feedwater regulating and Bypass Valves CLOSE and will re-open once 43 F 2 X N S S/G water level lowers below 85%. The Feedwater Isolation signal removes the ability for the Operator to manually operate the associated Feedwater Regulating Valve(s). Additionally, NUREG-1122, Section 1.9.2 states that the Ability Stem Statement for Plant Systems A4 is Ability to manually operate and/or monitor in the control room; whereas for System 059, Main Feedwater (MFW) System A4 states Ability to manually operate and monitor in the control room.
- Changed 1st part of Distractors A and B to 80%.
- Revised plausibility statements A and B.
- Added A-503.1, page 42 to Technical References.
44 F 2 N S 45 F 3 B S 2016 Callaway NRC Exam 46 H 3 B S 2018 Turkey Point NRC Exam 47 H 3 B S 2017 Beaver Valley NRC Exam 48 F 3 N S 49 F 3 B S 2019 Ginna NRC Exam (LAST 2 NRC EXAMS) 2015 Fort Calhoun NRC Exam NRC:
- Using the Starting Air Compressor (SAC) as a distractor for an EDG E component cooled by the Jacket Water (JW) System (utilized in Distractors A 50 F 2 X B S and B) is borderline implausible. The SAC shares no physical connection with the EDG crankcase. Suggest using a component with greater plausibility such as the Crankcase Exhausters. While there is no cooling medium associated with these components (other than the surrounding air), they are plausible considering (1) they share a physical connection with the crankcase, (2) they Page 9 of 21
ES-401 10 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only are started by a JW pressure switch when pressure increases to approximately 11 PSI following engine start, and (3) the applicants may be unfamiliar with their construct.
GINNA:
- Changed bullet 1 to Crankcase Exhauster.
- Revised plausibility statements A and B.
2012 Ginna NRC Exam NRC:
- Suggest changing PCV-135 OPEN position from 32% to 35% in the stem to more accurately reflect the guidance in AP-CCW.1, Leakage into the Component Cooling Loop, Step 4.b, which states that PCV-135 demand E should be approximately 35% OPEN when the 40 gpm letdown orifice is in 51 H 3 B S service. This enhancement further supports the plausibility explanation that plant parameters provided in the initial conditions indicate the absence of a leak into the CCW System. Note that PCV-135 position was 40% OPEN in the question that appeared on the 2012 Ginna NRC Exam.
GINNA:
- Changed stem bullet for PCV-135 position to 35% OPEN.
NRC:
- Low credibility associated with Distractor B (R-15, Air Ejector), given that this rad monitor provides evidence of a SGTR and is criteria for transitioning to E-3, with no resultant isolation (an event routinely practiced in the simulator).
E Recommend replacing PRM R-15 with R-16, Containment Fan Cooling, to 52 F 2 X B raise the plausibility of Distractor B.
S GINNA:
- Changed Distractor B to R-16, CNMT Fan Cooling.
- Revised plausibility statement B.
- Changed Technical Reference AR-RMS-15 to AR-RMS-16.
53 F 3 M S 2015 Point Beach NRC Exam NRC:
B E
- Distractor D is not credible. Implausible that a solenoid valve, which is 54 F 2 X N S electrically operated, would be held in position by Instrument Air pressure.
GINNA:
- Replaced question.
55 H 2 B E 2017 Point Beach NRC Exam Page 10 of 21
ES-401 11 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S NRC:
- Change the subsequent N-32 instrument reading in the stem from 190 cps to 115 cps to keep the increase below a factor of 3.
- Change Part 1 Answers to NOT VALID for Choices A/B and VALID for Choices C/D.
GINNA:
- Changed the subsequent N-32 indication to 115 cps.
- Changed Part 1 Answers to NOT VALID for Choices A/B and VALID for Choices C/D.
56 F 2 M S 57 H 2 N S NRC:
- Question requires the recall of knowledge that appears to be too specific for a closed-reference exam. ROs are typically expected to know the LCO statements and associated applicability information (i.e., info above the double line separating the ACTIONS from the LCO and APPLICABILITY). Question requires the applicant to know from memory (1) the information contained in TS Table 3.3.3-1, Post Accident Monitoring, which contains 22 instruments, including the required number of channels for each, and (2) a sub-note at the 5 U bottom of the Table that states A channel consists of two core exit 58 F X N 2 S thermocouples (CETs). Question also requires the applicant to know from memory information contained in the F-0.2, Core Cooling CSFST, Background Document, in order to answer Part 2. Is this expected RO knowledge at GInna?
GINNA:
- Deleted first part of question and answer choices.
- Revised answer choices and plausibility statements.
- Added RO Justification statement.
2007 Diablo Canyon NRC Retake Exam NRC:
- Part 2 of the question appears to require applicants to have general knowledge of Severe Accident Management Guideline (SAMG) procedures. The S* applicable technical reference is SAG-7, Reduce Containment Hydrogen, 59 F 3 B Attachment A, Methods for Venting CNMT. Is this information considered RO S
knowledge at GInna? Question SAT (S*) contingent upon Licensee confirmation of RO knowledge.
- Pedigree Sheet (Form ES-401-5) indicates that the question was last used on the 2007 Diablo Canyon NRC Exam. Was unable to locate the question on the 2007 Exam. Is the information on the ES-401-5 accurate?
Page 11 of 21
ES-401 12 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only GINNA:
- Ginnas Facility Representative has determined that the question is testing RO knowledge even though the Technical Reference for the second part of the question is SAG-7, the second part of the question is testing system knowledge and control of unmonitored potentially contaminated release to the environment. The Mini-Purge System is a monitored release path whereas venting through the Equipment Air Lock would NOT be a monitored release path to the environment. Added RO Justification statement.
- Question was last used on 2007 Diablo Canyon NRC ILT Retake Exam, #58.
NRC:
- Questioning the overall Discrimination Validity of this question as written, including the plausibility of Distractors C and D. Stem provides information that the crew has entered E-0. Question statement asks which action the board operator is allowed to perform upon completion of E-0 Immediate Action steps, in accordance with A-503.1, Emergency and Abnormal Operating Procedures User Guide, Section 5.3.B, Performing Steps Out of Order. Section 5.3.B states that the Immediate Actions for the procedure being performed have to be complete and that concurrence of the SRO in control has to be obtained prior to performing a step out of order.
Does A-503.1 guidance apply to actions outside of the EOP procedure that is in effect? Would SROs at Ginna concur on the performance of actions that are contained in one or more EOPs prior to transitioning to said EOPs? For example, in Question 60, the procedural guidance to secure AFW flow to a single faulted S/G resides in E-2, Faulted Steam Generator Isolation. Would E a board operator be permitted to perform the AFW isolation step in E-2 prior to 60 H 3 X N S the SRO transitioning from E-0 to E-2? Further:
o Regarding Distractor D, would a board operator be permitted, within the confines of E-0, to perform the Step 2 RNO actions in ECA 2.1, Uncontrolled Depressurization of Both Steam Generators, to reduce AFW flow to each S/G to 50 gpm, when the transition to ECA 2.1 is only made from within E-2?
o Regarding Distractor C, would a board operator be permitted, within the confines of E-0, to perform the actions to secure AFW flow to both S/Gs, if one is ruptured and the other faulted? Note that the associated plausibility explanation states A-503.1 contains guidance for securing AFW flow to a ruptured S/G and to a single faulted S/G.
GINNA:
- The five pre-approved actions contained in A-503.1, Section 5.3.B.1.d can be performed following completion of Immediate Actions of E-0, even though the actions are contained in Emergency Operating Procedures that have not yet been implemented.
Page 12 of 21
ES-401 13 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Revised stem information to indicate both S/Gs faulted.
- Replaced original Distractor A to Reduce AFW flow to each S/G to 100 gpm due to implausibility with new stem information.
- Rearranged answer choices for psychometrics.
- Changed correct answer to C.
- Revised plausibility and answer explanation statements.
61 H 3 N S 62 F 3 N S 63 H 3 B S 2011 Ginna NRC Retake Exam 2019 Ginna NRC Exam (LAST 2 NRC EXAMS)
NRC:
- Delete the words to prevent automatic closure of RCV-018 from the condition specified in the fourth bullet of the stem, which states Circ Water Pump trip interlock for R-18, Liquid Waste Disposal, is bypassed to prevent automatic closure of RCV-018. There is a potential that inclusion of this information may cue the applicant to the correct answer. The applicant should not have to be told that bypass of the trip interlock for R-18 will prevent automatic closure of RVC-018. This additional information was not provided in the version of the question that appeared on the 2019 Ginna NRC Exam.
- Delete the words due to lower dilution flow from the end of the Part 1 question statement. There is a potential that inclusion of this information may cue the applicant to the correct answer. This additional information was not provided in the version of the question that appeared on the 2019 Ginna NRC E Exam.
64 H 3 X X B
- Stem is confusing with respect to the second bullet under the Subsequently S
section, and how it relates to the Part 1 question statement. Does the beginning of the Part 1 question statement (i.e., If the Recirc Gate is opened) refer to the Recirc Gate being cycled to mitigate Frazil Ice effects, as stated in the second bullet, or is it referring to a second opening of the Recic Gate? Clarification required.
- Question determined not to be Significantly Modified from 2019 Ginna NRC Exam Question #64. No significant changes were made to the stem conditions and Part 1 of the question remained unchanged. Accordingly, the question (1) has been coded as Bank on the ES-401-9, requiring the same change to be reflected on the associated Form ES-401-5, and (2) counts as a LAST 2 NRC EXAM QUESTION.
GINNA:
- Deleted to prevent automatic closure of RCV-018 from the 4th stem bullet.
- Deleted due to lower dilution flow form the first question statement.
- Added being prior to cycled in second subsequent stem bullet.
Page 13 of 21
ES-401 14 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Revised first question statement to When the Recirc Gate is opened, the R-18 alarm setpoint will be conservative.
- Changed Question Source to Bank on ES-401-5.
65 H 4 B S 66 F 2 B S 2016 Browns Ferry NRC Exam 67 F 2 N S 68 F 2 B S 2012 Ginna NRC Retake Exam 69 F 2 B S 2010 Byron NRC Exam 70 F 2 N S 71 F 3 B S 72 H 2 B S 2019 Ginna NRC Exam (LAST 2 NRC EXAMS)
NRC:
- In order to satisfy Tier 3 criteria for maintaining focus on generic plant-wide topics, revise the stem to generically address the indications associated with Victoreen Model Monitors (R-1 through R-9). For example:
Given the following indications for Victoreen Model Radiation Monitors in E the plant (R-1 through R-9):
73 H 3 B o RANGE alarm is LIT S
o Display reads 0.00 o Monitor Bar Graph display is extinguished Which of the following describes the cause for these indications and the condition required to reset the RANGE alarm?
GINNA:
- Question stem information changed as suggested.
NRC:
- Borderline LOD=1 as written based on Part 2 of the question. Recommend keeping Part 1 as is and revising Part 2 to test the material in A-503.1, Emergency and Abnormal Operating Procedures Users Guide, Section E
74 F 2 B 5.2.G.5, with respect to whether a repeat CAUTION may be paraphrased.
S GINNA:
- Changed second part of question to An applicable CAUTION encountered a second time in the same procedure may be paraphrased
- Revised plausibility and answer explanation statements.
Page 14 of 21
ES-401 15 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC:
- Recommend inserting the word FIRST in the question statement to preclude the possibility of more than one correct answer; i.e., Which ONE of the E
75 F 2 N following emergency communications systems will the Shift Communicator use S FIRST to notify the State and County agencies?
GINNA:
- Added FIRST prior to to notify in the question statement.
NRC:
- Appears that the question can be answered using RO integrated plant and system knowledge, i.e., knowledge not unique to the SRO position. ROs would know that the reactor is to be immediately tripped upon receipt of the RCP A/B CCW RTURN HI TEMP OR LOW FLOW alarm, concurrent with a sustained loss of seal injection flow. A possible alternative would be to approach the K/A from the CCW perspective; i.e., loss of CCW flow to a single RCP (receipt of Alarm A7/A8), requiring entry into AP-CCW.2, Loss of CCW During Power Operation, with subsequent evaluation of the 2-minute time requirement and/or rising RCP motor temperatures, leading to a trip of the E
76 H 2 X N reactor and associated RCP (reference the Caution above Step 1 and the S actions contained in Step 4 of AP-CCW.2).
GINNA:
- The first part of the question tests specific knowledge of AP-CVCS.3, Step 17 which would not be required of a RO Applicant. The second part of the question is RO since a RO Applicant would be expected to use integrated plant knowledge to answer this part of the question. Therefore, this is an SRO question. Added SRO Justification statement.
- The proposed change for the second part of the question would also be considered RO knowledge at Ginna since RO Applicants are required to know all NOTEs and CAUTIONs and the basis for them.
NRC:
- Enhance Part 1 answers for Distractors A and C to read Initiate S/B blowdown E from both S/Gs, to reflect the actual verbiage used in AP-CCW.3, Step 7 RNO.
77 H 3 N S GINNA:
- Revised first part of Distractors A and C to Initiate S/G blowdown from both S/Gs.
78 H 3 N S E 2014 Vogtle NRC Exam 79 H 3 B S NRC:
Page 15 of 21
ES-401 16 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Rephrase the question statement for Part 1 to read _____ perform AP-SW.2, Loss of Service Water, in parallel with ES-1.1. A-503.1, Emergency and Abnormal Operating Procedures Users Guide, Section 5.2.M.4 states Referenced procedures should be performed in parallel with the primary procedure. ES-1.1, Step 3.a RNO, for less than two Service Water Pumps running, states Refer to AP-SW.2, LOSS OF SERVICE WATER.
- Explanation for correct answer B incorrectly references A-503.1, Section 5.2.6.
Should be Section 5.2.A.6.
- Separately, Pedigree Sheet (Form ES-401-5) indicates that the question was last used on the 2014 Vogtle NRC Exam. Was unable to locate the question on the 2014 Exam. Is the information on the ES-401-5 accurate?
GINNA:
- Changed first part of question to read perform AP-SW.2, Loss of Service Water, in parallel with ES-1.1.
- Corrected answer explanation statement.
- Listed on 2014 Vogtle 2014-301 SRO Exam as 028AG2.4.8.
- Revised last stem bullet to read PRZR level is 9% and rising slowly based on validation feedback. CE concurrence obtained.
80 H 3 N S 81 H 3 B S 2012 Ginna NRC Exam NRC:
- Part 1 question statement reads ATWS Mitigation capability FUNCTIONALITY. Revise question statement to read ATWS mitigation protection Operability to reflect the actual wording in TRB 3.4.3, A.1 Basis paragraph. In addition, change Part 1 answer choices from E
82 H 2 N FUNCTIONAL/NOT FUNCTIONAL to OPERABLE/NOT OPERABLE.
S GINNA:
- Changed capability FUNCTIONALITY to protection OPERABILITY in first part of question statement.
- Changed FUNCTIONAL to OPERABLE and NOT FUNCTIONAL to INOPERABLE in first part of answer choices.
83 H 3 M S NRC:
- Question can be answered using RO integrated plant and system knowledge, U i.e., knowledge not unique to the SRO position. ROs would know that de-84 H 3 X N energization of Bus 11A would result in the loss of power to A RCP, A MFW S
Pump, and A & C Condensate Pumps (note that A Condensate Pump had already tripped), requiring the unit to be manually tripped beforehand. ROs are required to know that (1) loss of an RCP requires immediate action to trip the Page 16 of 21
ES-401 17 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only reactor in accordance with AP-RCS.2, Loss of Reactor Coolant Flow, and (2) loss of a MFW Pump greater than 75% power requires immediate action to trip the reactor in accordance with AP-FW.1, Abnormal MFW Pump Flow or NPSH.
GINNA:
- Replaced question.
85 H 3 B S NRC:
B U GINNA:
86 H 3 X M S
- Replaced question with a modified version of Question 86 that appeared on the 2010 St. Lucie NRC ILT Exam. Accordingly, changed Question source to Modified Bank.
NRC:
- Distractor C is not credible. Why would an applicant believe that 15-minute State and County notifications would not be required for declaration of a General Emergency (GE)?
- Because Item #3 is included in each of the distractors, the examinee need only determine that this option is incorrect in order to eliminate all three distractors and arrive at the correct answer. This approach/practice should be avoided.
- Question, as written, focuses on notifications associated with the declaration of an Emergency Class under 10CFR50.72, Immediate Notification E
87 F 2 X N Requirements for operating nuclear power reactors. Note that 4-hour and 8-S hour reporting requirements as they pertain to ECCS under (b)(2) and (b)(3) of 10CFR50.72 may be areas for additional consideration relative to the K/A when addressing the credibility of Distractor C.
GINNA:
- Question replaced to Which ONE of the following correctly states a condition and the required notification that must be made by the Shift Manager?
- Revised correct answer to The NRC must be notified within eight (8) hours of a valid Safety Injection (SI) actuation.
- Revised answer explanation statement.
NRC:
U
- Question, as written, has two correct answers; Choices A and B.
88 H 3 B GINNA:
S
- Revised question statement to Which ONE of the following procedures would be used to directly restore the above PRT conditions to normal?
Page 17 of 21
ES-401 18 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Changed question format from 2x2 to four separate procedure answer choices.
89 H 3 N S 90 F 2 N S 2018 Ginna NRC Exam (LAST 2 NRC EXAMS)
NRC:
- Explanation for Distractor B requires enhancement. Discussion is silent regarding the alignment of MRPI Rod C7 (Rods C7 & K7 are both at 188 steps)
E and fails to provide a logically consistent explanation of plausibility that 91 H 3 B S correlates to the distractor.
GINNA:
- Revised Distractor B to Realign rods C7 and K7 in accordance with ER-RCC.2, Restoring a Misaligned RCC.
- Revised plausibility statement B.
NRC:
- Appears that Parts 1 and 2 of the question can be answered using RO integrated plant and system knowledge, i.e., knowledge not unique to the SRO position. Recommend revising the question to test applicant knowledge of S-23.2.2, Containment Purge Procedure, P&L 4.10 / 4.11 regarding changes in the configuration of Containment Purge Exhaust Fans. Guidance /
requirements associated with these P&Ls would be considered SRO level knowledge.
E GINNA:
92 F 2 X B S
- Revised the first part of Distractors A and B to ONE Purge Exhaust Fan in operation, NO Purge Supply Fans in operation.
- Revised plausibility statements A and B.
- The first part of the question is testing specific CNMT Purge alignment required during Reactor Head lift and can NOT be answered solely on system knowledge as it additionally requires knowledge of refueling limitations which is SRO knowledge. Additionally, the second part of the question is testing UFSAR basis for the required system alignment. Therefore, the question meets the requirements for an SRO question. Added SRO Justification statement.
93 H 3 N S 94 F 3 B S 2013 Farley NRC Exam 95 F 3 B S 2016 Diablo Canyon NRC Exam 96 H 3 B S 2012 Ginna NRC Exam Page 18 of 21
ES-401 19 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2015 Browns Ferry NRC Exam NRC:
- Part 2 of Distractors A and B, i.e., perform corrective maintenance, makes little sense within the context of Question 97. How can an Inoperable component that has been placed in the tripped condition to comply with TSs, be returned to service to perform corrective maintenance? What does this E actually mean? Question is identified as a Bank question from the 2015 97 F 3 X B Browns Ferry NRC Exam. The perform corrective maintenance, distractor is S a change to the original Bank question. Recommend using the question as it appears on the 2015 Browns Ferry Exam. A capable SRO applicant should be knowledgeable of requirements set forth in LCOs 3.0.4 and 3.0.5.
GINNA:
- Revised second part of question and answer choices to reflect the 2015 Browns Ferry ILT Final Exam Question #97.
- Revised plausibility statements A and B.
2017 Point Beach NRC Exam NRC:
- Explanations for Distractors A and B incorrectly state two of the three radiological readings Only two radiological readings have been provided in the stem.
98 F 3 M S GINNA:
- Changed two of the three to one of the two in plausibility statements A and B.
- Changed first stem bullet to An Operator has been directed by the US to enter the Auxiliary Building to isolate a safety-related system during implementation of AP-RCS.1, Reactor Coolant Leak based on validation feedback. CE concurrence obtained.
99 F 2 B S 2019 Wolf Creek NRC Exam 2014 Robinson NRC Exam NRC:
- Borderline LOD=1 for SRO applicants. In Part 1, 15 minutes is not a B E reasonable time for completing Site Accountability and can be easily 100 F 2 M S eliminated. In Part 2, recommend staying with the Accountability topic and testing the following concept to raise the overall discrimination validity: The Emergency Director May/May NOT conduct Accountability at the Alert level prior to TSC activation. (
Reference:
EP-AA-113, Personnel Protective Actions, Paragraph 4.1.1.1 on Page 3)
Page 19 of 21
ES-401 20 Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
- Separately, Pedigree Sheet (Form ES-401-5) indicates that the question was last used on the 2014 Robinson NRC Exam. Was unable to locate the question on the 2014 Exam. Is the information on the ES-401-5 accurate?
GINNA:
- Changed first part of Distractors A and B to 60 minutes.
- Changed second part of question to The Shift Emergency Director May/May NOT conduct Accountability at the ALERT level prior to TSC activation.
- Revised plausibility and answer explanation statements.
- Deleted EP-AA-111 from Technical references.
- Changed Question Source to Modified Bank.
- Verified that the Bank question is on the 2014 Robinson SRO Final NRC Exam Question #100.
Page 20 of 21
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: GINNA NUCLEAR POWER PLANT Exam Date: October 5 - 29, 2020 B= 41 F= 34 E= 25 RO TOTALS: M= 8 H= 41 U= 4 Additional Notes: _5.3%_ of RO questions assessed as unsatisfactory.
N= 26 B= 11 F= 9 E= 9 SRO TOTALS: M= 4 H= 16 U= 3 Additional Notes: __12%_ of SRO questions assessed as unsatisfactory.
N= 10
GENERAL COMMENT
S:
- 3. Average difficulty is __2.68_ on the RO exam and 2.72 on the SRO exam. Overall difficulty for the 100 question exam is 2.69 .
Page 21 of 21