ML22175A193
| ML22175A193 | |
| Person / Time | |
|---|---|
| Site: | Salem  |
| Issue date: | 02/11/2022 |
| From: | Joseph Demarshall Operations Branch I |
| To: | Public Service Enterprise Group |
| Shared Package | |
| ML21020A061 | List: |
| References | |
| EPID L-2022-OLL-0002 | |
| Download: ML22175A193 (29) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation
2018 BEAVER VALLEY UNIT 1 NRC EXAM NRC:
- Suggest enhancing the question by (a) revising the 4th bullet in the Given section of the stem to state that Operators have just closed Reactor Trip Bypass Breakers (BYBs) A and B, provided this is actually done in the RTB testing procedure, and (b) requiring the applicants to evaluate the response of BYB B instead of RTB B. As written, a minimally competent applicant would be able to easily eliminate options A and D, given the failure of SSPS Trian B 1 H 2 B E S to actuate and RTB B as the Part 1 answer option. Plausibility associated with RTB B opening on a failure of SSPS Train B to actuate is questionable.
NOTE: Suggested changes would make the question Modified instead of Bank.
- Remove the words in the Question Statement that read assuming no operator action The statement is unnecessary and can lead to confusion on questions where the same or similar statements have not been provided.
NUREG-1021, Appendix E, Paragraph B.7, states:
When answering a question, do not make assumptions regarding conditions that are not specified in the question unless they occur as a
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 29 ES-401 2 Form ES-401-9
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
consequence of other conditions that are stated in the question. For example, you should not assume that any alarm has activated unless the question so states or the alarm is expected to activate as a result of the conditions that are stated in the question. Similarly, you should assume that no operator actions have been taken, unless the stem of the question or one of the answer choices specifically state otherwise.
SALEM:
- First bullet not changed since this would be inaccurate and cause a Rx Trip.
- Second bullet statement was removed from stem.
2014 SALEM NRC EXAM 2019 BYRON (OCTOBER) NRC EXAM NRC:
- The question, as written, does not meet the intent of the K/A. K/A statement reads Knowledge of the interrelations between the Pressurizer Vapor Space Accident and the following: Sensors and detectors. Specifically, the interrelations with the Sensors and Detectors aspect of the K/A has not been addressed. Focus of the question is on the response of PZR level to a failed 2 H 3 X B U open Safety Valve. The K/A statement associated with the referenced 2014 S Salem Bank Source Question (AA1.06) reads Ability to operate and/or monitor the following as they apply to the Pressurizer Vapor Space Accident:
Control of PZR level.
- Separately, K/A Justification Statement and Plausibility explanations for Distractors B and C, all specify PZR PORV instead of PZR Safety Valve.
SALEM:
- Question was replaced with bank question from Byron 2019 (Oct exam) to test understanding of throttling process on leaking safety valve.
3 H 2 B S 2019 DIABLO CANYON NRC EXAM 2019 BYRON (JANUARY) NRC EXAM NRC:
- Distractor C is not credible. Why would an applicant reasonably believe on a Large Break LOCA that the crew would be dumping steam to inject the ECCS Accumulators with the RCS essentially depressurized (i.e., 110 psig)? Would 2-EOP-LOCA-5, Loss of Emergency Coolant Recirculation, be a possible 4 F 2 X B E S source for a plausible distractor? [Would it be possible to use the as written question from the 2019 Byron Exam? The major difference between this and the Byron question is that the ECCS Pumps have not been stopped due to signs of cavitation.]
- Enhance the Plausibility Explanation for Distractor A, To prevent a SG tube rupture, to include a discussion similar to that provided in the referenced Bank Q for this same distractor, regarding the differential temperature between the primary and secondary sides of the SG tubes increasing the potential for a tube Page 2 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
rupture.
SALEM:
- Distractor C was replaced using the distractor from 2019 Byron exam.
- Used explanation for distractor A from Byron 2019 Jan exam.
2018 DC COOK NRC EXAM NRC:
- Question overlaps with SRO Q86. Suggest revising Q86 to address this issue (reference CE comments for this question).
- Provide the noun name for 21CV104 and revise Answer A to read establishes static conditions for the #2 seal to perform its design function.
- Noun name for S2.OP-AB.RCP-0001 in the third bullet of the stem is incorrect.
Should be Reactor Coolant Pump Abnormality instead of RCP Malfunction.
- Stem statement, as written, is not asking a question; therefore, the Question Mark should be removed.
5 F 3 B E S
- Plausibility explanation for Distractor D states Closing the CV104 will not raise the temperature sensed by the Shutdown Safety Seals to inadvertently actuate. Should read something similar to the following: Closing the CV104 will not preclude inadvertent actuation of the Shutdown Safety Seal on high temperature.
- The K/A statement on the Pedigree Sheet is missing the following parenthetical reference: (Loss of RC Flow).
SALEM:
- CE randomly re-selected K/A APE 15 AK2.0 8 to address overlap concern.
Question replaced with a Bank question from the 2018 DC Cook NRC Exam.
NRC:
- Suggest raising the overall discrimination validity of this question by changing Part 1 to test applicant knowledge of the 23 Charging Pump (PDP) Low Speed 6 H 2 N E S Stop to maintain minimum charging flow at 47 gpm.
SALEM:
- Question revised to incorporate NRC comment.
NRC:
- Suggest enhancing the LOD for Part 2 of this question by revising the Part 2 options to read as follows:
7 F 2 N E S prevent exceeding the design pressure of the RHR system suction piping ONLY AND
prevent exceeding the design pressure of the RHR system suction and Page 3 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
discharge piping.
SALEM:
- Items changed as suggested NRC:
- Editorial - delete the wording is required at the end of the question 8 H 3 N E statement. Wording is unnecessary and makes the statement read awkwardly.
S SALEM:
- is required deleted.
NRC:
- Part 1 of Distractors A and B are not credible. Why would any applicant believe that PZR Backup Heaters would be FULLY ENERGIZED, regardless of the failure, given a stem condition stating that BOTH PZR Backup Heaters are in MANUAL and OFF?
- Overlap concern with Question 37. Both questions involve a failure of 9 H 2 X N U the Controlling PZR Pressure Channel, albeit in different directions..
S Suggest replacing Question 9 given the plausibility issues associated with Distractors A and B.
SALEM:
- CE randomly re-selected K/A APE 27 AK3.03 to address overlap concern.
New question written to address overlap concern.
10 F 3 B S SALEM:
11 H 3 N S
- Per CE direction, added information in explanation to describe why steam dumps are closed following a LOOP.
12 H 3 N S NRC:
- Editorial: Part 1 Question Statement incorrectly reads when compared to an Steam Line Break. Should be when compared to a Steam Line Break.
13 H 3 N E S SALEM:
- Item corrected
- Based on 4th validation feedback, enhanced Part 2 question stem to delete the effect from to avoid confusion understanding the question. This was approved the Chief Examiner.
14 H 2 X B U NRC Early Review Question
Page 4 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
S 2016 SALEM NRC EXAM NRC:
- Question UNSAT; does not meet the intent of the K/A AK1.04 as written.
The question (1) is a straight-forward exercise in how to use the Steam Tables, (2) can be answered without the first two bulleted items in the stem, and (3) can be answered without any knowledge of the following:
(a) how the concept of saturated conditions and associated operational implications apply to a Loss of Offsite P ower, (b) Emergency Operating Procedure 2-EOP-TRIP-4, Natural Circulation.
SALEM:
- Based on NRC comment, it is difficult to write a discriminating question on this K/A. CE randomly re-selected K/A AA2.03, Ability to determine and interpret the following as they apply to the Loss of Offsite Power: Operational status of safety injection pump.
15 H 2 N S NRC:
- Enhance Distractors C and D by inserting the words piping associated with, 16 H 3 B E similar to that of Choices A and B.
S SALEM:
- Item corrected as suggested Reference provided:
Detached Reference (Separate Handout); A-5-500- EEE-1686 (R11), Artificial Island Operating Guide, Page 297 only 2019 BYRON (OCTOBER) NRC EXAM NRC:
- Unable to validate the Minimum MVARS value; associated reference, A 500-EEE-1686 (R11), was not provided with the submittal.
U
- Part 2 of Distractors B and C do not appear to be credible and can easily be 17 H 3 N B S eliminated, given the initial value of 300 MVARS for Unit 2. For Distractor B,
why would lowering the Voltage Regulator setpoint to raise MVARS (300 to 350) be plausible? Similarly, for Distractor C, what would raising the Voltage Regulator setpoint to lower MVARS (300 to 265) be plausible? Is there another aspect or concept associated with the Generator Capability Curves that can be tested in Part 2?
- Suggest moving the second bullet to below the Unit Status Table to avoid any potential misinterpretation regarding initial status of the Units.
SALEM:
Page 5 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- CE randomly re-selected K/A APE 77 G2.1.27. Question replaced with a Bank question from the 2019 Bryon (October) Exam).
- Based on feedback from 4th validation, enhanced Part 1 answer choices for A and B to add the word b y. This change was approved by the Chief.
18 F 3 N S NRC:
- Borderline LOD=1. Suggest the following changes to raise the overall Discrimination Validity of the question:
Revise Part 2 to test applicant knowledge of whether the Dropped Rod can 19 H 2 N E S be recovered without restrictions as described in S2.OP.AB.ROD -0002, Dropped Rod (i.e., No withdraw rate, power level, or ramp rate restrictions if recovery is within 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> of the initial indication).
SALEM:
- Revised Part 2 stem and answers to test applicant knowledge on the 4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> criteria for dropped rod limitations.
NRC Early Review Question NRC:
- Correct Answer C explanation and plausibility explanations for Distractors A. B, and D on the Pedigree Sheet are deficient in that they provide no insight as to (a) why the Part 1 Lift Coil Disconnect Switch positions are correct/plausible, and (b) why the Part 2 Rod Bank Selector Switch positions are correct/plausible. The explanations are silent with respect to these items, appearing to focus primarily on clearing/resetting OHA E-24.
Enhancements required for all explanations.
- Stem provides information that there are 30 Steps between the Group 1 20 H 2 N E Control Rod in Bank D that is stuck (190 Steps) and the Group Demand S Counter Reading ( 160 Steps). Suggest changing the Step value information such that Rod Deviation from the Group Demand Step Counter is between 12 and 18 Steps, to raise the Discrimination Validity of the question.
SALEM:
- Agreed. The question was still in development at the time the question was sent to the NRC as an Early Review Question. T he explanation section was not updated to the revised question. Action taken was to revise the explanation section to provide the correct explanations.
- Changed stem to state that the control bank D is at 175 steps. This puts the misaligned rod > 12 steps when above 85% power.
21 H 3 B S 2015 SALEM NRC EXAM NRC:
22 H 3 N E S
- Suggest changing Distractor A to 1, 3, and 5 ONLY for balance purposes.
- E*anation fistrt C does s Item 5, FHB LOW Page 6 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
PRESSURE Alarm is LIT, is plausible. Enhancement required.
SALEM:
- Changed as suggested.
- Additional explanation provided for Distractor C.
- Based on NRC Ops Branch Chief review, added dropped fuel assembly to second bullet in stem to enhance question.
NRC:
- Confirm that the conditions provided in the stem are representative of an Accidental Gaseous Radwaste Release in order to meet the intent of the K/A, which reads Knowledge of the interrelations between the Accidental Gaseous Radwaste Release and the following: Auxiliary Building Ventilation System.
Unable to determine whether the conditions specified are indicative of an Accidental Release, given that the information contained in the first two bullets infers that releases are being procedurally controlled in accordance with Salem OP-SO procedures. Determination as to whether the question is an acceptable K/A Match is contingent upon Licensee confirmation that an Accidental Release is in progress. ( NOTE: if the stem conditions are representative of an Accidental Release, then enhance the K/A Match justification as to why.)
- Separately, there is Overlap concern with Question 54. In both questions, a Containment Pressure Relief is in service/progress and an actuation signal occurs requiring the applicant to assess/evaluate the response of Containment Isolation Valves *VC5 and *VC6. Resolve this item.
- Review of the Op Test identified a SECOND overlap issue involving Sim JPM h and Q23, which similarly requires the applicant to assess /
23 F 2 B E S evaluate the response of Containment Isolation Valves *VC5 and *VC6 upon receipt of High Radiation Alarm conditions where 2R41D is the affected Rad Monitor.
- Review of the Op Test identified yet a THIRD overlap issue involving Q54 and Sim JPM h, which similarly requires the applicant to assess /
evaluate the response of Containment Isolation Valves *VC5 and *VC6 following actuation of a Containment Vent Isolation signal.
CE (12/20/2021): 2 of the following 3 test items will require significant revision /
replacement due to the nature of the overlap issues: Q23, Q54, and Sim JPM h.
SALEM:
- Additional explanation provided in the K/A M atch justification statement to explain how this questions meets the assigned K/A. Explanation determined to be satisfactory by the CE.
- Question 54 was changed to address the overlap.
- Sim co addrs ovl.
Page 7 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- Sim h and Question 54 were changed to address the overlap.
NRC Early Review Question NRC:
E
- For Distractor C, explain why it is plausible to open only one PZR PORV 24 H 3 N S under the stated conditions.
SALEM:
- Plausibility explanation was added to distractor C.
NRC Early Review Question 2019 BYRON (JANUARY) NRC EXAM NRC:
- Stem information stating that 21AF21 and 21AF11 are closed, is not required and should therefore be removed. This information is already provided in the first bullet which states Unit 2 completed all actions in 2-EOP-LOSC-1, Faulted Steam Generator Isolation, to isolate a steam leak E on 21 steam generator. A minimally competent applicant should be able to 25 H 2 X B make this determination without having to actually be told that the S aforementioned AFW valves are closed. The additional information has the potential to inadvertently cue / lead the applicant.
- The explanation for correct Answer D references Emergency Operating Procedure 2-EOP-TRIP-1. This appears to be incorrect. Suspect that 2-EOP-TRIP-7 should actually be referenced. Clarification required.
SALEM:
- 21AF21 and 21AF11 was removed from the stem.
- Agreed TRIP-1 was corrected to TRIP-7.
2018 DC COOK NRC EXAM NRC:
- Appears that Distractor D may be considered a second correct answer.
26 F 3 B E S Replace / Modify Distractor D.
SALEM:
- Agree; Modified Distractor D.
27 H 3 B S 2011 SALEM NRC EXAM NRC:
- Revise the Question Statement to read Which ONE of the following is a design 28 F 3 B E S feature of the Rea ctor Coolant Pump #2 seal?
- Replace the comma separating the first and second parts of each answer with a semicolon.
- Risehe second parts both DistractBrtnswCo r Page 8 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
serves only as an emergency backup upon a total loss of the #1 seal.
- Revise Distractor A to read Film riding seal with a design leak -off of 3 gph to the RCP standpipe; allows the RCP to operate indefinitely without restrictions upon a loss of the #1 seal.
- Revise Distractor D to read F ace rubbing seal with a design leak-off of 100 cc/hr to the RCP standpipe; allows the RCP to operate indefinitely without restrictions upon a loss of the #1 seal.
- NOTE: Plausibility explanation for Distractor B incorrectly states that the Second part is incorrect. The Second part is actually correct.
SALEM:
- Suggested changes made to the question. Corrected Distractor B plausibility explanation.
29 H 2 N S 2006 SALEM NRC EXAM NRC:
- Last sentence of the Plausibility Explanation for Distractor D is inaccurate.
30 H 2 B E S 2CV18 responds to Letdown Line Pressure, not Temperature.
SALEM:
- Correction made as suggested.
31 H 3 N S 2016 DIABLO CANYON (OCTOBER) NRC EXAM NRC:
Question technically correct but the Answer and Plausibility Explanations contain inaccuracies. Last sentence of Correct Answer D Explanation states The 2CV18 will respond by lowering letdown line pressure Should be The 2CV18 will respond to the lowering letdown line pressure In addition, the last sentence of the Plausibility Explanations for Distractors A and C both state Letdown pressure lowering will require the operator to lower the 32 H 3 B E S demand and throttle the 2CV18 close more. This s tatement is inaccurate. The stem specifically states that 2CV18 is in AUTOMATIC. The operator will not be performing an action that is being done automatically.
Suggest copying the Correct Answer and Plausibility Explanations from the Diablo Canyon NRC Exam Question identified as the Question Source, given that they are technically accurate.
SALEM:
- Used explanation from Diablo Canyon
- Changed Part 2 answers from raise to rise in choices A & C.
33 H 3 N E NRC Early Review Question
Page 9 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
S NRC:
- Suggest changing RCS pressure to some lower value that is closer to the shutoff head for the RHR Pumps, to raise the Discrimination Validity of the question.
SALEM:
- RCS pressure in the stem was lowered to 300 psig. This was deemed plausible since RHR is placed in service below 340 psig. The shutoff head of RHR pumps is around 170 psig.
NRC Early Review Question NRC:
E
- Part 1 explanations for Distractors B and D should also note that this option 34 H 3 N S is incorrect because the PRT does not have a Relief Valve.
SALEM:
- Agreed. Added to distractor B and D that the PRT does not have a relief valve.
2017 WOLF CREEK NRC EXAM NRC:
- All of the answer choices contain the words trip the Reactor, and should thus be included in the stem (Reference NUREG-1021, Appendix B, C.2.d, Second Example).
- Level of Knowledge (LOK) is classified as Low Cognitive Level (LCL) (i.e.,
35 F Fundamental) on the Pedigree Sheet. Appears that the question should be H 2 B E S classified as High Cognitive Level (HCL) based on the guidance in NUREG-1021, Appendix A, regarding the number and types of mental steps necessary to identify the correct answer. Explain the Low Cog assignment.
SALEM:
- Stem revised as suggested.
- Changed LOK to HCL.
NRC:
- Replace Item #3, Letdown Heat Exchanger, with another source of RCS Inleakage (if available), due to overlap concerns associated with CCW Question 35.
36 H
- Level of Knowledge (LOK) is classified as High Cognitive Level (HCL) on the F 2 B E S Pedigree Sheet. Appears that the question should be classified as Low Cognitive Level (LCL) based on the guidance in NUREG-1021, Appendix A, regarding the number and types of mental steps necessary to identify the correct answer. Explain the High Cog assignment.
SALEM:
Page 10 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- Changed LOK to LCL
- Added the word potential to the stem based on NRC Ops Branch Chief review comment.
NRC:
- Overlap concern with Question 9. Both questions involve a failure of the Controlling PZR Pressure Channel, albeit in different directions. Suggest replacing Question 9 given the plausibility issues associated with Distractors A and B.
- Remove the last bullet in the stem that states ALL PZR Pressure channels are LOWERING RAPIDLY. The applicants should be able to predict / determine 37 H 2 N E the change in RCS pressure without this information. The K/A statement S reads:
Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated with operating the PZR PCS controls including: RCS pressure.
SALEM:
- Question 9 was replaced to address overlap concern.
- Removed last bullet in stem.
38 F 3 N S NRC:
2018 BEAVER VALLEY UNIT 1 NRC EXAM
- Plausibility Explanations for Distractors B and D are identical. Explanation for Distractor B does not address why Phase B actuation is also plausible.
Enhancement required.
39 H 3 B E S
- Plausibility Explanation for Distractor C is confusing. Why would Distractor C be plausible if an applicant were to incorrectly determine that the CS logic was de-energize to actuate? Enhancement required.
SALEM:
- Plausibility explanations for Distractors B, C, and D u pdated.
40 H 3 B S 2008 DC COOK NRC EXAM 41 F 3 M S QUESTION SOURCE - 2014 SALEM NRC EXAM (Q46) 42 H 2 B S QUESTION SOURCE - 2017 BYRON NRC EXAM (Q62)
E NRC:
43 H 2 B M S
- Plausibility Explanation for Distractor D does not address Part 2 answer, i.e.,
why SG Pressure would rise if Steam Dumps Open.
- Review of the Bank Question from the 2017 Byron Exam shows that the changes made make the Salem Question Modified in accordance with Page 11 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
NUREG-1021, ES-401, which states:
Changing the conditions in the stem such that one of the three distractors in the original question becomes the correct answer would also be considered a significant modification. The intent or objective of the question does not necessarily have to be changed.
Update the Pedigree Sheet to indicate Modified and provide the Source Question.
SALEM:
- Enhanced plausibility explanation for Distractor D.
- Changed question source to Modified.
2017 SALEM NRC EXAM NRC:
- Question 44 Overlaps with Simulator JPM e, Perform Immediate Actions for a Loss of a SGFP. Accordingly, either Q44 or the JPM will need to be replaced. Resolve this issue.
- Appears, based on review of the referenced Bank Question from the 2017 Salem NRC Exam (RO17), that Q44 on the 2022 Exam is completely different in that it is testing an entirely different concept. The K/A associated with 44 H Question RO17 on the 2017 Exam is Generic G2.4.45, Ability to prioritize and F 3 B E S interpret the significance of each annunciator or alarm. Explain why the question is classified as Bank in the Question Source Field of the Pedigree Sheet.
SALEM:
- e. Question replaced with a Salem Bank question. LOK changed from HCL to LCL
- Revised answer A to delete ALL and replace with the word the.
2016 COMANCHE PEAK NRC EXAM NRC:
- Enhance the Plausibility Statement for Distractor B to explain why it would be plausible for the demand on the BF19s to increase if the SG NR Levels are above program setpoint.
- Enhance the Plausibility Statement for Distractor C to explain why it would be 45 H 2 B E S plausible for the demand on the BF19s to decrease if the SG NR Levels are below program setpoint.
SALEM:
- Enhanced plausibility statement to D istractor B.
- Enhanced plausibility statement to D istractor C.
Page 12 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
46 H 2 X B S NRC:
- All of the answer choices contain the words The diesel generator output breaker opens. Suggest the following:
Revising Distractor C to read The diesel generator output breaker remains closed; non-safeguard loads are automatically stripped.
47 F 2 B E S Revising Distractor D to read The diesel generator output breaker remains closed; non-safeguard loads must be manually stripped.
SALEM:
- Distractors C and D revised as suggested. Associated plausibility explanations appropriately revised.
2011 SALEM NRC EXAM NRC:
- Remove the last bullet in the Question Statement that reads No operator actions have been taken The statement is unnecessary and can lead to confusion on questions where the same or similar statements have not been provided. NUREG-1021, Appendix E, Paragraph B.7, states:
When answering a question, do not make assumptions regarding 48 H 3 B E conditions that are not specified in the question unless they occur as a S consequence of other conditions that are stated in the question. For example, you should not assume that any alarm has activated unless the question so states or the alarm is expected to activate as a result of the conditions that are stated in the question. Similarly, you should assume that no operator actions have been taken, unless the stem of the question or one of the answer choices specifically state otherwise.
SALEM:
- Changed made as suggested NRC:
- K/A states Ability to locate and operate components, including local controls. As written, the operate components aspect of the K/A has not been addressed. Suggest revising the question to test applicant knowledge of the sequencing manipulations associated with operating the 2A 125 VDC 49 F 2 X N U Battery Charger 230V AC Input and DC Output Breakers when removing S and/or placing the 2A1/2A2 Battery Chargers in service.
SALEM:
- Revised Part 2 of stem and Part 2 of the answers to test applicant knowledge on battery charger sequencing operations.
Page 13 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
NRC:
- Remove the sign in the Question Statement. Per NUREG-1021, Appendix B, C.2.m(4), this is a Specific Determiner that is to be avoided. The Specific Determiner associated with C.2.m(4) states an option that includes another option (e.g., (a) less than 5; (b) less 3). An argument can be made for the selection of 250 KW that this answer is not incorrect on the basis that 500 KW is 250 KW.
50 F 2 X N U
- Part 2 of Distractors A and D (i.e., overcurrent) is not credible, given that KW S loading is minimal after the EDG is first paralleled (50 KW in this question).
Why would an applicant reasonably believe that EDG load needs to be raised immediately upon breaker closure in order to prevent an overcurrent trip condition?
SALEM:
- Item removed from stem.
- Revised Part 2 D istractors to replace overcurrent.
NRC:
- For Distractor D, why is it plausible that actuating Unit 2 CAV in AP Mode would be done from Unit 1?
- The last sentence of the Explanation for Correct Answer B states Actuating CAV in AP Mode from both units is not correct and not procedurally directed.
51 H 3 X N E None of the Part 2 answer choices include actuation of CAV in the AP mode S from both units. Clarification / Enhancement required.
SALEM:
- Revised Distractor D plausibility explanation.
- Corrected explanation for correct Answer B.
2018 SOUTH TEXAS PROJECT NRC EXAM 2015 SALEM N RC EXAM NRC:
- K/A states Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated with operating the SWS controls including: Reactor and turbine building closed cooling water 52 F 2 X B U temperatures. The operat ion of the SWS controls aspect of the K/A has not S been addressed. Suggest revising the question to test applicant knowledge of the SWS actions that need to be taken on low temperature conditions (i.e.,
TAC HX outlet 70°F or S W 50°F) and the response of TAC Heat Exchanger Bypass Temperature Control Valves to regulate temperature.
SALEM:
- CE randomly re-selected K/A K1.16. Question replaced with a question from 2015 Salem NRC Exam.
Page 14 of 29 ES-401 15 Form ES-401-9
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
53 F 2 B S 2016 DIABLO CANYON (OCTOBER) NRC EXAM 2003 SALEM NRC EXAM (RETAKE)
QUESTION SOURCE - 2017 BYRON NRC EXAM (Q30)
NRC:
- Overlap concern with Question 23. In both questions, a Containment Pressure Relief is in service/progress and an actuation signal occurs requiring the applicant to assess/evaluate the response of Containment Isolation Valves *VC5 and *VC6. Resolve this item.
- Review of the Op Test identified a SECOND overlap issue involving Sim JPM h and Q23, which similarly requires the applicant to assess /
evaluate the response of Containment Isolation Valves *VC5 and *VC6 upon receipt of High Radiation Alarm conditions where 2R41D is the 54 H 2 B E affected Rad Monitor.
M S
- Review of the Op Test identified yet a THIRD overlap issue involving Q54 and Sim JPM h, which similarly requires the applicant to assess /
evaluate the response of Containment Isolation Valves *VC5 and *VC6 following actuation of a Containment Vent Isolation signal.
CE (12/20/2021): 2 of the following 3 test items will require significant revision /
replacement due to the nature of the overlap issues: Q23, Q54, and Sim JPM h.
SALEM:
- Replaced question to eliminate the identified overlap issues. Replacement is a Modified version of a Bank Question from the 2017 Byron NRC Exam.
QUESTION SOURCE - SALEM BANK NRC:
- Level of Knowledge (LOK) is classified as High Cognitive Level (HCL) on the Pedigree Sheet. Appears that the question should be classified as Low 55 H Cognitive Level (LCL) based on the guidance in NUREG -1021, Appendix A, F 3 M E S regarding the number and types of mental steps necessary to identify the correct answer. Explain the High Cog assignment.
SALEM:
- LOK changed to LCL 56 H 2 B S 2018 BEAVER VALLEY UNIT 1 NRC EXAM NRC:
- Plausibility Explanation for Distractor B is confusing. Distractor Explanation 57 H 3 B E S states Plausible because the operator may incorrectly believe that when below P-10 permissive, that both IR channels need to exceed the high flux setpoint to cause a Rx trip. Why is there mention of being below the P-10 permissive in the Distractor B Explanation for 2/2 IR channels? The 25% power IR High Page 15 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
Neutron Flux Trip value associated with Distractor B is the same trip value upon which Distractor A is based. Clarification required. The same plausibility logic, with respect to power level, should apply to both Distractors A and B, the only difference being 1/2 versus 2/2 IR detectors exceeding the High Flux Trip.
- Remove the last bullet in the Question Statement that reads No corrective actions have been taken The statement is unnecessary and can lead to confusion on questions where the same or similar statements have not been provided. NUREG-1021, Appendix E, Paragraph B.7, states:
When answering a question, do not make assumptions regarding conditions that are not specified in the question unless they occur as a consequence of other conditions that are stated in the question. For example, you should not assume that any alarm has activated unless the question so states or the alarm is expected to activate as a result of the conditions that are stated in the question. Similarly, you should assume that no operator actions have been taken, unless the stem of the question or one of the answer choices specifically state otherwise.
SALEM:
- Distractor B appropriately revised.
- Removed the last bullet in the Question Statement.
NRC:
- Distractor D does not appear to be plausible. Why would an applicant believe that the Ovation DFCS would respond to the failure of a single Steam Pressure channel on only one SG, by switching the MS10s for all four SGs to MANUAL, and in doing so, remove the capability to automatically control/mitigate an overpressure condition on the other three SGs?
- Remove the words if any from the Question Statement.
- First sentence of the Plausibility Explanation for Distractor D reads One 58 H 2 X B E steam pressure channel failure will not cause the associated MS-10 to open.
S What does this statement have to do with the plausibility of Distractor D which states ALL MS10s will switch to MANUAL Clarification required.
- 10CFR Reference to 45.5 on the Pedigree Sheet is incorrect; should be 45.6.
SALEM:
- Enhanced Distractor D plausibility explanation.
- Removed the words if any from the Question Statement.
- First sentence of the Plausibility Explanation for Distractor D removed.
- 10 CFR reference corrected.
59 F 2 B S 2010 SALEM NRC EXAM QUESTION SOURCE - 2019 SALEM NRC EXAM (Q32) 60 H 2 M E S Reference provided:
Embedded Reference; 22 HYDROGEN COMBINER CONTROL POWER OUT KW Page 16 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
Meter Note: Embedded pictures, sketches, drawings, and graphs, with exception, are considered to be references.
Detached Reference (Separate Handout); S2.OP-SO.CAN-0001, Hydrogen Recombiner Operation
NRC:
- The Embedded Reference (i.e., 22 HYDROGEN COMBINER CONTROL POWER OUT KW Meter ) needs to be included, along with S2.OP-SO.CN-001, in the Proposed References to be Provided Field of the Pedigree Sheet.
SALEM:
- Embedded Reference added to P rovided References section.
2016 SALEM NRC EXAM NRC:
- LOD=1. Part 1 of the Question can be easily answered with the knowledge that OPEN valves/dampers CLOSE on system isolation, and that GREEN 61 F 1 U lights indicate CLOSED position status and RED lights indicate OPEN position 2 N B S status for these components.
SALEM:
- CE randomly re-selected System #033 (Spent Fuel Pool Cooling) and K/A K1.05. Question replaced with a question from the 2016 Salem NRC Exam.
62 F 2 B S NRC:
- K/A states Ability to predict and/or monitor changes in parameters (to prevent exceeding design limits) associated with operating the SDS controls including: T-ave., verification above low/low setpoint. The Question does not meet the intent of the K/A because it does not require the applicant to predict and/or monitor T-ave in response to operation of the SDS controls. Suggest revising the Question to test applicant knowledge of P-12 U and how T-ave is affected during RCS cooldown by operation of the SDS 63 F 2 X B controls upon receipt of P-12.
N S
- Separately, the K/A Match Justification contains parenthetical information that states (2/4 Tav e channels > 543°F). The Greater Than sign should be a Less Than sign; i.e., 543°F.
SALEM:
- Modified question to test applicant ability to predict/monitor Tave with respect to the Low-Low Tavg P -12 interlock and operation of the steam dumps.
- Corrected the parenthetical information in the K/A Match Justification.
Page 17 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
64 F 3 N S 2011 SALEM NRC EXAM NRC:
- Upon review of S2.OP-AB.CN-0001, Main Feedwater/Condensate System Abnormality, unclear as to how Attachment 2 actions ( i.e., load reduction to 85% at 5% per minute) are implemented and prioritized following a Condensate Pump trip at 100% power. Correct Answer D Explanation Statement does not sufficiently explain why the action to open the CN108s is prioritized over the load reduction. In addition, Distractors A and C mention 65 H 3 B E S the load reduction, but fail to address why it is not the NEX T action.
Enhancements required for these explanations on the Pedigree Sheet.
SALEM:
- Replaced with a Bank question used on the 2011 Salem NRC Exam.
Replacement is associated with the Loss of a second Condensate Pump at 75% power, where the correct answer and distractor explanations more clearly address the implementation and prioritization of actions based on plant conditions.
NRC Early Review Question NRC:
- LOD=1. A minimally competent applicant who has trained for months in the simulator and completed the requirements for in-plant time, knows that plant announcements are made prior to starting and securing major pieces of equipment (e.g., Circ Water Pump). Suggest raising the LOD of t his question U by changing the Correct Answer option to test the Public Address 66 F 1 2 N S Announcement requirements associated with OP-AA-104-101, Communication, Step 4.1.3.6.a, which states Prior to activities that could change plant radiation levels.
SALEM:
- Changed correct answer option to Performing radiography in the Turbine Building to raise the LOD. Radiography is not a typical or routine evolution performed during power operation.
2017 BEAVER VALLEY UNIT 2 NRC EXAM)
NRC:
- Borderline LOD=1 based on the current stem options. Suggest using the E Parent Question from the 2019 BV2 NRC Exam (#67) to raise the overall 67 F 2 M B S Discrimination Validity. Change the Question Source from MODIFIED to BANK on the Pedigree Sheet. NOTE: no impact in terms of challenging the BANK limit of 75% (i.e., 56 Questions) for the RO Exam.
SALEM:
Page 18 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- Changed question to a Bank equivalent version of the question used on the 2017 Beaver Valley Unit 2 NRC Exam.
NRC:
- LOD=1. Suggest testing applicant knowledge of the conditions under which the Attendant is procedurally directed to ORDER the authorized Entrants to evacuate the Permit-Required Confined Space (PRCS) immediately. The list 68 F 1 of conditions is provided on Page 41 of SA-AA-114, Confined Space 2 B U S Program, (R18).
SALEM:
- Changed Part 2 Distractors B & D to use Site Safety Professional and raise the LOD.
2017 ANO UNIT 1 NRC EXAM NRC:
- UNSAT; does not meet the intent of a Tier 3 Question. Per ES-401, Paragraph D.2.a (last sentence), questions selected for Tier 3 are to maintain their focus on the plant-wide generic K/As, and are not to become an extension of Tier 2 Plant systems. As written, system-specific knowledge of the Unit 2 RWST semi-auto swap-over feature is required to answer this question correctly, 69 F 3 X B U S making it an extension of Tier 2.
SALEM:
- CE randomly re-selected Generic K/A G2.2.6 to test applicant knowledge of On the Spot changes to procedures.
- Per CE direction, modified choice A from Deleting to Altering. Changed Distractor B statement to test if increasing manag emnt oversight/approvals is a change in intent.
NRC:
- Distractor C, Clearing Agent, is not plausible. Suggest enhancing the answer choices as follows to address the plausibility of Distractor C and raise the overall Discrimination Validity of this Question A. Shift Manager B. Control Room Supervisor 70 F 2 X N E C. Senior Director of Operations S D. Nuclear Shift Operations Manager
- Revise the Question Statement to read In an emergency, which position has the authority to authorize the repositioning of a component with a Red Blocking Tag attached?
SALEM:
- Suggested changes incorporated.
71 H 2 B E 2019 BYRON (OCTOBER) NRC EXAM Page 19 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
M S NRC:
- Review of the Bank Question from the 2019 (October) Byron Exam shows that the changes made make the Salem Question Modified in accordance with NUREG-1021, ES-401, which states:
Changing the conditions in the stem such that one of the three distractors in the original question becomes the correct answer would also be considered a significant modification. The intent or objective of the question does not necessarily have to be changed.
Update the Pedigree Sheet to indicate Modified and provide the Source Question.
- Editorial - delete the word Correct at the end of the plausibility explanation for Distractor B.
SALEM:
- Question source changed from Bank to Modified.
- Editorial item corrected.
NRC:
- Eliminate the first bullet in the stem which states Unit 2 has indications of failed fuel. This information is not required to correctly answer the question 72 F 2 X N E and may cue the applicant who is unsure of the posting requirement, that the S dose rate provided is for a Locked High Radiation Area.
SALEM:
- Item removed as suggested 73 F 3 B S 2016 DIABLO CANYON (October) NRC EXAM 74 F 3 B S NRC:
- Distractor B, FAX Transmission, is not a credible option as the Preferred or Primary Communication method.
75 F 2 X N E S SALEM:
- Replaced FAX with ESSX-1 phone. This is the secondary means of communications
NRC:
- K/A Mismatch. The Question, although applicable to a SBLOCA, fails to 76 H 2 X X B U specifically address any aspect of the Pressurizer Vapor Space Accident (TMI N S Event). Suggest testing SRO applicant knowledge of EOP Bases information associated with Reactor Vessel U pper Head Voiding, including (a) evaluation of SI Termination criteria, and/or (b) level determination based on Subcooling Margin.
Page 20 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
- Separately, Part 2 of Distractor A is not credible and the associated plausibility explanation, which states Plausible because this is a bases for other EOP steps, is deficient.
SALEM:
- CE randomly re -selected EPE 29 (ATWS) and retained K/A G2.4.18). New question developed to test this EPE/APE and K/A combination.
NRC:
- A Maximum Cooldown Rate of 50°F/hr is used in Part 2 of Distractors A and B. Associated Plausibility Explanations state Plausible because the 50°F/hr cooldown rate is used in other EOPs. Enhance these explanations by identifying where the 50°F/hr is used in other EOPs and how/ why its use in 77 H 3 X N E these other EOPS make it relatable i n terms of plausibility for Distractors A S and B? Questioning the plausibility of a 50°F/hr Maximum Cooldown Rate for this Question given the conditions provided in the stem.
SALEM:
- Enhanced Distractors A & B for 50 F/hr as requested..
NRC Early Review Question NRC:
- Appears that a case can be made for two correct answers ; Choices A and B.
Part 2 of Distractor B is improperly worded and can be easily misinterpreted due to poor readability. Specifically, the diction, as it relates to the use of provided and must in Distractor B, lacks clarity and conveys an element of ambiguity. It is therefore reasonable to assume that Distractor B may also be considered correct given that (a) BOTH Gamma-Metrics channels remain Operable following the loss of 115V Vital Bus power, and (b) the TS Bases for 3.9.2.2 states Any combination of NIS source range neutron flux monitors and/or Gamma-Metrics post-accident neutron flux monitors may be used to U satisfy the LCO. Two of the four total source range neutron flux monitors are 78 F H 3 X N S required to be OPERABLE.
- Part 2 of Correct Answer A is a Specific Determiner that provides a clue to the correct answer. Specifically, Part 2 of Answer A is a correct answer that is longer than the distractors (see NUREG-1021, R11, Appendix B, Section C.m(6)). Suggest revising Part 2 of A to read because any combination of Operable Source Range and Gamma-Metrics can be used. ( NOTE: Part 2 of A does not need to include the fact that two of the four detectors are required to b e Operable.
- Correct Answer A and Distractor plausibility explanations are deficient in that they do not sufficiently address how the loss of 2A 115V Vital Instrument Bus impacts the Operability of the Source Range Neutron Flux Monitors.
- Level of Knowledge (LOK) is classified as Low Cognitive Level (LCL) (i.e.,
Fundamental) on the Pedigree Sheet. Appears that the question should be classified as High Cognitive Level (HCL) based on the guidance in NUREG-Page 21 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
1021, Appendix A, regarding the number and types of mental steps necessary to identify the correct answer. Explain the Low Cog assignment.
SALEM:
- The stem was changed to only have one of the two Gamma-Metric channels operable. This was done to support distractor choice B Part 2 that two Gamma-Metrics must be operable in order to re-commence core alterations.
Note that during validations none of the validators considered that choice B Part 2 was possible because you dont need two Gamma-Metrics operable based on the stem.
- Correct answer A Part 2 was shortened to balance the answer choices.
- Explanation for correct answer A was revised to state that the loss of 2A 115 VAC will render the 2N31 inoperable leaving only one SR NIS operable.
- LOK was changed to Comprehension/Analysis.
- 2-8-22 based on 4th validation, added IAW Tech Specs to the stem to avoid possible two answers based on different requirements in the RE procedure.
Chief Examiner Supplemental Comment for Early Review Question (11/19/2021):
Question ultimately revised as follows: (a) 2-Part Format eliminated, (b) Stem conditions changed to state that Both channels of Gamma-Metrics are out of service for testing, and (c) Distractors C and D replaced. Chief Examiner determined the Question to be Satisfactory based on incorporation of these changes.
2016 BEAVER VALLEY UNIT 1 NRC EXAM NRC:
- Distractor B is not credible. S2.OP-AB.CN-0001, Main Feedwater/Condensate System Abnormality, the title of which is provided, is for a trip or abnormally operating Main Feed, Condensate, of Heater Drain Pump. Note that associated Bank Question #89 from the 2016 BV1 NRC Exam does not provide the Main Feedwater/Condensate System Abnormal 79 H 2 X B E S Operating procedure as a Distractor.
- Editorial - delete the words if any from the Question Statement. This qualifier is unnecessary and can lead to confusion.
SALEM:
- Changed the question to a Bank equivalent version that more closely resembles the actual question used on the 2016 Beaver Valley Unit 1 NRC Exam.
NRC:
- Enhance the Plausibility Explanation for Distractor D by including the same 80 H 3 B E S information contained in the explanation for Correct Answer B regarding the 2-EOP-FRCE, Step C3-1 Caution.
Page 22 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
SALEM:
- Changed as suggested 2016 COMANCHE PEAK NRC EXAM NRC:
- Distractor C is not credible. Why would it be okay to transition back to 2-EOP-TRIP-2, Reactor Trip Response, if operator actions to establish a heat sink in accordance with 2-EOP-FRHS-1, Loss of Secondary Heat Sink, are NOT 81 H 2 X B E complete?Note: Distractor B is borderline credible going the other way.
S SALEM:
- Enhanced the stem (no changes to the answer choices) to raise the Discrimination Validity of the question. Also enhanced the correct answer and plausibility explanations to address the stem changes and Distractor credibility concerns identified by the Chi ef Examiner.
Reference provided:
82 H 2 B S Detached Reference (Separate Handout); Salem U2 Tech Spec LCO 3.3.1.1, Reactor Trip System Instrumentation, Pages 3/4 3-1 through 3/4 3-7 2017 ANO 1 NRC RETAKE EXAM Reference provided:
Detached Reference (Separate Handout); EP-SA-325-123, Fission Product Barrier Table NRC:
- Change 2R44A and 2R44B readings to 2020 and 2010 R/hr respectively. No impact to the question.
- Year information not provided for the ANO 1 NRC Exam referenced in the Question Source Field of the Pedigree Sheet.
- Op Test overlap issue - SRO Admin JPM A5 will require revision/replacement to address overlap issues with Q83. Specifically, the GE in Q83 is based on 83 H 2 B E readings obtained from Containment High Range Radiation Monitors 2R44A S and 2R44B (> 2000 R/hr) and a declaration that is based, in part, on Fission Product Barrier (FPB) Table EALS FB2.1 and potentially RB1.L. The GE in SRO Admin A5 is based on a reading obtained from Containment High Range Radiation Monitor 2R44A (> 2000 R/hr) and a declaration that is based, in part, on FPB Table EALS FB2.1 and RB1.L. (Same comment made on the ES-301-7 for SRO Admin JPM A5).
SALEM:
- Changed Radiation Monitor readings as suggested
- Updated the Pedigree Sheet with the Year information for the ANO 1 NRC Exam.
Page 23 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
2015 BEAVER VALLEY UNIT 2 NRC EXAM NRC:
- Distractors A and B are not credible and can therefore be easily eliminated (effectively reducing the question to 1 out of 2 answer choices) based on stem information stating that Train A RVLIS is out-of-service for Maintenance and that Train B RVLIS Monitor on 2CC2 is displaying DATALINK FAILURE.
The Plausibility Statements for Distractors A and B both state Plausible because the SRO may believe that Train B RVLIS is still available. Why would an applicant believe that Train B RVLIS Monitor is available if the instrument is displaying DATALINK FAILURE? Comparatively, loss of the 84 H 2 X B U second RVLIS Train (Train B) in SRO Q85 of the 2015 BV2 Exam requires the S applicant to assess/evaluate the impact to RVLIS resulting from the loss of PSMS Data Processing Unit B indication.
- Year information provided for the Beaver Valley Unit 2 NRC Exam referenced in the Question Source Field of the Pedigree Sheet is incorrect; should be 2015 instead of 2016.
SALEM:
- Stem condition for Train B RVLIS condition changed to use failure of 2PT-405, RCS WR Pressure Transmitter, to make question more discriminating
- Corrected year information on the Pedigree Sheet for the Beaver Valley Unit 2 NRC Exam.
85 H 3 N S NRC:
> 6 GPM, requiring the Reactor to be immediately tripped and 21 RCP to be stopped in accordance with S2.OP-AB.RCP- 0001, Reactor Coolant Pump Abnormality, Attachment 2, Stopping Reactor Coolant Pumps. Suggest revising this question to test SRO applicant knowledge of a different RCP 86 H 2 N S condition listed on the Selected CAS Items Page of S2.OP-AB.RCP-0001, that also requires immediate Reactor Trip and stopping of the RCP in accordance with Attachment 2 of the procedure.
SALEM:
- RO Q5 was changed to address overlap. Q86 retained.
Reference provided:
Detached References (Separate Handout) ; SGS ECG RAL Section 11.3, System Actuation, Page 1 of 2; 87 H 2 N E S SGS EAL/RAL Technical Basis RAL-11.3.3, Pages 2-4 NRC:
- Question should be replaced due to overlap issues regarding the number of EAL Classifications (THREE) on this exam. Specifically, two questions Page 24 of 29 ES-401 25 Form ES-401-9
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
on the Written Exam (Q83 & Q87) and SRO Admin JPM A5 require the SRO applicants to classify events. Q83 and SRO Admin A5 are both GENERAL EMERGENCY (GE) Classifications, while Q87 is an ALERT. Suggest replacing this question (Q87) with one that tests SRO applicant knowledge of NRC reporting requirements (4 and/or 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />) associated with actuation of the Reactor Protection System when the Reactor is critical per 10CFR50.72(b).
- Separately, question is Borderline LOD=1 as written. Part 2 of the answer choices is EO/RO knowledge and Part 1 requires the use of an EAL reference (S6 -RPS Failure) that is relatively straight-forward.
- As an additional NOTE regarding Op Test overlap, SRO Admin JPM A5 will require revision/replacement to address overlap issues with Q83. Specifically, the GE in Q83 is based on readings obtained from Containment High Range Radiation Monitors 2R44A and 2R44B (> 2000 R/hr) and a declaration that is based, in part, on Fission Product Barrier (FPB) Table EALS FB2.1 and potentially RB1.L. The GE in SRO Admin A5 is based on a reading obtained from Containment High Range Radiation Monitor 2R44A (> 2000 R/hr) and a declaration that is based, in part, on FPB Table EALS FB2.1 and RB1.L.
(Same comment made on the ES-301-7 for SRO Admin JPM A5).
SALEM:
- Question changed to test applicant knowledge on reportability of events to NRC.
2019 (JANUARY) BYRON NRC EXAM NRC:
- Question, as written, does not meet the intent of the K/A. K/A states Ability to (a) predict the impacts of the following malfunctions or operations on the CCS; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those malfunctions or operations: Major leak in CCS The question, taken from the 2019 (January)
Byron NRC Exam (SRO85), is a Containment Flooding question. The K/A for the 2019 Byron Exam states EA2: Ability to determine and interpret the following as they apply to the (Containment Flooding): EA2.2: Adherence to 88 H 3 X X B U appropriate procedures and operations within the limitations in the facilitys N S license and amendments. The stem contains no information associated with the Containment Cooling System (CCS) that would make it possible for the SRO applicant to predict the impacts of a Major Leak in CCS and then select/use procedures to mitigate the consequences of this malfunction.
- Part 2 of Distractor A does not appear to be credible. Why would the SI Accumulators be isolated on a Large Break LOCA under conditions requiring them to perform their design function?
- Noun name for 2-EOP-FRCE-2 appears to be different from the associated Bases document provided with the list of references. Bases document is titled Response to High Containment Sump Level. Is this correct?
SALEM:
- CE randomlye -sectystem Itrument Air) and Gic/A Page 25 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
G2.2.44. New question developed to test this combination.
Question 88 was determined to have two correct answers, A and B, based on review of the post -examination comments. Final written examination with answer key revised to reflect the answer change. Reference Salem Exam Report 05000272 /2022301 ; 05000311/20 22301 (ML22117A124), for information regarding NRC disposition of the post -exam comments submitted by the Licensee for this question.
NRC Early Review Question QUESTION SOURCE - 2018 DC COOK NRC EXAM (Q89)
Reference provided:
Detached References (Separate Handout) ; Tech Spec 3.8.1.1, A.C. Electrical Power Sources, Pages 3/4 8-1 through 3/4 8-2a Procedure S2.OP-SO.DG-0005 NRC:
- Why is S2.OP-SO.DG-0005(Q) being provided as a reference? The SRO applicants are being given TS LCO 3.8.1.1 and are required to know TS LCO 3.0.3 from memory. Providing S2.OP-SO.DG-0005(Q) gives clues (i.e., Case E #2) to the correct answer and is leading.
89 H 3 X N M S SALEM:
- S2.OP-SO.DG-0005 was initially removed as a Reference based on Chief Examiner comment on the Free Look version of the question. Subsequently re-added the procedure to the R eferences Provided section based on feedback from the SRO validators after the second validation. The validators believed that this question was High LOD and suggested the procedure be added. 4 out 6 SROs missed this question during validations. Ultimately, S2.OP-SO.DG-0005 was removed from the list of References at the direction of the Chief Examiner.
- Question continued to yield poor validation results without the availability of S2.OP-SO.DG-0005 as a Reference. Q uestion replaced with another question that tests applicant knowledge of EDG TS when a common mode failure exists.
90 H 3 B S 2016 SALEM NRC EXAM NRC Early Review Question Reference provided:
91 H 1 U Detached Reference (Separate Handout) Tech Spec 3.4.10.3, Reactor Coolant 3 X N S System, Overpressure Protection Systems, Pages 3/4 4-31 and 3/4 4-32 and Bases NRC:
- L based onhe prenc to be ovided as noted on the Page 26 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
Pedigree Sheet. Distractors B and C can be easily eliminated if TS 3.4.10.3 Bases is given to the applicants.
SALEM:
- Agreed, removed the TS 3.4.10.3 basis as a provided reference. Only the TS LCO for 3.4.10.3 will be provided. The stem was changed to state which ONE of the following statements is correct regarding MODE 4 entry? and reworded answer choice and distractors to better support plausibility to actions in TS.
NRC:
- TS 3.1.3.1.Action referenced in the Plausibility Statement for Distractor D is 92 H 3 B E incorrect. Should be Action c.3.d, not Action 3.c.d S
SALEM:
- TS Action reference corrected.
2008 SALEM NRC EXAM NRC:
- Editorial - Change the word is in each of the Part 1 answer choices to are 93 F 2 B E S so that the Part 1 Answer Statement is grammatically correct.
SALEM:
- Item corrected as suggested.
NRC:
- Plausibility of Distractor D, Lifting the reactor vessel head, as a Core Alteration is low. Suggest replacing Distractor D with Removing CRDMs, to 94 F 2 X X B E raise the Discrimination Validity of this SRO question.
S SALEM:
- Replaced with Disconnecting CRDMs 2018 PALO VERDE NRC EXAM NRC:
- Revise Part 1 of Distractors A and B to read the same as the referenced Bank Question from the 2018 Palo Verde Exam. Specifically, revise Part 1 of 95 F 2 X B E S both Distractors to state EITHER an active or inactive SRO license holder.
Plausibility associated with an individual who holds an SRO certification is low.
SALEM:
- Part 1 of Distractors A and B changed as suggested.
96 F 2 N E NRC:
Page 27 of 29
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
S
- Second sentence of Correct Answer Explanation A appears to be incomplete and reads awkwardly. Clarification/Enhancement required.
SALEM:
- Answer A explanation corrected.
NRC:
- Part 1 of Distractors C and D does not appear to be plausible. Why would an applicant believe that the Shift Manager would place a direct call to the PJM on a Generator AVR swap from Auto to Manual? Plausibility Explanations for Distractors C and D both state Plausible because the SRO does make notifications to PJM. When and under what circumstances has, or would, a 97 F 2 X N U Shift Manager at Salem/HC directly call the PJM?
S
- The Correct Answer and Plausibility Explanations do not respectively address the 15-minute and 30- minute notification times.
SALEM:
- Replaced Distractors C & D with Hope Creek.
- Corrected Answer and Plausibility Explanations enhanced.
98 F 3 N S NRC:
- Change Distractors A and B to raise the Discrimination Validity of the 99 F 2 X N E question.
S SALEM:
- Distractors A & B changed to Security Shift Manager and Control Room Supervisor respectively.
100 F 2 B S
Page 28 of 29 ES-401 Written Examination Review Worksheet Form ES-401-9
Facility: SALEM NUCLEAR GENERATING STATION Exam Date: February 14 - 24, 2022
B= 41 F= 32 E= 36 RO TOTALS: M= 6 H= 43 U= 10 Additional Notes: __13. 33__% of RO questions assessed as unsatisfactory.
N= 28 B= 12 F= 8 E= 12 SRO TOTALS: M= 1 H= 17 U= 4 Additional Notes: __16__% of SRO questions assessed as unsatisfactory.
N= 12
GENERAL COMMENT
S:
- 1. There are 1 (RO) / 5_ (SRO) questions with r eferences/attachments pr ovided (Count total includes Embedded References).
- 3. Convention utilized by the Chief Examiner to indicate Final Review and Acceptance of those Written Exam Questions requiring Enhancement (E) OR initially determined to be Unsatisfactory (U), cons ists of lining out the E (E) or U (U) in the associated U/E/S Column, and assigning the letter S for Satisfactory, to indicate the nec essary corrections were made.
- 4. NOTE: NRC Early Review Quest ions (i.e., color -coded YELLOW) requiring Enhancement or determined to be Unsatisfactory, were not included in the final RO/SRO Totals for calculating the percentage of questions assessed as either Unsatisfactory or requiring Enhancement, on the basis that these Questions were corrected prior to the 75-Day Submittal.
Page 29 of 29