ML22173A237
| ML22173A237 | |
| Person / Time | |
|---|---|
| Site: | Braidwood  |
| Issue date: | 07/17/2020 |
| From: | Randy Baker NRC/RGN-III/DRS/OLB |
| To: | Exelon Generation Co LLC, Exelon Generation Co |
| Baker R | |
| Shared Package | |
| ML19121A238 | List: |
| References | |
| Download: ML22173A237 (14) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: None. (power, normally aligned) 1 F 2 Y B S Response: Added the comma.
Question is Sat.
NRC: None. (C/Ss and NAT?) (Previous Exam Use - one?)
2 H 2 Y N S Response: Spelled out abbreviated terms, changed one to None.
Question is Sat.
NRC: None. 2009 NRC Exam (Change Question Type to Bank vs. RO) 3 F 3 Y B S Response: Changed question type from RO to Bank.
Question is Sat.
NRC: None. 2006 NRC Exam (Change Question Type to Bank vs. RO)
Note: Good K/A match. How does the question tie to a procedural requirement for 4 H 3 Y B S system operation?
Response: Changed question type from RO to Bank. The procedure step that could be used for this condition is 1BwOA PRI-8, Step 8.d RNO Throttle 1CV121 and Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist.>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 14
ES-401 2 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1CV182 to establish desired charging flow. Added procedure reference to answer explanation.
Question as written is Sat.
NRC: None. Need to see the ARP for Annunciator 1-1-A2. Done.
Note: Good K/A match.
5 H 3 Y N S Response: Added BwAR 1-1-A2 Rev. 16 to question technical reference.
Question is Sat.
NRC: How does this question address the K/A tie for Guidance actions contained in the EOP for Loss of CCW? (Not initially in the EOPs) The reason for the Rx Trip is to procedurally allow tripping of the RCPs without initiating an automatic RPS actuation.
N U Response: Revised the question to meet the K/A by changing the initial conditions to 6 H 2 N Y S place the crew in an EOP. Revised the question, changed 2 distractors and the answer explanations. Also revised the training objective and technical references to match the revised question.
Question is now Sat.
NRC: If the applicant is told the condition of the Rx each time following operation of the Rx Trip switches and is then asked to provide RTB position indication, how does that demonstrate an ability to operate and monitor the Rx Trip switches?
Good question, wrong K/A (057 AA2.03 might be better).
Response: One method to monitor the performance of a switch is to monitor the N E indications that result of the switch being manipulated. By recognizing the correct 7 H 2 Y indication response, the candidate is in fact monitoring the performance of the switch B S itself.
The alternate K/A suggested by the NRC does also match the question, however the APE 057 category has already been selected for use in group 1 tier 1 questions.
Chief examiner randomly selected an alternate K/A for this question, which provides a better Tier 1 question match and question was replaced with a bank question from the 2011 NRC exam. Replaced question is SAT.
NRC: FREE-LOOK. Modified from 2014 NRC Exam. Modify Distractor A to delete the word Remained to match other distractors.
8 H 3 Y M S Response: Changes made.
Question is Sat.
NRC: None.
9 F 2 Y N S Question is Sat.
NRC: None.
10 F 2 Y B S Question is Sat.
Page 2 of 14
ES-401 3 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: FREE-LOOK. None.
11 F 2 Y B S Question is Sat.
NRC: Is there a procedural requirement to only monitor CC HX Outlet Temp from the MCR? Is local indication available and if so, why not use it?
Note: Good K/A match.
12 F 2 Y N S Response: BwOP RH-6, Placing RH System in Shutdown Cooling, contains a caution that reads Monitor 0TI-675 (T0622), U-0 CC HX Outlet Temp and/or_TI-674 (T0621), U-_ CC HX Outlet Temp as heat load is raised on the CC system.
This indication is available only in the MCR (not locally). Answer justification modified.
Question as written is Sat.
NRC: Use the same nomenclature from the stem information in the stem question.
(1SI8808A/B/C/D) 13 H 3 Y N S Response: Revised question stem using same nomenclature.
Question is Sat.
NRC: 2013 NRC Exam. The applicant must interpret the given indication and determine if any indication require a Rx Trip, therefore question is High Cog? Since F E this does not involve operator IAs, recommend removing immediate from the stem.
14 3 X Y B H S Response: Changed question cognitive level to high. Removed the word immediate from question stem.
Question is now Sat.
NRC: 2016 NRC Exam. Recommend moving the operator action statement from the E distractors to the stem question, since the stem question doesnt ask what to do.
15 H 3 Y B S Response: Moved operator action statement to stem as suggested.
Question is now Sat.
NRC: 2009 NRC Exam. None.
16 H 3 Y B S Question is Sat.
NRC: 2009 NRC Exam. None.
17 F 2 Y B S Question is Sat.
NRC: Is this required knowledge for ROs? (Why the action is taken and not just that the action is procedurally required?)
Response: The objective tied to this question APPRAISE each operator-initiated 18 F 3 Y B S recovery technique in its ability to restore the heat sink criticality function applies to both ROs and SROs. Generally, the ROs are required to know the reasons for procedural directed MCB actions.
Question as written is Sat.
Page 3 of 14
ES-401 4 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: (Should Distractor A say Insertion Limit alarm or annunciator to be clear?)
Note: Good K/A match.
19 H 3 Y B S Response: Changed word alarm to annunciator Question is Sat.
NRC: (Ovation Mod results in different system response to the failed instrument than previous analog systems.)
Note: Good K/A match but may not directly tie to a procedural requirement.
E Response: 1BwOA INST-2, Attachment C, Pressurizer Level Channel Failure, has 20 F 3 Y N S the operator check if pressurizer level is maintaining normal level following a level instrument malfunction. If level is not normal, the procedural option still exists to take manual control. Procedure entry added to stem Initial conditions.
Question is now Sat.
NRC: Need to see the ARP for Annunciators 1-10-A1 & 1-10-B1. Done.
Note: Good K/A match but may not directly tie to a procedural requirement.
21 H 3 Y N S Response: 1BwOA INST-1, NI Malfunction, would be the AOP in effect for this event.
Question as written is Sat.
NRC: Does this have a tie to a BwOA for NIs?
Response: Yes, 1BwOA INST-1, NI Malfunction, would be the AOP in effect for this 22 H 3 Y B S event.
Question as written is Sat.
NRC: 2009 NRC Exam. Does this have a tie to a BwOA?
Note: Good K/A match.
23 H 3 Y B S Response: 1BwOA SEC-3, Loss Of Condenser Vacuum would be applicable for this event.
Question as written is Sat.
NRC: Reference Provided. Does this have a tie to a procedural requirement?
Note: Good K/A match.
24 F 2 Y N S Response: 1BwOA PRI-5, CONTROL ROOM INACCESSESSIBILITY, would be the AOP in effect for this event.
Question as written is Sat.
NRC: How does understanding failure mode of instrumentation tie to operating/monitoring the failed equipment? Loose K/A match. Also, Distractor B E
25 H 3 Y N does not appear plausible. Distractor rewritten.
S Response: Recognizing how an instrument would respond to various changing plant conditions is essential to the ability to monitor the instrument.
Page 4 of 14
ES-401 5 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1BwOA PRI-4, HIGH REACTOR COOLANT ACTIVITY, would be the AOP in effect for this event. Replaced Distractor B.
Question is now SAT.
NRC: Reword Stem question and Distractor A to make A plausible. (i.e. S/G pressure drops to approximately. . . and then the respective valve; 60#...; 120#.
E 26 H 2 Y N Note: Good K/A match.
S Response: Made suggested changes.
Question is now Sat.
NRC: Which BwEP ES procedure does this tie to, 0.2 or 0.4?
Response: With the given stem information, the crew would currently be in 1BwEP ES-0.4. 1BwEP ES-0.2 was referenced in the answer explanation because it was the 27 H 3 Y B S procedure the crew transitioned from and contains the step monitoring for and diagnosing a reactor vessel steam void.
Question as written is Sat.
NRC: None.
28 H 2 Y N S Question is Sat.
NRC: None.
29 H 3 Y N S Question is Sat.
NRC: Is the stem focused enough to eliminate Distractor D also being a partially correct answer?
Response: Added the annunciator alarming in the stem to preclude the candidate E from assuming any manual action would have prevented the automatic action from 30 H 2 Y N S occurring. Also added the word INITIAL to the stem to eliminate distractor D from possibly being correct over time (i.e. if the VCT heated up and the water level expanded to the setpoint for diverting letdown to the HUT).
Question is now Sat.
NRC: None.
31 F 2 Y N S Question is Sat.
NRC: 2018 NRC Exam. Appears to be High Cog based on need to integrate several required items for answering the question; what was the LOK on the 2018 exam?
F E 32 3 Y B (Check TS 3.5.2 LCOs.)
H S Response: Changed question to High cog. Was High cog on 2018 NRC exam.
Question is now Sat.
Page 5 of 14
ES-401 6 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: Loose K/A match - Although a solid ECCS system will behave similarly to a solid RCS system, this question focuses on a solid RCS/Pressurizer system.
33 H 2 Y N S Response: The event was precipitated by an ECCS actuation (SI). The K/A tie is based upon the ECCS effect on the pressurizer for operational validity.
Question as written is Sat.
NRC: 2016 NRC Exam. None.
34 F 2 Y B S Question is Sat.
NRC: Modified from LORT Bank. This question does not appear to be significantly modified from the LORT bank question. Although an additional IC is stated in the M E stem, the correct answer is not changed, even with the addition of the 2-part question 35 H 3 Y component.
B S Response: Changed question type to Bank.
Question is now Sat.
NRC: Please explain how lowering pressure results in the M-PZR-PRESS Controller output lowering, which in turn raises heater amps.
36 H 3 Y N S Response: Enhanced answer explanation per NRC request.
Question is Sat.
NRC: None.
37 F 3 Y B S Question is Sat.
NRC: None.
38 F 3 Y N S Question is Sat.
NRC: 2013 CERT Exam. None.
39 F 3 Y B S Question is Sat.
NRC: 2016 NRC Exam. None.
40 H 3 Y B S Question is Sat.
NRC: None.
41 H 3 Y B S Question is Sat.
NRC: 2009 NRC Exam. None.
42 F 3 Y B S Question is Sat.
NRC: None.
43 H 3 Y N S Question is Sat.
Page 6 of 14
ES-401 7 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: 2013 NRC Exam. None. (Ovation Mod results in a different correct answer 44 H 3 Y B S without a change in the question Stem.)
Question is Sat.
NRC: None. (Good question that focuses on Unit differences.)
45 F 3 Y N S Question is Sat.
NRC: None.
46 F 3 Y N S Question is Sat.
NRC: Modified from RS10061-004. None.
47 H 3 Y M S Question is Sat.
NRC: 2014 NRC Exam. None.
48 F 2 Y B S Question is Sat.
NRC: None.
49 F 3 Y N S Question is Sat.
NRC: 2013 NRC Exam. None.
50 F 2 Y B S Question is Sat.
NRC: 2013 NRC Exam. None.
51 F 2 Y B S Question is Sat.
NRC: Modified from RS20076-N01. None.
52 H 3 Y M S Question is Sat.
NRC: 2018 NRC Exam. None.
53 H 3 Y B S Question is Sat.
NRC: 2014 NRC Exam. Are the SACs considered to be part of the IA system?
Response: Braidwood does not have separate instrument air compressors. The SACs directly supply instrument air desiccant dryers that in turn supply the instrument air header and plant loads. Although Westinghouse designers gave separate system designators to the station air (SA) and instrument air (IA) supply systems, the 54 H 3 Y B S common practice by Braidwood training and many plant support groups is to combine the systems and treat them as a single system. For example, operator training materials are combined and designated as a single topic (Station Air and Instrument Air System).
Question as written is Sat.
Page 7 of 14
ES-401 8 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: Are the ROs required to know that entry into 3.6.2 Cond C is required and that this will also require entry into 3.6.1 due to not meeting La requirements? Is this considered Immediate completion time TS action knowledge?
Response: ROs are required to know tech spec entry conditions. With the given stem conditions, a loss of containment integrity is indicated without having to analyze 55 H 2 Y B S a marginal leak rate (exceeding acceptable leak rate should be obvious). The completion time for TS 3.6.1, condition A is 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />. However, the question is not asking the RO to apply the completion time, only know the TS entry is required. Exam facility rep. and validation team agreed that it was a reasonable question for an RO.
Since the information in the NOTES is RO knowledge, question as written is Sat.
NRC: None.
56 H 2 Y B S Question is Sat.
NRC: None.
57 F 3 Y N S Question is Sat.
NRC: None.
58 H 3 Y N S Question is Sat.
NRC: 2016 NRC Exam. The stem question as written is confusing without looking at E the format of the distractor choices. (not stand alone) Attempt to reword the question.
59 H 3 Y B S Response: Revised question stem to clarify.
Question is now Sat.
NRC: It does not appear that Distractor D would be plausible for a novice trainee -
to believe that an alarm setpoint would be greater than the TS upper limit.
Response: Without giving the TS limit nor the alarm setpoint in the question stem, the distractor remains plausible. The distractor is a natural progression of the previous answers (+ 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br />). Additionally, there are several other containment 60 H 3 Y N S pressure alarms that are all above the Tech Spec pressure limit (SI, MSI, CS). Also, an example of another system initial pressure alarm that is outside the Tech Spec limit: 1-12-C1, PZR PRESS CONT DEV LOW is the initial alarm on dropping pressurizer pressure. Setpoint at 2205 psig which is below the Tech Spec DNB limit of 2209 psig.
Question as written is Sat.
NRC: Reference Provided in stem. Modified from 2016 NRC Exam RS20033-N02.
Although an additional IC was added, the original part 1 of the answer is unchanged.
Response: Agree, Part 1 answer remains the same. Question was modified by 61 F 3 Y M S adding 2nd part of answer (whether SFP level remained above or below Tech Spec limit).
Question as written is Sat.
Page 8 of 14
ES-401 9 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: 2016 NRC Exam. None.
62 H 3 Y B S Question is Sat.
NRC: None.
63 F 3 Y N S Question is Sat.
NRC: None.
64 F 2 Y N S Question is Sat.
NRC: None.
65 F 2 Y N S Question is Sat.
NRC: None.
66 F 2 Y N S Question is Sat.
NRC: None.
67 H 3 Y N S Question is Sat.
NRC: None.
68 F 3 Y B S Question is Sat.
NRC: 2006 NRC Exam. None.
69 F 2 Y B S Question is Sat.
NRC: Application of generic LCO and SR Technical Specifications (3.0.1 - 3.0.7) is considered SRO only knowledge in accordance with ES-401, Attachment 2,Section II Examples of Additional Knowledge and Abilities as they Pertain to an SRO License U example B. (Page 19 of 52).
70 H 2 Y X N S Response: Agree with NRC this is SRO ONLY based upon NUREG 1021 guidance.
Replaced the question with newly written question RG20037-N02.
New Question is Sat.
NRC: 2009 NRC Exam. None. Question is Sat.
71 F 2 Y B S
Response
NRC: FREE-LOOK. 2011 NRC Exam. (Need to correct the alpha Contamination level given in the stem to read 25 dpm/100cm2.)
72 H 3 Y B S Response: Corrected the alpha contamination level as requested.
Question is Sat NRC: None.
73 F 4 N S Question is Sat.
Page 9 of 14
ES-401 10 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: None.
74 F 2 N S Question is Sat.
NRC: None.
75 F 2 N S Question is Sat.
NRC: FREE-LOOK. None.
76 F 2 Y Y N S Question is Sat.
NRC: 2009 NRC Exam. Why would a PZR cooldown rate limit be plausible in this E situation? Would <100OF in any 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> be more plausible?
77 H 3 Y Y B S Response: Distractor can be changed to up to 100OF in any 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> period.
Question is now Sat. 43(b)(5)
NRC: None.
78 H 3 Y Y N S Question is Sat. 43(b)(2)
NRC: 2013 NRC Exam. None.
79 H 2 Y Y B S Question is Sat. 43(b)(5)
NRC: Why need 2nd part of 2 x 2? How does that tie to the K/A for verification that substitute power sources have come online?
Response: The indications available to the MCR that the DC bus crosstie is 80 H 2 Y N S complete is the annunciators 1/2-21-D7, DC BUS _11 TIE BRKR TO BUS _11 CLOSE/TRIP. To verify the field procedure steps are complete (and meet the K/A),
the candidate must recognize that both units cross tie breakers are closed.
Question as written is Sat. 43(b)(5)
NRC: None.
81 H 3 Y Y B S Question is Sat. 43(b)(5)
NRC: How is this SRO-Only and why is this High Cog? For the specific question asked in the stem, the question should be able to be answered using only system knowledge of CIS to assess Containment isolation.
Response: The question is SRO ONLY because it requires detailed emergency procedure knowledge (1BwEP-0, step 8 RNO action to locally close valves that are 82 H 2 Y Y N S outside containment) which is beyond the overall mitigation strategy. If the NRC interprets the stem statement The SRO then directs the RO to perform and/or dispatch EOs to perform the step 8 RNO actions as a cue, then the statement can be revised to read The SRO then directs the step 8 RNO actions to be performed.
This would eliminate the possible cue that field actions are required in the RNO action.
Page 10 of 14
ES-401 11 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only The question is high cog because it requires analysis skills in integrating the information bits to predict an outcome (See NUREG 1021, Appendix B, section C.1.d Level 3). To correctly answer the question the candidate must know 1) the 1BwEP-0, step 8 RNO actions, 2) which of the given containment isolation valves are outside of containment (and thereby able to be manipulated), 3) how the local manipulation of the valves affects the valve status lights in the MCR. Separately, each of the required knowledge pieces are low cognitive, but analyzing the result of the actions in the question stem is high cog.
Question as written is Sat. Sat.43(b)(5)?
NRC: 2009 NRC Exam. None.
83 H 3 Y Y B S Question is Sat. 43(b)(5)
NRC: 2009 NRC Exam. None.
84 F 2 Y Y B S Question is Sat. 43(b)(5)
NRC: FREE-LOOK. None.
85 H 3 Y Y M S Question is Sat. 43(b)(5)
NRC: Modified from SS10003-001. This question does not appear to be significantly modified from the bank question. Although an IC in the stem has been modified for the current step in the procedure in effect, it is immaterial. The original part 1 of the answer is unchanged, though the addition of a 2-part question component eliminates 86 H 3 Y Y M S a distractor.
Response: Part 2 of question was added to meet the K/A (a) statement predict the impacts of the following malfunctions or operations on the RCPS. Agree that part 1 of the question did not significantly change from bank question.
Question as written is Sat. 43(b)(5)
NRC: Reference Provided in stem. 1BwOA PRI-8 Table A. Modified from 2009 87 H 3 Y Y M S NRC Exam SE10062-N01. None.
Question is Sat. 43(b)(2)
NRC: None.
88 H 3 Y Y N S Question is Sat. 43(b)(5)
NRC: None.
89 F 2 Y Y N S Question is Sat. 43(b)(5)
NRC: Arent the Operators required to know where to find alarm setpoint values and general actions contained in the BwARs? (Not actually a procedure selection, but a 90 F 3 Y Y N S procedure direction for the BwAR.)
Response: Agree that the first part of the question (knowing where to find alarm setpoint values) is required for all operators. However, the second part of the Page 11 of 14
ES-401 12 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only question is the SRO ONLY component. The BwAR subsequent operator action to CONSULT RETS 2.1-1a is an administrative action that would be performed by the SRO. Administrative Action Requirements (AAR) are initiated and completed by SROs. It would not be expected that a RO would have knowledge of AAR content.
The BwAR does not give any specific information as to why the AAR is consulted nor does the BwAR reference any information regarding bypassing the rad monitor interlock function. All that information is contained within the AAR only. In this context, the selection of a procedure to mitigate effects of the event (the SRO justification) is comparable to a procedure transition step from an AOP or EOP during any other plant event.
Question as written is Sat. 43(b)(4)?
NRC: Change the stem statement to The Unit Supervisor will direct the crew to INITIALLY feed . . . Otherwise the actual knowledge of required S/G feed rates, N E based on plant conditions, is RO knowledge.
91 H 3 Y B Y S Response: Changed the stem statement as suggested.
Question is now Sat. 43(b)(5)?
NRC: None.
92 H 3 Y Y B S Question is Sat. 43(b)(5)
NRC: None.
93 F 3 Y Y N S Question is Sat. 43(b)(1)
NRC: 2009 NRC Exam. None.
94 F 3 Y Y B S Question is Sat. 43(b)(5)
NRC: FREE-LOOK. None.
95 F 2 Y Y B S Question is Sat. 43(b)(7)
NRC: None.
96 F 2 Y Y N S Question is Sat. 43(b)(5)
NRC: None.
97 F 3 Y Y N S Question is Sat. 43(b)(5)
NRC: 2011 NRC Exam. None.
98 F 2 Y Y B S Question is Sat. 43(b)(6)
NRC: Arent the Operators required to know what the critical safety function concerns are and the priority for addressing concurrent CSF red paths?
99 H 3 Y Y B S Response: Yes, all operators are required to know CSF priorities and red path entry procedures. However, the question requires detailed procedure knowledge (beyond the overall mitigation strategy) of 1BwFR-H-1. If the candidate evaluates the stem Page 12 of 14
ES-401 13 Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only status tree information and assumes the highest priority red path (Heat Sink) is the next action that will be taken, it will lead to an incorrect answer. Step 1 in BwFR-H.1 evaluates whether a heat sink is required for current plant conditions. If not, the RNO returns the crew to previous procedure and step in effect with no actions taken. This step is not contained in the OAS nor the CAS and is therefore SRO ONLY required knowledge.
Question as written is Sat. 43(b)(5)?
NRC: Emergency Classifications are declared; EAL (thresholds) are exceeded or E not. Stem ICs should be clarified/reworded.
100 F 2 Y Y B S Response: Reworded stem as suggested.
Question is now Sat. 43(b)(7)
Page 13 of 14
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: Braidwood Station Units 1 and 2 Exam Date: May 22 - June 9, 2020 B= 37 F= 34 E= 10 RO TOTALS: M= 4 H= 41 U= 2 Additional Notes: only 3 2x2 N= 34 B= 12 F= 11 E= 3 SRO TOTALS: M= 3 H= 14 U= 0 Additional Notes: only 4 2x2 N= 10
GENERAL COMMENT
S:
- 1. Question numbers highlighted as xx are sample test items the facility submitted for pre-review.
- 2. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 5. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 1/0 41.8 = 1/0 43.1 = 0/0 41.2 = 0/0 41.9 = 0/0 43.2 = 5/2 41.3 = 0/0 41.10 = 13 / 12 43.3 = 0/0 41.4 = 8/0 41.11 = 1/0 43.4 = 0/0 41.5 = 2/0 41.12 = 2/0 43.5 = 0/8 41.6 = 0/0 41.13 = 1/1 43.6 = 0/0 41.7 = 40 / 1 41.14 = 0/0 43.7 = 1/1
- 6. The answer distribution is:
RO / SRO A = 18 (24%) / 5 (20%)
B = 21 (28%) / 6 (24%)
C = 20 (27%) / 5 (20%)
D = 16 (21%) / 9 (36%)
Page 14 of 14