ML21144A216
| ML21144A216 | |
| Person / Time | |
|---|---|
| Site: | Clinton  |
| Issue date: | 04/13/2021 |
| From: | NRC/RGN-III/DRS/OLB |
| To: | AmerGen Energy Co |
| Roach G | |
| Shared Package | |
| ML20136A303 | List: |
| References | |
| Download: ML21144A216 (16) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the AOPs.
REFERENCE PROVIDED: Power to Flow Map attached to exam and screen shot 1 H 4 B N S of reactor recirculation system status embedded in question stem.
Changed tense in question to past tense where appropriate to signify changing plant conditions.
NRC: Changes made. Question is SAT.
NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated E
plant response to emergency or abnormal situations crossing several plant systems and/or safety functions.
2 F 3 X A B FREE SAMPLE S Response: Modified question to ask what procedure entries are required as well as the SRM availability.
NRC: Changes made. Question is SAT.
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 16
ES-401 2 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for multiple systems.
3 F 3 D N S Changed availability to ability and to operate in the stem.
NRC: Changes made. Question is SAT.
NRC: Question tests the impact of RPV pressure on reactor power following a trip of U the main turbine. The KA tests the impact of RPV pressure on reactor level following a main turbine trip.
4 H 2 A X B Response: Replaced this question with question 62 from this exam due to a better KA match and to prevent overlap between this question and question 62.
S NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it covers integrated plant 5 F 2 D B S response to a lowering vacuum condition.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses 6 F 2 C B S operator response to an abnormal plant condition per the AOPs.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for multiple systems.
E 7 H 2 X C N Capitalize the word NO in the question stem.
S Response: NO in stem capitalized.
Removed 140F and just say when RT F/D Isolate.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for multiple systems.
8 H 3 C B S CLINTON 2017 NRC ILE (Q7)
Response
NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated U plant response to emergency or abnormal situations crossing several plant systems and/or safety functions. The question would meet the requirements of the NUREG if it was changed to focus on operator actions associated with a loss of SDC associated 9 H 2 X D B with the abnormal plant conditions in the question stem.
CLINTON 2013 NRC ILE (Q11)
S Response: Changed phrasing in the stem and distractors to better illustrate required operator actions. Information tested is directly from CPS 4001.02.
NRC: Changes made. Question is SAT.
Page 2 of 16
ES-401 3 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated plant response to emergency or abnormal situations crossing several plant systems U and/or safety functions. The question would meet the requirements of the NUREG if the second part was associated with procedure actions from the appropriate AOP.
10 H 2 X C B Response: Changed phrasing in the stem and distractors to better illustrate required S
operator actions. Information tested is directly from CPS 4011.02.
Distractor B is not plausible. Replaced B and D part 2 with restore SFP Cooling with CY.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests operator actions E during EOP conditions.
11 F 2 C B S NRC: Add if any to the stem to make Distractor D plausible.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for multiple systems.
Capitalize the word NO in the question stem.
E FREE SAMPLE 12 H 2 X D N Response: NO in stem capitalized.
S What is the cause of the scram, if it is a load rejection or turbine trip this would cause LLS to actuate? Added scram was due to a feedwater control system malfunction.
NRC: Changes made. Question is SAT.
NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated U plant response to emergency or abnormal situations crossing several plant systems and/or safety functions. A more significant adjustment is required to make this 13 F 2 X C B question conform to the NUREG FAQ requirements; therefore, it is unsat. It may be necessary to change the KA.
S Response: Question modified to include required procedure entries as well as SPDS response to EOP-6 entry.
NRC: Changes made. Question is SAT.
E NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of 14 H 2 X X B B operator actions during EOP conditions.
Page 3 of 16
ES-401 4 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only Based on the conditions provided of containment pressure at 0.3 psig it is not realistic that the applicant will mistake that the PSP curve is exceeded. Perhaps you meant to indicate the containment pressure is 3 psig which would be more plausible.
S REFERENCE PROVIDED: Heat Capacity Temperature Limit and Pressure Suppression Pressure Curves embedded in the question stem.
CLINTON 2017 NRC ILE (Q3)
Response: Containment pressure given should be 3.0 psig. Question updated.
Answer justifications are confusing between answer B and C. Both are called as correct at some point in the justification section.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55, because it tests the progression of 15 H 2 C N S the event.
NRC: The reactor would have scrammed as level went below Level 3. Therefore, it would be expected that reactor power would be in the intermediate range and lowering. The effect of ATWS-RPT should not impact reactor power unless an ATWS exists. Therefore, if level went below Level 2 for some other reason such as a LOCA or loss of feedwater injection etc., ATWS-RPT would still occur but it would not have an impact on reactor power. The ATWS-RPT serves as a back stop for RPS in the sense that conditions have continued to degrade in the RCS if pressure continues to H 3 B U rise above the scram setpoint or level continues to lower below the scram setpoint This question is a stretch for a KA match.
16 D X REFERENCE PROVIDED: Diagram of RR pump breaker configuration in stem.
F 2 N S FREE SAMPLE Response: Question replaced with a new question that has a better KA match.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the progression of the event.
Level 3 trip will occur unless there is an ATWS, therefore the ATWS-RPT to impact power is not reasonable to rely on to address KA. ATWS added to question stem.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of E operator actions during EOP conditions.
17 H 2 X C N Capitalize the word NOT in the question stem.(Shutdown criteria is NOT met.)
S Response: NOT in stem capitalized.
NRC: Changes made. Question is SAT.
E NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of 18 F 2 X B B operator actions during EOP conditions.
Add the name Radioactive Release Control to the stem following EOP-9.
Page 4 of 16
ES-401 5 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only S Response: Radioactive Release Control added following EOP-9.
NRC: Changes made. Question is SAT.
NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated E plant response to emergency or abnormal situations crossing several plant systems and/or safety functions. The question can be modified (possibly into a 2x2 format) to 19 F 3 X B B ask what additional actions would be required by the ARPs/AOPs/ Fire Pre-Plans.
CLINTON 2017 NRC ILE (Q14)
S Response: Added a second part of the question to ask what MCR actions are required per 1893.04.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator response to an abnormal plant condition per the AOPs.
E Remove the word required from the stem and indicate which action is directed to be performed per the OP-CL procedure. The correct answer in this case is to be 20 F 3 X A B considered per OP-CL 108-107-1002 and is therefore not required.
S Response: Changed stem to read Which of the following actions is directed to be performed per OP-CL-108-107-1002, Degraded Grid Actions, and why?
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests integrated plant response to abnormal conditions for multiple systems.
E Distractor D is not a credible distractor as it serves as a Subset of Answer C.
21 H 2 X C N Specifically, the applicant can dismiss Distractor D as if it were correct then Answer C S would also have to be correct which would make this an invalid question.
Response: Distractor D changed to eliminate the subset issue.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of operator actions during EOP conditions.
The question does not address the stated KA. Specifically, operating containment ventilation/cooling as it applies to HIGH TEMPERATURE in the containment. The 22 H 3 C X N S isolation signals are associated with high drywell pressure and high containment radiation levels.
Response: Disagree. The candidate must understand the procedure to lower temperature in the containment following a ventilation trip in order to the answer the question. This question meets the stated KA.
Page 5 of 16
ES-401 6 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Concur, the KA is a match.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of operator actions during EOP conditions.
Question is a memory/fundamental knowledge question just requiring knowledge of E SP temperature logging requirements.
Capitalize the word NO in the question stem and add the name of the procedure 23 F 3 X C X N along with EOP-6.
S Response: NO in stem capitalized. EOP-6 title added. Changed cog level to 1-F.
Added justification info regarding the ARP 5064-5C directing TS entry which establishes logging requirements.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the results of operator actions during AOP/EOP conditions.
E Capitalize the word NO (NO lights lit) 24 F 3 X B N Response: NO in stem capitalized.
S Change lights to light.
NRC: Changes made. Question is SAT.
NRC: NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests operator actions during AOP conditions.
25 H 3 D N S Swapped CCP monitors for FHB PR monitors to better meet the KA.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because it tests the purpose of operator actions during EOP conditions.
26 F 2 C N S Is table required to answer this question, does not seem to add information required to answer question? Table removed.
NRC: Changes made. Question is SAT.
NRC: This question does not meet the requirements of FAQ 401.55 in that it doesnt test information 1) from the AOP/EOPs 2) diagnosis of procedures to be used to address the situation 3) progression of an event, OR 4) assessment of integrated E plant response to emergency or abnormal situations crossing several plant systems and/or safety functions. The question can be modified to ask about operator actions 27 F 2 X B B associated with EOP conditions related to use of the CGCS with high hydrogen concentrations present.
S Response: Question revised to ask actions required related to use of CGCS system during EOP-6.
NRC: Changes made. Question is SAT.
Page 6 of 16
ES-401 7 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Please explain in greater detail in the answer justification why pressing the manual pushbutton to start the pump in this instance is not sufficient to start the A E RHR pump versus taking the control switch to start.
28 H 3 C B CLINTON 2017 NRC ILE (Q4)
S Response: Answer justification clarified.
NRC: Changes made. Question is SAT.
29 H 3 A N S NRC: None.
30 H 3 C N S NRC: None.
31 H 3 C B S NRC: None.
32 F 2 C N S NRC: None.
NRC: None.
33 F 3 C B S FREE SAMPLE 34 F 2 D N S NRC: None.
NRC: None.
35 H 2 D B S FREE SAMPLE 36 F 2 A B S NRC: None.
37 H 3 C N S NRC: None.
NRC: None.
38 H 2 B B S CLINTON 2017 NRC ILE (Q38)
NRC: None.
39 H 3 B N S REFERENCE PROVIDED: Image of RCIC Isolation Switches embedded in the question stem.
NRC: None.
40 F 3 D N S FREE SAMPLE NRC: None.
41 H 2 D B S CLINTON 2017 NRC ILE (Q50)
NRC: None.
42 H 2 A B S CLINTON 2015 NRC ILE (Q21)
NRC: None.
43 H 3 B B S PREVIOUS 2 EXAMS: CLINTON 2018 NRC ILE (Q9)
Page 7 of 16
ES-401 8 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only 44 F 2 C N S NRC: None.
45 F 2 D N S NRC: None.
46 F 2 B B S NRC: None.
NRC: The question is considered UNSAT even though it is a previous NRC exam bank question, because it does not match the KA for this exam. The KA is written to test the effects of loads when energizing a bus associated with parameters of the AC electrical distribution system. The question does not test the effect on parameters such as frequency and voltage when energizing a bus.
47 F 3 A X B S CLINTON 2017 NRC ILE (Q44)
Response: Disagree. The candidate must understand that loads are sequenced onto the bus following its energization from the EDG to prevent overloading in order to answer the question.
KA match is acceptable.
NRC: Please provide a diagram which illustrates the Div 2 NSPS UPS.
E REFERENCE PROVIDED: Image of 480V 1B Voltage and Current control panel indications is embedded in the question stem.
48 H 3 B B CLINTON 2015 NRC ILE (Q20)
S Response: Added NSPS Bus diagram in answer explanation.
NRC: Changes made. Question is SAT.
NRC: Please explain why the graphics have changed since the 2018 exam, but the descriptions have not. Specifically, the 2018 exam indicates that a + current would be indicative of a charging battery (current into the battery) while the 2021 exam says that a charging current would be indicated by a negative current.
REFERENCE PROVIDED: Image of DC Voltage and Current control panel 49 H 3 X C B S indications is embedded in the question stem.
PREVIOUS 2 EXAMS: CLINTON 2018 NRC ILE (Q11)
Response: During the 2019 outage, pictures were taken of the meters in question and it was determined that the previous question was incorrect. Corrections were made and simulator modified in 2019/2020.
NRC: Question is SAT.
E NRC: Adjust the wording in Distractor C to be uniform throughout the question by using the term KVAR.
REFERENCE PROVIDED: EDG Reactive load capability curve attached to the 50 H 2 X C B exam.
CLINTON 2013 NRC ILE (Q40)
S Response: VARS in distractor C changed to KVAR.
Page 8 of 16
ES-401 9 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Changes made. Question is SAT.
NRC: None.
51 F 2 B B S CLINTON 2015 NRC ILE (Q9) 52 H 3 A B S NRC: None.
NRC: None.
53 H 2 C B S PREVIOUS 2 EXAMS: CLINTON 2018 NRC ILE (Q5) 54 H 4 B B S NRC: None.
55 F 4 D N S NRC: None.
56 F 2 A N S NRC: None.
NRC: For distractors B and C wouldnt you also have to open the F046 valve to send E RT return to the main condenser? Update the justification information as necessary.
57 H 2 A N Response: Answer explanation corrected to indicate that F046 must also be opened S to return RT to Main Condenser.
NRC: Changes made. Question is SAT.
NRC: At the heart of the answer to this question is a design feature of the EDG U system not the RHR Containment Spray system. Perhaps focus on cross tying the loops of RHR during certain circumstances.
58 H 2 A X N FREE SAMPLE S Response: Question replaced with a new question that has a better KA match NRC: Changes made. Question is SAT.
NRC: What is the purpose of the portion of Table U provided? The actual complete Table U includes a section covering area 755 around the fuel pool and indicates that 1RIX-AR016 reading 2.5 mr/hr is an EOP 8 entry condition. The applicant confusing the survey requirements for elevation 755 in the portion of Table U provided only E helps the applicant achieve the correct answer. In addition, the lowered level in the SFP itself is an entry condition on the EOP.
59 H 2 X A B REFERENCE PROVIDED: Table U from EOP-8, Secondary Containment S Control embedded in the question stem.
Response: Table U removed from stem of question.
This question no longer has a reference provided.
NRC: Changes made. Question is SAT.
NRC: None.
60 H 2 D B S REFERENCE PROVIDED: Graph of main condenser vacuum versus time embedded in the question stem.
Page 9 of 16
ES-401 10 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only CLINTON 2017 NRC ILE (Q54)
E NRC: Capitalize the word NO in the stem.
61 H 3 X D N Response: NO in stem capitalized.
S NRC: Changes made. Question is SAT.
NRC: None.
CLINTON 2015 NRC ILE (Q39) 62 F 2 D B S Response: Changed question; new question is from CLINTON 2018 ILE (Q35)
PREVIOUS 2 EXAMS: CLINTON 2018 ILE (Q35)
NRC: Changes made. Question is SAT.
63 H 3 D N S NRC: None.
NRC: None.
64 H 2 B N S REFERENCE PROVIDED: Image of containment and fuel handling ventilation damper control panel indications is embedded in the question stem.
NRC: This question is at the fundamental knowledge level in that it only requires the applicant to recall that Division 1 containment isolation impacts outboard containment E isolation valves only.
65 F 2 B N REFERENCE PROVIDED: Image of secondary containment area temperature recorder control panel indications is embedded in the question stem.
S Response: Changed cog level of question to 1-F.
NRC: Changes made. Question is SAT.
NRC: Capitalize the words NOT and MINIMUM in the question stem for E
consistency.
66 F 3 X B N Response: NOT and MINIMUM in stem capitalized.
S NRC: Changes made. Question is SAT.
67 F 2 C B S NRC: None.
E NRC: Capitalize the word MUST in the question stem.
68 F 3 X C N Response: MUST in stem capitalized.
S NRC: Changes made. Question is SAT.
NRC: None.
69 F 2 B B S CLINTON 2015 NRC ILE (Q69)
E NRC: The word changeout is misspelled in Distractor D.
70 F 2 X B N S Response: Corrected misspelling.
Page 10 of 16
ES-401 11 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: Changes made. Question is SAT.
NRC: None.
CLINTON 2011 NRC ILE (Q69) 71 F 3 B B S Add discussion in justification of difference between OOS and fully disabled.
NRC: Changes made. Question is SAT.
72 H 3 D B S NRC: None.
NRC: None.
73 F 3 C B S CLINTON 2017 NRC ILE (Q71)
NRC: The question tests the general philosophy of vortex limits as discussed in the 74 F 4 C B S EOPs and therefore meets the KA and generic aspects of Tier 3.
75 H 3 C N S NRC: None.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses required actions per the Technical Specifications caused by the abnormal event or a partial loss of DC power.
76/ 1 H 3 D B S REFERENCE PROVIDED: Portion of TS 3.8.4 and DC Amperage Indicator is embedded in the stem.
CLINTON 2013 NRC ILE (Q76)
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator action regarding reportability following a loss of shutdown cooling.
E Providing only the Cold EAL Chart page with the correct EAL on it provides cuing to 77/ 2 H 2 X C N the applicant. The applicant should be provided with the full set of Cold EALs.
S REFERENCE PROVIDED: Cold EAL Wall Chart EP-AA-1003 Addendum 3 Rev. 2 Response: Full cold EAL tables provided.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the AOP/EOPs.
78/ 3 H 2 A B S REFERENCE PROVIDED: Excerpt from Cold EAL Wall Chart EP-AA-1003 Addendum 3 Rev. 2 embedded in stem.
CLINTON 2017 NRC ILE (Q81)
N E NRC: This question may ask about a term used in the TS bases, but perhaps also in the UFSAR. Does this piece of TS bases information meet this criteria: knowledge 79/ 4 F 3 B X of TS bases that are required to analyze TS-required actions and terminology B it does not appear so for this question?
Page 11 of 16
ES-401 12 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only I need the references to assess this question. For the exam submittal, the references which provide the validation of the correct answer should be provided with the submittal. My concern is this SRO level of knowledge, where is this information S provided? Is it solely in the TS Bases? Every question should have AT LEAST an excerpt of the reference for which the correct answer can be ascertained and why distractors are wrong.
FREE SAMPLE Response: Question replaced with a new question that is more clearly SRO-only.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the EOPs.
Correct the KA statement in the question justification. The KA was changed but not updated in the justification section.
CLINTON 2017 NRC ILE (Q82)
Response: KA justification updated.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses 80/ 5 H 2 C N S operator actions as required by the ITS/ARPs.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the EOPs.
SRO Justification: Question is linked to SRO Only task 440201.03 Determine when Containment Sprays are required, when executing EOPs, and to 10CFR55.43(b)(5)
Assessment of facility conditions and selection of appropriate procedures during normal, abnormal, and emergency situations. This question appeared on the RO 81/ 6 H 3 B B S portion of the 2017 NRC ILE but is associated with decision making on EOP steps which is an SRO only responsibility.
REFERENCE PROVIDED: EOP-6, PRIMARY CONTAINMENT CONTROL, Detail O Containment Spray Initiation Limit Curve embedded in the stem with OK to Spray region nomenclature redacted.
CLINTON 2017 NRC ILE (Q75)
NRC: Perhaps indicate that the offsite release rate exceeds the NOUE level. By E saying the release rate is approaching the ALERT level without further clarity as to are we going to exceed that value in a matter of seconds or minutes or hours it could 82/ 7 H 3 X A B be argued to take the first step of EOP-9 if it is imminently going to be entered.
REFERENCE PROVIDED: EOP-8, Secondary Containment Control Table U S embedded in stem.
FREE SAMPLE Page 12 of 16
ES-401 13 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only Response: Question revised to specify that offsite release rate has exceeded NOUE level vice ALERT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the EOPs.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the AOP/EOPs.
E Capitalize the word MAXIMUM in the question stem.
83/ 8 F 2 X D B FREE SAMPLE S
Response: MAXIMUM in stem capitalized.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses E operator actions as required by the AOPs.
84/ 9 H 3 X A N Capitalize the word FIRST in the stem.
S Response: FIRST in stem capitalized.
NRC: Changes made. Question is SAT.
NRC: Meets Tier 1 requirements per FAQ 401.55 because the question addresses operator actions as required by the EOPs.
85/
H 2 D B S REFERENCE PROVIDED: CPS 4304.01 Flooding Table 2 embedded in the 10 question stem.
PREVIOUS 2 EXAMS: CLINTON 2018 NRC ILE (Q85)
NRC: Question is a KA mismatch in that it does not address accident conditions.
Recommend replacing KA with 2.2.12 Knowledge of surveillance procedures. In addition, providing TS 3.0.4 would assist with question 76 which effectively test the same concept and is an overlap on the exam for can you change modes without U meeting a TS. I recommend finding two more plausible distractors in place of part 2 86/
H 3 X A X B of the question.
11 S REFERENCE PROVIDED: Technical Specification 3.3.5.1 attached to the exam.
Response: Revised question to remove TS 3.0.4 reference and added two plausible distractors. Replaced KA with 2.2.12.
NRC: Changes made. Question is SAT.
87/
H 3 C N S NRC: None.
12 88/
H 3 C N S NRC: None.
13 Page 13 of 16
ES-401 14 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only 89/
H 2 D N S NRC: None.
14 NRC: Distractor A appears that it could be considered correct as EOP-2 calls out RCIC as a preferred injection system. Changes to the EOPs during depressurization allow for consideration of steam driven components on how low RPV pressure is E required to be lowered to since this question was last tested. In addition, a rising RPV pressure is one mechanism used to determine if the vessel is full.
90/
F 2 X D B CLINTON 2013 NRC ILE (Q88) 15 Response: Question modified to make distractor A incorrect. The second portion of S
distractor A was changed to read when RPV level is indicated.
Answer justifications needed to be reordered.
NRC: Changes made. Question is SAT.
91/ NRC: None.
H 3 C B S 16 PREVIOUS 2 EXAMS: CLINTON 2018 NRC ILE (Q93)
NRC: None.
CLINTON 2011 NRC ILE (Q79) 92/
H 2 A B S REFERENCE PROVIDED: EOP-6, PRIMARY CONTAINMENT CONTROL, Detail O 17 Containment Spray Initiation Limit Curve and Detail P Heat Capacity Limit Curve embedded in the stem.
93/
F 3 A N S NRC: None.
18 NRC: None.
94/ CLINTON 2015 NRC ILE (Q98)
F 2 A B S 19 REFERENCE PROVIDED: EOP Flow chart format embedded in the question stem.
95/
F 2 A N S NRC: None.
20 96/
F 2 A N S NRC: None.
21 97/
F 3 C N S NRC: None.
22 98/ S NRC: None.
F 2 B B 23 CLINTON 2011 NRC ILE (Q96)
Page 14 of 16
ES-401 15 Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Ans Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link wer ward K/A Only NRC: The justification of Distractor A seems incorrect. Based on exceeding HCTL, a blowdown is required and a ATWS exists. Per EAL Wall Chat page CL2-3, if an ED is required then you a have a loss of the RCS barrier (RC-4.2) and if HCTL is exceeded you have a potential loss of the containment barrier (CT-3.5). Therefore, E EAL FS1 would be declared due to a loss or potential loss of two fission product barriers. So, in the instance the two concurrent EALs are FS1 and MS3.
99/
H 2 X X D B REFERENCE PROVIDED: EOP-6, PRIMARY CONTAINMENT CONTROL, Detail P 24 Heat Capacity Limit Curve embedded in the stem. EAL Wall Board Hot Matrix S Sheets CL2-3 and CL2-5 are attached to the exam.
Response: Modified question wording and corrected distractor A justification to note that FS1 has also been exceeded but is not one of the four responses included.
NRC: Changes made. Question is SAT.
100/
F 3 D N S NRC: None.
25 Page 15 of 16
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: CLINTON POWER STATION Exam Date: MARCH 29 - APRIL 13, 2021 B= 41 F= 35 E= 25 M= 0 H= 40 U= 4 RO TOTALS: Additional Notes: SATISFACTORY SUBMITTAL 34 (18 High N=
Cog)
B= 14 F= 10 E= 7 M= 0 H= 15 U= 1 SRO TOTALS: Additional Notes: SATISFACTORY SUBMITTAL 11 (6 High N=
Cog)
GENERAL COMMENT
S:
- 1. Question numbers highlighted as FREE SAMPLE are sample test items the facility submitted for pre-review.
- 2. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 5. The answer distribution is:
RO / SRO A = 12 (16%) / 9 (36%)
B = 20 (27%) / 3 (12%)
C = 27 (36%) / 6 (23%)
D = 16 (21%) / 7 (28%)
The number of questions with references attached or embedded exceeds the guidance provided in OL FAQ 401.53 (4 on RO exam and 5-6 on SRO exam). The Chief Examiner assessed the references and determined that they did not provide cueing on other exam questions (except in one instance (Q77) as recorded in the 401-9 comments which were addressed by the facility).
Page 16 of 16