ML15245A475
| ML15245A475 | |
| Person / Time | |
|---|---|
| Site: | Davis Besse  |
| Issue date: | 06/22/2015 |
| From: | NRC/RGN-III/DRS/OLB |
| To: | FirstEnergy Nuclear Operating Co |
| Reeser, D W | |
| Shared Package | |
| ML15217A089 | List: |
| References | |
| Download: ML15245A475 (17) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 1
2015 Davis-Besse Initial Licensed Operator Written Examination Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
L 2
X X
N U
1/2X2 TS Purpose statement - reducing the magnitude of pressure and temperature transients on the Reactor Coolant System (RCS) caused by loss of main feedwater events or turbine trips. This lowers the probability of a Pressurizer Pilot Operated Relief Valve (PORV) actuation during these events.
SFRCS is an input to ARTS. Is not a feed line rupture a loss of feed?
Two partially correct answers (B and D) 1R L
2 N
S RESPONSE: Revised part (1) of distracters A and B to a Main Steam line break instead of a Main Feedwater line break.
2 H
3 X
X N
E 1/2X2; K/A Match -- A leaking PORV or code safety does not seem to rise to the level of an a pzr vapor space accident.
RESPONSE: Since valves release from the vapor space the observed changes in Pressurizer parameters would be similar; close enough to match intent of K/A.
Stem Focus - The stem seems to describe two unrelated events; leaking code safety and containment temperature rise. Stem gives no indication indications of a quench tank rupture RESPONSE: Elevated containment temperature is indicative of rupture disk rupture.
RESPONSE: The word Leaking was replaced with Partially Open in all four answer choices..
3 H
3 N
S 4
L 3
N S
1/2X2 5
L(H) 2 B
S Question is a combination of 2 recall questions RESPONSE: Agree; cognitive level changed to L.
6 H
3 N
S
ES-401 Written Examination Review Worksheet Form ES-401-9 2
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 7
L 2
M S
Bank - 165796 Modified. Looked at original question; original question significantly modified.
8 L
2 N
S 9
H 3
N S
10 L
2 B
S Bank - DB 2013 NRC Exam #48 11 H
3 N
S 12 H/L 3
N S
13 H
2 N
S 14 H
2 X
X X
?
N U
1/2X2; K/A match - K/A related to knowledge contingency lineup for restoration. Question test knowledge of Backup Service Water Pump operating modes (Fast vs Slow speed).
Stem Focus - Stem asks about steps (plural) when question response is singular.
Determining operability is a SRO function.
Suggested Fix - eliminate two part answer and provide other distracters. Examples:
Similar to part 1 but with pump in slow speed Align pump 1-3 to supply loop 1 Lineup pump 1-2 to supply both loop 1 and 2.
14R H
2 N
S RESPONSE: Part (2) of each answer choice was eliminated. The stem and part (1) of answer choices were revised to require selection of a single action and incorporate the suggested actions.
15 H
3 N
S 16 H
3 N
S 1/2X2 17 H
2 N
S 1/2X2 18 L
3 N
S 1/2X2 19 H
3 N
S 1/2X2
ES-401 Written Examination Review Worksheet Form ES-401-9 3
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 20 H
2 N
S 1/2X2 21 L
2 X
N E
Stem Focus - What value is provided by first two lines of stem?
Change to simply state plant in Mode 3 RESPONSE: Establishes the initial condition that SRMs are in operation. Removed reference to Control Rod position.
22 H
2 B
S Bank - ANO 2011 #24 23 L
2 X
N U
E Credible Distracter - Any choice that does not include 1 does not seem plausible.
RESPONSE: AOP directs performance of a source check to verify proper operation. Changed (1) to state perform a source check.
24 L
2 N
S 25 H
2 N
S 1/2X2 26 H
3 B
S Bank -#178901 27 L
2 N
S 28 H
3 N
S 29 H
2 N
S 30 H(L) 2 N
S 1/2X2 High Cognitive level - applicant must evaluate the impact of MU6 closing first, then determine correct response.
RESPONSE: Agree; cog level changed to H 31 L
3 N
S 32 L
2 N
S 33 L
2 N
S 1/2X2 Question is actually two unrelated questions. K/A is not a two part K/A.
RESPONSE: K/A is knowledge of Entry Condition AND Immediate Actions. No changes made.
ES-401 Written Examination Review Worksheet Form ES-401-9 4
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 34 H
3 N
S 35 L
2 N
E 1/2X2 Verify accuracy of part 1 response. Appears to be a miss-application of the procedural caution. No indication that component being vented is isolated.
RESPONSE: Stem reworded to indicate cooler is being restored following maintenance. Additionally component to be filled and vented was changed to an EDG Jacket Water Cooler to be consistent with the condition that the cooler is being filled from the surge tank volume; more realistic to fill a smaller component.
36 L
3 N
U S
Answer is only partially correct. The increase in flow through the DH Coolers will be offset by isolation of the Aux Bldg Non-Essential loads and pump will not experience runout unless the operator restores flow to the Aux Bldg non-essential header.
RESPONSE: The question relates only to a loss of air and the resulting RPS actuation and does not involve any other accident or event that would result in an SFAS actuation; therefore the Aux Bldg Non-Essential header would not isolate (MOVs and not AOVs).
Answer explanation was enhanced to clarify this fact. No other changes were made.0 37 H
2 B
S Bank # 167005 38 H
2 N
S 39 H
3 N
S 1/2X2 40 L
2 X
N S
1/2X2 Stem Focus - What value is provided by first two lines of stem?
RESPONSE: Provided to ensure that applicant is clear that question is related to the DBLOCA. OK as is; no changes made.
41 H
2 X
N E
Stem Focus - The status of the SW inlet valves provides no value t the question. The question is answered solely based on the fan speed. Delete any reference to the SW valves.
RESPONSE: Agree; SW valve info deleted.
ES-401 Written Examination Review Worksheet Form ES-401-9 5
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 42 L
4 X
X N
U 1/2X2 Stem Focus - Why not simply state that a Design Basis LOCA has occurred since the question centers on that fact.
The explanation seems incomplete and almost trivial. The reason appears to be due to the significant difference in temperature between the water in the BWST (90°F) vs the temperature in the water in the sump (approx. 255°F). The water temperature in the sump is relatively constant after the first 5 minutes until about 100 minutes after sump recirculation begins.
Additionally, the rise in containment pressure is rather insignificant
(< 1 psi).
42R L
N S
RESPONSE: Initial condition reworded to simply state that a Containment Design Basis LOCA has occurred. Revised the question to state that a small rise in containment pressure is observed following switch to sump recirc and asks the examinee to select reason for the pressure rise.
43 H
4 N
S 44 H
2 X
B S
Bank #168736 Does not match K/A - K/A refers to features that cause a Rapid Feedwater Reduction. Question answer relates to actuation RESULTING FROM a RFR actuation. Choices B and D should be revised to actuate [because].
RESPONSE: Question matches K/A since it tests how the system/components respond to achieve the desired effect.
OK as is; no changes made..
45 H
3 X
N E
Job Link - Determining operability is a SRO function. Suggest rewording to replace the word INOPERABLE.
RESPONSE: Revised stem question to describe operational impacts as described by the System Operating Procedure and changed to INOPERABLE to inoperable. These changes made to ensure that question was based on RO required level of knowledge and remove any suggestion that the RO would be making a determination of Tech Spec operability.
ES-401 Written Examination Review Worksheet Form ES-401-9 6
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 46 L
3 N
S/E Explanation of choice B appears to be incorrect. The normal lineup is for AF59 to be open and AF50 & AF51 to be closed.
RSPONSE: Corrected Explanation of D should include the reason for the NORMAL lineup and why the valves need to be realigned following an actuation.
RESPONSE: Enhanced answer explanation.
47 L
3 N
S 1/2X2 48 L
1 M
U Bank # 167376 modified Very low level of difficulty. Basic knowledge of inverter operation easily rules out choices C and D (regardless of what the normal supply is) and LPI pumps are AC powered.
48R L
2 M
S RESPONSE: Distracters C and D replaced with DC powered components which increased LOD sufficiently..
49 L
2 N
S 50 H
2 N
S 1/2X2 51 L
3 X
X N
E Stem Focus/Cues - Delete second bullet. Provides cue to answer and is normal configuration which can be assumed. Incorporated first bullet into first sentence.
RESPONSE: Changed as requested.
52 L
3 X
X N
U 1/2X2 Minutia -- Specifying valve numbers is unnecessary and overly specific.
Backward logic - The question implies a direct relationship between cold temperatures and relief valve operation. The issue is that cold temperatures reduce CCW flow needs which raises system pressure which could cause unnecessary actuation of the reliefs not challenges.
52R H
3 N
S RESPONSE: Revised question to identify cold weather impact on SW header pressure and the corresponding mitigating action.
ES-401 Written Examination Review Worksheet Form ES-401-9 7
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 53 H
3 X
M E
Oconee 2010 #53 modified Stem Focus - If the IA system separates from the SA system at 95 psig, then the IA header pressure should stabilize at the normal operating pressure of 104-110 psig, not 95 psig.
RESPONSE: IA Header Pressure Indication revised to reflect normal pressure range.
54 L
2 N
S 1/2X2 55 H
X X
N E
Delete the second sentence in the stem and replace HIS 2202A with noun name; or better yet delete the second and third sentences (including the three bulleted items). They add no value to the question.
Distracter A is not plausible. If a low temperature limit were being challenged, there is no logical reason to shift fans to FAST and thus increase cooling.
All distracters - provide a reason for the challenge RESPONSE: Stem conditions condensed and choices revised to incorporated intent of requested changes.
56 L
2 B
S Bank - #167286 57 L
3 N
E Other - Answer choices B - D, what final values are you referring too? Suggest rewording to say after final seal leakage [and Quench Tank Level] values are recorded.
RESPONSE: Changed recorded to entered 58 H
3
?
X N
E Stem Focus - what is the significance to CCW Pump 1 in operation?
RESPONSE: Initial condition bullet revised to state that Makeup Pump 2 was in operation.
Choice D is not plausible; replace and reword stem.
RESPONSE: Distracter replaced with a sequencer failure and stem revised to remove if any 59 H
3 X
N E
1/2X2 Delete either the 2nd or 3rd sentence; theyre redundant.
RESPONSE: Second sentence deleted.
ES-401 Written Examination Review Worksheet Form ES-401-9 8
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 60 L
2 N
S If the flow signal shorts to ground wont the input to the RPS channels go to zero indicating no flow in the loop. That is, the fault would not directly affect RPS, but because of the fault, the resultant change in output would be transmitted as a loss of flow affecting the RPS.
RESPONSE: Facility pointed out that RPS provides the signal to NNI and not the other way around. OK as is; no changes made.
61 L
2 X
N E
Choices C and D not very plausible. Simply adding makeup does not provide significant cooling.
Change C to 2, 1, 3 Change D to 2, 3, 1 Consider changing 2 to Decay Heat Train 1 RESPONSE: Distracters C and D changed as suggested. SFP Cooling option 2 was not changed (procedure does not support the recommended change).
62 H
3 N
S 63 H
3 X
X M
E Bank - #172527 2008 NRC modified 1/2X2 Stem Focus - insert the steady state values of between on and Reactor RESPONSE: Agree; changed.
K/A match - Explain why a closure of MSIV is a loss or malfunction of SDS. Appears SDS is functioning as designed.
RESPONSE: MSIV position is an input to SDS. The malfunction in the spurious actuation of the position switch. See explanation of correct answer. Meets K/A.
64 L
2 N
E 1/2X2 Part 1 after a timer times out implies the turbine trips actuates the timer. Timer is not activated until a reverse power condition is achieved. Suggest rewording to after an unspecified time delay.
RESPONSE: Part (1) of choices A and B revised by inserting reverse power relay at beginning. Part (1) of choices C and D will be revised by inserting after closure of Turbine Stop Valves at end.
ES-401 Written Examination Review Worksheet Form ES-401-9 9
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 65 H
3 X
N E
Replace a method, if any, with the ability RESPONSE: Agree; change made.
66 H(L) 3 B
S Bank - Oconee 2010 #95 Consider replacing C with two hours (120 minutes); plausible for misapplication of TS 3.9.5 testing allowance.
RESPONSE: Choices kept at LTE 60 minutes to prevent classification as SRO only. OK as is; no changes made.
67 L
2 X
N U
1/2X2 K/A is knowledge of system purpose and/or function. Both Hydrogen gas injection (cylinders) and Hydrazine injection use the Makeup and Purification System (Makeup Tank is part of the system) are used to control dissolve Oxygen. Question tests knowledge of when each is used, and not why.
- Part (1) of choices will be revised to address concern.
67R L
3 S
RESPONSE: Revised to ask why Makeup System is used to control dissolved Oxygen.
68 H
2 N
E Add to first sentence -- which includes a valve lineup in accordance with Attachment 5 of the procedure (provided).
Reword second sentence - Which of the following valves remains in its normal ?
RESPONSE: Suggested changes made.
69 H(L)
X X
N U
Action B.1 does not apply since it would have been performed when EDG 1 was removed from service and on a recurring 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> clock.
Condition E is now applicable (restore an EDG to operable status within 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br />). If either EDG is restored this does not reset the action B.1 time clock.
If B.1 does not apply, then there is no correct answer. Additionally, if B.1 is not applicable, the question becomes an SRO-ONLY question.
69R H
3 N
S RESPONSE: Question stem reworded. Choice A component replaced with a SFAS Sequencer malfunction.
ES-401 Written Examination Review Worksheet Form ES-401-9 10 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 70 H
X N
U S
SRO-ONLY question; No immediate action required RESPONSE: Question tests knowledge of a condition specified in the license NOT listed in the LCOs and therefore is required knowledge of RO. Question OK as is; no changes made.
71 H
2 N
S 72 L
X N
U S
1/2X2 Choices A, B, and D not plausible - Operators do not perform calibrations or source checks.
RESPONSE: Plausible because actions are performed; just not by the operator. OK as is; no changes made.
73 L
3 N
S 1/2X2 Explain why (basis for caution) elevator should not be used.
RESPONSE: Explanation enhanced.
74 L
3 N
S 75 L
3 X
N U
E No correct answer. The BOP RO is responsible for directing these actions to be performed by the Zone 1 and 2 Operators; refer to NOTE at beginning of AOP 2508 ATTACH 4 RESPONSE: Modified stem to ask which action the BOP RO is responsible for.
UNSAT Questions = 7 (9%)
Cognitive Level Breakdown (L/H) = 51%/49%
N(ew) 63 B(ank) 8 M(odified) 4
ES-401 Written Examination Review Worksheet Form ES-401-9 11 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 76 H
3 Y
N E
1/2X2 Enhance explanation of choice D to include discussion on why seal injection header is not the likely leak location (e.g., leak down stream of flow control valve would likely be indicated by closure of MU-19).
Consider replacing Distracter B with Attachment 11 and Distracter C with Attachment 5 and remove the specific action step from each of the choices.
RESPONSE: Recommended changes were made.
77 H
3 Y
N S
78 H
3 X
Y N
E U
1/2X2 Stem Focus - What is the significance of the first bullet (CCW). If not necessary to answer question, remove it.
RESPONSE: Establishes MU pump lineup. Determined to be unnecessary to answer question; removed.
Remove section numbers from part (1) answers.
RESPONSE: Section numbers removed.
Can you assume that all attempts to isolate the spray valve have failed? How?
RESPONSE: Yes; Pressure is still going down.
Is NOP-OP-1010 really plausible?
RESPONSE: Yes; see step on page 50 of AOP Additionally, part (2) of question revised to ask for a necessary action, and responses revised to include an action to be implemented by the procedure.
POST EXAM COMMENT - Based on review of a post-exam comment, it was determined that there was no correct answer and the question was deleted from the exam. The value of the Makeup System Flow provided as normal in the stem of the question was an old value and was significantly lower than the normal value currently utilized in the plant. The normal Makeup System flowrate was changed approximately two fuel cycles ago.
ES-401 Written Examination Review Worksheet Form ES-401-9 12 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 79 H
3 X
X N
N U
Stem Focus - Two unrelated questions; added Tech Spec determination in attempt to shoe-horn K/A into SRO Only question.
RESPONSE: Agree that second part added to try to fit K/A; but disagree that questions are unrelated. They are related through operation of TSV.
Credible Distracters - What does Loss of RCPs instrument channel have to do with stated event? Choices A and C not credible; invalidates SRO Only designation.
RESPONSE: Plausible because Loss of Coolant Pumps is an input to SFRCS which trips the Main Turbine. Evaluating replace of referenced LCO (Maybe 3.3.13 instead of 3.3.11) 79R H
3 Y
N S
RESPONSE: New question written using same K/A 80 H
3 X
Y N
U Credible Distracters - Choice B not credible since question centers on battery capacity (TS 3.8.6); TS 3.8.4 would not apply without TS 3.8.6 first applying. Choice A not credible for SRO only.
RESPONSE Choice A is credible since information capacity ratings is only discussed in TS Bases and not included as part of the normal training information. Still evaluating credibility of B Instead of enter TS use apply TS or implement required actions of TS.
80R H
3 Y
N S
RESPONSE: Question rewritten to determine the OPERABILITY impact on the Electrical Power Systems.
81 H
2 X
Y N
E Recommend replacing choice A or B since both are easily rejected.
RESPONSE: Distracter B revised to specify replacement of Code Safety Valves. Also added reference to be provided to applicants.
82 H
3 X
Y N
U S
Credible Distracters -- Seems unlikely that a transfer evolution would continue with HIGH alarms on process monitors; why would choices A and B be credible.
RESPONSE: Plausible because transfer and not a release. Alarms would not be valid unless a release flow path had been established.
Since both alarms are in HIGH alarm this would indicate that an unexpected flow path had be established.
ES-401 Written Examination Review Worksheet Form ES-401-9 13 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 83 H
X Y
N U
Stem Focus - Change first sentence to read was operating with CCW Pump 1 in operation, when a Loss of Offsite Power occurs A loss of Service Water based solely on CCW Temp is a bit of a stretch.
What is the significance of 1.4.H? Does it come in before or after EDG loads the bus? If before, shouldnt there also be an alarm for Bus C1?
83R H
3 Y
N S
RESPONSE: Stem revised to state that both EDGs are supplying their respective busses before alarms come in. Answer choices change to replace Loss of Service Water Pumps AOP with Instrument Air System Malfunctions AOP which also changed the correct answer to choice C.
84 H
X Y
M U
Modified from TMI 2011 Need more information:
Is fuel bundle irradiated Time frame between alarms and reported level.
DB-OP-00030 contains conflicting guidance.
If Spent Fuel Pool level has dropped 8 ft, Im guessing that the fuel bundle in the mast is either exposed or about to be exposed.
Seems like evacuating the containment is also correct.
Additionally, the fuel bundle should have been lowered into an appropriate location by now unless there is a huge gaping hole.
RESPONSE: Evaluating change to have bundle lowered to deep end of canal (DB-OP-00030, Attachment 1 action for lowering level) 84R H
3 Y
M S
RESPONSE: Last bullet of stem was revised to state that an operator has observed water spilling from a SG manway, significantly altering the required answer. All answer choices were replaced to reflect the change made in the stem.
85 H
3 Y
N E
Change verb tense of first sentence to past tense (was).
RESPONSE: Recommended change was made.
ES-401 Written Examination Review Worksheet Form ES-401-9 14 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 86 H
2 N
Y N
U E
Not sure this meets the intent of SRO only.
Question can likely be answered based on system knowledge only.
RESPONSE: Applicant needs to also know plant status and with the given information status is changing.
Additionally, the procedure guidance to use Attach 13 is imbedded within Attach 8. Unless the RO is REQUIRED to request direction from the SRO on which section to use, this would not be an SRO only question; additional SRO guidance is not required.
Reevaluate RESPONSE: While ROs should be able to implement attachment 13 without additional SRO direction, the SRO is responsible for ensuring the correct implementation of the mitigating actions.
Deleted the last line of the stem and removed Section numbers from the answer choices.
87 H
3 Y
N S
88 H
2 Y
N S
89 L
2 N
N U
1/2X2 NOT SRO Only; Part 1 is a system knowledge question (auto actuation) and Part 2 is simply recognizing the LCO which ROs are required to know.
89R L
2 X
Y N
S U
Part (2) revised to ask what actions, if any, are needed continue the release.
POST EXAM COMMENT -- Based on review of a post-exam comment, it was determined that there was no correct answer and the question was deleted from the exam. The stem of the question was not specific enough to restrict answer responses to the ODCM, and the intended answer was incomplete.
90 H
3 N
Y N
U E
Selecting the correct answer does not require knowledge of what procedure to use; simply requires knowledge of system seismic design.
RESPONSE: Facility provided justification as to why knowledge of system design alone is insufficient to answer the question. Question requires knowledge of the procedurally approve mitigating actions.
Revised stem to ask which of the following procedurally driven actions; eliminated specific procedure reference.
ES-401 Written Examination Review Worksheet Form ES-401-9 15 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 91 H
3 Y
N S
Do the referenced valves have resilient seals? If so, choice D should include the 92 day surveillance requirement.
RESPONSE: The 92 day requirement is an additional requirement but excluding it does not invalidate the question.
92 H
3 Y
N S
1/2X2 93 H
3 Y
N S
1/2X2 94 L
2 Y
N S
95 H
2 Y
N S
Requires memorization of TS Actions for Power Distribution Limits (TS LCO 3.2.1)
RESPONSE: Will provide all TS Section 3.2.1 LCOs and APPLICABLE COLR figures.
96 L
3 Y
N S
97 H
3 Y
N S
98 H
2 Y
N S
99 H
2 Y
N S
100 H
3 Y
N S
UNSAT Questions 5(20%)/Post Exam 7(28%)
Cognitive Level Breakdown (L/H) = 12%/88%
N(ew) 24 B(ank) 0 M(odified) 1
ES-401 Written Examination Review Worksheet Form ES-401-9 16 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 Written Examination Review Worksheet Form ES-401-9 17