ML17164A161
| ML17164A161 | |
| Person / Time | |
|---|---|
| Site: | Perry  |
| Issue date: | 02/03/2017 |
| From: | David Reeser NRC/RGN-III/DRS/OLB |
| To: | FirstEnergy Nuclear Operating Co |
| Shared Package | |
| ML16242A243 | List: |
| References | |
| Download: ML17164A161 (18) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 2017 Perry Initial Licensed Operator Examination
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only This in NLO level knowledge. Additionally, if dispatching an operator, I would simply tell the operator to check 1 F 1 N U NCC surge tank level, without specifying a location.
RESPONSE: Question will be replaced.
NRC: K/A reselected. Changed from New to Bank 1R F 2 B S Revised question is acceptable..
2 F 2 B S Stem should specifically state that only the I&C Tech and SRO were involved in the discussion; otherwise there may be multiple correct answers.
3 F 2 X X N E RESPONSE: Stem revised to state that the I&C Tech and SRO were the only personnel involved in the discussion of expected alarms.
NRC: Comment incorporated.
Typo in answer explanation. Should be GREEN light extinguishes.
4 F 2 N E Typo corrected.
NRC: Comment incorporated; explanation is missing parenthesis at the end of the corrected portion though).
2007 NRC Exam Instead of Who is the individual ask What is the title of the position 5 F 2 B E RESPONSE: Recommended change was made.
NRC: Comment incorporated Perry 2015 NRC Exam Q#RO-6 6 F 2 B S 2007 NRC Exam 7 H 3 B S Combine 2nd and 3rd sentences into one statement (delete when should venting be performed?)
8 F 2 N E RESPONSE: Recommended changes were made.
NRC: Comment incorporated
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only 1/2X2 9 F 3 B S Columbia 2009 RO Q#74 Reword last sentence in stem to eliminate confusion with the phrase pressure control.
10 H 3 N E RESPONSE: Sentence revised to ask how much time will pass before the SRVs operate.
NRC: Comment incorporated Even though the ROs should be able to answer this question from memory, it is not required by the stated objective. The objective states: Determine the Required Actions for each Power Distribution Limits LCO when given a copy of Technical Specifications and a description of plant conditions/sequence of events.
11 H 2 X X N U Additionally the question does not match the K/A since the Jet Pump failure has no immediate bearing on the ability to answer the question.
RESPONSE: Question will be revised/replaced.
Possible solution to ask a question related to how flow reduction affects MCPR safety limit.
NRC: comment incorporated; revised question is 11R F 2 N S satisfactory.
Question LOK changed from higher to fundamental.
Limerick 2012 Q#2 One minute seems to be too short a time interval.
Original question had a 5 minute time interval. Evaluate appropriateness of shortened interval.
Time interval reduced to 2 minutes.
12 H 2 X M E NRC: comment incorporated.
Change distracters A and B to state: RPV level will be controlled RESPONSE: Recommended change was made.
NRC: comment incorporated.
Nine Mile 2 2012 Exam Q#75 13 F 3 B S
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Perry 2009 NRC Exam Q#15; Perry 2007 NRC Exam Q#51 Need to add that except for placing the Reactor Mode Switch in SHUTDOWN, no other operator actions have been taken or some similar statement. Without the statement the examinee could assume that the post 14 H 3 B E scram actions are being implemented and therefore the speed control would be in manual and lowered.
RESPONSE: added the phrase no other operator actions were performed.
NRC: comment incorporated.
15 H 2 N S Question does not address K/A which tests the reason for the main turbine trip upon MCR evacuation.
16 F 2 X N U RESPONSE: Facility does not have a well-defined basis for tripping the Main Turbine.
NRC: revised question still does not test the reason for tripping the main turbine. The reason/basis is listed in 16R1 F 2 X X U conjunction with the answer to trip the turbine, but there is only one answer choice that involves tripping the turbine at all.
Facility reselected K/A and submitted Bank question 16R2 H 3 B S Perry 2013 # RO-16 Question LOK changed from F to H Perry 2001 NRC (Retake) Exam RO Q#20 Update pedigree to reflect that question was from the retake exam.
17 F 3 B S RESPONSE: Updated.
NRC: comment incorporated.
Perry 2010 NRC Exam RO Q#17 Reword distracter A to: close to completely isolate the Service Air header from the Instrument Air header.
18 F 3 X B E RESPONE: Recommended change was made.
NRC: comment incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Clinton 2013 NRC Exam RO Q#12 Reword NOTE to specify valve ID as opposed to Functional Location.
RESPONSE: Functional Location is the term FENOC uses for component ID. No change was made.
19 H 2 B E NRC: comment NOT incorporated.
Add: and RHR Pump B trips to distracters A and B RESPONSE: Phrase added and answer choices were re-ordered.
NRC: comment incorporated.
Nine Mile 2013 Exam RO Q#10 20 H 3 M S 21 H 2 N S Peach Bottom 2013 NRC Exam RO Q#13 22 H 3 B S 23 H 2 N S INL-0778 24 F 3 B S Perry 2010 NRC Exam RO Q#25 25 H 3 B S 26 F 2 N S River Bend 2004 NRC Exam SRO Q#77 Update pedigree to reflect correct River Bend exam and 27 H 4 M S question. Pedigree updated.
NRC: comment incorporated.
RQL-41692 28 F 3 B S Perry 2015 NRC Exam Q#74 29 F 2 M S
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Does not meet the intent of the K/A. K/A is Knowledge of the reasons for Actions contained in abnormal operating procedure for voltage and grid disturbances.
Automatic actions are listed in the ONI, but these are 30 F 3 X N U design features and not operator actions taken in response to the abnormal grid condition.
RESPONSE: Question to be revised.
NRC: Question is still not testing the basis for actions contained in the ONI. The additional knowledge incorporated into the revised question is associated with a diesel system precaution in the SOI.
30R1 F 3 X N U Additionally, the distractor analysis has not been revised to reflect the new question.
(Facility to submit revised question.)
NRC: revised question is acceptable.
30R2 F 3 N S Grand Gulf 2014 NRC Exam RO Q#12 To better match up with the K/A, Revise question to ask:
result in a degradation of the main condenser vacuum?
RESPONSE: Recommended change was made.
31 H 3 X B E NRC: comment incorporated.
Typo in Question Source; should be RO-21 instead of RO-12. Typo corrected.
NRC: comment incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only What information is provided to differentiate between a HI or LO Drywell pressure? Without any trend information on DW pressure, or a time reference, all answers could be assumed to be correct (if DW pressure is high and rising).
RESPONSE: Running the Combustible Gas Mixing compressors will cause DW pressure to rise even with the Backup DW Purge valves open. The test procedure 32 F 3 X N U directs the operator to shutdown the compressors after a pre-determined time interval or when the DW Press HI/LO alarm (1.5 psig) is received. Upon receipt of the DW Press HI/LO alarm the operator would be expected to shutdown the compressor. Therefore trend information is unnecessary to answer the question.
The last sentence (question) was revised to ask what automatic actions should have occurred when the alarms were received.
NRC: revised version is satisfactory.
32R F 3 N S The question asks How would you monitor ?
Difference between answer choices is rather trivial with the only difference being that the P602 meters will not display average pool temperature; using the recorder would be easier, but average temperature could be calculated from the meter indications.
33 F 3 X N E RESPONSE: Choices B and C are clearly wrong since the P601 meters do not display average temperature and the indication is manually selected.
NRC: revised version is satisfactory.
Perry 2007 NRC Exam Q#RO34 34 H 3 B S 35 H 3 N S Perry 2003 NRC Exam Q#RO29 Reword first sentence to state that a transient has resulted in entry to, and implementation of, EOP-2.
36 H 3 X B E RESPONSE: Stem reword to state that EOP 2 has been entered.
NRC: comment incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Perry 2009 NRC Exam Q#RO69 Answer explanation appears to be a miss-application of a licensed commitment. The commitment is to have H2 Igniters energized within 30 minutes of RPV level dropping below TAF, with the understanding that significant H2 will not be generated within that time frame. The question gives a situation where significant 37 H 3 B E H2 has already been generated, but is still below the HDOL. See exam markup for recommended change.
RESPONSE: Recommended changes were made, except that D was changed further to remove potential for two correct answers.
NRC: comment incorporated,.
Rearrange stem conditions to more accurately reflect the sequence of events. See exam mark-up for recommended changes.
38 H 3 X N E RESPONSE: Changes were made as recommended.
NRC: comment incorporated.
39 H 3 N S Perry 2009 NRC Exam Q#RO41 40 H 3 B S Perry 2009 NRC Exam Q#43 Recommend replacing the injection check valve with the injection valve. The probability of the check valve failing is very low.
41 F 3 M E Delete the words be able to from part (1).
RESPONSE: Recommended changes were made.
NRC: comments incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Delete the first sentence; its window dressing.
Answer choice D is not very plausible considering the reason for using Squib valves. Recommend replacing with the Equipment Drain Sump.
42 F 2 X N E RESPONSE: First sentence deleted and D changed to Floor Drain Sump.
NRC: comments incorporated.
INL-235083 43 F 2 B S Reword distracters to remove confusion on the use of the word Trip 44 H 3 N E
RESPONSE
NRC: comments incorporated.
Rearrange stem and responses to simplify question.
See exam markup for recommended changes.
45 H 3 N E RESPONSE: Changed as recommended.
NRC: comment incorporated.
Fermi 2013 NRC Exam Q#RO38; I would classify this question as a modified bank question [significant change to initial conditions.
Delete the word insertion/. There are no neutron 46 F 2 X M E monitor generated insert blocks only insert inhibits generated by RC&IS.
RESPONSE: Recommended changes were made.
NRC: comments incorporated.
Perry 2009 NRC Exam Q#RO50 Distracter A doesnt match up with the K/A.
Recommend changing Enter to Implement or 47 H 3 B E Perform Immediate Actions of RESPONSE: Changed to Perform Immediate Actions NRC: comments incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Perry 2010 NRC Exam Q#RO48 Question seems incomplete. Question specifies a flow card failure with no indication of how the card fails. If the card falls low (0% flow) the trip set-point would be 61%.
If the card fails high the trip set-point would be clamped at 111%. With RR pumps just being shifted to high speed the Rx Power would be approx. 35% not anywhere near either set-point. Therefore the cause of 48 H 3 X X M U the alarm must be unrelated to the flow card failure.
Additionally the question does not test the K/A which may no longer be applicable since RR Flow Control is not operated in automatic mode. The K/A is related the impact on the RR system of an APRM failure. Not the impact on the APRM system of a RR failure.
RESPONSE: Will revise/replace question, possibly related to flow runback on APRM A failure.
NRC: 2010 NRC Exam. Revised version is satisfactory.
48R H 3 B S Question has been changed from modified bank to bank.
INL-0863 49 H 3 B S Perry 2015 NRC Exam Q#RO49 Remove 1st sentence (window dressing). Question can be answered without it.
50 H 3 X M E RESPONSE: Removed 1st sentence.
NRC: comments incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only K/A match is a stretch; examinee does not demonstrate an ability to monitor RPV level.
RESPONSE: (Facility) If the operator does not manually operate switches, he will not control RPV level.
(NRC) The intent of the K/A is the ability to monitor RPV water level, and based on those observations be able to operate the system (ADS).
The second action to place the ADS INHIBIT switch in INHIBIT is not required unless the first step does not work; as written there is no correct answer.
51 F 2 X X N U RESPONSE: (Facility) Could change to Depress and release.
(NRC) While that change may make the choice clearly wrong it would not address the concern that logically inhibiting ADS is only required if reset does not work.
Recommend including RPV level instrument (both narrow and wide range) traces showing downward spikes returning to normal (probable cause a momentary electrical power loss).
RESPONSE: Evaluating possible changes.
NRC: revised question is acceptable.
51R F 2 S More fully explain why MCV-646 is unnecessary for penetration isolation.
52 H 2 N S Required action completion time for MCV-646 is 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> not 1 hr Perry 2013 NRC Exam Q#RO13 [Original Question 53 H 3 M S could have been used unless too many bank questions from last two exams.]
Marginal tie to K/A; stated failure is not in level control system.
54 H 3 N S RESPONSE: Instruments are part of the level control system.
1st part of question is immaterial since only one choice (D) contains the correct answer to the second part. See markup for proposed change 55 F 3 N E RESPONSE: Recommended change was made.
NRC: comment incorporated.
56 F 3 N S
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Perry 2015 NRC Exam Q#RO27 Revise answer choices to include all Div 1 and 2 ECCS Pumps 57 F 2 M E RESPONSE: Recommended changes made.
NRC: comments incorporated.
Delete 2nd sentence (question) and reword question statements.
E RESPONSE: Recommended changes made.
NRC: comment incorporated.
58 F 3 X N Question 58 was deleted from the exam based on post-U exam comment review which determined that stem of the question was written with insufficient information to elicit a specific answer choice and thus there was no correct answer for the question.
River Bend 2003 NRC Exam Q#RO-65 Question does not appear to be operationally valid, With the indications provided the DC Bus load is approximately 850 Amps (450 from the battery and 400 from the charger. This seems excessively high even in and accident condition. Per the SDM, the battery charger has enough power output capacity for the 59 H 3 X X B U steady state operation of connected loads required during normal or emergency operation (whichever is larger), while maintaining the associated battery in a fully charged state.
RESPONSE: Reduced battery amps from 450 to 50 amps.
NRC: Comment incorporated. Distractor analysis has NOT been updated to match the revised question.
Distractor analysis was fixed 59R H 3 M S Wording of the stem is redundant. See markup for proposed change.
60 H 3 X N E Recommended changes were made.
NRC: comment incorporated.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Perry 2009 NRC Exam Q#RO-62 I dont see the plausibility of the first part of distracters C and D. What is the link between the failure of the refrigeration and desiccant infiltration?
61 H 2 X B E RESPONSE: Plausible if applicants dont recall that there are after filters to prevent desiccant infiltration.
Stem statements are redundant.
NRC: comment incorporated.
62 H 2 N S 63 H 2 N S Quad Cities 2009 NRC Exam Q#RO-91 Underline the word required 64 H 3 M S RESPONSE: Requested change was made.
NRC: comment incorporated.
Clinton 2009 NRC Exam Q#RO-56 65 H 2 B S Perry 2002 NRC Exam Q#RO-78 Recommend revising choices A and D to include status of the other pump.
66 H 3 M S RESPONSE: Recommended change was made.
NRC: comment incorporated.
67 H 3 N S 68 F 2 N S Perry 2010 NRC Exam Q#RO-19 Since the most correct answer includes 4 persons (everyone except the fuel handling team), the choices 69 F 3 B E should probably all include 4 persons.
RESPONSE: Changes made to address concern.
NRC: revised question satisfactory
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Hatch 2013 NRC Exam Q#RO-26 70 F 2 M S Limerick 2012 NRC Exam Q#RO-61 71 H 3 B S Why are choices B and D credible since DFWCS will already be in !E control RESPONSE: Plausible is operator recalls shift from 3E 72 H 3 X N E to 1E is performed at 15% on a power decrease.
Changed from startup scenario to shutdown scenario.
NRC: revised question satisfactory.
Perry 2007 NRC Exam Q#RO-25 73 H 3 M S 74 H 3 N S 75 F 3 N S UNSAT 9 N/B/M 34/27/14 (45.3/36/18.7)
F/H 32/43 (42.7/57.3) 76 F 2 B S (1) 77 F 2 M S (2)
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only Per ES-401 D.2.a Tier 3 questions must focus on plant wide generic knowledge (versus specific system 78 H 3 X N U knowledge).
(3)
RESPONSE: Question will be replaced.
NRC: Question changed from New to Bank. Monticello 2016 Exam #86. The original question was formatted using military time; this version uses a 12-hour clock but does not specify AM or PM. Either use military time or specify AM or PM. Also, the question says that the 3.0 section of TS is to be given as a reference. The original bank version of this question only gave SR 3.0.1 -
78R1 H 2 X B U 3.0.4. Providing the entire 3.0 section of TS appears excessive and would require analyzing the rest of the exam to ensure that the reference information contained therein did not affect any other questions. Additionally, capitalize the word not in the Stem for emphasis.
Question revised to include military time; provide only TS Sections SR 3.0.1 through 3.0.4; and emphasized 78R2 H 2 B S the word not by underlining. Question is acceptable with these changes.
Include noun name of 1G33-F107 in distractor D.
NRC: comment incorporated.
79 F 4 ?? N E (4) RESPONSE: Added noun name and reordered answer choices.
Screening vs Evaluation? Evaluation.
Answer is a direct lookup from the provided references.
Explain why this isnt a direct lookup.
80 RESPONSE: The applicant needs to select the correct H 1 N E (5) response. Will also supply entire ODCM instead only the applicable section.
NRC: revised question acceptable.
81 2010 NRC Exam.
H 3 B S (6)
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only 2009 NRC Exam. Stem must specify plant condition; PAP-1910 Att. 3 section 1.C contains a possible plant condition where no answer would be correct.
82 Explain why an 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> tour is not the correct answer.
H 2 X B E (7)
RESPONSE: Added plant in at rated power. This change ensures an 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> tour is not applicable.
NRC: revised question acceptable.
83 H 4 N S (8)
All distractors contain 4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> notification; eliminating this one item yields the correct answer.
84 H 3 X N U (9) RESPONSE: Changed choice D to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.
Comment incorporated. Revised question satisfactory.
84R H 3 N S 85 2010 NRC Exam.
H 3 B S (10)
Perry 2013 NRC Exam. This question is not testing the DW pressure to SP level relationship of the K/A; on the 2013 exam this question was associated with a different K/A (associated with SP level to RPV pressure relationship).
86 I can eliminate the first two sentences of the stem and F 2 X X B U (11) answer the question.
May not be operationally valid in that the TS Limits are applicable to normal operation/pre-accident conditions.
RESPONSE: Question will be revised to relate how change in DW Pressure affects indicated level.
NRC: revised question acceptable. Question changed 86R H 3 M S from bank to modified bank. LOK changed from F to H.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only 2010 NRC Exam Distracters C and D may not be plausible since Supp Pool Cooling should already be in operation 87 (prerequisite for test).
H 1 X B S (12)
Pool Cooling is not a prerequisite for the test.
NRC: question acceptable as is. LOD reevaluated as 2 and distractors determined to be credible.
88 H 2 N S (13) 89 H 3 N S (14)
Distractor D is not plausible; the plant parameters given indicate 80% reactor power. Why would the applicant believe that a reactor scram has occurred?
90 H 2 X N S RESPONSE: Given that RPV level is 210 and rising, (15) applicant may incorrectly interpret the condition as a SCRAM in imminent.
NRC: question acceptable as is.
91 H 3 B S (16) 92 H 3 N S (17)
Perry 2015 NRC Exam. 2x2.
Answering the 2nd part of the question requires memorization of specific procedure/checklist content (whether or not a specific supplemental action is 93 H 5 X X B U contained within the ARI; and/or whether or not the (18) correct position for the heater disconnect is contained specifically in ELI-R24) at a level which is not required to be memorized.
RESPONSE: TBD NRC: K/A Reselected. Question changed from Bank to 93R H 3 N S New. Revised question is acceptable.
94 H 3 N S (19)
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only 2x2. First part of the answer is RO knowledge. Second half of answer is TS bases knowledge, however it is not required to analyze TS required actions and terminology 95 as part of determining the answer to this question.
F 2 ?? ?? N U (20)
RESPONSE: TBD Question replaced and changed from LOK of F to H.
95R H N S Distractor analysis contains typo (cause is spelled case incorrectly). Revised question is acceptable.
2010 NRC Exam. 2x2. First part of the answer is RO knowledge.
Switch position of last two bulleted items.
Recommend changing 2nd part of distracter D to NOTIFY TSC to enter Severe Accident Management Guidance RESPONSE: Notifying TSC would not be a panel operator action. Changed to Initiate Containment Spray 96 H 3 B E (21)
NRC: distractor analysis has NOT been updated to reflect the revised question. Revised question itself is acceptable however.
Shouldnt EOPs be provided?
RESPONSE: Facility considers responses to be high level actions, that the applicant is expected to have knowledge of these actions and when they are applicable.
NRC: response accepted.
97 In the stem, place commas around the words if any.
F 3 N E Done (22)
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q LOK LOD Source Status 8. Explanation (F/H) (1-5) Stem Cred. Job- #/ Back Q- SRO (B/M/N) (U/E/S)
Cues T/F Partial Minutia Focus Dist Link Units ward K/A Only 2x2. First part of the answer is RO knowledge.
Distractor B could be a second correct answer if applicant makes an assumption that the FCV has failed open due to a controller issue; this is not contradicted by 98 the stem.
H 2 X N U (23)
RESPONSE: Question revised to have FCV fail closed due to loss of air.
Revised question is acceptable.
98R H 2 N S 99 F 2 N S (24) 100 H 3 N S (25)
UNSAT 4 N/B/M 15/9/1 (60/36/4)
F/H 7/18 (28/82)
Instructions (Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question a 1(easy) to 5 ( difficult); (questions with a difficulty between 2 and 4 are acceptable)
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- # / Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable)
- 6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any "U" Status ratings (e.g., how the Appendix B psychometric attributes are not being met).