ML15002A225
| ML15002A225 | |
| Person / Time | |
|---|---|
| Site: | Braidwood  |
| Issue date: | 11/24/2014 |
| From: | Mcneil D NRC/RGN-III/DRS/OLB |
| To: | Exelon Generation Co |
| Shared Package | |
| ML14344A985 | List: |
| References | |
| Download: ML15002A225 (9) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2 B S 2 F 2 N S 3 H 3 B S 4 F 2 N S 5 H 2 N S 6 H 2 B S 7 H 2 B S 8 F 2 X N U The gas analyzer would not be secured. It is maintained to be able to monitor the concentrations.
RE: Question was changed, the distractors are SAT.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 F 2 N S 10 H 3 X N E The answer key states that even though SAT 142-2 is tripped.
Should this be 142-1? What causes 142-2 to trip?
RE: Changes made SAT.
11 H 2 B S 12 H 2 B S 13 H 2 N S 14 H 3 N S 15 F 2 X B U Answer B is correct in accordance with the LCO 3.4.12, a maximum of 1 CV pump shall be operable. So the statement that BOTH must not be operable is correct. Change B.
RE: Changed distractor B SAT 16 F 2 N S 17 H 2 X N E Change A to REMAIN at 40% even after IA is restored to containment.
RE: Changes SAT 18 H 2 X N E Change D to RISE and then STABLE at a new higher temperature.
RE: Changes SAT 19 H 2 N S 20 H 2 N S 21 F 2 N S 22 H 2 X B E The Stem should say: Unit 1 was at 100% power, all systems were The answer explanation final sentence does not make sense. It should be: on the Loss of Bus DC112 the 1A & 1D MSIV close on the active trains RE: Changes SAT
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 23 H 2 X B E Answer D (2) is not credible. Change the reason to remaining constant in the reference leg Answer C1 should be changed to lower than RE: Changes SAT 24 H 2 X X N U The question only addresses the (a) part of the K/A and not the (b) part. There is no indication in the question stem or answers that there is any use of procedures to correct, control, or mitigate the consequences. It would be better stated as: ___2___ CS pump(s) can be started. Answer Explanation does not match the stem. The RWST level LO-2 comes in after the SI has been reset. So, 2SI8811A should not open.
RE: Changes SAT 25 H 3 B S 26 F 1 X B US This is strictly a low level memory question.
RE: Question determined to be SAT due to percentage of wrong answers during previous use and there are Unit differences.
27 H 2 N S 28 F 2 X B E Answer C states that: the fire in the AEER implies the candidates are told not to imply and therefor the question cannot require them to imply. The stem needs to state the extent of damage to the room. If this is not done carefully, the question may become a level of difficulty 1.
RE: Changed stem and answer C. SAT 29 H 2 N S 30 F 2 B S 31 F 2 B E 32 H 2 N S 33 F 2 X B E The answer distractor statements do not match the actual answer.
Correct the distractor statements.
RE: Changed SAT 34 H 2 N S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 35 H 2 X N E Answer explanations for A and B do not match answers in question. The schematic does not specify the sequence of contact closure of contacts for a manual start requirement. Are the ROs required to know TS numbers or just entry conditions?
RE: Question is SAT as written no changes required.
36 H 2 N S 37 F 2 N S 38 F 2 N S 39 H 2 N S 40 H 4 X N E Did an SI occur and get reset and RHR pumps secured? Is this too deep in the EOPs? Answer D is not creditable, change to Re-initiate SI; increase cooldown rate; or something similar.
RE: Question changed SAT. Required knowledge from Learning Objective. Distractor D SAT as written.
41 H 3 X B E Need to add that the RCS pressure is stable or slowly lowering to provide adequate information that this is a SBLOCA.
RE: Changed SAT 42 H 2 N S 43 F 3 N S 44 H 2 B S 45 H 2 N S 46 F 2 B S 47 F 2 B S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 H 2 B S 49 F 2 M S 50 F 2 B S 51 H 2 X X B US The annunciator alarm procedures only discuss a potential reactor trip. The stem asks What are the immediate actions? Rewrite the question. There is no correct answer. This is system level knowledge.
RE: Question SAT as written after more procedure review.
52 H 2 N S 53 F 2 X B U There is not enough information provided in the stem to answer the question. The reference sited only indicates that the RHR system is to be considered most likely. It does not differentiate between suction and discharge piping. This question is too vague. Do not use Most Likely.
RE: Question replaced, replacement question SAT.
54 F 2 N S 55 F 2 B S 56 F 2 X N E Need to add information about voltage drop greater than 0.7 seconds to the stem to ensure that the answer is correct.
RE: Changed to 2.0 seconds, SAT.
57 H 2 B S 58 F 2 B S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 F 2 X X N US The reference gives the answer, this is a direct look-up. Since this is an immediate action, remove the reference page and it is an acceptable question.
RE: After review this question requires more knowledge to answer that is in the reference. Question stem changed SAT.
60 H 2 B S 61 H 2 B S 62 F 2 X N E Answer B; is not creditable. There is no information related to the SFP bridge is in the question except for this answer.
RE: Distractor changed SAT.
63 H 2 X X N U All answers state maximize AFW flow, the procedure states maintain feedwater flow greater than 500 gpm. Stem does not state the subsequent SG pressure. The candidate does not know if it is less than 90 psig. This knowledge is required to answer the question.
RE: Question modified to address issues SAT.
64 H 2 B S 65 F 2 B S 66 F 2 B S 67 F 2 B S 68 F 2 N S 69 H 2 X B ES Change answer A to Immediately stop RCS dilution. This fits better with the stem and while it may be required by procedure, it is not required by TS.
RE: question SAT as written.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 70 F 2 M S 71 H 2 B S 72 F 2 X N E Change answer D to placed in manual to allow for controlled radioactive release to the atmosphere. Change answer A to in AUTOI so the ruptured S/G PORV is available to prevent challenging the S/G integrity.
RE: Distractor D changed SAT to allow controlled radioactive release to the environment.
73 F 2 X B E Change answer A to ANY time during the procedure performance, AND it MAY apply after a transition is made to another procedure.
RE: Changed SAT.
74 F 2 N E Why is the answer 14 minutes instead of 15 minutes?
RE: Answer changed so question is SAT.
75 F 1 X B U The question is basic knowledge and does not even require memory level knowledge. This was on the 2011 exam.
RE: Question replaced, new question SAT.
76 H 2 B S 77 H 2 X N E Are SROs required to have knowledge of procedural step sequence of steps in an EOP after the immediate actions? This question is confusing, in order usually means all 4 are used.
RE: Knowledge is required by learning objective. Question reworded, SAT.
78 H 3 N S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 79 F 2 X B U Answer C and D can be eliminated with RO knowledge of systems operation for PZR heaters. Answer A can be eliminated with RO knowledge of TS. The above the line portion of 3.4.1 does not mention subcooling, only DNB design criteria. Therefore, the basis is not required knowledge to answer the question.
RE: Question replaced, replacement SAT.
80 H 2 B S 81 H 2 X N E Answer B is RO only knowledge and can be easily eliminated.
Rewrite answer B to add as SRO portion.
RE: After discussions with licensee, distractor B SAT.
82 F 2 X B U Are SROs expected to memorize RNOs for procedure steps this far into a procedure? The question and answer do not make sense.
The Answer Explanation is not totally correct. The 300 ppm is based on damage to the fuel racks, which is not stated in the stem. The racks themselves will provide the < 0.95 Keff.
RE: Question reworded SAT.
83 H 2 X M E Are SROs expected to memorize RNOs for procedure steps this far into a procedure?
RE: Question SAT based on learning objective.
84 H 2 N S 85 F 2 N S 86 H 2 B S 87 F 2 X N E Are SROs expected to memorize RNOs for procedure steps this far into a procedure?
RE: Question SAT based on learning objective.
88 H 2 B S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 89 H 2 X N E The Answer Explanation states that the PZR pressure must be maintained below 2235#. Is this supposed to be 2335#? Are SROs expected to memorize RNOs for procedure steps this far into a procedure?
RE: Number changed, SAT.
90 F 2 N S 91 F 2 N S 92 F 2 N S 93 H 2 B S 94 F 2 N S 95 H 2 N S 96 F 2 N S 97 F 2 X B U The question only requires the candidate to calculate the release rate. There is no requirement for EAL consideration. Use of procedures and calculations are RO level knowledge.
RE: Question replaced, replacement SAT.
98 H 2 X N E Change answer C to .. AND transition to 1BwCA-3.2, SGTR with Loss of Reactor Coolant - Saturated Recovery Desired. CS-2.1 distractor is not plausible.
RE: Distractor changed SAT.
99 H 2 B S 100 H 2 B S