ML14057A726
| ML14057A726 | |
| Person / Time | |
|---|---|
| Site: | Vermont Yankee File:NorthStar Vermont Yankee icon.png |
| Issue date: | 02/14/2014 |
| From: | Mcneil D Operations Branch III |
| To: | Stewart B Entergy Nuclear Vermont Yankee |
| Jackson D | |
| Shared Package | |
| ML13204A095 | List: |
| References | |
| TAC U01897 | |
| Download: ML14057A726 (9) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
- questions reviewed in depth. *Qs marked U that were used on previous NRC examinations were not counted against the 20% criteria since they were previously sat Qs.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Replace result in with ensure. RO Question? Replaced.
1 H 3 Y N E Verified RO Question Distractors (a.) and (b.) are not plausible. Not a higher skill 2 H 1 Y N U question. LOD = 1. Replaced with acceptable question.
In the stem: change is to was; put rest of stem (bullets) in past tense. Delete fourth bullet. Change distracter C to be the opposite 3 H 2 Y B E of distracter A. Change distracter D to neither pump will auto start and one or both pumps must be manually started Made changes 4 F 2 B S 2002 Pilgrim Verify that Vital AC is same as 120/240 VAC UPS (Instrument 5 F 3 Y N S Power) Higher skill question. Verified.
2004 Columbia. LOD = 1.0 What is the loss or malfunction 6 H 1.0 N B *S (U) associated with the PCIS/NSSS? Replaced with acceptable question.
H 3 Y B E Remove double space in bullet 3 (turbine stopped). Un-capitalize 7
System in distractors (c.) and (d.). Made changes.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A, and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only All applicants are incumbent operators and should know that all APRM Channels have full coverage. Question should require applicants to choose from four choices which describe how detectors are sampled; e.g.
a) Each channel monitors the detectors in a separate horizontal plane and due to control rod symmetry is representative of average core power 8 F 2 Y N E b) Each channel monitors the detectors in a separate vertical sector and due to control rod symmetry is representative of average core power c) Each channel monitors a group of detectors chosen in an orderly pattern across the core and includes detectors in each detector plane d) Each channel monitors a group of detectors chosen at in an orderly pattern within separate vertical sectors.
Licensee accepted and used this suggested fix.
Simply stating that noise levels in the plant are normal does not rule out the possibility of an air leak. Normal noise levels in some areas could easily mask an air leak.
The actions specified in distracters A and D are subsequent actions that are not required to be memorized.
9 H 4 X X Y N S U A better fit for the K/A might be to identify adverse consequence of operating the IA system with the Air Dryers bypassed.
Refer to question 53. Evaluate whether either question gives clues to the other. Reworked distractor (c.). Remainder of the question is satisfactory. Q53 doesnt provide clues for this Q. Changed to S.
2011 Pilgrim Cognitive level should be Comp/Analysis since you have to evaluate how the loss of air affects the level indication then 10 F 2.5 Y B S how that failure affects other system components. Changed to higher cognitive skill.
11 H 3 Y B S 2010 Duane Arnold 12 H 2 Y B S Distracter A is not plausible. Dont know of any SRV that will not operate in the safety mode. Replace if possible. Replaced the distractor.
Distractor (b.) is implausible. In the stem you state that KW = 0. The generator should not trip on overload under these conditions. Find a 13 H 2 Y N E new distractor. Licensee provided information that makes distractor (b.) plausible. Kept the distractor.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Reword stem to eliminate first part of distracters; e.g., To prevent thermal stratification, under these conditions:
- a. Flow must be increased and maintained GTE 6700 GPM
- b. Reactor Temperature must be reduced and maintained 14# H 2 Y B E LTE 140°
- c. Flow must be maintained GTE 4100 GPM
- d. Reactor water level must be maintained GTE 190 inches.
Replaced with suggested question (post exam comment: 100%
miss rate on this question.)
Distractors (c.) and (d.) are implausible. This goes against the basic idea of one train will provide safe shut down conditions for the plant.
Taking one train out of service should not result in a failure to establish adequate core cooling. The reference document states that pump flow must be increased to at least 4100 GPM after 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> of 15 H 2 X Y N U operation with flow less than 4100 GPM. Following an ECCS actuation, no manual operator action to increase flow above 4100 GPM is permitted for the first hour, and then only if the pump is not needed to maintain adequate core cooling. Please resolve while fixing this question. Reworked question. Changes were acceptable.
Question relates to the 2nd part of the K/A, but not the 1st part. Can 16# H 2 N B E we fix to address both parts? Reworked Q to add 1st part of the K/A.
Recommend replacing PCPL-A violation with breach of the primary containment or challenge to primary containment integrity Remove 17 H 1 Y N E automatic Automatic from the stem. I would immediately select the lowest level, knowing if it is a higher level, the lower one will be right This is a subset issue. Reworked Q to eliminate subset.
18 H 2 Y B S 2007 Monticello 19# H 2 Y B S 2011 Susqhuehanna Matching LOWER than assumed power level to a MINIMUM SRM count rate makes Distracters B and D non-credible. Additionally, shouldnt the question source be MODIFIED? Licensee provided 20 F 2 X X Y B E U system information that shows distractors (b.) and (d.) are credible at Vermont Yankee. Accepted added information, left Q as is. Changed to E.
21 H 2 Y B S 2007 Duane Arnold The generic K/A should be linked to the system (PCIS/NSSS). There 22# F 2 N N U is no HIGH RPV water level input to the isolation logic for the MSIVs.
Q was replaced/revalidated with a new Q.
Put The SLC SYS 1 is in the stem and remove it from each 23 H 2 Y N E distractor. Done.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only The difference between choices C and D is trivial. The key knowledge being tested is that DC-3A can be supplied by DC-1, and 24 F 2 X Y N E that there is a design feature that prevents parallel operation of the two supplies. Replace distractor (c.). Replaced distractor (c.).
25# H 2 Y B E Add or why not? to the question stem. Added.
2009 Vermont Yankee Reformat the question with numbers in the 26 H 2 Y B E blanks and in front of the answers. Reformatted.
27 F 2 Y B S 2011 Columbia K/A is for the Condensate System but focus is on Feedwater System.
28# F 2 N B U Changed K/A to one that maintained outline, retained Q.
Need a better explanation of why distracters B and C are plausible.
What is the plausible tie between RMCS Select Matrix and 29 F 2.5 X Y N S U upscale/downscale trips? Licensee provided additional information that shows distractors (b.) and (c.) are plausible.
Retained Q as is. Changed to S from U.
2010 Grand Gulf 30 F 2 Y N E This question does not look anything like the Grand Gulf Question. It should be new, not modified. Add degree symbol - second bullet.
Made requested changes.
Subsequent actions of normal procedures are not required to be memorized. May reword question to: Which one of the following 31# F 2 Y N E describes actions that are appropriate for the given conditions?
Made requested changes.
32 F 2 M S 2004 River Bend Moving control rods from the MCR is not operating the FUEL HANDLING EQUIPMENT controls required by the K/A. Question as 33 H 2 N N U posed is a fundamental question. Q was good, therefore, replaced K/A with an appropriate K/A that maintained the outline.
Retained the question.
Verify that pump runout will not occur to verify the correct answer.
34# H 2 X Y N U Once the RPV depressurizes the pumps may be trying to pump twice their normal flow rate and enter runout conditions. Replaced Q.
35 H 2 Y N S 36 F 3 ? B S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Add on A in distractor (a.).
Recommend the following to increase LOD:
Remove the failure mode from the stem of the question and add pump discharge pressure to the bulleted list. Change the question to determine the status of each subsystem; e.g.,
37# H 2 Y N E Which of the following actions is necessary to maximize injection to the RPV from the Core Spray system?
- a. Close or isolate CS-5A
- b. Close or isolate CS-5B
- c. Throttle both CS-12A and CS-12B to full open
- d. Throttle CS-12B only to full open Replaced Q with suggested Q.
2007 Hope Creek 38 H 2 Y B E Remove reason for the scram; it is immaterial to the question.
Removed extra material.
2007 Peach Bottom 39 H 2 Y B E Add a bullet stating RPV water level that is high enough to preclude Recirc Pumps in operation. (See Question 14) Unnecessary change. Q retained as is.
Change correct affect to correct effect in the stem. The question is very specific to Standby Gas, and if the associated breaker also 40# H 2.5 Y B E disables the fan, its immaterial what position the dampers are in.
Verify validity of question. Made correction. Q is valid as is.
2007 Duane Arnold Recommend removing the temperature value and simply state that 41 H 2 Y B E Torus temperature is rising due to a leaking SRV.
Replace capability with inability OR Reword the answer choices to state adequate/complete. Made suggested changes.
Spell out approximately in the 2nd bullet of the stem. Change last bullet to SLC A was started at 1230 hours0.0142 days <br />0.342 hours <br />0.00203 weeks <br />4.68015e-4 months <br />. Unless the values are included in OP4114, the applicant is expected to have memorized the SLC Pump flow rate and percent change in storage tank level to 42 H 2.5 B E U achieve cold shutdown Boron weight. NRC does not require these values to be memorized. Licensee made slight modifications to the Q, but maintained they require operators to know cold shutdown boron weight from memory.
The KA is related to effects that a high pressure transient will have on RPV level and not calibration condition; e,g., what happens to 43# H 2 N B U indicated level if pressure increases due an MSIV or TCV closure; or how is RPV injection affected by pressure transient. Also, see Question # 011. They test the same item, replace one. Replaced Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2010 Nine Mile Point 2 LOD = 1. Not a higher skill question.
Interpretation is required - higher skill. Licensee provided 44 F 1 Y B *S U information showing this is a problem issue at the station, i.e. (LOD=2) Retained Q 2010 Monticello. LOD = 1. Licensee provided information 45 F 1 Y B *S U showing this is a problem issue at the station, i.e. (LOD=2).
Retained Q.
Suggest changing answer choice A to Containment which may 46# F 2 Y B E fail Made suggested change.
Question asks how the Turbine is tripped and not WHY as specified 47 F 2 N N U by the K/A. Replaced Q.
In accordance with OPON-3147-01 implies memorization of procedure steps. Show how this is required to be memorized or 48 F 2 Y N E U derived based on required knowledge. Removed portions of the procedure, retained Q. Changed to E.
What is the point of the question? Does the operator really care what water level is doing during blowdown? He is more interested in level during recovery after injection is initiated.
49# H 2 X X Y B E U The second part of the question does not seem to be supported by the reference provided. Licensee provided information indicating they expected operators to know what water level instruments to use. Reworked part of the Q. Changed to E.
Since indications are dependent on the failure mode, suggest stating 50 H 3 Y B E how the jet pump failed (e.g., displaced mixer) Added info.
The focus of the question is on Torus water level and not temperature. Based on Torus water level you dont need to know 51 F 2 N B U Torus water temperature (level has reached the trigger point and all attempts to restore level have failed). Replaced, revalidated Q.
Question does not determine or interpret reactor water level 52# F 2 N B E U associated with a turbine trip. Q doesn't match K/A. Good Q, replace K/A, retained Q. Changed to E.
53 F 2 Y B S Cognitive level could be increased by asking. Including impact to 54 F 2 Y B E EDG B (will it keep running?} No change.
Applicants are not required to memorize step sequences. Show why applicants would know this information from memory, OR, revise last stem statement to state: Main Control Room personnel were unable 55# F 2 Y N U to place the Shutdown Iodine Filter in service then include for choices of action with the correct choice being to place the filter in service locally. Replaced, revalidated Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 56 F 2 Y B S 57 F 2 Y B S Question is related to recall of automatic actions and does not test 58# H 2 N B U the ability to prioritize or interpret significance. Reworked, revalidated Q.
59 F 2 Y B S Verify the steps to restore ventilation are temperature related and not 60 F 2.5 N B S U just required after any isolation. Licensee provided information to verify the steps. Changed to S.
Question tests knowledge entry conditions and/or triggers for action 61# F 2 N B U and not the reason initiating suppression pool cooling. Replaced, revalidated Q.
62 F 2 Y B S 63 F 2 Y B S 295012 is related to HIGH DRYWELL PRESSURE. Question focus is on Radiation Release.
64# H 2 X X N B U What is meant by outdated entry condition. Seems to me that ON 3152 is still required to be entered. Selection of procedures is an SRO task. Selected correct K/A, moved to SRO exam portion (Q80).
65 H 2 Y B S 66 F 2 Y N S 67 H 2.5 Y B S 2007 Vermont Yankee 68 H 2.0 Y B S 2009 Monticello 69 F 2.0 Y B S 2009 Pilgrim 70 F 2.0 Y B S 2009 Vermont Yankee 71 F 2.0 Y B S 2009 Vermont Yankee 2007 Pilgrim - Entry into EOP3 is not discriminatory, it shows in all 72 F 2.0 Y B E four distractors. See if you can add a transition to EOP3 to make it discriminate. Added drywell pressure.
The first and most obvious action (depress manual scram pushbuttons) only appears in choice D. Distractor (b.) can be 73 F 1 X Y N U eliminated because there is only one action in the distractor where the stem says to identify actions. Revised, revalidated Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 74 H 2 Y B S 2009 Pilgrim 75 H 2 Y B S 2011 Pilgrim Second bullet - air samples are in mrem/hour. Is this correct for the 76# H 2.5 Y S N E station? Left Q in mr/hr. Some samples are mr/hr, some DAC.
77 H 2 Y S B S 78 H 2 Y S B S Although the question has a turbine trip in it, the question doesn't 79# H 2 N R B U deal with the turbine trip, it deals with a loss of air to containment.
Also, not an SRO question. Replaced, revalidated Q Change the stem to The CRS will direct operators to Q was 80 H 2.5 Y R B E swapped with Q64 that was an SRO Q. Changed to E.
No correct answer. ED is required when the setpoint is reached in 81 H 2.0 Y S B S U the EOPs. Licensee provided information from BWROG showing the answer is correct. Changed to S.
82# H 2.0 Y S B S 83 H 2.5 Y S B S 84 H 2.5 Y S B S Change question so SRO declares operability (ROs have to 85# H 2.0 Y S N E recognize inoperability.) Revised, revalidated Q.
86 H 2.0 Y S N S 87 H 2.0 Y S B S 88# H 2.5 Y S N S It appears that 5 distractors have been submitted for this question.
89 H 2.0 Y S N S E Delete an incorrect distractor. Examiner copy of Q was flawed.
Only 4 distractors provided. Changed to S.
90 H 2.0 Y S N S 91# H 2.0 Y S B S Need info to determine if this is an SRO question or an AO question.
92 H 2.0 Y N B U Replaced, revalidated Q.
93 H 2.0 Y S B S 94# H 2.0 Y S B S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 H 2.0 Y S B S 96 H 2.5 Y S B S 97 H 2.0 Y S B S Not an SRO Question. the RO should know what to do under the given circumstances; the technical specification call is above the 98 H 2.0 Y N B S U double line, i.e., the RO should know this information. VY doesnt have standardized TS. Determined the Q is acceptable as is with their TS. Changed to S.
99 F 2.0 Y S B S 100 H 2.0 Y S B S