ML19099A118
| ML19099A118 | |
| Person / Time | |
|---|---|
| Site: | Columbia  |
| Issue date: | 03/07/2019 |
| From: | Greg Werner Operations Branch IV |
| To: | Energy Northwest |
| References | |
| Download: ML19099A118 (16) | |
Text
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3
- 1.
LOK
- 2.
LOD 6
7 Ans Letter CFR 8
Q#
(F/H)
(1-5) stem focus cueing T/F cred dist partial job link minutia
- /
units back-ward K/A SRO-only B/M/N U/E/S A/B/C/D 55.41 55.43 Explanation All Comments Resolved 1
F 3
N S
A 10 2
H 2
N S
C 7
3 H
2 N
S B
10 4
F 2
N S
A 5
5 H
2 N
S C
7 6
H 3
N S
C 10 7
H 2
N S
A 14 8
F 2
B S
B 3
9 F
4 N
S A
8 10 H
3 N
S B
6 11 H
3 N
S D
8 12 H
3 N
S C
10 13 H
2 N
S A
7 14 F
2 B
S C
8 15 F
2 M
S A
7 16 H
2 N
S D
7 17 F
2 N
S D
10 18 F
2 B
S C
12 19 F
2 N
S C
8 20 F
3 N
S B
5 21 H
3 B
S A
10 22 F
2 N
S B
4
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 to 5 (easy to difficult) rating scale (questions in the 2 to 4 range are acceptable).
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 23 F
3 N
S D
10 24 H
3 N
S C
6 25 F
2 N
S B
10 26 F
3 N
S B
10 27 H
3 N
S D
13 28 H
2 B
S A
10 29 H
3 N
S A
10 30 H
2 N
S B
8 31 H
3 N
S A
8 32 H
3 N
S B
1 33 H
2 B
S A
5 34 F
3 N
S C
11 35 H
2 N
S A
7 36 H
2 B
S D
7 37 H
3 N
S C
4 38 H
3 N
S D
8 39 F
2 B
S C
9 40 H
2 B
S A
5 41 F
3 N
S B
10 42 F
3 B
S A
13 43 F
2 N
S C
4 44 H
3 N
S D
4 45 F
2 N
S D
4 46 H
3 N
S C
7 47 H
2 N
S A
4 48 F
2 B
S C
4 49 F
3 N
S B
8 50 H
2 N
S A
6 51 H
3 B
S D
7 52 H
3 B
S B
7
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 53 F
2 N
S B
8 54 F
2 B
S C
6 55 F
2 N
S D
6 56 H
3 N
S B
2 57 H
2 N
S A
9 58 F
3 N
S C
8 59 H
2 M
S A
12 60 H
3 M
S A
5 61 H
3 N
S B
5 62 F
2 N
S B
4 63 F
3 N
S B
13 64 H
3 N
S A
11 65 H
3 N
S C
4 66 F
2 N
S B
10 67 H
2 N
S C
13 68 F
2 N
S C
6 69 F
2 N
S B
1 70 H
3 N
S B
10 71 H
2 N
S C
10 72 F
2 N
S D
11 73 F
2 N
S A
12 74 F
2 N
S C
10 75 F
2 N
S A
10 76 H
3 N
S D
5 77 H
3 M
S A
5 78 H
3 N
S A
5 79 H
3 N
S D
5 80 H
2 N
S C
4 81 H
3 N
S A
5 82 F
4 N
S D
5
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 83 F
2 N
S A
2 84 F
3 N
S B
5 85 H
2 N
S D
5 86 H
3 N
S C
5 87 F
3 B
S A
2 88 H
3 N
S C
2 89 H
2 N
S B
2 90 H
3 N
S B
5 91 F
3 B
S A
7 92 H
2 N
S D
5 93 F
2 N
S B
2 94 F
2 B
S C
5 95 H
4 B
S A
5 96 F
2 N
S D
3 97 F
3 B
S D
2 98 H
2 N
S B
4 99 F
2 N
S D
1 100 H
3 N
S C
5 Results Table RO LOK -H 40 Avg RO LOD 2.45 Flaws 10 CFR Distribution RO LOK-F 35 AVG SRO LOD 2.68 Stem focus 0
41(b)1 2
43(b)1 1 SRO LOK - H 15 Overall LOD 2.51 Cues 0
41(b)2 1
43(b)2 6 SRO LOK - F 10 T/F 0
41(b)3 1
43(b)3 1 Cred Dist 0
41(b)4 9
43(b)4 2 RO Bank 14 18.67 SRO Bank 5
20 Partial 0
41(b)5 6
43(b)5 14 RO Mod 3
4 SRO Mod 1
4 job link 0
41(b)6 6
43(b)6 0 RO New 58 77.33 SRO New 19 76 units 0
41(b)7 10 43(b)7 1 minutia 0
41(b)8 10
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 Total Bank 19 19 backward 0
41(b)9 2
Total Mod 4
4 KA 0
41(b)1 17 Total New 77 77 SRO-only 0
41(b)1 3
LOD = 1 0
41(b)1 3
RO Sat 75 100 SRO Sat 25 100 41(b)1 4
RO Unsat 0
0 SRO Unsat 0
0 Answer Dist ( in %)
41(b)1 1
RO Edit 0
0 SRO Edit 0
0 RO-A 22 SRO-A 7
RO-B 20 SRO-B 5
Total Sat 100 100 Total Unsat 0
0 RO-C 21 SRO-C 5
Total Edit 0
0 RO-D 12 SRO-D 8
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3
- 1.
LOK
- 2.
LOD 6
7 Ans Letter CFR 8
Q#
(F/H)
(1-5) stem focus cueing T/F cred dist partial job link minutia
- /
units back-ward K/A SRO-only B/M/N U/E/S A/B/C/D 55.41 55.43 Explanation 1
F 3
N S
A 10 2
H 2
N S
C 7
The plausibility statement for B appears to be incorrect. The alternate battery charger should be E-C1-1B instead of 2A.
3 H
2 X
N E
B 10 C doesn't seem credible because the stem does not have any information on degraded voltage. How could you remain operating while getting an auto transfer to TR-S 4
F 2
X N
E A
5 I'm concerned that D could be correct on appeal. Should we bound initially to be over the next 5 minutes?
5 H
2 N
S C
7 6
H 3
N S
C 10 7
H 2
N S
A 14
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 to 5 (easy to difficult) rating scale (questions in the 2 to 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- a. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- b. The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- c. The answer choices are a collection of unrelated true/false statements.
- d. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- e. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 8
F 2
B E
B 3
Too close to question 22. It is overlap to have inboard MSIV as a distractor on both a loss of CIA and loss of CAS. Do feedwater control valves use CAS? If so could change C to affect on feedwater flow.
9 F
4 X
X X
N U
A 8
B and D are also correct. For B since you can't open RHR-V-8 you won't be able to get SDC in service so you will exceed 200F eventually. An applicant can assume that alternate SDC can't be placed in service until after 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> making B correct. For D an applicant can assume RHR-V-8 cannot be opened so without SDC it will exceed 200F eventually.
10 H
3 N
E B
6 For the second part in C and D I think an endpoint of whenever the shorting links are reinstalled should be added.
11 H
3 N
S D
8 12 H
3 N
E C
10 For C should it read "an automatic reactor scram setpoint has been reached"? Does this fit better with what the question is asking?
13 H
2 N
S A
7 14 F
2 B
S C
8 15 F
2 X
M E
A 7
The mode of operation isn't necessary for answering the question. I believe it should be removed.
16 H
2 N
S D
7 Changed to higher cognitive level.
17 F
1 N
S D
10 18 F
2 B
S C
12
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 19 H
2 X
X N
E B
8 Two answers talk about leaving the area, one talks about remaining on station, and the other (A) alludes to remaining on station.
Doesn't seem plausible to shut off air in an area that's IDLH. Cueing issue with having Immediately in the stem and the answer.
20 F
3 N
E B
5 Change A to 59.5 Hz to match the alarm setpoint 21 H
3 X
B U
A 10 I don't see how it is a given that you are in ABN-BACKPRESSURE. Entry condition is unexpected rise in backbpressure, and the stem does not state why the DEH WARNING is alarming. C also appears to be correct.
Since you haven't reached the setpoint you could still start a circ water pump even if it won't do any good. This could be overturned on appeal. Could give expected SJAE information in the stem and replace C with Shift to standby SJAE.
22 F
2 N
S B
4 Too close to question 8. It is overlap to have inboard MSIV as a distractor on both a loss of CIA and loss of CAS. Too easy to eliminate in one of the two 23 F
2 N
E D
10 Free Review question. Still marked as a F/2.
24 H
3 X
N E
C 6
While it is expected that steam dome pressure would be above 900 psi, one could argue that you are making assumptions not stated in the question by assuming it is above 900 psig.
Could be fixed by a general statement that alll other parameters are normal. A doesn't seem credible. Could use 1205 or 1220 as a distractor. 1220 is preferred.
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 25 F
2 N
S B
10 26 F
4 X
X N
U B
10 This K/A is looking at equipment qualifications and whether or not equipment will work if exceeded. Also could argue no correct answer. B is correct only if the two areas are a result of spreading temps. If the high temps are due to rooms that don't communicate with each other the basis isn't met.
27 H
3 N
E B
13 The structure of this question is very confusing. It appears to be asking two questions, but it looks like the distractors are answering the second part first. If this is asking two questions, set up as a 2x2, and put in (1) and (2) in the distractors 28 H
2 M
E A
10 Part 1 is asking if the breaker closes in A and B, but talks about the pump in C and D. I would changed part 1 of C and D to something like, "the breaker must be manually closed." This may move it closer to being a bank question.
29 H
3 X
N E
A 10 Should add in accordance with and the applicable procedure to the stem for challenge purposes.
30 H
2 N
E B
8 Is manual override lit for the pump and injection valve? Will it change the answer if or if not lit?
31 H
3 N
E A
8 A negative answer is not allowed on initial exams. Changed to higher cognitive level.
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 32 H
3 X
X N
U D
1 All rods in is always the correct answer. The K/A isn't matched because the reason for injecting that much boron isn't being tested.
Could ask how much boron to inject for CSBW and the reason why to meet the K/A.
33 H
2 B
S A
5 34 F
3 X
N E
C 11 "On scale for any range switch position" isn't credible. Would GT 40/125 on range 7 work?
Also the power ranges should 3% and 5%.
10% power is too high.
35 H
2 X
N U
C 7
The question is confusing. It looks like backwards logic. Ask "The alarm was received because" "A rod block is/is not generated" Maybe need to ask the second part first.
36 H
2 B
S D
7 37 H
3 N
S C
4 38 H
3 N
E D
8 Switch the choices of 1 and 3. It's unusual to put div 2 before div 1 in answer choices.
39 F
2 B
E C
9 Add MSIVs will not close to A 40 H
2 B
S A
5
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 41 F
3 N
S B
10 How low did reactor water level go, and what brought it back up? The fact that RPV level is at +33 inches tells me something had to feed it to that level, after shrink, and it wasn't RFW.
Since B and C have you arm and depress, that signifies to me that RCIC and HPCS are not running, so you did not get to level 2 before level recovered. So what fed the RPV back up? CRD should still be running but would it be expected to recover level and not maintain? This look like implausible physics 42 F
3 X
B E
A 13 The FSAR lists the fans as primary and backup. What are the official names of the fans and valves? D should be a combination of 3A1 and 5A1 to be consistent with the other answers.
43 F
2 X
N E
C 4
(3) isn't plausible. I think SL 85 or 82 would be a good replacement.
44 H
3 N
S D
4 45 F
2 N
S D
4 46 H
3 N
S C
7 Free Review 47 H
2 X
N E
A 4
Restating CIA-V-39A is open isn't necessary for the question 48 F
2 B
S C
4 49 F
3 N
S B
8 I think (3) can easily be eliminated since the stem specifically states that the MSIVs are closed. Is it possible to set the stem up so that the MSIVs would have to be closed, without explicitly stating such?
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 50 H
2 X
N U
A 6
It appears that all IRM failures bring in INOP TRIP. For the first part of the question you need to discuss other failure modes that would not bring in the alarm. The second part of the K/A talks about using procedures. For the RO you need to state IAW... in the stem to match the K/A.
51 H
3 B
S D
7 52 H
3 B
S B
7 53 F
2 X
N U
B 8
Not meeting the K/A because there is no parameter change. Needs to be closer to question 51. Could ask once the limit is exceeded if the diesel is running at full/idle speeds.
54 F
2 B
S C
6 Changed to a memory question.
55 F
2 N
E D
6 The double period looks odd in distractor C.
Maybe use double plus instead.
56 H
3 N
S B
2 57 H
2 N
E A
9 You have 3 uses of TIP-V-1 and one of TIP-V-
- 7. Try to balance the use of the 2. Also, since TIP-V-7 only operates on a group isolation add info in the stem on group isolations that have occurred that don't include TIP-V-7 58 F
3 N
E C
8 Pressure is too high for the 42B to be plausible. Make pressure 500 psig.
59 H
2 M
S A
12 60 H
3 M
S A
5 61 H
3 N
S B
5 Revised free review question.
62 F
2 N
S B
4 63 F
3 N
S B
13 64 H
3 N
S A
11
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 65 H
3 X
N E
C 4
Why is it necessary to tell the applicant the transmitter inputs to the controller? Eliminate the parenthetical information about the transmitter providing input to the controller.
That should be known information for the operator.
66 F
2 N
E B
10 add 'and' after "N/A". Don't capitalize the first letter in the distractors.
67 H
2 N
E C
13 (1) seems too obvious. Consider using control rods not fully inserted in a cell.
68 F
2 N
S C
6 69 F
2 X
N U
B 1
This question shows the ability to monitor while doing control manipulation. Could ask when single rod notching is required during a startup, if those requirements exist.
70 H
3 X
N U
B 10 Too HPCS focused to be a tier 3 question.
71 H
2 N
S C
10 72 F
2 N
S D
11 73 F
2 X
N E
A 12 Don't need any of the RCIC information for the question. Could simplify by saying an individual needs to go through a LHRA to respond to an equipment problem in a RA during an emergency.
74 F
2 N
S C
10 75 F
2 N
S A
10 76 H
3 N
S D
5 Free Review 77 H
3 M
S A
5 78 H
3 N
S A
5 79 H
3 X
N E
D 5
Should power and RPV level be added to the stem so they know they've reduced power by lowering level and can maintain level with systems other than booster pumps?
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 80 H
2 N
S C
4 81 H
3 N
S A
5 Free Review 82 F
4 N
E D
5 Add 'until it isolates on low pressure.' to match D. In the plausibility statement for B and C add information that swapping to LPCS when it will exceed its temperature vortex limit should not be done.
83 F
2 N
S A
2 84 F
3 N
E B
5 Should distractor A be "Place the reactor mode switch in the shutdown position" since that is what the tech spec statement is?
85 H
2 N
S D
5 86 H
3 N
E C
5 Consider changing wetwell level to 17 feet and up slow. This makes for better distractors B and D, as the wetwell is below the NPSH limit for RCIC, but still above that for the RHR pumps.
87 F
3 B
E A
2 Worksheet states that B is the correct answer, but the distractor analysis states that A is the correct answer.
88 H
3 N
E C
2 By providing the tech spec as a reference, part 2 is appears to be direct lookup, enabling B and D to be easily eliminated. Since "by time = 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br />" is in all four distractors, move to the stem. There is a font difference in distractors B and D 89 H
2 N
S B
2 90 H
3 X
X N
U B
5 I don't see procedure selection. Also, when would you not start both pumps during an ATWS when SLC is required.
91 F
3 B
S A
7 Free Review 92 H
2 N
S D
5
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 93 F
2 N
S B
2 Free Review 94 F
2 B
S C
5 Free Review 95 H
4 B
S A
5 96 F
2 N
S D
3 97 H
3 X
B U
B 2
Not a generic 98 H
2 X
N U
B 4
Not generic. The K/A is asking to determine what monitors are used during a given situation. Such as what procedure determines who can waive monitoring for entering the control room during an emergency.
99 F
2 N
S D
1 100 H
3 N
S C
5 Results Table RO LOK -H 41 Avg RO LOD 2.44 Flaws 10 CFR Distribution RO LOK-F 34 AVG SRO LOD 2.68 Stem focus 7
41(b)1 2
43(b)1 1 SRO LOK - H 16 Overall LOD 2.5 Cues 2
41(b)2 1
43(b)2 6 SRO LOK - F 9
T/F 1
41(b)3 1
43(b)3 1 Cred Dist 6
41(b)4 9
43(b)4 2 RO Bank 13 17.33 SRO Bank 5
20 Partial 4
41(b)5 6
43(b)5 14 RO Mod 4
5.333 SRO Mod 1
4 job link 0
41(b)6 6
43(b)6 0 RO New 58 77.33 SRO New 19 76 units 0
41(b)7 10 43(b)7 1 minutia 0
41(b)8 10 Total Bank 18 18 backward 1
41(b)9 2
Total Mod 5
5 KA 9
41(b)1 17 Total New 77 77 SRO-only 1
41(b)1 3
LOD = 1 1
41(b)1 3
RO Sat 38 50.67 SRO Sat 16 64 41(b)1 4
RO Unsat 9
12 SRO Unsat 3
12 Answer Dist ( in %)
41(b)1 1
ES-401 CGS-2019-02 Written Examination Review Worksheet Form ES-401-9 a Rev 3 RO Edit 28 37.33 SRO Edit 6
24 RO-A 21 SRO-A 7
RO-B 21 SRO-B 6
Total Sat 54 54 Total Unsat 12 12 RO-C 21 SRO-C 5
Total Edit 34 34 RO-D 12 SRO-D 7