ML110460706
| ML110460706 | |
| Person / Time | |
|---|---|
| Site: | Kewaunee  |
| Issue date: | 02/11/2011 |
| From: | Walton R Operations Branch III |
| To: | |
| References | |
| ES-401-9 | |
| Download: ML110460706 (7) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
F 3
X N
E Added light to 4th & 5th bullets in stem of question to be consistent.
2 H
3 X
B S
3 H
3 X
N S
4 H
3 X
B S
5 H
3 X
M S
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
A + in the Q# column indicates that question was reviewed as part of the representative sample of 30 questions.
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 6
H 2
X B
S 7
H 2
X N
S 8
F 2
X N
S 9
H 2
X N
S Last sentence in distractor C justification states PT-429 failed low causes PORV B not to open. But it doesnt open since selector switch is in 2-1 position? Why is distractor B incorrect? Justification doesnt make sense since PT449 is unaffected by stem condition.
RE: Requires both PT449 and PT429 greater than setpoint to open PORVs. Selector sw is not relevant to Distractor c.
10 H
3 X
N S
11 F
3 X
N S
12 F
2 X
N S
13 F
2 X
B S
14 H
3 X
N S
15 H
2 X
B S
16 H
2 X
N E
Added 2nd set of bullets to stem of question to inhibit possible no correct answer response by applicants more versed in law than procedure adherence! (Licensee idd).
17 H
3 X
B S
18 H
3 X
N S
19 H
3 X
N E
Added correct designator of switch to distracters in lieu of using short hand designator.
20 F
2 X
N S
Do not have references that isolate SG with leakage >100 gpd! RE:
AOP RC-004, requires isolate SG with leakage >100 gpd. Reference missing. Will provide step in procedure.
21 H
3 X
N S
Is P2 Permissive light lit due to power at 7% or due to N-35 failure?
P2 lit due to less than 7%. Ran on simulator.
22 F
3 X
N S
23 F
2 X
N S
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 24 F
2 X
N S
25 H
2 X
N S
26 H
2 X
N S
27 F
2 X
N S
28 F
2 X
M S
Bordering on too easy!
29 H
2 Y
N S
30 F
2 Y
N S
31 H
3 Y
N S
32 H
4 Y
N S
Most difficult! Are annunciator lights out due to loss of power or due to component positioning? Bottom 6 rows unaffected. Delete? Was this validated on simulator? Is there a B Ctmt Isol Panel not shown?
RE: Yes, run on simulator! This is a status panel, operators look at entire panel, not just upper rows. Keep Q as is.
33 H
2 Y
N S
Are Ctmt Spray & Ctmt Fan Coil Units ECCS? RE: Yes, credited ECCS sources for lowering containment pressure post accident.
34 H
3 Y
N S
35 H
2 Y
N S
Chg Pump 1B stopped by SI? RE: Yes auto inhibited during SI.
36 F
2 Y
N S
At what rad level does CCW surge tank vent line auto close? RE:
CCW Vent line used to close on rad alert but function disabled.
37 H
3 Y
B E
Corrected pzr spray valve designators - added PS-1B.
38 F
2 Y
B S
39 F
2 Y
M S
40 H
3 Y
N S
41 H
3 N
N U
Are there instrument indications for this system? Mismatch on K/A.
RE: SW Shroud Cooling coils are in containment and are isolated during an accident. RE: Changed stem and Made into a 2-part question, for ctmt press and temp and/or rate of rise..
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 42 H
3 Y
N E
Distractor B is not plausible, must be changed! RE: Changed distractor to reference load shed and sequencer (incorrect distractor).
43 F
3 Y
N S
44 F
3 Y
M S
45 H
3 Y
N S
46 F
2 Y
N S
47 F
2 X
Y B
S Stem states 221 amp-hrs. Reference states battery is rated for 221 amps for 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />. Discharge rate should be ~27 amps for 8 hrs? RE:
Licensee validators had no problem with units. Keep Q as is.
48 F
3 X
Y B
E C distractor, what does BRA-102 have to do with BRA112 since it indirectly feeds the stand-by source. Is BRA 102 in distractor a typo for BRA 112. RE: No typo, BRA 102 supplies stand by source. Keep Q as is.
49 H
2 Y
M S
50 F
2 Y
B S
51 H
3 Y
N S
52 H
3 X
Y N
E Change should to musts? Distractor A could be construed as being correct since CW pumps trip if forebay level is <64%? RE: No, CW pumps auto trip at 42% level. Distractor A still incorrect.
Changed shoulds to shalls.
53 H
2 Y
N S
54 F
2 Y
B S
55 F
2 Y
N E
Capitalize both and and. RE: Done.
56 F
2 Y
N S
57 H
3 Y
N S
58 F
2 Y
N S
59 F
2 Y
B S
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 60 H
3 Y
N S
Not in A2 format. RE: Rereviewed and determined that distracters included A2 format. Changed incorrect distractor c from release to environment to release to the Aux Bldg to prevent possible 2 correct answer.
61 F
2 Y
N S
62 H
2 Y
M S
63 F
2 Y
B S
64 F
3 Y
X N
U S
ROs not required to know basis to TS. RE: Question asking RO knowledge of components of TS not TS basis. What is purpose could be used as a substitute. RE: Changed references to UFSAR.
65 H
3 Y
X N
U S
ROs not required to know basis to TS. RE: Question asking RO knowledge of components of TS not TS basis. What is purpose could be used as a substitute. RE: Changed references to UFSAR.
66 H
3 Y
N S
67 F
2 Y
N S
68 F
3 Y
N U
Diesel Fire pump can be monitored from DSP but not operated from DSP. Removed Fire Pump from distractor A to prevent against no correct answer. (licensee idd unsat) 69 H
3 Y
N S
Why the need to bring Time into stem? Why not use terms of highest mode? And eliminate third column. RE: Wanted distracters to be more plausible by adding time dimension. Question draws from Mode (temp dependent), LCO ( Pressure dependent) and Time from LCO 3.0.3. Keep Q as is.
70 F
2 Y
N S
71 F
3 Y
B S
72 F
2 N
B U
This is a rad posting question. Does not meet K/A for exposure limits! RE: Replaced Q.
73 F
3 Y
N S
74 F
2 Y
N S
75 H
3 Y
N S
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S1 H
3 Y
Y B
S S2 F
3 Y
Y N
S S3 H
3 Y
Y N
S S4 H
3 Y
Y N
S S5 H
3 Y
Y N
S S6 H
3 Y
Y N
E Changed distractor D since temps could reach FR-C1 transition.
Changed to transition to FR-C2 (still the incorrect distractor).
S7 F
2 Y
Y M
S S8 H
3 Y
Y N
S S9 H
3 Y
Y N
S S10 H
2 Y
Y N
S S11 H
3 Y
Y N
S Are references provided? RE: No references provided.
S12 H
3 Y
Y N
S S13 H
3 Y
Y N
S S14 H
2 Y
Y N
S S15 F
3 N
Y N
U Does not meet intent of K/A, Notification of offsite authorities. RE:
Needs to be addressed. Reselected K/A since no notifications for ctmt. Repicked electrical distribution K/A.
S16 H
3 Y
Y M
E Do you need to add, Rx trip without SI to stem? RE: Received no comments from validators on need to add comment. But added no SI occurred to new last bullet in stem.
S17 H
2 Y
Y M
S S18 H
3 Y
Y N
S D distractor not plausible since cant go from E-2 to ECA 3-1. How about using E-0 Fold out page to isolate FW to SG. Statement would be incorrect since SG Levels not rising in an uncontrolled manner.
RE: Even though not possible to transition to ECA 3-1 from E-2, could be possible for someone who doesnt understand transitions.
Leave Q as is.
ES-401 Written Examination Review Worksheet Form ES-401-9 KEWAUNEE 2011 Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S19 H
3 Y
Y N
S S20 F
3 Y
Y B
S Added, In an emergency.. to stem and added, to protect public safety to distractor A.
S21 H
3 Y
Y B
S S22 F
2 Y
Y N
S Changed grammar in stem of question.
S23 H
2 Y
Y N
S S24 H
3 Y
Y M
S Changed status of refueling personnel in stem S25 H
3 Y
Y N
S Dont need second part of question to answer correctly. RE: Second part of question added as a result of validation. Removed references to time and revalidated. Discussed with EP folks, OK.